2023-09-21T12:27:07.790 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-21T12:27:07.792 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} --archive /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862 --owner scheduled_leonidus@teuthology --verbose --name leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi -- /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/orig.config.yaml 2023-09-21T12:27:07.847 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T12:27:07.939 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862 branch: wip-lusov-config-format description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} email: null first_in_suite: false job_id: '7399862' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-lusov-config-format ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 41c9e835c3f621102ade35dd597317a42116a491 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 41c9e835c3f621102ade35dd597317a42116a491 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-config-format sha1: 41c9e835c3f621102ade35dd597317a42116a491 owner: scheduled_leonidus@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8407 sha1: 41c9e835c3f621102ade35dd597317a42116a491 sleep_before_teardown: 0 subset: 111/10000 suite: fs suite_branch: wip-lusov-config-format suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 41c9e835c3f621102ade35dd597317a42116a491 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi142.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi156.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-20_16:32:45 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-21T12:27:07.940 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa; will attempt to use it 2023-09-21T12:27:07.942 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks 2023-09-21T12:27:07.943 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-21T12:27:07.944 INFO:teuthology.task.internal:Checking packages... 2023-09-21T12:27:08.002 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '41c9e835c3f621102ade35dd597317a42116a491' 2023-09-21T12:27:08.002 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-21T12:27:08.002 INFO:teuthology.packaging:ref: None 2023-09-21T12:27:08.003 INFO:teuthology.packaging:tag: None 2023-09-21T12:27:08.003 INFO:teuthology.packaging:branch: wip-lusov-config-format 2023-09-21T12:27:08.003 INFO:teuthology.packaging:sha1: 41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:27:08.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-lusov-config-format 2023-09-21T12:27:08.233 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6168.g41c9e835 2023-09-21T12:27:08.234 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-21T12:27:08.241 INFO:teuthology.task.internal:no buildpackages task found 2023-09-21T12:27:08.241 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-21T12:27:08.257 INFO:teuthology.task.internal:Saving configuration 2023-09-21T12:27:08.277 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-21T12:27:08.283 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T12:27:08.309 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.622250', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T12:27:08.336 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.620549', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T12:27:08.359 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.618630', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T12:27:08.359 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-21T12:27:08.366 INFO:teuthology.task.internal:roles: ubuntu@smithi142.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-09-21T12:27:08.366 INFO:teuthology.task.internal:roles: ubuntu@smithi156.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-09-21T12:27:08.366 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-09-21T12:27:08.366 INFO:teuthology.run_tasks:Running task console_log... 2023-09-21T12:27:08.498 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ec534bc10>, signals=[15]) 2023-09-21T12:27:08.499 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-21T12:27:08.505 INFO:teuthology.task.internal:Opening connections... 2023-09-21T12:27:08.506 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:27:08.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:27:08.615 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi156.front.sepia.ceph.com 2023-09-21T12:27:08.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:27:08.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2023-09-21T12:27:08.686 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:27:08.749 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-21T12:27:08.756 DEBUG:teuthology.orchestra.run.smithi142:> uname -m 2023-09-21T12:27:08.779 INFO:teuthology.orchestra.run.smithi142.stdout:x86_64 2023-09-21T12:27:08.779 DEBUG:teuthology.orchestra.run.smithi142:> cat /etc/os-release 2023-09-21T12:27:08.837 INFO:teuthology.orchestra.run.smithi142.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T12:27:08.837 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T12:27:08.838 INFO:teuthology.orchestra.run.smithi142.stdout:ID="rhel" 2023-09-21T12:27:08.838 INFO:teuthology.orchestra.run.smithi142.stdout:ID_LIKE="fedora" 2023-09-21T12:27:08.838 INFO:teuthology.orchestra.run.smithi142.stdout:VERSION_ID="8.6" 2023-09-21T12:27:08.839 INFO:teuthology.orchestra.run.smithi142.stdout:PLATFORM_ID="platform:el8" 2023-09-21T12:27:08.839 INFO:teuthology.orchestra.run.smithi142.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T12:27:08.839 INFO:teuthology.orchestra.run.smithi142.stdout:ANSI_COLOR="0;31" 2023-09-21T12:27:08.839 INFO:teuthology.orchestra.run.smithi142.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T12:27:08.840 INFO:teuthology.orchestra.run.smithi142.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T12:27:08.840 INFO:teuthology.orchestra.run.smithi142.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T12:27:08.840 INFO:teuthology.orchestra.run.smithi142.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T12:27:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:27:08.841 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T12:27:08.841 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T12:27:08.841 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T12:27:08.841 INFO:teuthology.orchestra.run.smithi142.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T12:27:08.842 INFO:teuthology.lock.ops:Updating smithi142.front.sepia.ceph.com on lock server 2023-09-21T12:27:08.867 DEBUG:teuthology.orchestra.run.smithi156:> uname -m 2023-09-21T12:27:08.887 INFO:teuthology.orchestra.run.smithi156.stdout:x86_64 2023-09-21T12:27:08.888 DEBUG:teuthology.orchestra.run.smithi156:> cat /etc/os-release 2023-09-21T12:27:08.947 INFO:teuthology.orchestra.run.smithi156.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T12:27:08.947 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T12:27:08.948 INFO:teuthology.orchestra.run.smithi156.stdout:ID="rhel" 2023-09-21T12:27:08.948 INFO:teuthology.orchestra.run.smithi156.stdout:ID_LIKE="fedora" 2023-09-21T12:27:08.948 INFO:teuthology.orchestra.run.smithi156.stdout:VERSION_ID="8.6" 2023-09-21T12:27:08.948 INFO:teuthology.orchestra.run.smithi156.stdout:PLATFORM_ID="platform:el8" 2023-09-21T12:27:08.948 INFO:teuthology.orchestra.run.smithi156.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T12:27:08.949 INFO:teuthology.orchestra.run.smithi156.stdout:ANSI_COLOR="0;31" 2023-09-21T12:27:08.949 INFO:teuthology.orchestra.run.smithi156.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T12:27:08.949 INFO:teuthology.orchestra.run.smithi156.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T12:27:08.949 INFO:teuthology.orchestra.run.smithi156.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T12:27:08.949 INFO:teuthology.orchestra.run.smithi156.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T12:27:08.950 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:27:08.950 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T12:27:08.950 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T12:27:08.950 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T12:27:08.950 INFO:teuthology.orchestra.run.smithi156.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T12:27:08.951 INFO:teuthology.lock.ops:Updating smithi156.front.sepia.ceph.com on lock server 2023-09-21T12:27:08.975 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2023-09-21T12:27:08.996 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2023-09-21T12:27:08.996 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2023-09-21T12:27:09.053 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="Red Hat Enterprise Linux" 2023-09-21T12:27:09.053 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="8.6 (Ootpa)" 2023-09-21T12:27:09.054 INFO:teuthology.orchestra.run.smithi160.stdout:ID="rhel" 2023-09-21T12:27:09.054 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="fedora" 2023-09-21T12:27:09.054 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="8.6" 2023-09-21T12:27:09.054 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el8" 2023-09-21T12:27:09.055 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-21T12:27:09.055 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2023-09-21T12:27:09.055 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-21T12:27:09.055 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://www.redhat.com/" 2023-09-21T12:27:09.055 INFO:teuthology.orchestra.run.smithi160.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-21T12:27:09.056 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-21T12:27:09.056 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:27:09.056 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-21T12:27:09.056 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-21T12:27:09.057 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-21T12:27:09.057 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-21T12:27:09.057 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2023-09-21T12:27:09.074 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-21T12:27:09.085 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-21T12:27:09.091 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-21T12:27:09.092 DEBUG:teuthology.orchestra.run.smithi142:> test '!' -e /home/ubuntu/cephtest 2023-09-21T12:27:09.094 DEBUG:teuthology.orchestra.run.smithi156:> test '!' -e /home/ubuntu/cephtest 2023-09-21T12:27:09.097 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2023-09-21T12:27:09.116 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-21T12:27:09.122 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-21T12:27:09.122 DEBUG:teuthology.orchestra.run.smithi142:> test -z $(ls -A /var/lib/ceph) 2023-09-21T12:27:09.154 DEBUG:teuthology.orchestra.run.smithi156:> test -z $(ls -A /var/lib/ceph) 2023-09-21T12:27:09.157 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2023-09-21T12:27:09.186 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-21T12:27:09.264 INFO:teuthology.run_tasks:Running task kernel... 2023-09-21T12:27:09.280 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-09-21T12:27:09.281 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-09-21T12:27:09.282 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-09-21T12:27:09.283 DEBUG:teuthology.orchestra.run.smithi142:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-21T12:27:09.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:27:09.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-09-21T12:27:09.571 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-21T12:27:09.572 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-09-21T12:27:09.572 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-09-21T12:27:09.592 INFO:teuthology.orchestra.run.smithi142.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-21T12:27:09.592 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-21T12:27:09.593 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-09-21T12:27:09.594 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum upgrade -y linux-firmware 2023-09-21T12:27:10.789 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-09-21T12:27:10.789 INFO:teuthology.orchestra.run.smithi142.stdout:Unable to read consumer identity 2023-09-21T12:27:12.266 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 13 kB/s | 3.5 kB 00:00 2023-09-21T12:27:13.291 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-09-21T12:27:16.833 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 422 kB/s | 24 kB 00:00 2023-09-21T12:27:17.592 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-21T12:27:17.593 INFO:teuthology.orchestra.run.smithi142.stdout:Nothing to do. 2023-09-21T12:27:17.594 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-21T12:27:17.722 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-21T12:27:17.722 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-09-21T12:27:17.864 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-09-21T12:27:17.865 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-09-21T12:27:17.867 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi142.front.sepia.ceph.com to complete... 2023-09-21T12:27:30.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21 12:27:30 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-09-21T12:27:30.691 INFO:teuthology.orchestra.run.smithi142.stderr:FINISHED --2023-09-21 12:27:30-- 2023-09-21T12:27:30.691 INFO:teuthology.orchestra.run.smithi142.stderr:Total wall clock time: 13s 2023-09-21T12:27:30.691 INFO:teuthology.orchestra.run.smithi142.stderr:Downloaded: 1 files, 363M in 13s (28.9 MB/s) 2023-09-21T12:27:30.692 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-09-21T12:27:30.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-09-21T12:27:32.280 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying... ######################################## 2023-09-21T12:27:32.345 INFO:teuthology.orchestra.run.smithi142.stdout:Preparing... ######################################## 2023-09-21T12:27:32.432 INFO:teuthology.orchestra.run.smithi142.stdout:Updating / installing... 2023-09-21T12:28:10.673 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-09-21T12:28:36.884 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi142.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-09-21T12:28:36.885 DEBUG:teuthology.orchestra.run.smithi142:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-09-21T12:28:36.981 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:36.982 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:36.982 INFO:teuthology.orchestra.run.smithi142.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:36.982 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:36.982 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-09-21T12:28:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-09-21T12:28:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-09-21T12:28:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-09-21T12:28:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-09-21T12:28:36.983 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-09-21T12:28:36.984 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-09-21T12:28:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-09-21T12:28:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-09-21T12:28:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-09-21T12:28:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-09-21T12:28:36.985 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-09-21T12:28:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-09-21T12:28:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-09-21T12:28:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-09-21T12:28:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-09-21T12:28:36.986 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-09-21T12:28:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-09-21T12:28:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-09-21T12:28:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-09-21T12:28:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-09-21T12:28:36.987 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-09-21T12:28:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-09-21T12:28:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-09-21T12:28:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-09-21T12:28:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-09-21T12:28:36.988 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-09-21T12:28:36.989 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-09-21T12:28:36.990 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-09-21T12:28:36.990 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-09-21T12:28:36.990 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-09-21T12:28:36.990 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-09-21T12:28:36.990 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-09-21T12:28:36.991 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-09-21T12:28:36.991 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-09-21T12:28:36.991 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-09-21T12:28:36.991 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-09-21T12:28:36.991 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-09-21T12:28:36.992 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-09-21T12:28:36.992 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-09-21T12:28:36.992 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-09-21T12:28:36.992 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-09-21T12:28:36.992 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-09-21T12:28:36.993 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-09-21T12:28:36.993 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-09-21T12:28:36.993 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-09-21T12:28:36.993 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-09-21T12:28:36.993 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-09-21T12:28:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-09-21T12:28:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-09-21T12:28:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-09-21T12:28:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-09-21T12:28:36.994 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-09-21T12:28:36.995 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-09-21T12:28:36.995 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-09-21T12:28:36.995 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-09-21T12:28:36.995 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-09-21T12:28:36.995 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-09-21T12:28:36.996 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-09-21T12:28:36.997 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-09-21T12:28:36.997 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-09-21T12:28:36.997 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-09-21T12:28:36.997 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-09-21T12:28:36.997 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-09-21T12:28:36.998 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-09-21T12:28:36.998 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-09-21T12:28:36.998 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-09-21T12:28:36.998 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-09-21T12:28:36.998 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-09-21T12:28:36.999 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-09-21T12:28:36.999 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-09-21T12:28:36.999 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-09-21T12:28:36.999 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-09-21T12:28:36.999 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-09-21T12:28:37.000 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-09-21T12:28:37.000 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-09-21T12:28:37.000 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-09-21T12:28:37.000 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-09-21T12:28:37.000 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-09-21T12:28:37.001 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-09-21T12:28:37.002 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-09-21T12:28:37.002 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-09-21T12:28:37.002 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-09-21T12:28:37.002 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-09-21T12:28:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-09-21T12:28:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-09-21T12:28:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-09-21T12:28:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-09-21T12:28:37.003 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-09-21T12:28:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-09-21T12:28:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-09-21T12:28:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-09-21T12:28:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-09-21T12:28:37.004 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-09-21T12:28:37.005 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-09-21T12:28:37.005 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-09-21T12:28:37.005 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-09-21T12:28:37.005 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-09-21T12:28:37.005 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-09-21T12:28:37.006 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-09-21T12:28:37.007 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-09-21T12:28:37.007 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-09-21T12:28:37.007 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-09-21T12:28:37.007 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-09-21T12:28:37.007 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-09-21T12:28:37.008 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-09-21T12:28:37.008 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-09-21T12:28:37.008 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-09-21T12:28:37.008 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-09-21T12:28:37.008 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-09-21T12:28:37.009 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-09-21T12:28:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-09-21T12:28:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-09-21T12:28:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-09-21T12:28:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-09-21T12:28:37.010 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-09-21T12:28:37.011 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-09-21T12:28:37.011 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-09-21T12:28:37.011 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-09-21T12:28:37.011 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-09-21T12:28:37.011 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-09-21T12:28:37.012 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-09-21T12:28:37.012 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-09-21T12:28:37.012 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-09-21T12:28:37.012 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-09-21T12:28:37.012 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-09-21T12:28:37.013 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-09-21T12:28:37.014 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-09-21T12:28:37.015 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-09-21T12:28:37.015 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-09-21T12:28:37.015 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-09-21T12:28:37.015 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-09-21T12:28:37.016 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-09-21T12:28:37.016 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-09-21T12:28:37.016 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-09-21T12:28:37.016 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-09-21T12:28:37.016 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-09-21T12:28:37.017 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-09-21T12:28:37.017 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-09-21T12:28:37.017 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-09-21T12:28:37.017 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-09-21T12:28:37.017 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-09-21T12:28:37.018 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-09-21T12:28:37.018 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-09-21T12:28:37.018 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-09-21T12:28:37.018 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-09-21T12:28:37.018 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-09-21T12:28:37.019 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-09-21T12:28:37.020 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-09-21T12:28:37.020 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-09-21T12:28:37.020 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-09-21T12:28:37.020 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-09-21T12:28:37.020 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-09-21T12:28:37.021 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-09-21T12:28:37.022 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-09-21T12:28:37.022 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-09-21T12:28:37.022 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-09-21T12:28:37.022 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-09-21T12:28:37.022 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-09-21T12:28:37.023 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-09-21T12:28:37.023 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-09-21T12:28:37.023 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-09-21T12:28:37.023 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-09-21T12:28:37.023 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-09-21T12:28:37.024 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-09-21T12:28:37.024 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-09-21T12:28:37.024 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-09-21T12:28:37.024 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-09-21T12:28:37.024 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-09-21T12:28:37.025 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-09-21T12:28:37.025 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-09-21T12:28:37.025 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-09-21T12:28:37.025 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-09-21T12:28:37.025 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-09-21T12:28:37.026 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-09-21T12:28:37.026 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-09-21T12:28:37.026 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-09-21T12:28:37.026 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-09-21T12:28:37.026 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-09-21T12:28:37.027 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-09-21T12:28:37.027 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-09-21T12:28:37.027 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-09-21T12:28:37.027 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-09-21T12:28:37.027 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-09-21T12:28:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-09-21T12:28:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-09-21T12:28:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-09-21T12:28:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-09-21T12:28:37.028 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-09-21T12:28:37.029 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-09-21T12:28:37.029 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-09-21T12:28:37.029 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-09-21T12:28:37.029 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-09-21T12:28:37.029 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-09-21T12:28:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-09-21T12:28:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-09-21T12:28:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-09-21T12:28:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-09-21T12:28:37.030 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-09-21T12:28:37.031 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-09-21T12:28:37.032 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-09-21T12:28:37.032 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-09-21T12:28:37.032 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-09-21T12:28:37.032 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-09-21T12:28:37.032 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-09-21T12:28:37.033 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-09-21T12:28:37.033 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-09-21T12:28:37.033 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-09-21T12:28:37.033 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-09-21T12:28:37.033 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-09-21T12:28:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-09-21T12:28:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-09-21T12:28:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-09-21T12:28:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-09-21T12:28:37.034 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-09-21T12:28:37.035 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-09-21T12:28:37.036 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-09-21T12:28:37.036 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-09-21T12:28:37.036 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-09-21T12:28:37.036 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-09-21T12:28:37.036 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-09-21T12:28:37.037 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-09-21T12:28:37.037 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-09-21T12:28:37.037 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-09-21T12:28:37.037 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-09-21T12:28:37.037 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-09-21T12:28:37.038 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-09-21T12:28:37.039 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-09-21T12:28:37.039 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-09-21T12:28:37.039 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-09-21T12:28:37.039 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-09-21T12:28:37.039 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-09-21T12:28:37.040 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-09-21T12:28:37.041 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-09-21T12:28:37.041 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-09-21T12:28:37.041 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-09-21T12:28:37.041 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-09-21T12:28:37.041 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-09-21T12:28:37.042 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-09-21T12:28:37.042 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-09-21T12:28:37.042 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-09-21T12:28:37.042 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-09-21T12:28:37.042 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-09-21T12:28:37.043 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-09-21T12:28:37.043 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-09-21T12:28:37.043 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-09-21T12:28:37.043 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-09-21T12:28:37.043 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-09-21T12:28:37.044 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-09-21T12:28:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-09-21T12:28:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-09-21T12:28:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-09-21T12:28:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-09-21T12:28:37.045 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-09-21T12:28:37.046 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-09-21T12:28:37.047 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-09-21T12:28:37.047 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-09-21T12:28:37.047 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-09-21T12:28:37.047 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-09-21T12:28:37.048 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-09-21T12:28:37.049 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-09-21T12:28:37.049 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-09-21T12:28:37.049 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-09-21T12:28:37.049 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-09-21T12:28:37.050 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-09-21T12:28:37.050 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-09-21T12:28:37.050 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-09-21T12:28:37.050 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-09-21T12:28:37.050 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-09-21T12:28:37.051 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-09-21T12:28:37.051 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-09-21T12:28:37.051 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-09-21T12:28:37.051 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-09-21T12:28:37.051 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-09-21T12:28:37.052 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-09-21T12:28:37.053 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-09-21T12:28:37.053 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-09-21T12:28:37.053 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-09-21T12:28:37.053 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-09-21T12:28:37.053 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-09-21T12:28:37.054 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-09-21T12:28:37.054 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-09-21T12:28:37.054 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-09-21T12:28:37.054 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-09-21T12:28:37.054 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-09-21T12:28:37.055 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-09-21T12:28:37.056 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-09-21T12:28:37.056 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-09-21T12:28:37.056 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-09-21T12:28:37.056 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-09-21T12:28:37.056 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-09-21T12:28:37.057 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-09-21T12:28:37.057 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-09-21T12:28:37.057 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-09-21T12:28:37.057 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-09-21T12:28:37.057 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-09-21T12:28:37.058 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-09-21T12:28:37.058 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-09-21T12:28:37.058 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-09-21T12:28:37.058 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-09-21T12:28:37.058 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-09-21T12:28:37.059 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-09-21T12:28:37.060 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-09-21T12:28:37.060 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-09-21T12:28:37.060 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-09-21T12:28:37.060 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-09-21T12:28:37.060 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-09-21T12:28:37.061 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-09-21T12:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-09-21T12:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-09-21T12:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-09-21T12:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-09-21T12:28:37.062 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-09-21T12:28:37.063 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-09-21T12:28:37.063 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-09-21T12:28:37.063 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-09-21T12:28:37.063 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-09-21T12:28:37.063 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-09-21T12:28:37.064 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-09-21T12:28:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-09-21T12:28:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-09-21T12:28:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-09-21T12:28:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-09-21T12:28:37.065 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-09-21T12:28:37.066 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-09-21T12:28:37.066 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-09-21T12:28:37.066 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-09-21T12:28:37.066 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-09-21T12:28:37.066 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-09-21T12:28:37.067 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-09-21T12:28:37.067 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-09-21T12:28:37.067 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-09-21T12:28:37.067 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-09-21T12:28:37.067 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-09-21T12:28:37.068 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-09-21T12:28:37.068 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-09-21T12:28:37.068 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-09-21T12:28:37.068 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-09-21T12:28:37.068 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-09-21T12:28:37.069 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-09-21T12:28:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-09-21T12:28:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-09-21T12:28:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-09-21T12:28:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-09-21T12:28:37.070 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-09-21T12:28:37.071 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-09-21T12:28:37.071 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-09-21T12:28:37.071 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-09-21T12:28:37.071 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-09-21T12:28:37.072 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-09-21T12:28:37.072 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-09-21T12:28:37.072 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-09-21T12:28:37.072 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-09-21T12:28:37.072 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-09-21T12:28:37.073 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-09-21T12:28:37.073 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-09-21T12:28:37.073 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-09-21T12:28:37.073 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-09-21T12:28:37.073 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-09-21T12:28:37.074 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-09-21T12:28:37.075 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-09-21T12:28:37.075 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-09-21T12:28:37.075 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-09-21T12:28:37.075 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-09-21T12:28:37.075 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-09-21T12:28:37.076 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-09-21T12:28:37.076 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-09-21T12:28:37.076 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-09-21T12:28:37.076 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-09-21T12:28:37.076 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-09-21T12:28:37.077 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-09-21T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-09-21T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-09-21T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-09-21T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-09-21T12:28:37.078 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-09-21T12:28:37.079 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-09-21T12:28:37.079 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-09-21T12:28:37.079 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-09-21T12:28:37.079 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-09-21T12:28:37.079 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-09-21T12:28:37.080 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-09-21T12:28:37.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-09-21T12:28:37.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-09-21T12:28:37.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-09-21T12:28:37.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-09-21T12:28:37.081 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-09-21T12:28:37.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-09-21T12:28:37.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-09-21T12:28:37.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-09-21T12:28:37.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-09-21T12:28:37.082 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-09-21T12:28:37.083 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-09-21T12:28:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-09-21T12:28:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-09-21T12:28:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-09-21T12:28:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-09-21T12:28:37.084 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-09-21T12:28:37.085 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-09-21T12:28:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-09-21T12:28:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-09-21T12:28:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-09-21T12:28:37.086 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-09-21T12:28:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-09-21T12:28:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-09-21T12:28:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-09-21T12:28:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-09-21T12:28:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-09-21T12:28:37.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-09-21T12:28:37.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-09-21T12:28:37.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-09-21T12:28:37.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-09-21T12:28:37.088 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-09-21T12:28:37.089 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-09-21T12:28:37.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-09-21T12:28:37.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-09-21T12:28:37.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-09-21T12:28:37.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-09-21T12:28:37.090 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-09-21T12:28:37.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-09-21T12:28:37.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-09-21T12:28:37.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-09-21T12:28:37.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-09-21T12:28:37.091 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-09-21T12:28:37.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-09-21T12:28:37.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-09-21T12:28:37.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-09-21T12:28:37.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-09-21T12:28:37.092 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-09-21T12:28:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-09-21T12:28:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-09-21T12:28:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-09-21T12:28:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-09-21T12:28:37.093 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-09-21T12:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-09-21T12:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-09-21T12:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-09-21T12:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-09-21T12:28:37.094 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-09-21T12:28:37.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-09-21T12:28:37.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-09-21T12:28:37.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-09-21T12:28:37.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-09-21T12:28:37.095 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-09-21T12:28:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-09-21T12:28:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-09-21T12:28:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-09-21T12:28:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-09-21T12:28:37.096 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-09-21T12:28:37.097 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-09-21T12:28:37.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-09-21T12:28:37.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-09-21T12:28:37.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-09-21T12:28:37.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-09-21T12:28:37.098 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-09-21T12:28:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-09-21T12:28:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-09-21T12:28:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-09-21T12:28:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-09-21T12:28:37.099 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-09-21T12:28:37.100 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-09-21T12:28:37.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-09-21T12:28:37.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-09-21T12:28:37.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-09-21T12:28:37.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-09-21T12:28:37.101 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-09-21T12:28:37.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-09-21T12:28:37.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-09-21T12:28:37.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-09-21T12:28:37.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-09-21T12:28:37.102 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-09-21T12:28:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-09-21T12:28:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-09-21T12:28:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-09-21T12:28:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-09-21T12:28:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-09-21T12:28:37.104 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-09-21T12:28:37.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-09-21T12:28:37.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-09-21T12:28:37.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-09-21T12:28:37.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-09-21T12:28:37.105 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-09-21T12:28:37.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-09-21T12:28:37.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-09-21T12:28:37.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-09-21T12:28:37.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-09-21T12:28:37.106 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-09-21T12:28:37.107 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-09-21T12:28:37.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-09-21T12:28:37.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-09-21T12:28:37.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-09-21T12:28:37.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-09-21T12:28:37.108 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-09-21T12:28:37.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-09-21T12:28:37.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-09-21T12:28:37.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-09-21T12:28:37.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-09-21T12:28:37.109 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-09-21T12:28:37.110 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-09-21T12:28:37.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-09-21T12:28:37.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-09-21T12:28:37.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-09-21T12:28:37.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-09-21T12:28:37.111 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-09-21T12:28:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-09-21T12:28:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-09-21T12:28:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-09-21T12:28:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-09-21T12:28:37.112 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-09-21T12:28:37.113 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-09-21T12:28:37.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-09-21T12:28:37.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-09-21T12:28:37.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-09-21T12:28:37.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-09-21T12:28:37.114 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-09-21T12:28:37.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-09-21T12:28:37.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-09-21T12:28:37.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-09-21T12:28:37.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-09-21T12:28:37.115 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-09-21T12:28:37.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-09-21T12:28:37.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-09-21T12:28:37.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-09-21T12:28:37.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-09-21T12:28:37.116 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-09-21T12:28:37.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-09-21T12:28:37.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-09-21T12:28:37.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-09-21T12:28:37.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-09-21T12:28:37.117 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-09-21T12:28:37.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-09-21T12:28:37.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-09-21T12:28:37.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-09-21T12:28:37.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-09-21T12:28:37.118 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-09-21T12:28:37.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-09-21T12:28:37.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-09-21T12:28:37.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-09-21T12:28:37.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-09-21T12:28:37.119 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-09-21T12:28:37.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-09-21T12:28:37.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-09-21T12:28:37.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-09-21T12:28:37.120 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-09-21T12:28:37.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-09-21T12:28:37.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-09-21T12:28:37.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-09-21T12:28:37.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-09-21T12:28:37.121 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-09-21T12:28:37.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-09-21T12:28:37.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-09-21T12:28:37.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-09-21T12:28:37.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-09-21T12:28:37.122 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-09-21T12:28:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-09-21T12:28:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-09-21T12:28:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-09-21T12:28:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-09-21T12:28:37.123 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-09-21T12:28:37.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-09-21T12:28:37.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-09-21T12:28:37.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-09-21T12:28:37.124 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-09-21T12:28:37.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-09-21T12:28:37.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-09-21T12:28:37.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-09-21T12:28:37.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-09-21T12:28:37.125 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-09-21T12:28:37.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-09-21T12:28:37.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-09-21T12:28:37.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-09-21T12:28:37.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-09-21T12:28:37.126 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-09-21T12:28:37.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-09-21T12:28:37.127 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-09-21T12:28:37.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-09-21T12:28:37.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-09-21T12:28:37.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-09-21T12:28:37.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-09-21T12:28:37.128 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-09-21T12:28:37.129 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-09-21T12:28:37.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-09-21T12:28:37.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-09-21T12:28:37.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-09-21T12:28:37.130 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-09-21T12:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-09-21T12:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-09-21T12:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-09-21T12:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-09-21T12:28:37.131 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-09-21T12:28:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-09-21T12:28:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-09-21T12:28:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-09-21T12:28:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-09-21T12:28:37.132 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-09-21T12:28:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-09-21T12:28:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-09-21T12:28:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-09-21T12:28:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-09-21T12:28:37.133 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-09-21T12:28:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-09-21T12:28:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-09-21T12:28:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-09-21T12:28:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-09-21T12:28:37.134 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-09-21T12:28:37.135 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-09-21T12:28:37.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-09-21T12:28:37.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-09-21T12:28:37.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-09-21T12:28:37.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-09-21T12:28:37.136 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-09-21T12:28:37.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-09-21T12:28:37.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-09-21T12:28:37.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-09-21T12:28:37.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-09-21T12:28:37.137 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-09-21T12:28:37.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-09-21T12:28:37.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-09-21T12:28:37.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-09-21T12:28:37.138 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-09-21T12:28:37.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-09-21T12:28:37.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-09-21T12:28:37.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-09-21T12:28:37.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-09-21T12:28:37.139 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-09-21T12:28:37.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-09-21T12:28:37.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-09-21T12:28:37.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-09-21T12:28:37.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-09-21T12:28:37.140 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-09-21T12:28:37.141 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-09-21T12:28:37.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-09-21T12:28:37.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-09-21T12:28:37.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-09-21T12:28:37.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-09-21T12:28:37.142 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-09-21T12:28:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-09-21T12:28:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-09-21T12:28:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-09-21T12:28:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-09-21T12:28:37.143 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-09-21T12:28:37.144 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-09-21T12:28:37.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-09-21T12:28:37.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-09-21T12:28:37.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-09-21T12:28:37.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-09-21T12:28:37.145 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-09-21T12:28:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-09-21T12:28:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-09-21T12:28:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-09-21T12:28:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-09-21T12:28:37.146 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-09-21T12:28:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-09-21T12:28:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-09-21T12:28:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-09-21T12:28:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-09-21T12:28:37.147 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-09-21T12:28:37.148 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-09-21T12:28:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-09-21T12:28:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-09-21T12:28:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-09-21T12:28:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-09-21T12:28:37.149 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-09-21T12:28:37.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-09-21T12:28:37.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-09-21T12:28:37.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-09-21T12:28:37.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-09-21T12:28:37.150 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-09-21T12:28:37.151 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-09-21T12:28:37.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-09-21T12:28:37.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-09-21T12:28:37.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-09-21T12:28:37.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-09-21T12:28:37.152 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-09-21T12:28:37.153 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-09-21T12:28:37.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-09-21T12:28:37.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-09-21T12:28:37.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-09-21T12:28:37.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-09-21T12:28:37.154 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-09-21T12:28:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-09-21T12:28:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-09-21T12:28:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-09-21T12:28:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-09-21T12:28:37.155 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-09-21T12:28:37.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-09-21T12:28:37.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-09-21T12:28:37.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-09-21T12:28:37.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-09-21T12:28:37.156 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-09-21T12:28:37.157 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-09-21T12:28:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-09-21T12:28:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-09-21T12:28:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-09-21T12:28:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-09-21T12:28:37.158 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-09-21T12:28:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-09-21T12:28:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-09-21T12:28:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-09-21T12:28:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-09-21T12:28:37.159 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-09-21T12:28:37.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-09-21T12:28:37.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-09-21T12:28:37.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-09-21T12:28:37.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-09-21T12:28:37.160 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-09-21T12:28:37.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-09-21T12:28:37.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-09-21T12:28:37.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-09-21T12:28:37.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-09-21T12:28:37.161 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-09-21T12:28:37.162 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-09-21T12:28:37.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-09-21T12:28:37.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-09-21T12:28:37.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-09-21T12:28:37.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-09-21T12:28:37.163 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-09-21T12:28:37.164 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-09-21T12:28:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-09-21T12:28:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-09-21T12:28:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-09-21T12:28:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-09-21T12:28:37.165 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-09-21T12:28:37.166 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-09-21T12:28:37.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-09-21T12:28:37.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-09-21T12:28:37.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-09-21T12:28:37.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-09-21T12:28:37.167 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-09-21T12:28:37.168 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-09-21T12:28:37.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-09-21T12:28:37.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-09-21T12:28:37.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-09-21T12:28:37.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-09-21T12:28:37.169 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-09-21T12:28:37.170 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-09-21T12:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-09-21T12:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-09-21T12:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-09-21T12:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-09-21T12:28:37.171 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-09-21T12:28:37.172 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-09-21T12:28:37.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-09-21T12:28:37.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-09-21T12:28:37.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-09-21T12:28:37.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-09-21T12:28:37.173 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-09-21T12:28:37.174 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-09-21T12:28:37.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-09-21T12:28:37.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-09-21T12:28:37.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-09-21T12:28:37.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-09-21T12:28:37.175 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-09-21T12:28:37.176 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-09-21T12:28:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-09-21T12:28:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-09-21T12:28:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-09-21T12:28:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-09-21T12:28:37.177 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-09-21T12:28:37.178 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-09-21T12:28:37.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-09-21T12:28:37.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-09-21T12:28:37.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-09-21T12:28:37.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-09-21T12:28:37.179 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-09-21T12:28:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-09-21T12:28:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-09-21T12:28:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-09-21T12:28:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-09-21T12:28:37.180 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-09-21T12:28:37.181 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-09-21T12:28:37.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-09-21T12:28:37.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-09-21T12:28:37.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-09-21T12:28:37.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-09-21T12:28:37.182 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-09-21T12:28:37.183 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-09-21T12:28:37.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-09-21T12:28:37.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-09-21T12:28:37.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-09-21T12:28:37.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-09-21T12:28:37.184 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-09-21T12:28:37.185 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-09-21T12:28:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-09-21T12:28:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-09-21T12:28:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-09-21T12:28:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-09-21T12:28:37.186 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-09-21T12:28:37.187 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-09-21T12:28:37.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-09-21T12:28:37.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-09-21T12:28:37.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-09-21T12:28:37.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-09-21T12:28:37.188 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-09-21T12:28:37.189 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-09-21T12:28:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-09-21T12:28:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-09-21T12:28:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-09-21T12:28:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-09-21T12:28:37.190 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-09-21T12:28:37.191 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-09-21T12:28:37.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-09-21T12:28:37.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-09-21T12:28:37.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-09-21T12:28:37.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-09-21T12:28:37.192 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-09-21T12:28:37.193 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-09-21T12:28:37.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-09-21T12:28:37.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-09-21T12:28:37.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-09-21T12:28:37.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-09-21T12:28:37.194 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-09-21T12:28:37.195 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-09-21T12:28:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-09-21T12:28:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-09-21T12:28:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-09-21T12:28:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-09-21T12:28:37.196 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-09-21T12:28:37.197 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-09-21T12:28:37.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-09-21T12:28:37.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-09-21T12:28:37.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-09-21T12:28:37.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-09-21T12:28:37.198 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-09-21T12:28:37.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-09-21T12:28:37.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-09-21T12:28:37.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-09-21T12:28:37.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-09-21T12:28:37.199 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-09-21T12:28:37.200 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-09-21T12:28:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-09-21T12:28:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-09-21T12:28:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-09-21T12:28:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-09-21T12:28:37.201 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-09-21T12:28:37.202 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-09-21T12:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-09-21T12:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-09-21T12:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-09-21T12:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-09-21T12:28:37.203 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-09-21T12:28:37.204 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-09-21T12:28:37.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-09-21T12:28:37.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-09-21T12:28:37.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-09-21T12:28:37.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-09-21T12:28:37.205 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-09-21T12:28:37.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-09-21T12:28:37.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-09-21T12:28:37.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-09-21T12:28:37.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-09-21T12:28:37.206 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-09-21T12:28:37.207 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-09-21T12:28:37.208 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-09-21T12:28:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-09-21T12:28:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-09-21T12:28:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-09-21T12:28:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-09-21T12:28:37.209 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-09-21T12:28:37.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-09-21T12:28:37.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-09-21T12:28:37.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-09-21T12:28:37.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-09-21T12:28:37.210 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-09-21T12:28:37.211 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-09-21T12:28:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-09-21T12:28:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-09-21T12:28:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-09-21T12:28:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-09-21T12:28:37.212 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-09-21T12:28:37.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-09-21T12:28:37.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-09-21T12:28:37.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-09-21T12:28:37.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-09-21T12:28:37.213 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-09-21T12:28:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-09-21T12:28:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-09-21T12:28:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-09-21T12:28:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-09-21T12:28:37.214 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-09-21T12:28:37.215 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-09-21T12:28:37.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-09-21T12:28:37.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-09-21T12:28:37.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-09-21T12:28:37.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-09-21T12:28:37.216 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-09-21T12:28:37.217 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-09-21T12:28:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-09-21T12:28:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-09-21T12:28:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-09-21T12:28:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-09-21T12:28:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-09-21T12:28:37.219 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-09-21T12:28:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-09-21T12:28:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-09-21T12:28:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-09-21T12:28:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-09-21T12:28:37.220 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-09-21T12:28:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-09-21T12:28:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-09-21T12:28:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-09-21T12:28:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-09-21T12:28:37.221 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-09-21T12:28:37.222 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-09-21T12:28:37.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-09-21T12:28:37.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-09-21T12:28:37.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-09-21T12:28:37.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-09-21T12:28:37.223 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-09-21T12:28:37.224 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-09-21T12:28:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-09-21T12:28:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-09-21T12:28:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-09-21T12:28:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-09-21T12:28:37.225 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-09-21T12:28:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-09-21T12:28:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-09-21T12:28:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-09-21T12:28:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-09-21T12:28:37.226 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-09-21T12:28:37.227 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-09-21T12:28:37.228 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-09-21T12:28:37.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-09-21T12:28:37.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-09-21T12:28:37.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-09-21T12:28:37.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-09-21T12:28:37.229 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-09-21T12:28:37.230 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-09-21T12:28:37.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-09-21T12:28:37.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-09-21T12:28:37.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-09-21T12:28:37.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-09-21T12:28:37.231 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-09-21T12:28:37.232 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-09-21T12:28:37.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-09-21T12:28:37.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-09-21T12:28:37.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-09-21T12:28:37.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-09-21T12:28:37.233 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-09-21T12:28:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-09-21T12:28:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-09-21T12:28:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-09-21T12:28:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-09-21T12:28:37.234 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-09-21T12:28:37.235 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-09-21T12:28:37.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-09-21T12:28:37.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-09-21T12:28:37.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-09-21T12:28:37.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-09-21T12:28:37.236 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-09-21T12:28:37.237 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-09-21T12:28:37.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-09-21T12:28:37.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-09-21T12:28:37.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-09-21T12:28:37.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-09-21T12:28:37.238 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-09-21T12:28:37.239 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-09-21T12:28:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-09-21T12:28:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-09-21T12:28:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-09-21T12:28:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-09-21T12:28:37.240 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-09-21T12:28:37.241 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-09-21T12:28:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-09-21T12:28:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-09-21T12:28:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-09-21T12:28:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-09-21T12:28:37.242 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-09-21T12:28:37.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-09-21T12:28:37.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-09-21T12:28:37.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-09-21T12:28:37.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-09-21T12:28:37.243 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-09-21T12:28:37.244 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-09-21T12:28:37.245 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-09-21T12:28:37.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-09-21T12:28:37.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-09-21T12:28:37.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-09-21T12:28:37.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-09-21T12:28:37.246 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-09-21T12:28:37.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-09-21T12:28:37.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-09-21T12:28:37.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-09-21T12:28:37.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-09-21T12:28:37.247 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-09-21T12:28:37.248 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-09-21T12:28:37.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-09-21T12:28:37.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-09-21T12:28:37.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-09-21T12:28:37.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-09-21T12:28:37.249 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-09-21T12:28:37.250 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-09-21T12:28:37.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-09-21T12:28:37.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-09-21T12:28:37.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-09-21T12:28:37.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-09-21T12:28:37.251 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-09-21T12:28:37.252 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-09-21T12:28:37.253 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-09-21T12:28:37.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-09-21T12:28:37.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-09-21T12:28:37.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-09-21T12:28:37.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-09-21T12:28:37.254 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-09-21T12:28:37.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-09-21T12:28:37.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-09-21T12:28:37.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-09-21T12:28:37.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-09-21T12:28:37.255 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-09-21T12:28:37.256 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-09-21T12:28:37.257 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-09-21T12:28:37.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-09-21T12:28:37.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-09-21T12:28:37.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-09-21T12:28:37.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-09-21T12:28:37.258 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-09-21T12:28:37.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-09-21T12:28:37.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-09-21T12:28:37.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-09-21T12:28:37.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-09-21T12:28:37.259 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-09-21T12:28:37.260 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-09-21T12:28:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-09-21T12:28:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-09-21T12:28:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-09-21T12:28:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-09-21T12:28:37.261 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-09-21T12:28:37.262 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-09-21T12:28:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-09-21T12:28:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-09-21T12:28:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-09-21T12:28:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-09-21T12:28:37.263 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-09-21T12:28:37.264 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-09-21T12:28:37.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-09-21T12:28:37.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-09-21T12:28:37.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-09-21T12:28:37.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-09-21T12:28:37.265 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-09-21T12:28:37.266 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-09-21T12:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-09-21T12:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-09-21T12:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-09-21T12:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-09-21T12:28:37.267 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-09-21T12:28:37.268 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-09-21T12:28:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-09-21T12:28:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-09-21T12:28:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-09-21T12:28:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-09-21T12:28:37.269 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-09-21T12:28:37.270 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-09-21T12:28:37.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-09-21T12:28:37.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-09-21T12:28:37.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-09-21T12:28:37.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-09-21T12:28:37.271 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-09-21T12:28:37.272 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-09-21T12:28:37.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-09-21T12:28:37.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-09-21T12:28:37.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-09-21T12:28:37.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-09-21T12:28:37.273 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-09-21T12:28:37.274 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-09-21T12:28:37.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-09-21T12:28:37.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-09-21T12:28:37.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-09-21T12:28:37.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-09-21T12:28:37.275 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-09-21T12:28:37.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-09-21T12:28:37.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-09-21T12:28:37.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-09-21T12:28:37.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-09-21T12:28:37.276 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-09-21T12:28:37.277 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-09-21T12:28:37.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-09-21T12:28:37.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-09-21T12:28:37.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-09-21T12:28:37.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-09-21T12:28:37.278 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-09-21T12:28:37.279 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-09-21T12:28:37.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-09-21T12:28:37.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-09-21T12:28:37.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-09-21T12:28:37.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-09-21T12:28:37.280 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-09-21T12:28:37.281 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-09-21T12:28:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-09-21T12:28:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-09-21T12:28:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-09-21T12:28:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-09-21T12:28:37.282 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-09-21T12:28:37.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-09-21T12:28:37.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-09-21T12:28:37.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-09-21T12:28:37.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-09-21T12:28:37.283 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-09-21T12:28:37.284 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-09-21T12:28:37.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-09-21T12:28:37.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-09-21T12:28:37.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-09-21T12:28:37.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-09-21T12:28:37.285 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-09-21T12:28:37.286 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-09-21T12:28:37.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-09-21T12:28:37.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-09-21T12:28:37.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-09-21T12:28:37.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-09-21T12:28:37.287 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-09-21T12:28:37.288 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-09-21T12:28:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-09-21T12:28:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-09-21T12:28:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-09-21T12:28:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-09-21T12:28:37.289 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-09-21T12:28:37.290 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-09-21T12:28:37.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-09-21T12:28:37.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-09-21T12:28:37.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-09-21T12:28:37.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-09-21T12:28:37.291 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-09-21T12:28:37.292 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-09-21T12:28:37.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-09-21T12:28:37.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-09-21T12:28:37.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-09-21T12:28:37.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-09-21T12:28:37.293 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-09-21T12:28:37.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-09-21T12:28:37.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-09-21T12:28:37.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-09-21T12:28:37.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-09-21T12:28:37.294 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-09-21T12:28:37.295 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-09-21T12:28:37.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-09-21T12:28:37.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-09-21T12:28:37.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-09-21T12:28:37.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-09-21T12:28:37.296 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-09-21T12:28:37.297 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-09-21T12:28:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-09-21T12:28:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-09-21T12:28:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-09-21T12:28:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-09-21T12:28:37.298 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-09-21T12:28:37.299 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-09-21T12:28:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-09-21T12:28:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-09-21T12:28:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-09-21T12:28:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-09-21T12:28:37.300 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-09-21T12:28:37.301 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-09-21T12:28:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-09-21T12:28:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-09-21T12:28:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-09-21T12:28:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-09-21T12:28:37.302 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-09-21T12:28:37.303 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-09-21T12:28:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-09-21T12:28:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-09-21T12:28:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-09-21T12:28:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-09-21T12:28:37.304 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-09-21T12:28:37.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-09-21T12:28:37.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-09-21T12:28:37.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-09-21T12:28:37.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-09-21T12:28:37.305 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-09-21T12:28:37.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-09-21T12:28:37.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-09-21T12:28:37.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-09-21T12:28:37.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-09-21T12:28:37.306 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-09-21T12:28:37.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-09-21T12:28:37.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-09-21T12:28:37.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-09-21T12:28:37.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-09-21T12:28:37.307 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-09-21T12:28:37.308 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-09-21T12:28:37.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-09-21T12:28:37.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-09-21T12:28:37.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-09-21T12:28:37.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-09-21T12:28:37.309 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-09-21T12:28:37.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-09-21T12:28:37.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-09-21T12:28:37.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-09-21T12:28:37.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-09-21T12:28:37.310 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-09-21T12:28:37.311 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-09-21T12:28:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-09-21T12:28:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-09-21T12:28:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-09-21T12:28:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-09-21T12:28:37.312 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-09-21T12:28:37.313 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-09-21T12:28:37.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-09-21T12:28:37.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-09-21T12:28:37.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-09-21T12:28:37.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-09-21T12:28:37.314 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-09-21T12:28:37.315 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-09-21T12:28:37.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-09-21T12:28:37.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-09-21T12:28:37.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-09-21T12:28:37.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-09-21T12:28:37.316 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-09-21T12:28:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-09-21T12:28:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-09-21T12:28:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-09-21T12:28:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-09-21T12:28:37.317 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-09-21T12:28:37.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-09-21T12:28:37.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-09-21T12:28:37.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-09-21T12:28:37.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-09-21T12:28:37.318 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-09-21T12:28:37.319 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-09-21T12:28:37.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-09-21T12:28:37.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-09-21T12:28:37.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-09-21T12:28:37.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-09-21T12:28:37.320 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-09-21T12:28:37.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-09-21T12:28:37.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-09-21T12:28:37.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-09-21T12:28:37.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-09-21T12:28:37.321 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-09-21T12:28:37.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-09-21T12:28:37.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-09-21T12:28:37.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-09-21T12:28:37.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-09-21T12:28:37.322 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-09-21T12:28:37.323 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-09-21T12:28:37.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-09-21T12:28:37.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-09-21T12:28:37.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-09-21T12:28:37.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-09-21T12:28:37.324 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-09-21T12:28:37.325 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-09-21T12:28:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-09-21T12:28:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-09-21T12:28:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-09-21T12:28:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-09-21T12:28:37.326 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-09-21T12:28:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-09-21T12:28:37.328 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-09-21T12:28:37.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-09-21T12:28:37.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-09-21T12:28:37.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-09-21T12:28:37.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-09-21T12:28:37.329 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-09-21T12:28:37.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-09-21T12:28:37.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-09-21T12:28:37.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-09-21T12:28:37.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-09-21T12:28:37.330 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-09-21T12:28:37.331 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-09-21T12:28:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-09-21T12:28:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-09-21T12:28:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-09-21T12:28:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-09-21T12:28:37.332 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-09-21T12:28:37.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-09-21T12:28:37.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-09-21T12:28:37.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-09-21T12:28:37.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-09-21T12:28:37.333 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-09-21T12:28:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-09-21T12:28:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-09-21T12:28:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-09-21T12:28:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-09-21T12:28:37.334 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-09-21T12:28:37.335 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-09-21T12:28:37.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-09-21T12:28:37.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-09-21T12:28:37.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-09-21T12:28:37.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-09-21T12:28:37.336 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-09-21T12:28:37.337 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-09-21T12:28:37.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-09-21T12:28:37.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-09-21T12:28:37.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-09-21T12:28:37.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-09-21T12:28:37.338 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-09-21T12:28:37.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-09-21T12:28:37.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-09-21T12:28:37.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-09-21T12:28:37.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-09-21T12:28:37.339 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-09-21T12:28:37.340 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-09-21T12:28:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-09-21T12:28:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-09-21T12:28:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-09-21T12:28:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-09-21T12:28:37.341 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-09-21T12:28:37.342 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-09-21T12:28:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-09-21T12:28:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-09-21T12:28:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-09-21T12:28:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-09-21T12:28:37.343 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-09-21T12:28:37.344 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-09-21T12:28:37.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-09-21T12:28:37.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-09-21T12:28:37.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-09-21T12:28:37.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-09-21T12:28:37.345 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-09-21T12:28:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-09-21T12:28:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-09-21T12:28:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-09-21T12:28:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-09-21T12:28:37.346 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-09-21T12:28:37.347 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-09-21T12:28:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-09-21T12:28:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-09-21T12:28:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-09-21T12:28:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-09-21T12:28:37.348 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-09-21T12:28:37.349 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-09-21T12:28:37.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-09-21T12:28:37.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-09-21T12:28:37.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-09-21T12:28:37.350 INFO:teuthology.orchestra.run.smithi142.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-09-21T12:28:37.351 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:37.351 DEBUG:teuthology.orchestra.run.smithi142:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-09-21T12:28:37.379 INFO:teuthology.orchestra.run.smithi142.stdout:postinstall scriptlet (using /bin/sh): 2023-09-21T12:28:37.379 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-09-21T12:28:37.379 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-21T12:28:37.380 INFO:teuthology.orchestra.run.smithi142.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-21T12:28:37.380 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:37.380 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-21T12:28:37.380 INFO:teuthology.orchestra.run.smithi142.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-09-21T12:28:37.380 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-21T12:28:37.381 INFO:teuthology.orchestra.run.smithi142.stdout:preuninstall scriptlet (using /bin/sh): 2023-09-21T12:28:37.381 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-09-21T12:28:37.381 INFO:teuthology.orchestra.run.smithi142.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-09-21T12:28:37.381 INFO:teuthology.orchestra.run.smithi142.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-09-21T12:28:37.381 INFO:teuthology.orchestra.run.smithi142.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:37.382 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-21T12:28:37.382 INFO:teuthology.orchestra.run.smithi142.stdout:postuninstall scriptlet (using /bin/sh): 2023-09-21T12:28:37.382 INFO:teuthology.orchestra.run.smithi142.stdout:if [ -x /sbin/update-bootloader ]; then 2023-09-21T12:28:37.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:37.382 INFO:teuthology.orchestra.run.smithi142.stdout:fi 2023-09-21T12:28:37.383 DEBUG:teuthology.orchestra.run.smithi142:> sudo rpm -qi grub2-tools 2023-09-21T12:28:37.462 INFO:teuthology.orchestra.run.smithi142.stdout:Name : grub2-tools 2023-09-21T12:28:37.462 INFO:teuthology.orchestra.run.smithi142.stdout:Epoch : 1 2023-09-21T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Version : 2.02 2023-09-21T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Release : 123.el8 2023-09-21T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Architecture: x86_64 2023-09-21T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-09-21T12:28:37.463 INFO:teuthology.orchestra.run.smithi142.stdout:Group : System Environment/Base 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Size : 9265450 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:License : GPLv3+ 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-09-21T12:28:37.464 INFO:teuthology.orchestra.run.smithi142.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-09-21T12:28:37.465 INFO:teuthology.orchestra.run.smithi142.stdout:Relocations : (not relocatable) 2023-09-21T12:28:37.465 INFO:teuthology.orchestra.run.smithi142.stdout:Packager : Red Hat, Inc. 2023-09-21T12:28:37.465 INFO:teuthology.orchestra.run.smithi142.stdout:Vendor : Red Hat, Inc. 2023-09-21T12:28:37.465 INFO:teuthology.orchestra.run.smithi142.stdout:URL : http://www.gnu.org/software/grub/ 2023-09-21T12:28:37.465 INFO:teuthology.orchestra.run.smithi142.stdout:Summary : Support tools for GRUB. 2023-09-21T12:28:37.466 INFO:teuthology.orchestra.run.smithi142.stdout:Description : 2023-09-21T12:28:37.466 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:28:37.466 INFO:teuthology.orchestra.run.smithi142.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-09-21T12:28:37.466 INFO:teuthology.orchestra.run.smithi142.stdout:customizable bootloader with modular architecture. It supports a rich 2023-09-21T12:28:37.466 INFO:teuthology.orchestra.run.smithi142.stdout:variety of kernel formats, file systems, computer architectures and 2023-09-21T12:28:37.467 INFO:teuthology.orchestra.run.smithi142.stdout:hardware devices. 2023-09-21T12:28:37.467 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:28:37.467 INFO:teuthology.orchestra.run.smithi142.stdout:This subpackage provides tools for support of all platforms. 2023-09-21T12:28:37.468 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-09-21T12:28:37.468 INFO:teuthology.task.kernel:Updating grub on smithi142 to boot 6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:37.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-09-21T12:28:40.014 INFO:teuthology.orchestra.run.smithi142.stderr:Generating grub configuration file ... 2023-09-21T12:28:41.941 INFO:teuthology.orchestra.run.smithi142.stderr:done 2023-09-21T12:28:41.943 DEBUG:teuthology.orchestra.run.smithi142:> mktemp 2023-09-21T12:28:41.961 INFO:teuthology.orchestra.run.smithi142.stdout:/tmp/tmp.pXT2smcChi 2023-09-21T12:28:41.961 DEBUG:teuthology.orchestra.run.smithi142:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pXT2smcChi 2023-09-21T12:28:42.034 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0666 /tmp/tmp.pXT2smcChi 2023-09-21T12:28:42.183 DEBUG:teuthology.orchestra.remote:smithi142:/tmp/tmp.pXT2smcChi is 6KB 2023-09-21T12:28:42.231 DEBUG:teuthology.orchestra.run.smithi142:> rm -fr /tmp/tmp.pXT2smcChi 2023-09-21T12:28:42.247 DEBUG:teuthology.orchestra.run.smithi142:> sudo /bin/ls /boot/loader/entries || true 2023-09-21T12:28:42.326 INFO:teuthology.orchestra.run.smithi142.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-09-21T12:28:42.326 INFO:teuthology.orchestra.run.smithi142.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-09-21T12:28:42.327 INFO:teuthology.orchestra.run.smithi142.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b.conf 2023-09-21T12:28:42.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc7-gfef64f93da2b 2023-09-21T12:28:42.506 DEBUG:teuthology.orchestra.run.smithi142:> sudo shutdown -r now 2023-09-21T12:29:12.510 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-09-21T12:29:12.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:29:12.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:29:30.906 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.142 2023-09-21T12:29:39.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:29:39.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:30:39.912 DEBUG:teuthology.orchestra.remote:timed out 2023-09-21T12:30:51.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:30:51.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:30:52.297 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-09-21T12:30:52.747 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:30:52.748 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-09-21T12:30:52.748 DEBUG:teuthology.orchestra.run.smithi142:> uname -r 2023-09-21T12:30:52.791 INFO:teuthology.orchestra.run.smithi142.stdout:6.5.0-rc7-gfef64f93da2b 2023-09-21T12:30:52.791 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-09-21T12:30:52.791 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-21T12:30:52.792 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-09-21T12:30:53.793 DEBUG:teuthology.parallel:result is None 2023-09-21T12:30:53.794 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-21T12:30:53.801 INFO:teuthology.task.internal:Creating test directory... 2023-09-21T12:30:53.802 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-21T12:30:53.807 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-21T12:30:53.810 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-21T12:30:53.849 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-21T12:30:53.856 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-21T12:30:53.866 INFO:teuthology.task.internal:Creating archive directory... 2023-09-21T12:30:53.866 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-21T12:30:53.894 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-21T12:30:53.897 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-21T12:30:53.976 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-21T12:30:53.983 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-21T12:30:53.983 DEBUG:teuthology.orchestra.run.smithi156:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-21T12:30:54.002 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:30:54.003 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-21T12:30:54.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:30:54.023 DEBUG:teuthology.orchestra.run.smithi142:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-21T12:30:54.028 DEBUG:teuthology.orchestra.run.smithi156:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-21T12:30:54.046 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-21T12:30:54.104 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.111 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.119 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.128 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.155 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.188 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-21T12:30:54.191 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-21T12:30:54.199 INFO:teuthology.task.internal:Configuring sudo... 2023-09-21T12:30:54.200 DEBUG:teuthology.orchestra.run.smithi142:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-21T12:30:54.204 DEBUG:teuthology.orchestra.run.smithi156:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-21T12:30:54.206 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-21T12:30:54.268 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-21T12:30:54.280 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-21T12:30:54.281 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-21T12:30:54.285 DEBUG:teuthology.orchestra.run.smithi156:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-21T12:30:54.288 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-21T12:30:54.323 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:54.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:54.542 DEBUG:teuthology.orchestra.run.smithi142:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:54.611 DEBUG:teuthology.orchestra.run.smithi142:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:54.695 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:30:54.695 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-21T12:30:54.763 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:54.808 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:54.863 DEBUG:teuthology.orchestra.run.smithi156:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:54.947 DEBUG:teuthology.orchestra.run.smithi156:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:54.993 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:30:54.993 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-21T12:30:55.062 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:55.107 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-21T12:30:55.163 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:55.249 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-21T12:30:55.292 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:30:55.292 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-21T12:30:55.372 DEBUG:teuthology.orchestra.run.smithi142:> sudo service rsyslog restart 2023-09-21T12:30:55.377 DEBUG:teuthology.orchestra.run.smithi156:> sudo service rsyslog restart 2023-09-21T12:30:55.380 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2023-09-21T12:30:55.445 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T12:30:55.474 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T12:30:55.494 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T12:30:55.949 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-21T12:30:55.957 INFO:teuthology.task.internal:Starting timer... 2023-09-21T12:30:55.957 INFO:teuthology.run_tasks:Running task pcp... 2023-09-21T12:30:55.977 INFO:teuthology.run_tasks:Running task selinux... 2023-09-21T12:30:55.987 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-21T12:30:55.988 DEBUG:teuthology.orchestra.run.smithi142:> sudo service auditd rotate 2023-09-21T12:30:56.101 INFO:teuthology.orchestra.run.smithi142.stdout:Rotating logs: 2023-09-21T12:30:56.104 DEBUG:teuthology.orchestra.run.smithi156:> sudo service auditd rotate 2023-09-21T12:30:56.174 INFO:teuthology.orchestra.run.smithi156.stdout:Rotating logs: 2023-09-21T12:30:56.176 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2023-09-21T12:30:56.243 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2023-09-21T12:30:56.245 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-21T12:30:56.246 DEBUG:teuthology.orchestra.run.smithi142:> /usr/sbin/getenforce 2023-09-21T12:30:56.293 INFO:teuthology.orchestra.run.smithi142.stdout:Permissive 2023-09-21T12:30:56.293 DEBUG:teuthology.orchestra.run.smithi156:> /usr/sbin/getenforce 2023-09-21T12:30:56.315 INFO:teuthology.orchestra.run.smithi156.stdout:Permissive 2023-09-21T12:30:56.316 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2023-09-21T12:30:56.338 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2023-09-21T12:30:56.339 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi142.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi156.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2023-09-21T12:30:56.339 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T12:30:56.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:30:56.416 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T12:30:56.443 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:30:56.444 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T12:30:56.472 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:30:56.472 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-21T12:30:56.473 DEBUG:teuthology.orchestra.run.smithi142:> sudo /usr/sbin/setenforce permissive 2023-09-21T12:30:56.542 DEBUG:teuthology.orchestra.run.smithi156:> sudo /usr/sbin/setenforce permissive 2023-09-21T12:30:56.569 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2023-09-21T12:30:56.608 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-21T12:30:56.618 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-21T12:30:56.659 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-21T12:30:56.991 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-21T12:30:57.056 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-21T12:30:57.057 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi142.front.sepia.ceph.com,smithi156.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-21T12:42:51.477 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi142.front.sepia.ceph.com'), Remote(name='ubuntu@smithi156.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2023-09-21T12:42:51.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:42:51.481 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi142.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:42:51.572 DEBUG:teuthology.orchestra.run.smithi142:> true 2023-09-21T12:42:51.679 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi142.front.sepia.ceph.com' 2023-09-21T12:42:51.680 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-21T12:42:51.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi156.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:42:51.751 DEBUG:teuthology.orchestra.run.smithi156:> true 2023-09-21T12:42:51.821 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi156.front.sepia.ceph.com' 2023-09-21T12:42:51.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-09-21T12:42:51.822 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-21T12:42:51.892 DEBUG:teuthology.orchestra.run.smithi160:> true 2023-09-21T12:42:51.965 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2023-09-21T12:42:51.965 INFO:teuthology.run_tasks:Running task clock... 2023-09-21T12:42:51.978 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-21T12:42:51.978 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-21T12:42:51.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T12:42:51.983 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-21T12:42:51.984 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T12:42:51.986 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-21T12:42:51.986 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T12:42:52.021 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-21T12:42:52.037 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-21T12:42:52.038 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-21T12:42:52.052 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-21T12:42:52.053 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-21T12:42:52.086 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-21T12:42:52.109 INFO:teuthology.orchestra.run.smithi156.stderr:sudo: ntpd: command not found 2023-09-21T12:42:52.122 INFO:teuthology.orchestra.run.smithi156.stdout:506 Cannot talk to daemon 2023-09-21T12:42:52.132 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2023-09-21T12:42:52.137 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-21T12:42:52.144 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2023-09-21T12:42:52.153 INFO:teuthology.orchestra.run.smithi156.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-21T12:42:52.160 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-21T12:42:52.174 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-21T12:42:52.178 INFO:teuthology.orchestra.run.smithi142.stderr:sudo: ntpd: command not found 2023-09-21T12:42:52.207 INFO:teuthology.orchestra.run.smithi142.stdout:506 Cannot talk to daemon 2023-09-21T12:42:52.227 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-09-21T12:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T12:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-09-21T12:42:52.230 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.231 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.241 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-21T12:42:52.247 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2023-09-21T12:42:52.250 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T12:42:52.250 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2023-09-21T12:42:52.251 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.251 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.251 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.251 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.276 INFO:teuthology.orchestra.run.smithi142.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-21T12:42:52.367 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-09-21T12:42:52.373 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T12:42:52.374 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-09-21T12:42:52.374 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.374 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.374 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.375 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T12:42:52.376 INFO:teuthology.run_tasks:Running task pexec... 2023-09-21T12:42:52.398 INFO:teuthology.task.pexec:Executing custom commands... 2023-09-21T12:42:52.399 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:42:52.399 DEBUG:teuthology.orchestra.run.smithi142:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-21T12:42:52.400 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi156.front.sepia.ceph.com 2023-09-21T12:42:52.400 DEBUG:teuthology.orchestra.run.smithi156:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-21T12:42:52.400 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi160.front.sepia.ceph.com 2023-09-21T12:42:52.401 DEBUG:teuthology.orchestra.run.smithi160:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-21T12:42:52.775 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-09-21T12:42:52.776 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-09-21T12:42:52.885 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-09-21T12:42:53.608 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:35 ago on Thu 21 Sep 2023 12:38:18 PM UTC. 2023-09-21T12:42:53.611 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:04:36 ago on Thu 21 Sep 2023 12:38:17 PM UTC. 2023-09-21T12:42:53.829 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:45 ago on Thu 21 Sep 2023 12:41:08 PM UTC. 2023-09-21T12:42:55.324 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-21T12:42:55.325 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-21T12:42:55.325 INFO:teuthology.orchestra.run.smithi156.stdout: Package Architecture Version Repository Size 2023-09-21T12:42:55.325 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-21T12:42:55.325 INFO:teuthology.orchestra.run.smithi156.stdout:Resetting modules: 2023-09-21T12:42:55.325 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools 2023-09-21T12:42:55.326 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:42:55.326 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-21T12:42:55.326 INFO:teuthology.orchestra.run.smithi156.stdout:================================================================================ 2023-09-21T12:42:55.326 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:42:55.341 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-09-21T12:42:55.342 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2023-09-21T12:42:55.342 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2023-09-21T12:42:55.342 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2023-09-21T12:42:55.342 INFO:teuthology.orchestra.run.smithi160.stdout:Resetting modules: 2023-09-21T12:42:55.343 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools 2023-09-21T12:42:55.343 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:42:55.343 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2023-09-21T12:42:55.343 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2023-09-21T12:42:55.343 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:42:55.610 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-21T12:42:55.611 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-21T12:42:55.611 INFO:teuthology.orchestra.run.smithi142.stdout: Package Architecture Version Repository Size 2023-09-21T12:42:55.611 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-21T12:42:55.611 INFO:teuthology.orchestra.run.smithi142.stdout:Resetting modules: 2023-09-21T12:42:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools 2023-09-21T12:42:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:42:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-09-21T12:42:55.612 INFO:teuthology.orchestra.run.smithi142.stdout:================================================================================ 2023-09-21T12:42:55.612 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:42:56.277 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:37 ago on Thu 21 Sep 2023 12:38:18 PM UTC. 2023-09-21T12:42:56.286 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:04:38 ago on Thu 21 Sep 2023 12:38:17 PM UTC. 2023-09-21T12:42:56.839 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:48 ago on Thu 21 Sep 2023 12:41:08 PM UTC. 2023-09-21T12:42:58.936 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-21T12:42:59.051 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-09-21T12:42:59.428 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-21T12:42:59.431 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-09-21T12:42:59.526 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:00.029 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:00.265 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:41 ago on Thu 21 Sep 2023 12:38:18 PM UTC. 2023-09-21T12:43:00.376 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:04:42 ago on Thu 21 Sep 2023 12:38:17 PM UTC. 2023-09-21T12:43:01.004 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:01:52 ago on Thu 21 Sep 2023 12:41:08 PM UTC. 2023-09-21T12:43:02.115 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-21T12:43:02.137 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-09-21T12:43:02.207 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-09-21T12:43:02.207 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-09-21T12:43:02.208 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-09-21T12:43:02.208 INFO:teuthology.orchestra.run.smithi156.stdout:Installing group/module packages: 2023-09-21T12:43:02.208 INFO:teuthology.orchestra.run.smithi156.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-21T12:43:02.208 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-21T12:43:02.208 INFO:teuthology.orchestra.run.smithi156.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-21T12:43:02.209 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-21T12:43:02.209 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-21T12:43:02.209 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-21T12:43:02.209 INFO:teuthology.orchestra.run.smithi156.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-21T12:43:02.209 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-09-21T12:43:02.210 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-21T12:43:02.210 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-21T12:43:02.210 INFO:teuthology.orchestra.run.smithi156.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-21T12:43:02.210 INFO:teuthology.orchestra.run.smithi156.stdout:Installing module profiles: 2023-09-21T12:43:02.210 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools/common 2023-09-21T12:43:02.211 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:02.211 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-09-21T12:43:02.211 INFO:teuthology.orchestra.run.smithi156.stdout: container-tools rhel8 2023-09-21T12:43:02.211 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:02.211 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-21T12:43:02.212 INFO:teuthology.orchestra.run.smithi156.stdout:============================================================================================================ 2023-09-21T12:43:02.212 INFO:teuthology.orchestra.run.smithi156.stdout:Install 10 Packages 2023-09-21T12:43:02.212 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:02.213 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 18 M 2023-09-21T12:43:02.213 INFO:teuthology.orchestra.run.smithi156.stdout:Installed size: 65 M 2023-09-21T12:43:02.213 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-09-21T12:43:02.229 INFO:teuthology.orchestra.run.smithi160.stdout:============================================================================================================ 2023-09-21T12:43:02.229 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2023-09-21T12:43:02.230 INFO:teuthology.orchestra.run.smithi160.stdout:============================================================================================================ 2023-09-21T12:43:02.230 INFO:teuthology.orchestra.run.smithi160.stdout:Installing group/module packages: 2023-09-21T12:43:02.230 INFO:teuthology.orchestra.run.smithi160.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-21T12:43:02.230 INFO:teuthology.orchestra.run.smithi160.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-21T12:43:02.230 INFO:teuthology.orchestra.run.smithi160.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-21T12:43:02.231 INFO:teuthology.orchestra.run.smithi160.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-21T12:43:02.231 INFO:teuthology.orchestra.run.smithi160.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-21T12:43:02.231 INFO:teuthology.orchestra.run.smithi160.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-21T12:43:02.231 INFO:teuthology.orchestra.run.smithi160.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-21T12:43:02.231 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2023-09-21T12:43:02.232 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-21T12:43:02.232 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-21T12:43:02.232 INFO:teuthology.orchestra.run.smithi160.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-21T12:43:02.232 INFO:teuthology.orchestra.run.smithi160.stdout:Installing module profiles: 2023-09-21T12:43:02.232 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools/common 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout: container-tools rhel8 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2023-09-21T12:43:02.233 INFO:teuthology.orchestra.run.smithi160.stdout:============================================================================================================ 2023-09-21T12:43:02.234 INFO:teuthology.orchestra.run.smithi160.stdout:Install 10 Packages 2023-09-21T12:43:02.234 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:02.235 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 18 M 2023-09-21T12:43:02.235 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 65 M 2023-09-21T12:43:02.235 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2023-09-21T12:43:02.321 INFO:teuthology.orchestra.run.smithi156.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 844 kB/s | 94 kB 00:00 2023-09-21T12:43:02.334 INFO:teuthology.orchestra.run.smithi160.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 922 kB/s | 94 kB 00:00 2023-09-21T12:43:02.346 INFO:teuthology.orchestra.run.smithi156.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 182 kB/s | 25 kB 00:00 2023-09-21T12:43:02.359 INFO:teuthology.orchestra.run.smithi160.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 196 kB/s | 25 kB 00:00 2023-09-21T12:43:02.371 INFO:teuthology.orchestra.run.smithi156.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 252 kB/s | 41 kB 00:00 2023-09-21T12:43:02.386 INFO:teuthology.orchestra.run.smithi160.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 268 kB/s | 41 kB 00:00 2023-09-21T12:43:02.397 INFO:teuthology.orchestra.run.smithi156.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 655 kB/s | 49 kB 00:00 2023-09-21T12:43:02.430 INFO:teuthology.orchestra.run.smithi156.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-21T12:43:02.434 INFO:teuthology.orchestra.run.smithi160.stdout:(4/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-09-21T12:43:02.447 INFO:teuthology.orchestra.run.smithi156.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-09-21T12:43:02.460 INFO:teuthology.orchestra.run.smithi160.stdout:(5/10): udica-0.2.6-4.module+el8.6.0+16771+28df 393 kB/s | 49 kB 00:00 2023-09-21T12:43:02.485 INFO:teuthology.orchestra.run.smithi160.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.9 MB/s | 149 kB 00:00 2023-09-21T12:43:02.497 INFO:teuthology.orchestra.run.smithi156.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.1 MB/s | 213 kB 00:00 2023-09-21T12:43:02.510 INFO:teuthology.orchestra.run.smithi160.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-09-21T12:43:02.628 INFO:teuthology.orchestra.run.smithi160.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-09-21T12:43:02.657 INFO:teuthology.orchestra.run.smithi156.stdout:(8/10): buildah-1.26.2-1.module+el8.6.0+16771+2 28 MB/s | 8.0 MB 00:00 2023-09-21T12:43:02.706 INFO:teuthology.orchestra.run.smithi156.stdout:(9/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 11 MB/s | 2.2 MB 00:00 2023-09-21T12:43:02.719 INFO:teuthology.orchestra.run.smithi160.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 30 MB/s | 7.0 MB 00:00 2023-09-21T12:43:02.782 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-21T12:43:02.823 INFO:teuthology.orchestra.run.smithi160.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-09-21T12:43:02.823 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:43:02.824 INFO:teuthology.orchestra.run.smithi160.stdout:Total 31 MB/s | 18 MB 00:00 2023-09-21T12:43:02.825 INFO:teuthology.orchestra.run.smithi156.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 19 MB/s | 7.0 MB 00:00 2023-09-21T12:43:02.825 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:43:02.826 INFO:teuthology.orchestra.run.smithi156.stdout:Total 30 MB/s | 18 MB 00:00 2023-09-21T12:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================ 2023-09-21T12:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-09-21T12:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================ 2023-09-21T12:43:02.882 INFO:teuthology.orchestra.run.smithi142.stdout:Installing group/module packages: 2023-09-21T12:43:02.883 INFO:teuthology.orchestra.run.smithi142.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-21T12:43:02.883 INFO:teuthology.orchestra.run.smithi142.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-21T12:43:02.883 INFO:teuthology.orchestra.run.smithi142.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-21T12:43:02.883 INFO:teuthology.orchestra.run.smithi142.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-21T12:43:02.883 INFO:teuthology.orchestra.run.smithi142.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-21T12:43:02.884 INFO:teuthology.orchestra.run.smithi142.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-21T12:43:02.884 INFO:teuthology.orchestra.run.smithi142.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-21T12:43:02.884 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-09-21T12:43:02.884 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-21T12:43:02.885 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-21T12:43:02.885 INFO:teuthology.orchestra.run.smithi142.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-21T12:43:02.885 INFO:teuthology.orchestra.run.smithi142.stdout:Installing module profiles: 2023-09-21T12:43:02.885 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools/common 2023-09-21T12:43:02.885 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:02.886 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling module streams: 2023-09-21T12:43:02.886 INFO:teuthology.orchestra.run.smithi142.stdout: container-tools rhel8 2023-09-21T12:43:02.886 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:02.886 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-09-21T12:43:02.886 INFO:teuthology.orchestra.run.smithi142.stdout:============================================================================================================ 2023-09-21T12:43:02.887 INFO:teuthology.orchestra.run.smithi142.stdout:Install 10 Packages 2023-09-21T12:43:02.887 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:02.887 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 18 M 2023-09-21T12:43:02.888 INFO:teuthology.orchestra.run.smithi142.stdout:Installed size: 65 M 2023-09-21T12:43:02.888 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-09-21T12:43:02.963 INFO:teuthology.orchestra.run.smithi142.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-09-21T12:43:02.989 INFO:teuthology.orchestra.run.smithi142.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 241 kB/s | 25 kB 00:00 2023-09-21T12:43:03.014 INFO:teuthology.orchestra.run.smithi142.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 317 kB/s | 41 kB 00:00 2023-09-21T12:43:03.023 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2023-09-21T12:43:03.025 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-09-21T12:43:03.039 INFO:teuthology.orchestra.run.smithi142.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 651 kB/s | 49 kB 00:00 2023-09-21T12:43:03.042 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2023-09-21T12:43:03.043 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2023-09-21T12:43:03.044 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-09-21T12:43:03.044 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-09-21T12:43:03.073 INFO:teuthology.orchestra.run.smithi142.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-21T12:43:03.098 INFO:teuthology.orchestra.run.smithi142.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-09-21T12:43:03.123 INFO:teuthology.orchestra.run.smithi142.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-09-21T12:43:03.225 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2023-09-21T12:43:03.227 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-09-21T12:43:03.229 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2023-09-21T12:43:03.231 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-09-21T12:43:03.240 INFO:teuthology.orchestra.run.smithi142.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-09-21T12:43:03.391 INFO:teuthology.orchestra.run.smithi142.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 24 MB/s | 7.0 MB 00:00 2023-09-21T12:43:03.483 INFO:teuthology.orchestra.run.smithi142.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 17 MB/s | 8.0 MB 00:00 2023-09-21T12:43:03.483 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:43:03.484 INFO:teuthology.orchestra.run.smithi142.stdout:Total 30 MB/s | 18 MB 00:00 2023-09-21T12:43:03.747 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2023-09-21T12:43:03.758 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-09-21T12:43:03.815 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-09-21T12:43:03.838 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-09-21T12:43:03.838 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-09-21T12:43:03.915 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-21T12:43:03.920 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-21T12:43:04.090 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:04.242 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:04.301 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-21T12:43:04.397 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-09-21T12:43:04.402 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-09-21T12:43:04.486 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-21T12:43:04.503 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-21T12:43:04.679 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-21T12:43:04.860 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-21T12:43:04.971 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-09-21T12:43:05.062 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-21T12:43:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-21T12:43:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-21T12:43:05.626 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-21T12:43:05.827 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-21T12:43:05.832 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-21T12:43:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-21T12:43:06.492 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-21T12:43:06.716 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-21T12:43:06.769 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-21T12:43:06.897 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-21T12:43:06.962 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-21T12:43:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-21T12:43:07.074 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:07.131 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-21T12:43:07.275 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:07.345 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:07.346 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-21T12:43:07.346 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:07.346 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-21T12:43:07.346 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-21T12:43:07.346 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-21T12:43:07.347 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-21T12:43:07.347 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-21T12:43:07.347 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-21T12:43:07.347 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-21T12:43:07.531 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:07.531 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-21T12:43:07.531 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:07.531 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-21T12:43:07.532 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-21T12:43:07.532 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-21T12:43:07.532 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-21T12:43:07.532 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-21T12:43:07.532 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-21T12:43:07.533 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-21T12:43:07.967 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-21T12:43:08.274 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-21T12:43:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-21T12:43:08.530 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-21T12:43:08.531 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:04:51 ago on Thu 21 Sep 2023 12:38:17 PM UTC. 2023-09-21T12:43:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:08.699 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-21T12:43:08.700 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:04:50 ago on Thu 21 Sep 2023 12:38:18 PM UTC. 2023-09-21T12:43:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-21T12:43:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-21T12:43:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-21T12:43:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-21T12:43:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-21T12:43:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-21T12:43:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-21T12:43:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-21T12:43:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-21T12:43:09.079 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-21T12:43:10.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-21T12:43:10.643 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:02 ago on Thu 21 Sep 2023 12:41:08 PM UTC. 2023-09-21T12:43:11.775 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2023-09-21T12:43:11.918 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-09-21T12:43:11.986 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:11.987 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2023-09-21T12:43:11.987 INFO:teuthology.orchestra.run.smithi160.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:11.987 INFO:teuthology.orchestra.run.smithi160.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:11.987 INFO:teuthology.orchestra.run.smithi160.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:11.988 INFO:teuthology.orchestra.run.smithi160.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-21T12:43:11.988 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-21T12:43:11.988 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-21T12:43:11.988 INFO:teuthology.orchestra.run.smithi160.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:11.989 INFO:teuthology.orchestra.run.smithi160.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:11.989 INFO:teuthology.orchestra.run.smithi160.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:11.989 INFO:teuthology.orchestra.run.smithi160.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-21T12:43:11.989 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:11.989 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-09-21T12:43:12.128 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:12.128 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-09-21T12:43:12.128 INFO:teuthology.orchestra.run.smithi156.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:12.129 INFO:teuthology.orchestra.run.smithi156.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:12.129 INFO:teuthology.orchestra.run.smithi156.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:12.129 INFO:teuthology.orchestra.run.smithi156.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-21T12:43:12.129 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-21T12:43:12.130 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-21T12:43:12.130 INFO:teuthology.orchestra.run.smithi156.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:12.130 INFO:teuthology.orchestra.run.smithi156.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:12.130 INFO:teuthology.orchestra.run.smithi156.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:12.130 INFO:teuthology.orchestra.run.smithi156.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-21T12:43:12.131 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:12.131 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-21T12:43:12.173 DEBUG:teuthology.parallel:result is None 2023-09-21T12:43:12.305 DEBUG:teuthology.parallel:result is None 2023-09-21T12:43:13.660 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2023-09-21T12:43:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:13.870 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-09-21T12:43:13.870 INFO:teuthology.orchestra.run.smithi142.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-21T12:43:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-21T12:43:13.871 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-21T12:43:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-21T12:43:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-21T12:43:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-21T12:43:13.872 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:13.873 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-21T12:43:14.095 DEBUG:teuthology.parallel:result is None 2023-09-21T12:43:14.096 INFO:teuthology.run_tasks:Running task install... 2023-09-21T12:43:14.105 DEBUG:teuthology.task.install:project ceph 2023-09-21T12:43:14.105 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '41c9e835c3f621102ade35dd597317a42116a491'}} 2023-09-21T12:43:14.105 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '41c9e835c3f621102ade35dd597317a42116a491'} 2023-09-21T12:43:14.106 INFO:teuthology.task.install:Using flavor: default 2023-09-21T12:43:14.112 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-21T12:43:14.112 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-21T12:43:14.113 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '41c9e835c3f621102ade35dd597317a42116a491', 'tag': None, 'wait_for_package': False} 2023-09-21T12:43:14.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:43:14.116 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '41c9e835c3f621102ade35dd597317a42116a491', 'tag': None, 'wait_for_package': False} 2023-09-21T12:43:14.116 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:43:14.117 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '41c9e835c3f621102ade35dd597317a42116a491', 'tag': None, 'wait_for_package': False} 2023-09-21T12:43:14.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:43:14.268 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/ 2023-09-21T12:43:14.268 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6168.g41c9e835 2023-09-21T12:43:14.342 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/ 2023-09-21T12:43:14.342 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6168.g41c9e835 2023-09-21T12:43:14.354 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/ 2023-09-21T12:43:14.355 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6168.g41c9e835 2023-09-21T12:43:14.454 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-21T12:43:14.454 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:43:14.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-21T12:43:14.481 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-21T12:43:14.481 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/41c9e835c3f621102ade35dd597317a42116a491/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-21T12:43:14.515 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-21T12:43:14.515 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:43:14.515 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-21T12:43:14.522 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-21T12:43:14.523 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:43:14.523 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-21T12:43:14.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-21T12:43:14.551 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-21T12:43:14.551 DEBUG:teuthology.orchestra.run.smithi156:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/41c9e835c3f621102ade35dd597317a42116a491/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-21T12:43:14.584 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-21T12:43:14.585 DEBUG:teuthology.orchestra.run.smithi142:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/41c9e835c3f621102ade35dd597317a42116a491/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-21T12:43:14.621 DEBUG:teuthology.orchestra.run.smithi156:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-21T12:43:14.627 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-21T12:43:14.693 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2023-09-21T12:43:14.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-21T12:43:14.695 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2023-09-21T12:43:14.700 DEBUG:teuthology.orchestra.run.smithi156:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-21T12:43:14.767 INFO:teuthology.orchestra.run.smithi156.stdout:check_obsoletes = 1 2023-09-21T12:43:14.769 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum clean all 2023-09-21T12:43:14.791 DEBUG:teuthology.orchestra.run.smithi142:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-21T12:43:14.858 INFO:teuthology.orchestra.run.smithi142.stdout:check_obsoletes = 1 2023-09-21T12:43:14.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum clean all 2023-09-21T12:43:15.123 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:15.200 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:15.308 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:15.415 INFO:teuthology.orchestra.run.smithi160.stdout:44 files removed 2023-09-21T12:43:15.474 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-21T12:43:15.498 INFO:teuthology.orchestra.run.smithi156.stdout:44 files removed 2023-09-21T12:43:15.554 DEBUG:teuthology.orchestra.run.smithi156:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-21T12:43:15.645 INFO:teuthology.orchestra.run.smithi142.stdout:44 files removed 2023-09-21T12:43:15.700 DEBUG:teuthology.orchestra.run.smithi142:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-21T12:43:15.846 INFO:teuthology.orchestra.run.smithi160.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:15.907 INFO:teuthology.orchestra.run.smithi156.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:16.145 INFO:teuthology.orchestra.run.smithi142.stdout:Updating Subscription Management repositories. 2023-09-21T12:43:16.609 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 248 kB/s | 81 kB 00:00 2023-09-21T12:43:16.731 INFO:teuthology.orchestra.run.smithi156.stdout:ceph packages for x86_64 222 kB/s | 81 kB 00:00 2023-09-21T12:43:16.842 INFO:teuthology.orchestra.run.smithi142.stdout:ceph packages for x86_64 316 kB/s | 81 kB 00:00 2023-09-21T12:43:16.977 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-21T12:43:17.091 INFO:teuthology.orchestra.run.smithi156.stdout:ceph noarch packages 29 kB/s | 9.4 kB 00:00 2023-09-21T12:43:17.210 INFO:teuthology.orchestra.run.smithi142.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-09-21T12:43:17.328 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 4.5 kB/s | 1.5 kB 00:00 2023-09-21T12:43:17.442 INFO:teuthology.orchestra.run.smithi156.stdout:ceph source packages 4.6 kB/s | 1.5 kB 00:00 2023-09-21T12:43:17.470 INFO:teuthology.orchestra.run.smithi160.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-21T12:43:17.527 INFO:teuthology.orchestra.run.smithi142.stdout:ceph source packages 5.1 kB/s | 1.5 kB 00:00 2023-09-21T12:43:17.584 INFO:teuthology.orchestra.run.smithi156.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-21T12:43:17.711 INFO:teuthology.orchestra.run.smithi142.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-09-21T12:43:18.520 INFO:teuthology.orchestra.run.smithi156.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-09-21T12:43:18.731 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-21T12:43:19.170 INFO:teuthology.orchestra.run.smithi142.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-09-21T12:43:22.234 INFO:teuthology.orchestra.run.smithi156.stdout:lab-extras 300 kB/s | 24 kB 00:00 2023-09-21T12:43:22.387 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 472 kB/s | 24 kB 00:00 2023-09-21T12:43:23.287 INFO:teuthology.orchestra.run.smithi142.stdout:lab-extras 404 kB/s | 24 kB 00:00 2023-09-21T12:43:23.308 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-09-21T12:43:23.342 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-09-21T12:43:24.414 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 50 MB/s | 53 MB 00:01 2023-09-21T12:43:31.233 INFO:teuthology.orchestra.run.smithi156.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-09-21T12:43:31.234 INFO:teuthology.orchestra.run.smithi160.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 53 MB 00:00 2023-09-21T12:43:33.553 INFO:teuthology.orchestra.run.smithi142.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 37 MB/s | 47 MB 00:01 2023-09-21T12:43:42.253 INFO:teuthology.orchestra.run.smithi156.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:42.254 INFO:teuthology.orchestra.run.smithi156.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi156.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi156.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi156.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi156.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T12:43:42.273 INFO:teuthology.orchestra.run.smithi156.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T12:43:42.276 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.277 INFO:teuthology.orchestra.run.smithi156.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T12:43:42.337 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:42.338 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:42.353 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.354 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.355 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T12:43:42.356 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T12:43:42.359 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T12:43:42.362 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T12:43:42.363 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T12:43:42.412 INFO:teuthology.orchestra.run.smithi156.stdout:Dependencies resolved. 2023-09-21T12:43:42.425 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-09-21T12:43:42.425 INFO:teuthology.orchestra.run.smithi156.stdout: Package Arch Version Repository Size 2023-09-21T12:43:42.425 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-09-21T12:43:42.425 INFO:teuthology.orchestra.run.smithi156.stdout:Installing: 2023-09-21T12:43:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-21T12:43:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-21T12:43:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: ceph x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.4 k 2023-09-21T12:43:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 5.4 M 2023-09-21T12:43:42.426 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 907 k 2023-09-21T12:43:42.427 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 167 k 2023-09-21T12:43:42.427 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 1.6 M 2023-09-21T12:43:42.427 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 132 k 2023-09-21T12:43:42.427 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 1.7 M 2023-09-21T12:43:42.427 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 7.4 M 2023-09-21T12:43:42.428 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 47 k 2023-09-21T12:43:42.428 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 14 M 2023-09-21T12:43:42.428 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 49 M 2023-09-21T12:43:42.428 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 261 k 2023-09-21T12:43:42.428 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 179 k 2023-09-21T12:43:42.429 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 260 k 2023-09-21T12:43:42.429 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 18 k 2023-09-21T12:43:42.429 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-21T12:43:42.429 INFO:teuthology.orchestra.run.smithi156.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-21T12:43:42.430 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-21T12:43:42.430 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 31 k 2023-09-21T12:43:42.430 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 829 k 2023-09-21T12:43:42.430 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 139 k 2023-09-21T12:43:42.430 INFO:teuthology.orchestra.run.smithi156.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-21T12:43:42.431 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-21T12:43:42.431 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-21T12:43:42.431 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-21T12:43:42.431 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-21T12:43:42.431 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-21T12:43:42.432 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 196 k 2023-09-21T12:43:42.432 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 371 k 2023-09-21T12:43:42.432 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 364 k 2023-09-21T12:43:42.432 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 107 k 2023-09-21T12:43:42.432 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 94 k 2023-09-21T12:43:42.433 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.6 M 2023-09-21T12:43:42.433 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 179 k 2023-09-21T12:43:42.433 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-21T12:43:42.433 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrading: 2023-09-21T12:43:42.433 INFO:teuthology.orchestra.run.smithi156.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-21T12:43:42.434 INFO:teuthology.orchestra.run.smithi156.stdout: librados2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:42.434 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:42.434 INFO:teuthology.orchestra.run.smithi156.stdout:Installing dependencies: 2023-09-21T12:43:42.434 INFO:teuthology.orchestra.run.smithi156.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-21T12:43:42.435 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 23 M 2023-09-21T12:43:42.435 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 23 k 2023-09-21T12:43:42.435 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 2.3 M 2023-09-21T12:43:42.435 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 242 k 2023-09-21T12:43:42.435 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 4.6 M 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 18 M 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 15 k 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 24 k 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-21T12:43:42.436 INFO:teuthology.orchestra.run.smithi156.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-21T12:43:42.437 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-21T12:43:42.437 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-21T12:43:42.437 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 183 k 2023-09-21T12:43:42.437 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-21T12:43:42.437 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-21T12:43:42.438 INFO:teuthology.orchestra.run.smithi156.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-21T12:43:42.438 INFO:teuthology.orchestra.run.smithi156.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-21T12:43:42.438 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-21T12:43:42.438 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-21T12:43:42.438 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 518 k 2023-09-21T12:43:42.439 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-21T12:43:42.439 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.9 M 2023-09-21T12:43:42.439 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-21T12:43:42.439 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-21T12:43:42.440 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-21T12:43:42.440 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-21T12:43:42.440 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-21T12:43:42.440 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-21T12:43:42.440 INFO:teuthology.orchestra.run.smithi156.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-21T12:43:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-21T12:43:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-21T12:43:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-21T12:43:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-21T12:43:42.441 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-21T12:43:42.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-21T12:43:42.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-21T12:43:42.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-21T12:43:42.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-21T12:43:42.442 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 45 k 2023-09-21T12:43:42.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 125 k 2023-09-21T12:43:42.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-21T12:43:42.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-21T12:43:42.443 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-21T12:43:42.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-21T12:43:42.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-21T12:43:42.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-21T12:43:42.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-21T12:43:42.444 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-21T12:43:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T12:43:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-21T12:43:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-21T12:43:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:42.445 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-21T12:43:42.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-21T12:43:42.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-21T12:43:42.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-21T12:43:42.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-21T12:43:42.446 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-21T12:43:42.447 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-21T12:43:42.447 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-21T12:43:42.447 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-21T12:43:42.447 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-21T12:43:42.447 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-21T12:43:42.448 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-21T12:43:42.448 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-21T12:43:42.448 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-21T12:43:42.448 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-21T12:43:42.448 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-21T12:43:42.449 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-21T12:43:42.449 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-21T12:43:42.449 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:42.449 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-21T12:43:42.449 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-21T12:43:42.450 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-21T12:43:42.451 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-21T12:43:42.451 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-21T12:43:42.451 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-21T12:43:42.451 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-21T12:43:42.452 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-21T12:43:42.452 INFO:teuthology.orchestra.run.smithi156.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-21T12:43:42.452 INFO:teuthology.orchestra.run.smithi156.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-21T12:43:42.452 INFO:teuthology.orchestra.run.smithi156.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-21T12:43:42.452 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-21T12:43:42.453 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-21T12:43:42.453 INFO:teuthology.orchestra.run.smithi156.stdout:Enabling module streams: 2023-09-21T12:43:42.453 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql 10 2023-09-21T12:43:42.453 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:42.453 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction Summary 2023-09-21T12:43:42.454 INFO:teuthology.orchestra.run.smithi156.stdout:=========================================================================================================================== 2023-09-21T12:43:42.454 INFO:teuthology.orchestra.run.smithi156.stdout:Install 128 Packages 2023-09-21T12:43:42.454 INFO:teuthology.orchestra.run.smithi156.stdout:Upgrade 3 Packages 2023-09-21T12:43:42.454 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:43:42.455 INFO:teuthology.orchestra.run.smithi156.stdout:Total download size: 208 M 2023-09-21T12:43:42.455 INFO:teuthology.orchestra.run.smithi156.stdout:Downloading Packages: 2023-09-21T12:43:42.496 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2023-09-21T12:43:42.508 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-09-21T12:43:42.508 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2023-09-21T12:43:42.508 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-09-21T12:43:42.509 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2023-09-21T12:43:42.509 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-21T12:43:42.509 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-21T12:43:42.509 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.4 k 2023-09-21T12:43:42.510 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 5.4 M 2023-09-21T12:43:42.510 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 907 k 2023-09-21T12:43:42.510 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 167 k 2023-09-21T12:43:42.510 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 1.6 M 2023-09-21T12:43:42.510 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 132 k 2023-09-21T12:43:42.511 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 1.7 M 2023-09-21T12:43:42.511 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 7.4 M 2023-09-21T12:43:42.511 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 47 k 2023-09-21T12:43:42.511 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 14 M 2023-09-21T12:43:42.511 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 49 M 2023-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 261 k 2023-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 179 k 2023-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 260 k 2023-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 18 k 2023-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-21T12:43:42.513 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-21T12:43:42.513 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-21T12:43:42.513 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 31 k 2023-09-21T12:43:42.513 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 829 k 2023-09-21T12:43:42.513 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 139 k 2023-09-21T12:43:42.514 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-21T12:43:42.514 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-21T12:43:42.514 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-21T12:43:42.514 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-21T12:43:42.515 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-21T12:43:42.515 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-21T12:43:42.515 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 196 k 2023-09-21T12:43:42.515 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 371 k 2023-09-21T12:43:42.515 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 364 k 2023-09-21T12:43:42.516 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 107 k 2023-09-21T12:43:42.516 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 94 k 2023-09-21T12:43:42.516 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.6 M 2023-09-21T12:43:42.516 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 179 k 2023-09-21T12:43:42.516 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-21T12:43:42.517 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2023-09-21T12:43:42.517 INFO:teuthology.orchestra.run.smithi160.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-21T12:43:42.517 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:42.517 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:42.517 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2023-09-21T12:43:42.518 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-21T12:43:42.518 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 23 M 2023-09-21T12:43:42.518 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 23 k 2023-09-21T12:43:42.518 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 2.3 M 2023-09-21T12:43:42.518 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 242 k 2023-09-21T12:43:42.519 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 4.6 M 2023-09-21T12:43:42.519 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 18 M 2023-09-21T12:43:42.519 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 15 k 2023-09-21T12:43:42.519 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 24 k 2023-09-21T12:43:42.519 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 183 k 2023-09-21T12:43:42.520 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-21T12:43:42.521 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-21T12:43:42.521 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-21T12:43:42.521 INFO:teuthology.orchestra.run.smithi160.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-21T12:43:42.521 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-21T12:43:42.521 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-21T12:43:42.522 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 518 k 2023-09-21T12:43:42.522 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-21T12:43:42.522 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.9 M 2023-09-21T12:43:42.522 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-21T12:43:42.523 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-21T12:43:42.523 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-21T12:43:42.523 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-21T12:43:42.523 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-21T12:43:42.524 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-21T12:43:42.524 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-21T12:43:42.524 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-21T12:43:42.524 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-21T12:43:42.524 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-21T12:43:42.525 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-21T12:43:42.525 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-21T12:43:42.526 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-21T12:43:42.526 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-21T12:43:42.526 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-21T12:43:42.526 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-21T12:43:42.527 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 45 k 2023-09-21T12:43:42.527 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 125 k 2023-09-21T12:43:42.527 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-21T12:43:42.527 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-21T12:43:42.528 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-21T12:43:42.529 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T12:43:42.529 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-21T12:43:42.529 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-21T12:43:42.529 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:42.529 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-21T12:43:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-21T12:43:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-21T12:43:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-21T12:43:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-21T12:43:42.530 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-21T12:43:42.531 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-21T12:43:42.531 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-21T12:43:42.531 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-21T12:43:42.531 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-21T12:43:42.531 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-21T12:43:42.532 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-21T12:43:42.532 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-21T12:43:42.532 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-21T12:43:42.532 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-21T12:43:42.532 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-21T12:43:42.533 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-21T12:43:42.533 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-21T12:43:42.533 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:42.533 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-21T12:43:42.533 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-21T12:43:42.534 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-21T12:43:42.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-21T12:43:42.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-21T12:43:42.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-21T12:43:42.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-21T12:43:42.535 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-21T12:43:42.536 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-21T12:43:42.536 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-21T12:43:42.536 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-21T12:43:42.536 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-21T12:43:42.536 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-21T12:43:42.537 INFO:teuthology.orchestra.run.smithi160.stdout:Enabling module streams: 2023-09-21T12:43:42.537 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql 10 2023-09-21T12:43:42.537 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:42.537 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2023-09-21T12:43:42.537 INFO:teuthology.orchestra.run.smithi160.stdout:=========================================================================================================================== 2023-09-21T12:43:42.538 INFO:teuthology.orchestra.run.smithi160.stdout:Install 128 Packages 2023-09-21T12:43:42.538 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 3 Packages 2023-09-21T12:43:42.538 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:43:42.539 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 208 M 2023-09-21T12:43:42.539 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2023-09-21T12:43:42.676 INFO:teuthology.orchestra.run.smithi156.stdout:(1/131): ceph-18.0.0-6168.g41c9e835.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-09-21T12:43:42.677 INFO:teuthology.orchestra.run.smithi160.stdout:(1/131): ceph-18.0.0-6168.g41c9e835.el8.x86_64. 53 kB/s | 6.4 kB 00:00 2023-09-21T12:43:42.927 INFO:teuthology.orchestra.run.smithi160.stdout:(2/131): ceph-fuse-18.0.0-6168.g41c9e835.el8.x8 3.5 MB/s | 907 kB 00:00 2023-09-21T12:43:42.994 INFO:teuthology.orchestra.run.smithi160.stdout:(3/131): ceph-immutable-object-cache-18.0.0-616 2.4 MB/s | 167 kB 00:00 2023-09-21T12:43:43.043 INFO:teuthology.orchestra.run.smithi156.stdout:(2/131): ceph-fuse-18.0.0-6168.g41c9e835.el8.x8 2.4 MB/s | 907 kB 00:00 2023-09-21T12:43:43.135 INFO:teuthology.orchestra.run.smithi156.stdout:(3/131): ceph-immutable-object-cache-18.0.0-616 1.8 MB/s | 167 kB 00:00 2023-09-21T12:43:43.360 INFO:teuthology.orchestra.run.smithi156.stdout:(4/131): ceph-base-18.0.0-6168.g41c9e835.el8.x8 6.1 MB/s | 5.4 MB 00:00 2023-09-21T12:43:43.494 INFO:teuthology.orchestra.run.smithi160.stdout:(4/131): ceph-mds-18.0.0-6168.g41c9e835.el8.x86 4.7 MB/s | 2.3 MB 00:00 2023-09-21T12:43:43.627 INFO:teuthology.orchestra.run.smithi156.stdout:(5/131): ceph-mgr-18.0.0-6168.g41c9e835.el8.x86 6.1 MB/s | 1.6 MB 00:00 2023-09-21T12:43:43.911 INFO:teuthology.orchestra.run.smithi160.stdout:(5/131): ceph-mgr-18.0.0-6168.g41c9e835.el8.x86 3.9 MB/s | 1.6 MB 00:00 2023-09-21T12:43:43.944 INFO:teuthology.orchestra.run.smithi156.stdout:(6/131): ceph-mds-18.0.0-6168.g41c9e835.el8.x86 2.9 MB/s | 2.3 MB 00:00 2023-09-21T12:43:44.795 INFO:teuthology.orchestra.run.smithi160.stdout:(6/131): ceph-mon-18.0.0-6168.g41c9e835.el8.x86 5.2 MB/s | 4.6 MB 00:00 2023-09-21T12:43:44.802 INFO:teuthology.orchestra.run.smithi156.stdout:(7/131): ceph-mon-18.0.0-6168.g41c9e835.el8.x86 3.9 MB/s | 4.6 MB 00:01 2023-09-21T12:43:44.862 INFO:teuthology.orchestra.run.smithi160.stdout:(7/131): ceph-base-18.0.0-6168.g41c9e835.el8.x8 2.3 MB/s | 5.4 MB 00:02 2023-09-21T12:43:45.028 INFO:teuthology.orchestra.run.smithi156.stdout:(8/131): ceph-common-18.0.0-6168.g41c9e835.el8. 8.9 MB/s | 23 MB 00:02 2023-09-21T12:43:45.095 INFO:teuthology.orchestra.run.smithi156.stdout:(9/131): ceph-selinux-18.0.0-6168.g41c9e835.el8 366 kB/s | 24 kB 00:00 2023-09-21T12:43:45.158 INFO:teuthology.orchestra.run.smithi142.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:45.159 INFO:teuthology.orchestra.run.smithi142.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-21T12:43:45.174 INFO:teuthology.orchestra.run.smithi142.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:45.175 INFO:teuthology.orchestra.run.smithi142.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-21T12:43:45.176 INFO:teuthology.orchestra.run.smithi142.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-21T12:43:45.177 INFO:teuthology.orchestra.run.smithi142.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-21T12:43:45.179 INFO:teuthology.orchestra.run.smithi142.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-21T12:43:45.183 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-21T12:43:45.184 INFO:teuthology.orchestra.run.smithi142.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-21T12:43:45.321 INFO:teuthology.orchestra.run.smithi142.stdout:Dependencies resolved. 2023-09-21T12:43:45.334 INFO:teuthology.orchestra.run.smithi142.stdout:=========================================================================================================================== 2023-09-21T12:43:45.334 INFO:teuthology.orchestra.run.smithi142.stdout: Package Arch Version Repository Size 2023-09-21T12:43:45.334 INFO:teuthology.orchestra.run.smithi142.stdout:=========================================================================================================================== 2023-09-21T12:43:45.334 INFO:teuthology.orchestra.run.smithi142.stdout:Installing: 2023-09-21T12:43:45.335 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-21T12:43:45.335 INFO:teuthology.orchestra.run.smithi142.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-21T12:43:45.335 INFO:teuthology.orchestra.run.smithi142.stdout: ceph x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.4 k 2023-09-21T12:43:45.335 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 5.4 M 2023-09-21T12:43:45.335 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 907 k 2023-09-21T12:43:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 167 k 2023-09-21T12:43:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 1.6 M 2023-09-21T12:43:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 132 k 2023-09-21T12:43:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 1.7 M 2023-09-21T12:43:45.336 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 7.4 M 2023-09-21T12:43:45.337 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 47 k 2023-09-21T12:43:45.337 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 14 M 2023-09-21T12:43:45.337 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 49 M 2023-09-21T12:43:45.337 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 261 k 2023-09-21T12:43:45.337 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 179 k 2023-09-21T12:43:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 260 k 2023-09-21T12:43:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 18 k 2023-09-21T12:43:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-21T12:43:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-21T12:43:45.338 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-21T12:43:45.339 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 31 k 2023-09-21T12:43:45.339 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 829 k 2023-09-21T12:43:45.339 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 139 k 2023-09-21T12:43:45.339 INFO:teuthology.orchestra.run.smithi142.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-21T12:43:45.340 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-21T12:43:45.340 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-21T12:43:45.340 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-21T12:43:45.340 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-21T12:43:45.340 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-21T12:43:45.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 196 k 2023-09-21T12:43:45.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 371 k 2023-09-21T12:43:45.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 364 k 2023-09-21T12:43:45.341 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 107 k 2023-09-21T12:43:45.341 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 94 k 2023-09-21T12:43:45.342 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.6 M 2023-09-21T12:43:45.342 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 179 k 2023-09-21T12:43:45.342 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-21T12:43:45.342 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrading: 2023-09-21T12:43:45.342 INFO:teuthology.orchestra.run.smithi142.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-21T12:43:45.343 INFO:teuthology.orchestra.run.smithi142.stdout: librados2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:45.343 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 3.7 M 2023-09-21T12:43:45.343 INFO:teuthology.orchestra.run.smithi142.stdout:Installing dependencies: 2023-09-21T12:43:45.343 INFO:teuthology.orchestra.run.smithi142.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-21T12:43:45.343 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 23 M 2023-09-21T12:43:45.344 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 23 k 2023-09-21T12:43:45.344 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 2.3 M 2023-09-21T12:43:45.344 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 242 k 2023-09-21T12:43:45.344 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 4.6 M 2023-09-21T12:43:45.344 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 18 M 2023-09-21T12:43:45.345 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6168.g41c9e835.el8 ceph-noarch 15 k 2023-09-21T12:43:45.345 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 24 k 2023-09-21T12:43:45.345 INFO:teuthology.orchestra.run.smithi142.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-21T12:43:45.345 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-21T12:43:45.345 INFO:teuthology.orchestra.run.smithi142.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-21T12:43:45.346 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-21T12:43:45.346 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-21T12:43:45.346 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 183 k 2023-09-21T12:43:45.346 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-21T12:43:45.349 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-21T12:43:45.349 INFO:teuthology.orchestra.run.smithi142.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-21T12:43:45.349 INFO:teuthology.orchestra.run.smithi142.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-21T12:43:45.349 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-21T12:43:45.350 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-21T12:43:45.350 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 518 k 2023-09-21T12:43:45.350 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-21T12:43:45.350 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2 x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 6.9 M 2023-09-21T12:43:45.350 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-21T12:43:45.351 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-21T12:43:45.351 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-21T12:43:45.351 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-21T12:43:45.351 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-21T12:43:45.352 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-21T12:43:45.352 INFO:teuthology.orchestra.run.smithi142.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-21T12:43:45.352 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-21T12:43:45.352 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-21T12:43:45.352 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-21T12:43:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-21T12:43:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-21T12:43:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-21T12:43:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-21T12:43:45.353 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-21T12:43:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-21T12:43:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 45 k 2023-09-21T12:43:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common x86_64 2:18.0.0-6168.g41c9e835.el8 ceph 125 k 2023-09-21T12:43:45.354 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-21T12:43:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-21T12:43:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-21T12:43:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-21T12:43:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-21T12:43:45.355 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-21T12:43:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-21T12:43:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-21T12:43:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-21T12:43:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-21T12:43:45.356 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-21T12:43:45.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:45.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-21T12:43:45.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-21T12:43:45.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-21T12:43:45.357 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-21T12:43:45.358 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-21T12:43:45.358 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-21T12:43:45.358 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-21T12:43:45.358 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-21T12:43:45.358 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-21T12:43:45.359 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-21T12:43:45.359 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-21T12:43:45.359 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-21T12:43:45.359 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-21T12:43:45.359 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-21T12:43:45.360 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-21T12:43:45.360 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-21T12:43:45.360 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-21T12:43:45.360 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-21T12:43:45.361 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-21T12:43:45.361 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-21T12:43:45.361 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-21T12:43:45.361 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-21T12:43:45.361 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-21T12:43:45.362 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-21T12:43:45.362 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-21T12:43:45.362 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-21T12:43:45.362 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-21T12:43:45.362 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-21T12:43:45.363 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-21T12:43:45.363 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-21T12:43:45.363 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-21T12:43:45.363 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-21T12:43:45.363 INFO:teuthology.orchestra.run.smithi142.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-21T12:43:45.364 INFO:teuthology.orchestra.run.smithi142.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-21T12:43:45.364 INFO:teuthology.orchestra.run.smithi142.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-21T12:43:45.364 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-21T12:43:45.364 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-21T12:43:45.365 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling module streams: 2023-09-21T12:43:45.365 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql 10 2023-09-21T12:43:45.365 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:45.365 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction Summary 2023-09-21T12:43:45.365 INFO:teuthology.orchestra.run.smithi142.stdout:=========================================================================================================================== 2023-09-21T12:43:45.366 INFO:teuthology.orchestra.run.smithi142.stdout:Install 128 Packages 2023-09-21T12:43:45.366 INFO:teuthology.orchestra.run.smithi142.stdout:Upgrade 3 Packages 2023-09-21T12:43:45.366 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:43:45.367 INFO:teuthology.orchestra.run.smithi142.stdout:Total download size: 208 M 2023-09-21T12:43:45.367 INFO:teuthology.orchestra.run.smithi142.stdout:Downloading Packages: 2023-09-21T12:43:46.057 INFO:teuthology.orchestra.run.smithi142.stdout:(1/131): ceph-18.0.0-6168.g41c9e835.el8.x86_64. 18 kB/s | 6.4 kB 00:00 2023-09-21T12:43:47.015 INFO:teuthology.orchestra.run.smithi142.stdout:(2/131): ceph-fuse-18.0.0-6168.g41c9e835.el8.x8 947 kB/s | 907 kB 00:00 2023-09-21T12:43:47.216 INFO:teuthology.orchestra.run.smithi142.stdout:(3/131): ceph-immutable-object-cache-18.0.0-616 835 kB/s | 167 kB 00:00 2023-09-21T12:43:48.376 INFO:teuthology.orchestra.run.smithi142.stdout:(4/131): ceph-mds-18.0.0-6168.g41c9e835.el8.x86 2.0 MB/s | 2.3 MB 00:01 2023-09-21T12:43:48.933 INFO:teuthology.orchestra.run.smithi142.stdout:(5/131): ceph-mgr-18.0.0-6168.g41c9e835.el8.x86 2.9 MB/s | 1.6 MB 00:00 2023-09-21T12:43:48.978 INFO:teuthology.orchestra.run.smithi160.stdout:(8/131): ceph-common-18.0.0-6168.g41c9e835.el8. 3.5 MB/s | 23 MB 00:06 2023-09-21T12:43:49.019 INFO:teuthology.orchestra.run.smithi142.stdout:(6/131): ceph-base-18.0.0-6168.g41c9e835.el8.x8 1.6 MB/s | 5.4 MB 00:03 2023-09-21T12:43:49.087 INFO:teuthology.orchestra.run.smithi160.stdout:(9/131): ceph-selinux-18.0.0-6168.g41c9e835.el8 224 kB/s | 24 kB 00:00 2023-09-21T12:43:50.167 INFO:teuthology.orchestra.run.smithi142.stdout:(7/131): ceph-mon-18.0.0-6168.g41c9e835.el8.x86 3.7 MB/s | 4.6 MB 00:01 2023-09-21T12:43:50.262 INFO:teuthology.orchestra.run.smithi156.stdout:(10/131): ceph-test-18.0.0-6168.g41c9e835.el8.x 9.5 MB/s | 49 MB 00:05 2023-09-21T12:43:50.412 INFO:teuthology.orchestra.run.smithi156.stdout:(11/131): cephfs-mirror-18.0.0-6168.g41c9e835.e 1.7 MB/s | 260 kB 00:00 2023-09-21T12:43:50.495 INFO:teuthology.orchestra.run.smithi156.stdout:(12/131): libcephfs-devel-18.0.0-6168.g41c9e835 373 kB/s | 31 kB 00:00 2023-09-21T12:43:50.596 INFO:teuthology.orchestra.run.smithi160.stdout:(10/131): ceph-radosgw-18.0.0-6168.g41c9e835.el 2.4 MB/s | 14 MB 00:05 2023-09-21T12:43:50.696 INFO:teuthology.orchestra.run.smithi156.stdout:(13/131): libcephfs2-18.0.0-6168.g41c9e835.el8. 4.0 MB/s | 829 kB 00:00 2023-09-21T12:43:50.771 INFO:teuthology.orchestra.run.smithi160.stdout:(11/131): cephfs-mirror-18.0.0-6168.g41c9e835.e 1.5 MB/s | 260 kB 00:00 2023-09-21T12:43:50.804 INFO:teuthology.orchestra.run.smithi156.stdout:(14/131): libcephsqlite-18.0.0-6168.g41c9e835.e 1.7 MB/s | 183 kB 00:00 2023-09-21T12:43:50.863 INFO:teuthology.orchestra.run.smithi160.stdout:(12/131): libcephfs-devel-18.0.0-6168.g41c9e835 338 kB/s | 31 kB 00:00 2023-09-21T12:43:50.888 INFO:teuthology.orchestra.run.smithi156.stdout:(15/131): librados-devel-18.0.0-6168.g41c9e835. 1.6 MB/s | 139 kB 00:00 2023-09-21T12:43:51.047 INFO:teuthology.orchestra.run.smithi156.stdout:(16/131): libradosstriper1-18.0.0-6168.g41c9e83 3.2 MB/s | 518 kB 00:00 2023-09-21T12:43:51.413 INFO:teuthology.orchestra.run.smithi160.stdout:(13/131): libcephfs2-18.0.0-6168.g41c9e835.el8. 1.5 MB/s | 829 kB 00:00 2023-09-21T12:43:51.622 INFO:teuthology.orchestra.run.smithi160.stdout:(14/131): libcephsqlite-18.0.0-6168.g41c9e835.e 882 kB/s | 183 kB 00:00 2023-09-21T12:43:51.739 INFO:teuthology.orchestra.run.smithi160.stdout:(15/131): librados-devel-18.0.0-6168.g41c9e835. 1.2 MB/s | 139 kB 00:00 2023-09-21T12:43:52.030 INFO:teuthology.orchestra.run.smithi156.stdout:(17/131): ceph-osd-18.0.0-6168.g41c9e835.el8.x8 2.2 MB/s | 18 MB 00:08 2023-09-21T12:43:52.073 INFO:teuthology.orchestra.run.smithi160.stdout:(16/131): ceph-osd-18.0.0-6168.g41c9e835.el8.x8 2.5 MB/s | 18 MB 00:07 2023-09-21T12:43:52.131 INFO:teuthology.orchestra.run.smithi156.stdout:(18/131): python3-ceph-argparse-18.0.0-6168.g41 449 kB/s | 45 kB 00:00 2023-09-21T12:43:52.156 INFO:teuthology.orchestra.run.smithi160.stdout:(17/131): libradosstriper1-18.0.0-6168.g41c9e83 1.2 MB/s | 518 kB 00:00 2023-09-21T12:43:52.231 INFO:teuthology.orchestra.run.smithi156.stdout:(19/131): python3-ceph-common-18.0.0-6168.g41c9 1.2 MB/s | 125 kB 00:00 2023-09-21T12:43:52.264 INFO:teuthology.orchestra.run.smithi160.stdout:(18/131): python3-ceph-argparse-18.0.0-6168.g41 413 kB/s | 45 kB 00:00 2023-09-21T12:43:52.365 INFO:teuthology.orchestra.run.smithi160.stdout:(19/131): python3-ceph-common-18.0.0-6168.g41c9 1.2 MB/s | 125 kB 00:00 2023-09-21T12:43:52.373 INFO:teuthology.orchestra.run.smithi156.stdout:(20/131): ceph-radosgw-18.0.0-6168.g41c9e835.el 1.8 MB/s | 14 MB 00:07 2023-09-21T12:43:52.490 INFO:teuthology.orchestra.run.smithi156.stdout:(21/131): librgw2-18.0.0-6168.g41c9e835.el8.x86 4.8 MB/s | 6.9 MB 00:01 2023-09-21T12:43:52.510 INFO:teuthology.orchestra.run.smithi160.stdout:(20/131): python3-cephfs-18.0.0-6168.g41c9e835. 1.4 MB/s | 196 kB 00:00 2023-09-21T12:43:52.515 INFO:teuthology.orchestra.run.smithi156.stdout:(22/131): python3-cephfs-18.0.0-6168.g41c9e835. 692 kB/s | 196 kB 00:00 2023-09-21T12:43:52.540 INFO:teuthology.orchestra.run.smithi156.stdout:(23/131): python3-rados-18.0.0-6168.g41c9e835.e 2.2 MB/s | 371 kB 00:00 2023-09-21T12:43:52.584 INFO:teuthology.orchestra.run.smithi142.stdout:(8/131): ceph-common-18.0.0-6168.g41c9e835.el8. 3.3 MB/s | 23 MB 00:06 2023-09-21T12:43:52.591 INFO:teuthology.orchestra.run.smithi156.stdout:(24/131): python3-rgw-18.0.0-6168.g41c9e835.el8 1.4 MB/s | 107 kB 00:00 2023-09-21T12:43:52.616 INFO:teuthology.orchestra.run.smithi156.stdout:(25/131): rbd-fuse-18.0.0-6168.g41c9e835.el8.x8 1.2 MB/s | 94 kB 00:00 2023-09-21T12:43:52.641 INFO:teuthology.orchestra.run.smithi156.stdout:(26/131): python3-rbd-18.0.0-6168.g41c9e835.el8 2.4 MB/s | 364 kB 00:00 2023-09-21T12:43:52.676 INFO:teuthology.orchestra.run.smithi142.stdout:(9/131): ceph-selinux-18.0.0-6168.g41c9e835.el8 266 kB/s | 24 kB 00:00 2023-09-21T12:43:52.723 INFO:teuthology.orchestra.run.smithi160.stdout:(21/131): python3-rados-18.0.0-6168.g41c9e835.e 1.7 MB/s | 371 kB 00:00 2023-09-21T12:43:52.733 INFO:teuthology.orchestra.run.smithi156.stdout:(27/131): rbd-nbd-18.0.0-6168.g41c9e835.el8.x86 1.5 MB/s | 179 kB 00:00 2023-09-21T12:43:52.750 INFO:teuthology.orchestra.run.smithi156.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6168.g 213 kB/s | 23 kB 00:00 2023-09-21T12:43:52.892 INFO:teuthology.orchestra.run.smithi156.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6168.g41c9e83 833 kB/s | 132 kB 00:00 2023-09-21T12:43:52.990 INFO:teuthology.orchestra.run.smithi160.stdout:(22/131): python3-rbd-18.0.0-6168.g41c9e835.el8 1.3 MB/s | 364 kB 00:00 2023-09-21T12:43:53.130 INFO:teuthology.orchestra.run.smithi160.stdout:(23/131): python3-rgw-18.0.0-6168.g41c9e835.el8 764 kB/s | 107 kB 00:00 2023-09-21T12:43:53.233 INFO:teuthology.orchestra.run.smithi160.stdout:(24/131): rbd-fuse-18.0.0-6168.g41c9e835.el8.x8 917 kB/s | 94 kB 00:00 2023-09-21T12:43:53.234 INFO:teuthology.orchestra.run.smithi142.stdout:(10/131): ceph-radosgw-18.0.0-6168.g41c9e835.el 4.5 MB/s | 14 MB 00:03 2023-09-21T12:43:53.268 INFO:teuthology.orchestra.run.smithi156.stdout:(30/131): rbd-mirror-18.0.0-6168.g41c9e835.el8. 5.3 MB/s | 3.6 MB 00:00 2023-09-21T12:43:53.318 INFO:teuthology.orchestra.run.smithi142.stdout:(11/131): cephfs-mirror-18.0.0-6168.g41c9e835.e 3.1 MB/s | 260 kB 00:00 2023-09-21T12:43:53.351 INFO:teuthology.orchestra.run.smithi156.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6168.g41 2.8 MB/s | 242 kB 00:00 2023-09-21T12:43:53.418 INFO:teuthology.orchestra.run.smithi142.stdout:(12/131): libcephfs-devel-18.0.0-6168.g41c9e835 310 kB/s | 31 kB 00:00 2023-09-21T12:43:53.426 INFO:teuthology.orchestra.run.smithi156.stdout:(32/131): ceph-mgr-rook-18.0.0-6168.g41c9e835.e 630 kB/s | 47 kB 00:00 2023-09-21T12:43:53.518 INFO:teuthology.orchestra.run.smithi156.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6168.g4 159 kB/s | 15 kB 00:00 2023-09-21T12:43:53.577 INFO:teuthology.orchestra.run.smithi156.stdout:(34/131): ceph-mgr-dashboard-18.0.0-6168.g41c9e 2.1 MB/s | 1.7 MB 00:00 2023-09-21T12:43:53.619 INFO:teuthology.orchestra.run.smithi156.stdout:(35/131): ceph-volume-18.0.0-6168.g41c9e835.el8 2.6 MB/s | 261 kB 00:00 2023-09-21T12:43:53.660 INFO:teuthology.orchestra.run.smithi142.stdout:(13/131): libcephfs2-18.0.0-6168.g41c9e835.el8. 3.4 MB/s | 829 kB 00:00 2023-09-21T12:43:53.694 INFO:teuthology.orchestra.run.smithi156.stdout:(36/131): cephfs-top-18.0.0-6168.g41c9e835.el8. 241 kB/s | 18 kB 00:00 2023-09-21T12:43:53.760 INFO:teuthology.orchestra.run.smithi142.stdout:(14/131): libcephsqlite-18.0.0-6168.g41c9e835.e 1.8 MB/s | 183 kB 00:00 2023-09-21T12:43:53.761 INFO:teuthology.orchestra.run.smithi156.stdout:(37/131): cephadm-18.0.0-6168.g41c9e835.el8.noa 973 kB/s | 179 kB 00:00 2023-09-21T12:43:53.861 INFO:teuthology.orchestra.run.smithi142.stdout:(15/131): librados-devel-18.0.0-6168.g41c9e835. 1.4 MB/s | 139 kB 00:00 2023-09-21T12:43:54.019 INFO:teuthology.orchestra.run.smithi142.stdout:(16/131): libradosstriper1-18.0.0-6168.g41c9e83 3.2 MB/s | 518 kB 00:00 2023-09-21T12:43:54.044 INFO:teuthology.orchestra.run.smithi156.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 211 kB/s | 59 kB 00:00 2023-09-21T12:43:54.145 INFO:teuthology.orchestra.run.smithi156.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 680 kB/s | 306 kB 00:00 2023-09-21T12:43:54.162 INFO:teuthology.orchestra.run.smithi156.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 641 kB/s | 75 kB 00:00 2023-09-21T12:43:54.262 INFO:teuthology.orchestra.run.smithi156.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 437 kB/s | 44 kB 00:00 2023-09-21T12:43:54.287 INFO:teuthology.orchestra.run.smithi156.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2023-09-21T12:43:54.388 INFO:teuthology.orchestra.run.smithi156.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-09-21T12:43:54.413 INFO:teuthology.orchestra.run.smithi156.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-09-21T12:43:54.463 INFO:teuthology.orchestra.run.smithi156.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-09-21T12:43:54.514 INFO:teuthology.orchestra.run.smithi156.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-09-21T12:43:54.564 INFO:teuthology.orchestra.run.smithi156.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2023-09-21T12:43:54.589 INFO:teuthology.orchestra.run.smithi156.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.1 MB/s | 81 kB 00:00 2023-09-21T12:43:54.648 INFO:teuthology.orchestra.run.smithi156.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-09-21T12:43:54.673 INFO:teuthology.orchestra.run.smithi156.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-09-21T12:43:54.758 INFO:teuthology.orchestra.run.smithi160.stdout:(25/131): librgw2-18.0.0-6168.g41c9e835.el8.x86 2.6 MB/s | 6.9 MB 00:02 2023-09-21T12:43:54.774 INFO:teuthology.orchestra.run.smithi156.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 488 kB/s | 49 kB 00:00 2023-09-21T12:43:54.832 INFO:teuthology.orchestra.run.smithi156.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 6.3 MB/s | 1.2 MB 00:00 2023-09-21T12:43:54.866 INFO:teuthology.orchestra.run.smithi160.stdout:(26/131): rbd-nbd-18.0.0-6168.g41c9e835.el8.x86 1.6 MB/s | 179 kB 00:00 2023-09-21T12:43:54.874 INFO:teuthology.orchestra.run.smithi156.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 586 kB/s | 59 kB 00:00 2023-09-21T12:43:54.924 INFO:teuthology.orchestra.run.smithi156.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-09-21T12:43:55.033 INFO:teuthology.orchestra.run.smithi156.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-09-21T12:43:55.058 INFO:teuthology.orchestra.run.smithi156.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 117 kB/s | 16 kB 00:00 2023-09-21T12:43:55.095 INFO:teuthology.orchestra.run.smithi160.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6168.g 101 kB/s | 23 kB 00:00 2023-09-21T12:43:55.125 INFO:teuthology.orchestra.run.smithi156.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2023-09-21T12:43:55.169 INFO:teuthology.orchestra.run.smithi156.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-09-21T12:43:55.209 INFO:teuthology.orchestra.run.smithi156.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 769 kB/s | 64 kB 00:00 2023-09-21T12:43:55.226 INFO:teuthology.orchestra.run.smithi160.stdout:(28/131): rbd-mirror-18.0.0-6168.g41c9e835.el8. 1.8 MB/s | 3.6 MB 00:01 2023-09-21T12:43:55.251 INFO:teuthology.orchestra.run.smithi160.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6168.g41c9e83 849 kB/s | 132 kB 00:00 2023-09-21T12:43:55.252 INFO:teuthology.orchestra.run.smithi156.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 223 kB/s | 19 kB 00:00 2023-09-21T12:43:55.285 INFO:teuthology.orchestra.run.smithi156.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-09-21T12:43:55.327 INFO:teuthology.orchestra.run.smithi156.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-09-21T12:43:55.352 INFO:teuthology.orchestra.run.smithi156.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 412 kB/s | 27 kB 00:00 2023-09-21T12:43:55.370 INFO:teuthology.orchestra.run.smithi142.stdout:(17/131): librgw2-18.0.0-6168.g41c9e835.el8.x86 5.1 MB/s | 6.9 MB 00:01 2023-09-21T12:43:55.436 INFO:teuthology.orchestra.run.smithi156.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-09-21T12:43:55.461 INFO:teuthology.orchestra.run.smithi156.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.9 MB/s | 255 kB 00:00 2023-09-21T12:43:55.462 INFO:teuthology.orchestra.run.smithi142.stdout:(18/131): python3-ceph-argparse-18.0.0-6168.g41 489 kB/s | 45 kB 00:00 2023-09-21T12:43:55.503 INFO:teuthology.orchestra.run.smithi156.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 918 kB/s | 61 kB 00:00 2023-09-21T12:43:55.545 INFO:teuthology.orchestra.run.smithi156.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-09-21T12:43:55.553 INFO:teuthology.orchestra.run.smithi142.stdout:(19/131): python3-ceph-common-18.0.0-6168.g41c9 1.3 MB/s | 125 kB 00:00 2023-09-21T12:43:55.570 INFO:teuthology.orchestra.run.smithi156.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 343 kB/s | 23 kB 00:00 2023-09-21T12:43:55.596 INFO:teuthology.orchestra.run.smithi156.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi142.stdout:(20/131): python3-cephfs-18.0.0-6168.g41c9e835. 1.8 MB/s | 196 kB 00:00 2023-09-21T12:43:55.746 INFO:teuthology.orchestra.run.smithi156.stdout:(70/131): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-09-21T12:43:55.754 INFO:teuthology.orchestra.run.smithi142.stdout:(21/131): python3-rados-18.0.0-6168.g41c9e835.e 4.0 MB/s | 371 kB 00:00 2023-09-21T12:43:55.813 INFO:teuthology.orchestra.run.smithi156.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-09-21T12:43:55.854 INFO:teuthology.orchestra.run.smithi142.stdout:(22/131): python3-rbd-18.0.0-6168.g41c9e835.el8 3.6 MB/s | 364 kB 00:00 2023-09-21T12:43:55.855 INFO:teuthology.orchestra.run.smithi156.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2023-09-21T12:43:55.880 INFO:teuthology.orchestra.run.smithi156.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 812 kB/s | 54 kB 00:00 2023-09-21T12:43:55.939 INFO:teuthology.orchestra.run.smithi156.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.0 MB/s | 259 kB 00:00 2023-09-21T12:43:55.946 INFO:teuthology.orchestra.run.smithi142.stdout:(23/131): python3-rgw-18.0.0-6168.g41c9e835.el8 1.1 MB/s | 107 kB 00:00 2023-09-21T12:43:55.964 INFO:teuthology.orchestra.run.smithi156.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.0 MB/s | 323 kB 00:00 2023-09-21T12:43:55.989 INFO:teuthology.orchestra.run.smithi156.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 773 kB/s | 39 kB 00:00 2023-09-21T12:43:56.009 INFO:teuthology.orchestra.run.smithi160.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6168.g41c9e 2.2 MB/s | 1.7 MB 00:00 2023-09-21T12:43:56.023 INFO:teuthology.orchestra.run.smithi156.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-09-21T12:43:56.030 INFO:teuthology.orchestra.run.smithi142.stdout:(24/131): rbd-fuse-18.0.0-6168.g41c9e835.el8.x8 1.1 MB/s | 94 kB 00:00 2023-09-21T12:43:56.057 INFO:teuthology.orchestra.run.smithi156.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.8 MB/s | 538 kB 00:00 2023-09-21T12:43:56.082 INFO:teuthology.orchestra.run.smithi156.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-21T12:43:56.099 INFO:teuthology.orchestra.run.smithi156.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-09-21T12:43:56.141 INFO:teuthology.orchestra.run.smithi156.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-09-21T12:43:56.168 INFO:teuthology.orchestra.run.smithi160.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6168.g41 1.5 MB/s | 242 kB 00:00 2023-09-21T12:43:56.193 INFO:teuthology.orchestra.run.smithi156.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 532 kB/s | 27 kB 00:00 2023-09-21T12:43:56.260 INFO:teuthology.orchestra.run.smithi160.stdout:(32/131): ceph-mgr-rook-18.0.0-6168.g41c9e835.e 518 kB/s | 47 kB 00:00 2023-09-21T12:43:56.343 INFO:teuthology.orchestra.run.smithi160.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6168.g4 174 kB/s | 15 kB 00:00 2023-09-21T12:43:56.375 INFO:teuthology.orchestra.run.smithi156.stdout:(83/131): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-09-21T12:43:56.408 INFO:teuthology.orchestra.run.smithi156.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 1.4 MB/s | 320 kB 00:00 2023-09-21T12:43:56.433 INFO:teuthology.orchestra.run.smithi156.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 754 kB/s | 44 kB 00:00 2023-09-21T12:43:56.510 INFO:teuthology.orchestra.run.smithi160.stdout:(34/131): ceph-volume-18.0.0-6168.g41c9e835.el8 1.5 MB/s | 261 kB 00:00 2023-09-21T12:43:56.525 INFO:teuthology.orchestra.run.smithi156.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2023-09-21T12:43:56.559 INFO:teuthology.orchestra.run.smithi156.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 3.6 MB/s | 457 kB 00:00 2023-09-21T12:43:56.585 INFO:teuthology.orchestra.run.smithi156.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.7 MB/s | 225 kB 00:00 2023-09-21T12:43:56.610 INFO:teuthology.orchestra.run.smithi156.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-09-21T12:43:56.635 INFO:teuthology.orchestra.run.smithi156.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-09-21T12:43:56.636 INFO:teuthology.orchestra.run.smithi160.stdout:(35/131): cephadm-18.0.0-6168.g41c9e835.el8.noa 1.4 MB/s | 179 kB 00:00 2023-09-21T12:43:56.647 INFO:teuthology.orchestra.run.smithi142.stdout:(25/131): ceph-osd-18.0.0-6168.g41c9e835.el8.x8 2.3 MB/s | 18 MB 00:07 2023-09-21T12:43:56.660 INFO:teuthology.orchestra.run.smithi156.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-09-21T12:43:56.677 INFO:teuthology.orchestra.run.smithi156.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2023-09-21T12:43:56.711 INFO:teuthology.orchestra.run.smithi160.stdout:(36/131): cephfs-top-18.0.0-6168.g41c9e835.el8. 241 kB/s | 18 kB 00:00 2023-09-21T12:43:56.719 INFO:teuthology.orchestra.run.smithi156.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-09-21T12:43:56.747 INFO:teuthology.orchestra.run.smithi142.stdout:(26/131): rbd-mirror-18.0.0-6168.g41c9e835.el8. 5.0 MB/s | 3.6 MB 00:00 2023-09-21T12:43:56.823 INFO:teuthology.orchestra.run.smithi142.stdout:(27/131): rbd-nbd-18.0.0-6168.g41c9e835.el8.x86 1.0 MB/s | 179 kB 00:00 2023-09-21T12:43:56.848 INFO:teuthology.orchestra.run.smithi142.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6168.g 231 kB/s | 23 kB 00:00 2023-09-21T12:43:56.861 INFO:teuthology.orchestra.run.smithi156.stdout:(94/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.2 MB/s | 3.7 MB 00:00 2023-09-21T12:43:56.899 INFO:teuthology.orchestra.run.smithi142.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6168.g41c9e83 1.7 MB/s | 132 kB 00:00 2023-09-21T12:43:57.020 INFO:teuthology.orchestra.run.smithi156.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 659 kB/s | 198 kB 00:00 2023-09-21T12:43:57.079 INFO:teuthology.orchestra.run.smithi156.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-09-21T12:43:57.137 INFO:teuthology.orchestra.run.smithi156.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-09-21T12:43:57.178 INFO:teuthology.orchestra.run.smithi160.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 3.8 MB/s | 7.4 MB 00:01 2023-09-21T12:43:57.212 INFO:teuthology.orchestra.run.smithi156.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 9.1 MB/s | 4.9 MB 00:00 2023-09-21T12:43:57.223 INFO:teuthology.orchestra.run.smithi142.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6168.g41c9e 4.7 MB/s | 1.7 MB 00:00 2023-09-21T12:43:57.278 INFO:teuthology.orchestra.run.smithi160.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 540 kB/s | 306 kB 00:00 2023-09-21T12:43:57.279 INFO:teuthology.orchestra.run.smithi156.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-09-21T12:43:57.307 INFO:teuthology.orchestra.run.smithi142.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6168.g41 2.8 MB/s | 242 kB 00:00 2023-09-21T12:43:57.321 INFO:teuthology.orchestra.run.smithi156.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-09-21T12:43:57.370 INFO:teuthology.orchestra.run.smithi160.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 819 kB/s | 75 kB 00:00 2023-09-21T12:43:57.371 INFO:teuthology.orchestra.run.smithi156.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-09-21T12:43:57.383 INFO:teuthology.orchestra.run.smithi142.stdout:(32/131): ceph-mgr-rook-18.0.0-6168.g41c9e835.e 633 kB/s | 47 kB 00:00 2023-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi156.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 622 kB/s | 47 kB 00:00 2023-09-21T12:43:57.422 INFO:teuthology.orchestra.run.smithi156.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-09-21T12:43:57.447 INFO:teuthology.orchestra.run.smithi156.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-09-21T12:43:57.458 INFO:teuthology.orchestra.run.smithi142.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6168.g4 194 kB/s | 15 kB 00:00 2023-09-21T12:43:57.473 INFO:teuthology.orchestra.run.smithi156.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-21T12:43:57.498 INFO:teuthology.orchestra.run.smithi156.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 956 kB/s | 48 kB 00:00 2023-09-21T12:43:57.523 INFO:teuthology.orchestra.run.smithi156.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-21T12:43:57.541 INFO:teuthology.orchestra.run.smithi142.stdout:(34/131): ceph-volume-18.0.0-6168.g41c9e835.el8 3.1 MB/s | 261 kB 00:00 2023-09-21T12:43:57.545 INFO:teuthology.orchestra.run.smithi160.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 160 kB/s | 59 kB 00:00 2023-09-21T12:43:57.548 INFO:teuthology.orchestra.run.smithi156.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 849 kB/s | 43 kB 00:00 2023-09-21T12:43:57.571 INFO:teuthology.orchestra.run.smithi160.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-09-21T12:43:57.574 INFO:teuthology.orchestra.run.smithi156.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-09-21T12:43:57.599 INFO:teuthology.orchestra.run.smithi156.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-21T12:43:57.608 INFO:teuthology.orchestra.run.smithi142.stdout:(35/131): cephadm-18.0.0-6168.g41c9e835.el8.noa 2.6 MB/s | 179 kB 00:00 2023-09-21T12:43:57.633 INFO:teuthology.orchestra.run.smithi156.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-09-21T12:43:57.658 INFO:teuthology.orchestra.run.smithi156.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2023-09-21T12:43:57.679 INFO:teuthology.orchestra.run.smithi160.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 326 kB/s | 44 kB 00:00 2023-09-21T12:43:57.684 INFO:teuthology.orchestra.run.smithi142.stdout:(36/131): cephfs-top-18.0.0-6168.g41c9e835.el8. 241 kB/s | 18 kB 00:00 2023-09-21T12:43:57.705 INFO:teuthology.orchestra.run.smithi160.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-09-21T12:43:57.706 INFO:teuthology.orchestra.run.smithi156.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.1 MB/s | 155 kB 00:00 2023-09-21T12:43:57.742 INFO:teuthology.orchestra.run.smithi156.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 6.5 MB/s | 559 kB 00:00 2023-09-21T12:43:57.767 INFO:teuthology.orchestra.run.smithi156.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 294 kB/s | 18 kB 00:00 2023-09-21T12:43:57.797 INFO:teuthology.orchestra.run.smithi160.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 282 kB/s | 33 kB 00:00 2023-09-21T12:43:57.830 INFO:teuthology.orchestra.run.smithi160.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 130 kB/s | 16 kB 00:00 2023-09-21T12:43:57.843 INFO:teuthology.orchestra.run.smithi156.stdout:(116/131): postgresql-server-10.21-2.module+el8 7.2 MB/s | 5.1 MB 00:00 2023-09-21T12:43:57.868 INFO:teuthology.orchestra.run.smithi156.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-09-21T12:43:57.902 INFO:teuthology.orchestra.run.smithi156.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-09-21T12:43:57.927 INFO:teuthology.orchestra.run.smithi156.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-09-21T12:43:57.939 INFO:teuthology.orchestra.run.smithi160.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2023-09-21T12:43:57.952 INFO:teuthology.orchestra.run.smithi156.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-21T12:43:57.978 INFO:teuthology.orchestra.run.smithi156.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-09-21T12:43:57.981 INFO:teuthology.orchestra.run.smithi160.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 939 kB/s | 173 kB 00:00 2023-09-21T12:43:58.003 INFO:teuthology.orchestra.run.smithi156.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-21T12:43:58.028 INFO:teuthology.orchestra.run.smithi156.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-21T12:43:58.048 INFO:teuthology.orchestra.run.smithi160.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 749 kB/s | 81 kB 00:00 2023-09-21T12:43:58.053 INFO:teuthology.orchestra.run.smithi156.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-09-21T12:43:58.087 INFO:teuthology.orchestra.run.smithi156.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-09-21T12:43:58.098 INFO:teuthology.orchestra.run.smithi160.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-09-21T12:43:58.112 INFO:teuthology.orchestra.run.smithi156.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-09-21T12:43:58.138 INFO:teuthology.orchestra.run.smithi156.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-09-21T12:43:58.148 INFO:teuthology.orchestra.run.smithi160.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-09-21T12:43:58.159 INFO:teuthology.orchestra.run.smithi142.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 645 kB/s | 306 kB 00:00 2023-09-21T12:43:58.196 INFO:teuthology.orchestra.run.smithi156.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-09-21T12:43:58.255 INFO:teuthology.orchestra.run.smithi156.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-09-21T12:43:58.267 INFO:teuthology.orchestra.run.smithi142.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 545 kB/s | 59 kB 00:00 2023-09-21T12:43:58.308 INFO:teuthology.orchestra.run.smithi160.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 307 kB/s | 49 kB 00:00 2023-09-21T12:43:58.368 INFO:teuthology.orchestra.run.smithi142.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 750 kB/s | 75 kB 00:00 2023-09-21T12:43:58.415 INFO:teuthology.orchestra.run.smithi160.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 546 kB/s | 59 kB 00:00 2023-09-21T12:43:58.466 INFO:teuthology.orchestra.run.smithi160.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 3.2 MB/s | 1.2 MB 00:00 2023-09-21T12:43:58.541 INFO:teuthology.orchestra.run.smithi160.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 481 kB/s | 60 kB 00:00 2023-09-21T12:43:58.551 INFO:teuthology.orchestra.run.smithi142.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-09-21T12:43:58.583 INFO:teuthology.orchestra.run.smithi160.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-09-21T12:43:58.634 INFO:teuthology.orchestra.run.smithi160.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 169 kB/s | 16 kB 00:00 2023-09-21T12:43:58.652 INFO:teuthology.orchestra.run.smithi142.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-09-21T12:43:58.676 INFO:teuthology.orchestra.run.smithi160.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 365 kB/s | 34 kB 00:00 2023-09-21T12:43:58.751 INFO:teuthology.orchestra.run.smithi160.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-09-21T12:43:58.760 INFO:teuthology.orchestra.run.smithi142.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-09-21T12:43:58.784 INFO:teuthology.orchestra.run.smithi160.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 592 kB/s | 64 kB 00:00 2023-09-21T12:43:58.843 INFO:teuthology.orchestra.run.smithi160.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 204 kB/s | 19 kB 00:00 2023-09-21T12:43:58.877 INFO:teuthology.orchestra.run.smithi160.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 260 kB/s | 24 kB 00:00 2023-09-21T12:43:58.919 INFO:teuthology.orchestra.run.smithi142.stdout:(43/131): ceph-mgr-diskprediction-local-18.0.0- 3.7 MB/s | 7.4 MB 00:02 2023-09-21T12:43:58.936 INFO:teuthology.orchestra.run.smithi142.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 188 kB/s | 33 kB 00:00 2023-09-21T12:43:58.960 INFO:teuthology.orchestra.run.smithi160.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 250 kB/s | 29 kB 00:00 2023-09-21T12:43:58.985 INFO:teuthology.orchestra.run.smithi160.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-09-21T12:43:59.036 INFO:teuthology.orchestra.run.smithi142.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-09-21T12:43:59.077 INFO:teuthology.orchestra.run.smithi160.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.1 MB/s | 255 kB 00:00 2023-09-21T12:43:59.103 INFO:teuthology.orchestra.run.smithi160.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.1 MB/s | 251 kB 00:00 2023-09-21T12:43:59.137 INFO:teuthology.orchestra.run.smithi142.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.8 MB/s | 384 kB 00:00 2023-09-21T12:43:59.162 INFO:teuthology.orchestra.run.smithi142.stdout:(47/131): python3-certifi-2018.10.15-7.el8.noar 67 kB/s | 16 kB 00:00 2023-09-21T12:43:59.178 INFO:teuthology.orchestra.run.smithi160.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 611 kB/s | 61 kB 00:00 2023-09-21T12:43:59.195 INFO:teuthology.orchestra.run.smithi160.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 931 kB/s | 85 kB 00:00 2023-09-21T12:43:59.237 INFO:teuthology.orchestra.run.smithi142.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 810 kB/s | 81 kB 00:00 2023-09-21T12:43:59.280 INFO:teuthology.orchestra.run.smithi142.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-09-21T12:43:59.280 INFO:teuthology.orchestra.run.smithi160.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-09-21T12:43:59.281 INFO:teuthology.orchestra.run.smithi156.stdout:(130/131): librbd1-18.0.0-6168.g41c9e835.el8.x8 3.2 MB/s | 3.7 MB 00:01 2023-09-21T12:43:59.304 INFO:teuthology.orchestra.run.smithi160.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-21T12:43:59.338 INFO:teuthology.orchestra.run.smithi142.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 175 kB/s | 18 kB 00:00 2023-09-21T12:43:59.438 INFO:teuthology.orchestra.run.smithi142.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 488 kB/s | 49 kB 00:00 2023-09-21T12:43:59.505 INFO:teuthology.orchestra.run.smithi156.stdout:(131/131): librados2-18.0.0-6168.g41c9e835.el8. 2.7 MB/s | 3.7 MB 00:01 2023-09-21T12:43:59.509 INFO:teuthology.orchestra.run.smithi156.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:43:59.509 INFO:teuthology.orchestra.run.smithi156.stdout:Total 12 MB/s | 208 MB 00:17 2023-09-21T12:43:59.539 INFO:teuthology.orchestra.run.smithi142.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 588 kB/s | 59 kB 00:00 2023-09-21T12:43:59.639 INFO:teuthology.orchestra.run.smithi142.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 603 kB/s | 60 kB 00:00 2023-09-21T12:43:59.646 INFO:teuthology.orchestra.run.smithi160.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 40 MB/s | 14 MB 00:00 2023-09-21T12:43:59.688 INFO:teuthology.orchestra.run.smithi160.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 3.5 MB/s | 1.7 MB 00:00 2023-09-21T12:43:59.705 INFO:teuthology.orchestra.run.smithi160.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-09-21T12:43:59.739 INFO:teuthology.orchestra.run.smithi142.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.8 MB/s | 283 kB 00:00 2023-09-21T12:43:59.755 INFO:teuthology.orchestra.run.smithi160.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 812 kB/s | 54 kB 00:00 2023-09-21T12:43:59.780 INFO:teuthology.orchestra.run.smithi160.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.6 MB/s | 259 kB 00:00 2023-09-21T12:43:59.805 INFO:teuthology.orchestra.run.smithi160.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-09-21T12:43:59.823 INFO:teuthology.orchestra.run.smithi142.stdout:(55/131): python3-kubernetes-11.0.0-6.el8.noarc 2.1 MB/s | 1.2 MB 00:00 2023-09-21T12:43:59.831 INFO:teuthology.orchestra.run.smithi160.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 771 kB/s | 39 kB 00:00 2023-09-21T12:43:59.848 INFO:teuthology.orchestra.run.smithi142.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 143 kB/s | 16 kB 00:00 2023-09-21T12:43:59.865 INFO:teuthology.orchestra.run.smithi160.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-09-21T12:43:59.898 INFO:teuthology.orchestra.run.smithi160.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-09-21T12:43:59.923 INFO:teuthology.orchestra.run.smithi160.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-21T12:43:59.932 INFO:teuthology.orchestra.run.smithi142.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 311 kB/s | 34 kB 00:00 2023-09-21T12:43:59.948 INFO:teuthology.orchestra.run.smithi160.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-09-21T12:43:59.957 INFO:teuthology.orchestra.run.smithi142.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-09-21T12:43:59.990 INFO:teuthology.orchestra.run.smithi160.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-09-21T12:44:00.024 INFO:teuthology.orchestra.run.smithi160.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 796 kB/s | 27 kB 00:00 2023-09-21T12:44:00.033 INFO:teuthology.orchestra.run.smithi142.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 640 kB/s | 64 kB 00:00 2023-09-21T12:44:00.058 INFO:teuthology.orchestra.run.smithi142.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 187 kB/s | 19 kB 00:00 2023-09-21T12:44:00.066 INFO:teuthology.orchestra.run.smithi160.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-21T12:44:00.100 INFO:teuthology.orchestra.run.smithi160.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-09-21T12:44:00.133 INFO:teuthology.orchestra.run.smithi142.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 239 kB/s | 24 kB 00:00 2023-09-21T12:44:00.158 INFO:teuthology.orchestra.run.smithi142.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 291 kB/s | 29 kB 00:00 2023-09-21T12:44:00.159 INFO:teuthology.orchestra.run.smithi160.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-09-21T12:44:00.232 INFO:teuthology.orchestra.run.smithi160.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 6.1 MB/s | 457 kB 00:00 2023-09-21T12:44:00.233 INFO:teuthology.orchestra.run.smithi142.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 275 kB/s | 27 kB 00:00 2023-09-21T12:44:00.259 INFO:teuthology.orchestra.run.smithi142.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-09-21T12:44:00.276 INFO:teuthology.orchestra.run.smithi160.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.1 MB/s | 225 kB 00:00 2023-09-21T12:44:00.330 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction check 2023-09-21T12:44:00.343 INFO:teuthology.orchestra.run.smithi142.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-09-21T12:44:00.343 INFO:teuthology.orchestra.run.smithi160.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 15 MB/s | 3.7 MB 00:00 2023-09-21T12:44:00.368 INFO:teuthology.orchestra.run.smithi142.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 564 kB/s | 61 kB 00:00 2023-09-21T12:44:00.369 INFO:teuthology.orchestra.run.smithi160.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-09-21T12:44:00.393 INFO:teuthology.orchestra.run.smithi160.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-09-21T12:44:00.410 INFO:teuthology.orchestra.run.smithi160.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 479 kB/s | 20 kB 00:00 2023-09-21T12:44:00.427 INFO:teuthology.orchestra.run.smithi160.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 3.0 MB/s | 103 kB 00:00 2023-09-21T12:44:00.443 INFO:teuthology.orchestra.run.smithi142.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 852 kB/s | 85 kB 00:00 2023-09-21T12:44:00.451 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction check succeeded. 2023-09-21T12:44:00.451 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction test 2023-09-21T12:44:00.461 INFO:teuthology.orchestra.run.smithi160.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 14 MB/s | 709 kB 00:00 2023-09-21T12:44:00.468 INFO:teuthology.orchestra.run.smithi142.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 229 kB/s | 23 kB 00:00 2023-09-21T12:44:00.494 INFO:teuthology.orchestra.run.smithi142.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi160.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-09-21T12:44:00.561 INFO:teuthology.orchestra.run.smithi142.stdout:(70/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 703 kB/s | 47 kB 00:00 2023-09-21T12:44:00.603 INFO:teuthology.orchestra.run.smithi142.stdout:(71/131): libselinux-devel-2.9-5.el8.x86_64.rpm 4.7 MB/s | 200 kB 00:00 2023-09-21T12:44:00.645 INFO:teuthology.orchestra.run.smithi142.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2023-09-21T12:44:00.670 INFO:teuthology.orchestra.run.smithi142.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 638 kB/s | 43 kB 00:00 2023-09-21T12:44:00.778 INFO:teuthology.orchestra.run.smithi160.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 14 MB/s | 4.9 MB 00:00 2023-09-21T12:44:00.902 INFO:teuthology.orchestra.run.smithi160.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 1.6 MB/s | 202 kB 00:00 2023-09-21T12:44:00.979 INFO:teuthology.orchestra.run.smithi160.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-09-21T12:44:01.004 INFO:teuthology.orchestra.run.smithi160.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-09-21T12:44:01.063 INFO:teuthology.orchestra.run.smithi160.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2023-09-21T12:44:01.112 INFO:teuthology.orchestra.run.smithi142.stdout:(74/131): ceph-test-18.0.0-6168.g41c9e835.el8.x 5.8 MB/s | 49 MB 00:08 2023-09-21T12:44:01.129 INFO:teuthology.orchestra.run.smithi160.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-09-21T12:44:01.137 INFO:teuthology.orchestra.run.smithi142.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 104 kB/s | 48 kB 00:00 2023-09-21T12:44:01.196 INFO:teuthology.orchestra.run.smithi160.stdout:(101/131): postgresql-server-10.21-2.module+el8 23 MB/s | 5.1 MB 00:00 2023-09-21T12:44:01.198 INFO:teuthology.orchestra.run.smithi142.stdout:(76/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 399 kB/s | 220 kB 00:00 2023-09-21T12:44:01.221 INFO:teuthology.orchestra.run.smithi142.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 548 kB/s | 43 kB 00:00 2023-09-21T12:44:01.222 INFO:teuthology.orchestra.run.smithi160.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 510 kB/s | 47 kB 00:00 2023-09-21T12:44:01.238 INFO:teuthology.orchestra.run.smithi142.stdout:(78/131): libsepol-devel-2.9-3.el8.x86_64.rpm 694 kB/s | 87 kB 00:00 2023-09-21T12:44:01.247 INFO:teuthology.orchestra.run.smithi160.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-09-21T12:44:01.263 INFO:teuthology.orchestra.run.smithi142.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-09-21T12:44:01.272 INFO:teuthology.orchestra.run.smithi160.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-09-21T12:44:01.297 INFO:teuthology.orchestra.run.smithi142.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-09-21T12:44:01.298 INFO:teuthology.orchestra.run.smithi160.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-21T12:44:01.314 INFO:teuthology.orchestra.run.smithi142.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 372 kB/s | 19 kB 00:00 2023-09-21T12:44:01.323 INFO:teuthology.orchestra.run.smithi160.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 958 kB/s | 48 kB 00:00 2023-09-21T12:44:01.348 INFO:teuthology.orchestra.run.smithi142.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-09-21T12:44:01.348 INFO:teuthology.orchestra.run.smithi160.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-21T12:44:01.374 INFO:teuthology.orchestra.run.smithi160.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 852 kB/s | 43 kB 00:00 2023-09-21T12:44:01.390 INFO:teuthology.orchestra.run.smithi142.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.6 MB/s | 560 kB 00:00 2023-09-21T12:44:01.398 INFO:teuthology.orchestra.run.smithi160.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-09-21T12:44:01.415 INFO:teuthology.orchestra.run.smithi142.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 267 kB/s | 18 kB 00:00 2023-09-21T12:44:01.424 INFO:teuthology.orchestra.run.smithi160.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-09-21T12:44:01.449 INFO:teuthology.orchestra.run.smithi142.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.1 MB/s | 559 kB 00:00 2023-09-21T12:44:01.457 INFO:teuthology.orchestra.run.smithi160.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-09-21T12:44:01.482 INFO:teuthology.orchestra.run.smithi142.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-09-21T12:44:01.483 INFO:teuthology.orchestra.run.smithi160.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2023-09-21T12:44:01.508 INFO:teuthology.orchestra.run.smithi142.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-09-21T12:44:01.516 INFO:teuthology.orchestra.run.smithi160.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 2.6 MB/s | 155 kB 00:00 2023-09-21T12:44:01.533 INFO:teuthology.orchestra.run.smithi142.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-09-21T12:44:01.558 INFO:teuthology.orchestra.run.smithi142.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-21T12:44:01.571 INFO:teuthology.orchestra.run.smithi160.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 6.2 MB/s | 559 kB 00:00 2023-09-21T12:44:01.584 INFO:teuthology.orchestra.run.smithi142.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-21T12:44:01.596 INFO:teuthology.orchestra.run.smithi156.stdout:Transaction test succeeded. 2023-09-21T12:44:01.600 INFO:teuthology.orchestra.run.smithi156.stdout:Running transaction 2023-09-21T12:44:01.600 INFO:teuthology.orchestra.run.smithi160.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-09-21T12:44:01.609 INFO:teuthology.orchestra.run.smithi142.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-09-21T12:44:01.634 INFO:teuthology.orchestra.run.smithi142.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-21T12:44:01.642 INFO:teuthology.orchestra.run.smithi160.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.3 MB/s | 605 kB 00:00 2023-09-21T12:44:01.659 INFO:teuthology.orchestra.run.smithi142.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 771 kB/s | 39 kB 00:00 2023-09-21T12:44:01.668 INFO:teuthology.orchestra.run.smithi160.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-09-21T12:44:01.701 INFO:teuthology.orchestra.run.smithi142.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.5 MB/s | 644 kB 00:00 2023-09-21T12:44:01.710 INFO:teuthology.orchestra.run.smithi160.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-09-21T12:44:01.727 INFO:teuthology.orchestra.run.smithi142.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-09-21T12:44:01.752 INFO:teuthology.orchestra.run.smithi142.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-09-21T12:44:01.760 INFO:teuthology.orchestra.run.smithi160.stdout:(119/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 20 MB/s | 2.3 MB 00:00 2023-09-21T12:44:01.785 INFO:teuthology.orchestra.run.smithi160.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-09-21T12:44:01.810 INFO:teuthology.orchestra.run.smithi160.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-09-21T12:44:01.836 INFO:teuthology.orchestra.run.smithi160.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-21T12:44:01.844 INFO:teuthology.orchestra.run.smithi142.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.9 MB/s | 2.3 MB 00:00 2023-09-21T12:44:01.861 INFO:teuthology.orchestra.run.smithi142.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-09-21T12:44:01.861 INFO:teuthology.orchestra.run.smithi160.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-21T12:44:01.886 INFO:teuthology.orchestra.run.smithi142.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-09-21T12:44:01.887 INFO:teuthology.orchestra.run.smithi160.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-09-21T12:44:01.921 INFO:teuthology.orchestra.run.smithi160.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-09-21T12:44:01.922 INFO:teuthology.orchestra.run.smithi142.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-21T12:44:01.945 INFO:teuthology.orchestra.run.smithi160.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-09-21T12:44:01.962 INFO:teuthology.orchestra.run.smithi142.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.2 MB/s | 323 kB 00:00 2023-09-21T12:44:01.970 INFO:teuthology.orchestra.run.smithi160.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-09-21T12:44:01.978 INFO:teuthology.orchestra.run.smithi142.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 667 kB/s | 39 kB 00:00 2023-09-21T12:44:02.029 INFO:teuthology.orchestra.run.smithi142.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-09-21T12:44:02.062 INFO:teuthology.orchestra.run.smithi142.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-09-21T12:44:02.088 INFO:teuthology.orchestra.run.smithi142.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-21T12:44:02.121 INFO:teuthology.orchestra.run.smithi142.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-09-21T12:44:02.163 INFO:teuthology.orchestra.run.smithi142.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-09-21T12:44:02.197 INFO:teuthology.orchestra.run.smithi142.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 801 kB/s | 27 kB 00:00 2023-09-21T12:44:02.247 INFO:teuthology.orchestra.run.smithi142.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 6.3 MB/s | 320 kB 00:00 2023-09-21T12:44:02.289 INFO:teuthology.orchestra.run.smithi142.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-09-21T12:44:02.431 INFO:teuthology.orchestra.run.smithi142.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-09-21T12:44:02.490 INFO:teuthology.orchestra.run.smithi142.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-09-21T12:44:02.565 INFO:teuthology.orchestra.run.smithi142.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-09-21T12:44:02.590 INFO:teuthology.orchestra.run.smithi142.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.2 MB/s | 225 kB 00:00 2023-09-21T12:44:02.616 INFO:teuthology.orchestra.run.smithi142.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2023-09-21T12:44:02.633 INFO:teuthology.orchestra.run.smithi142.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.9 MB/s | 126 kB 00:00 2023-09-21T12:44:02.658 INFO:teuthology.orchestra.run.smithi142.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 480 kB/s | 20 kB 00:00 2023-09-21T12:44:02.683 INFO:teuthology.orchestra.run.smithi142.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-09-21T12:44:02.725 INFO:teuthology.orchestra.run.smithi142.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-21T12:44:02.776 INFO:teuthology.orchestra.run.smithi142.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 3.9 MB/s | 198 kB 00:00 2023-09-21T12:44:02.954 INFO:teuthology.orchestra.run.smithi142.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-09-21T12:44:02.971 INFO:teuthology.orchestra.run.smithi160.stdout:(128/131): librados2-18.0.0-6168.g41c9e835.el8. 3.6 MB/s | 3.7 MB 00:01 2023-09-21T12:44:02.993 INFO:teuthology.orchestra.run.smithi142.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-09-21T12:44:03.029 INFO:teuthology.orchestra.run.smithi160.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-09-21T12:44:03.043 INFO:teuthology.orchestra.run.smithi142.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-09-21T12:44:03.160 INFO:teuthology.orchestra.run.smithi142.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 10 MB/s | 4.9 MB 00:00 2023-09-21T12:44:03.252 INFO:teuthology.orchestra.run.smithi142.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-09-21T12:44:03.286 INFO:teuthology.orchestra.run.smithi142.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-09-21T12:44:03.353 INFO:teuthology.orchestra.run.smithi142.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-09-21T12:44:03.445 INFO:teuthology.orchestra.run.smithi142.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-09-21T12:44:03.495 INFO:teuthology.orchestra.run.smithi142.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-21T12:44:03.546 INFO:teuthology.orchestra.run.smithi160.stdout:(130/131): ceph-test-18.0.0-6168.g41c9e835.el8. 3.4 MB/s | 49 MB 00:14 2023-09-21T12:44:03.721 INFO:teuthology.orchestra.run.smithi160.stdout:(131/131): librbd1-18.0.0-6168.g41c9e835.el8.x8 2.1 MB/s | 3.7 MB 00:01 2023-09-21T12:44:03.724 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:44:03.725 INFO:teuthology.orchestra.run.smithi160.stdout:Total 9.8 MB/s | 208 MB 00:21 2023-09-21T12:44:04.254 INFO:teuthology.orchestra.run.smithi142.stdout:(130/131): librados2-18.0.0-6168.g41c9e835.el8. 3.8 MB/s | 3.7 MB 00:00 2023-09-21T12:44:04.578 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2023-09-21T12:44:04.595 INFO:teuthology.orchestra.run.smithi142.stdout:(131/131): librbd1-18.0.0-6168.g41c9e835.el8.x8 3.0 MB/s | 3.7 MB 00:01 2023-09-21T12:44:04.598 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:44:04.598 INFO:teuthology.orchestra.run.smithi142.stdout:Total 11 MB/s | 208 MB 00:19 2023-09-21T12:44:04.698 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2023-09-21T12:44:04.699 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2023-09-21T12:44:05.839 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2023-09-21T12:44:05.844 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2023-09-21T12:44:06.227 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction check 2023-09-21T12:44:06.361 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction check succeeded. 2023-09-21T12:44:06.361 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction test 2023-09-21T12:44:06.718 INFO:teuthology.orchestra.run.smithi156.stdout: Preparing : 1/1 2023-09-21T12:44:06.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-21T12:44:07.023 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-21T12:44:07.216 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-21T12:44:07.410 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T12:44:07.514 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T12:44:07.751 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T12:44:07.875 INFO:teuthology.orchestra.run.smithi142.stdout:Transaction test succeeded. 2023-09-21T12:44:07.879 INFO:teuthology.orchestra.run.smithi142.stdout:Running transaction 2023-09-21T12:44:08.205 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T12:44:08.709 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:09.131 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:09.359 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:09.493 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:09.676 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:44:09.777 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:44:09.976 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 9/134 2023-09-21T12:44:10.204 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-21T12:44:10.404 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-21T12:44:10.747 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2023-09-21T12:44:10.826 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-21T12:44:10.931 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-21T12:44:11.057 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-21T12:44:11.126 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-21T12:44:11.267 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:11.381 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:11.542 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:11.575 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-21T12:44:11.634 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:11.759 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T12:44:11.767 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T12:44:11.894 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T12:44:11.908 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-21T12:44:12.059 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T12:44:12.142 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T12:44:12.549 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-21T12:44:12.657 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T12:44:12.766 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:12.850 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T12:44:13.023 INFO:teuthology.orchestra.run.smithi142.stdout: Preparing : 1/1 2023-09-21T12:44:13.161 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:13.206 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-21T12:44:13.358 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:13.430 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T12:44:13.467 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-21T12:44:13.475 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:13.632 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-21T12:44:13.633 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T12:44:13.683 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:44:13.766 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-21T12:44:13.810 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:44:13.974 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-21T12:44:14.005 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 9/134 2023-09-21T12:44:14.237 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-21T12:44:14.351 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T12:44:14.469 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-21T12:44:14.471 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-21T12:44:14.640 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-21T12:44:14.715 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 5/134 2023-09-21T12:44:14.865 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-21T12:44:14.877 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-21T12:44:15.129 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-21T12:44:15.131 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-21T12:44:15.185 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 5/134 2023-09-21T12:44:15.308 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:15.348 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-21T12:44:15.373 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:15.427 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:15.515 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:44:15.573 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-21T12:44:15.591 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:15.687 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:15.715 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:15.814 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:44:15.841 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T12:44:15.844 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-21T12:44:15.990 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-21T12:44:15.998 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 26/134 2023-09-21T12:44:16.013 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:44:16.119 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 27/134 2023-09-21T12:44:16.166 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T12:44:16.210 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-09-21T12:44:16.454 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-21T12:44:16.704 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-21T12:44:16.778 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-21T12:44:17.019 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 28/134 2023-09-21T12:44:17.125 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-21T12:44:17.336 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T12:44:17.341 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-21T12:44:17.389 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-21T12:44:17.556 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:17.586 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-21T12:44:17.682 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 14/134 2023-09-21T12:44:17.831 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:17.872 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-21T12:44:17.938 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-21T12:44:18.026 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 15/134 2023-09-21T12:44:18.075 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T12:44:18.124 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T12:44:18.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-09-21T12:44:18.473 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-09-21T12:44:18.714 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-09-21T12:44:18.848 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-21T12:44:18.862 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-21T12:44:19.022 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-21T12:44:19.122 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-21T12:44:19.223 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-21T12:44:19.342 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-21T12:44:19.594 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-21T12:44:19.755 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-21T12:44:19.861 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T12:44:19.922 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-21T12:44:19.938 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-21T12:44:20.089 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-21T12:44:20.176 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-21T12:44:20.202 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-21T12:44:20.372 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 26/134 2023-09-21T12:44:20.420 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-21T12:44:20.510 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 27/134 2023-09-21T12:44:20.610 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-21T12:44:20.773 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-21T12:44:20.796 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 36/134 2023-09-21T12:44:20.964 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-09-21T12:44:21.003 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 37/134 2023-09-21T12:44:21.164 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-21T12:44:21.353 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-21T12:44:21.423 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 28/134 2023-09-21T12:44:21.602 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-21T12:44:21.740 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-21T12:44:21.778 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-21T12:44:21.800 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-09-21T12:44:21.994 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-21T12:44:21.999 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-21T12:44:22.063 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-09-21T12:44:22.206 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-21T12:44:22.266 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-21T12:44:22.274 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-09-21T12:44:22.440 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T12:44:22.542 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-21T12:44:22.585 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-21T12:44:22.730 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 26/134 2023-09-21T12:44:22.868 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 27/134 2023-09-21T12:44:22.911 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-21T12:44:23.109 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-21T12:44:23.132 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 28/134 2023-09-21T12:44:23.320 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-21T12:44:23.339 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-21T12:44:23.587 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-21T12:44:23.917 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-21T12:44:24.148 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-21T12:44:24.206 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-21T12:44:24.350 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-21T12:44:24.508 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-21T12:44:24.545 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-21T12:44:24.703 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-21T12:44:24.752 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-21T12:44:24.893 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-21T12:44:24.942 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-21T12:44:25.146 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 36/134 2023-09-21T12:44:25.200 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-21T12:44:25.368 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 37/134 2023-09-21T12:44:25.404 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-21T12:44:25.446 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-21T12:44:25.539 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-21T12:44:25.678 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-21T12:44:25.709 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-21T12:44:25.863 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-21T12:44:25.942 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-21T12:44:26.014 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-21T12:44:26.093 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-21T12:44:26.199 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-21T12:44:26.306 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-21T12:44:26.390 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T12:44:26.466 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T12:44:26.488 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-21T12:44:26.543 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-09-21T12:44:26.710 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-21T12:44:26.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-09-21T12:44:26.900 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-21T12:44:26.910 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-21T12:44:27.065 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T12:44:27.127 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T12:44:27.153 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-09-21T12:44:27.234 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-21T12:44:27.378 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-09-21T12:44:27.394 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-21T12:44:27.457 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-21T12:44:27.566 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-21T12:44:27.633 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-21T12:44:27.684 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-21T12:44:27.714 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-21T12:44:27.834 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-21T12:44:27.900 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-21T12:44:27.952 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-21T12:44:28.029 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 36/134 2023-09-21T12:44:28.165 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-21T12:44:28.263 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 37/134 2023-09-21T12:44:28.271 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-21T12:44:28.413 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-21T12:44:28.422 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-09-21T12:44:28.488 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-21T12:44:28.577 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-21T12:44:28.590 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-09-21T12:44:28.678 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-21T12:44:28.758 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-21T12:44:28.813 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-09-21T12:44:28.876 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-21T12:44:28.884 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-09-21T12:44:28.965 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-21T12:44:29.042 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-21T12:44:29.151 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-21T12:44:29.162 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-09-21T12:44:29.250 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-21T12:44:29.354 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-21T12:44:29.358 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-09-21T12:44:29.542 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-21T12:44:29.546 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-21T12:44:29.549 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-21T12:44:29.646 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-21T12:44:29.687 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-21T12:44:29.844 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-21T12:44:29.865 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-09-21T12:44:29.912 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-21T12:44:30.054 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-09-21T12:44:30.102 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-21T12:44:30.194 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-21T12:44:30.205 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-09-21T12:44:30.387 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-21T12:44:30.395 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-21T12:44:30.399 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-09-21T12:44:30.546 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-21T12:44:30.574 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-09-21T12:44:30.620 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-21T12:44:30.697 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-21T12:44:30.768 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-09-21T12:44:30.855 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T12:44:30.960 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-21T12:44:30.983 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-09-21T12:44:31.046 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-21T12:44:31.202 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-09-21T12:44:31.241 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-21T12:44:31.316 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-21T12:44:31.434 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-21T12:44:31.597 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T12:44:31.657 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-09-21T12:44:31.714 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-21T12:44:31.945 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-21T12:44:32.011 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-09-21T12:44:32.115 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-21T12:44:32.219 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-09-21T12:44:32.264 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-21T12:44:32.426 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-21T12:44:32.466 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-09-21T12:44:32.478 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-21T12:44:32.722 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-21T12:44:32.723 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-09-21T12:44:32.752 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-21T12:44:32.996 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-21T12:44:33.006 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-21T12:44:33.057 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-09-21T12:44:33.152 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-21T12:44:33.297 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-09-21T12:44:33.317 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-21T12:44:33.342 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-21T12:44:33.508 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-21T12:44:33.537 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-09-21T12:44:33.610 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-21T12:44:33.735 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-21T12:44:33.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-09-21T12:44:33.882 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-21T12:44:33.914 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-21T12:44:33.987 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-09-21T12:44:34.100 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-21T12:44:34.161 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-09-21T12:44:34.278 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-21T12:44:34.503 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-21T12:44:34.516 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-09-21T12:44:34.697 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-21T12:44:34.734 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-21T12:44:34.807 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-09-21T12:44:34.880 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:34.939 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:34.944 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-21T12:44:35.052 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-09-21T12:44:35.131 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 93/134 2023-09-21T12:44:35.177 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-21T12:44:35.323 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-09-21T12:44:35.396 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-21T12:44:35.505 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-21T12:44:35.605 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-21T12:44:35.744 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-21T12:44:35.831 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-21T12:44:36.060 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-21T12:44:36.286 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-21T12:44:36.458 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-21T12:44:36.650 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-21T12:44:36.869 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-21T12:44:36.930 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-21T12:44:37.094 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-21T12:44:37.208 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-21T12:44:37.309 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-21T12:44:37.470 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-21T12:44:37.490 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-21T12:44:37.660 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-21T12:44:37.756 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-21T12:44:37.953 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-21T12:44:38.147 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-21T12:44:38.202 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-21T12:44:38.355 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-21T12:44:38.402 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-21T12:44:38.727 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-21T12:44:38.818 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:38.946 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-21T12:44:39.080 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:39.164 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-21T12:44:39.169 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-21T12:44:39.362 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:39.412 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-21T12:44:39.433 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:39.596 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 93/134 2023-09-21T12:44:39.802 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:40.313 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:40.390 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:40.554 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:44:40.841 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-21T12:44:41.347 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-21T12:44:41.615 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-21T12:44:42.016 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-21T12:44:42.381 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-21T12:44:42.597 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-21T12:44:43.318 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:43.451 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-21T12:44:43.612 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:43.652 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:43.731 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 92/134 2023-09-21T12:44:43.919 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 93/134 2023-09-21T12:44:44.211 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:44.466 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:44.576 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:44.712 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:44:49.164 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:49.460 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:50.148 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 94/134 2023-09-21T12:44:50.426 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:50.575 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 95/134 2023-09-21T12:44:50.727 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:44:59.643 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:44:59.644 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /sys 2023-09-21T12:44:59.644 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /proc 2023-09-21T12:44:59.644 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-09-21T12:44:59.645 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /run 2023-09-21T12:44:59.645 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /mnt 2023-09-21T12:44:59.645 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /var/tmp 2023-09-21T12:44:59.646 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /home 2023-09-21T12:44:59.646 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /tmp 2023-09-21T12:44:59.646 INFO:teuthology.orchestra.run.smithi156.stdout:skipping the directory /dev 2023-09-21T12:44:59.647 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:45:00.027 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:01.614 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:01.826 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:02.048 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:02.259 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:02.714 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:02.884 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:02.902 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:03.475 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:45:03.475 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2023-09-21T12:45:03.476 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2023-09-21T12:45:03.476 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-09-21T12:45:03.476 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /run 2023-09-21T12:45:03.476 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2023-09-21T12:45:03.476 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2023-09-21T12:45:03.477 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2023-09-21T12:45:03.477 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2023-09-21T12:45:03.477 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /dev 2023-09-21T12:45:03.477 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:45:03.834 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:04.625 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:04.837 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:04.956 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 102/134 2023-09-21T12:45:05.185 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 103/134 2023-09-21T12:45:05.383 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:05.425 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:05.604 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:05.820 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:05.917 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:06.017 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:06.472 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:06.625 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:06.642 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:06.880 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:07.100 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:07.191 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:07.533 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 107/134 2023-09-21T12:45:07.785 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:07.820 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:07.999 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:08.011 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:08.324 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:08.523 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:08.647 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 102/134 2023-09-21T12:45:08.876 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 103/134 2023-09-21T12:45:09.049 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:09.270 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:09.355 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 110/134 2023-09-21T12:45:09.545 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:09.584 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:09.618 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:09.766 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:09.808 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:09.983 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:10.354 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:10.506 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:10.508 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:10.666 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:10.757 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:11.095 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 107/134 2023-09-21T12:45:11.204 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 96/134 2023-09-21T12:45:11.204 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /sys 2023-09-21T12:45:11.204 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /proc 2023-09-21T12:45:11.205 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-09-21T12:45:11.205 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /run 2023-09-21T12:45:11.205 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /mnt 2023-09-21T12:45:11.205 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /var/tmp 2023-09-21T12:45:11.206 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /home 2023-09-21T12:45:11.206 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /tmp 2023-09-21T12:45:11.206 INFO:teuthology.orchestra.run.smithi142.stdout:skipping the directory /dev 2023-09-21T12:45:11.206 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:45:11.302 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:11.336 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:11.524 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:11.535 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:11.615 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:12.875 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 110/134 2023-09-21T12:45:13.065 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:13.098 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:13.274 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:13.316 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:13.373 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 97/134 2023-09-21T12:45:13.474 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:13.547 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:13.819 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 98/134 2023-09-21T12:45:13.835 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:14.016 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:14.039 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:14.565 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 99/134 2023-09-21T12:45:14.781 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:14.822 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 100/134 2023-09-21T12:45:15.175 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:15.496 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 115/134 2023-09-21T12:45:15.673 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T12:45:15.866 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T12:45:16.816 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-21T12:45:17.134 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-21T12:45:17.351 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 119/134 2023-09-21T12:45:17.473 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:17.536 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T12:45:17.700 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 101/134 2023-09-21T12:45:17.703 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 121/134 2023-09-21T12:45:17.830 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 102/134 2023-09-21T12:45:17.841 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T12:45:18.029 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 103/134 2023-09-21T12:45:18.271 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:18.538 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 104/134 2023-09-21T12:45:18.687 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:18.746 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:18.987 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 115/134 2023-09-21T12:45:19.173 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T12:45:19.369 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-21T12:45:19.849 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 105/134 2023-09-21T12:45:20.063 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:20.071 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:20.191 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 106/134 2023-09-21T12:45:20.265 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-21T12:45:20.306 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:20.326 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:20.482 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 124/134 2023-09-21T12:45:20.584 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 107/134 2023-09-21T12:45:20.608 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-21T12:45:20.784 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 119/134 2023-09-21T12:45:20.806 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 125/134 2023-09-21T12:45:20.847 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:20.912 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 108/134 2023-09-21T12:45:21.010 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T12:45:21.111 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 126/134 2023-09-21T12:45:21.112 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:21.140 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 109/134 2023-09-21T12:45:21.185 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 121/134 2023-09-21T12:45:21.332 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T12:45:21.400 INFO:teuthology.orchestra.run.smithi156.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-21T12:45:21.539 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:21.549 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:21.735 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-21T12:45:21.964 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T12:45:22.053 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T12:45:22.281 INFO:teuthology.orchestra.run.smithi156.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T12:45:22.295 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T12:45:22.295 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:22.542 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:22.543 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:22.589 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 110/134 2023-09-21T12:45:22.788 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:22.841 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:22.902 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 111/134 2023-09-21T12:45:22.997 INFO:teuthology.orchestra.run.smithi156.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:23.046 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:23.117 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 112/134 2023-09-21T12:45:23.313 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:23.529 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:23.542 INFO:teuthology.orchestra.run.smithi156.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:23.542 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 1/134 2023-09-21T12:45:23.542 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2/134 2023-09-21T12:45:23.542 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 3/134 2023-09-21T12:45:23.542 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 4/134 2023-09-21T12:45:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 5/134 2023-09-21T12:45:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:45:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:45:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:45:23.543 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 9/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 10/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 11/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 12/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 13/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 14/134 2023-09-21T12:45:23.544 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 15/134 2023-09-21T12:45:23.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 16/134 2023-09-21T12:45:23.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 17/134 2023-09-21T12:45:23.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 18/134 2023-09-21T12:45:23.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 19/134 2023-09-21T12:45:23.545 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 20/134 2023-09-21T12:45:23.546 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 21/134 2023-09-21T12:45:23.546 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 22/134 2023-09-21T12:45:23.546 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 23/134 2023-09-21T12:45:23.546 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 24/134 2023-09-21T12:45:23.546 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 25/134 2023-09-21T12:45:23.555 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 26/134 2023-09-21T12:45:23.555 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 27/134 2023-09-21T12:45:23.556 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 28/134 2023-09-21T12:45:23.556 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 29/134 2023-09-21T12:45:23.556 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 30/134 2023-09-21T12:45:23.556 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 31/134 2023-09-21T12:45:23.556 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 32/134 2023-09-21T12:45:23.557 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 33/134 2023-09-21T12:45:23.557 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 34/134 2023-09-21T12:45:23.557 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 35/134 2023-09-21T12:45:23.557 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 36/134 2023-09-21T12:45:23.557 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 37/134 2023-09-21T12:45:23.558 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 38/134 2023-09-21T12:45:23.558 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-21T12:45:23.558 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-21T12:45:23.558 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-21T12:45:23.558 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-21T12:45:23.559 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-21T12:45:23.559 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-21T12:45:23.559 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-21T12:45:23.559 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-21T12:45:23.559 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-21T12:45:23.560 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-21T12:45:23.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-21T12:45:23.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-21T12:45:23.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-21T12:45:23.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-21T12:45:23.561 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-21T12:45:23.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-21T12:45:23.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-21T12:45:23.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-21T12:45:23.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-21T12:45:23.562 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-21T12:45:23.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-21T12:45:23.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-21T12:45:23.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-21T12:45:23.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-21T12:45:23.563 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-21T12:45:23.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-21T12:45:23.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-21T12:45:23.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-21T12:45:23.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-21T12:45:23.564 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-21T12:45:23.565 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-21T12:45:23.566 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-21T12:45:23.566 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-21T12:45:23.566 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-21T12:45:23.566 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-21T12:45:23.566 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-21T12:45:23.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-21T12:45:23.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-21T12:45:23.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-21T12:45:23.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-21T12:45:23.567 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-21T12:45:23.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-21T12:45:23.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-21T12:45:23.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-21T12:45:23.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-21T12:45:23.568 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-21T12:45:23.569 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-21T12:45:23.569 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-21T12:45:23.569 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-21T12:45:23.569 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-21T12:45:23.569 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-21T12:45:23.570 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-21T12:45:23.570 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-21T12:45:23.570 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-21T12:45:23.570 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-21T12:45:23.570 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-21T12:45:23.571 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-21T12:45:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-21T12:45:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-21T12:45:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-21T12:45:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-21T12:45:23.572 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-21T12:45:23.573 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-21T12:45:23.573 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-21T12:45:23.573 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-21T12:45:23.573 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-21T12:45:23.573 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T12:45:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-21T12:45:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T12:45:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-21T12:45:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-21T12:45:23.574 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 129/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-21T12:45:23.575 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 131/134 2023-09-21T12:45:23.576 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:23.576 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-21T12:45:23.750 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 113/134 2023-09-21T12:45:23.831 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:23.848 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:23.955 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:24.027 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 124/134 2023-09-21T12:45:24.305 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 125/134 2023-09-21T12:45:24.607 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 126/134 2023-09-21T12:45:24.949 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-21T12:45:25.097 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:25.106 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:25.299 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-21T12:45:25.530 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T12:45:25.610 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-21T12:45:25.797 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T12:45:25.809 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-21T12:45:25.809 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:26.004 INFO:teuthology.orchestra.run.smithi156.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:26.005 INFO:teuthology.orchestra.run.smithi156.stdout:Last metadata expiration check: 0:01:56 ago on Thu 21 Sep 2023 12:43:30 PM UTC. 2023-09-21T12:45:26.016 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:26.016 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:26.285 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:26.504 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:27.044 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:27.044 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 1/134 2023-09-21T12:45:27.045 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2/134 2023-09-21T12:45:27.045 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 3/134 2023-09-21T12:45:27.045 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 4/134 2023-09-21T12:45:27.045 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 5/134 2023-09-21T12:45:27.045 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:45:27.046 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:45:27.046 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:45:27.046 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 9/134 2023-09-21T12:45:27.046 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 10/134 2023-09-21T12:45:27.046 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 11/134 2023-09-21T12:45:27.047 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 12/134 2023-09-21T12:45:27.047 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 13/134 2023-09-21T12:45:27.047 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 14/134 2023-09-21T12:45:27.047 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 15/134 2023-09-21T12:45:27.047 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 16/134 2023-09-21T12:45:27.048 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 17/134 2023-09-21T12:45:27.048 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 18/134 2023-09-21T12:45:27.048 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 19/134 2023-09-21T12:45:27.048 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 20/134 2023-09-21T12:45:27.048 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 21/134 2023-09-21T12:45:27.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 22/134 2023-09-21T12:45:27.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 23/134 2023-09-21T12:45:27.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 24/134 2023-09-21T12:45:27.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 25/134 2023-09-21T12:45:27.049 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 26/134 2023-09-21T12:45:27.050 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 27/134 2023-09-21T12:45:27.050 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 28/134 2023-09-21T12:45:27.050 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 29/134 2023-09-21T12:45:27.050 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 30/134 2023-09-21T12:45:27.059 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 31/134 2023-09-21T12:45:27.059 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 32/134 2023-09-21T12:45:27.059 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 33/134 2023-09-21T12:45:27.060 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 34/134 2023-09-21T12:45:27.060 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 35/134 2023-09-21T12:45:27.060 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 36/134 2023-09-21T12:45:27.060 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 37/134 2023-09-21T12:45:27.060 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 38/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-21T12:45:27.061 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-21T12:45:27.062 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-21T12:45:27.062 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-21T12:45:27.062 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-21T12:45:27.062 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-21T12:45:27.063 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-21T12:45:27.063 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-21T12:45:27.063 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-21T12:45:27.063 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-21T12:45:27.063 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-21T12:45:27.064 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-21T12:45:27.064 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-21T12:45:27.064 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-21T12:45:27.064 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-21T12:45:27.064 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-21T12:45:27.065 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-21T12:45:27.065 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-21T12:45:27.065 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-21T12:45:27.065 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-21T12:45:27.065 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-21T12:45:27.066 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-21T12:45:27.066 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-21T12:45:27.066 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-21T12:45:27.066 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-21T12:45:27.066 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-21T12:45:27.067 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-21T12:45:27.067 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-21T12:45:27.067 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-21T12:45:27.067 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-21T12:45:27.067 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-21T12:45:27.068 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-21T12:45:27.069 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-21T12:45:27.069 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-21T12:45:27.069 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-21T12:45:27.069 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-21T12:45:27.069 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-21T12:45:27.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-21T12:45:27.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-21T12:45:27.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-21T12:45:27.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-21T12:45:27.070 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-21T12:45:27.071 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-21T12:45:27.071 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-21T12:45:27.071 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-21T12:45:27.071 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-21T12:45:27.071 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-21T12:45:27.072 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-21T12:45:27.072 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-21T12:45:27.072 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-21T12:45:27.072 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-21T12:45:27.073 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-21T12:45:27.073 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-21T12:45:27.073 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-21T12:45:27.073 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-21T12:45:27.073 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-21T12:45:27.074 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-21T12:45:27.075 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-21T12:45:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-21T12:45:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-21T12:45:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-21T12:45:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-21T12:45:27.076 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-21T12:45:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-21T12:45:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T12:45:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-21T12:45:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-21T12:45:27.077 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 129/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-21T12:45:27.078 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 131/134 2023-09-21T12:45:27.079 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:27.079 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-21T12:45:28.483 INFO:teuthology.orchestra.run.smithi156.stdout:Installed products updated. 2023-09-21T12:45:28.698 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:45:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Upgraded: 2023-09-21T12:45:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-21T12:45:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.699 INFO:teuthology.orchestra.run.smithi156.stdout: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.699 INFO:teuthology.orchestra.run.smithi156.stdout:Installed: 2023-09-21T12:45:28.700 INFO:teuthology.orchestra.run.smithi156.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-21T12:45:28.700 INFO:teuthology.orchestra.run.smithi156.stdout: automake-1.16.1-7.el8.noarch 2023-09-21T12:45:28.700 INFO:teuthology.orchestra.run.smithi156.stdout: bison-3.0.4-10.el8.x86_64 2023-09-21T12:45:28.700 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.700 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.701 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.702 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.702 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.702 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.702 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.703 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.703 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.703 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.703 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.703 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.704 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.704 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.704 INFO:teuthology.orchestra.run.smithi156.stdout: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.704 INFO:teuthology.orchestra.run.smithi156.stdout: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.704 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: flex-2.6.1-9.el8.x86_64 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-21T12:45:28.705 INFO:teuthology.orchestra.run.smithi156.stdout: jq-1.6-3.el8.x86_64 2023-09-21T12:45:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-21T12:45:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-21T12:45:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-21T12:45:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.706 INFO:teuthology.orchestra.run.smithi156.stdout: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.707 INFO:teuthology.orchestra.run.smithi156.stdout: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.707 INFO:teuthology.orchestra.run.smithi156.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-21T12:45:28.707 INFO:teuthology.orchestra.run.smithi156.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:28.707 INFO:teuthology.orchestra.run.smithi156.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-21T12:45:28.707 INFO:teuthology.orchestra.run.smithi156.stdout: libpq-13.5-1.el8.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-21T12:45:28.708 INFO:teuthology.orchestra.run.smithi156.stdout: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.709 INFO:teuthology.orchestra.run.smithi156.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-21T12:45:28.709 INFO:teuthology.orchestra.run.smithi156.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-21T12:45:28.709 INFO:teuthology.orchestra.run.smithi156.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-21T12:45:28.709 INFO:teuthology.orchestra.run.smithi156.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-21T12:45:28.709 INFO:teuthology.orchestra.run.smithi156.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-21T12:45:28.710 INFO:teuthology.orchestra.run.smithi156.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-21T12:45:28.710 INFO:teuthology.orchestra.run.smithi156.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-21T12:45:28.710 INFO:teuthology.orchestra.run.smithi156.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-21T12:45:28.710 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-21T12:45:28.711 INFO:teuthology.orchestra.run.smithi156.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-21T12:45:28.711 INFO:teuthology.orchestra.run.smithi156.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-21T12:45:28.711 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-21T12:45:28.711 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-21T12:45:28.711 INFO:teuthology.orchestra.run.smithi156.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-21T12:45:28.712 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:28.712 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:28.712 INFO:teuthology.orchestra.run.smithi156.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:28.712 INFO:teuthology.orchestra.run.smithi156.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-21T12:45:28.712 INFO:teuthology.orchestra.run.smithi156.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-21T12:45:28.713 INFO:teuthology.orchestra.run.smithi156.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-21T12:45:28.713 INFO:teuthology.orchestra.run.smithi156.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-21T12:45:28.713 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-21T12:45:28.713 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.714 INFO:teuthology.orchestra.run.smithi156.stdout: python3-ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.714 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.714 INFO:teuthology.orchestra.run.smithi156.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-21T12:45:28.715 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-21T12:45:28.716 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-21T12:45:28.716 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-21T12:45:28.716 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-21T12:45:28.716 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-21T12:45:28.716 INFO:teuthology.orchestra.run.smithi156.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-21T12:45:28.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-21T12:45:28.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-21T12:45:28.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-21T12:45:28.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-21T12:45:28.717 INFO:teuthology.orchestra.run.smithi156.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-21T12:45:28.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-21T12:45:28.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:28.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:28.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-21T12:45:28.718 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-portend-2.6-1.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-21T12:45:28.719 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-21T12:45:28.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-21T12:45:28.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-21T12:45:28.720 INFO:teuthology.orchestra.run.smithi156.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-21T12:45:28.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-21T12:45:28.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-21T12:45:28.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-21T12:45:28.721 INFO:teuthology.orchestra.run.smithi156.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-21T12:45:28.722 INFO:teuthology.orchestra.run.smithi156.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-21T12:45:28.722 INFO:teuthology.orchestra.run.smithi156.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-21T12:45:28.722 INFO:teuthology.orchestra.run.smithi156.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-21T12:45:28.722 INFO:teuthology.orchestra.run.smithi156.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-21T12:45:28.722 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-21T12:45:28.723 INFO:teuthology.orchestra.run.smithi156.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-21T12:45:28.723 INFO:teuthology.orchestra.run.smithi156.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-21T12:45:28.723 INFO:teuthology.orchestra.run.smithi156.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-21T12:45:28.724 INFO:teuthology.orchestra.run.smithi156.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-21T12:45:28.724 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.724 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.724 INFO:teuthology.orchestra.run.smithi156.stdout: rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:28.724 INFO:teuthology.orchestra.run.smithi156.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-21T12:45:28.725 INFO:teuthology.orchestra.run.smithi156.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-21T12:45:28.725 INFO:teuthology.orchestra.run.smithi156.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-21T12:45:28.725 INFO:teuthology.orchestra.run.smithi156.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-21T12:45:28.725 INFO:teuthology.orchestra.run.smithi156.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-21T12:45:28.726 INFO:teuthology.orchestra.run.smithi156.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-21T12:45:28.726 INFO:teuthology.orchestra.run.smithi156.stdout: 2023-09-21T12:45:28.726 INFO:teuthology.orchestra.run.smithi156.stdout:Complete! 2023-09-21T12:45:28.891 DEBUG:teuthology.parallel:result is None 2023-09-21T12:45:29.066 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 114/134 2023-09-21T12:45:29.495 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:29.496 INFO:teuthology.orchestra.run.smithi160.stdout:Last metadata expiration check: 0:01:59 ago on Thu 21 Sep 2023 12:43:30 PM UTC. 2023-09-21T12:45:30.280 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 115/134 2023-09-21T12:45:30.678 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-09-21T12:45:30.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 117/134 2023-09-21T12:45:31.198 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-09-21T12:45:31.386 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-09-21T12:45:31.638 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-09-21T12:45:31.892 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-09-21T12:45:32.020 INFO:teuthology.orchestra.run.smithi160.stdout:Installed products updated. 2023-09-21T12:45:32.075 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 121/134 2023-09-21T12:45:32.229 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-21T12:45:32.236 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:45:32.237 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2023-09-21T12:45:32.237 INFO:teuthology.orchestra.run.smithi160.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-21T12:45:32.237 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.237 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.238 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2023-09-21T12:45:32.238 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-21T12:45:32.238 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.1-7.el8.noarch 2023-09-21T12:45:32.239 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.0.4-10.el8.x86_64 2023-09-21T12:45:32.239 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.239 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.239 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.240 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.240 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.240 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.240 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.241 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.242 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.242 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.242 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.242 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.242 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.243 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.243 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.243 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.243 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.243 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.244 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.244 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:32.244 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-21T12:45:32.244 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.1-9.el8.x86_64 2023-09-21T12:45:32.245 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-21T12:45:32.245 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-21T12:45:32.245 INFO:teuthology.orchestra.run.smithi160.stdout: jq-1.6-3.el8.x86_64 2023-09-21T12:45:32.245 INFO:teuthology.orchestra.run.smithi160.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-21T12:45:32.245 INFO:teuthology.orchestra.run.smithi160.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-21T12:45:32.246 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-21T12:45:32.246 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.246 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.246 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-21T12:45:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-21T12:45:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: libpq-13.5-1.el8.x86_64 2023-09-21T12:45:32.247 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:32.248 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-21T12:45:32.248 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.248 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.248 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-21T12:45:32.249 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.249 INFO:teuthology.orchestra.run.smithi160.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-21T12:45:32.249 INFO:teuthology.orchestra.run.smithi160.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-21T12:45:32.249 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-21T12:45:32.249 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-21T12:45:32.250 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-21T12:45:32.250 INFO:teuthology.orchestra.run.smithi160.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-21T12:45:32.250 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-21T12:45:32.250 INFO:teuthology.orchestra.run.smithi160.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-21T12:45:32.251 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-21T12:45:32.251 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-21T12:45:32.251 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-21T12:45:32.251 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-21T12:45:32.252 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-21T12:45:32.252 INFO:teuthology.orchestra.run.smithi160.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-21T12:45:32.252 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:32.252 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:32.253 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:32.253 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-21T12:45:32.253 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-21T12:45:32.254 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-21T12:45:32.254 INFO:teuthology.orchestra.run.smithi160.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-21T12:45:32.254 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-21T12:45:32.254 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.255 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.255 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.255 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-21T12:45:32.255 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-21T12:45:32.256 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-21T12:45:32.256 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-21T12:45:32.256 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-21T12:45:32.256 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-21T12:45:32.257 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-21T12:45:32.257 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-21T12:45:32.257 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-21T12:45:32.257 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-21T12:45:32.258 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-21T12:45:32.258 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-21T12:45:32.258 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-21T12:45:32.259 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-21T12:45:32.259 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-21T12:45:32.259 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-21T12:45:32.259 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-21T12:45:32.260 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-21T12:45:32.260 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:32.260 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:32.260 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-21T12:45:32.261 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-21T12:45:32.261 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-2.6-1.el8.noarch 2023-09-21T12:45:32.261 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-21T12:45:32.262 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-21T12:45:32.262 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-21T12:45:32.262 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-21T12:45:32.263 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-21T12:45:32.263 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-21T12:45:32.263 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.263 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.264 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-21T12:45:32.264 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-21T12:45:32.264 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.265 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-21T12:45:32.265 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-21T12:45:32.265 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-21T12:45:32.265 INFO:teuthology.orchestra.run.smithi160.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-21T12:45:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-21T12:45:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-21T12:45:32.266 INFO:teuthology.orchestra.run.smithi160.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-21T12:45:32.267 INFO:teuthology.orchestra.run.smithi160.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-21T12:45:32.267 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-21T12:45:32.267 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-21T12:45:32.267 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-21T12:45:32.268 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-21T12:45:32.268 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-21T12:45:32.268 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.268 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.269 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:32.269 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-21T12:45:32.269 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-21T12:45:32.269 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-21T12:45:32.270 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-21T12:45:32.270 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-21T12:45:32.270 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-21T12:45:32.271 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:45:32.271 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2023-09-21T12:45:32.411 DEBUG:teuthology.parallel:result is None 2023-09-21T12:45:35.609 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:35.900 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:35.937 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-21T12:45:36.170 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 124/134 2023-09-21T12:45:36.386 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 125/134 2023-09-21T12:45:36.699 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 126/134 2023-09-21T12:45:37.065 INFO:teuthology.orchestra.run.smithi142.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-21T12:45:37.268 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-09-21T12:45:37.389 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-09-21T12:45:37.627 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-09-21T12:45:37.654 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-09-21T12:45:37.835 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-21T12:45:37.857 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-21T12:45:38.047 INFO:teuthology.orchestra.run.smithi142.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-09-21T12:45:38.047 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:38.274 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:38.275 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:38.515 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-21T12:45:38.769 INFO:teuthology.orchestra.run.smithi142.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:39.026 INFO:teuthology.orchestra.run.smithi142.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:39.026 INFO:teuthology.orchestra.run.smithi142.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-09-21T12:45:39.026 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:45:39.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 1/134 2023-09-21T12:45:39.643 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2/134 2023-09-21T12:45:39.644 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 3/134 2023-09-21T12:45:39.644 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 4/134 2023-09-21T12:45:39.644 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6168.g41c9e 5/134 2023-09-21T12:45:39.645 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 6/134 2023-09-21T12:45:39.645 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 7/134 2023-09-21T12:45:39.645 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 8/134 2023-09-21T12:45:39.645 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 9/134 2023-09-21T12:45:39.645 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 10/134 2023-09-21T12:45:39.646 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 11/134 2023-09-21T12:45:39.646 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 12/134 2023-09-21T12:45:39.646 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 13/134 2023-09-21T12:45:39.646 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_ 14/134 2023-09-21T12:45:39.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 15/134 2023-09-21T12:45:39.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 16/134 2023-09-21T12:45:39.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_6 17/134 2023-09-21T12:45:39.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86 18/134 2023-09-21T12:45:39.647 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 19/134 2023-09-21T12:45:39.648 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el 20/134 2023-09-21T12:45:39.648 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-ceph-common-2:18.0.0-6168.g41c9e835.el8. 21/134 2023-09-21T12:45:39.648 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_6 22/134 2023-09-21T12:45:39.648 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 23/134 2023-09-21T12:45:39.649 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 24/134 2023-09-21T12:45:39.649 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 25/134 2023-09-21T12:45:39.649 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 26/134 2023-09-21T12:45:39.649 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 27/134 2023-09-21T12:45:39.650 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 28/134 2023-09-21T12:45:39.650 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835. 29/134 2023-09-21T12:45:39.650 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noa 30/134 2023-09-21T12:45:39.650 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.n 31/134 2023-09-21T12:45:39.651 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c 32/134 2023-09-21T12:45:39.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el 33/134 2023-09-21T12:45:39.659 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 34/134 2023-09-21T12:45:39.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.e 35/134 2023-09-21T12:45:39.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 36/134 2023-09-21T12:45:39.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 37/134 2023-09-21T12:45:39.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 38/134 2023-09-21T12:45:39.660 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-21T12:45:39.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-21T12:45:39.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-21T12:45:39.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-21T12:45:39.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-21T12:45:39.661 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-21T12:45:39.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-21T12:45:39.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-21T12:45:39.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-21T12:45:39.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-21T12:45:39.662 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-21T12:45:39.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-21T12:45:39.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-21T12:45:39.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-21T12:45:39.663 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-21T12:45:39.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-21T12:45:39.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-21T12:45:39.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-21T12:45:39.664 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-21T12:45:39.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-21T12:45:39.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-21T12:45:39.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-21T12:45:39.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-21T12:45:39.665 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-21T12:45:39.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-21T12:45:39.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-21T12:45:39.666 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-21T12:45:39.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-21T12:45:39.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-21T12:45:39.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-21T12:45:39.667 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-21T12:45:39.668 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-21T12:45:39.668 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-21T12:45:39.668 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-09-21T12:45:39.668 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-09-21T12:45:39.669 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-09-21T12:45:39.669 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-09-21T12:45:39.669 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-09-21T12:45:39.669 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-09-21T12:45:39.669 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-09-21T12:45:39.670 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-09-21T12:45:39.670 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-09-21T12:45:39.670 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-09-21T12:45:39.671 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-09-21T12:45:39.671 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-09-21T12:45:39.671 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-09-21T12:45:39.671 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-09-21T12:45:39.672 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-09-21T12:45:39.672 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-09-21T12:45:39.672 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-09-21T12:45:39.672 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-09-21T12:45:39.673 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-09-21T12:45:39.673 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-09-21T12:45:39.673 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-09-21T12:45:39.673 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-09-21T12:45:39.674 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-09-21T12:45:39.674 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-09-21T12:45:39.674 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-09-21T12:45:39.674 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-09-21T12:45:39.675 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-09-21T12:45:39.675 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-09-21T12:45:39.675 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-09-21T12:45:39.675 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-09-21T12:45:39.676 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-09-21T12:45:39.676 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-09-21T12:45:39.676 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-09-21T12:45:39.676 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-09-21T12:45:39.677 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-09-21T12:45:39.677 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-09-21T12:45:39.677 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-09-21T12:45:39.677 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-09-21T12:45:39.678 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-09-21T12:45:39.678 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-09-21T12:45:39.678 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-09-21T12:45:39.679 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-09-21T12:45:39.679 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-09-21T12:45:39.679 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-09-21T12:45:39.679 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-09-21T12:45:39.680 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-09-21T12:45:39.680 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-09-21T12:45:39.680 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-09-21T12:45:39.681 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-09-21T12:45:39.681 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-09-21T12:45:39.681 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-09-21T12:45:39.681 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-09-21T12:45:39.681 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-09-21T12:45:39.682 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-09-21T12:45:39.682 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-09-21T12:45:39.682 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-09-21T12:45:39.682 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-09-21T12:45:39.683 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 129/134 2023-09-21T12:45:39.683 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-21T12:45:39.683 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 131/134 2023-09-21T12:45:39.683 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-21T12:45:39.683 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-21T12:45:42.396 INFO:teuthology.orchestra.run.smithi142.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-21T12:45:42.397 INFO:teuthology.orchestra.run.smithi142.stdout:Last metadata expiration check: 0:02:10 ago on Thu 21 Sep 2023 12:43:32 PM UTC. 2023-09-21T12:45:45.038 INFO:teuthology.orchestra.run.smithi142.stdout:Installed products updated. 2023-09-21T12:45:45.289 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:45:45.289 INFO:teuthology.orchestra.run.smithi142.stdout:Upgraded: 2023-09-21T12:45:45.289 INFO:teuthology.orchestra.run.smithi142.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-21T12:45:45.289 INFO:teuthology.orchestra.run.smithi142.stdout: librados2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.290 INFO:teuthology.orchestra.run.smithi142.stdout: librbd1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.290 INFO:teuthology.orchestra.run.smithi142.stdout:Installed: 2023-09-21T12:45:45.290 INFO:teuthology.orchestra.run.smithi142.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-21T12:45:45.290 INFO:teuthology.orchestra.run.smithi142.stdout: automake-1.16.1-7.el8.noarch 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: bison-3.0.4-10.el8.x86_64 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-base-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.291 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-grafana-dashboards-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.292 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-immutable-object-cache-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.292 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mds-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.292 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.292 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.292 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-dashboard-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.293 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.293 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-modules-core-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.293 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mgr-rook-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.293 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-mon-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.293 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-osd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.294 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-prometheus-alerts-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.294 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-radosgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.294 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-selinux-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.294 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-test-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.294 INFO:teuthology.orchestra.run.smithi142.stdout: ceph-volume-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.295 INFO:teuthology.orchestra.run.smithi142.stdout: cephadm-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.295 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.295 INFO:teuthology.orchestra.run.smithi142.stdout: cephfs-top-2:18.0.0-6168.g41c9e835.el8.noarch 2023-09-21T12:45:45.295 INFO:teuthology.orchestra.run.smithi142.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-21T12:45:45.295 INFO:teuthology.orchestra.run.smithi142.stdout: flex-2.6.1-9.el8.x86_64 2023-09-21T12:45:45.296 INFO:teuthology.orchestra.run.smithi142.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-21T12:45:45.296 INFO:teuthology.orchestra.run.smithi142.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-21T12:45:45.296 INFO:teuthology.orchestra.run.smithi142.stdout: jq-1.6-3.el8.x86_64 2023-09-21T12:45:45.296 INFO:teuthology.orchestra.run.smithi142.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-21T12:45:45.296 INFO:teuthology.orchestra.run.smithi142.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-21T12:45:45.297 INFO:teuthology.orchestra.run.smithi142.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-21T12:45:45.297 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.297 INFO:teuthology.orchestra.run.smithi142.stdout: libcephfs2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.297 INFO:teuthology.orchestra.run.smithi142.stdout: libcephsqlite-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.297 INFO:teuthology.orchestra.run.smithi142.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-21T12:45:45.298 INFO:teuthology.orchestra.run.smithi142.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:45.298 INFO:teuthology.orchestra.run.smithi142.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-21T12:45:45.298 INFO:teuthology.orchestra.run.smithi142.stdout: libpq-13.5-1.el8.x86_64 2023-09-21T12:45:45.298 INFO:teuthology.orchestra.run.smithi142.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-21T12:45:45.298 INFO:teuthology.orchestra.run.smithi142.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-21T12:45:45.299 INFO:teuthology.orchestra.run.smithi142.stdout: librados-devel-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.299 INFO:teuthology.orchestra.run.smithi142.stdout: libradosstriper1-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.299 INFO:teuthology.orchestra.run.smithi142.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-21T12:45:45.299 INFO:teuthology.orchestra.run.smithi142.stdout: librgw2-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.299 INFO:teuthology.orchestra.run.smithi142.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-21T12:45:45.300 INFO:teuthology.orchestra.run.smithi142.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-21T12:45:45.301 INFO:teuthology.orchestra.run.smithi142.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-21T12:45:45.301 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-21T12:45:45.301 INFO:teuthology.orchestra.run.smithi142.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-21T12:45:45.301 INFO:teuthology.orchestra.run.smithi142.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-21T12:45:45.301 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-21T12:45:45.302 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-21T12:45:45.302 INFO:teuthology.orchestra.run.smithi142.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-21T12:45:45.302 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:45.302 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:45.302 INFO:teuthology.orchestra.run.smithi142.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-21T12:45:45.303 INFO:teuthology.orchestra.run.smithi142.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-21T12:45:45.303 INFO:teuthology.orchestra.run.smithi142.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-21T12:45:45.303 INFO:teuthology.orchestra.run.smithi142.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-21T12:45:45.303 INFO:teuthology.orchestra.run.smithi142.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-21T12:45:45.303 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-21T12:45:45.304 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-argparse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.304 INFO:teuthology.orchestra.run.smithi142.stdout: python3-ceph-common-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.304 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cephfs-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.304 INFO:teuthology.orchestra.run.smithi142.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-21T12:45:45.304 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-21T12:45:45.305 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-21T12:45:45.305 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-21T12:45:45.305 INFO:teuthology.orchestra.run.smithi142.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-21T12:45:45.305 INFO:teuthology.orchestra.run.smithi142.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-21T12:45:45.306 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-21T12:45:45.306 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-21T12:45:45.306 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-21T12:45:45.306 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-21T12:45:45.306 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-21T12:45:45.307 INFO:teuthology.orchestra.run.smithi142.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-21T12:45:45.308 INFO:teuthology.orchestra.run.smithi142.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-21T12:45:45.308 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:45.308 INFO:teuthology.orchestra.run.smithi142.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-21T12:45:45.308 INFO:teuthology.orchestra.run.smithi142.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-21T12:45:45.308 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-21T12:45:45.309 INFO:teuthology.orchestra.run.smithi142.stdout: python3-portend-2.6-1.el8.noarch 2023-09-21T12:45:45.309 INFO:teuthology.orchestra.run.smithi142.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-21T12:45:45.309 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-21T12:45:45.309 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-21T12:45:45.309 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-21T12:45:45.310 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-21T12:45:45.310 INFO:teuthology.orchestra.run.smithi142.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-21T12:45:45.310 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rados-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.310 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.310 INFO:teuthology.orchestra.run.smithi142.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-21T12:45:45.311 INFO:teuthology.orchestra.run.smithi142.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-21T12:45:45.311 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rgw-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.311 INFO:teuthology.orchestra.run.smithi142.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-21T12:45:45.311 INFO:teuthology.orchestra.run.smithi142.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-21T12:45:45.311 INFO:teuthology.orchestra.run.smithi142.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-21T12:45:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-21T12:45:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-21T12:45:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-21T12:45:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-21T12:45:45.312 INFO:teuthology.orchestra.run.smithi142.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-21T12:45:45.313 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-fuse-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.314 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-mirror-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.314 INFO:teuthology.orchestra.run.smithi142.stdout: rbd-nbd-2:18.0.0-6168.g41c9e835.el8.x86_64 2023-09-21T12:45:45.314 INFO:teuthology.orchestra.run.smithi142.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-21T12:45:45.314 INFO:teuthology.orchestra.run.smithi142.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-21T12:45:45.314 INFO:teuthology.orchestra.run.smithi142.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-21T12:45:45.315 INFO:teuthology.orchestra.run.smithi142.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-21T12:45:45.315 INFO:teuthology.orchestra.run.smithi142.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-21T12:45:45.315 INFO:teuthology.orchestra.run.smithi142.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-21T12:45:45.316 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:45:45.316 INFO:teuthology.orchestra.run.smithi142.stdout:Complete! 2023-09-21T12:45:46.325 DEBUG:teuthology.parallel:result is None 2023-09-21T12:45:46.326 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:46.493 DEBUG:teuthology.orchestra.run.smithi142:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-21T12:45:46.547 INFO:teuthology.orchestra.run.smithi142.stdout:18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.548 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.548 INFO:teuthology.task.install:The correct ceph version 18.0.0-6168.g41c9e835 is installed. 2023-09-21T12:45:46.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:46.695 DEBUG:teuthology.orchestra.run.smithi156:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-21T12:45:46.723 INFO:teuthology.orchestra.run.smithi156.stdout:18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.724 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.724 INFO:teuthology.task.install:The correct ceph version 18.0.0-6168.g41c9e835 is installed. 2023-09-21T12:45:46.725 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:46.949 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-21T12:45:46.978 INFO:teuthology.orchestra.run.smithi160.stdout:18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.979 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6168.g41c9e835.el8 2023-09-21T12:45:46.979 INFO:teuthology.task.install:The correct ceph version 18.0.0-6168.g41c9e835 is installed. 2023-09-21T12:45:46.979 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-21T12:45:46.980 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:45:46.980 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-21T12:45:47.071 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:45:47.072 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-21T12:45:47.121 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:45:47.121 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-21T12:45:47.168 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-21T12:45:47.169 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:45:47.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/daemon-helper 2023-09-21T12:45:47.275 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-21T12:45:47.414 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:45:47.414 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/daemon-helper 2023-09-21T12:45:47.447 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-21T12:45:47.518 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:45:47.519 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2023-09-21T12:45:47.553 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-21T12:45:47.625 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-21T12:45:47.625 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:45:47.625 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-21T12:45:47.693 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-21T12:45:47.800 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:45:47.801 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-21T12:45:47.834 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-21T12:45:47.906 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:45:47.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-21T12:45:47.939 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-21T12:45:48.011 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-21T12:45:48.012 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:45:48.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/usr/bin/stdin-killer 2023-09-21T12:45:48.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-21T12:45:48.188 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:45:48.188 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/usr/bin/stdin-killer 2023-09-21T12:45:48.220 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-21T12:45:48.290 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:45:48.291 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2023-09-21T12:45:48.323 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-21T12:45:48.394 INFO:teuthology.run_tasks:Running task cephadm... 2023-09-21T12:45:48.739 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '41c9e835c3f621102ade35dd597317a42116a491', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-09-21T12:45:48.740 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:48.741 INFO:tasks.cephadm:Cluster fsid is ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:45:48.741 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-09-21T12:45:48.742 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.142', 'mon.b': '172.21.15.156', 'mon.c': '172.21.15.160'} 2023-09-21T12:45:48.742 INFO:tasks.cephadm:First mon is mon.a on smithi142 2023-09-21T12:45:48.742 INFO:tasks.cephadm:First mgr is x 2023-09-21T12:45:48.742 INFO:tasks.cephadm:Normalizing hostnames... 2023-09-21T12:45:48.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo hostname $(hostname -s) 2023-09-21T12:45:48.814 DEBUG:teuthology.orchestra.run.smithi156:> sudo hostname $(hostname -s) 2023-09-21T12:45:48.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo hostname $(hostname -s) 2023-09-21T12:45:48.881 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-09-21T12:45:48.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:49.026 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '41c9e835c3f621102ade35dd597317a42116a491', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/72704/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6168-g41c9e835', 'node_name': '172.21.2.4+braggi04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6168.g41c9e835'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-09-20 14:24:27.570213', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-lusov-config-format', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-09-21T12:45:49.196 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-lusov-config-format, sha1 41c9e835c3f621102ade35dd597317a42116a491 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:45:49.196 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/x86_64/flavors/default/cephadm 2023-09-21T12:45:49.197 DEBUG:teuthology.orchestra.run.smithi142:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:49.723 INFO:teuthology.orchestra.run.smithi142.stdout:-rw-rw-r--. 1 ubuntu ubuntu 733450 Sep 21 12:45 /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:49.724 DEBUG:teuthology.orchestra.run.smithi156:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.103 INFO:teuthology.orchestra.run.smithi156.stdout:-rw-rw-r--. 1 ubuntu ubuntu 733450 Sep 21 12:45 /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.103 DEBUG:teuthology.orchestra.run.smithi160:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-lusov-config-format/41c9e835c3f621102ade35dd597317a42116a491/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.612 INFO:teuthology.orchestra.run.smithi160.stdout:-rw-rw-r--. 1 ubuntu ubuntu 733450 Sep 21 12:45 /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.613 DEBUG:teuthology.orchestra.run.smithi142:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.664 DEBUG:teuthology.orchestra.run.smithi156:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.686 DEBUG:teuthology.orchestra.run.smithi160:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-21T12:45:50.747 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 on all hosts... 2023-09-21T12:45:50.747 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 pull 2023-09-21T12:45:50.752 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 pull 2023-09-21T12:45:50.755 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 pull 2023-09-21T12:45:52.437 INFO:teuthology.orchestra.run.smithi156.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491... 2023-09-21T12:45:53.783 INFO:teuthology.orchestra.run.smithi160.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491... 2023-09-21T12:45:55.413 INFO:teuthology.orchestra.run.smithi142.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491... 2023-09-21T12:46:18.727 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-21T12:46:18.728 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_version": "ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev)", 2023-09-21T12:46:18.728 INFO:teuthology.orchestra.run.smithi156.stdout: "image_id": "5dcbd8e3a27a1f4f816497f22b01b6f49bbb382efefe94b3c13332adc7b6f17c", 2023-09-21T12:46:18.728 INFO:teuthology.orchestra.run.smithi156.stdout: "repo_digests": [ 2023-09-21T12:46:18.728 INFO:teuthology.orchestra.run.smithi156.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5ccdeef007e4c19e6e851e16ce2e93e676143e0a82d80cfc2da058ff3f026c70" 2023-09-21T12:46:18.729 INFO:teuthology.orchestra.run.smithi156.stdout: ] 2023-09-21T12:46:18.729 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-21T12:46:19.075 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2023-09-21T12:46:19.076 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev)", 2023-09-21T12:46:19.076 INFO:teuthology.orchestra.run.smithi160.stdout: "image_id": "5dcbd8e3a27a1f4f816497f22b01b6f49bbb382efefe94b3c13332adc7b6f17c", 2023-09-21T12:46:19.076 INFO:teuthology.orchestra.run.smithi160.stdout: "repo_digests": [ 2023-09-21T12:46:19.076 INFO:teuthology.orchestra.run.smithi160.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5ccdeef007e4c19e6e851e16ce2e93e676143e0a82d80cfc2da058ff3f026c70" 2023-09-21T12:46:19.076 INFO:teuthology.orchestra.run.smithi160.stdout: ] 2023-09-21T12:46:19.077 INFO:teuthology.orchestra.run.smithi160.stdout:} 2023-09-21T12:46:27.982 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:46:27.982 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_version": "ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev)", 2023-09-21T12:46:27.982 INFO:teuthology.orchestra.run.smithi142.stdout: "image_id": "5dcbd8e3a27a1f4f816497f22b01b6f49bbb382efefe94b3c13332adc7b6f17c", 2023-09-21T12:46:27.983 INFO:teuthology.orchestra.run.smithi142.stdout: "repo_digests": [ 2023-09-21T12:46:27.983 INFO:teuthology.orchestra.run.smithi142.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5ccdeef007e4c19e6e851e16ce2e93e676143e0a82d80cfc2da058ff3f026c70" 2023-09-21T12:46:27.983 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T12:46:27.983 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:46:28.007 DEBUG:teuthology.orchestra.run.smithi142:> sudo mkdir -p /etc/ceph 2023-09-21T12:46:28.082 DEBUG:teuthology.orchestra.run.smithi156:> sudo mkdir -p /etc/ceph 2023-09-21T12:46:28.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph 2023-09-21T12:46:28.155 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 777 /etc/ceph 2023-09-21T12:46:28.223 DEBUG:teuthology.orchestra.run.smithi156:> sudo chmod 777 /etc/ceph 2023-09-21T12:46:28.256 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /etc/ceph 2023-09-21T12:46:28.288 INFO:tasks.cephadm:Writing seed config... 2023-09-21T12:46:28.292 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-09-21T12:46:28.292 INFO:tasks.cephadm: override: [client] debug client = 20 2023-09-21T12:46:28.292 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-09-21T12:46:28.293 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-09-21T12:46:28.293 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-09-21T12:46:28.293 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-09-21T12:46:28.294 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-09-21T12:46:28.294 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-09-21T12:46:28.294 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-09-21T12:46:28.294 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-09-21T12:46:28.295 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-09-21T12:46:28.295 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-09-21T12:46:28.295 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-09-21T12:46:28.296 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-09-21T12:46:28.296 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-09-21T12:46:28.296 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-09-21T12:46:28.296 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-09-21T12:46:28.297 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-09-21T12:46:28.297 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-09-21T12:46:28.297 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-09-21T12:46:28.298 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-09-21T12:46:28.298 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-09-21T12:46:28.298 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-09-21T12:46:28.298 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-09-21T12:46:28.299 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-09-21T12:46:28.299 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-09-21T12:46:28.299 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-09-21T12:46:28.300 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-09-21T12:46:28.300 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-09-21T12:46:28.300 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-09-21T12:46:28.300 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-09-21T12:46:28.301 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-09-21T12:46:28.301 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-09-21T12:46:28.301 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-09-21T12:46:28.301 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-09-21T12:46:28.302 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-09-21T12:46:28.302 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-09-21T12:46:28.302 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-09-21T12:46:28.303 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-09-21T12:46:28.303 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-09-21T12:46:28.303 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-09-21T12:46:28.303 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-09-21T12:46:28.304 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-09-21T12:46:28.304 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-09-21T12:46:28.305 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:46:28.305 DEBUG:teuthology.orchestra.run.smithi142:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-09-21T12:46:28.348 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ca3f7e80-587c-11ee-9ab8-7b867c8bd7da ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-09-21T12:46:28.348 DEBUG:teuthology.orchestra.run.smithi142:mon.a> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service 2023-09-21T12:46:28.409 DEBUG:teuthology.orchestra.run.smithi142:mgr.x> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x.service 2023-09-21T12:46:28.454 INFO:tasks.cephadm:Bootstrapping... 2023-09-21T12:46:28.455 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 -v bootstrap --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.142 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-09-21T12:46:29.489 INFO:journalctl@ceph.mon.a.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:46:29.490 INFO:journalctl@ceph.mgr.x.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:46:29.743 INFO:teuthology.orchestra.run.smithi142.stdout:-------------------------------------------------------------------------------- 2023-09-21T12:46:29.743 INFO:teuthology.orchestra.run.smithi142.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491', '-v', 'bootstrap', '--fsid', 'ca3f7e80-587c-11ee-9ab8-7b867c8bd7da', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.142', '--skip-admin-label'] 2023-09-21T12:46:29.915 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.1.1 2023-09-21T12:46:29.915 INFO:teuthology.orchestra.run.smithi142.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-09-21T12:46:29.916 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying podman|docker is present... 2023-09-21T12:46:30.085 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.1.1 2023-09-21T12:46:30.085 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying lvm2 is present... 2023-09-21T12:46:30.086 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying time synchronization is in place... 2023-09-21T12:46:30.099 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-21T12:46:30.099 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-21T12:46:30.112 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-21T12:46:30.113 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:46:30.126 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout enabled 2023-09-21T12:46:30.139 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout active 2023-09-21T12:46:30.139 INFO:teuthology.orchestra.run.smithi142.stdout:Unit chronyd.service is enabled and running 2023-09-21T12:46:30.139 INFO:teuthology.orchestra.run.smithi142.stdout:Repeating the final host check... 2023-09-21T12:46:30.307 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 4.1.1 2023-09-21T12:46:30.307 INFO:teuthology.orchestra.run.smithi142.stdout:podman (/bin/podman) version 4.1.1 is present 2023-09-21T12:46:30.308 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl is present 2023-09-21T12:46:30.308 INFO:teuthology.orchestra.run.smithi142.stdout:lvcreate is present 2023-09-21T12:46:30.320 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-21T12:46:30.321 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-21T12:46:30.332 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-21T12:46:30.333 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:46:30.346 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout enabled 2023-09-21T12:46:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout active 2023-09-21T12:46:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:Unit chronyd.service is enabled and running 2023-09-21T12:46:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:Host looks OK 2023-09-21T12:46:30.359 INFO:teuthology.orchestra.run.smithi142.stdout:Cluster fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:30.360 INFO:teuthology.orchestra.run.smithi142.stdout:Acquiring lock 140162308274664 on /run/cephadm/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.lock 2023-09-21T12:46:30.361 INFO:teuthology.orchestra.run.smithi142.stdout:Lock 140162308274664 acquired on /run/cephadm/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.lock 2023-09-21T12:46:30.361 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying IP 172.21.15.142 port 3300 ... 2023-09-21T12:46:30.361 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying IP 172.21.15.142 port 6789 ... 2023-09-21T12:46:30.361 INFO:teuthology.orchestra.run.smithi142.stdout:Base mon IP(s) is [172.21.15.142:3300, 172.21.15.142:6789], mon addrv is [v2:172.21.15.142:3300,v1:172.21.15.142:6789] 2023-09-21T12:46:30.368 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-09-21T12:46:30.368 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.142 metric 100 2023-09-21T12:46:30.375 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-09-21T12:46:30.375 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-09-21T12:46:30.375 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-09-21T12:46:30.381 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-09-21T12:46:30.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-09-21T12:46:30.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-21T12:46:30.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-09-21T12:46:30.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout inet6 fe80::7a4f:a396:a154:4bd/64 scope link noprefixroute 2023-09-21T12:46:30.382 INFO:teuthology.orchestra.run.smithi142.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-21T12:46:30.383 INFO:teuthology.orchestra.run.smithi142.stdout:Mon IP `172.21.15.142` is in CIDR network `172.21.0.0/20` 2023-09-21T12:46:30.383 INFO:teuthology.orchestra.run.smithi142.stdout:Mon IP `172.21.15.142` is in CIDR network `172.21.0.0/20` 2023-09-21T12:46:30.383 INFO:teuthology.orchestra.run.smithi142.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-09-21T12:46:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-09-21T12:46:30.384 INFO:teuthology.orchestra.run.smithi142.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491... 2023-09-21T12:46:30.855 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stdout 5dcbd8e3a27a1f4f816497f22b01b6f49bbb382efefe94b3c13332adc7b6f17c 2023-09-21T12:46:30.856 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491... 2023-09-21T12:46:30.856 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Getting image source signatures 2023-09-21T12:46:30.856 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying blob sha256:cf3a568310ecc7a445dd35037557a7bffe808999316550e149bcddebbd73a243 2023-09-21T12:46:30.856 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying blob sha256:3f4fd5c3c800c6da9ef94691df203a05a5bbbf32c483d09d620ec06eef42ea2b 2023-09-21T12:46:30.857 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Copying config sha256:5dcbd8e3a27a1f4f816497f22b01b6f49bbb382efefe94b3c13332adc7b6f17c 2023-09-21T12:46:30.857 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Writing manifest to image destination 2023-09-21T12:46:30.857 INFO:teuthology.orchestra.run.smithi142.stdout:/bin/podman: stderr Storing signatures 2023-09-21T12:46:31.728 INFO:teuthology.orchestra.run.smithi142.stdout:ceph: stdout ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev) 2023-09-21T12:46:31.729 INFO:teuthology.orchestra.run.smithi142.stdout:Ceph version: ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev) 2023-09-21T12:46:31.729 INFO:teuthology.orchestra.run.smithi142.stdout:Extracting ceph user uid/gid from container image... 2023-09-21T12:46:32.604 INFO:teuthology.orchestra.run.smithi142.stdout:stat: stdout 167 167 2023-09-21T12:46:32.604 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial keys... 2023-09-21T12:46:33.378 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQAoOwxlvq1yOxAA0fPO56bViL7EPM1BuzJI2w== 2023-09-21T12:46:34.157 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQApOwxlZyWLLBAAaI9d5236HhbEOvqOP4dqOQ== 2023-09-21T12:46:34.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph-authtool: stdout AQAqOwxl5yIhHxAAxwA+MgFTas5SlvwLTdaAQA== 2023-09-21T12:46:34.931 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial monmap... 2023-09-21T12:46:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-21T12:46:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-09-21T12:46:36.213 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-21T12:46:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:monmaptool for a [v2:172.21.15.142:3300,v1:172.21.15.142:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-21T12:46:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:setting min_mon_release = pacific 2023-09-21T12:46:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: set fsid to ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:36.214 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-21T12:46:36.215 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:46:36.215 INFO:teuthology.orchestra.run.smithi142.stdout:Creating mon... 2023-09-21T12:46:37.087 INFO:teuthology.orchestra.run.smithi142.stdout:create mon.a on 2023-09-21T12:46:37.327 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-09-21T12:46:37.528 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-09-21T12:46:37.754 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target → /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target. 2023-09-21T12:46:37.754 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target → /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target. 2023-09-21T12:46:38.105 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a 2023-09-21T12:46:38.105 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service: Unit ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service not loaded. 2023-09-21T12:46:38.304 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target.wants/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service → /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@.service. 2023-09-21T12:46:38.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:38 smithi142 systemd[1]: Starting Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:46:39.083 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:38 smithi142 podman[97121]: 2023-09-21T12:46:39.210 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-21T12:46:39.210 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2023-09-21T12:46:39.225 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-21T12:46:39.226 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:46:39.226 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2023-09-21T12:46:39.226 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to enable service . firewalld.service is not available 2023-09-21T12:46:39.227 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mon to start... 2023-09-21T12:46:39.227 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mon... 2023-09-21T12:46:39.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:39 smithi142 bash[97121]: 54990e17a0c4ff2a746176e629c645baae0ff788079752729169880bfe79edbd 2023-09-21T12:46:39.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:39 smithi142 ceph-mon[97161]: mkfs ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:39.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:39 smithi142 ceph-mon[97161]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-21T12:46:39.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:39 smithi142 systemd[1]: Started Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:46:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-21T12:46:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: monmap e1: 1 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} 2023-09-21T12:46:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: fsmap 2023-09-21T12:46:40.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: osdmap e1: 0 total, 0 up, 0 in 2023-09-21T12:46:40.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: mgrmap e1: no daemons active 2023-09-21T12:46:40.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:40 smithi142 ceph-mon[97161]: from='client.? 172.21.15.142:0/2835515977' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-09-21T12:46:40.408 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout cluster: 2023-09-21T12:46:40.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout id: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:40.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-09-21T12:46:40.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:40.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout services: 2023-09-21T12:46:40.414 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.759978s) 2023-09-21T12:46:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-09-21T12:46:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-09-21T12:46:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout data: 2023-09-21T12:46:40.415 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout pgs: 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.800+0000 7f973c62a700 1 Processor -- start 2023-09-21T12:46:40.416 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.800+0000 7f973c62a700 1 -- start start 2023-09-21T12:46:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.800+0000 7f973c62a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.800+0000 7f973c62a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9734106ff0 con 0x7f9734106600 2023-09-21T12:46:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.801+0000 7f973a3c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.801+0000 7f973a3c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56898/0 (socket says 172.21.15.142:56898) 2023-09-21T12:46:40.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.801+0000 7f973a3c6700 1 -- 172.21.15.142:0/2432571746 learned_addr learned my addr 172.21.15.142:0/2432571746 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.801+0000 7f973a3c6700 1 -- 172.21.15.142:0/2432571746 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734107800 con 0x7f9734106600 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973a3c6700 1 --2- 172.21.15.142:0/2432571746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f97300098a0 tx=0x7f9730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c0e6186d8213f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f97393c4700 1 -- 172.21.15.142:0/2432571746 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9730004160 con 0x7f9734106600 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f97393c4700 1 -- 172.21.15.142:0/2432571746 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97300042c0 con 0x7f9734106600 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f97393c4700 1 -- 172.21.15.142:0/2432571746 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97300045a0 con 0x7f9734106600 2023-09-21T12:46:40.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973c62a700 1 -- 172.21.15.142:0/2432571746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 msgr2=0x7f9734106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973c62a700 1 --2- 172.21.15.142:0/2432571746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f97300098a0 tx=0x7f9730009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973c62a700 1 -- 172.21.15.142:0/2432571746 shutdown_connections 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973c62a700 1 --2- 172.21.15.142:0/2432571746 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f9734106a20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.802+0000 7f973c62a700 1 -- 172.21.15.142:0/2432571746 >> 172.21.15.142:0/2432571746 conn(0x7f9734101ba0 msgr2=0x7f9734103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.803+0000 7f973c62a700 1 -- 172.21.15.142:0/2432571746 shutdown_connections 2023-09-21T12:46:40.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.803+0000 7f973c62a700 1 -- 172.21.15.142:0/2432571746 wait complete. 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973c62a700 1 Processor -- start 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973c62a700 1 -- start start 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973c62a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973c62a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973419c470 con 0x7f9734106600 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973a3c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:40.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973a3c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56902/0 (socket says 172.21.15.142:56902) 2023-09-21T12:46:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.804+0000 7f973a3c6700 1 -- 172.21.15.142:0/2835515977 learned_addr learned my addr 172.21.15.142:0/2835515977 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f973a3c6700 1 -- 172.21.15.142:0/2835515977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9730009550 con 0x7f9734106600 2023-09-21T12:46:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f973a3c6700 1 --2- 172.21.15.142:0/2835515977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9730004000 tx=0x7f9730004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9730011630 con 0x7f9734106600 2023-09-21T12:46:40.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730011790 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9730011a30 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973419c670 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.805+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973419ca90 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.806+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9730022070 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.806+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f973001c450 con 0x7f9734106600 2023-09-21T12:46:40.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.806+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9734062410 con 0x7f9734106600 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.809+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f973001b450 con 0x7f9734106600 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.880+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f9734107b70 con 0x7f9734106600 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.881+0000 7f972b7fe700 1 -- 172.21.15.142:0/2835515977 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f9734107b70 con 0x7f9734106600 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 msgr2=0x7f973419bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 --2- 172.21.15.142:0/2835515977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9730004000 tx=0x7f9730004750 comp rx=0 tx=0).stop 2023-09-21T12:46:40.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 shutdown_connections 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 --2- 172.21.15.142:0/2835515977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9734106600 0x7f973419bf30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 >> 172.21.15.142:0/2835515977 conn(0x7f9734101ba0 msgr2=0x7f973407a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 shutdown_connections 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:39.882+0000 7f973c62a700 1 -- 172.21.15.142:0/2835515977 wait complete. 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:mon is available 2023-09-21T12:46:40.424 INFO:teuthology.orchestra.run.smithi142.stdout:Assimilating anything we can from ceph.conf... 2023-09-21T12:46:42.651 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:42 smithi142 ceph-mon[97161]: from='client.? 172.21.15.142:0/249744188' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-21T12:46:42.652 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:42 smithi142 ceph-mon[97161]: from='client.? 172.21.15.142:0/249744188' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-09-21T12:46:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:42.698 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [global] 2023-09-21T12:46:42.699 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout fsid = ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:42.699 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.142:3300,v1:172.21.15.142:6789] 2023-09-21T12:46:42.699 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-21T12:46:42.699 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-21T12:46:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-21T12:46:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-21T12:46:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-21T12:46:42.700 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-21T12:46:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [osd] 2023-09-21T12:46:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-21T12:46:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-21T12:46:42.701 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-21T12:46:42.702 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-21T12:46:42.702 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-21T12:46:42.702 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.101+0000 7fd1a3da3700 1 Processor -- start 2023-09-21T12:46:42.702 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.101+0000 7fd1a3da3700 1 -- start start 2023-09-21T12:46:42.702 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.102+0000 7fd1a3da3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:42.703 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.102+0000 7fd1a3da3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c106ff0 con 0x7fd19c106600 2023-09-21T12:46:42.703 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.102+0000 7fd1a1b3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:42.703 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.102+0000 7fd1a1b3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56910/0 (socket says 172.21.15.142:56910) 2023-09-21T12:46:42.703 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.102+0000 7fd1a1b3f700 1 -- 172.21.15.142:0/630551024 learned_addr learned my addr 172.21.15.142:0/630551024 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:42.703 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.103+0000 7fd1a1b3f700 1 -- 172.21.15.142:0/630551024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c107800 con 0x7fd19c106600 2023-09-21T12:46:42.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.103+0000 7fd1a1b3f700 1 --2- 172.21.15.142:0/630551024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd1980098a0 tx=0x7fd198009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d2870975f84f03 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:42.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.103+0000 7fd1a0b3d700 1 -- 172.21.15.142:0/630551024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd198004160 con 0x7fd19c106600 2023-09-21T12:46:42.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.103+0000 7fd1a0b3d700 1 -- 172.21.15.142:0/630551024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1980042c0 con 0x7fd19c106600 2023-09-21T12:46:42.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.103+0000 7fd1a0b3d700 1 -- 172.21.15.142:0/630551024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1980045a0 con 0x7fd19c106600 2023-09-21T12:46:42.704 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 -- 172.21.15.142:0/630551024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 msgr2=0x7fd19c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 --2- 172.21.15.142:0/630551024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd1980098a0 tx=0x7fd198009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 -- 172.21.15.142:0/630551024 shutdown_connections 2023-09-21T12:46:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 --2- 172.21.15.142:0/630551024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c106a20 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:42.705 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 -- 172.21.15.142:0/630551024 >> 172.21.15.142:0/630551024 conn(0x7fd19c101ba0 msgr2=0x7fd19c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 -- 172.21.15.142:0/630551024 shutdown_connections 2023-09-21T12:46:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.104+0000 7fd1a3da3700 1 -- 172.21.15.142:0/630551024 wait complete. 2023-09-21T12:46:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.105+0000 7fd1a3da3700 1 Processor -- start 2023-09-21T12:46:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.105+0000 7fd1a3da3700 1 -- start start 2023-09-21T12:46:42.706 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a3da3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:42.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a3da3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c19c470 con 0x7fd19c106600 2023-09-21T12:46:42.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a1b3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:42.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a1b3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56912/0 (socket says 172.21.15.142:56912) 2023-09-21T12:46:42.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a1b3f700 1 -- 172.21.15.142:0/249744188 learned_addr learned my addr 172.21.15.142:0/249744188 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:42.707 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a1b3f700 1 -- 172.21.15.142:0/249744188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198009550 con 0x7fd19c106600 2023-09-21T12:46:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.106+0000 7fd1a1b3f700 1 --2- 172.21.15.142:0/249744188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd198004000 tx=0x7fd198004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd198011630 con 0x7fd19c106600 2023-09-21T12:46:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198011790 con 0x7fd19c106600 2023-09-21T12:46:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd198011a30 con 0x7fd19c106600 2023-09-21T12:46:42.708 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c19c670 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c19ca90 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd198022070 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.107+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd19801c450 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.108+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c062410 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.110+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd19801b450 con 0x7fd19c106600 2023-09-21T12:46:42.709 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.181+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd19c107b70 con 0x7fd19c106600 2023-09-21T12:46:42.710 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.185+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd19801b5f0 con 0x7fd19c106600 2023-09-21T12:46:42.710 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.185+0000 7fd192ffd700 1 -- 172.21.15.142:0/249744188 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fd198024510 con 0x7fd19c106600 2023-09-21T12:46:42.710 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 msgr2=0x7fd19c19bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:42.710 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 --2- 172.21.15.142:0/249744188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fd198004000 tx=0x7fd198004750 comp rx=0 tx=0).stop 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 shutdown_connections 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 --2- 172.21.15.142:0/249744188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd19c106600 0x7fd19c19bf30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 >> 172.21.15.142:0/249744188 conn(0x7fd19c101ba0 msgr2=0x7fd19c07a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.186+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 shutdown_connections 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:42.187+0000 7fd1a3da3700 1 -- 172.21.15.142:0/249744188 wait complete. 2023-09-21T12:46:42.711 INFO:teuthology.orchestra.run.smithi142.stdout:Generating new minimal ceph.conf... 2023-09-21T12:46:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:43 smithi142 ceph-mon[97161]: from='client.? 172.21.15.142:0/824828369' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:46:43.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.241+0000 7fd556cab700 1 Processor -- start 2023-09-21T12:46:43.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.241+0000 7fd556cab700 1 -- start start 2023-09-21T12:46:43.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.242+0000 7fd556cab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:43.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.242+0000 7fd556cab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd550106ff0 con 0x7fd550106600 2023-09-21T12:46:43.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.242+0000 7fd554a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:43.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.242+0000 7fd554a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56922/0 (socket says 172.21.15.142:56922) 2023-09-21T12:46:43.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.242+0000 7fd554a47700 1 -- 172.21.15.142:0/1363624007 learned_addr learned my addr 172.21.15.142:0/1363624007 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:43.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.243+0000 7fd554a47700 1 -- 172.21.15.142:0/1363624007 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd550107800 con 0x7fd550106600 2023-09-21T12:46:43.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.243+0000 7fd554a47700 1 --2- 172.21.15.142:0/1363624007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd5440098a0 tx=0x7fd544009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4ed10a03c1f02c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:43.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.243+0000 7fd54f7fe700 1 -- 172.21.15.142:0/1363624007 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd544004160 con 0x7fd550106600 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.243+0000 7fd54f7fe700 1 -- 172.21.15.142:0/1363624007 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd5440042c0 con 0x7fd550106600 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.243+0000 7fd54f7fe700 1 -- 172.21.15.142:0/1363624007 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd544011a00 con 0x7fd550106600 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 -- 172.21.15.142:0/1363624007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 msgr2=0x7fd550106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 --2- 172.21.15.142:0/1363624007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd5440098a0 tx=0x7fd544009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 -- 172.21.15.142:0/1363624007 shutdown_connections 2023-09-21T12:46:43.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 --2- 172.21.15.142:0/1363624007 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd550106a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 -- 172.21.15.142:0/1363624007 >> 172.21.15.142:0/1363624007 conn(0x7fd550101ba0 msgr2=0x7fd550103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 -- 172.21.15.142:0/1363624007 shutdown_connections 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.244+0000 7fd556cab700 1 -- 172.21.15.142:0/1363624007 wait complete. 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.245+0000 7fd556cab700 1 Processor -- start 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd556cab700 1 -- start start 2023-09-21T12:46:43.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd556cab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd556cab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55007c1a0 con 0x7fd550106600 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd554a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd554a47700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56932/0 (socket says 172.21.15.142:56932) 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.246+0000 7fd554a47700 1 -- 172.21.15.142:0/824828369 learned_addr learned my addr 172.21.15.142:0/824828369 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd554a47700 1 -- 172.21.15.142:0/824828369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd544009550 con 0x7fd550106600 2023-09-21T12:46:43.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd554a47700 1 --2- 172.21.15.142:0/824828369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd544006af0 tx=0x7fd544011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:43.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd544003a40 con 0x7fd550106600 2023-09-21T12:46:43.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd544003ba0 con 0x7fd550106600 2023-09-21T12:46:43.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55007a2b0 con 0x7fd550106600 2023-09-21T12:46:43.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd54401a700 con 0x7fd550106600 2023-09-21T12:46:43.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.247+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55007a6d0 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.248+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd54401ac30 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.248+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd544024430 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.248+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd550062410 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.251+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd544024ad0 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.320+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd55010aac0 con 0x7fd550106600 2023-09-21T12:46:43.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.321+0000 7fd54dffb700 1 -- 172.21.15.142:0/824828369 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7fd544024c70 con 0x7fd550106600 2023-09-21T12:46:43.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 msgr2=0x7fd55007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:43.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 --2- 172.21.15.142:0/824828369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd544006af0 tx=0x7fd544011ad0 comp rx=0 tx=0).stop 2023-09-21T12:46:43.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 shutdown_connections 2023-09-21T12:46:43.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 --2- 172.21.15.142:0/824828369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd550106600 0x7fd55007bc60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:43.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 >> 172.21.15.142:0/824828369 conn(0x7fd550101ba0 msgr2=0x7fd550102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:43.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 shutdown_connections 2023-09-21T12:46:43.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:43.322+0000 7fd556cab700 1 -- 172.21.15.142:0/824828369 wait complete. 2023-09-21T12:46:43.785 INFO:teuthology.orchestra.run.smithi142.stdout:Restarting the monitor... 2023-09-21T12:46:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:43 smithi142 systemd[1]: Stopping Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:46:44.574 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a[97137]: 2023-09-21T12:46:44.228+0000 7f206cb7f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T12:46:44.575 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a[97137]: 2023-09-21T12:46:44.228+0000 7f206cb7f700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-21T12:46:44.857 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 bash[97497]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a 2023-09-21T12:46:45.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 systemd[1]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service: Succeeded. 2023-09-21T12:46:45.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 systemd[1]: Stopped Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:46:45.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:44 smithi142 systemd[1]: Starting Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:46:45.566 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 podman[97622]: 2023-09-21T12:46:45.567 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 bash[97622]: d53e204945eb5d7abcb3b26e9be26279799c68e16fe3a4637780748864c8570d 2023-09-21T12:46:45.567 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: set uid:gid to 167:167 (ceph:ceph) 2023-09-21T12:46:45.579 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev), process ceph-mon, pid 7 2023-09-21T12:46:45.579 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: pidfile_write: ignore empty --pid-file 2023-09-21T12:46:45.579 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: load: jerasure load: lrc 2023-09-21T12:46:45.580 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: RocksDB version: 7.9.2 2023-09-21T12:46:45.580 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Git sha 0 2023-09-21T12:46:45.580 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Compile date 2023-09-20 13:08:22 2023-09-21T12:46:45.580 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: DB SUMMARY 2023-09-21T12:46:45.580 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: DB Session ID: V66XCN5D5UBDI5RS705V 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: CURRENT file: CURRENT 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: IDENTITY file: IDENTITY 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99322 ; 2023-09-21T12:46:45.581 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.error_if_exists: 0 2023-09-21T12:46:45.582 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.create_if_missing: 0 2023-09-21T12:46:45.582 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.paranoid_checks: 1 2023-09-21T12:46:45.582 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-21T12:46:45.582 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-21T12:46:45.582 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-21T12:46:45.583 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.env: 0x55ebd6645da0 2023-09-21T12:46:45.583 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.fs: PosixFileSystem 2023-09-21T12:46:45.583 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.info_log: 0x55ebd7ca3580 2023-09-21T12:46:45.583 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_file_opening_threads: 16 2023-09-21T12:46:45.583 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.statistics: (nil) 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.use_fsync: 0 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_log_file_size: 0 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.keep_log_file_num: 1000 2023-09-21T12:46:45.584 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.recycle_log_file_num: 0 2023-09-21T12:46:45.585 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_fallocate: 1 2023-09-21T12:46:45.585 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_mmap_reads: 0 2023-09-21T12:46:45.585 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_mmap_writes: 0 2023-09-21T12:46:45.585 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.use_direct_reads: 0 2023-09-21T12:46:45.585 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-21T12:46:45.586 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.create_missing_column_families: 0 2023-09-21T12:46:45.586 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.db_log_dir: 2023-09-21T12:46:45.586 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.wal_dir: 2023-09-21T12:46:45.586 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-21T12:46:45.586 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-21T12:46:45.587 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-21T12:46:45.587 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-21T12:46:45.587 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-21T12:46:45.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-21T12:46:45.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.advise_random_on_open: 1 2023-09-21T12:46:45.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.db_write_buffer_size: 0 2023-09-21T12:46:45.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.write_buffer_manager: 0x55ebd7c5b4a0 2023-09-21T12:46:45.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.rate_limiter: (nil) 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.wal_recovery_mode: 2 2023-09-21T12:46:45.589 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enable_thread_tracking: 0 2023-09-21T12:46:45.590 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enable_pipelined_write: 0 2023-09-21T12:46:45.590 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.unordered_write: 0 2023-09-21T12:46:45.590 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-21T12:46:45.590 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-21T12:46:45.590 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.row_cache: None 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.wal_filter: None 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_ingest_behind: 0 2023-09-21T12:46:45.591 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.two_write_queues: 0 2023-09-21T12:46:45.592 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.manual_wal_flush: 0 2023-09-21T12:46:45.592 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.wal_compression: 0 2023-09-21T12:46:45.592 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.atomic_flush: 0 2023-09-21T12:46:45.592 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-21T12:46:45.592 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-21T12:46:45.593 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-21T12:46:45.638 INFO:teuthology.orchestra.run.smithi142.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-09-21T12:46:45.906 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.log_readahead_size: 0 2023-09-21T12:46:45.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-21T12:46:45.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.best_efforts_recovery: 0 2023-09-21T12:46:45.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-21T12:46:45.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-21T12:46:45.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.allow_data_in_errors: 0 2023-09-21T12:46:45.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.db_host_id: __hostname__ 2023-09-21T12:46:45.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-21T12:46:45.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_background_jobs: 2 2023-09-21T12:46:45.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_background_compactions: -1 2023-09-21T12:46:45.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_subcompactions: 1 2023-09-21T12:46:45.909 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-21T12:46:45.909 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-21T12:46:45.909 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-21T12:46:45.909 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_total_wal_size: 0 2023-09-21T12:46:45.909 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-21T12:46:45.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-21T12:46:45.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-21T12:46:45.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-21T12:46:45.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_open_files: -1 2023-09-21T12:46:45.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bytes_per_sync: 0 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_readahead_size: 0 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_background_flushes: -1 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Compression algorithms supported: 2023-09-21T12:46:45.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-21T12:46:45.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kZSTD supported: 0 2023-09-21T12:46:45.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kXpressCompression supported: 0 2023-09-21T12:46:45.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kLZ4HCCompression supported: 1 2023-09-21T12:46:45.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kZlibCompression supported: 1 2023-09-21T12:46:45.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kSnappyCompression supported: 1 2023-09-21T12:46:45.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kLZ4Compression supported: 1 2023-09-21T12:46:45.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: kBZip2Compression supported: 0 2023-09-21T12:46:45.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-21T12:46:45.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-21T12:46:45.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-09-21T12:46:45.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-21T12:46:45.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-21T12:46:45.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.merge_operator: 2023-09-21T12:46:45.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_filter: None 2023-09-21T12:46:45.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_filter_factory: None 2023-09-21T12:46:45.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.sst_partitioner_factory: None 2023-09-21T12:46:45.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-21T12:46:45.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-21T12:46:45.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ebd7ca3680) 2023-09-21T12:46:45.915 INFO:journalctl@ceph.mon.a.smithi142.stdout: cache_index_and_filter_blocks: 1 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: pin_top_level_index_and_filter: 1 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: index_type: 0 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: data_block_index_type: 0 2023-09-21T12:46:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout: index_shortening: 1 2023-09-21T12:46:45.917 INFO:journalctl@ceph.mon.a.smithi142.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-21T12:46:45.917 INFO:journalctl@ceph.mon.a.smithi142.stdout: checksum: 4 2023-09-21T12:46:45.917 INFO:journalctl@ceph.mon.a.smithi142.stdout: no_block_cache: 0 2023-09-21T12:46:45.917 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_cache: 0x55ebd7cf91f0 2023-09-21T12:46:45.917 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_cache_name: BinnedLRUCache 2023-09-21T12:46:45.918 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_cache_options: 2023-09-21T12:46:45.918 INFO:journalctl@ceph.mon.a.smithi142.stdout: capacity : 536870912 2023-09-21T12:46:45.918 INFO:journalctl@ceph.mon.a.smithi142.stdout: num_shard_bits : 4 2023-09-21T12:46:45.918 INFO:journalctl@ceph.mon.a.smithi142.stdout: strict_capacity_limit : 0 2023-09-21T12:46:45.918 INFO:journalctl@ceph.mon.a.smithi142.stdout: high_pri_pool_ratio: 0.000 2023-09-21T12:46:45.919 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_cache_compressed: (nil) 2023-09-21T12:46:45.919 INFO:journalctl@ceph.mon.a.smithi142.stdout: persistent_cache: (nil) 2023-09-21T12:46:45.919 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_size: 4096 2023-09-21T12:46:45.919 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_size_deviation: 10 2023-09-21T12:46:45.919 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_restart_interval: 16 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: index_block_restart_interval: 1 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: metadata_block_size: 4096 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: partition_filters: 0 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: use_delta_encoding: 1 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: filter_policy: bloomfilter 2023-09-21T12:46:45.920 INFO:journalctl@ceph.mon.a.smithi142.stdout: whole_key_filtering: 1 2023-09-21T12:46:45.921 INFO:journalctl@ceph.mon.a.smithi142.stdout: verify_compression: 0 2023-09-21T12:46:45.921 INFO:journalctl@ceph.mon.a.smithi142.stdout: read_amp_bytes_per_bit: 0 2023-09-21T12:46:45.921 INFO:journalctl@ceph.mon.a.smithi142.stdout: format_version: 5 2023-09-21T12:46:45.921 INFO:journalctl@ceph.mon.a.smithi142.stdout: enable_index_compression: 1 2023-09-21T12:46:45.921 INFO:journalctl@ceph.mon.a.smithi142.stdout: block_align: 0 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout: max_auto_readahead_size: 262144 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout: prepopulate_block_cache: 0 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout: initial_auto_readahead_size: 8192 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout: num_file_reads_for_auto_readahead: 2 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.write_buffer_size: 33554432 2023-09-21T12:46:45.922 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_write_buffer_number: 2 2023-09-21T12:46:45.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression: NoCompression 2023-09-21T12:46:45.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression: Disabled 2023-09-21T12:46:45.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.prefix_extractor: nullptr 2023-09-21T12:46:45.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-21T12:46:45.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.num_levels: 7 2023-09-21T12:46:45.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-21T12:46:45.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-21T12:46:45.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-21T12:46:45.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-21T12:46:45.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-21T12:46:45.925 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-21T12:46:45.925 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-21T12:46:45.925 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:46:45.925 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-21T12:46:45.925 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-21T12:46:45.926 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:46:45.926 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:46:45.926 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-21T12:46:45.926 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.level: 32767 2023-09-21T12:46:45.926 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.strategy: 0 2023-09-21T12:46:45.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-21T12:46:45.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:46:45.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:46:45.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-21T12:46:45.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.enabled: false 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.target_file_size_base: 67108864 2023-09-21T12:46:45.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-21T12:46:45.929 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-21T12:46:45.929 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-21T12:46:45.929 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-21T12:46:45.929 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-21T12:46:45.929 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-21T12:46:45.930 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-21T12:46:45.931 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-21T12:46:45.931 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-21T12:46:45.931 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.arena_block_size: 1048576 2023-09-21T12:46:45.931 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.disable_auto_compactions: 0 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-21T12:46:45.932 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-21T12:46:45.933 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-21T12:46:45.933 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-21T12:46:45.933 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-21T12:46:45.933 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-21T12:46:45.933 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-21T12:46:45.934 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-21T12:46:45.934 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.table_properties_collectors: 2023-09-21T12:46:45.934 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.inplace_update_support: 0 2023-09-21T12:46:45.934 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-21T12:46:45.934 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.bloom_locality: 0 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.max_successive_merges: 0 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-21T12:46:45.935 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.paranoid_file_checks: 0 2023-09-21T12:46:45.936 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.force_consistency_checks: 1 2023-09-21T12:46:45.936 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.report_bg_io_stats: 0 2023-09-21T12:46:45.936 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.ttl: 2592000 2023-09-21T12:46:45.936 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-21T12:46:45.936 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-21T12:46:45.937 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-21T12:46:45.937 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enable_blob_files: false 2023-09-21T12:46:45.937 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.min_blob_size: 0 2023-09-21T12:46:45.937 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_file_size: 268435456 2023-09-21T12:46:45.937 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-21T12:46:45.938 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-21T12:46:45.938 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-21T12:46:45.938 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-21T12:46:45.938 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-21T12:46:45.938 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.blob_file_starting_level: 0 2023-09-21T12:46:45.939 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-21T12:46:45.939 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-09-21T12:46:45.939 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-09-21T12:46:45.939 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 29475f16-5196-411b-99e0-83eb1c470e73 2023-09-21T12:46:45.939 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300405577299, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300405579143, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94319, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 323, "table_properties": {"data_size": 92324, "index_size": 277, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13656, "raw_average_key_size": 49, "raw_value_size": 84876, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 274, "num_filter_entries": 274, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1695300405, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "29475f16-5196-411b-99e0-83eb1c470e73", "db_session_id": "V66XCN5D5UBDI5RS705V", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300405579273, "job": 1, "event": "recovery_finished"} 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-21T12:46:45.940 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ebd7d96000 2023-09-21T12:46:45.941 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: DB pointer 0x55ebd7d82000 2023-09-21T12:46:45.941 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-21T12:46:45.941 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-21T12:46:45.941 INFO:journalctl@ceph.mon.a.smithi142.stdout: ** DB Stats ** 2023-09-21T12:46:45.941 INFO:journalctl@ceph.mon.a.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:46:45.942 INFO:journalctl@ceph.mon.a.smithi142.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:46:45.943 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.943 INFO:journalctl@ceph.mon.a.smithi142.stdout: ** Compaction Stats [default] ** 2023-09-21T12:46:45.943 INFO:journalctl@ceph.mon.a.smithi142.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:46:45.943 INFO:journalctl@ceph.mon.a.smithi142.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-21T12:46:45.943 INFO:journalctl@ceph.mon.a.smithi142.stdout: L0 2/0 93.94 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: Sum 2/0 93.94 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 72.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: ** Compaction Stats [default] ** 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:46:45.944 INFO:journalctl@ceph.mon.a.smithi142.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-21T12:46:45.945 INFO:journalctl@ceph.mon.a.smithi142.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 72.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:46:45.945 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.945 INFO:journalctl@ceph.mon.a.smithi142.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-21T12:46:45.945 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.945 INFO:journalctl@ceph.mon.a.smithi142.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:46:45.946 INFO:journalctl@ceph.mon.a.smithi142.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-21T12:46:45.946 INFO:journalctl@ceph.mon.a.smithi142.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-21T12:46:45.946 INFO:journalctl@ceph.mon.a.smithi142.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-21T12:46:45.946 INFO:journalctl@ceph.mon.a.smithi142.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-21T12:46:45.946 INFO:journalctl@ceph.mon.a.smithi142.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: Cumulative compaction: 0.00 GB write, 10.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: Interval compaction: 0.00 GB write, 10.03 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: Block cache BinnedLRUCache@0x55ebd7cf91f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-09-21T12:46:45.947 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.948 INFO:journalctl@ceph.mon.a.smithi142.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-21T12:46:45.948 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: starting mon.a rank 0 at public addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] at bind addrs [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:45.948 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???) e1 preinit fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:46:45.948 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).mds e1 new map 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).mds e1 print_map 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout: e1 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout: legacy client fscid: -1 2023-09-21T12:46:45.949 INFO:journalctl@ceph.mon.a.smithi142.stdout: 2023-09-21T12:46:45.950 INFO:journalctl@ceph.mon.a.smithi142.stdout: No filesystems configured 2023-09-21T12:46:45.950 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-21T12:46:45.950 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:46:45.950 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:46:45.950 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 systemd[1]: Started Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: monmap e1: 1 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0]} removed_ranks: {} 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: fsmap 2023-09-21T12:46:45.951 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: osdmap e1: 0 total, 0 up, 0 in 2023-09-21T12:46:45.952 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:45 smithi142 ceph-mon[97663]: mgrmap e1: no daemons active 2023-09-21T12:46:46.724 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.170+0000 7fb9eee1d700 1 Processor -- start 2023-09-21T12:46:46.724 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.171+0000 7fb9eee1d700 1 -- start start 2023-09-21T12:46:46.725 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.171+0000 7fb9eee1d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:46.725 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.171+0000 7fb9eee1d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e807a8e0 con 0x7fb9e807beb0 2023-09-21T12:46:46.725 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.172+0000 7fb9ecbb9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:46.725 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.172+0000 7fb9ecbb9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47044/0 (socket says 172.21.15.142:47044) 2023-09-21T12:46:46.725 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.172+0000 7fb9ecbb9700 1 -- 172.21.15.142:0/3151804853 learned_addr learned my addr 172.21.15.142:0/3151804853 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:46.726 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.172+0000 7fb9ecbb9700 1 -- 172.21.15.142:0/3151804853 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e807aa20 con 0x7fb9e807beb0 2023-09-21T12:46:46.726 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.172+0000 7fb9ecbb9700 1 --2- 172.21.15.142:0/3151804853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098a0 tx=0x7fb9dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bb9b8988d519d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:46.726 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9e77fe700 1 -- 172.21.15.142:0/3151804853 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc004160 con 0x7fb9e807beb0 2023-09-21T12:46:46.726 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9e77fe700 1 -- 172.21.15.142:0/3151804853 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9dc0042c0 con 0x7fb9e807beb0 2023-09-21T12:46:46.727 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9e77fe700 1 -- 172.21.15.142:0/3151804853 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc011a00 con 0x7fb9e807beb0 2023-09-21T12:46:46.727 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 -- 172.21.15.142:0/3151804853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 msgr2=0x7fb9e807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:46.727 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 --2- 172.21.15.142:0/3151804853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0098a0 tx=0x7fb9dc009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:46.727 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 -- 172.21.15.142:0/3151804853 shutdown_connections 2023-09-21T12:46:46.727 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 --2- 172.21.15.142:0/3151804853 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e807a310 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 -- 172.21.15.142:0/3151804853 >> 172.21.15.142:0/3151804853 conn(0x7fb9e8101ba0 msgr2=0x7fb9e8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 -- 172.21.15.142:0/3151804853 shutdown_connections 2023-09-21T12:46:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.173+0000 7fb9eee1d700 1 -- 172.21.15.142:0/3151804853 wait complete. 2023-09-21T12:46:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.174+0000 7fb9eee1d700 1 Processor -- start 2023-09-21T12:46:46.728 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9eee1d700 1 -- start start 2023-09-21T12:46:46.729 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9eee1d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:46.729 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9eee1d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e819ccf0 con 0x7fb9e807beb0 2023-09-21T12:46:46.729 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9ecbb9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:46.729 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9ecbb9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47052/0 (socket says 172.21.15.142:47052) 2023-09-21T12:46:46.729 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9ecbb9700 1 -- 172.21.15.142:0/476513092 learned_addr learned my addr 172.21.15.142:0/476513092 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.175+0000 7fb9ecbb9700 1 -- 172.21.15.142:0/476513092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc009550 con 0x7fb9e807beb0 2023-09-21T12:46:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9ecbb9700 1 --2- 172.21.15.142:0/476513092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009fb0 tx=0x7fb9dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc003930 con 0x7fb9e807beb0 2023-09-21T12:46:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb9dc003a90 con 0x7fb9e807beb0 2023-09-21T12:46:46.730 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e819cef0 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9dc0195e0 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e819d310 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.176+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb9dc019b70 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.177+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb9dc0243f0 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.177+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e81965e0 con 0x7fb9e807beb0 2023-09-21T12:46:46.731 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.180+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fb9dc02de30 con 0x7fb9e807beb0 2023-09-21T12:46:46.732 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.250+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fb9e8062410 con 0x7fb9e807beb0 2023-09-21T12:46:46.732 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.252+0000 7fb9e5ffb700 1 -- 172.21.15.142:0/476513092 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb9dc003c00 con 0x7fb9e807beb0 2023-09-21T12:46:46.732 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 msgr2=0x7fb9e819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:46.732 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 --2- 172.21.15.142:0/476513092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc009fb0 tx=0x7fb9dc011ad0 comp rx=0 tx=0).stop 2023-09-21T12:46:46.732 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 shutdown_connections 2023-09-21T12:46:46.733 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 --2- 172.21.15.142:0/476513092 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9e807beb0 0x7fb9e819c7b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:46.733 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 >> 172.21.15.142:0/476513092 conn(0x7fb9e8101ba0 msgr2=0x7fb9e8102b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:46.733 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 shutdown_connections 2023-09-21T12:46:46.733 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:46.253+0000 7fb9eee1d700 1 -- 172.21.15.142:0/476513092 wait complete. 2023-09-21T12:46:46.733 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote config to /etc/ceph/ceph.conf 2023-09-21T12:46:46.749 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-09-21T12:46:46.749 INFO:teuthology.orchestra.run.smithi142.stdout:Creating mgr... 2023-09-21T12:46:46.750 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying port 0.0.0.0:9283 ... 2023-09-21T12:46:46.750 INFO:teuthology.orchestra.run.smithi142.stdout:Verifying port 0.0.0.0:8765 ... 2023-09-21T12:46:47.135 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x 2023-09-21T12:46:47.135 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x.service: Unit ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x.service not loaded. 2023-09-21T12:46:47.338 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.target.wants/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x.service → /etc/systemd/system/ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@.service. 2023-09-21T12:46:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/476513092' entity='client.admin' 2023-09-21T12:46:47.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:47 smithi142 systemd[1]: Starting Ceph mgr.x for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:46:48.090 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:47 smithi142 podman[97890]: 2023-09-21T12:46:48.155 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-21T12:46:48.155 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2023-09-21T12:46:48.173 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-21T12:46:48.174 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:46:48.174 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2023-09-21T12:46:48.175 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to enable service . firewalld.service is not available 2023-09-21T12:46:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-21T12:46:48.194 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2023-09-21T12:46:48.212 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-21T12:46:48.213 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:46:48.213 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2023-09-21T12:46:48.214 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-09-21T12:46:48.214 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr to start... 2023-09-21T12:46:48.214 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr... 2023-09-21T12:46:48.399 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 bash[97890]: 2e3638b93e4677567f5e2d11e649d869af374d0cb225028a6fb8e9fc4ba35f8f 2023-09-21T12:46:48.417 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 systemd[1]: Started Ceph mgr.x for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:46:48.417 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:48.292+0000 7fb155aec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:46:48.418 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:48.399+0000 7fb155aec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:46:48.650 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:48.518+0000 7fb155aec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:46:48.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:48.650+0000 7fb155aec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:46:48.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:48.884+0000 7fb155aec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:46:49.303 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:49.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:46:49.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:46:49.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2023-09-21T12:46:49.306 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-21T12:46:49.307 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-21T12:46:49.307 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-21T12:46:49.307 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.307 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-21T12:46:49.307 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-21T12:46:49.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2023-09-21T12:46:49.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:49.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-21T12:46:49.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "a" 2023-09-21T12:46:49.308 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:49.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-09-21T12:46:49.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-21T12:46:49.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:49.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-21T12:46:49.309 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-21T12:46:49.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-21T12:46:49.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:49.310 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-21T12:46:49.311 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-21T12:46:49.311 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-21T12:46:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-21T12:46:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-21T12:46:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-21T12:46:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.318 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-21T12:46:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-21T12:46:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-21T12:46:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-21T12:46:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-21T12:46:49.319 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-21T12:46:49.320 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:49.321 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-21T12:46:49.321 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-21T12:46:49.321 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.321 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-21T12:46:49.321 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-21T12:46:49.322 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-21T12:46:49.322 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-21T12:46:49.322 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-21T12:46:49.322 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-21T12:46:49.322 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2023-09-21T12:46:49.323 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:49.323 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:46:49.323 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.323 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-21T12:46:49.323 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2023-09-21T12:46:39.123790+0000", 2023-09-21T12:46:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:46:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-21T12:46:49.324 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.781+0000 7f6bb58b5700 1 Processor -- start 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.782+0000 7f6bb58b5700 1 -- start start 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.782+0000 7f6bb58b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.782+0000 7f6bb58b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb0106ff0 con 0x7f6bb0106600 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.782+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:49.325 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47092/0 (socket says 172.21.15.142:47092) 2023-09-21T12:46:49.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6baeffd700 1 -- 172.21.15.142:0/4293250777 learned_addr learned my addr 172.21.15.142:0/4293250777 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:49.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6baeffd700 1 -- 172.21.15.142:0/4293250777 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb0107800 con 0x7f6bb0106600 2023-09-21T12:46:49.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6baeffd700 1 --2- 172.21.15.142:0/4293250777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098a0 tx=0x7f6ba0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f1a8615905eb56 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:49.326 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6badffb700 1 -- 172.21.15.142:0/4293250777 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0004160 con 0x7f6bb0106600 2023-09-21T12:46:49.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6badffb700 1 -- 172.21.15.142:0/4293250777 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ba00042c0 con 0x7f6bb0106600 2023-09-21T12:46:49.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.783+0000 7f6badffb700 1 -- 172.21.15.142:0/4293250777 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0011a00 con 0x7f6bb0106600 2023-09-21T12:46:49.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 -- 172.21.15.142:0/4293250777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 msgr2=0x7f6bb0106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:49.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 --2- 172.21.15.142:0/4293250777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00098a0 tx=0x7f6ba0009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:49.327 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 -- 172.21.15.142:0/4293250777 shutdown_connections 2023-09-21T12:46:49.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 --2- 172.21.15.142:0/4293250777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb0106a20 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:49.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 -- 172.21.15.142:0/4293250777 >> 172.21.15.142:0/4293250777 conn(0x7f6bb0101ba0 msgr2=0x7f6bb0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:49.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 -- 172.21.15.142:0/4293250777 shutdown_connections 2023-09-21T12:46:49.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.784+0000 7f6bb58b5700 1 -- 172.21.15.142:0/4293250777 wait complete. 2023-09-21T12:46:49.328 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.786+0000 7f6bb58b5700 1 Processor -- start 2023-09-21T12:46:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.786+0000 7f6bb58b5700 1 -- start start 2023-09-21T12:46:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.786+0000 7f6bb58b5700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.786+0000 7f6bb58b5700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb007c1a0 con 0x7f6bb0106600 2023-09-21T12:46:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.787+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:49.329 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.787+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47106/0 (socket says 172.21.15.142:47106) 2023-09-21T12:46:49.330 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.787+0000 7f6baeffd700 1 -- 172.21.15.142:0/3284525987 learned_addr learned my addr 172.21.15.142:0/3284525987 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:49.330 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.787+0000 7f6baeffd700 1 -- 172.21.15.142:0/3284525987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009550 con 0x7f6bb0106600 2023-09-21T12:46:49.330 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.787+0000 7f6baeffd700 1 --2- 172.21.15.142:0/3284525987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006af0 tx=0x7f6ba0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:49.330 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba0003a40 con 0x7f6bb0106600 2023-09-21T12:46:49.330 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ba0003ba0 con 0x7f6bb0106600 2023-09-21T12:46:49.331 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb007a2b0 con 0x7f6bb0106600 2023-09-21T12:46:49.331 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ba001a700 con 0x7f6bb0106600 2023-09-21T12:46:49.331 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb007a6d0 con 0x7f6bb0106600 2023-09-21T12:46:49.331 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6ba001ac30 con 0x7f6bb0106600 2023-09-21T12:46:49.331 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.788+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6ba0019700 con 0x7f6bb0106600 2023-09-21T12:46:49.332 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.789+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb0062410 con 0x7f6bb0106600 2023-09-21T12:46:49.332 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.792+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6ba002de40 con 0x7f6bb0106600 2023-09-21T12:46:49.332 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.866+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6bb010aac0 con 0x7f6bb0106600 2023-09-21T12:46:49.332 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.867+0000 7f6bb48b3700 1 -- 172.21.15.142:0/3284525987 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f6ba0024ad0 con 0x7f6bb0106600 2023-09-21T12:46:49.332 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 msgr2=0x7f6bb007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:49.333 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 --2- 172.21.15.142:0/3284525987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0006af0 tx=0x7f6ba0011ad0 comp rx=0 tx=0).stop 2023-09-21T12:46:49.333 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 shutdown_connections 2023-09-21T12:46:49.333 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 --2- 172.21.15.142:0/3284525987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bb0106600 0x7f6bb007bc60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:49.333 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 >> 172.21.15.142:0/3284525987 conn(0x7f6bb0101ba0 msgr2=0x7f6bb0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:49.333 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 shutdown_connections 2023-09-21T12:46:49.334 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:48.868+0000 7f6bb58b5700 1 -- 172.21.15.142:0/3284525987 wait complete. 2023-09-21T12:46:49.334 INFO:teuthology.orchestra.run.smithi142.stdout:mgr not available, waiting (1/15)... 2023-09-21T12:46:49.370 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:48 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3284525987' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-21T12:46:49.646 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:49.370+0000 7fb155aec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:46:49.647 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:49.533+0000 7fb155aec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:46:49.647 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:49.647+0000 7fb155aec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:46:49.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:49.768+0000 7fb155aec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:46:50.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:50.303+0000 7fb155aec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:46:51.607 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:51.177+0000 7fb155aec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:46:51.607 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:51.283+0000 7fb155aec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:46:52.278 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:52 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/569076157' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-21T12:46:52.880 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:52.278+0000 7fb155aec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:46:52.929 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:52.396+0000 7fb155aec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:46:52.929 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:52.615+0000 7fb155aec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:46:53.282 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:52.990+0000 7fb155aec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:46:53.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:53.281+0000 7fb155aec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:46:53.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:53.475+0000 7fb155aec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:46:54.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:53.814+0000 7fb155aec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:46:55.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:54.743+0000 7fb155aec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:46:55.168 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:54.919+0000 7fb155aec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:46:55.589 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:55.167+0000 7fb155aec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:46:55.589 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:55.314+0000 7fb155aec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:46:55.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:55.588+0000 7fb155aec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:46:57.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:46:56.676+0000 7fb155aec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:46:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: Activating manager daemon x 2023-09-21T12:46:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: mgrmap e2: x(active, starting, since 0.00405506s) 2023-09-21T12:46:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:46:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:46:57.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:46:57.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:46:57.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:46:57.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: Manager daemon x is now available 2023-09-21T12:46:57.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:46:57.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:46:57.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' 2023-09-21T12:46:57.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' 2023-09-21T12:46:57.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:56 smithi142 ceph-mon[97663]: from='mgr.14100 172.21.15.142:0/1960778242' entity='mgr.x' 2023-09-21T12:46:59.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:58 smithi142 ceph-mon[97663]: mgrmap e3: x(active, since 1.0089s) 2023-09-21T12:46:59.623 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:46:59.623 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:46:59.623 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:46:59.623 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2023-09-21T12:46:59.624 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-21T12:46:59.624 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-21T12:46:59.624 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-21T12:46:59.624 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.625 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-21T12:46:59.625 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-21T12:46:59.625 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2023-09-21T12:46:59.625 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-21T12:46:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "a" 2023-09-21T12:46:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-09-21T12:46:59.626 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-21T12:46:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-21T12:46:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-21T12:46:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.627 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-21T12:46:59.628 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:59.628 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-21T12:46:59.628 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-21T12:46:59.628 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-21T12:46:59.628 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-21T12:46:59.629 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-21T12:46:59.629 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-21T12:46:59.629 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.629 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-21T12:46:59.629 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-21T12:46:59.630 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-21T12:46:59.630 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-21T12:46:59.630 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-21T12:46:59.630 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-21T12:46:59.630 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-21T12:46:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-21T12:46:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-21T12:46:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-21T12:46:59.631 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:59.632 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-21T12:46:59.632 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-21T12:46:59.632 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.632 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-21T12:46:59.632 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-21T12:46:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-21T12:46:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-21T12:46:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-21T12:46:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-21T12:46:59.633 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2023-09-21T12:46:59.634 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:46:59.634 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:46:59.634 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.634 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-21T12:46:59.635 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:46:59.635 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2023-09-21T12:46:39.123790+0000", 2023-09-21T12:46:59.635 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:46:59.635 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:46:59.636 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-21T12:46:59.636 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:46:59.636 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.885+0000 7fe7fbea3700 1 Processor -- start 2023-09-21T12:46:59.636 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.885+0000 7fe7fbea3700 1 -- start start 2023-09-21T12:46:59.636 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7fbea3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:59.637 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7fbea3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f407a8a0 con 0x7fe7f407be70 2023-09-21T12:46:59.637 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7f9c3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:59.637 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7f9c3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47112/0 (socket says 172.21.15.142:47112) 2023-09-21T12:46:59.637 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7f9c3f700 1 -- 172.21.15.142:0/3856747573 learned_addr learned my addr 172.21.15.142:0/3856747573 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:59.638 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.886+0000 7fe7f9c3f700 1 -- 172.21.15.142:0/3856747573 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f407a9e0 con 0x7fe7f407be70 2023-09-21T12:46:59.638 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7f9c3f700 1 --2- 172.21.15.142:0/3856747573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098a0 tx=0x7fe7f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=512049c2f915752e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:59.638 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7f8c3d700 1 -- 172.21.15.142:0/3856747573 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0004160 con 0x7fe7f407be70 2023-09-21T12:46:59.638 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7f8c3d700 1 -- 172.21.15.142:0/3856747573 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7f00042c0 con 0x7fe7f407be70 2023-09-21T12:46:59.639 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7f8c3d700 1 -- 172.21.15.142:0/3856747573 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0011a00 con 0x7fe7f407be70 2023-09-21T12:46:59.639 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7fbea3700 1 -- 172.21.15.142:0/3856747573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 msgr2=0x7fe7f407a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:59.639 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.887+0000 7fe7fbea3700 1 --2- 172.21.15.142:0/3856747573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe7f00098a0 tx=0x7fe7f0009bb0 comp rx=0 tx=0).stop 2023-09-21T12:46:59.639 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.888+0000 7fe7fbea3700 1 -- 172.21.15.142:0/3856747573 shutdown_connections 2023-09-21T12:46:59.640 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.888+0000 7fe7fbea3700 1 --2- 172.21.15.142:0/3856747573 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f407a2d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:59.640 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.888+0000 7fe7fbea3700 1 -- 172.21.15.142:0/3856747573 >> 172.21.15.142:0/3856747573 conn(0x7fe7f4101ba0 msgr2=0x7fe7f4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:59.640 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.888+0000 7fe7fbea3700 1 -- 172.21.15.142:0/3856747573 shutdown_connections 2023-09-21T12:46:59.640 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.888+0000 7fe7fbea3700 1 -- 172.21.15.142:0/3856747573 wait complete. 2023-09-21T12:46:59.641 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.889+0000 7fe7fbea3700 1 Processor -- start 2023-09-21T12:46:59.641 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.889+0000 7fe7fbea3700 1 -- start start 2023-09-21T12:46:59.641 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.889+0000 7fe7fbea3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:46:59.641 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.889+0000 7fe7fbea3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f419cc60 con 0x7fe7f407be70 2023-09-21T12:46:59.641 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.890+0000 7fe7f9c3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:46:59.642 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.890+0000 7fe7f9c3f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47128/0 (socket says 172.21.15.142:47128) 2023-09-21T12:46:59.642 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.890+0000 7fe7f9c3f700 1 -- 172.21.15.142:0/569076157 learned_addr learned my addr 172.21.15.142:0/569076157 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:46:59.642 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.890+0000 7fe7f9c3f700 1 -- 172.21.15.142:0/569076157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f0009550 con 0x7fe7f407be70 2023-09-21T12:46:59.643 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.890+0000 7fe7f9c3f700 1 --2- 172.21.15.142:0/569076157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0006af0 tx=0x7fe7f0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:46:59.643 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f0003a40 con 0x7fe7f407be70 2023-09-21T12:46:59.643 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f419ce60 con 0x7fe7f407be70 2023-09-21T12:46:59.643 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7f0003ba0 con 0x7fe7f407be70 2023-09-21T12:46:59.644 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7f001a6e0 con 0x7fe7f407be70 2023-09-21T12:46:59.644 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7f419d280 con 0x7fe7f407be70 2023-09-21T12:46:59.644 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe7f001ac50 con 0x7fe7f407be70 2023-09-21T12:46:59.644 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.891+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe7f0019700 con 0x7fe7f407be70 2023-09-21T12:46:59.645 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.892+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7f41965d0 con 0x7fe7f407be70 2023-09-21T12:46:59.645 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.894+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe7f002de30 con 0x7fe7f407be70 2023-09-21T12:46:59.645 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.970+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe7f4062410 con 0x7fe7f407be70 2023-09-21T12:46:59.645 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.970+0000 7fe7eaffd700 1 -- 172.21.15.142:0/569076157 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fe7f0024a60 con 0x7fe7f407be70 2023-09-21T12:46:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.971+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 msgr2=0x7fe7f419c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:46:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.971+0000 7fe7fbea3700 1 --2- 172.21.15.142:0/569076157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0006af0 tx=0x7fe7f0011ad0 comp rx=0 tx=0).stop 2023-09-21T12:46:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.972+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 shutdown_connections 2023-09-21T12:46:59.646 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.972+0000 7fe7fbea3700 1 --2- 172.21.15.142:0/569076157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7f407be70 0x7fe7f419c720 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:46:59.647 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.972+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 >> 172.21.15.142:0/569076157 conn(0x7fe7f4101ba0 msgr2=0x7fe7f4102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:46:59.647 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.972+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 shutdown_connections 2023-09-21T12:46:59.647 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:46:51.972+0000 7fe7fbea3700 1 -- 172.21.15.142:0/569076157 wait complete. 2023-09-21T12:46:59.647 INFO:teuthology.orchestra.run.smithi142.stdout:mgr not available, waiting (2/15)... 2023-09-21T12:46:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:46:59 smithi142 ceph-mon[97663]: mgrmap e4: x(active, since 2s) 2023-09-21T12:47:02.879 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:02 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1518013176' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-21T12:47:02.916 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:47:02.916 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:47:02.916 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:47:02.916 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "health": { 2023-09-21T12:47:02.917 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-21T12:47:02.917 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-21T12:47:02.917 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-21T12:47:02.917 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-21T12:47:02.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-21T12:47:02.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 0 2023-09-21T12:47:02.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:47:02.918 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-21T12:47:02.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "a" 2023-09-21T12:47:02.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:47:02.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-09-21T12:47:02.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-21T12:47:02.919 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:47:02.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-21T12:47:02.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-21T12:47:02.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-21T12:47:02.920 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:47:02.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-21T12:47:02.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-21T12:47:02.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-21T12:47:02.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-21T12:47:02.921 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-21T12:47:02.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-21T12:47:02.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-21T12:47:02.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-21T12:47:02.922 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-21T12:47:02.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-21T12:47:02.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-21T12:47:02.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-21T12:47:02.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-21T12:47:02.923 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-21T12:47:02.924 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-21T12:47:02.924 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.924 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-21T12:47:02.924 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:47:02.924 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-21T12:47:02.925 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-21T12:47:02.925 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.925 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-21T12:47:02.925 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-21T12:47:02.925 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-21T12:47:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-21T12:47:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-21T12:47:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-21T12:47:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "restful" 2023-09-21T12:47:02.926 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ], 2023-09-21T12:47:02.927 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:47:02.927 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.927 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-21T12:47:02.927 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-21T12:47:02.927 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "modified": "2023-09-21T12:46:39.123790+0000", 2023-09-21T12:47:02.928 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-21T12:47:02.928 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout }, 2023-09-21T12:47:02.928 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-21T12:47:02.928 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:47:02.928 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c82e4700 1 Processor -- start 2023-09-21T12:47:02.929 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c82e4700 1 -- start start 2023-09-21T12:47:02.929 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c82e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:02.929 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c82e4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c0106ff0 con 0x7ff8c0106600 2023-09-21T12:47:02.929 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c6080700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:02.929 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c6080700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56478/0 (socket says 172.21.15.142:56478) 2023-09-21T12:47:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.171+0000 7ff8c6080700 1 -- 172.21.15.142:0/1384293848 learned_addr learned my addr 172.21.15.142:0/1384293848 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.172+0000 7ff8c6080700 1 -- 172.21.15.142:0/1384293848 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c0107800 con 0x7ff8c0106600 2023-09-21T12:47:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.172+0000 7ff8c6080700 1 --2- 172.21.15.142:0/1384293848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0098a0 tx=0x7ff8bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7f4167a54493c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.172+0000 7ff8c507e700 1 -- 172.21.15.142:0/1384293848 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8bc004160 con 0x7ff8c0106600 2023-09-21T12:47:02.930 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.172+0000 7ff8c507e700 1 -- 172.21.15.142:0/1384293848 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8bc0042c0 con 0x7ff8c0106600 2023-09-21T12:47:02.931 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.172+0000 7ff8c507e700 1 -- 172.21.15.142:0/1384293848 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8bc011a00 con 0x7ff8c0106600 2023-09-21T12:47:02.931 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1384293848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 msgr2=0x7ff8c0106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:02.931 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1384293848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc0098a0 tx=0x7ff8bc009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:02.931 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1384293848 shutdown_connections 2023-09-21T12:47:02.932 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1384293848 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c0106a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:02.932 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1384293848 >> 172.21.15.142:0/1384293848 conn(0x7ff8c0101ba0 msgr2=0x7ff8c0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:02.932 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1384293848 shutdown_connections 2023-09-21T12:47:02.932 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.173+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1384293848 wait complete. 2023-09-21T12:47:02.932 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.174+0000 7ff8c82e4700 1 Processor -- start 2023-09-21T12:47:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.174+0000 7ff8c82e4700 1 -- start start 2023-09-21T12:47:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.174+0000 7ff8c82e4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.174+0000 7ff8c82e4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c007c1a0 con 0x7ff8c0106600 2023-09-21T12:47:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c6080700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:02.933 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c6080700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56484/0 (socket says 172.21.15.142:56484) 2023-09-21T12:47:02.934 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c6080700 1 -- 172.21.15.142:0/1518013176 learned_addr learned my addr 172.21.15.142:0/1518013176 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:02.934 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c6080700 1 -- 172.21.15.142:0/1518013176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc009550 con 0x7ff8c0106600 2023-09-21T12:47:02.934 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c6080700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006af0 tx=0x7ff8bc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:02.934 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8bc003a40 con 0x7ff8c0106600 2023-09-21T12:47:02.934 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff8bc003ba0 con 0x7ff8c0106600 2023-09-21T12:47:02.935 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8bc01a700 con 0x7ff8c0106600 2023-09-21T12:47:02.935 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.175+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c007a2b0 con 0x7ff8c0106600 2023-09-21T12:47:02.935 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.176+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c007a6d0 con 0x7ff8c0106600 2023-09-21T12:47:02.935 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.177+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7ff8bc024ad0 con 0x7ff8c0106600 2023-09-21T12:47:02.936 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.177+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c0062410 con 0x7ff8c0106600 2023-09-21T12:47:02.936 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.177+0000 7ff8b77fe700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 0x7ff8ac03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:02.936 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.177+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff8bc04c180 con 0x7ff8c0106600 2023-09-21T12:47:02.936 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.177+0000 7ff8c587f700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 0x7ff8ac03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:02.936 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.178+0000 7ff8c587f700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 0x7ff8ac03a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0006fd0 tx=0x7ff8b0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:02.937 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.183+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff8bc024430 con 0x7ff8c0106600 2023-09-21T12:47:02.937 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.460+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff8c007b0e0 con 0x7ff8c0106600 2023-09-21T12:47:02.937 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.460+0000 7ff8b77fe700 1 -- 172.21.15.142:0/1518013176 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ff8bc018350 con 0x7ff8c0106600 2023-09-21T12:47:02.937 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.462+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 msgr2=0x7ff8ac03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:02.937 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.462+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 0x7ff8ac03a8e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0006fd0 tx=0x7ff8b0006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 msgr2=0x7ff8c007bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc006af0 tx=0x7ff8bc011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 shutdown_connections 2023-09-21T12:47:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7ff8ac038420 0x7ff8ac03a8e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:02.938 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 --2- 172.21.15.142:0/1518013176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8c0106600 0x7ff8c007bc60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:02.939 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 >> 172.21.15.142:0/1518013176 conn(0x7ff8c0101ba0 msgr2=0x7ff8c0102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:02.939 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 shutdown_connections 2023-09-21T12:47:02.939 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:02.463+0000 7ff8c82e4700 1 -- 172.21.15.142:0/1518013176 wait complete. 2023-09-21T12:47:02.939 INFO:teuthology.orchestra.run.smithi142.stdout:mgr is available 2023-09-21T12:47:04.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:47:04.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [global] 2023-09-21T12:47:04.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout fsid = ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:04.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-21T12:47:04.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-21T12:47:04.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-21T12:47:04.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout [osd] 2023-09-21T12:47:04.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-21T12:47:04.093 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-21T12:47:04.093 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-21T12:47:04.093 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-21T12:47:04.093 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-21T12:47:04.093 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.437+0000 7f743a765700 1 Processor -- start 2023-09-21T12:47:04.094 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.437+0000 7f743a765700 1 -- start start 2023-09-21T12:47:04.094 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.437+0000 7f743a765700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:04.094 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.437+0000 7f743a765700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7434106ff0 con 0x7f7434106600 2023-09-21T12:47:04.094 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.438+0000 7f7433fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:04.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.438+0000 7f7433fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56486/0 (socket says 172.21.15.142:56486) 2023-09-21T12:47:04.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.438+0000 7f7433fff700 1 -- 172.21.15.142:0/3397315492 learned_addr learned my addr 172.21.15.142:0/3397315492 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:04.095 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.438+0000 7f7433fff700 1 -- 172.21.15.142:0/3397315492 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7434107800 con 0x7f7434106600 2023-09-21T12:47:04.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.438+0000 7f7433fff700 1 --2- 172.21.15.142:0/3397315492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74240098a0 tx=0x7f7424009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ca572a03196f28 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:04.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f7432ffd700 1 -- 172.21.15.142:0/3397315492 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7424004160 con 0x7f7434106600 2023-09-21T12:47:04.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f7432ffd700 1 -- 172.21.15.142:0/3397315492 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74240042c0 con 0x7f7434106600 2023-09-21T12:47:04.096 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f7432ffd700 1 -- 172.21.15.142:0/3397315492 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7424011a00 con 0x7f7434106600 2023-09-21T12:47:04.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 -- 172.21.15.142:0/3397315492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 msgr2=0x7f7434106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:04.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 --2- 172.21.15.142:0/3397315492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f74240098a0 tx=0x7f7424009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:04.097 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 -- 172.21.15.142:0/3397315492 shutdown_connections 2023-09-21T12:47:04.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 --2- 172.21.15.142:0/3397315492 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f7434106a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:04.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 -- 172.21.15.142:0/3397315492 >> 172.21.15.142:0/3397315492 conn(0x7f7434101ba0 msgr2=0x7f7434103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:04.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 -- 172.21.15.142:0/3397315492 shutdown_connections 2023-09-21T12:47:04.098 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.439+0000 7f743a765700 1 -- 172.21.15.142:0/3397315492 wait complete. 2023-09-21T12:47:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.440+0000 7f743a765700 1 Processor -- start 2023-09-21T12:47:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.440+0000 7f743a765700 1 -- start start 2023-09-21T12:47:04.099 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f743a765700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f743a765700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743419cca0 con 0x7f7434106600 2023-09-21T12:47:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f7433fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f7433fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56496/0 (socket says 172.21.15.142:56496) 2023-09-21T12:47:04.100 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f7433fff700 1 -- 172.21.15.142:0/21951477 learned_addr learned my addr 172.21.15.142:0/21951477 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:04.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.441+0000 7f7433fff700 1 -- 172.21.15.142:0/21951477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7424009550 con 0x7f7434106600 2023-09-21T12:47:04.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f7433fff700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7424006af0 tx=0x7f7424011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:04.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7424003a40 con 0x7f7434106600 2023-09-21T12:47:04.101 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7424003ba0 con 0x7f7434106600 2023-09-21T12:47:04.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f742401a700 con 0x7f7434106600 2023-09-21T12:47:04.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743419cea0 con 0x7f7434106600 2023-09-21T12:47:04.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.442+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743419d2c0 con 0x7f7434106600 2023-09-21T12:47:04.102 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.443+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7f7424024ad0 con 0x7f7434106600 2023-09-21T12:47:04.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.443+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74341967e0 con 0x7f7434106600 2023-09-21T12:47:04.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.444+0000 7f74317fa700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 0x7f741c03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:04.103 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.444+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f742404c180 con 0x7f7434106600 2023-09-21T12:47:04.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.444+0000 7f74337fe700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 0x7f741c03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:04.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.445+0000 7f74337fe700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 0x7f741c03a8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:04.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.449+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7424024430 con 0x7f7434106600 2023-09-21T12:47:04.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.648+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f743410ab30 con 0x7f7434106600 2023-09-21T12:47:04.104 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.649+0000 7f74317fa700 1 -- 172.21.15.142:0/21951477 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f7424018350 con 0x7f7434106600 2023-09-21T12:47:04.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 msgr2=0x7f741c03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:04.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 0x7f741c03a8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7428006fd0 tx=0x7f7428006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:04.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 msgr2=0x7f743419c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:04.105 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7424006af0 tx=0x7f7424011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:04.106 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 shutdown_connections 2023-09-21T12:47:04.106 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f741c038420 0x7f741c03a8e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:04.106 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 --2- 172.21.15.142:0/21951477 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7434106600 0x7f743419c760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:04.106 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 >> 172.21.15.142:0/21951477 conn(0x7f7434101ba0 msgr2=0x7f7434102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:04.107 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 shutdown_connections 2023-09-21T12:47:04.107 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:03.652+0000 7f743a765700 1 -- 172.21.15.142:0/21951477 wait complete. 2023-09-21T12:47:04.107 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling cephadm module... 2023-09-21T12:47:04.123 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/21951477' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-21T12:47:05.242 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3448806444' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-09-21T12:47:05.243 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setuser ceph since I am not root 2023-09-21T12:47:05.243 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setgroup ceph since I am not root 2023-09-21T12:47:05.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.654+0000 7f7102c0f700 1 Processor -- start 2023-09-21T12:47:05.484 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.654+0000 7f7102c0f700 1 -- start start 2023-09-21T12:47:05.487 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f7102c0f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:05.488 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f7102c0f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc105ef0 con 0x7f70fc105500 2023-09-21T12:47:05.488 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f71009ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:05.488 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f71009ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42438/0 (socket says 172.21.15.142:42438) 2023-09-21T12:47:05.488 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f71009ab700 1 -- 172.21.15.142:0/3860411252 learned_addr learned my addr 172.21.15.142:0/3860411252 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:05.488 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f71009ab700 1 -- 172.21.15.142:0/3860411252 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc106700 con 0x7f70fc105500 2023-09-21T12:47:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.655+0000 7f71009ab700 1 --2- 172.21.15.142:0/3860411252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7cd25055b41f1f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f70fb7fe700 1 -- 172.21.15.142:0/3860411252 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f0004160 con 0x7f70fc105500 2023-09-21T12:47:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f70fb7fe700 1 -- 172.21.15.142:0/3860411252 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70f00042c0 con 0x7f70fc105500 2023-09-21T12:47:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f70fb7fe700 1 -- 172.21.15.142:0/3860411252 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f0011a00 con 0x7f70fc105500 2023-09-21T12:47:05.489 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 -- 172.21.15.142:0/3860411252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 msgr2=0x7f70fc105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:05.490 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3860411252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f70f00098a0 tx=0x7f70f0009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:05.490 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 -- 172.21.15.142:0/3860411252 shutdown_connections 2023-09-21T12:47:05.490 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3860411252 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc105920 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:05.490 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 -- 172.21.15.142:0/3860411252 >> 172.21.15.142:0/3860411252 conn(0x7f70fc100a80 msgr2=0x7f70fc102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:05.490 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.656+0000 7f7102c0f700 1 -- 172.21.15.142:0/3860411252 shutdown_connections 2023-09-21T12:47:05.491 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.657+0000 7f7102c0f700 1 -- 172.21.15.142:0/3860411252 wait complete. 2023-09-21T12:47:05.491 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.657+0000 7f7102c0f700 1 Processor -- start 2023-09-21T12:47:05.491 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f7102c0f700 1 -- start start 2023-09-21T12:47:05.491 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f7102c0f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:05.491 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f7102c0f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc19ad50 con 0x7f70fc105500 2023-09-21T12:47:05.492 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f71009ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:05.492 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f71009ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42446/0 (socket says 172.21.15.142:42446) 2023-09-21T12:47:05.492 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.658+0000 7f71009ab700 1 -- 172.21.15.142:0/3448806444 learned_addr learned my addr 172.21.15.142:0/3448806444 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:05.492 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f71009ab700 1 -- 172.21.15.142:0/3448806444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f0009550 con 0x7f70fc105500 2023-09-21T12:47:05.492 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f71009ab700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006af0 tx=0x7f70f0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f0003a40 con 0x7f70fc105500 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f70f0003ba0 con 0x7f70fc105500 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f70f001a700 con 0x7f70fc105500 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc19af50 con 0x7f70fc105500 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.659+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc19b370 con 0x7f70fc105500 2023-09-21T12:47:05.493 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.660+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7f70f0024ad0 con 0x7f70fc105500 2023-09-21T12:47:05.494 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.660+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc062410 con 0x7f70fc105500 2023-09-21T12:47:05.494 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.661+0000 7f70f9ffb700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 0x7f70ec03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:05.494 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.661+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f70f004c1b0 con 0x7f70fc105500 2023-09-21T12:47:05.494 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.661+0000 7f70fbfff700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 0x7f70ec03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.661+0000 7f70fbfff700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 0x7f70ec03a8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70e8006fd0 tx=0x7f70e8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.666+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f70f0018bd0 con 0x7f70fc105500 2023-09-21T12:47:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.919+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f70fc19b920 con 0x7f70fc105500 2023-09-21T12:47:05.495 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.973+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f70f002d770 con 0x7f70fc105500 2023-09-21T12:47:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.974+0000 7f70f9ffb700 1 -- 172.21.15.142:0/3448806444 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f70f0017a70 con 0x7f70fc105500 2023-09-21T12:47:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 msgr2=0x7f70ec03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 0x7f70ec03a8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f70e8006fd0 tx=0x7f70e8006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:05.496 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 msgr2=0x7f70fc079ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:05.497 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f70f0006af0 tx=0x7f70f0011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:05.497 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 shutdown_connections 2023-09-21T12:47:05.497 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f70ec038420 0x7f70ec03a8e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:05.497 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 --2- 172.21.15.142:0/3448806444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f70fc105500 0x7f70fc079ba0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:05.498 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 >> 172.21.15.142:0/3448806444 conn(0x7f70fc100a80 msgr2=0x7f70fc101880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:05.498 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 shutdown_connections 2023-09-21T12:47:05.498 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:04.977+0000 7f7102c0f700 1 -- 172.21.15.142:0/3448806444 wait complete. 2023-09-21T12:47:05.602 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:05.243+0000 7f79a50a8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:47:05.603 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:05.348+0000 7f79a50a8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:47:05.603 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:05.465+0000 7f79a50a8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:47:05.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:05.602+0000 7f79a50a8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:47:05.925 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:05.851+0000 7f79a50a8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:47:06.316 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3448806444' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-09-21T12:47:06.438 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:05 smithi142 ceph-mon[97663]: mgrmap e5: x(active, since 8s) 2023-09-21T12:47:06.612 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:06.316+0000 7f79a50a8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:47:06.612 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:06.496+0000 7f79a50a8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:47:06.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:47:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-09-21T12:47:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-21T12:47:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-21T12:47:06.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-21T12:47:06.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:47:06.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.032+0000 7f98f2580700 1 Processor -- start 2023-09-21T12:47:06.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.032+0000 7f98f2580700 1 -- start start 2023-09-21T12:47:06.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98f2580700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:06.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98f2580700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec07a8c0 con 0x7f98ec07be90 2023-09-21T12:47:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42474/0 (socket says 172.21.15.142:42474) 2023-09-21T12:47:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98ebfff700 1 -- 172.21.15.142:0/2041597070 learned_addr learned my addr 172.21.15.142:0/2041597070 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.033+0000 7f98ebfff700 1 -- 172.21.15.142:0/2041597070 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ec07aa00 con 0x7f98ec07be90 2023-09-21T12:47:06.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98ebfff700 1 --2- 172.21.15.142:0/2041597070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098a0 tx=0x7f98dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cee01f507cd3ebc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98eaffd700 1 -- 172.21.15.142:0/2041597070 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98dc004160 con 0x7f98ec07be90 2023-09-21T12:47:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98eaffd700 1 -- 172.21.15.142:0/2041597070 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98dc0042c0 con 0x7f98ec07be90 2023-09-21T12:47:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98eaffd700 1 -- 172.21.15.142:0/2041597070 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98dc011a00 con 0x7f98ec07be90 2023-09-21T12:47:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98f2580700 1 -- 172.21.15.142:0/2041597070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 msgr2=0x7f98ec07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:06.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98f2580700 1 --2- 172.21.15.142:0/2041597070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0098a0 tx=0x7f98dc009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98f2580700 1 -- 172.21.15.142:0/2041597070 shutdown_connections 2023-09-21T12:47:06.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98f2580700 1 --2- 172.21.15.142:0/2041597070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec07a2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.034+0000 7f98f2580700 1 -- 172.21.15.142:0/2041597070 >> 172.21.15.142:0/2041597070 conn(0x7f98ec101ba0 msgr2=0x7f98ec103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:06.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.035+0000 7f98f2580700 1 -- 172.21.15.142:0/2041597070 shutdown_connections 2023-09-21T12:47:06.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.035+0000 7f98f2580700 1 -- 172.21.15.142:0/2041597070 wait complete. 2023-09-21T12:47:06.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98f2580700 1 Processor -- start 2023-09-21T12:47:06.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98f2580700 1 -- start start 2023-09-21T12:47:06.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98f2580700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:06.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98f2580700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec19cc20 con 0x7f98ec07be90 2023-09-21T12:47:06.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:06.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98ebfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42488/0 (socket says 172.21.15.142:42488) 2023-09-21T12:47:06.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.036+0000 7f98ebfff700 1 -- 172.21.15.142:0/625586242 learned_addr learned my addr 172.21.15.142:0/625586242 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:06.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98ebfff700 1 -- 172.21.15.142:0/625586242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009550 con 0x7f98ec07be90 2023-09-21T12:47:06.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98ebfff700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98dc006af0 tx=0x7f98dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:06.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98dc003a40 con 0x7f98ec07be90 2023-09-21T12:47:06.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f98dc003ba0 con 0x7f98ec07be90 2023-09-21T12:47:06.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98dc01a6e0 con 0x7f98ec07be90 2023-09-21T12:47:06.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ec19ce20 con 0x7f98ec07be90 2023-09-21T12:47:06.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.037+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec19d240 con 0x7f98ec07be90 2023-09-21T12:47:06.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.038+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f98dc024a60 con 0x7f98ec07be90 2023-09-21T12:47:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.039+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ec1965d0 con 0x7f98ec07be90 2023-09-21T12:47:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.039+0000 7f98e97fa700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 0x7f98d403a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.039+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f98dc04c250 con 0x7f98ec07be90 2023-09-21T12:47:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.039+0000 7f98eb7fe700 1 -- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 msgr2=0x7f98d403a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:06.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.039+0000 7f98eb7fe700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 0x7f98d403a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:47:06.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.044+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f98dc024430 con 0x7f98ec07be90 2023-09-21T12:47:06.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.240+0000 7f98eb7fe700 1 -- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 msgr2=0x7f98d403a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:06.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.240+0000 7f98eb7fe700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 0x7f98d403a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:47:06.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.303+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f98ec062410 con 0x7f98ec07be90 2023-09-21T12:47:06.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.304+0000 7f98e97fa700 1 -- 172.21.15.142:0/625586242 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f98dc018350 con 0x7f98ec07be90 2023-09-21T12:47:06.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 msgr2=0x7f98d403a930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:47:06.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 0x7f98d403a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 msgr2=0x7f98ec19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:06.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f98dc006af0 tx=0x7f98dc011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 shutdown_connections 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f98d4038470 0x7f98d403a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 --2- 172.21.15.142:0/625586242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec07be90 0x7f98ec19c6e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 >> 172.21.15.142:0/625586242 conn(0x7f98ec101ba0 msgr2=0x7f98ec1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 shutdown_connections 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:06.306+0000 7f98f2580700 1 -- 172.21.15.142:0/625586242 wait complete. 2023-09-21T12:47:06.762 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for the mgr to restart... 2023-09-21T12:47:06.763 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr epoch 5... 2023-09-21T12:47:06.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:06.612+0000 7f79a50a8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:47:06.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:06.738+0000 7f79a50a8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:47:07.302 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:06 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/625586242' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-21T12:47:07.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:07.302+0000 7f79a50a8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:47:08.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:08.148+0000 7f79a50a8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:47:08.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:08.254+0000 7f79a50a8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:47:09.556 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:09.209+0000 7f79a50a8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:47:09.557 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:09.336+0000 7f79a50a8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:47:09.557 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:09.556+0000 7f79a50a8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:47:10.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:09.913+0000 7f79a50a8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:47:10.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:10.192+0000 7f79a50a8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:47:10.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:10.382+0000 7f79a50a8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:47:11.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:10.719+0000 7f79a50a8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:47:11.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:11.637+0000 7f79a50a8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:47:11.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:11.808+0000 7f79a50a8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:47:12.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:12.053+0000 7f79a50a8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:47:12.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:12.199+0000 7f79a50a8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:47:12.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:12.470+0000 7f79a50a8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:47:13.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:13.537+0000 7f79a50a8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:47:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: Active manager daemon x restarted 2023-09-21T12:47:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: Activating manager daemon x 2023-09-21T12:47:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: osdmap e2: 0 total, 0 up, 0 in 2023-09-21T12:47:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: mgrmap e6: x(active, starting, since 0.00399531s) 2023-09-21T12:47:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:47:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:47:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:47:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: Manager daemon x is now available 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:13 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:14 smithi142 ceph-mon[97663]: Found migration_current of "None". Setting to last migration. 2023-09-21T12:47:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:14 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:14 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:47:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:14 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:47:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:14 smithi142 ceph-mon[97663]: mgrmap e7: x(active, since 1.00667s) 2023-09-21T12:47:14.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:47:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-09-21T12:47:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-21T12:47:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:47:14.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.307+0000 7f3dadbbf700 1 Processor -- start 2023-09-21T12:47:14.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.307+0000 7f3dadbbf700 1 -- start start 2023-09-21T12:47:14.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.307+0000 7f3dadbbf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:14.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.307+0000 7f3dadbbf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da807a8c0 con 0x7f3da807be90 2023-09-21T12:47:14.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.308+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:14.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.308+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42498/0 (socket says 172.21.15.142:42498) 2023-09-21T12:47:14.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.308+0000 7f3da77fe700 1 -- 172.21.15.142:0/3673882712 learned_addr learned my addr 172.21.15.142:0/3673882712 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:14.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.308+0000 7f3da77fe700 1 -- 172.21.15.142:0/3673882712 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da807aa00 con 0x7f3da807be90 2023-09-21T12:47:14.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.308+0000 7f3da77fe700 1 --2- 172.21.15.142:0/3673882712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d980098a0 tx=0x7f3d98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c8877ef14e79fe server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:14.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3da67fc700 1 -- 172.21.15.142:0/3673882712 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d98004160 con 0x7f3da807be90 2023-09-21T12:47:14.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3da67fc700 1 -- 172.21.15.142:0/3673882712 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d980042c0 con 0x7f3da807be90 2023-09-21T12:47:14.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3da67fc700 1 -- 172.21.15.142:0/3673882712 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d98011a00 con 0x7f3da807be90 2023-09-21T12:47:14.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 -- 172.21.15.142:0/3673882712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 msgr2=0x7f3da807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:14.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/3673882712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3d980098a0 tx=0x7f3d98009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 -- 172.21.15.142:0/3673882712 shutdown_connections 2023-09-21T12:47:14.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/3673882712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da807a2f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 -- 172.21.15.142:0/3673882712 >> 172.21.15.142:0/3673882712 conn(0x7f3da8101ba0 msgr2=0x7f3da8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:14.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 -- 172.21.15.142:0/3673882712 shutdown_connections 2023-09-21T12:47:14.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.309+0000 7f3dadbbf700 1 -- 172.21.15.142:0/3673882712 wait complete. 2023-09-21T12:47:14.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.310+0000 7f3dadbbf700 1 Processor -- start 2023-09-21T12:47:14.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3dadbbf700 1 -- start start 2023-09-21T12:47:14.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3dadbbf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:14.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3dadbbf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da819cc20 con 0x7f3da807be90 2023-09-21T12:47:14.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:14.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3da77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42514/0 (socket says 172.21.15.142:42514) 2023-09-21T12:47:14.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3da77fe700 1 -- 172.21.15.142:0/2186750840 learned_addr learned my addr 172.21.15.142:0/2186750840 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:14.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.311+0000 7f3da77fe700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98009550 con 0x7f3da807be90 2023-09-21T12:47:14.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3da77fe700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006af0 tx=0x7f3d98011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:14.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d98003a40 con 0x7f3da807be90 2023-09-21T12:47:14.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3d98003ba0 con 0x7f3da807be90 2023-09-21T12:47:14.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3d9801a6e0 con 0x7f3da807be90 2023-09-21T12:47:14.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da819ce20 con 0x7f3da807be90 2023-09-21T12:47:14.958 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.312+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da819d240 con 0x7f3da807be90 2023-09-21T12:47:14.958 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.313+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f3d98024430 con 0x7f3da807be90 2023-09-21T12:47:14.958 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.314+0000 7f3da4ff9700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:14.958 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.314+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d9003aff0 con 0x7f3d90038420 2023-09-21T12:47:14.958 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.314+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3d9804c250 con 0x7f3da807be90 2023-09-21T12:47:14.959 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.314+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.959 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.314+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:47:14.959 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.515+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.959 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.515+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:47:14.959 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.916+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:07.916+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-21T12:47:14.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:08.717+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:08.717+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-21T12:47:14.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:10.318+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.960 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:10.319+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-21T12:47:14.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:13.522+0000 7f3da6ffd700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3614708159 2023-09-21T12:47:14.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:13.522+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-09-21T12:47:14.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:13.542+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mgrmap(e 6) v1 ==== 45098+0+0 (secure 0 0 0) 0x7f3d98024a60 con 0x7f3da807be90 2023-09-21T12:47:14.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:13.542+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 msgr2=0x7f3d9003a8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:47:14.961 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:13.542+0000 7f3da4ff9700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.544+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 7) v1 ==== 45225+0+0 (secure 0 0 0) 0x7f3d98017d90 con 0x7f3da807be90 2023-09-21T12:47:14.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.544+0000 7f3da4ff9700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 0x7f3d9003e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:14.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.544+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3d9003aff0 con 0x7f3d9003bd00 2023-09-21T12:47:14.962 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.545+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 0x7f3d9003e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:14.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.545+0000 7f3da6ffd700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 0x7f3d9003e0f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c003a10 tx=0x7f3d9c009290 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:14.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.546+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f3d9003aff0 con 0x7f3d9003bd00 2023-09-21T12:47:14.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.557+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3da819da20 con 0x7f3d9003bd00 2023-09-21T12:47:14.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.557+0000 7f3da4ff9700 1 -- 172.21.15.142:0/2186750840 <== mgr.14118 v2:172.21.15.142:6800/3720958087 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3da819da20 con 0x7f3d9003bd00 2023-09-21T12:47:14.963 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 msgr2=0x7f3d9003e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 0x7f3d9003e0f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c003a10 tx=0x7f3d9c009290 comp rx=0 tx=0).stop 2023-09-21T12:47:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 msgr2=0x7f3da819c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3d98006af0 tx=0x7f3d98011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 shutdown_connections 2023-09-21T12:47:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3d9003bd00 0x7f3d9003e0f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3da807be90 0x7f3da819c6e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 --2- 172.21.15.142:0/2186750840 >> [v2:172.21.15.142:6800/3614708159,v1:172.21.15.142:6801/3614708159] conn(0x7f3d90038420 0x7f3d9003a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:14.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 >> 172.21.15.142:0/2186750840 conn(0x7f3da8101ba0 msgr2=0x7f3da81029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:14.965 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 shutdown_connections 2023-09-21T12:47:14.966 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:14.558+0000 7f3dadbbf700 1 -- 172.21.15.142:0/2186750840 wait complete. 2023-09-21T12:47:14.966 INFO:teuthology.orchestra.run.smithi142.stdout:mgr epoch 5 is available 2023-09-21T12:47:14.966 INFO:teuthology.orchestra.run.smithi142.stdout:Setting orchestrator backend to cephadm... 2023-09-21T12:47:16.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:15 smithi142 ceph-mon[97663]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-21T12:47:16.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:15 smithi142 ceph-mon[97663]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-21T12:47:16.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:15 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:16.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:15 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.541+0000 7f94beafb700 1 Processor -- start 2023-09-21T12:47:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.541+0000 7f94beafb700 1 -- start start 2023-09-21T12:47:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.541+0000 7f94beafb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:16.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94beafb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b807a8c0 con 0x7f94b807be90 2023-09-21T12:47:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94bc897700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94bc897700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58186/0 (socket says 172.21.15.142:58186) 2023-09-21T12:47:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94bc897700 1 -- 172.21.15.142:0/2001776973 learned_addr learned my addr 172.21.15.142:0/2001776973 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94bc897700 1 -- 172.21.15.142:0/2001776973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b807aa00 con 0x7f94b807be90 2023-09-21T12:47:16.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.542+0000 7f94bc897700 1 --2- 172.21.15.142:0/2001776973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0098a0 tx=0x7f94ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88ef460e06407b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:16.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94b77fe700 1 -- 172.21.15.142:0/2001776973 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94ac004160 con 0x7f94b807be90 2023-09-21T12:47:16.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94b77fe700 1 -- 172.21.15.142:0/2001776973 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94ac0042c0 con 0x7f94b807be90 2023-09-21T12:47:16.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94b77fe700 1 -- 172.21.15.142:0/2001776973 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94ac011a00 con 0x7f94b807be90 2023-09-21T12:47:16.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94beafb700 1 -- 172.21.15.142:0/2001776973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 msgr2=0x7f94b807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:16.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94beafb700 1 --2- 172.21.15.142:0/2001776973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94ac0098a0 tx=0x7f94ac009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94beafb700 1 -- 172.21.15.142:0/2001776973 shutdown_connections 2023-09-21T12:47:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94beafb700 1 --2- 172.21.15.142:0/2001776973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b807a2f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.543+0000 7f94beafb700 1 -- 172.21.15.142:0/2001776973 >> 172.21.15.142:0/2001776973 conn(0x7f94b8101ba0 msgr2=0x7f94b8103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.544+0000 7f94beafb700 1 -- 172.21.15.142:0/2001776973 shutdown_connections 2023-09-21T12:47:16.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.544+0000 7f94beafb700 1 -- 172.21.15.142:0/2001776973 wait complete. 2023-09-21T12:47:16.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94beafb700 1 Processor -- start 2023-09-21T12:47:16.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94beafb700 1 -- start start 2023-09-21T12:47:16.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94beafb700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:16.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94beafb700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b819cc60 con 0x7f94b807be90 2023-09-21T12:47:16.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94bc897700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94bc897700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58190/0 (socket says 172.21.15.142:58190) 2023-09-21T12:47:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.545+0000 7f94bc897700 1 -- 172.21.15.142:0/2437507081 learned_addr learned my addr 172.21.15.142:0/2437507081 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94bc897700 1 -- 172.21.15.142:0/2437507081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ac009550 con 0x7f94b807be90 2023-09-21T12:47:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94bc897700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94ac006af0 tx=0x7f94ac011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:16.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94ac003a40 con 0x7f94b807be90 2023-09-21T12:47:16.239 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f94ac003ba0 con 0x7f94b807be90 2023-09-21T12:47:16.239 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b819ce60 con 0x7f94b807be90 2023-09-21T12:47:16.239 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94ac01a6e0 con 0x7f94b807be90 2023-09-21T12:47:16.239 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.546+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b819d280 con 0x7f94b807be90 2023-09-21T12:47:16.239 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.547+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 7) v1 ==== 45225+0+0 (secure 0 0 0) 0x7f94ac024430 con 0x7f94b807be90 2023-09-21T12:47:16.240 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.547+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b81965d0 con 0x7f94b807be90 2023-09-21T12:47:16.240 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.548+0000 7f94b5ffb700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 0x7f94a803a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:16.240 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.548+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f94ac04c0e0 con 0x7f94b807be90 2023-09-21T12:47:16.240 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.548+0000 7f94b7fff700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 0x7f94a803a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:16.240 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.549+0000 7f94b7fff700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 0x7f94a803a800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006fd0 tx=0x7f94a4006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:16.241 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.553+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f94ac0246e0 con 0x7f94b807be90 2023-09-21T12:47:16.241 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.774+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f94b810ccd0 con 0x7f94a8038340 2023-09-21T12:47:16.241 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.781+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f94ac024b10 con 0x7f94b807be90 2023-09-21T12:47:16.241 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.785+0000 7f94b5ffb700 1 -- 172.21.15.142:0/2437507081 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f94b810ccd0 con 0x7f94a8038340 2023-09-21T12:47:16.241 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 msgr2=0x7f94a803a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:16.242 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 0x7f94a803a800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f94a4006fd0 tx=0x7f94a4006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:16.242 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 msgr2=0x7f94b819c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:16.242 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f94ac006af0 tx=0x7f94ac011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:16.242 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 shutdown_connections 2023-09-21T12:47:16.242 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f94a8038340 0x7f94a803a800 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:16.243 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 --2- 172.21.15.142:0/2437507081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b807be90 0x7f94b819c720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:16.243 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 >> 172.21.15.142:0/2437507081 conn(0x7f94b8101ba0 msgr2=0x7f94b8102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:16.243 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.788+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 shutdown_connections 2023-09-21T12:47:16.243 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:15.789+0000 7f94beafb700 1 -- 172.21.15.142:0/2437507081 wait complete. 2023-09-21T12:47:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:15] ENGINE Bus STARTING 2023-09-21T12:47:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: mgrmap e8: x(active, since 2s) 2023-09-21T12:47:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:15] ENGINE Serving on https://172.21.15.142:7150 2023-09-21T12:47:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:15] ENGINE Serving on http://172.21.15.142:8765 2023-09-21T12:47:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:15] ENGINE Bus STARTED 2023-09-21T12:47:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:16 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:17.412 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout value unchanged 2023-09-21T12:47:17.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.779+0000 7fc099eff700 1 Processor -- start 2023-09-21T12:47:17.417 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.779+0000 7fc099eff700 1 -- start start 2023-09-21T12:47:17.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc099eff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:17.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc099eff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094106ff0 con 0x7fc094106600 2023-09-21T12:47:17.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:17.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58204/0 (socket says 172.21.15.142:58204) 2023-09-21T12:47:17.418 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc0937fe700 1 -- 172.21.15.142:0/1518238989 learned_addr learned my addr 172.21.15.142:0/1518238989 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:17.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.780+0000 7fc0937fe700 1 -- 172.21.15.142:0/1518238989 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094107800 con 0x7fc094106600 2023-09-21T12:47:17.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.781+0000 7fc0937fe700 1 --2- 172.21.15.142:0/1518238989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0840098a0 tx=0x7fc084009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8dcd429d08b663 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:17.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.783+0000 7fc0927fc700 1 -- 172.21.15.142:0/1518238989 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc084004160 con 0x7fc094106600 2023-09-21T12:47:17.419 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.783+0000 7fc0927fc700 1 -- 172.21.15.142:0/1518238989 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc0840042c0 con 0x7fc094106600 2023-09-21T12:47:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.783+0000 7fc0927fc700 1 -- 172.21.15.142:0/1518238989 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc084011a00 con 0x7fc094106600 2023-09-21T12:47:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 -- 172.21.15.142:0/1518238989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 msgr2=0x7fc094106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 --2- 172.21.15.142:0/1518238989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc0840098a0 tx=0x7fc084009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 -- 172.21.15.142:0/1518238989 shutdown_connections 2023-09-21T12:47:17.420 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 --2- 172.21.15.142:0/1518238989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc094106a20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:17.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 -- 172.21.15.142:0/1518238989 >> 172.21.15.142:0/1518238989 conn(0x7fc094101ba0 msgr2=0x7fc094103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:17.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 -- 172.21.15.142:0/1518238989 shutdown_connections 2023-09-21T12:47:17.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.784+0000 7fc099eff700 1 -- 172.21.15.142:0/1518238989 wait complete. 2023-09-21T12:47:17.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.785+0000 7fc099eff700 1 Processor -- start 2023-09-21T12:47:17.421 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.785+0000 7fc099eff700 1 -- start start 2023-09-21T12:47:17.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc099eff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:17.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc099eff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09419cca0 con 0x7fc094106600 2023-09-21T12:47:17.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:17.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc0937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58208/0 (socket says 172.21.15.142:58208) 2023-09-21T12:47:17.422 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc0937fe700 1 -- 172.21.15.142:0/3499404752 learned_addr learned my addr 172.21.15.142:0/3499404752 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:17.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc0937fe700 1 -- 172.21.15.142:0/3499404752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc084009550 con 0x7fc094106600 2023-09-21T12:47:17.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.786+0000 7fc0937fe700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc084009fb0 tx=0x7fc084011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:17.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.787+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc084003930 con 0x7fc094106600 2023-09-21T12:47:17.423 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.787+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc084003a90 con 0x7fc094106600 2023-09-21T12:47:17.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.787+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc0840195e0 con 0x7fc094106600 2023-09-21T12:47:17.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.787+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09419cea0 con 0x7fc094106600 2023-09-21T12:47:17.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.787+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09419d2c0 con 0x7fc094106600 2023-09-21T12:47:17.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.788+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7fc08401a430 con 0x7fc094106600 2023-09-21T12:47:17.424 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.788+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0941967e0 con 0x7fc094106600 2023-09-21T12:47:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.788+0000 7fc090ff9700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 0x7fc07c03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.789+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc08404c3d0 con 0x7fc094106600 2023-09-21T12:47:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.789+0000 7fc092ffd700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 0x7fc07c03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.789+0000 7fc092ffd700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 0x7fc07c03a8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc088006fd0 tx=0x7fc088006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:17.425 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.794+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc084023840 con 0x7fc094106600 2023-09-21T12:47:17.426 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.993+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fc09410aba0 con 0x7fc07c038420 2023-09-21T12:47:17.426 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.994+0000 7fc090ff9700 1 -- 172.21.15.142:0/3499404752 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fc09410aba0 con 0x7fc07c038420 2023-09-21T12:47:17.426 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 msgr2=0x7fc07c03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:17.426 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 0x7fc07c03a8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc088006fd0 tx=0x7fc088006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:17.426 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 msgr2=0x7fc09419c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:17.427 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc084009fb0 tx=0x7fc084011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:17.427 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 shutdown_connections 2023-09-21T12:47:17.427 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fc07c038420 0x7fc07c03a8e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:17.427 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 --2- 172.21.15.142:0/3499404752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc094106600 0x7fc09419c760 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:17.428 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 >> 172.21.15.142:0/3499404752 conn(0x7fc094101ba0 msgr2=0x7fc094102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:17.428 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.996+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 shutdown_connections 2023-09-21T12:47:17.428 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:16.997+0000 7fc099eff700 1 -- 172.21.15.142:0/3499404752 wait complete. 2023-09-21T12:47:17.428 INFO:teuthology.orchestra.run.smithi142.stdout:Generating ssh key... 2023-09-21T12:47:18.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:17 smithi142 ceph-mon[97663]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:18.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: Generating public/private rsa key pair. 2023-09-21T12:47:18.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: Your identification has been saved in /tmp/tmptl_ptjyi/key. 2023-09-21T12:47:18.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: Your public key has been saved in /tmp/tmptl_ptjyi/key.pub. 2023-09-21T12:47:18.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: The key fingerprint is: 2023-09-21T12:47:18.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: SHA256:XLqF1VA53G8ZYnyunglbRMo4obRY1jN/Id0ILXu6088 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:18.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: The key's randomart image is: 2023-09-21T12:47:18.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: +---[RSA 3072]----+ 2023-09-21T12:47:18.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | . .+*oo | 2023-09-21T12:47:18.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | + = =+X.+ | 2023-09-21T12:47:18.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | = o X O.=.o| 2023-09-21T12:47:18.669 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | . + B = + oo| 2023-09-21T12:47:18.669 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | S o = .. | 2023-09-21T12:47:18.669 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | o o o | 2023-09-21T12:47:18.669 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | . B o | 2023-09-21T12:47:18.669 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | + =. | 2023-09-21T12:47:18.670 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: | . .E | 2023-09-21T12:47:18.670 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:18 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: +----[SHA256]-----+ 2023-09-21T12:47:18.800 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.942+0000 7f64617ea700 1 Processor -- start 2023-09-21T12:47:18.800 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.942+0000 7f64617ea700 1 -- start start 2023-09-21T12:47:18.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f64617ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:18.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f64617ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c07a8c0 con 0x7f645c07be90 2023-09-21T12:47:18.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f645affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:18.801 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f645affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58210/0 (socket says 172.21.15.142:58210) 2023-09-21T12:47:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f645affd700 1 -- 172.21.15.142:0/2216031133 learned_addr learned my addr 172.21.15.142:0/2216031133 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.943+0000 7f645affd700 1 -- 172.21.15.142:0/2216031133 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c07aa00 con 0x7f645c07be90 2023-09-21T12:47:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f645affd700 1 --2- 172.21.15.142:0/2216031133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f644c0098a0 tx=0x7f644c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4f90a5e6083475 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f6459ffb700 1 -- 172.21.15.142:0/2216031133 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f644c004160 con 0x7f645c07be90 2023-09-21T12:47:18.802 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f6459ffb700 1 -- 172.21.15.142:0/2216031133 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f644c0042c0 con 0x7f645c07be90 2023-09-21T12:47:18.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f6459ffb700 1 -- 172.21.15.142:0/2216031133 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f644c011a00 con 0x7f645c07be90 2023-09-21T12:47:18.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f64617ea700 1 -- 172.21.15.142:0/2216031133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 msgr2=0x7f645c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:18.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f64617ea700 1 --2- 172.21.15.142:0/2216031133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f644c0098a0 tx=0x7f644c009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:18.803 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f64617ea700 1 -- 172.21.15.142:0/2216031133 shutdown_connections 2023-09-21T12:47:18.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f64617ea700 1 --2- 172.21.15.142:0/2216031133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c07a2f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:18.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.944+0000 7f64617ea700 1 -- 172.21.15.142:0/2216031133 >> 172.21.15.142:0/2216031133 conn(0x7f645c101ba0 msgr2=0x7f645c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:18.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.945+0000 7f64617ea700 1 -- 172.21.15.142:0/2216031133 shutdown_connections 2023-09-21T12:47:18.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.945+0000 7f64617ea700 1 -- 172.21.15.142:0/2216031133 wait complete. 2023-09-21T12:47:18.804 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.945+0000 7f64617ea700 1 Processor -- start 2023-09-21T12:47:18.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f64617ea700 1 -- start start 2023-09-21T12:47:18.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f64617ea700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:18.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f64617ea700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c19cc20 con 0x7f645c07be90 2023-09-21T12:47:18.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f645affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:18.805 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f645affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58222/0 (socket says 172.21.15.142:58222) 2023-09-21T12:47:18.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.946+0000 7f645affd700 1 -- 172.21.15.142:0/4151152438 learned_addr learned my addr 172.21.15.142:0/4151152438 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:18.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f645affd700 1 -- 172.21.15.142:0/4151152438 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644c009550 con 0x7f645c07be90 2023-09-21T12:47:18.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f645affd700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f644c006af0 tx=0x7f644c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:18.806 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f644c003a40 con 0x7f645c07be90 2023-09-21T12:47:18.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c19ce20 con 0x7f645c07be90 2023-09-21T12:47:18.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f644c003ba0 con 0x7f645c07be90 2023-09-21T12:47:18.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f644c01a6e0 con 0x7f645c07be90 2023-09-21T12:47:18.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.947+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c19d240 con 0x7f645c07be90 2023-09-21T12:47:18.807 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.948+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f644c024430 con 0x7f645c07be90 2023-09-21T12:47:18.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.948+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c1965d0 con 0x7f645c07be90 2023-09-21T12:47:18.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.949+0000 7f6443fff700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 0x7f644403a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:18.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.949+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f644c04c320 con 0x7f645c07be90 2023-09-21T12:47:18.808 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.949+0000 7f645a7fc700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 0x7f644403a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:18.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.949+0000 7f645a7fc700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 0x7f644403a8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6450006fd0 tx=0x7f6450006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:18.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:17.954+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f644c0246e0 con 0x7f645c07be90 2023-09-21T12:47:18.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.152+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f645c10ccd0 con 0x7f6444038420 2023-09-21T12:47:18.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.319+0000 7f6443fff700 1 -- 172.21.15.142:0/4151152438 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f645c10ccd0 con 0x7f6444038420 2023-09-21T12:47:18.809 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 msgr2=0x7f644403a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:18.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 0x7f644403a8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6450006fd0 tx=0x7f6450006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:18.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 msgr2=0x7f645c19c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:18.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f644c006af0 tx=0x7f644c011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:18.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 shutdown_connections 2023-09-21T12:47:18.810 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f6444038420 0x7f644403a8e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:18.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 --2- 172.21.15.142:0/4151152438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f645c07be90 0x7f645c19c6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:18.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 >> 172.21.15.142:0/4151152438 conn(0x7f645c101ba0 msgr2=0x7f645c1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:18.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 shutdown_connections 2023-09-21T12:47:18.811 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:18.322+0000 7f64617ea700 1 -- 172.21.15.142:0/4151152438 wait complete. 2023-09-21T12:47:19.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:19 smithi142 ceph-mon[97663]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:19.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:19 smithi142 ceph-mon[97663]: Generating ssh key... 2023-09-21T12:47:19.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:19 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:19.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:19 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:20.080 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.369+0000 7fd7f9e54700 1 Processor -- start 2023-09-21T12:47:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.369+0000 7fd7f9e54700 1 -- start start 2023-09-21T12:47:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.369+0000 7fd7f9e54700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:20.081 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.369+0000 7fd7f9e54700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f407a8c0 con 0x7fd7f407be90 2023-09-21T12:47:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58228/0 (socket says 172.21.15.142:58228) 2023-09-21T12:47:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f37fe700 1 -- 172.21.15.142:0/1965603630 learned_addr learned my addr 172.21.15.142:0/1965603630 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:20.082 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f37fe700 1 -- 172.21.15.142:0/1965603630 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f407aa00 con 0x7fd7f407be90 2023-09-21T12:47:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f37fe700 1 --2- 172.21.15.142:0/1965603630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40098a0 tx=0x7fd7e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47a1c5327cd6f4e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f27fc700 1 -- 172.21.15.142:0/1965603630 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7e4004160 con 0x7fd7f407be90 2023-09-21T12:47:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.370+0000 7fd7f27fc700 1 -- 172.21.15.142:0/1965603630 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7e40042c0 con 0x7fd7f407be90 2023-09-21T12:47:20.083 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f27fc700 1 -- 172.21.15.142:0/1965603630 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7e4011a00 con 0x7fd7f407be90 2023-09-21T12:47:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 -- 172.21.15.142:0/1965603630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 msgr2=0x7fd7f407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/1965603630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7e40098a0 tx=0x7fd7e4009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 -- 172.21.15.142:0/1965603630 shutdown_connections 2023-09-21T12:47:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/1965603630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f407a2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:20.084 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 -- 172.21.15.142:0/1965603630 >> 172.21.15.142:0/1965603630 conn(0x7fd7f4101ba0 msgr2=0x7fd7f4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 -- 172.21.15.142:0/1965603630 shutdown_connections 2023-09-21T12:47:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.371+0000 7fd7f9e54700 1 -- 172.21.15.142:0/1965603630 wait complete. 2023-09-21T12:47:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.372+0000 7fd7f9e54700 1 Processor -- start 2023-09-21T12:47:20.085 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.372+0000 7fd7f9e54700 1 -- start start 2023-09-21T12:47:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f9e54700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f9e54700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f419cc20 con 0x7fd7f407be90 2023-09-21T12:47:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58236/0 (socket says 172.21.15.142:58236) 2023-09-21T12:47:20.086 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f37fe700 1 -- 172.21.15.142:0/3907984401 learned_addr learned my addr 172.21.15.142:0/3907984401 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f37fe700 1 -- 172.21.15.142:0/3907984401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009550 con 0x7fd7f407be90 2023-09-21T12:47:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.373+0000 7fd7f37fe700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4006af0 tx=0x7fd7e4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.374+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7e4003a40 con 0x7fd7f407be90 2023-09-21T12:47:20.087 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.374+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd7e4003ba0 con 0x7fd7f407be90 2023-09-21T12:47:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.374+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7e401a6e0 con 0x7fd7f407be90 2023-09-21T12:47:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.374+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f419ce20 con 0x7fd7f407be90 2023-09-21T12:47:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.374+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f419d240 con 0x7fd7f407be90 2023-09-21T12:47:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.375+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7fd7e4024a60 con 0x7fd7f407be90 2023-09-21T12:47:20.088 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.375+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f41965d0 con 0x7fd7f407be90 2023-09-21T12:47:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.375+0000 7fd7f0ff9700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 0x7fd7dc03a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.375+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd7e404c320 con 0x7fd7f407be90 2023-09-21T12:47:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.375+0000 7fd7f2ffd700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 0x7fd7dc03a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.376+0000 7fd7f2ffd700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 0x7fd7dc03a930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006fd0 tx=0x7fd7e8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:20.089 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.380+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd7e4024430 con 0x7fd7f407be90 2023-09-21T12:47:20.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.580+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f410ccd0 con 0x7fd7dc038470 2023-09-21T12:47:20.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.581+0000 7fd7f0ff9700 1 -- 172.21.15.142:0/3907984401 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fd7f410ccd0 con 0x7fd7dc038470 2023-09-21T12:47:20.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.583+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 msgr2=0x7fd7dc03a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:20.090 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.583+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 0x7fd7dc03a930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8006fd0 tx=0x7fd7e8006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:20.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.583+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 msgr2=0x7fd7f419c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:20.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.583+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4006af0 tx=0x7fd7e4011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:20.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 shutdown_connections 2023-09-21T12:47:20.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fd7dc038470 0x7fd7dc03a930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:20.091 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 --2- 172.21.15.142:0/3907984401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7f407be90 0x7fd7f419c6e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:20.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 >> 172.21.15.142:0/3907984401 conn(0x7fd7f4101ba0 msgr2=0x7fd7f41029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:20.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 shutdown_connections 2023-09-21T12:47:20.092 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:19.584+0000 7fd7f9e54700 1 -- 172.21.15.142:0/3907984401 wait complete. 2023-09-21T12:47:20.092 INFO:teuthology.orchestra.run.smithi142.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-09-21T12:47:20.092 INFO:teuthology.orchestra.run.smithi142.stdout:Adding key to root@localhost authorized_keys... 2023-09-21T12:47:20.093 INFO:teuthology.orchestra.run.smithi142.stdout:Adding host smithi142... 2023-09-21T12:47:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:20 smithi142 ceph-mon[97663]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:21.878 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:21 smithi142 ceph-mon[97663]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi142", "addr": "172.21.15.142", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:22.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:22 smithi142 ceph-mon[97663]: Deploying cephadm binary to smithi142 2023-09-21T12:47:24.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Added host 'smithi142' with addr '172.21.15.142' 2023-09-21T12:47:24.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.631+0000 7f2d22b5c700 1 Processor -- start 2023-09-21T12:47:24.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d22b5c700 1 -- start start 2023-09-21T12:47:24.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d22b5c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:24.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d22b5c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c106ff0 con 0x7f2d1c106600 2023-09-21T12:47:24.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d208f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:24.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d208f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58246/0 (socket says 172.21.15.142:58246) 2023-09-21T12:47:24.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.632+0000 7f2d208f8700 1 -- 172.21.15.142:0/2270428681 learned_addr learned my addr 172.21.15.142:0/2270428681 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:24.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.633+0000 7f2d208f8700 1 -- 172.21.15.142:0/2270428681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d1c107800 con 0x7f2d1c106600 2023-09-21T12:47:24.471 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.633+0000 7f2d208f8700 1 --2- 172.21.15.142:0/2270428681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098a0 tx=0x7f2d10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d692d8cb2ce7a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:24.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.633+0000 7f2d1b7fe700 1 -- 172.21.15.142:0/2270428681 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d10004160 con 0x7f2d1c106600 2023-09-21T12:47:24.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.633+0000 7f2d1b7fe700 1 -- 172.21.15.142:0/2270428681 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d100042c0 con 0x7f2d1c106600 2023-09-21T12:47:24.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.633+0000 7f2d1b7fe700 1 -- 172.21.15.142:0/2270428681 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d10011a00 con 0x7f2d1c106600 2023-09-21T12:47:24.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 -- 172.21.15.142:0/2270428681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 msgr2=0x7f2d1c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:24.472 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/2270428681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2d100098a0 tx=0x7f2d10009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:24.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 -- 172.21.15.142:0/2270428681 shutdown_connections 2023-09-21T12:47:24.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/2270428681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c106a20 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:24.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 -- 172.21.15.142:0/2270428681 >> 172.21.15.142:0/2270428681 conn(0x7f2d1c101ba0 msgr2=0x7f2d1c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:24.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 -- 172.21.15.142:0/2270428681 shutdown_connections 2023-09-21T12:47:24.473 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.634+0000 7f2d22b5c700 1 -- 172.21.15.142:0/2270428681 wait complete. 2023-09-21T12:47:24.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.635+0000 7f2d22b5c700 1 Processor -- start 2023-09-21T12:47:24.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.635+0000 7f2d22b5c700 1 -- start start 2023-09-21T12:47:24.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.635+0000 7f2d22b5c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:24.474 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.635+0000 7f2d22b5c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1c07c1a0 con 0x7f2d1c106600 2023-09-21T12:47:24.475 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d208f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:24.475 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d208f8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58250/0 (socket says 172.21.15.142:58250) 2023-09-21T12:47:24.475 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d208f8700 1 -- 172.21.15.142:0/1538007975 learned_addr learned my addr 172.21.15.142:0/1538007975 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:24.475 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d208f8700 1 -- 172.21.15.142:0/1538007975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10009550 con 0x7f2d1c106600 2023-09-21T12:47:24.476 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d208f8700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009fb0 tx=0x7f2d10011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:24.476 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d10003930 con 0x7f2d1c106600 2023-09-21T12:47:24.476 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2d10003a90 con 0x7f2d1c106600 2023-09-21T12:47:24.476 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d100195e0 con 0x7f2d1c106600 2023-09-21T12:47:24.477 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.636+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1c07a2b0 con 0x7f2d1c106600 2023-09-21T12:47:24.477 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.637+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1c07a6d0 con 0x7f2d1c106600 2023-09-21T12:47:24.477 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.637+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f2d1001a9d0 con 0x7f2d1c106600 2023-09-21T12:47:24.477 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.637+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d1c062410 con 0x7f2d1c106600 2023-09-21T12:47:24.478 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.638+0000 7f2d19ffb700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 0x7f2d0c03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:24.478 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.638+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f2d1004c430 con 0x7f2d1c106600 2023-09-21T12:47:24.478 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.638+0000 7f2d1bfff700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 0x7f2d0c03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:24.479 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.639+0000 7f2d1bfff700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 0x7f2d0c03a8e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:24.479 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.644+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2d10023b40 con 0x7f2d1c106600 2023-09-21T12:47:24.479 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:20.845+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi142", "addr": "172.21.15.142", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d1c07a910 con 0x7f2d0c038420 2023-09-21T12:47:24.479 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.066+0000 7f2d19ffb700 1 -- 172.21.15.142:0/1538007975 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f2d1c07a910 con 0x7f2d0c038420 2023-09-21T12:47:24.480 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 msgr2=0x7f2d0c03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:24.480 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 0x7f2d0c03a8e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2d08006fd0 tx=0x7f2d08006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:24.480 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 msgr2=0x7f2d1c07bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:24.481 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2d10009fb0 tx=0x7f2d10011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:24.481 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 shutdown_connections 2023-09-21T12:47:24.481 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2d0c038420 0x7f2d0c03a8e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:24.481 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 --2- 172.21.15.142:0/1538007975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d1c106600 0x7f2d1c07bc60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:24.482 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 >> 172.21.15.142:0/1538007975 conn(0x7f2d1c101ba0 msgr2=0x7f2d1c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:24.482 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 shutdown_connections 2023-09-21T12:47:24.482 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:24.069+0000 7f2d22b5c700 1 -- 172.21.15.142:0/1538007975 wait complete. 2023-09-21T12:47:24.483 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying unmanaged mon service... 2023-09-21T12:47:25.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:25 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:25.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:25 smithi142 ceph-mon[97663]: Added host smithi142 2023-09-21T12:47:25.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:25 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:25.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-09-21T12:47:25.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.033+0000 7f29af9d6700 1 Processor -- start 2023-09-21T12:47:25.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.033+0000 7f29af9d6700 1 -- start start 2023-09-21T12:47:25.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29af9d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:25.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29af9d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8079ec0 con 0x7f29a8107070 2023-09-21T12:47:25.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29ad772700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:25.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29ad772700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33262/0 (socket says 172.21.15.142:33262) 2023-09-21T12:47:25.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29ad772700 1 -- 172.21.15.142:0/1990118536 learned_addr learned my addr 172.21.15.142:0/1990118536 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:25.757 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29ad772700 1 -- 172.21.15.142:0/1990118536 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a81099a0 con 0x7f29a8107070 2023-09-21T12:47:25.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.034+0000 7f29ad772700 1 --2- 172.21.15.142:0/1990118536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a40098a0 tx=0x7f29a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4dc2a47314a3a00 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:25.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f299ffff700 1 -- 172.21.15.142:0/1990118536 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29a4004160 con 0x7f29a8107070 2023-09-21T12:47:25.758 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f299ffff700 1 -- 172.21.15.142:0/1990118536 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29a40042c0 con 0x7f29a8107070 2023-09-21T12:47:25.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f299ffff700 1 -- 172.21.15.142:0/1990118536 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29a4011a00 con 0x7f29a8107070 2023-09-21T12:47:25.759 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 -- 172.21.15.142:0/1990118536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 msgr2=0x7f29a8109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:25.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 --2- 172.21.15.142:0/1990118536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a40098a0 tx=0x7f29a4009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:25.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 -- 172.21.15.142:0/1990118536 shutdown_connections 2023-09-21T12:47:25.760 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 --2- 172.21.15.142:0/1990118536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a8109460 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:25.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 -- 172.21.15.142:0/1990118536 >> 172.21.15.142:0/1990118536 conn(0x7f29a8100a80 msgr2=0x7f29a8102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:25.761 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 -- 172.21.15.142:0/1990118536 shutdown_connections 2023-09-21T12:47:25.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.035+0000 7f29af9d6700 1 -- 172.21.15.142:0/1990118536 wait complete. 2023-09-21T12:47:25.762 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.036+0000 7f29af9d6700 1 Processor -- start 2023-09-21T12:47:25.763 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29af9d6700 1 -- start start 2023-09-21T12:47:25.763 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29af9d6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:25.763 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29af9d6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a819a740 con 0x7f29a8107070 2023-09-21T12:47:25.764 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29ad772700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:25.764 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29ad772700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33274/0 (socket says 172.21.15.142:33274) 2023-09-21T12:47:25.765 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29ad772700 1 -- 172.21.15.142:0/3622871549 learned_addr learned my addr 172.21.15.142:0/3622871549 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:25.765 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.037+0000 7f29ad772700 1 -- 172.21.15.142:0/3622871549 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a4009550 con 0x7f29a8107070 2023-09-21T12:47:25.765 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f29ad772700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006af0 tx=0x7f29a4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:25.766 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29a4003a40 con 0x7f29a8107070 2023-09-21T12:47:25.766 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f29a4003ba0 con 0x7f29a8107070 2023-09-21T12:47:25.767 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a819a940 con 0x7f29a8107070 2023-09-21T12:47:25.767 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29a401a6e0 con 0x7f29a8107070 2023-09-21T12:47:25.768 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.038+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a819ad60 con 0x7f29a8107070 2023-09-21T12:47:25.768 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.039+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f29a4024a60 con 0x7f29a8107070 2023-09-21T12:47:25.768 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.039+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a8062410 con 0x7f29a8107070 2023-09-21T12:47:25.769 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.039+0000 7f299e7fc700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 0x7f299403a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:25.769 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.039+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f29a404c350 con 0x7f29a8107070 2023-09-21T12:47:25.770 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.040+0000 7f29acf71700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 0x7f299403a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:25.770 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.040+0000 7f29acf71700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 0x7f299403a8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2998006fd0 tx=0x7f2998006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:25.771 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.044+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f29a4024430 con 0x7f29a8107070 2023-09-21T12:47:25.771 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.262+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f29a8101f10 con 0x7f2994038420 2023-09-21T12:47:25.771 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.269+0000 7f299e7fc700 1 -- 172.21.15.142:0/3622871549 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f29a8101f10 con 0x7f2994038420 2023-09-21T12:47:25.772 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 msgr2=0x7f299403a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:25.772 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 0x7f299403a8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2998006fd0 tx=0x7f2998006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:25.773 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 msgr2=0x7f29a819a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:25.773 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f29a4006af0 tx=0x7f29a4011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:25.773 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 shutdown_connections 2023-09-21T12:47:25.774 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f2994038420 0x7f299403a8e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:25.774 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 --2- 172.21.15.142:0/3622871549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f29a8107070 0x7f29a819a200 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:25.774 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 >> 172.21.15.142:0/3622871549 conn(0x7f29a8100a80 msgr2=0x7f29a8101800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:25.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 shutdown_connections 2023-09-21T12:47:25.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:25.271+0000 7f29af9d6700 1 -- 172.21.15.142:0/3622871549 wait complete. 2023-09-21T12:47:25.776 INFO:teuthology.orchestra.run.smithi142.stdout:Deploying unmanaged mgr service... 2023-09-21T12:47:26.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:26 smithi142 ceph-mon[97663]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:26.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:26 smithi142 ceph-mon[97663]: Saving service mon spec with placement count:5 2023-09-21T12:47:26.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:26 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:27.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-09-21T12:47:27.226 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.571+0000 7f4b527ec700 1 Processor -- start 2023-09-21T12:47:27.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.572+0000 7f4b527ec700 1 -- start start 2023-09-21T12:47:27.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.572+0000 7f4b527ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:27.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.572+0000 7f4b527ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c106ff0 con 0x7f4b4c106600 2023-09-21T12:47:27.227 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:27.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33284/0 (socket says 172.21.15.142:33284) 2023-09-21T12:47:27.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4bfff700 1 -- 172.21.15.142:0/958998272 learned_addr learned my addr 172.21.15.142:0/958998272 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:27.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4bfff700 1 -- 172.21.15.142:0/958998272 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c107800 con 0x7f4b4c106600 2023-09-21T12:47:27.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4bfff700 1 --2- 172.21.15.142:0/958998272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098a0 tx=0x7f4b3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8f26c00c35b2a50 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:27.228 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4affd700 1 -- 172.21.15.142:0/958998272 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c004160 con 0x7f4b4c106600 2023-09-21T12:47:27.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4affd700 1 -- 172.21.15.142:0/958998272 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b3c0042c0 con 0x7f4b4c106600 2023-09-21T12:47:27.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.573+0000 7f4b4affd700 1 -- 172.21.15.142:0/958998272 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c011a00 con 0x7f4b4c106600 2023-09-21T12:47:27.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 -- 172.21.15.142:0/958998272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 msgr2=0x7f4b4c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:27.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 --2- 172.21.15.142:0/958998272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c0098a0 tx=0x7f4b3c009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:27.229 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 -- 172.21.15.142:0/958998272 shutdown_connections 2023-09-21T12:47:27.230 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 --2- 172.21.15.142:0/958998272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c106a20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:27.230 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 -- 172.21.15.142:0/958998272 >> 172.21.15.142:0/958998272 conn(0x7f4b4c101ba0 msgr2=0x7f4b4c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:27.230 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 -- 172.21.15.142:0/958998272 shutdown_connections 2023-09-21T12:47:27.230 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.574+0000 7f4b527ec700 1 -- 172.21.15.142:0/958998272 wait complete. 2023-09-21T12:47:27.231 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.575+0000 7f4b527ec700 1 Processor -- start 2023-09-21T12:47:27.231 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.575+0000 7f4b527ec700 1 -- start start 2023-09-21T12:47:27.231 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b527ec700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:27.231 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b527ec700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b4c19cca0 con 0x7f4b4c106600 2023-09-21T12:47:27.231 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:27.232 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33292/0 (socket says 172.21.15.142:33292) 2023-09-21T12:47:27.232 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b4bfff700 1 -- 172.21.15.142:0/2216684487 learned_addr learned my addr 172.21.15.142:0/2216684487 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:27.232 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b4bfff700 1 -- 172.21.15.142:0/2216684487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b3c009550 con 0x7f4b4c106600 2023-09-21T12:47:27.232 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.576+0000 7f4b4bfff700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009fb0 tx=0x7f4b3c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:27.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.577+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c003930 con 0x7f4b4c106600 2023-09-21T12:47:27.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.577+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4b3c003a90 con 0x7f4b4c106600 2023-09-21T12:47:27.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.577+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4c19cea0 con 0x7f4b4c106600 2023-09-21T12:47:27.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.577+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4b3c0195e0 con 0x7f4b4c106600 2023-09-21T12:47:27.233 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.577+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4c19d2c0 con 0x7f4b4c106600 2023-09-21T12:47:27.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.578+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f4b3c0198a0 con 0x7f4b4c106600 2023-09-21T12:47:27.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.578+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4c1967e0 con 0x7f4b4c106600 2023-09-21T12:47:27.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.578+0000 7f4b497fa700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 0x7f4b3403a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:27.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.578+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4b3c04c5e0 con 0x7f4b4c106600 2023-09-21T12:47:27.234 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.578+0000 7f4b4b7fe700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 0x7f4b3403a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:27.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.579+0000 7f4b4b7fe700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 0x7f4b3403a890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006fd0 tx=0x7f4b40006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:27.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.584+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4b3c018530 con 0x7f4b4c106600 2023-09-21T12:47:27.235 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.801+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4b4c074840 con 0x7f4b340383d0 2023-09-21T12:47:27.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.807+0000 7f4b497fa700 1 -- 172.21.15.142:0/2216684487 <== mgr.14118 v2:172.21.15.142:6800/3720958087 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f4b4c074840 con 0x7f4b340383d0 2023-09-21T12:47:27.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.809+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 msgr2=0x7f4b3403a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:27.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.809+0000 7f4b527ec700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 0x7f4b3403a890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4b40006fd0 tx=0x7f4b40006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:27.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.809+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 msgr2=0x7f4b4c19c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:27.236 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.809+0000 7f4b527ec700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c009fb0 tx=0x7f4b3c011ad0 comp rx=0 tx=0).stop 2023-09-21T12:47:27.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 shutdown_connections 2023-09-21T12:47:27.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f4b340383d0 0x7f4b3403a890 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:27.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 --2- 172.21.15.142:0/2216684487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4b4c106600 0x7f4b4c19c760 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:27.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 >> 172.21.15.142:0/2216684487 conn(0x7f4b4c101ba0 msgr2=0x7f4b4c102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:27.237 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 shutdown_connections 2023-09-21T12:47:27.238 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:26.810+0000 7f4b527ec700 1 -- 172.21.15.142:0/2216684487 wait complete. 2023-09-21T12:47:28.060 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:27 smithi142 ceph-mon[97663]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:28.061 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:27 smithi142 ceph-mon[97663]: Saving service mgr spec with placement count:2 2023-09-21T12:47:28.061 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:27 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:28.061 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:27 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:28.061 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:27 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:28.503 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.808+0000 7f9400dd7700 1 Processor -- start 2023-09-21T12:47:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.808+0000 7f9400dd7700 1 -- start start 2023-09-21T12:47:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f9400dd7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:28.504 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f9400dd7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc07a8c0 con 0x7f93fc07be90 2023-09-21T12:47:28.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f93fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:28.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f93fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33300/0 (socket says 172.21.15.142:33300) 2023-09-21T12:47:28.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f93fa59c700 1 -- 172.21.15.142:0/3175762262 learned_addr learned my addr 172.21.15.142:0/3175762262 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:28.505 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.809+0000 7f93fa59c700 1 -- 172.21.15.142:0/3175762262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc07aa00 con 0x7f93fc07be90 2023-09-21T12:47:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.810+0000 7f93fa59c700 1 --2- 172.21.15.142:0/3175762262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fd88ed785d7223 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.812+0000 7f93f959a700 1 -- 172.21.15.142:0/3175762262 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec004160 con 0x7f93fc07be90 2023-09-21T12:47:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.812+0000 7f93f959a700 1 -- 172.21.15.142:0/3175762262 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93ec0042c0 con 0x7f93fc07be90 2023-09-21T12:47:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.812+0000 7f93f959a700 1 -- 172.21.15.142:0/3175762262 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec0119b0 con 0x7f93fc07be90 2023-09-21T12:47:28.506 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 -- 172.21.15.142:0/3175762262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 msgr2=0x7f93fc07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3175762262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f93ec0098a0 tx=0x7f93ec009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 -- 172.21.15.142:0/3175762262 shutdown_connections 2023-09-21T12:47:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3175762262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc07a2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 -- 172.21.15.142:0/3175762262 >> 172.21.15.142:0/3175762262 conn(0x7f93fc101ba0 msgr2=0x7f93fc103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:28.507 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 -- 172.21.15.142:0/3175762262 shutdown_connections 2023-09-21T12:47:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.813+0000 7f9400dd7700 1 -- 172.21.15.142:0/3175762262 wait complete. 2023-09-21T12:47:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.814+0000 7f9400dd7700 1 Processor -- start 2023-09-21T12:47:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f9400dd7700 1 -- start start 2023-09-21T12:47:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f9400dd7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:28.508 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f9400dd7700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc19cc80 con 0x7f93fc07be90 2023-09-21T12:47:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f93fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f93fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33302/0 (socket says 172.21.15.142:33302) 2023-09-21T12:47:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.815+0000 7f93fa59c700 1 -- 172.21.15.142:0/3992725497 learned_addr learned my addr 172.21.15.142:0/3992725497 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f93fa59c700 1 -- 172.21.15.142:0/3992725497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009550 con 0x7f93fc07be90 2023-09-21T12:47:28.509 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f93fa59c700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93ec011980 tx=0x7f93ec011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec003a60 con 0x7f93fc07be90 2023-09-21T12:47:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93ec003bc0 con 0x7f93fc07be90 2023-09-21T12:47:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc19ce80 con 0x7f93fc07be90 2023-09-21T12:47:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.816+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f93ec01a670 con 0x7f93fc07be90 2023-09-21T12:47:28.510 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.817+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc19d2a0 con 0x7f93fc07be90 2023-09-21T12:47:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.818+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f93ec01a930 con 0x7f93fc07be90 2023-09-21T12:47:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.818+0000 7f93eb7fe700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 0x7f93e403a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.818+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f93ec04c590 con 0x7f93fc07be90 2023-09-21T12:47:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.818+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc196640 con 0x7f93fc07be90 2023-09-21T12:47:28.511 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.818+0000 7f93f9d9b700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 0x7f93e403a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.819+0000 7f93f9d9b700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 0x7f93e403a8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006fd0 tx=0x7f93f0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:27.823+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f93ec018db0 con 0x7f93fc07be90 2023-09-21T12:47:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.028+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f93fc10cb80 con 0x7f93fc07be90 2023-09-21T12:47:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.034+0000 7f93eb7fe700 1 -- 172.21.15.142:0/3992725497 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f93ec018350 con 0x7f93fc07be90 2023-09-21T12:47:28.512 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 msgr2=0x7f93e403a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 0x7f93e403a8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006fd0 tx=0x7f93f0006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 msgr2=0x7f93fc19c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f93ec011980 tx=0x7f93ec011a60 comp rx=0 tx=0).stop 2023-09-21T12:47:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 shutdown_connections 2023-09-21T12:47:28.513 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f93e4038420 0x7f93e403a8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:28.514 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 --2- 172.21.15.142:0/3992725497 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93fc07be90 0x7f93fc19c740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:28.514 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 >> 172.21.15.142:0/3992725497 conn(0x7f93fc101ba0 msgr2=0x7f93fc102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:28.514 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 shutdown_connections 2023-09-21T12:47:28.514 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:28.038+0000 7f9400dd7700 1 -- 172.21.15.142:0/3992725497 wait complete. 2023-09-21T12:47:29.336 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:29 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3992725497' entity='client.admin' 2023-09-21T12:47:29.883 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.084+0000 7f3f1c542700 1 Processor -- start 2023-09-21T12:47:29.884 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.084+0000 7f3f1c542700 1 -- start start 2023-09-21T12:47:29.884 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.084+0000 7f3f1c542700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:29.884 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.084+0000 7f3f1c542700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1407a8c0 con 0x7f3f1407be90 2023-09-21T12:47:29.885 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.084+0000 7f3f1a2de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:29.885 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f1a2de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33314/0 (socket says 172.21.15.142:33314) 2023-09-21T12:47:29.885 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f1a2de700 1 -- 172.21.15.142:0/4194555886 learned_addr learned my addr 172.21.15.142:0/4194555886 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:29.885 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f1a2de700 1 -- 172.21.15.142:0/4194555886 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1407aa00 con 0x7f3f1407be90 2023-09-21T12:47:29.885 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f1a2de700 1 --2- 172.21.15.142:0/4194555886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f100098a0 tx=0x7f3f10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c1850b3f065f33 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:29.886 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f192dc700 1 -- 172.21.15.142:0/4194555886 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f10004160 con 0x7f3f1407be90 2023-09-21T12:47:29.886 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f192dc700 1 -- 172.21.15.142:0/4194555886 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f100042c0 con 0x7f3f1407be90 2023-09-21T12:47:29.886 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.085+0000 7f3f192dc700 1 -- 172.21.15.142:0/4194555886 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f100119b0 con 0x7f3f1407be90 2023-09-21T12:47:29.886 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 -- 172.21.15.142:0/4194555886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 msgr2=0x7f3f1407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:29.886 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 --2- 172.21.15.142:0/4194555886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3f100098a0 tx=0x7f3f10009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:29.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 -- 172.21.15.142:0/4194555886 shutdown_connections 2023-09-21T12:47:29.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 --2- 172.21.15.142:0/4194555886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1407a2f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:29.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 -- 172.21.15.142:0/4194555886 >> 172.21.15.142:0/4194555886 conn(0x7f3f14101ba0 msgr2=0x7f3f14103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:29.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 -- 172.21.15.142:0/4194555886 shutdown_connections 2023-09-21T12:47:29.887 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.086+0000 7f3f1c542700 1 -- 172.21.15.142:0/4194555886 wait complete. 2023-09-21T12:47:29.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.088+0000 7f3f1c542700 1 Processor -- start 2023-09-21T12:47:29.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.088+0000 7f3f1c542700 1 -- start start 2023-09-21T12:47:29.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.088+0000 7f3f1c542700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:29.888 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.088+0000 7f3f1c542700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1419cc80 con 0x7f3f1407be90 2023-09-21T12:47:29.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1a2de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:29.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1a2de700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33318/0 (socket says 172.21.15.142:33318) 2023-09-21T12:47:29.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1a2de700 1 -- 172.21.15.142:0/3615679084 learned_addr learned my addr 172.21.15.142:0/3615679084 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:29.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1a2de700 1 -- 172.21.15.142:0/3615679084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f10009550 con 0x7f3f1407be90 2023-09-21T12:47:29.889 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1a2de700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f10011980 tx=0x7f3f10011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:29.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f10003a60 con 0x7f3f1407be90 2023-09-21T12:47:29.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f10003bc0 con 0x7f3f1407be90 2023-09-21T12:47:29.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1419ce80 con 0x7f3f1407be90 2023-09-21T12:47:29.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.089+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3f1001a670 con 0x7f3f1407be90 2023-09-21T12:47:29.890 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.090+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1419d2a0 con 0x7f3f1407be90 2023-09-21T12:47:29.891 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.090+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f3f10024a00 con 0x7f3f1407be90 2023-09-21T12:47:29.891 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.091+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f14196640 con 0x7f3f1407be90 2023-09-21T12:47:29.891 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.091+0000 7f3f0b7fe700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 0x7f3f0003a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:29.891 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.091+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3f1004c370 con 0x7f3f1407be90 2023-09-21T12:47:29.892 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.091+0000 7f3f19add700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 0x7f3f0003a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:29.892 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.092+0000 7f3f19add700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 0x7f3f0003a930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006fd0 tx=0x7f3f04006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:29.892 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.096+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3f10024440 con 0x7f3f1407be90 2023-09-21T12:47:29.892 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.305+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f3f140746d0 con 0x7f3f1407be90 2023-09-21T12:47:29.892 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.310+0000 7f3f0b7fe700 1 -- 172.21.15.142:0/3615679084 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f3f10018350 con 0x7f3f1407be90 2023-09-21T12:47:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 msgr2=0x7f3f0003a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 0x7f3f0003a930 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f04006fd0 tx=0x7f3f04006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 msgr2=0x7f3f1419c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3f10011980 tx=0x7f3f10011a60 comp rx=0 tx=0).stop 2023-09-21T12:47:29.893 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 shutdown_connections 2023-09-21T12:47:29.894 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7f3f00038470 0x7f3f0003a930 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:29.894 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 --2- 172.21.15.142:0/3615679084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f1407be90 0x7f3f1419c740 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:29.894 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.313+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 >> 172.21.15.142:0/3615679084 conn(0x7f3f14101ba0 msgr2=0x7f3f14102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:29.894 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.314+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 shutdown_connections 2023-09-21T12:47:29.894 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:29.314+0000 7f3f1c542700 1 -- 172.21.15.142:0/3615679084 wait complete. 2023-09-21T12:47:29.895 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling the dashboard module... 2023-09-21T12:47:30.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:30 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3615679084' entity='client.admin' 2023-09-21T12:47:30.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:30 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:31.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:31 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1306209831' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-09-21T12:47:31.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:31 smithi142 ceph-mon[97663]: from='mgr.14118 172.21.15.142:0/2740240331' entity='mgr.x' 2023-09-21T12:47:31.917 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setuser ceph since I am not root 2023-09-21T12:47:31.917 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setgroup ceph since I am not root 2023-09-21T12:47:32.065 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.423+0000 7fbd931db700 1 Processor -- start 2023-09-21T12:47:32.066 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.423+0000 7fbd931db700 1 -- start start 2023-09-21T12:47:32.066 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.423+0000 7fbd931db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:32.066 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.423+0000 7fbd931db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c07a900 con 0x7fbd8c07bed0 2023-09-21T12:47:32.066 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.424+0000 7fbd90f77700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.424+0000 7fbd90f77700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33320/0 (socket says 172.21.15.142:33320) 2023-09-21T12:47:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.424+0000 7fbd90f77700 1 -- 172.21.15.142:0/3516735736 learned_addr learned my addr 172.21.15.142:0/3516735736 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.424+0000 7fbd90f77700 1 -- 172.21.15.142:0/3516735736 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8c07aa40 con 0x7fbd8c07bed0 2023-09-21T12:47:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.424+0000 7fbd90f77700 1 --2- 172.21.15.142:0/3516735736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97cfdd8d40adb4e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:32.067 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd8b7fe700 1 -- 172.21.15.142:0/3516735736 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd80004160 con 0x7fbd8c07bed0 2023-09-21T12:47:32.068 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd8b7fe700 1 -- 172.21.15.142:0/3516735736 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd800042c0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.068 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd8b7fe700 1 -- 172.21.15.142:0/3516735736 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd800119b0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.068 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 -- 172.21.15.142:0/3516735736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 msgr2=0x7fbd8c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:32.068 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 --2- 172.21.15.142:0/3516735736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbd800098a0 tx=0x7fbd80009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:32.068 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 -- 172.21.15.142:0/3516735736 shutdown_connections 2023-09-21T12:47:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 --2- 172.21.15.142:0/3516735736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c07a330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 -- 172.21.15.142:0/3516735736 >> 172.21.15.142:0/3516735736 conn(0x7fbd8c101ba0 msgr2=0x7fbd8c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.425+0000 7fbd931db700 1 -- 172.21.15.142:0/3516735736 shutdown_connections 2023-09-21T12:47:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.426+0000 7fbd931db700 1 -- 172.21.15.142:0/3516735736 wait complete. 2023-09-21T12:47:32.069 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.426+0000 7fbd931db700 1 Processor -- start 2023-09-21T12:47:32.070 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd931db700 1 -- start start 2023-09-21T12:47:32.070 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd931db700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:32.070 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd931db700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8c19cc90 con 0x7fbd8c07bed0 2023-09-21T12:47:32.070 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd90f77700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:32.070 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd90f77700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33336/0 (socket says 172.21.15.142:33336) 2023-09-21T12:47:32.071 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd90f77700 1 -- 172.21.15.142:0/1306209831 learned_addr learned my addr 172.21.15.142:0/1306209831 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:32.071 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.427+0000 7fbd90f77700 1 -- 172.21.15.142:0/1306209831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009550 con 0x7fbd8c07bed0 2023-09-21T12:47:32.071 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd90f77700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd80003e60 tx=0x7fbd80011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:32.071 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd80003970 con 0x7fbd8c07bed0 2023-09-21T12:47:32.071 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd80003ad0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd8c19ce90 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd800195e0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.428+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd8c19d2b0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.429+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7fbd800198a0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.430+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd8c196600 con 0x7fbd8c07bed0 2023-09-21T12:47:32.072 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.430+0000 7fbd89ffb700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 0x7fbd7c03a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.430+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbd8004c4a0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.430+0000 7fbd8bfff700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 0x7fbd7c03a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.431+0000 7fbd8bfff700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 0x7fbd7c03a8e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.435+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbd80003c40 con 0x7fbd8c07bed0 2023-09-21T12:47:32.073 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:30.704+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fbd8c062410 con 0x7fbd8c07bed0 2023-09-21T12:47:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.609+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7fbd8001a430 con 0x7fbd8c07bed0 2023-09-21T12:47:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.610+0000 7fbd89ffb700 1 -- 172.21.15.142:0/1306209831 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fbd80016db0 con 0x7fbd8c07bed0 2023-09-21T12:47:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 msgr2=0x7fbd7c03a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:32.074 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 0x7fbd7c03a8e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd78006fd0 tx=0x7fbd78006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 msgr2=0x7fbd8c19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fbd80003e60 tx=0x7fbd80011aa0 comp rx=0 tx=0).stop 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 shutdown_connections 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fbd7c038420 0x7fbd7c03a8e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 --2- 172.21.15.142:0/1306209831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd8c07bed0 0x7fbd8c19c750 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:32.075 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 >> 172.21.15.142:0/1306209831 conn(0x7fbd8c101ba0 msgr2=0x7fbd8c102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:32.076 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 shutdown_connections 2023-09-21T12:47:32.076 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:31.613+0000 7fbd931db700 1 -- 172.21.15.142:0/1306209831 wait complete. 2023-09-21T12:47:32.296 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:31.919+0000 7fa7ee5eb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:47:32.296 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:32.024+0000 7fa7ee5eb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:47:32.296 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:32.163+0000 7fa7ee5eb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:47:32.297 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:32.296+0000 7fa7ee5eb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:47:32.553 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:32.546+0000 7fa7ee5eb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:47:32.810 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1306209831' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-09-21T12:47:32.811 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:32 smithi142 ceph-mon[97663]: mgrmap e9: x(active, since 18s) 2023-09-21T12:47:33.151 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:33.054+0000 7fa7ee5eb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:47:33.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:33.227+0000 7fa7ee5eb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:47:33.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:33.343+0000 7fa7ee5eb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:47:33.562 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:47:33.562 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-09-21T12:47:33.562 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-21T12:47:33.563 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-21T12:47:33.563 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-21T12:47:33.563 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:47:33.563 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.703+0000 7fba2386c700 1 Processor -- start 2023-09-21T12:47:33.564 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.703+0000 7fba2386c700 1 -- start start 2023-09-21T12:47:33.564 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.703+0000 7fba2386c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:33.564 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.703+0000 7fba2386c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c106ff0 con 0x7fba1c106600 2023-09-21T12:47:33.564 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.704+0000 7fba21608700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:33.565 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.704+0000 7fba21608700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33372/0 (socket says 172.21.15.142:33372) 2023-09-21T12:47:33.565 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.704+0000 7fba21608700 1 -- 172.21.15.142:0/2660815438 learned_addr learned my addr 172.21.15.142:0/2660815438 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:33.565 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.704+0000 7fba21608700 1 -- 172.21.15.142:0/2660815438 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c107800 con 0x7fba1c106600 2023-09-21T12:47:33.565 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.704+0000 7fba21608700 1 --2- 172.21.15.142:0/2660815438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba180098a0 tx=0x7fba18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dddc15c1c19f04 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:33.566 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba13fff700 1 -- 172.21.15.142:0/2660815438 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba18004160 con 0x7fba1c106600 2023-09-21T12:47:33.566 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba13fff700 1 -- 172.21.15.142:0/2660815438 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba180042c0 con 0x7fba1c106600 2023-09-21T12:47:33.566 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba13fff700 1 -- 172.21.15.142:0/2660815438 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba180119b0 con 0x7fba1c106600 2023-09-21T12:47:33.566 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 -- 172.21.15.142:0/2660815438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 msgr2=0x7fba1c106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:33.567 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 --2- 172.21.15.142:0/2660815438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba180098a0 tx=0x7fba18009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.567 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 -- 172.21.15.142:0/2660815438 shutdown_connections 2023-09-21T12:47:33.567 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 --2- 172.21.15.142:0/2660815438 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c106a20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.567 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 -- 172.21.15.142:0/2660815438 >> 172.21.15.142:0/2660815438 conn(0x7fba1c101ba0 msgr2=0x7fba1c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.705+0000 7fba2386c700 1 -- 172.21.15.142:0/2660815438 shutdown_connections 2023-09-21T12:47:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.706+0000 7fba2386c700 1 -- 172.21.15.142:0/2660815438 wait complete. 2023-09-21T12:47:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.706+0000 7fba2386c700 1 Processor -- start 2023-09-21T12:47:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba2386c700 1 -- start start 2023-09-21T12:47:33.568 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba2386c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:33.569 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba2386c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1c19ccc0 con 0x7fba1c106600 2023-09-21T12:47:33.569 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba21608700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:33.569 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba21608700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33386/0 (socket says 172.21.15.142:33386) 2023-09-21T12:47:33.569 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba21608700 1 -- 172.21.15.142:0/4289445312 learned_addr learned my addr 172.21.15.142:0/4289445312 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.707+0000 7fba21608700 1 -- 172.21.15.142:0/4289445312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba18009550 con 0x7fba1c106600 2023-09-21T12:47:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba21608700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba18003e60 tx=0x7fba18011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba18003970 con 0x7fba1c106600 2023-09-21T12:47:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba18003ad0 con 0x7fba1c106600 2023-09-21T12:47:33.570 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba180195e0 con 0x7fba1c106600 2023-09-21T12:47:33.571 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c19cec0 con 0x7fba1c106600 2023-09-21T12:47:33.571 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.708+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba1c19d2e0 con 0x7fba1c106600 2023-09-21T12:47:33.571 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.710+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1c1968a0 con 0x7fba1c106600 2023-09-21T12:47:33.571 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.710+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7fba18019740 con 0x7fba1c106600 2023-09-21T12:47:33.572 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.711+0000 7fba127fc700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 0x7fba0803a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:33.572 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.711+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fba1804c4e0 con 0x7fba1c106600 2023-09-21T12:47:33.572 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.711+0000 7fba20e07700 1 -- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 msgr2=0x7fba0803a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:33.573 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.711+0000 7fba20e07700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 0x7fba0803a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:47:33.573 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.716+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fba18003c40 con 0x7fba1c106600 2023-09-21T12:47:33.573 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.912+0000 7fba20e07700 1 -- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 msgr2=0x7fba0803a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:33.573 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.912+0000 7fba20e07700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 0x7fba0803a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:47:33.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.986+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fba1c0746d0 con 0x7fba1c106600 2023-09-21T12:47:33.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.986+0000 7fba127fc700 1 -- 172.21.15.142:0/4289445312 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7fba18018350 con 0x7fba1c106600 2023-09-21T12:47:33.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 msgr2=0x7fba0803a930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:47:33.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 0x7fba0803a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.574 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 msgr2=0x7fba1c19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:33.575 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba18003e60 tx=0x7fba18011aa0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.575 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 shutdown_connections 2023-09-21T12:47:33.575 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fba08038470 0x7fba0803a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.575 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 --2- 172.21.15.142:0/4289445312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba1c106600 0x7fba1c19c780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:33.576 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.988+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 >> 172.21.15.142:0/4289445312 conn(0x7fba1c101ba0 msgr2=0x7fba1c102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:33.576 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.989+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 shutdown_connections 2023-09-21T12:47:33.576 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:32.989+0000 7fba2386c700 1 -- 172.21.15.142:0/4289445312 wait complete. 2023-09-21T12:47:33.576 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for the mgr to restart... 2023-09-21T12:47:33.576 INFO:teuthology.orchestra.run.smithi142.stdout:Waiting for mgr epoch 9... 2023-09-21T12:47:33.865 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:33 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4289445312' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-21T12:47:33.865 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:33.469+0000 7fa7ee5eb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:47:34.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:34.042+0000 7fa7ee5eb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:47:35.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:34.892+0000 7fa7ee5eb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:47:35.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:34.998+0000 7fa7ee5eb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:47:36.282 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:35.943+0000 7fa7ee5eb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:47:36.283 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:36.061+0000 7fa7ee5eb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:47:36.646 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:36.283+0000 7fa7ee5eb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:47:36.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:36.646+0000 7fa7ee5eb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:47:37.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:36.925+0000 7fa7ee5eb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:47:37.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:37.116+0000 7fa7ee5eb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:47:37.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:37.456+0000 7fa7ee5eb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:47:38.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:38.378+0000 7fa7ee5eb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:47:38.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:38.550+0000 7fa7ee5eb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:47:39.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:38.794+0000 7fa7ee5eb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:47:39.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:38.941+0000 7fa7ee5eb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:47:39.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:39.217+0000 7fa7ee5eb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:47:40.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:47:40.286+0000 7fa7ee5eb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:47:40.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: Active manager daemon x restarted 2023-09-21T12:47:40.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: Activating manager daemon x 2023-09-21T12:47:40.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: osdmap e3: 0 total, 0 up, 0 in 2023-09-21T12:47:40.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: mgrmap e10: x(active, starting, since 0.00421031s) 2023-09-21T12:47:40.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:47:40.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:47:40.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:47:40.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:47:40.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:47:40.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: Manager daemon x is now available 2023-09-21T12:47:40.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:40.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:41.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:47:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:47:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:41 smithi142 ceph-mon[97663]: mgrmap e11: x(active, since 1.00778s) 2023-09-21T12:47:41.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout { 2023-09-21T12:47:41.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-09-21T12:47:41.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-21T12:47:41.775 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout } 2023-09-21T12:47:41.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.147+0000 7fccb8f88700 1 Processor -- start 2023-09-21T12:47:41.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.148+0000 7fccb8f88700 1 -- start start 2023-09-21T12:47:41.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.148+0000 7fccb8f88700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:41.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.148+0000 7fccb8f88700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb407a8e0 con 0x7fccb407beb0 2023-09-21T12:47:41.776 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.148+0000 7fccb259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60518/0 (socket says 172.21.15.142:60518) 2023-09-21T12:47:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb259c700 1 -- 172.21.15.142:0/4278312046 learned_addr learned my addr 172.21.15.142:0/4278312046 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb259c700 1 -- 172.21.15.142:0/4278312046 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb407aa20 con 0x7fccb407beb0 2023-09-21T12:47:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb259c700 1 --2- 172.21.15.142:0/4278312046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcca40098a0 tx=0x7fcca4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e16b8a1530c63b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:41.777 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb159a700 1 -- 172.21.15.142:0/4278312046 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca4004160 con 0x7fccb407beb0 2023-09-21T12:47:41.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb159a700 1 -- 172.21.15.142:0/4278312046 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcca40042c0 con 0x7fccb407beb0 2023-09-21T12:47:41.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.149+0000 7fccb159a700 1 -- 172.21.15.142:0/4278312046 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40119b0 con 0x7fccb407beb0 2023-09-21T12:47:41.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 -- 172.21.15.142:0/4278312046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 msgr2=0x7fccb407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:41.778 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4278312046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcca40098a0 tx=0x7fcca4009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 -- 172.21.15.142:0/4278312046 shutdown_connections 2023-09-21T12:47:41.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4278312046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb407a310 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 -- 172.21.15.142:0/4278312046 >> 172.21.15.142:0/4278312046 conn(0x7fccb4101ba0 msgr2=0x7fccb4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:41.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 -- 172.21.15.142:0/4278312046 shutdown_connections 2023-09-21T12:47:41.779 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.150+0000 7fccb8f88700 1 -- 172.21.15.142:0/4278312046 wait complete. 2023-09-21T12:47:41.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.151+0000 7fccb8f88700 1 Processor -- start 2023-09-21T12:47:41.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb8f88700 1 -- start start 2023-09-21T12:47:41.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb8f88700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:41.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb8f88700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccb419cc90 con 0x7fccb407beb0 2023-09-21T12:47:41.780 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:41.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60534/0 (socket says 172.21.15.142:60534) 2023-09-21T12:47:41.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.152+0000 7fccb259c700 1 -- 172.21.15.142:0/4083349870 learned_addr learned my addr 172.21.15.142:0/4083349870 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:41.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fccb259c700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca4009550 con 0x7fccb407beb0 2023-09-21T12:47:41.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fccb259c700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcca4000c00 tx=0x7fcca4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:41.781 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca40039f0 con 0x7fccb407beb0 2023-09-21T12:47:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccb419ce90 con 0x7fccb407beb0 2023-09-21T12:47:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcca4003b50 con 0x7fccb407beb0 2023-09-21T12:47:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcca401a780 con 0x7fccb407beb0 2023-09-21T12:47:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.153+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccb419d2b0 con 0x7fccb407beb0 2023-09-21T12:47:41.782 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.154+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7fcca4024440 con 0x7fccb407beb0 2023-09-21T12:47:41.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.155+0000 7fcca37fe700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:41.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.155+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc9c03b040 con 0x7fcc9c038470 2023-09-21T12:47:41.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.155+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcca404c320 con 0x7fccb407beb0 2023-09-21T12:47:41.783 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.155+0000 7fccb1d9b700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.155+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:47:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.356+0000 7fccb1d9b700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.356+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:47:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.757+0000 7fccb1d9b700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:41.784 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:34.757+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-21T12:47:41.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:35.558+0000 7fccb1d9b700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:41.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:35.558+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-21T12:47:41.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:37.159+0000 7fccb1d9b700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3720958087 2023-09-21T12:47:41.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:37.160+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-21T12:47:41.785 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:40.291+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mgrmap(e 10) v1 ==== 45111+0+0 (secure 0 0 0) 0x7fcca402d910 con 0x7fccb407beb0 2023-09-21T12:47:41.786 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:40.291+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 msgr2=0x7fcc9c03a930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:47:41.786 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:40.291+0000 7fcca37fe700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.786 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.293+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 11) v1 ==== 45238+0+0 (secure 0 0 0) 0x7fcca404df90 con 0x7fccb407beb0 2023-09-21T12:47:41.786 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.293+0000 7fcca37fe700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 0x7fcc9c03e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:41.786 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.293+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcc9c03b040 con 0x7fcc9c03bee0 2023-09-21T12:47:41.787 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.294+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 0x7fcc9c03e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:41.787 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.295+0000 7fccb1d9b700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 0x7fcc9c03e2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcca8003a10 tx=0x7fcca80092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:41.787 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.295+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fcc9c03b040 con 0x7fcc9c03bee0 2023-09-21T12:47:41.787 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.302+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fccb419da90 con 0x7fcc9c03bee0 2023-09-21T12:47:41.787 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fcca37fe700 1 -- 172.21.15.142:0/4083349870 <== mgr.14150 v2:172.21.15.142:6800/3499877374 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fccb419da90 con 0x7fcc9c03bee0 2023-09-21T12:47:41.788 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 msgr2=0x7fcc9c03e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:41.788 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 0x7fcc9c03e2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcca8003a10 tx=0x7fcca80092b0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.788 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 msgr2=0x7fccb419c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:41.788 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcca4000c00 tx=0x7fcca4011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:41.788 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 shutdown_connections 2023-09-21T12:47:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fccb407beb0 0x7fccb419c750 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc9c03bee0 0x7fcc9c03e2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 --2- 172.21.15.142:0/4083349870 >> [v2:172.21.15.142:6800/3720958087,v1:172.21.15.142:6801/3720958087] conn(0x7fcc9c038470 0x7fcc9c03a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 >> 172.21.15.142:0/4083349870 conn(0x7fccb4101ba0 msgr2=0x7fccb4102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:41.789 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.303+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 shutdown_connections 2023-09-21T12:47:41.790 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:41.304+0000 7fccb8f88700 1 -- 172.21.15.142:0/4083349870 wait complete. 2023-09-21T12:47:41.790 INFO:teuthology.orchestra.run.smithi142.stdout:mgr epoch 9 is available 2023-09-21T12:47:41.790 INFO:teuthology.orchestra.run.smithi142.stdout:Generating a dashboard self-signed certificate... 2023-09-21T12:47:42.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:41] ENGINE Bus STARTING 2023-09-21T12:47:42.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-21T12:47:42.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-21T12:47:42.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:41] ENGINE Serving on http://172.21.15.142:8765 2023-09-21T12:47:42.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:41] ENGINE Serving on https://172.21.15.142:7150 2023-09-21T12:47:42.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:42 smithi142 ceph-mon[97663]: [21/Sep/2023:12:47:41] ENGINE Bus STARTED 2023-09-21T12:47:43.460 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-09-21T12:47:43.460 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.489+0000 7fbdc734d700 1 Processor -- start 2023-09-21T12:47:43.460 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc734d700 1 -- start start 2023-09-21T12:47:43.460 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc734d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:43.461 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc734d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc007a8e0 con 0x7fbdc007beb0 2023-09-21T12:47:43.461 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc50e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:43.461 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc50e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60602/0 (socket says 172.21.15.142:60602) 2023-09-21T12:47:43.461 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.490+0000 7fbdc50e9700 1 -- 172.21.15.142:0/929545852 learned_addr learned my addr 172.21.15.142:0/929545852 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:43.461 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.491+0000 7fbdc50e9700 1 -- 172.21.15.142:0/929545852 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc007aa20 con 0x7fbdc007beb0 2023-09-21T12:47:43.462 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.491+0000 7fbdc50e9700 1 --2- 172.21.15.142:0/929545852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0098a0 tx=0x7fbdbc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129f582fec3062a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:43.462 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.491+0000 7fbdb7fff700 1 -- 172.21.15.142:0/929545852 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdbc004160 con 0x7fbdc007beb0 2023-09-21T12:47:43.462 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.491+0000 7fbdb7fff700 1 -- 172.21.15.142:0/929545852 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdbc0042c0 con 0x7fbdc007beb0 2023-09-21T12:47:43.462 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.491+0000 7fbdb7fff700 1 -- 172.21.15.142:0/929545852 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdbc0119b0 con 0x7fbdc007beb0 2023-09-21T12:47:43.463 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 -- 172.21.15.142:0/929545852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 msgr2=0x7fbdc007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:43.463 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 --2- 172.21.15.142:0/929545852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0098a0 tx=0x7fbdbc009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:43.463 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 -- 172.21.15.142:0/929545852 shutdown_connections 2023-09-21T12:47:43.463 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 --2- 172.21.15.142:0/929545852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc007a310 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:43.463 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 -- 172.21.15.142:0/929545852 >> 172.21.15.142:0/929545852 conn(0x7fbdc0101ba0 msgr2=0x7fbdc0103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 -- 172.21.15.142:0/929545852 shutdown_connections 2023-09-21T12:47:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.492+0000 7fbdc734d700 1 -- 172.21.15.142:0/929545852 wait complete. 2023-09-21T12:47:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.493+0000 7fbdc734d700 1 Processor -- start 2023-09-21T12:47:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc734d700 1 -- start start 2023-09-21T12:47:43.464 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc734d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc734d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc019cc90 con 0x7fbdc007beb0 2023-09-21T12:47:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc50e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc50e9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60608/0 (socket says 172.21.15.142:60608) 2023-09-21T12:47:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.494+0000 7fbdc50e9700 1 -- 172.21.15.142:0/943740577 learned_addr learned my addr 172.21.15.142:0/943740577 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:43.465 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdc50e9700 1 -- 172.21.15.142:0/943740577 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc009550 con 0x7fbdc007beb0 2023-09-21T12:47:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdc50e9700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000c00 tx=0x7fbdbc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdbc0039f0 con 0x7fbdc007beb0 2023-09-21T12:47:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbdbc003b50 con 0x7fbdc007beb0 2023-09-21T12:47:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc019ce90 con 0x7fbdc007beb0 2023-09-21T12:47:43.466 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbdbc01a780 con 0x7fbdc007beb0 2023-09-21T12:47:43.467 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.495+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc019d2b0 con 0x7fbdc007beb0 2023-09-21T12:47:43.467 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.496+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 12) v1 ==== 45344+0+0 (secure 0 0 0) 0x7fbdbc024440 con 0x7fbdc007beb0 2023-09-21T12:47:43.467 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.496+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc0196600 con 0x7fbdc007beb0 2023-09-21T12:47:43.467 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.497+0000 7fbdb67fc700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 0x7fbdac03a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:43.467 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.497+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbdbc04c4c0 con 0x7fbdc007beb0 2023-09-21T12:47:43.468 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.497+0000 7fbdc48e8700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 0x7fbdac03a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:43.468 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.497+0000 7fbdc48e8700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 0x7fbdac03a930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0006fd0 tx=0x7fbdb0006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:43.468 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.502+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbdbc018d90 con 0x7fbdc007beb0 2023-09-21T12:47:43.468 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.730+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdc010ccc0 con 0x7fbdac038470 2023-09-21T12:47:43.468 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.959+0000 7fbdb67fc700 1 -- 172.21.15.142:0/943740577 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fbdc010ccc0 con 0x7fbdac038470 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 msgr2=0x7fbdac03a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 0x7fbdac03a930 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0006fd0 tx=0x7fbdb0006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 msgr2=0x7fbdc019c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc000c00 tx=0x7fbdbc011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 shutdown_connections 2023-09-21T12:47:43.469 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fbdac038470 0x7fbdac03a930 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.962+0000 7fbdc734d700 1 --2- 172.21.15.142:0/943740577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdc007beb0 0x7fbdc019c750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.963+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 >> 172.21.15.142:0/943740577 conn(0x7fbdc0101ba0 msgr2=0x7fbdc0102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.963+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 shutdown_connections 2023-09-21T12:47:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:42.963+0000 7fbdc734d700 1 -- 172.21.15.142:0/943740577 wait complete. 2023-09-21T12:47:43.470 INFO:teuthology.orchestra.run.smithi142.stdout:Creating initial admin user... 2023-09-21T12:47:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:43 smithi142 ceph-mon[97663]: mgrmap e12: x(active, since 2s) 2023-09-21T12:47:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:43 smithi142 ceph-mon[97663]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:44.946 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$iPlLKPk1IXc.rodyvY3QweGjppC.JJWZ1bnsAWM8WrzJZWga6PTga", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1695300464, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-09-21T12:47:44.947 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.041+0000 7f1b0d990700 1 Processor -- start 2023-09-21T12:47:44.947 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.041+0000 7f1b0d990700 1 -- start start 2023-09-21T12:47:44.947 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0d990700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:44.948 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0d990700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0807a8c0 con 0x7f1b0807be90 2023-09-21T12:47:44.948 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0c98e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:44.948 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0c98e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48028/0 (socket says 172.21.15.142:48028) 2023-09-21T12:47:44.948 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0c98e700 1 -- 172.21.15.142:0/950139002 learned_addr learned my addr 172.21.15.142:0/950139002 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:44.948 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0c98e700 1 -- 172.21.15.142:0/950139002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0807aa00 con 0x7f1b0807be90 2023-09-21T12:47:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.042+0000 7f1b0c98e700 1 --2- 172.21.15.142:0/950139002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098a0 tx=0x7f1afc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bdd30f15e0fe7f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.043+0000 7f1b077fe700 1 -- 172.21.15.142:0/950139002 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1afc004160 con 0x7f1b0807be90 2023-09-21T12:47:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.043+0000 7f1b077fe700 1 -- 172.21.15.142:0/950139002 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1afc0042c0 con 0x7f1b0807be90 2023-09-21T12:47:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.043+0000 7f1b077fe700 1 -- 172.21.15.142:0/950139002 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1afc0119b0 con 0x7f1b0807be90 2023-09-21T12:47:44.949 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.043+0000 7f1b0d990700 1 -- 172.21.15.142:0/950139002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 msgr2=0x7f1b0807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:44.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.043+0000 7f1b0d990700 1 --2- 172.21.15.142:0/950139002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1afc0098a0 tx=0x7f1afc009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:44.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.044+0000 7f1b0d990700 1 -- 172.21.15.142:0/950139002 shutdown_connections 2023-09-21T12:47:44.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.044+0000 7f1b0d990700 1 --2- 172.21.15.142:0/950139002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0807a2f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:44.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.044+0000 7f1b0d990700 1 -- 172.21.15.142:0/950139002 >> 172.21.15.142:0/950139002 conn(0x7f1b08101a00 msgr2=0x7f1b08103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:44.950 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.044+0000 7f1b0d990700 1 -- 172.21.15.142:0/950139002 shutdown_connections 2023-09-21T12:47:44.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.044+0000 7f1b0d990700 1 -- 172.21.15.142:0/950139002 wait complete. 2023-09-21T12:47:44.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0d990700 1 Processor -- start 2023-09-21T12:47:44.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0d990700 1 -- start start 2023-09-21T12:47:44.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0d990700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:44.951 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0d990700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0819cb40 con 0x7f1b0807be90 2023-09-21T12:47:44.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0c98e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:44.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0c98e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48042/0 (socket says 172.21.15.142:48042) 2023-09-21T12:47:44.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.045+0000 7f1b0c98e700 1 -- 172.21.15.142:0/387028313 learned_addr learned my addr 172.21.15.142:0/387028313 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:44.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b0c98e700 1 -- 172.21.15.142:0/387028313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1afc009550 con 0x7f1b0807be90 2023-09-21T12:47:44.952 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b0c98e700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1afc003f00 tx=0x7f1afc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:44.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1afc003b20 con 0x7f1b0807be90 2023-09-21T12:47:44.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1afc003c80 con 0x7f1b0807be90 2023-09-21T12:47:44.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1afc019770 con 0x7f1b0807be90 2023-09-21T12:47:44.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.046+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0819cd40 con 0x7f1b0807be90 2023-09-21T12:47:44.953 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.047+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0819d160 con 0x7f1b0807be90 2023-09-21T12:47:44.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.048+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 12) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f1afc01a430 con 0x7f1b0807be90 2023-09-21T12:47:44.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.048+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b08196480 con 0x7f1b0807be90 2023-09-21T12:47:44.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.048+0000 7f1b05ffb700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 0x7f1af803a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:44.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.048+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1afc04c690 con 0x7f1b0807be90 2023-09-21T12:47:44.954 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.048+0000 7f1b07fff700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 0x7f1af803a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:44.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.049+0000 7f1b07fff700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 0x7f1af803a930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1af4006fd0 tx=0x7f1af4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:44.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.054+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1afc02d9a0 con 0x7f1b0807be90 2023-09-21T12:47:44.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.292+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f1b08062230 con 0x7f1af8038470 2023-09-21T12:47:44.955 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.519+0000 7f1b05ffb700 1 -- 172.21.15.142:0/387028313 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f1b08062230 con 0x7f1af8038470 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 msgr2=0x7f1af803a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 0x7f1af803a930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1af4006fd0 tx=0x7f1af4006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 msgr2=0x7f1b0819c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1afc003f00 tx=0x7f1afc011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 shutdown_connections 2023-09-21T12:47:44.956 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1af8038470 0x7f1af803a930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:44.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 --2- 172.21.15.142:0/387028313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b0807be90 0x7f1b0819c600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:44.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.521+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 >> 172.21.15.142:0/387028313 conn(0x7f1b08101a00 msgr2=0x7f1b08103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:44.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.522+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 shutdown_connections 2023-09-21T12:47:44.957 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:44.522+0000 7f1b0d990700 1 -- 172.21.15.142:0/387028313 wait complete. 2023-09-21T12:47:44.957 INFO:teuthology.orchestra.run.smithi142.stdout:Fetching dashboard port number... 2023-09-21T12:47:45.389 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:45.389 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:44 smithi142 ceph-mon[97663]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:45.390 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:46.529 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stdout 8443 2023-09-21T12:47:46.529 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.691+0000 7f8b82ece700 1 Processor -- start 2023-09-21T12:47:46.529 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.691+0000 7f8b82ece700 1 -- start start 2023-09-21T12:47:46.529 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.691+0000 7f8b82ece700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:46.530 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.691+0000 7f8b82ece700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c07a920 con 0x7f8b7c07bef0 2023-09-21T12:47:46.530 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.692+0000 7f8b80c6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:46.530 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.692+0000 7f8b80c6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48048/0 (socket says 172.21.15.142:48048) 2023-09-21T12:47:46.530 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.692+0000 7f8b80c6a700 1 -- 172.21.15.142:0/4011031742 learned_addr learned my addr 172.21.15.142:0/4011031742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.692+0000 7f8b80c6a700 1 -- 172.21.15.142:0/4011031742 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c07aa60 con 0x7f8b7c07bef0 2023-09-21T12:47:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.692+0000 7f8b80c6a700 1 --2- 172.21.15.142:0/4011031742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b700098a0 tx=0x7f8b70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9e43ae4061f845e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.693+0000 7f8b7b7fe700 1 -- 172.21.15.142:0/4011031742 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b70004160 con 0x7f8b7c07bef0 2023-09-21T12:47:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.693+0000 7f8b7b7fe700 1 -- 172.21.15.142:0/4011031742 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b700042c0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.531 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.693+0000 7f8b7b7fe700 1 -- 172.21.15.142:0/4011031742 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b700119b0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.693+0000 7f8b82ece700 1 -- 172.21.15.142:0/4011031742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 msgr2=0x7f8b7c07a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.693+0000 7f8b82ece700 1 --2- 172.21.15.142:0/4011031742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8b700098a0 tx=0x7f8b70009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.694+0000 7f8b82ece700 1 -- 172.21.15.142:0/4011031742 shutdown_connections 2023-09-21T12:47:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.694+0000 7f8b82ece700 1 --2- 172.21.15.142:0/4011031742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c07a350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:46.532 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.694+0000 7f8b82ece700 1 -- 172.21.15.142:0/4011031742 >> 172.21.15.142:0/4011031742 conn(0x7f8b7c101ba0 msgr2=0x7f8b7c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.694+0000 7f8b82ece700 1 -- 172.21.15.142:0/4011031742 shutdown_connections 2023-09-21T12:47:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.694+0000 7f8b82ece700 1 -- 172.21.15.142:0/4011031742 wait complete. 2023-09-21T12:47:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.695+0000 7f8b82ece700 1 Processor -- start 2023-09-21T12:47:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.695+0000 7f8b82ece700 1 -- start start 2023-09-21T12:47:46.533 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.695+0000 7f8b82ece700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.695+0000 7f8b82ece700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c1a98e0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.696+0000 7f8b80c6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.696+0000 7f8b80c6a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48058/0 (socket says 172.21.15.142:48058) 2023-09-21T12:47:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.696+0000 7f8b80c6a700 1 -- 172.21.15.142:0/3133561186 learned_addr learned my addr 172.21.15.142:0/3133561186 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:46.534 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.696+0000 7f8b80c6a700 1 -- 172.21.15.142:0/3133561186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70009550 con 0x7f8b7c07bef0 2023-09-21T12:47:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.696+0000 7f8b80c6a700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000c00 tx=0x7f8b70011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.697+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b700039f0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.697+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c1a9ae0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.697+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b70003b50 con 0x7f8b7c07bef0 2023-09-21T12:47:46.535 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.697+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c1a9f00 con 0x7f8b7c07bef0 2023-09-21T12:47:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.697+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8b7001a780 con 0x7f8b7c07bef0 2023-09-21T12:47:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.698+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 12) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f8b7001a9f0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.698+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60005320 con 0x7f8b7c07bef0 2023-09-21T12:47:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.699+0000 7f8b79ffb700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 0x7f8b6c03a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:46.536 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.699+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8b7004c3c0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.699+0000 7f8b7bfff700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 0x7f8b6c03a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.700+0000 7f8b7bfff700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 0x7f8b6c03a9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006fd0 tx=0x7f8b68006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.704+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8b700237b0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.924+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f8b60005b50 con 0x7f8b7c07bef0 2023-09-21T12:47:46.537 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.925+0000 7f8b79ffb700 1 -- 172.21.15.142:0/3133561186 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f8b700172b0 con 0x7f8b7c07bef0 2023-09-21T12:47:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 msgr2=0x7f8b6c03a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 0x7f8b6c03a9d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8b68006fd0 tx=0x7f8b68006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 msgr2=0x7f8b7c1a93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000c00 tx=0x7f8b70011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:46.538 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 shutdown_connections 2023-09-21T12:47:46.539 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b6c038510 0x7f8b6c03a9d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:46.539 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 --2- 172.21.15.142:0/3133561186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b7c07bef0 0x7f8b7c1a93a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:46.560 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.927+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 >> 172.21.15.142:0/3133561186 conn(0x7f8b7c101ba0 msgr2=0x7f8b7c102860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:46.561 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.928+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 shutdown_connections 2023-09-21T12:47:46.561 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:45.928+0000 7f8b82ece700 1 -- 172.21.15.142:0/3133561186 wait complete. 2023-09-21T12:47:46.563 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-21T12:47:46.563 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout disabled 2023-09-21T12:47:46.564 INFO:teuthology.orchestra.run.smithi142.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-21T12:47:46.564 INFO:teuthology.orchestra.run.smithi142.stdout:systemctl: stdout inactive 2023-09-21T12:47:46.564 INFO:teuthology.orchestra.run.smithi142.stdout:firewalld.service is not enabled 2023-09-21T12:47:46.564 INFO:teuthology.orchestra.run.smithi142.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-09-21T12:47:46.564 INFO:teuthology.orchestra.run.smithi142.stdout:Ceph Dashboard is now available at: 2023-09-21T12:47:46.565 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:46.565 INFO:teuthology.orchestra.run.smithi142.stdout: URL: https://smithi142.front.sepia.ceph.com:8443/ 2023-09-21T12:47:46.565 INFO:teuthology.orchestra.run.smithi142.stdout: User: admin 2023-09-21T12:47:46.565 INFO:teuthology.orchestra.run.smithi142.stdout: Password: m2v9f0h7sg 2023-09-21T12:47:46.566 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:46.566 INFO:teuthology.orchestra.run.smithi142.stdout:Saving cluster configuration to /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config directory 2023-09-21T12:47:46.567 INFO:teuthology.orchestra.run.smithi142.stdout:Enabling autotune for osd_memory_target 2023-09-21T12:47:46.841 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3133561186' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-09-21T12:47:47.745 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.109+0000 7f0b9442a700 1 Processor -- start 2023-09-21T12:47:47.745 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.109+0000 7f0b9442a700 1 -- start start 2023-09-21T12:47:47.745 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.109+0000 7f0b9442a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:47.745 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.109+0000 7f0b9442a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c07a900 con 0x7f0b8c07bed0 2023-09-21T12:47:47.746 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.110+0000 7f0b921c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:47.746 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.110+0000 7f0b921c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48070/0 (socket says 172.21.15.142:48070) 2023-09-21T12:47:47.746 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.110+0000 7f0b921c6700 1 -- 172.21.15.142:0/1196782915 learned_addr learned my addr 172.21.15.142:0/1196782915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:47.746 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.110+0000 7f0b921c6700 1 -- 172.21.15.142:0/1196782915 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c07aa40 con 0x7f0b8c07bed0 2023-09-21T12:47:47.747 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b921c6700 1 --2- 172.21.15.142:0/1196782915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b88009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3321621cdd1455d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:47.747 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b911c4700 1 -- 172.21.15.142:0/1196782915 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b88004160 con 0x7f0b8c07bed0 2023-09-21T12:47:47.747 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b911c4700 1 -- 172.21.15.142:0/1196782915 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b880042c0 con 0x7f0b8c07bed0 2023-09-21T12:47:47.747 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b911c4700 1 -- 172.21.15.142:0/1196782915 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b880119b0 con 0x7f0b8c07bed0 2023-09-21T12:47:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b9442a700 1 -- 172.21.15.142:0/1196782915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 msgr2=0x7f0b8c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.111+0000 7f0b9442a700 1 --2- 172.21.15.142:0/1196782915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b88009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.112+0000 7f0b9442a700 1 -- 172.21.15.142:0/1196782915 shutdown_connections 2023-09-21T12:47:47.748 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.112+0000 7f0b9442a700 1 --2- 172.21.15.142:0/1196782915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c07a330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.112+0000 7f0b9442a700 1 -- 172.21.15.142:0/1196782915 >> 172.21.15.142:0/1196782915 conn(0x7f0b8c101ba0 msgr2=0x7f0b8c103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.112+0000 7f0b9442a700 1 -- 172.21.15.142:0/1196782915 shutdown_connections 2023-09-21T12:47:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.112+0000 7f0b9442a700 1 -- 172.21.15.142:0/1196782915 wait complete. 2023-09-21T12:47:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b9442a700 1 Processor -- start 2023-09-21T12:47:47.749 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b9442a700 1 -- start start 2023-09-21T12:47:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b9442a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b9442a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c19cc90 con 0x7f0b8c07bed0 2023-09-21T12:47:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b921c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b921c6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48080/0 (socket says 172.21.15.142:48080) 2023-09-21T12:47:47.750 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.113+0000 7f0b921c6700 1 -- 172.21.15.142:0/2857185639 learned_addr learned my addr 172.21.15.142:0/2857185639 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b921c6700 1 -- 172.21.15.142:0/2857185639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b88009550 con 0x7f0b8c07bed0 2023-09-21T12:47:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b921c6700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b88000c00 tx=0x7f0b88011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b880039f0 con 0x7f0b8c07bed0 2023-09-21T12:47:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b88003b50 con 0x7f0b8c07bed0 2023-09-21T12:47:47.751 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b8c19ce90 con 0x7f0b8c07bed0 2023-09-21T12:47:47.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0b8801a780 con 0x7f0b8c07bed0 2023-09-21T12:47:47.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.114+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b8c19d2b0 con 0x7f0b8c07bed0 2023-09-21T12:47:47.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.115+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f0b88024440 con 0x7f0b8c07bed0 2023-09-21T12:47:47.752 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.115+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8c196600 con 0x7f0b8c07bed0 2023-09-21T12:47:47.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.116+0000 7f0b837fe700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 0x7f0b7803aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:47.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.116+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0b8804c590 con 0x7f0b8c07bed0 2023-09-21T12:47:47.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.116+0000 7f0b919c5700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 0x7f0b7803aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:47.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.116+0000 7f0b919c5700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 0x7f0b7803aa20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c006fd0 tx=0x7f0b7c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:47.753 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.120+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0b880189a0 con 0x7f0b8c07bed0 2023-09-21T12:47:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.323+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f0b8c062410 con 0x7f0b8c07bed0 2023-09-21T12:47:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.323+0000 7f0b837fe700 1 -- 172.21.15.142:0/2857185639 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f0b88018350 con 0x7f0b8c07bed0 2023-09-21T12:47:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 msgr2=0x7f0b7803aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 0x7f0b7803aa20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0b7c006fd0 tx=0x7f0b7c006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:47.754 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 msgr2=0x7f0b8c19c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:47.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0b88000c00 tx=0x7f0b88011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:47.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 shutdown_connections 2023-09-21T12:47:47.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0b78038560 0x7f0b7803aa20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:47.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 --2- 172.21.15.142:0/2857185639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0b8c07bed0 0x7f0b8c19c750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:47.755 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 >> 172.21.15.142:0/2857185639 conn(0x7f0b8c101ba0 msgr2=0x7f0b8c102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:47.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 shutdown_connections 2023-09-21T12:47:47.756 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:47.326+0000 7f0b9442a700 1 -- 172.21.15.142:0/2857185639 wait complete. 2023-09-21T12:47:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:47 smithi142 ceph-mon[97663]: mgrmap e13: x(active, since 6s) 2023-09-21T12:47:49.024 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.283+0000 7f7b90616700 1 Processor -- start 2023-09-21T12:47:49.024 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.283+0000 7f7b90616700 1 -- start start 2023-09-21T12:47:49.024 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.284+0000 7f7b90616700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:49.025 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.284+0000 7f7b90616700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88106ff0 con 0x7f7b88106600 2023-09-21T12:47:49.025 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.284+0000 7f7b8e3b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:49.025 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.284+0000 7f7b8e3b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48086/0 (socket says 172.21.15.142:48086) 2023-09-21T12:47:49.025 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.284+0000 7f7b8e3b2700 1 -- 172.21.15.142:0/1926929543 learned_addr learned my addr 172.21.15.142:0/1926929543 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:49.025 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.285+0000 7f7b8e3b2700 1 -- 172.21.15.142:0/1926929543 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88107800 con 0x7f7b88106600 2023-09-21T12:47:49.026 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.285+0000 7f7b8e3b2700 1 --2- 172.21.15.142:0/1926929543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b840098a0 tx=0x7f7b84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72777cfe3b821aba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:49.026 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.285+0000 7f7b8d3b0700 1 -- 172.21.15.142:0/1926929543 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b84004160 con 0x7f7b88106600 2023-09-21T12:47:49.026 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.285+0000 7f7b8d3b0700 1 -- 172.21.15.142:0/1926929543 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b840042c0 con 0x7f7b88106600 2023-09-21T12:47:49.026 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.285+0000 7f7b8d3b0700 1 -- 172.21.15.142:0/1926929543 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b840119b0 con 0x7f7b88106600 2023-09-21T12:47:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 -- 172.21.15.142:0/1926929543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 msgr2=0x7f7b88106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 --2- 172.21.15.142:0/1926929543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7b840098a0 tx=0x7f7b84009bb0 comp rx=0 tx=0).stop 2023-09-21T12:47:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 -- 172.21.15.142:0/1926929543 shutdown_connections 2023-09-21T12:47:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 --2- 172.21.15.142:0/1926929543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b88106a20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:49.027 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 -- 172.21.15.142:0/1926929543 >> 172.21.15.142:0/1926929543 conn(0x7f7b88101ba0 msgr2=0x7f7b88103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 -- 172.21.15.142:0/1926929543 shutdown_connections 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.286+0000 7f7b90616700 1 -- 172.21.15.142:0/1926929543 wait complete. 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.287+0000 7f7b90616700 1 Processor -- start 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.287+0000 7f7b90616700 1 -- start start 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b90616700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:49.028 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b90616700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8807c1a0 con 0x7f7b88106600 2023-09-21T12:47:49.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b8e3b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:49.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b8e3b2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48094/0 (socket says 172.21.15.142:48094) 2023-09-21T12:47:49.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b8e3b2700 1 -- 172.21.15.142:0/1925016975 learned_addr learned my addr 172.21.15.142:0/1925016975 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:49.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.288+0000 7f7b8e3b2700 1 -- 172.21.15.142:0/1925016975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009550 con 0x7f7b88106600 2023-09-21T12:47:49.029 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b8e3b2700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:49.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b840039f0 con 0x7f7b88106600 2023-09-21T12:47:49.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b84003b50 con 0x7f7b88106600 2023-09-21T12:47:49.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b8401a780 con 0x7f7b88106600 2023-09-21T12:47:49.030 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8807a2b0 con 0x7f7b88106600 2023-09-21T12:47:49.031 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.289+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8807a6d0 con 0x7f7b88106600 2023-09-21T12:47:49.031 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.290+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f7b84024440 con 0x7f7b88106600 2023-09-21T12:47:49.031 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.290+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8807b0e0 con 0x7f7b88106600 2023-09-21T12:47:49.031 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.291+0000 7f7b7f7fe700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 0x7f7b7403a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:49.031 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.291+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7b8404c5e0 con 0x7f7b88106600 2023-09-21T12:47:49.032 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.291+0000 7f7b8dbb1700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 0x7f7b7403a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:49.032 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.292+0000 7f7b8dbb1700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 0x7f7b7403a9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b78006fd0 tx=0x7f7b78006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:49.032 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.296+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7b84018db0 con 0x7f7b88106600 2023-09-21T12:47:49.032 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.601+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f7b880746d0 con 0x7f7b88106600 2023-09-21T12:47:49.032 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.604+0000 7f7b7f7fe700 1 -- 172.21.15.142:0/1925016975 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f7b84018350 con 0x7f7b88106600 2023-09-21T12:47:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 msgr2=0x7f7b7403a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 0x7f7b7403a9d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b78006fd0 tx=0x7f7b78006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 msgr2=0x7f7b8807bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000c00 tx=0x7f7b84011a30 comp rx=0 tx=0).stop 2023-09-21T12:47:49.033 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 shutdown_connections 2023-09-21T12:47:49.034 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7b74038510 0x7f7b7403a9d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:49.034 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 --2- 172.21.15.142:0/1925016975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b88106600 0x7f7b8807bc60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:49.034 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 >> 172.21.15.142:0/1925016975 conn(0x7f7b88101ba0 msgr2=0x7f7b88102aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:49.034 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 shutdown_connections 2023-09-21T12:47:49.034 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr 2023-09-21T12:47:48.607+0000 7f7b90616700 1 -- 172.21.15.142:0/1925016975 wait complete. 2023-09-21T12:47:49.035 INFO:teuthology.orchestra.run.smithi142.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-09-21T12:47:49.035 INFO:teuthology.orchestra.run.smithi142.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-09-21T12:47:49.035 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.035 INFO:teuthology.orchestra.run.smithi142.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-09-21T12:47:49.035 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.036 INFO:teuthology.orchestra.run.smithi142.stdout:Or, if you are only running a single cluster on this host: 2023-09-21T12:47:49.036 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.036 INFO:teuthology.orchestra.run.smithi142.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-09-21T12:47:49.036 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.036 INFO:teuthology.orchestra.run.smithi142.stdout:Please consider enabling telemetry to help improve Ceph: 2023-09-21T12:47:49.037 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.037 INFO:teuthology.orchestra.run.smithi142.stdout: ceph telemetry on 2023-09-21T12:47:49.037 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.037 INFO:teuthology.orchestra.run.smithi142.stdout:For more information see: 2023-09-21T12:47:49.037 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.038 INFO:teuthology.orchestra.run.smithi142.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-09-21T12:47:49.038 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:47:49.038 INFO:teuthology.orchestra.run.smithi142.stdout:Bootstrap complete. 2023-09-21T12:47:49.084 INFO:tasks.cephadm:Fetching config... 2023-09-21T12:47:49.084 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:47:49.085 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-09-21T12:47:49.128 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-09-21T12:47:49.128 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:47:49.129 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-09-21T12:47:49.216 INFO:tasks.cephadm:Fetching mon keyring... 2023-09-21T12:47:49.216 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:47:49.217 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/keyring of=/dev/stdout 2023-09-21T12:47:49.326 INFO:tasks.cephadm:Fetching pub ssh key... 2023-09-21T12:47:49.327 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:47:49.327 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-09-21T12:47:49.412 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-09-21T12:47:49.412 DEBUG:teuthology.orchestra.run.smithi142:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-21T12:47:49.554 INFO:teuthology.orchestra.run.smithi142.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:49.585 DEBUG:teuthology.orchestra.run.smithi156:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-21T12:47:49.631 INFO:teuthology.orchestra.run.smithi156.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:49.644 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-21T12:47:49.688 INFO:teuthology.orchestra.run.smithi160.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+Z4EZLi1CfyP3pVZS1j4Fr84+b5kV066H8udaNwtGO+TX+8g1RCqggEbju0G0kHV6Vg82s9BEoDbsYBWW+dMsD6P587hU298CvY5JvQuupOO1j8o6iSiLS+AhGxqkKoIK66O95hJrBjQ49t1GH9Dx6+IW61tBe4fKemKo2lUi5+sI0h7GOyPIDx/hedbUavCQyxCxSldsqjqd+WrIgBGdL3hV6j99xAQLAPeoiusk7kp6OIoEgU9MukPXv6nOeqW6AarIfvxjRnNmTT4zUFFnGB02QzhapZlmUotcgDli1EwTFIj0x6wRvfttpSnklgAzLwKCILyCV/FfkdJy//t8sL+Wymtv8dhK+tPPKJPQklH5cM4h2dbdiBTMGxzldS3jPuLrYiWeKIFoumPUHIWXFTzIaWPtZt70AO20Et+eKqPB2y+UOJ/9JaeMLpiM3xS2Kx5tsIJcaXBughZQFXfY3PDHoW0VnCI3Wv4qtLwTwjGSoBQseJkJT3q8N/8mt58= ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:47:49.701 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-09-21T12:47:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:49 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1925016975' entity='client.admin' 2023-09-21T12:47:50.449 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:47:52.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 -- 172.21.15.142:0/2534311109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 msgr2=0x7fda34100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:52.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 --2- 172.21.15.142:0/2534311109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34100d20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fda30009910 tx=0x7fda30009c20 comp rx=0 tx=0).stop 2023-09-21T12:47:52.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 -- 172.21.15.142:0/2534311109 shutdown_connections 2023-09-21T12:47:52.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 --2- 172.21.15.142:0/2534311109 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34100d20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:52.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 -- 172.21.15.142:0/2534311109 >> 172.21.15.142:0/2534311109 conn(0x7fda340fbe80 msgr2=0x7fda340fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:52.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 -- 172.21.15.142:0/2534311109 shutdown_connections 2023-09-21T12:47:52.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.273+0000 7fda3b53c700 1 -- 172.21.15.142:0/2534311109 wait complete. 2023-09-21T12:47:52.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda3b53c700 1 Processor -- start 2023-09-21T12:47:52.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda3b53c700 1 -- start start 2023-09-21T12:47:52.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda3b53c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:52.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda3b53c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda340750c0 con 0x7fda34100900 2023-09-21T12:47:52.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda392d8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:52.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda392d8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48112/0 (socket says 172.21.15.142:48112) 2023-09-21T12:47:52.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.274+0000 7fda392d8700 1 -- 172.21.15.142:0/3226258639 learned_addr learned my addr 172.21.15.142:0/3226258639 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:52.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda392d8700 1 -- 172.21.15.142:0/3226258639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300095f0 con 0x7fda34100900 2023-09-21T12:47:52.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda392d8700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda30006010 tx=0x7fda300057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:52.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda3001d070 con 0x7fda34100900 2023-09-21T12:47:52.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda300044e0 con 0x7fda34100900 2023-09-21T12:47:52.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340731d0 con 0x7fda34100900 2023-09-21T12:47:52.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fda300039b0 con 0x7fda34100900 2023-09-21T12:47:52.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.275+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34073610 con 0x7fda34100900 2023-09-21T12:47:52.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.277+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7fda3000baf0 con 0x7fda34100900 2023-09-21T12:47:52.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.277+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34062410 con 0x7fda34100900 2023-09-21T12:47:52.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.277+0000 7fda2a7fc700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 0x7fda2003a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:52.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.277+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fda3004c3e0 con 0x7fda34100900 2023-09-21T12:47:52.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.278+0000 7fda38ad7700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 0x7fda2003a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:52.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.278+0000 7fda38ad7700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 0x7fda2003a910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda24006fd0 tx=0x7fda24006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:52.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.282+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fda3002a950 con 0x7fda34100900 2023-09-21T12:47:52.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.499+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fda34106650 con 0x7fda34100900 2023-09-21T12:47:52.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.505+0000 7fda2a7fc700 1 -- 172.21.15.142:0/3226258639 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fda3002a360 con 0x7fda34100900 2023-09-21T12:47:52.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 msgr2=0x7fda2003a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 0x7fda2003a910 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda24006fd0 tx=0x7fda24006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 msgr2=0x7fda34074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda30006010 tx=0x7fda300057c0 comp rx=0 tx=0).stop 2023-09-21T12:47:52.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 shutdown_connections 2023-09-21T12:47:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda20038450 0x7fda2003a910 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 --2- 172.21.15.142:0/3226258639 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda34100900 0x7fda34074b80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 >> 172.21.15.142:0/3226258639 conn(0x7fda340fbe80 msgr2=0x7fda340fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 shutdown_connections 2023-09-21T12:47:52.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:52.508+0000 7fda3b53c700 1 -- 172.21.15.142:0/3226258639 wait complete. 2023-09-21T12:47:53.054 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:53.055 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:53.055 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi142", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:47:53.055 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:53.055 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:53.056 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:53.056 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3226258639' entity='client.admin' 2023-09-21T12:47:53.056 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:53.056 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:53.086 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-09-21T12:47:53.087 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-09-21T12:47:53.731 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:47:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 -- 172.21.15.142:0/1135914165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 msgr2=0x7fb230073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 --2- 172.21.15.142:0/1135914165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230073270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb220009910 tx=0x7fb220009c20 comp rx=0 tx=0).stop 2023-09-21T12:47:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 -- 172.21.15.142:0/1135914165 shutdown_connections 2023-09-21T12:47:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 --2- 172.21.15.142:0/1135914165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230073270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:55.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 -- 172.21.15.142:0/1135914165 >> 172.21.15.142:0/1135914165 conn(0x7fb2300fbe80 msgr2=0x7fb2300fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:55.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 -- 172.21.15.142:0/1135914165 shutdown_connections 2023-09-21T12:47:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.662+0000 7fb236636700 1 -- 172.21.15.142:0/1135914165 wait complete. 2023-09-21T12:47:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb236636700 1 Processor -- start 2023-09-21T12:47:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb236636700 1 -- start start 2023-09-21T12:47:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb236636700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:55.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb236636700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb230198180 con 0x7fb230074e10 2023-09-21T12:47:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb22ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46322/0 (socket says 172.21.15.142:46322) 2023-09-21T12:47:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.664+0000 7fb22ffff700 1 -- 172.21.15.142:0/2784528892 learned_addr learned my addr 172.21.15.142:0/2784528892 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb22ffff700 1 -- 172.21.15.142:0/2784528892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2200095f0 con 0x7fb230074e10 2023-09-21T12:47:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb22ffff700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb220006010 tx=0x7fb2200057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb22001d070 con 0x7fb230074e10 2023-09-21T12:47:55.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb2200044e0 con 0x7fb230074e10 2023-09-21T12:47:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb230198380 con 0x7fb230074e10 2023-09-21T12:47:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb2200039b0 con 0x7fb230074e10 2023-09-21T12:47:55.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.665+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2301987c0 con 0x7fb230074e10 2023-09-21T12:47:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.666+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7fb22000baf0 con 0x7fb230074e10 2023-09-21T12:47:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.666+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb230191620 con 0x7fb230074e10 2023-09-21T12:47:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.667+0000 7fb22d7fa700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 0x7fb21803a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.667+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb22004c510 con 0x7fb230074e10 2023-09-21T12:47:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.667+0000 7fb22f7fe700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 0x7fb21803a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:55.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.668+0000 7fb22f7fe700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 0x7fb21803a8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:55.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.672+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb22002a930 con 0x7fb230074e10 2023-09-21T12:47:55.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.875+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb23002d120 con 0x7fb218038400 2023-09-21T12:47:55.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.881+0000 7fb22d7fa700 1 -- 172.21.15.142:0/2784528892 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb23002d120 con 0x7fb218038400 2023-09-21T12:47:55.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 msgr2=0x7fb21803a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 0x7fb21803a8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb224006fd0 tx=0x7fb224006e40 comp rx=0 tx=0).stop 2023-09-21T12:47:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 msgr2=0x7fb230197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:55.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb220006010 tx=0x7fb2200057c0 comp rx=0 tx=0).stop 2023-09-21T12:47:55.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 shutdown_connections 2023-09-21T12:47:55.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.884+0000 7fb236636700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb218038400 0x7fb21803a8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:55.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.885+0000 7fb236636700 1 --2- 172.21.15.142:0/2784528892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb230074e10 0x7fb230197c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:55.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.885+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 >> 172.21.15.142:0/2784528892 conn(0x7fb2300fbe80 msgr2=0x7fb2300fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:55.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.885+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 shutdown_connections 2023-09-21T12:47:55.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:55.885+0000 7fb236636700 1 -- 172.21.15.142:0/2784528892 wait complete. 2023-09-21T12:47:56.399 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi156 2023-09-21T12:47:56.400 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:47:56.400 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.conf 2023-09-21T12:47:56.421 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:47:56.421 DEBUG:teuthology.orchestra.run.smithi156:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:47:56.480 INFO:tasks.cephadm:Adding host smithi156 to orchestrator... 2023-09-21T12:47:56.480 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch host add smithi156 2023-09-21T12:47:57.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:47:57.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:47:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:47:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:47:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: Updating smithi142:/etc/ceph/ceph.conf 2023-09-21T12:47:57.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:56 smithi142 ceph-mon[97663]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:47:57.238 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:47:58.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:57 smithi142 ceph-mon[97663]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:47:58.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:57 smithi142 ceph-mon[97663]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:47:58.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.726+0000 7f8a16aa4700 1 -- 172.21.15.142:0/1212593688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 msgr2=0x7f8a10073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:47:58.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.726+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/1212593688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a10073560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8a04009910 tx=0x7f8a04009c20 comp rx=0 tx=0).stop 2023-09-21T12:47:58.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.726+0000 7f8a16aa4700 1 -- 172.21.15.142:0/1212593688 shutdown_connections 2023-09-21T12:47:58.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.726+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/1212593688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a10073560 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:47:58.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.726+0000 7f8a16aa4700 1 -- 172.21.15.142:0/1212593688 >> 172.21.15.142:0/1212593688 conn(0x7f8a100fc3d0 msgr2=0x7f8a100fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:47:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.727+0000 7f8a16aa4700 1 -- 172.21.15.142:0/1212593688 shutdown_connections 2023-09-21T12:47:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.727+0000 7f8a16aa4700 1 -- 172.21.15.142:0/1212593688 wait complete. 2023-09-21T12:47:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.727+0000 7f8a16aa4700 1 Processor -- start 2023-09-21T12:47:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a16aa4700 1 -- start start 2023-09-21T12:47:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a16aa4700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:58.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a16aa4700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1019c850 con 0x7f8a10073180 2023-09-21T12:47:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a14840700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:58.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a14840700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46342/0 (socket says 172.21.15.142:46342) 2023-09-21T12:47:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.728+0000 7f8a14840700 1 -- 172.21.15.142:0/2150157383 learned_addr learned my addr 172.21.15.142:0/2150157383 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:47:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a14840700 1 -- 172.21.15.142:0/2150157383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a040095f0 con 0x7f8a10073180 2023-09-21T12:47:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a14840700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a04006010 tx=0x7f8a04004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a0401d070 con 0x7f8a10073180 2023-09-21T12:47:58.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a040044a0 con 0x7f8a10073180 2023-09-21T12:47:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1019cab0 con 0x7f8a10073180 2023-09-21T12:47:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8a040039b0 con 0x7f8a10073180 2023-09-21T12:47:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.729+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1019cf30 con 0x7f8a10073180 2023-09-21T12:47:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.730+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f8a04003ba0 con 0x7f8a10073180 2023-09-21T12:47:58.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.730+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a10062410 con 0x7f8a10073180 2023-09-21T12:47:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.731+0000 7f8a0dffb700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 0x7f8a0003a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:47:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.731+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8a0404c1b0 con 0x7f8a10073180 2023-09-21T12:47:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.731+0000 7f8a0ffff700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 0x7f8a0003a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:47:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.731+0000 7f8a0ffff700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 0x7f8a0003a910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f89fc006fd0 tx=0x7f89fc006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:47:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.736+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8a04029540 con 0x7f8a10073180 2023-09-21T12:47:58.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:47:58.937+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a100008d0 con 0x7f8a00038450 2023-09-21T12:47:59.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:59.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:47:59.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:47:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:00.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:00 smithi142 ceph-mon[97663]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi156", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:00.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:00 smithi142 ceph-mon[97663]: Deploying cephadm binary to smithi156 2023-09-21T12:48:01.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.315+0000 7f8a0dffb700 1 -- 172.21.15.142:0/2150157383 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8a100008d0 con 0x7f8a00038450 2023-09-21T12:48:01.315 INFO:teuthology.orchestra.run.smithi142.stdout:Added host 'smithi156' with addr '172.21.15.156' 2023-09-21T12:48:01.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 msgr2=0x7f8a0003a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:01.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 0x7f8a0003a910 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f89fc006fd0 tx=0x7f89fc006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:01.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 msgr2=0x7f8a1019c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:01.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a04006010 tx=0x7f8a04004ff0 comp rx=0 tx=0).stop 2023-09-21T12:48:01.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 shutdown_connections 2023-09-21T12:48:01.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8a00038450 0x7f8a0003a910 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:01.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 --2- 172.21.15.142:0/2150157383 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8a10073180 0x7f8a1019c310 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:01.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.317+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 >> 172.21.15.142:0/2150157383 conn(0x7f8a100fc3d0 msgr2=0x7f8a100fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:01.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.318+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 shutdown_connections 2023-09-21T12:48:01.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:01.318+0000 7f8a16aa4700 1 -- 172.21.15.142:0/2150157383 wait complete. 2023-09-21T12:48:01.825 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch host ls --format=json 2023-09-21T12:48:01.888 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:01 smithi142 ceph-mon[97663]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:01.888 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:01.888 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:02.548 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:02.964 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:02 smithi142 ceph-mon[97663]: Added host smithi156 2023-09-21T12:48:02.965 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:02.965 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:03.767 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:03 smithi142 ceph-mon[97663]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:03.767 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:04.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.013+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/963998127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 msgr2=0x7f0dd4106bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:04.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.013+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/963998127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4106bf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009910 tx=0x7f0dd0009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:04.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.014+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/963998127 shutdown_connections 2023-09-21T12:48:04.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.014+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/963998127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4106bf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:04.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.014+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/963998127 >> 172.21.15.142:0/963998127 conn(0x7f0dd40fc340 msgr2=0x7f0dd40fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:04.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.014+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/963998127 shutdown_connections 2023-09-21T12:48:04.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.014+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/963998127 wait complete. 2023-09-21T12:48:04.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0ddbc9f700 1 Processor -- start 2023-09-21T12:48:04.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0ddbc9f700 1 -- start start 2023-09-21T12:48:04.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0ddbc9f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:04.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0ddbc9f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd4198400 con 0x7f0dd4106810 2023-09-21T12:48:04.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0dd9a3b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:04.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0dd9a3b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34358/0 (socket says 172.21.15.142:34358) 2023-09-21T12:48:04.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.015+0000 7f0dd9a3b700 1 -- 172.21.15.142:0/1058273318 learned_addr learned my addr 172.21.15.142:0/1058273318 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:04.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0dd9a3b700 1 -- 172.21.15.142:0/1058273318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00095f0 con 0x7f0dd4106810 2023-09-21T12:48:04.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0dd9a3b700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006010 tx=0x7f0dd0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:04.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dd001d070 con 0x7f0dd4106810 2023-09-21T12:48:04.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd4198660 con 0x7f0dd4106810 2023-09-21T12:48:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0dd000bbb0 con 0x7f0dd4106810 2023-09-21T12:48:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0dd0003930 con 0x7f0dd4106810 2023-09-21T12:48:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.016+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd4198ae0 con 0x7f0dd4106810 2023-09-21T12:48:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.017+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f0dd0003b70 con 0x7f0dd4106810 2023-09-21T12:48:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.017+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd4062410 con 0x7f0dd4106810 2023-09-21T12:48:04.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.018+0000 7f0dcaffd700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 0x7f0dc003a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:04.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.018+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0dd004c110 con 0x7f0dd4106810 2023-09-21T12:48:04.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.018+0000 7f0dd923a700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 0x7f0dc003a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:04.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.019+0000 7f0dd923a700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 0x7f0dc003a8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006fd0 tx=0x7f0dc4006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:04.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.023+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0dd0029540 con 0x7f0dd4106810 2023-09-21T12:48:04.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.229+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dd40008d0 con 0x7f0dc0038400 2023-09-21T12:48:04.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.231+0000 7f0dcaffd700 1 -- 172.21.15.142:0/1058273318 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f0dd40008d0 con 0x7f0dc0038400 2023-09-21T12:48:04.230 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:48:04.231 INFO:teuthology.orchestra.run.smithi142.stdout:[{"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}] 2023-09-21T12:48:04.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 msgr2=0x7f0dc003a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:04.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 0x7f0dc003a8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4006fd0 tx=0x7f0dc4006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:04.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 msgr2=0x7f0dd4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:04.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0006010 tx=0x7f0dd0004ff0 comp rx=0 tx=0).stop 2023-09-21T12:48:04.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 shutdown_connections 2023-09-21T12:48:04.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0dc0038400 0x7f0dc003a8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:04.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 --2- 172.21.15.142:0/1058273318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dd4106810 0x7f0dd4197ec0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:04.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 >> 172.21.15.142:0/1058273318 conn(0x7f0dd40fc340 msgr2=0x7f0dd4108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:04.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 shutdown_connections 2023-09-21T12:48:04.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:04.233+0000 7f0ddbc9f700 1 -- 172.21.15.142:0/1058273318 wait complete. 2023-09-21T12:48:04.726 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi160 2023-09-21T12:48:04.726 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:48:04.727 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.conf 2023-09-21T12:48:04.747 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:48:04.748 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:04.807 INFO:tasks.cephadm:Adding host smithi160 to orchestrator... 2023-09-21T12:48:04.808 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch host add smithi160 2023-09-21T12:48:05.529 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:06.088 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:05 smithi142 ceph-mon[97663]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:48:06.088 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:05 smithi142 ceph-mon[97663]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:07.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.045+0000 7f15130e0700 1 -- 172.21.15.142:0/1038065483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 msgr2=0x7f150c0735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.045+0000 7f15130e0700 1 --2- 172.21.15.142:0/1038065483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c0735f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1500009910 tx=0x7f1500009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.045+0000 7f15130e0700 1 -- 172.21.15.142:0/1038065483 shutdown_connections 2023-09-21T12:48:07.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.045+0000 7f15130e0700 1 --2- 172.21.15.142:0/1038065483 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c0735f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:07.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.045+0000 7f15130e0700 1 -- 172.21.15.142:0/1038065483 >> 172.21.15.142:0/1038065483 conn(0x7f150c0fc3d0 msgr2=0x7f150c0fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:07.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.046+0000 7f15130e0700 1 -- 172.21.15.142:0/1038065483 shutdown_connections 2023-09-21T12:48:07.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.046+0000 7f15130e0700 1 -- 172.21.15.142:0/1038065483 wait complete. 2023-09-21T12:48:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.047+0000 7f15130e0700 1 Processor -- start 2023-09-21T12:48:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.047+0000 7f15130e0700 1 -- start start 2023-09-21T12:48:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f15130e0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f15130e0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150c1984d0 con 0x7f150c073210 2023-09-21T12:48:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f1510e7c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f1510e7c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34374/0 (socket says 172.21.15.142:34374) 2023-09-21T12:48:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f1510e7c700 1 -- 172.21.15.142:0/350648171 learned_addr learned my addr 172.21.15.142:0/350648171 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.048+0000 7f1510e7c700 1 -- 172.21.15.142:0/350648171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15000095f0 con 0x7f150c073210 2023-09-21T12:48:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f1510e7c700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1500006010 tx=0x7f1500004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f150001d070 con 0x7f150c073210 2023-09-21T12:48:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150c1986d0 con 0x7f150c073210 2023-09-21T12:48:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15000044a0 con 0x7f150c073210 2023-09-21T12:48:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1500003a70 con 0x7f150c073210 2023-09-21T12:48:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.049+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150c198af0 con 0x7f150c073210 2023-09-21T12:48:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.050+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f1500003cb0 con 0x7f150c073210 2023-09-21T12:48:07.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.050+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150c062410 con 0x7f150c073210 2023-09-21T12:48:07.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.050+0000 7f1509ffb700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 0x7f14fc03a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:07.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.050+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f150004c230 con 0x7f150c073210 2023-09-21T12:48:07.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.051+0000 7f150bfff700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 0x7f14fc03a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:07.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.051+0000 7f150bfff700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 0x7f14fc03a8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14f8006fd0 tx=0x7f14f8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:07.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.056+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1500005c00 con 0x7f150c073210 2023-09-21T12:48:07.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:07.265+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}) v1 -- 0x7f150c10cf60 con 0x7f14fc038400 2023-09-21T12:48:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:48:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:07.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:08.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:08 smithi142 ceph-mon[97663]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:08.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:08 smithi142 ceph-mon[97663]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:08.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:08 smithi142 ceph-mon[97663]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:08.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:08 smithi142 ceph-mon[97663]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:09.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.638+0000 7f1509ffb700 1 -- 172.21.15.142:0/350648171 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f150c10cf60 con 0x7f14fc038400 2023-09-21T12:48:09.640 INFO:teuthology.orchestra.run.smithi142.stdout:Added host 'smithi160' with addr '172.21.15.160' 2023-09-21T12:48:09.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 msgr2=0x7f14fc03a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 0x7f14fc03a8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f14f8006fd0 tx=0x7f14f8006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 msgr2=0x7f150c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:09.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1500006010 tx=0x7f1500004ff0 comp rx=0 tx=0).stop 2023-09-21T12:48:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 shutdown_connections 2023-09-21T12:48:09.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f14fc038400 0x7f14fc03a8c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:09.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 --2- 172.21.15.142:0/350648171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f150c073210 0x7f150c197f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:09.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.641+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 >> 172.21.15.142:0/350648171 conn(0x7f150c0fc3d0 msgr2=0x7f150c1073c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:09.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.642+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 shutdown_connections 2023-09-21T12:48:09.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:09.642+0000 7f15130e0700 1 -- 172.21.15.142:0/350648171 wait complete. 2023-09-21T12:48:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:09 smithi142 ceph-mon[97663]: Deploying cephadm binary to smithi160 2023-09-21T12:48:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:09 smithi142 ceph-mon[97663]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:10.110 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch host ls --format=json 2023-09-21T12:48:10.833 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:10.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:10.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:10 smithi142 ceph-mon[97663]: Added host smithi160 2023-09-21T12:48:10.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:10.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:12.067 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:11 smithi142 ceph-mon[97663]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:12.068 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:12.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 -- 172.21.15.142:0/3702823604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 msgr2=0x7f6324106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:12.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 --2- 172.21.15.142:0/3702823604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f6324106c60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6314009910 tx=0x7f6314009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:12.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 -- 172.21.15.142:0/3702823604 shutdown_connections 2023-09-21T12:48:12.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 --2- 172.21.15.142:0/3702823604 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f6324106c60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:12.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 -- 172.21.15.142:0/3702823604 >> 172.21.15.142:0/3702823604 conn(0x7f63240fc3d0 msgr2=0x7f63240fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:12.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 -- 172.21.15.142:0/3702823604 shutdown_connections 2023-09-21T12:48:12.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.314+0000 7f632940e700 1 -- 172.21.15.142:0/3702823604 wait complete. 2023-09-21T12:48:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.315+0000 7f632940e700 1 Processor -- start 2023-09-21T12:48:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.315+0000 7f632940e700 1 -- start start 2023-09-21T12:48:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.315+0000 7f632940e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f632940e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6324075060 con 0x7f6324106880 2023-09-21T12:48:12.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:12.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f6322ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:34388/0 (socket says 172.21.15.142:34388) 2023-09-21T12:48:12.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f6322ffd700 1 -- 172.21.15.142:0/519925059 learned_addr learned my addr 172.21.15.142:0/519925059 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:12.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f6322ffd700 1 -- 172.21.15.142:0/519925059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63140095f0 con 0x7f6324106880 2023-09-21T12:48:12.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.316+0000 7f6322ffd700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6314006010 tx=0x7f6314004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:12.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.317+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f631401d070 con 0x7f6324106880 2023-09-21T12:48:12.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.317+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6324073620 con 0x7f6324106880 2023-09-21T12:48:12.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.317+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f631400bc10 con 0x7f6324106880 2023-09-21T12:48:12.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.317+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6314003910 con 0x7f6324106880 2023-09-21T12:48:12.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.317+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6324073aa0 con 0x7f6324106880 2023-09-21T12:48:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.318+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6324104b30 con 0x7f6324106880 2023-09-21T12:48:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.318+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f631400bd80 con 0x7f6324106880 2023-09-21T12:48:12.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.318+0000 7f630bfff700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 0x7f630c03a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.318+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f631404c140 con 0x7f6324106880 2023-09-21T12:48:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.319+0000 7f63227fc700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 0x7f630c03a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:12.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.319+0000 7f63227fc700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 0x7f630c03a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6318006fd0 tx=0x7f6318006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:12.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.324+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f631402abb0 con 0x7f6324106880 2023-09-21T12:48:12.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.530+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6324073da0 con 0x7f630c038450 2023-09-21T12:48:12.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.531+0000 7f630bfff700 1 -- 172.21.15.142:0/519925059 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7f6324073da0 con 0x7f630c038450 2023-09-21T12:48:12.531 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:48:12.531 INFO:teuthology.orchestra.run.smithi142.stdout:[{"addr": "172.21.15.142", "hostname": "smithi142", "labels": [], "status": ""}, {"addr": "172.21.15.156", "hostname": "smithi156", "labels": [], "status": ""}, {"addr": "172.21.15.160", "hostname": "smithi160", "labels": [], "status": ""}] 2023-09-21T12:48:12.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 msgr2=0x7f630c03a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:12.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 0x7f630c03a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6318006fd0 tx=0x7f6318006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:12.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 msgr2=0x7f63240730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:12.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6314006010 tx=0x7f6314004ff0 comp rx=0 tx=0).stop 2023-09-21T12:48:12.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 shutdown_connections 2023-09-21T12:48:12.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f630c038450 0x7f630c03a910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:12.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 --2- 172.21.15.142:0/519925059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6324106880 0x7f63240730e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:12.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 >> 172.21.15.142:0/519925059 conn(0x7f63240fc3d0 msgr2=0x7f6324108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:12.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 shutdown_connections 2023-09-21T12:48:12.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:12.534+0000 7f632940e700 1 -- 172.21.15.142:0/519925059 wait complete. 2023-09-21T12:48:13.008 INFO:tasks.cephadm:Setting crush tunables to default 2023-09-21T12:48:13.009 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd crush tunables default 2023-09-21T12:48:13.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:12 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:13.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:12 smithi142 ceph-mon[97663]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:13.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:12 smithi142 ceph-mon[97663]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:48:13.740 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:15.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 -- 172.21.15.142:0/2502796697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 msgr2=0x7f7d54106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/2502796697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54106c60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7d48009910 tx=0x7f7d48009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 -- 172.21.15.142:0/2502796697 shutdown_connections 2023-09-21T12:48:15.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/2502796697 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54106c60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 -- 172.21.15.142:0/2502796697 >> 172.21.15.142:0/2502796697 conn(0x7f7d540fc3d0 msgr2=0x7f7d540fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 -- 172.21.15.142:0/2502796697 shutdown_connections 2023-09-21T12:48:15.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.135+0000 7f7d5ad73700 1 -- 172.21.15.142:0/2502796697 wait complete. 2023-09-21T12:48:15.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.136+0000 7f7d5ad73700 1 Processor -- start 2023-09-21T12:48:15.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d5ad73700 1 -- start start 2023-09-21T12:48:15.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d5ad73700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:15.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d5ad73700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d54198430 con 0x7f7d54106880 2023-09-21T12:48:15.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d58b0f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:15.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d58b0f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:44278/0 (socket says 172.21.15.142:44278) 2023-09-21T12:48:15.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.137+0000 7f7d58b0f700 1 -- 172.21.15.142:0/245112296 learned_addr learned my addr 172.21.15.142:0/245112296 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:15.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d58b0f700 1 -- 172.21.15.142:0/245112296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d480095f0 con 0x7f7d54106880 2023-09-21T12:48:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d58b0f700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006010 tx=0x7f7d48004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d4801d070 con 0x7f7d54106880 2023-09-21T12:48:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4800bbb0 con 0x7f7d54106880 2023-09-21T12:48:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7d48003930 con 0x7f7d54106880 2023-09-21T12:48:15.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d54198690 con 0x7f7d54106880 2023-09-21T12:48:15.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.138+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d54198b10 con 0x7f7d54106880 2023-09-21T12:48:15.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.139+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f7d4800bd20 con 0x7f7d54106880 2023-09-21T12:48:15.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.139+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d54062410 con 0x7f7d54106880 2023-09-21T12:48:15.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.140+0000 7f7d51ffb700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 0x7f7d4403a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:15.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.140+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7d4804c170 con 0x7f7d54106880 2023-09-21T12:48:15.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.140+0000 7f7d53fff700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 0x7f7d4403a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.141+0000 7f7d53fff700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 0x7f7d4403a8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006fd0 tx=0x7f7d40006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:15.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.145+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7d48029770 con 0x7f7d54106880 2023-09-21T12:48:15.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:15.354+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7d540008d0 con 0x7f7d54106880 2023-09-21T12:48:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:15.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:16.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.358+0000 7f7d51ffb700 1 -- 172.21.15.142:0/245112296 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7d48026020 con 0x7f7d54106880 2023-09-21T12:48:16.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 msgr2=0x7f7d4403a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:16.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 0x7f7d4403a8c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7d40006fd0 tx=0x7f7d40006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:16.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 msgr2=0x7f7d54197ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:16.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7d48006010 tx=0x7f7d48004ff0 comp rx=0 tx=0).stop 2023-09-21T12:48:16.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 shutdown_connections 2023-09-21T12:48:16.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7d44038400 0x7f7d4403a8c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:16.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 --2- 172.21.15.142:0/245112296 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d54106880 0x7f7d54197ef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:16.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 >> 172.21.15.142:0/245112296 conn(0x7f7d540fc3d0 msgr2=0x7f7d54108c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:16.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 shutdown_connections 2023-09-21T12:48:16.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:16.360+0000 7f7d5ad73700 1 -- 172.21.15.142:0/245112296 wait complete. 2023-09-21T12:48:16.362 INFO:teuthology.orchestra.run.smithi142.stderr:adjusted tunables profile to default 2023-09-21T12:48:16.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:48:16.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-21T12:48:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:16.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:16 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:16.917 INFO:tasks.cephadm:Adding mon.a on smithi142 2023-09-21T12:48:16.917 INFO:tasks.cephadm:Adding mon.b on smithi156 2023-09-21T12:48:16.917 INFO:tasks.cephadm:Adding mon.c on smithi160 2023-09-21T12:48:16.918 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch apply mon '3;smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c' 2023-09-21T12:48:17.517 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:17.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:17 smithi142 ceph-mon[97663]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:17.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:17 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-21T12:48:17.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:17 smithi142 ceph-mon[97663]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:18.727 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 -- 172.21.15.160:0/2306189150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 msgr2=0x7f904c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:18.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 --2- 172.21.15.160:0/2306189150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c105b40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9040009910 tx=0x7f9040009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:18.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 -- 172.21.15.160:0/2306189150 shutdown_connections 2023-09-21T12:48:18.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 --2- 172.21.15.160:0/2306189150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c105b40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:18.728 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 -- 172.21.15.160:0/2306189150 >> 172.21.15.160:0/2306189150 conn(0x7f904c0fb270 msgr2=0x7f904c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:18.729 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 -- 172.21.15.160:0/2306189150 shutdown_connections 2023-09-21T12:48:18.729 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.727+0000 7f90508ba700 1 -- 172.21.15.160:0/2306189150 wait complete. 2023-09-21T12:48:18.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.728+0000 7f90508ba700 1 Processor -- start 2023-09-21T12:48:18.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.728+0000 7f90508ba700 1 -- start start 2023-09-21T12:48:18.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.728+0000 7f90508ba700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:18.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.728+0000 7f90508ba700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c198400 con 0x7f904c105760 2023-09-21T12:48:18.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f904a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:18.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f904a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.160:58816/0 (socket says 172.21.15.160:58816) 2023-09-21T12:48:18.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f904a59c700 1 -- 172.21.15.160:0/727198374 learned_addr learned my addr 172.21.15.160:0/727198374 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:48:18.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f904a59c700 1 -- 172.21.15.160:0/727198374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400095f0 con 0x7f904c105760 2023-09-21T12:48:18.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f904a59c700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9040004f40 tx=0x7f9040005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:18.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f904001d070 con 0x7f904c105760 2023-09-21T12:48:18.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c198660 con 0x7f904c105760 2023-09-21T12:48:18.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9040004370 con 0x7f904c105760 2023-09-21T12:48:18.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9040003960 con 0x7f904c105760 2023-09-21T12:48:18.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.729+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c198ae0 con 0x7f904c105760 2023-09-21T12:48:18.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.730+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f904000b6f0 con 0x7f904c105760 2023-09-21T12:48:18.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.730+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c062410 con 0x7f904c105760 2023-09-21T12:48:18.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.730+0000 7f903b7fe700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 0x7f903403a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:18.734 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.730+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f904004c420 con 0x7f904c105760 2023-09-21T12:48:18.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.731+0000 7f9049d9b700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 0x7f903403a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:18.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.731+0000 7f9049d9b700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 0x7f903403a8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:18.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.736+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f904000bcd0 con 0x7f904c105760 2023-09-21T12:48:18.932 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.933+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f904c109d50 con 0x7f9034038400 2023-09-21T12:48:18.939 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.940+0000 7f903b7fe700 1 -- 172.21.15.160:0/727198374 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f904c109d50 con 0x7f9034038400 2023-09-21T12:48:18.940 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mon update... 2023-09-21T12:48:18.942 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 msgr2=0x7f903403a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:18.942 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 0x7f903403a8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f903c006fd0 tx=0x7f903c006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:18.942 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 msgr2=0x7f904c197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:18.943 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9040004f40 tx=0x7f9040005020 comp rx=0 tx=0).stop 2023-09-21T12:48:18.943 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 shutdown_connections 2023-09-21T12:48:18.943 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9034038400 0x7f903403a8c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:18.943 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 --2- 172.21.15.160:0/727198374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f904c105760 0x7f904c197ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:18.943 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 >> 172.21.15.160:0/727198374 conn(0x7f904c0fb270 msgr2=0x7f904c068900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:18.944 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 shutdown_connections 2023-09-21T12:48:18.944 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:18.942+0000 7f90508ba700 1 -- 172.21.15.160:0/727198374 wait complete. 2023-09-21T12:48:19.392 DEBUG:teuthology.orchestra.run.smithi156:mon.b> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.b.service 2023-09-21T12:48:19.395 DEBUG:teuthology.orchestra.run.smithi160:mon.c> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.c.service 2023-09-21T12:48:19.398 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-21T12:48:19.398 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-21T12:48:19.429 INFO:journalctl@ceph.mon.c.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:48:19.431 INFO:journalctl@ceph.mon.b.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:48:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:19.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:19.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:19.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:19.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:19.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:19.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:20.308 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:20 smithi142 ceph-mon[97663]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:20.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:20 smithi142 ceph-mon[97663]: Saving service mon spec with placement smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c;count:3 2023-09-21T12:48:20.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:20 smithi142 ceph-mon[97663]: Deploying daemon mon.c on smithi160 2023-09-21T12:48:21.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 -- 172.21.15.160:0/817831254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 msgr2=0x7f4408106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:21.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 --2- 172.21.15.160:0/817831254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f4408106c60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4404009910 tx=0x7f4404009c20 comp rx=0 tx=0).stop 2023-09-21T12:48:21.837 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 -- 172.21.15.160:0/817831254 shutdown_connections 2023-09-21T12:48:21.838 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 --2- 172.21.15.160:0/817831254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f4408106c60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:21.838 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 -- 172.21.15.160:0/817831254 >> 172.21.15.160:0/817831254 conn(0x7f44080fc3d0 msgr2=0x7f44080fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:21.838 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 -- 172.21.15.160:0/817831254 shutdown_connections 2023-09-21T12:48:21.838 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.836+0000 7f44101e1700 1 -- 172.21.15.160:0/817831254 wait complete. 2023-09-21T12:48:21.839 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f44101e1700 1 Processor -- start 2023-09-21T12:48:21.839 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f44101e1700 1 -- start start 2023-09-21T12:48:21.839 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f44101e1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:21.839 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f44101e1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4408075060 con 0x7f4408106880 2023-09-21T12:48:21.839 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f440df7d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:21.840 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f440df7d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.160:58822/0 (socket says 172.21.15.160:58822) 2023-09-21T12:48:21.840 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.837+0000 7f440df7d700 1 -- 172.21.15.160:0/766584821 learned_addr learned my addr 172.21.15.160:0/766584821 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:48:21.841 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f440df7d700 1 -- 172.21.15.160:0/766584821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44040095f0 con 0x7f4408106880 2023-09-21T12:48:21.841 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f440df7d700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4404004f40 tx=0x7f4404005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:21.842 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f440401d070 con 0x7f4408106880 2023-09-21T12:48:21.842 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4404004370 con 0x7f4408106880 2023-09-21T12:48:21.842 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4408073620 con 0x7f4408106880 2023-09-21T12:48:21.842 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44040039b0 con 0x7f4408106880 2023-09-21T12:48:21.843 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.838+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4408073aa0 con 0x7f4408106880 2023-09-21T12:48:21.843 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.839+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4408104b30 con 0x7f4408106880 2023-09-21T12:48:21.843 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.840+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f4404003c70 con 0x7f4408106880 2023-09-21T12:48:21.843 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.840+0000 7f43feffd700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 0x7f43f403a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:21.843 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.840+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f440404c140 con 0x7f4408106880 2023-09-21T12:48:21.844 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.840+0000 7f440d77c700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 0x7f43f403a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:21.844 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.841+0000 7f440d77c700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 0x7f43f403a8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43f8006fd0 tx=0x7f43f8006e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:21.845 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:21.845+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4404029360 con 0x7f4408106880 2023-09-21T12:48:21.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:21 smithi142 ceph-mon[97663]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:22.135 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.136+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4408062410 con 0x7f4408106880 2023-09-21T12:48:22.136 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.136+0000 7f43feffd700 1 -- 172.21.15.160:0/766584821 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7f440402aba0 con 0x7f4408106880 2023-09-21T12:48:22.136 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:48:22.137 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":1,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","modified":"2023-09-21T12:46:35.369491Z","created":"2023-09-21T12:46:35.369491Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-09-21T12:48:22.138 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 msgr2=0x7f43f403a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:22.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 0x7f43f403a8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43f8006fd0 tx=0x7f43f8006e40 comp rx=0 tx=0).stop 2023-09-21T12:48:22.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 msgr2=0x7f44080730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:22.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4404004f40 tx=0x7f4404005020 comp rx=0 tx=0).stop 2023-09-21T12:48:22.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 shutdown_connections 2023-09-21T12:48:22.139 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f43f4038400 0x7f43f403a8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:22.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 --2- 172.21.15.160:0/766584821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4408106880 0x7f44080730e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:22.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 >> 172.21.15.160:0/766584821 conn(0x7f44080fc3d0 msgr2=0x7f4408108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:22.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 shutdown_connections 2023-09-21T12:48:22.140 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:22.139+0000 7f44101e1700 1 -- 172.21.15.160:0/766584821 wait complete. 2023-09-21T12:48:22.141 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 1 2023-09-21T12:48:22.868 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 podman[134410]: 2023-09-21T12:48:22.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:22 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/766584821' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: set uid:gid to 167:167 (ceph:ceph) 2023-09-21T12:48:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev), process ceph-mon, pid 7 2023-09-21T12:48:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 bash[134410]: aba71394e8aa5b648f2d5ce6d76971ec8f1693a723798d3fdf2f27708005aba6 2023-09-21T12:48:23.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pidfile_write: ignore empty --pid-file 2023-09-21T12:48:23.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: load: jerasure load: lrc 2023-09-21T12:48:23.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: RocksDB version: 7.9.2 2023-09-21T12:48:23.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Git sha 0 2023-09-21T12:48:23.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Compile date 2023-09-20 13:08:22 2023-09-21T12:48:23.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: DB SUMMARY 2023-09-21T12:48:23.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: DB Session ID: HNFBRAS1J9MMIPAFK59G 2023-09-21T12:48:23.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: CURRENT file: CURRENT 2023-09-21T12:48:23.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: IDENTITY file: IDENTITY 2023-09-21T12:48:23.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-09-21T12:48:23.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-09-21T12:48:23.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-09-21T12:48:23.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.error_if_exists: 0 2023-09-21T12:48:23.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.create_if_missing: 0 2023-09-21T12:48:23.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.paranoid_checks: 1 2023-09-21T12:48:23.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-21T12:48:23.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-21T12:48:23.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-21T12:48:23.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.env: 0x564832072da0 2023-09-21T12:48:23.194 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.fs: PosixFileSystem 2023-09-21T12:48:23.194 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.info_log: 0x564832d89580 2023-09-21T12:48:23.194 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_file_opening_threads: 16 2023-09-21T12:48:23.194 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.statistics: (nil) 2023-09-21T12:48:23.194 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.use_fsync: 0 2023-09-21T12:48:23.195 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_log_file_size: 0 2023-09-21T12:48:23.195 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-21T12:48:23.195 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-21T12:48:23.195 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.keep_log_file_num: 1000 2023-09-21T12:48:23.195 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.recycle_log_file_num: 0 2023-09-21T12:48:23.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_fallocate: 1 2023-09-21T12:48:23.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_mmap_reads: 0 2023-09-21T12:48:23.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_mmap_writes: 0 2023-09-21T12:48:23.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.use_direct_reads: 0 2023-09-21T12:48:23.196 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-21T12:48:23.197 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.create_missing_column_families: 0 2023-09-21T12:48:23.197 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.db_log_dir: 2023-09-21T12:48:23.197 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.wal_dir: 2023-09-21T12:48:23.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-21T12:48:23.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-21T12:48:23.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-21T12:48:23.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-21T12:48:23.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-21T12:48:23.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-21T12:48:23.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.advise_random_on_open: 1 2023-09-21T12:48:23.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.db_write_buffer_size: 0 2023-09-21T12:48:23.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.write_buffer_manager: 0x564832d414a0 2023-09-21T12:48:23.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-21T12:48:23.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-21T12:48:23.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-21T12:48:23.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.rate_limiter: (nil) 2023-09-21T12:48:23.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-21T12:48:23.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.wal_recovery_mode: 2 2023-09-21T12:48:23.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enable_thread_tracking: 0 2023-09-21T12:48:23.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enable_pipelined_write: 0 2023-09-21T12:48:23.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.unordered_write: 0 2023-09-21T12:48:23.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-21T12:48:23.203 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-21T12:48:23.203 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-21T12:48:23.203 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-21T12:48:23.203 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.row_cache: None 2023-09-21T12:48:23.203 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.wal_filter: None 2023-09-21T12:48:23.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-21T12:48:23.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_ingest_behind: 0 2023-09-21T12:48:23.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.two_write_queues: 0 2023-09-21T12:48:23.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.manual_wal_flush: 0 2023-09-21T12:48:23.204 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.wal_compression: 0 2023-09-21T12:48:23.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.atomic_flush: 0 2023-09-21T12:48:23.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-21T12:48:23.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-21T12:48:23.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-21T12:48:23.205 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.log_readahead_size: 0 2023-09-21T12:48:23.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-21T12:48:23.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.best_efforts_recovery: 0 2023-09-21T12:48:23.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-21T12:48:23.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-21T12:48:23.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.allow_data_in_errors: 0 2023-09-21T12:48:23.207 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.db_host_id: __hostname__ 2023-09-21T12:48:23.207 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-21T12:48:23.207 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_background_jobs: 2 2023-09-21T12:48:23.207 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_background_compactions: -1 2023-09-21T12:48:23.207 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_subcompactions: 1 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_total_wal_size: 0 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-21T12:48:23.208 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-21T12:48:23.209 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-21T12:48:23.209 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-21T12:48:23.209 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_open_files: -1 2023-09-21T12:48:23.209 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bytes_per_sync: 0 2023-09-21T12:48:23.209 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-21T12:48:23.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-21T12:48:23.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_readahead_size: 0 2023-09-21T12:48:23.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_background_flushes: -1 2023-09-21T12:48:23.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Compression algorithms supported: 2023-09-21T12:48:23.210 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-21T12:48:23.211 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kZSTD supported: 0 2023-09-21T12:48:23.211 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kXpressCompression supported: 0 2023-09-21T12:48:23.211 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kLZ4HCCompression supported: 1 2023-09-21T12:48:23.211 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kZlibCompression supported: 1 2023-09-21T12:48:23.211 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kSnappyCompression supported: 1 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kLZ4Compression supported: 1 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: kBZip2Compression supported: 0 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-09-21T12:48:23.212 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-21T12:48:23.213 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-21T12:48:23.213 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.merge_operator: 2023-09-21T12:48:23.213 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_filter: None 2023-09-21T12:48:23.213 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_filter_factory: None 2023-09-21T12:48:23.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.sst_partitioner_factory: None 2023-09-21T12:48:23.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-21T12:48:23.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-21T12:48:23.214 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564832d89680) 2023-09-21T12:48:23.214 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks: 1 2023-09-21T12:48:23.215 INFO:journalctl@ceph.mon.c.smithi160.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-21T12:48:23.215 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-21T12:48:23.215 INFO:journalctl@ceph.mon.c.smithi160.stdout: pin_top_level_index_and_filter: 1 2023-09-21T12:48:23.215 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_type: 0 2023-09-21T12:48:23.215 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_index_type: 0 2023-09-21T12:48:23.216 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_shortening: 1 2023-09-21T12:48:23.216 INFO:journalctl@ceph.mon.c.smithi160.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-21T12:48:23.216 INFO:journalctl@ceph.mon.c.smithi160.stdout: checksum: 4 2023-09-21T12:48:23.216 INFO:journalctl@ceph.mon.c.smithi160.stdout: no_block_cache: 0 2023-09-21T12:48:23.216 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache: 0x564832ddf1f0 2023-09-21T12:48:23.217 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_name: BinnedLRUCache 2023-09-21T12:48:23.217 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_options: 2023-09-21T12:48:23.217 INFO:journalctl@ceph.mon.c.smithi160.stdout: capacity : 536870912 2023-09-21T12:48:23.217 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_shard_bits : 4 2023-09-21T12:48:23.217 INFO:journalctl@ceph.mon.c.smithi160.stdout: strict_capacity_limit : 0 2023-09-21T12:48:23.218 INFO:journalctl@ceph.mon.c.smithi160.stdout: high_pri_pool_ratio: 0.000 2023-09-21T12:48:23.218 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_cache_compressed: (nil) 2023-09-21T12:48:23.218 INFO:journalctl@ceph.mon.c.smithi160.stdout: persistent_cache: (nil) 2023-09-21T12:48:23.218 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size: 4096 2023-09-21T12:48:23.218 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_size_deviation: 10 2023-09-21T12:48:23.219 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_restart_interval: 16 2023-09-21T12:48:23.219 INFO:journalctl@ceph.mon.c.smithi160.stdout: index_block_restart_interval: 1 2023-09-21T12:48:23.219 INFO:journalctl@ceph.mon.c.smithi160.stdout: metadata_block_size: 4096 2023-09-21T12:48:23.219 INFO:journalctl@ceph.mon.c.smithi160.stdout: partition_filters: 0 2023-09-21T12:48:23.219 INFO:journalctl@ceph.mon.c.smithi160.stdout: use_delta_encoding: 1 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: filter_policy: bloomfilter 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: whole_key_filtering: 1 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: verify_compression: 0 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: read_amp_bytes_per_bit: 0 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: format_version: 5 2023-09-21T12:48:23.220 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_index_compression: 1 2023-09-21T12:48:23.221 INFO:journalctl@ceph.mon.c.smithi160.stdout: block_align: 0 2023-09-21T12:48:23.221 INFO:journalctl@ceph.mon.c.smithi160.stdout: max_auto_readahead_size: 262144 2023-09-21T12:48:23.221 INFO:journalctl@ceph.mon.c.smithi160.stdout: prepopulate_block_cache: 0 2023-09-21T12:48:23.221 INFO:journalctl@ceph.mon.c.smithi160.stdout: initial_auto_readahead_size: 8192 2023-09-21T12:48:23.221 INFO:journalctl@ceph.mon.c.smithi160.stdout: num_file_reads_for_auto_readahead: 2 2023-09-21T12:48:23.222 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.write_buffer_size: 33554432 2023-09-21T12:48:23.222 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_write_buffer_number: 2 2023-09-21T12:48:23.222 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression: NoCompression 2023-09-21T12:48:23.222 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression: Disabled 2023-09-21T12:48:23.223 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.prefix_extractor: nullptr 2023-09-21T12:48:23.223 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-21T12:48:23.223 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.num_levels: 7 2023-09-21T12:48:23.223 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-21T12:48:23.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-21T12:48:23.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-21T12:48:23.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-21T12:48:23.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-21T12:48:23.224 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-21T12:48:23.225 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-21T12:48:23.225 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:48:23.225 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-21T12:48:23.225 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-21T12:48:23.225 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:48:23.226 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:48:23.226 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-21T12:48:23.226 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.level: 32767 2023-09-21T12:48:23.226 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.strategy: 0 2023-09-21T12:48:23.226 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-21T12:48:23.227 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:48:23.227 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:48:23.227 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-21T12:48:23.227 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.enabled: false 2023-09-21T12:48:23.227 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:48:23.228 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-21T12:48:23.228 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-21T12:48:23.228 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-21T12:48:23.228 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.target_file_size_base: 67108864 2023-09-21T12:48:23.228 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-21T12:48:23.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-21T12:48:23.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-21T12:48:23.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-21T12:48:23.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-21T12:48:23.229 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-21T12:48:23.230 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-21T12:48:23.230 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-21T12:48:23.230 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-21T12:48:23.230 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-21T12:48:23.230 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.arena_block_size: 1048576 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-21T12:48:23.231 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-21T12:48:23.232 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.disable_auto_compactions: 0 2023-09-21T12:48:23.232 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-21T12:48:23.232 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-21T12:48:23.232 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-21T12:48:23.232 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-21T12:48:23.233 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-21T12:48:23.233 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-21T12:48:23.233 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-21T12:48:23.233 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-21T12:48:23.233 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-21T12:48:23.234 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-21T12:48:23.234 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.table_properties_collectors: 2023-09-21T12:48:23.234 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.inplace_update_support: 0 2023-09-21T12:48:23.234 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-21T12:48:23.234 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-21T12:48:23.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-21T12:48:23.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-21T12:48:23.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.bloom_locality: 0 2023-09-21T12:48:23.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.max_successive_merges: 0 2023-09-21T12:48:23.235 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-21T12:48:23.236 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.paranoid_file_checks: 0 2023-09-21T12:48:23.236 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.force_consistency_checks: 1 2023-09-21T12:48:23.236 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.report_bg_io_stats: 0 2023-09-21T12:48:23.236 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.ttl: 2592000 2023-09-21T12:48:23.236 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-21T12:48:23.237 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-21T12:48:23.237 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-21T12:48:23.237 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enable_blob_files: false 2023-09-21T12:48:23.237 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.min_blob_size: 0 2023-09-21T12:48:23.237 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_file_size: 268435456 2023-09-21T12:48:23.238 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-21T12:48:23.238 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-21T12:48:23.238 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-21T12:48:23.238 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-21T12:48:23.238 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-21T12:48:23.239 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.blob_file_starting_level: 0 2023-09-21T12:48:23.239 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-21T12:48:23.239 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-09-21T12:48:23.239 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-09-21T12:48:23.239 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 07d4daa0-5323-4492-97b5-723c23be5e51 2023-09-21T12:48:23.240 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300502942718, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-09-21T12:48:23.240 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-09-21T12:48:23.240 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300502943128, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1695300502, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "07d4daa0-5323-4492-97b5-723c23be5e51", "db_session_id": "HNFBRAS1J9MMIPAFK59G", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-09-21T12:48:23.240 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300502943206, "job": 1, "event": "recovery_finished"} 2023-09-21T12:48:23.240 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564832e7c000 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: DB pointer 0x564832e68000 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-21T12:48:23.241 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** DB Stats ** 2023-09-21T12:48:23.242 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:48:23.242 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:23.242 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:23.242 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:48:23.242 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-21T12:48:23.243 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:23.243 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:48:23.243 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.243 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2023-09-21T12:48:23.243 INFO:journalctl@ceph.mon.c.smithi160.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:48:23.244 INFO:journalctl@ceph.mon.c.smithi160.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-21T12:48:23.244 INFO:journalctl@ceph.mon.c.smithi160.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-21T12:48:23.244 INFO:journalctl@ceph.mon.c.smithi160.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-21T12:48:23.244 INFO:journalctl@ceph.mon.c.smithi160.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-21T12:48:23.244 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** Compaction Stats [default] ** 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.245 INFO:journalctl@ceph.mon.c.smithi160.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-21T12:48:23.246 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.246 INFO:journalctl@ceph.mon.c.smithi160.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:48:23.246 INFO:journalctl@ceph.mon.c.smithi160.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-21T12:48:23.246 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-21T12:48:23.246 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-21T12:48:23.247 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-21T12:48:23.247 INFO:journalctl@ceph.mon.c.smithi160.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-21T12:48:23.247 INFO:journalctl@ceph.mon.c.smithi160.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:48:23.247 INFO:journalctl@ceph.mon.c.smithi160.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:48:23.248 INFO:journalctl@ceph.mon.c.smithi160.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-21T12:48:23.248 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache BinnedLRUCache@0x564832ddf1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2023-09-21T12:48:23.248 INFO:journalctl@ceph.mon.c.smithi160.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-09-21T12:48:23.248 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.248 INFO:journalctl@ceph.mon.c.smithi160.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-21T12:48:23.249 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-09-21T12:48:23.249 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: using public_addr v2:172.21.15.160:0/0 -> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2023-09-21T12:48:23.249 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: starting mon.c rank -1 at public addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] at bind addrs [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:23.249 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(???) e0 preinit fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:23.250 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 systemd[1]: Started Ceph mon.c for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:48:23.250 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).mds e1 new map 2023-09-21T12:48:23.250 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).mds e1 print_map 2023-09-21T12:48:23.250 INFO:journalctl@ceph.mon.c.smithi160.stdout: e1 2023-09-21T12:48:23.250 INFO:journalctl@ceph.mon.c.smithi160.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-21T12:48:23.251 INFO:journalctl@ceph.mon.c.smithi160.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-21T12:48:23.251 INFO:journalctl@ceph.mon.c.smithi160.stdout: legacy client fscid: -1 2023-09-21T12:48:23.251 INFO:journalctl@ceph.mon.c.smithi160.stdout: 2023-09-21T12:48:23.251 INFO:journalctl@ceph.mon.c.smithi160.stdout: No filesystems configured 2023-09-21T12:48:23.251 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-09-21T12:48:23.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-09-21T12:48:23.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-09-21T12:48:23.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-09-21T12:48:23.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-09-21T12:48:23.252 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.253 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.254 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.254 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.254 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.254 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:23.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:23.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:23.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:48:23.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.255 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.256 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.256 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:23.256 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:23.256 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:23.256 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:23.257 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Deploying cephadm binary to smithi160 2023-09-21T12:48:23.257 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.257 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.257 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Added host smithi160 2023-09-21T12:48:23.257 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:23.258 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.258 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.258 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.258 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.258 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.259 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.260 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:23.260 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:23.260 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:23.260 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:48:23.260 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:23.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-21T12:48:23.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:23.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:23.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.261 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.262 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:23.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:23.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:23.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:23.263 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:23.264 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:23.264 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:23.264 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Saving service mon spec with placement smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c;count:3 2023-09-21T12:48:23.264 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: Deploying daemon mon.c on smithi160 2023-09-21T12:48:23.264 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/766584821' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-21T12:48:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expand map: {default=false} 2023-09-21T12:48:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta from 'false' to 'false' 2023-09-21T12:48:23.265 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expanded map: {default=false} 2023-09-21T12:48:23.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expand map: {default=info} 2023-09-21T12:48:23.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta from 'info' to 'info' 2023-09-21T12:48:23.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expanded map: {default=info} 2023-09-21T12:48:23.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expand map: {default=daemon} 2023-09-21T12:48:23.266 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-21T12:48:23.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expanded map: {default=daemon} 2023-09-21T12:48:23.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expand map: {default=debug} 2023-09-21T12:48:23.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta from 'debug' to 'debug' 2023-09-21T12:48:23.267 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: expand_channel_meta expanded map: {default=debug} 2023-09-21T12:48:23.268 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:22 smithi160 ceph-mon[134450]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-09-21T12:48:23.573 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-21T12:48:23.574 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-21T12:48:24.136 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:48:28.342 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 -- 172.21.15.160:0/918236380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d4100400 msgr2=0x7f63c4007820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:28.342 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 --2- 172.21.15.160:0/918236380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d4100400 0x7f63c4007820 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f63c8005fa0 tx=0x7f63c800ffc0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.343 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 -- 172.21.15.160:0/918236380 shutdown_connections 2023-09-21T12:48:28.343 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 --2- 172.21.15.160:0/918236380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d4100400 0x7f63c4007820 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.343 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 -- 172.21.15.160:0/918236380 >> 172.21.15.160:0/918236380 conn(0x7f63d4074b30 msgr2=0x7f63d4074f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:28.343 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 -- 172.21.15.160:0/918236380 shutdown_connections 2023-09-21T12:48:28.343 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.339+0000 7f63db001700 1 -- 172.21.15.160:0/918236380 wait complete. 2023-09-21T12:48:28.344 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 Processor -- start 2023-09-21T12:48:28.344 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 -- start start 2023-09-21T12:48:28.344 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:28.344 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 0x7f63d41975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:28.344 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d4194770 con 0x7f63d41941e0 2023-09-21T12:48:28.345 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63db001700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d41948b0 con 0x7f63d4100400 2023-09-21T12:48:28.345 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.340+0000 7f63d8d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:28.345 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57562/0 (socket says 172.21.15.160:57562) 2023-09-21T12:48:28.345 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 -- 172.21.15.160:0/536635378 learned_addr learned my addr 172.21.15.160:0/536635378 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:48:28.345 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d3fff700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 0x7f63d41975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:28.346 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 -- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 msgr2=0x7f63d4193ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-09-21T12:48:28.346 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 -- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 msgr2=0x7f63d4193ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-21T12:48:28.346 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T12:48:28.346 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d8d9d700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:48:28.346 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d3fff700 1 -- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 msgr2=0x7f63d4193ca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:48:28.347 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d3fff700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.347 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d3fff700 1 -- 172.21.15.160:0/536635378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c800f9c0 con 0x7f63d41941e0 2023-09-21T12:48:28.347 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.341+0000 7f63d3fff700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 0x7f63d41975a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b4d0 tx=0x7f63c000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:28.347 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.342+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f63c0011630 con 0x7f63d41941e0 2023-09-21T12:48:28.347 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.342+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c0011c50 con 0x7f63d41941e0 2023-09-21T12:48:28.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.342+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d4197ae0 con 0x7f63d41941e0 2023-09-21T12:48:28.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.342+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f63c0010c60 con 0x7f63d41941e0 2023-09-21T12:48:28.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.342+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d4198030 con 0x7f63d41941e0 2023-09-21T12:48:28.348 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.343+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f63c001a410 con 0x7f63d41941e0 2023-09-21T12:48:28.350 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.343+0000 7f63d1ffb700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 0x7f63b803a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:28.350 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.343+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f63c004a2c0 con 0x7f63d41941e0 2023-09-21T12:48:28.351 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.343+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d4062410 con 0x7f63d41941e0 2023-09-21T12:48:28.351 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.343+0000 7f63d8d9d700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 0x7f63b803a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:28.351 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.344+0000 7f63d8d9d700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 0x7f63b803a700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63c80059d0 tx=0x7f63c8005940 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:28.351 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.348+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f63c00193b0 con 0x7f63d41941e0 2023-09-21T12:48:28.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:28.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: mon.a calling monitor election 2023-09-21T12:48:28.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:28.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: mon.c calling monitor election 2023-09-21T12:48:28.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:28.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:28.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: monmap e2: 2 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:28.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: fsmap 2023-09-21T12:48:28.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:28.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: mgrmap e13: x(active, since 47s) 2023-09-21T12:48:28.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: overall HEALTH_OK 2023-09-21T12:48:28.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:28.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:28.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:28.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: mon.a calling monitor election 2023-09-21T12:48:28.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:28.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: mon.c calling monitor election 2023-09-21T12:48:28.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:28.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:28.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: monmap e2: 2 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: fsmap 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: mgrmap e13: x(active, since 47s) 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: overall HEALTH_OK 2023-09-21T12:48:28.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:28.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:28.617 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.617+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f63d4194fc0 con 0x7f63d41941e0 2023-09-21T12:48:28.617 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.618+0000 7f63d1ffb700 1 -- 172.21.15.160:0/536635378 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7f63c0010ed0 con 0x7f63d41941e0 2023-09-21T12:48:28.618 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:48:28.618 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":2,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","modified":"2023-09-21T12:48:22.975544Z","created":"2023-09-21T12:46:35.369491Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-21T12:48:28.619 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 msgr2=0x7f63b803a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:28.620 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 0x7f63b803a700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63c80059d0 tx=0x7f63c8005940 comp rx=0 tx=0).stop 2023-09-21T12:48:28.620 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 msgr2=0x7f63d41975a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:28.620 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 0x7f63d41975a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b4d0 tx=0x7f63c000b890 comp rx=0 tx=0).stop 2023-09-21T12:48:28.620 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 shutdown_connections 2023-09-21T12:48:28.620 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63b8038240 0x7f63b803a700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.621 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63d4100400 0x7f63d4193ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.621 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 --2- 172.21.15.160:0/536635378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63d41941e0 0x7f63d41975a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:28.621 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 >> 172.21.15.160:0/536635378 conn(0x7f63d4074b30 msgr2=0x7f63d41034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:28.621 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 shutdown_connections 2023-09-21T12:48:28.621 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:28.620+0000 7f63db001700 1 -- 172.21.15.160:0/536635378 wait complete. 2023-09-21T12:48:28.622 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 2 2023-09-21T12:48:29.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:29.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:29.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:29.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: Deploying daemon mon.b on smithi156 2023-09-21T12:48:29.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:29.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/536635378' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:29.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:29.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:29.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:29.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:29.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: Deploying daemon mon.b on smithi156 2023-09-21T12:48:29.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:29.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/536635378' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:29.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:29.996 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-21T12:48:29.997 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-21T12:48:30.562 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:48:30.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:30 smithi156 systemd[1]: Starting Ceph mon.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:48:31.196 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:30 smithi156 podman[134038]: 2023-09-21T12:48:31.196 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: set uid:gid to 167:167 (ceph:ceph) 2023-09-21T12:48:31.196 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: ceph version 18.0.0-6168-g41c9e835 (41c9e835c3f621102ade35dd597317a42116a491) reef (dev), process ceph-mon, pid 7 2023-09-21T12:48:31.197 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pidfile_write: ignore empty --pid-file 2023-09-21T12:48:31.197 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 bash[134038]: ade8653e41b30c28760eea7794db68da85987628f84dcec87829e7e4a9cd9b80 2023-09-21T12:48:31.197 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: load: jerasure load: lrc 2023-09-21T12:48:31.197 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: RocksDB version: 7.9.2 2023-09-21T12:48:31.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Git sha 0 2023-09-21T12:48:31.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Compile date 2023-09-20 13:08:22 2023-09-21T12:48:31.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: DB SUMMARY 2023-09-21T12:48:31.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: DB Session ID: XSAT6N5LEHYHJSHDTGJI 2023-09-21T12:48:31.198 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: CURRENT file: CURRENT 2023-09-21T12:48:31.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: IDENTITY file: IDENTITY 2023-09-21T12:48:31.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-09-21T12:48:31.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-09-21T12:48:31.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-09-21T12:48:31.199 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.error_if_exists: 0 2023-09-21T12:48:31.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.create_if_missing: 0 2023-09-21T12:48:31.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.paranoid_checks: 1 2023-09-21T12:48:31.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-21T12:48:31.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-21T12:48:31.200 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-21T12:48:31.201 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.env: 0x556e9bdceda0 2023-09-21T12:48:31.201 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.fs: PosixFileSystem 2023-09-21T12:48:31.201 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.info_log: 0x556e9e5f5580 2023-09-21T12:48:31.201 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_file_opening_threads: 16 2023-09-21T12:48:31.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.statistics: (nil) 2023-09-21T12:48:31.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.use_fsync: 0 2023-09-21T12:48:31.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_log_file_size: 0 2023-09-21T12:48:31.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-21T12:48:31.202 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-21T12:48:31.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.keep_log_file_num: 1000 2023-09-21T12:48:31.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.recycle_log_file_num: 0 2023-09-21T12:48:31.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_fallocate: 1 2023-09-21T12:48:31.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_mmap_reads: 0 2023-09-21T12:48:31.203 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_mmap_writes: 0 2023-09-21T12:48:31.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.use_direct_reads: 0 2023-09-21T12:48:31.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-21T12:48:31.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.create_missing_column_families: 0 2023-09-21T12:48:31.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.db_log_dir: 2023-09-21T12:48:31.204 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.wal_dir: 2023-09-21T12:48:31.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-21T12:48:31.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-21T12:48:31.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-21T12:48:31.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-21T12:48:31.205 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-21T12:48:31.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-21T12:48:31.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.advise_random_on_open: 1 2023-09-21T12:48:31.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.db_write_buffer_size: 0 2023-09-21T12:48:31.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.write_buffer_manager: 0x556e9e5ad4a0 2023-09-21T12:48:31.206 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-21T12:48:31.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-21T12:48:31.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-21T12:48:31.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.rate_limiter: (nil) 2023-09-21T12:48:31.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-21T12:48:31.207 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.wal_recovery_mode: 2 2023-09-21T12:48:31.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enable_thread_tracking: 0 2023-09-21T12:48:31.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enable_pipelined_write: 0 2023-09-21T12:48:31.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.unordered_write: 0 2023-09-21T12:48:31.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-21T12:48:31.208 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-21T12:48:31.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-21T12:48:31.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-21T12:48:31.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.row_cache: None 2023-09-21T12:48:31.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.wal_filter: None 2023-09-21T12:48:31.209 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-21T12:48:31.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_ingest_behind: 0 2023-09-21T12:48:31.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.two_write_queues: 0 2023-09-21T12:48:31.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.manual_wal_flush: 0 2023-09-21T12:48:31.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.wal_compression: 0 2023-09-21T12:48:31.210 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.atomic_flush: 0 2023-09-21T12:48:31.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-21T12:48:31.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-21T12:48:31.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-21T12:48:31.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.log_readahead_size: 0 2023-09-21T12:48:31.211 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-21T12:48:31.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.best_efforts_recovery: 0 2023-09-21T12:48:31.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-21T12:48:31.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-21T12:48:31.212 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.allow_data_in_errors: 0 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.db_host_id: __hostname__ 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_background_jobs: 2 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_background_compactions: -1 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_subcompactions: 1 2023-09-21T12:48:31.213 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-21T12:48:31.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-21T12:48:31.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-21T12:48:31.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_total_wal_size: 0 2023-09-21T12:48:31.214 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-21T12:48:31.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-21T12:48:31.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-21T12:48:31.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-21T12:48:31.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_open_files: -1 2023-09-21T12:48:31.215 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bytes_per_sync: 0 2023-09-21T12:48:31.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-21T12:48:31.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-21T12:48:31.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_readahead_size: 0 2023-09-21T12:48:31.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_background_flushes: -1 2023-09-21T12:48:31.216 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Compression algorithms supported: 2023-09-21T12:48:31.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-21T12:48:31.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kZSTD supported: 0 2023-09-21T12:48:31.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kXpressCompression supported: 0 2023-09-21T12:48:31.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kLZ4HCCompression supported: 1 2023-09-21T12:48:31.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kZlibCompression supported: 1 2023-09-21T12:48:31.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kSnappyCompression supported: 1 2023-09-21T12:48:31.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kLZ4Compression supported: 1 2023-09-21T12:48:31.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: kBZip2Compression supported: 0 2023-09-21T12:48:31.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-21T12:48:31.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-21T12:48:31.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-09-21T12:48:31.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-21T12:48:31.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-21T12:48:31.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.merge_operator: 2023-09-21T12:48:31.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_filter: None 2023-09-21T12:48:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_filter_factory: None 2023-09-21T12:48:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.sst_partitioner_factory: None 2023-09-21T12:48:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-21T12:48:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-21T12:48:31.220 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556e9e5f5680) 2023-09-21T12:48:31.221 INFO:journalctl@ceph.mon.b.smithi156.stdout: cache_index_and_filter_blocks: 1 2023-09-21T12:48:31.221 INFO:journalctl@ceph.mon.b.smithi156.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-21T12:48:31.221 INFO:journalctl@ceph.mon.b.smithi156.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-21T12:48:31.221 INFO:journalctl@ceph.mon.b.smithi156.stdout: pin_top_level_index_and_filter: 1 2023-09-21T12:48:31.221 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_type: 0 2023-09-21T12:48:31.222 INFO:journalctl@ceph.mon.b.smithi156.stdout: data_block_index_type: 0 2023-09-21T12:48:31.222 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_shortening: 1 2023-09-21T12:48:31.222 INFO:journalctl@ceph.mon.b.smithi156.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-21T12:48:31.222 INFO:journalctl@ceph.mon.b.smithi156.stdout: checksum: 4 2023-09-21T12:48:31.222 INFO:journalctl@ceph.mon.b.smithi156.stdout: no_block_cache: 0 2023-09-21T12:48:31.223 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache: 0x556e9e64b1f0 2023-09-21T12:48:31.223 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_name: BinnedLRUCache 2023-09-21T12:48:31.223 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_options: 2023-09-21T12:48:31.223 INFO:journalctl@ceph.mon.b.smithi156.stdout: capacity : 536870912 2023-09-21T12:48:31.223 INFO:journalctl@ceph.mon.b.smithi156.stdout: num_shard_bits : 4 2023-09-21T12:48:31.224 INFO:journalctl@ceph.mon.b.smithi156.stdout: strict_capacity_limit : 0 2023-09-21T12:48:31.224 INFO:journalctl@ceph.mon.b.smithi156.stdout: high_pri_pool_ratio: 0.000 2023-09-21T12:48:31.224 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_cache_compressed: (nil) 2023-09-21T12:48:31.224 INFO:journalctl@ceph.mon.b.smithi156.stdout: persistent_cache: (nil) 2023-09-21T12:48:31.224 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_size: 4096 2023-09-21T12:48:31.225 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_size_deviation: 10 2023-09-21T12:48:31.225 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_restart_interval: 16 2023-09-21T12:48:31.225 INFO:journalctl@ceph.mon.b.smithi156.stdout: index_block_restart_interval: 1 2023-09-21T12:48:31.225 INFO:journalctl@ceph.mon.b.smithi156.stdout: metadata_block_size: 4096 2023-09-21T12:48:31.225 INFO:journalctl@ceph.mon.b.smithi156.stdout: partition_filters: 0 2023-09-21T12:48:31.226 INFO:journalctl@ceph.mon.b.smithi156.stdout: use_delta_encoding: 1 2023-09-21T12:48:31.226 INFO:journalctl@ceph.mon.b.smithi156.stdout: filter_policy: bloomfilter 2023-09-21T12:48:31.226 INFO:journalctl@ceph.mon.b.smithi156.stdout: whole_key_filtering: 1 2023-09-21T12:48:31.226 INFO:journalctl@ceph.mon.b.smithi156.stdout: verify_compression: 0 2023-09-21T12:48:31.226 INFO:journalctl@ceph.mon.b.smithi156.stdout: read_amp_bytes_per_bit: 0 2023-09-21T12:48:31.227 INFO:journalctl@ceph.mon.b.smithi156.stdout: format_version: 5 2023-09-21T12:48:31.227 INFO:journalctl@ceph.mon.b.smithi156.stdout: enable_index_compression: 1 2023-09-21T12:48:31.227 INFO:journalctl@ceph.mon.b.smithi156.stdout: block_align: 0 2023-09-21T12:48:31.227 INFO:journalctl@ceph.mon.b.smithi156.stdout: max_auto_readahead_size: 262144 2023-09-21T12:48:31.227 INFO:journalctl@ceph.mon.b.smithi156.stdout: prepopulate_block_cache: 0 2023-09-21T12:48:31.228 INFO:journalctl@ceph.mon.b.smithi156.stdout: initial_auto_readahead_size: 8192 2023-09-21T12:48:31.228 INFO:journalctl@ceph.mon.b.smithi156.stdout: num_file_reads_for_auto_readahead: 2 2023-09-21T12:48:31.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.write_buffer_size: 33554432 2023-09-21T12:48:31.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_write_buffer_number: 2 2023-09-21T12:48:31.228 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression: NoCompression 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression: Disabled 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.prefix_extractor: nullptr 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.num_levels: 7 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-21T12:48:31.229 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-21T12:48:31.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-21T12:48:31.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-21T12:48:31.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-21T12:48:31.230 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-21T12:48:31.231 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-21T12:48:31.231 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:48:31.231 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-21T12:48:31.231 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-21T12:48:31.231 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.level: 32767 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.strategy: 0 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-21T12:48:31.232 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-21T12:48:31.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-21T12:48:31.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-21T12:48:31.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.enabled: false 2023-09-21T12:48:31.233 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-21T12:48:31.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-21T12:48:31.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-21T12:48:31.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-21T12:48:31.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.target_file_size_base: 67108864 2023-09-21T12:48:31.234 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-21T12:48:31.235 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-21T12:48:31.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-21T12:48:31.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-21T12:48:31.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-21T12:48:31.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-21T12:48:31.236 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-21T12:48:31.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-21T12:48:31.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-21T12:48:31.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.arena_block_size: 1048576 2023-09-21T12:48:31.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-21T12:48:31.237 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-21T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.disable_auto_compactions: 0 2023-09-21T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-21T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-21T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-21T12:48:31.238 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-21T12:48:31.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-21T12:48:31.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-21T12:48:31.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-21T12:48:31.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-21T12:48:31.239 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-21T12:48:31.240 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-21T12:48:31.240 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.table_properties_collectors: 2023-09-21T12:48:31.240 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.inplace_update_support: 0 2023-09-21T12:48:31.240 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-21T12:48:31.240 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-21T12:48:31.241 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-21T12:48:31.241 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-21T12:48:31.241 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.bloom_locality: 0 2023-09-21T12:48:31.241 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.max_successive_merges: 0 2023-09-21T12:48:31.241 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-21T12:48:31.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.paranoid_file_checks: 0 2023-09-21T12:48:31.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.force_consistency_checks: 1 2023-09-21T12:48:31.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.report_bg_io_stats: 0 2023-09-21T12:48:31.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.ttl: 2592000 2023-09-21T12:48:31.242 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-21T12:48:31.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-21T12:48:31.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-21T12:48:31.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enable_blob_files: false 2023-09-21T12:48:31.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.min_blob_size: 0 2023-09-21T12:48:31.243 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_file_size: 268435456 2023-09-21T12:48:31.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-21T12:48:31.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-21T12:48:31.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-21T12:48:31.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-21T12:48:31.244 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-21T12:48:31.245 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.blob_file_starting_level: 0 2023-09-21T12:48:31.245 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-21T12:48:31.246 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-09-21T12:48:31.246 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-09-21T12:48:31.246 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 67758373-7171-4e70-a280-61fc3505993b 2023-09-21T12:48:31.247 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300511127762, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-09-21T12:48:31.247 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-09-21T12:48:31.247 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300511128309, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1695300511, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "67758373-7171-4e70-a280-61fc3505993b", "db_session_id": "XSAT6N5LEHYHJSHDTGJI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-09-21T12:48:31.247 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: EVENT_LOG_v1 {"time_micros": 1695300511128407, "job": 1, "event": "recovery_finished"} 2023-09-21T12:48:31.247 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-09-21T12:48:31.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-21T12:48:31.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556e9e6e8000 2023-09-21T12:48:31.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: DB pointer 0x556e9e6d4000 2023-09-21T12:48:31.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-21T12:48:31.248 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-21T12:48:31.249 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** DB Stats ** 2023-09-21T12:48:31.249 INFO:journalctl@ceph.mon.b.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:48:31.249 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:31.249 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:31.249 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:48:31.250 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-21T12:48:31.250 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-21T12:48:31.250 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-21T12:48:31.250 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.250 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** Compaction Stats [default] ** 2023-09-21T12:48:31.251 INFO:journalctl@ceph.mon.b.smithi156.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:48:31.251 INFO:journalctl@ceph.mon.b.smithi156.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-21T12:48:31.251 INFO:journalctl@ceph.mon.b.smithi156.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:48:31.251 INFO:journalctl@ceph.mon.b.smithi156.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:48:31.251 INFO:journalctl@ceph.mon.b.smithi156.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:48:31.252 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.252 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** Compaction Stats [default] ** 2023-09-21T12:48:31.252 INFO:journalctl@ceph.mon.b.smithi156.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-21T12:48:31.252 INFO:journalctl@ceph.mon.b.smithi156.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-21T12:48:31.252 INFO:journalctl@ceph.mon.b.smithi156.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-21T12:48:31.253 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.253 INFO:journalctl@ceph.mon.b.smithi156.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-21T12:48:31.253 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.253 INFO:journalctl@ceph.mon.b.smithi156.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-21T12:48:31.253 INFO:journalctl@ceph.mon.b.smithi156.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-21T12:48:31.254 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-21T12:48:31.254 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-21T12:48:31.254 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-21T12:48:31.254 INFO:journalctl@ceph.mon.b.smithi156.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-21T12:48:31.254 INFO:journalctl@ceph.mon.b.smithi156.stdout: Cumulative compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:48:31.255 INFO:journalctl@ceph.mon.b.smithi156.stdout: Interval compaction: 0.00 GB write, 0.50 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-21T12:48:31.255 INFO:journalctl@ceph.mon.b.smithi156.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-21T12:48:31.255 INFO:journalctl@ceph.mon.b.smithi156.stdout: Block cache BinnedLRUCache@0x556e9e64b1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-09-21T12:48:31.255 INFO:journalctl@ceph.mon.b.smithi156.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-09-21T12:48:31.255 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.256 INFO:journalctl@ceph.mon.b.smithi156.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-21T12:48:31.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-09-21T12:48:31.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: using public_addr v2:172.21.15.156:0/0 -> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] 2023-09-21T12:48:31.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: starting mon.b rank -1 at public addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] at bind addrs [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:31.256 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(???) e0 preinit fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:31.257 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).mds e1 new map 2023-09-21T12:48:31.257 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).mds e1 print_map 2023-09-21T12:48:31.257 INFO:journalctl@ceph.mon.b.smithi156.stdout: e1 2023-09-21T12:48:31.257 INFO:journalctl@ceph.mon.b.smithi156.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-21T12:48:31.257 INFO:journalctl@ceph.mon.b.smithi156.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-21T12:48:31.258 INFO:journalctl@ceph.mon.b.smithi156.stdout: legacy client fscid: -1 2023-09-21T12:48:31.258 INFO:journalctl@ceph.mon.b.smithi156.stdout: 2023-09-21T12:48:31.258 INFO:journalctl@ceph.mon.b.smithi156.stdout: No filesystems configured 2023-09-21T12:48:31.258 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-09-21T12:48:31.259 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-09-21T12:48:31.259 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-09-21T12:48:31.259 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-09-21T12:48:31.259 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-09-21T12:48:31.259 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-09-21T12:48:31.260 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-21T12:48:31.260 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:31.260 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:31.260 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-21T12:48:31.260 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.261 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi156", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:31.262 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:31.262 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:31.262 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:48:31.262 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.262 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:31.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:31.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:31.263 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi160", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:31.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Deploying cephadm binary to smithi160 2023-09-21T12:48:31.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Added host smithi160 2023-09-21T12:48:31.264 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:31.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.265 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:48:31.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.266 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.267 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.267 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi160", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:48:31.267 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:31.267 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:31.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:48:31.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:31.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-21T12:48:31.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:31.268 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:48:31.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.269 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/245112296' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-21T12:48:31.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:31.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:31.270 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:31.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:31.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:31.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:31.271 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:31.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Saving service mon spec with placement smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c;count:3 2023-09-21T12:48:31.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Deploying daemon mon.c on smithi160 2023-09-21T12:48:31.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/766584821' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:31.272 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.a calling monitor election 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.273 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.c calling monitor election 2023-09-21T12:48:31.274 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.274 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.274 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.274 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.274 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:31.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: monmap e2: 2 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:31.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: fsmap 2023-09-21T12:48:31.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:31.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mgrmap e13: x(active, since 47s) 2023-09-21T12:48:31.275 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: overall HEALTH_OK 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:31.276 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: Deploying daemon mon.b on smithi156 2023-09-21T12:48:31.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:31.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/536635378' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-21T12:48:31.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:31.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-21T12:48:31.277 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-09-21T12:48:31.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expand map: {default=false} 2023-09-21T12:48:31.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta from 'false' to 'false' 2023-09-21T12:48:31.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expanded map: {default=false} 2023-09-21T12:48:31.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expand map: {default=info} 2023-09-21T12:48:31.278 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta from 'info' to 'info' 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expanded map: {default=info} 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expand map: {default=daemon} 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expanded map: {default=daemon} 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expand map: {default=debug} 2023-09-21T12:48:31.279 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta from 'debug' to 'debug' 2023-09-21T12:48:31.280 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 ceph-mon[134078]: expand_channel_meta expanded map: {default=debug} 2023-09-21T12:48:31.280 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:31 smithi156 systemd[1]: Started Ceph mon.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:48:36.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:36.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: mon.a calling monitor election 2023-09-21T12:48:36.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: mon.c calling monitor election 2023-09-21T12:48:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:36.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: fsmap 2023-09-21T12:48:36.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:36.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: mgrmap e13: x(active, since 55s) 2023-09-21T12:48:36.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:36.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: mon.a calling monitor election 2023-09-21T12:48:36.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: mon.c calling monitor election 2023-09-21T12:48:36.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:36.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:36.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:36.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:36.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:36.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:36.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: fsmap 2023-09-21T12:48:36.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:36.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: mgrmap e13: x(active, since 55s) 2023-09-21T12:48:36.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-21T12:48:36.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-21T12:48:36.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-21T12:48:36.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-09-21T12:48:36.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:36.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:36.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:37.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:37.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:37 smithi142 ceph-mon[97663]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:37.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:37.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:37.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:37.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:37 smithi160 ceph-mon[134450]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:37.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:37.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:37.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- 172.21.15.160:0/4067762948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be40062a0 msgr2=0x7f7be40086d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:37.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4067762948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be40062a0 0x7f7be40086d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8100970 tx=0x7f7be800fe90 comp rx=0 tx=0).stop 2023-09-21T12:48:37.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- 172.21.15.160:0/4067762948 shutdown_connections 2023-09-21T12:48:37.731 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4067762948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7be40062a0 0x7f7be40086d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:37.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- 172.21.15.160:0/4067762948 >> 172.21.15.160:0/4067762948 conn(0x7f7bf80fb3e0 msgr2=0x7f7bf80fd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:37.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- 172.21.15.160:0/4067762948 shutdown_connections 2023-09-21T12:48:37.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- 172.21.15.160:0/4067762948 wait complete. 2023-09-21T12:48:37.732 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 Processor -- start 2023-09-21T12:48:37.733 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.731+0000 7f7bffac9700 1 -- start start 2023-09-21T12:48:37.735 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:37.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 0x7f7bf81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:37.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:37.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81a2aa0 con 0x7f7bf8197430 2023-09-21T12:48:37.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81a2c10 con 0x7f7bf819ff60 2023-09-21T12:48:37.736 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bffac9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf81a2dd0 con 0x7f7be40062a0 2023-09-21T12:48:37.737 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:37.737 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57590/0 (socket says 172.21.15.160:57590) 2023-09-21T12:48:37.737 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 -- 172.21.15.160:0/4014279010 learned_addr learned my addr 172.21.15.160:0/4014279010 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:48:37.737 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 msgr2=0x7f7bf8196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-09-21T12:48:37.738 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 msgr2=0x7f7bf8196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-21T12:48:37.738 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T12:48:37.738 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfe066700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:37.738 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 0x7f7bf81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:37.738 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd865700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:48:37.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfe066700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 msgr2=0x7f7bf81a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-09-21T12:48:37.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfe066700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 msgr2=0x7f7bf81a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-21T12:48:37.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfe066700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-21T12:48:37.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfe066700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:48:37.739 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 msgr2=0x7f7bf8196ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:48:37.740 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:37.740 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 msgr2=0x7f7bf81a2350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:48:37.740 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:37.740 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.732+0000 7f7bfd064700 1 -- 172.21.15.160:0/4014279010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be800f8e0 con 0x7f7bf8197430 2023-09-21T12:48:37.740 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7bfd064700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 0x7f7bf81978b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b550 tx=0x7f7bf400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:37.741 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4004230 con 0x7f7bf8197430 2023-09-21T12:48:37.741 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf8194e00 con 0x7f7bf8197430 2023-09-21T12:48:37.741 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bf4004390 con 0x7f7bf8197430 2023-09-21T12:48:37.741 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4011af0 con 0x7f7bf8197430 2023-09-21T12:48:37.741 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.733+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf8195350 con 0x7f7bf8197430 2023-09-21T12:48:37.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.734+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf8062410 con 0x7f7bf8197430 2023-09-21T12:48:37.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.736+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7f7bf40036a0 con 0x7f7bf8197430 2023-09-21T12:48:37.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.736+0000 7f7beeffd700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 0x7f7bdc03ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:37.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.736+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7bf404af90 con 0x7f7bf8197430 2023-09-21T12:48:37.742 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.736+0000 7f7bfd865700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 0x7f7bdc03ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:37.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.737+0000 7f7bfd865700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 0x7f7bdc03ad40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7be800f550 tx=0x7f7be800f4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:37.743 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:37.741+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7bf4004500 con 0x7f7bf8197430 2023-09-21T12:48:38.031 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.032+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7bf8107700 con 0x7f7bf8197430 2023-09-21T12:48:38.032 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.032+0000 7f7beeffd700 1 -- 172.21.15.160:0/4014279010 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7f7bf403e090 con 0x7f7bf8197430 2023-09-21T12:48:38.032 INFO:teuthology.orchestra.run.smithi160.stdout: 2023-09-21T12:48:38.033 INFO:teuthology.orchestra.run.smithi160.stdout:{"epoch":3,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","modified":"2023-09-21T12:48:31.152930Z","created":"2023-09-21T12:46:35.369491Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:3300","nonce":0},{"type":"v1","addr":"172.21.15.142:6789","nonce":0}]},"addr":"172.21.15.142:6789/0","public_addr":"172.21.15.142:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:3300","nonce":0},{"type":"v1","addr":"172.21.15.160:6789","nonce":0}]},"addr":"172.21.15.160:6789/0","public_addr":"172.21.15.160:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:3300","nonce":0},{"type":"v1","addr":"172.21.15.156:6789","nonce":0}]},"addr":"172.21.15.156:6789/0","public_addr":"172.21.15.156:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-21T12:48:38.034 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 msgr2=0x7f7bdc03ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:38.034 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 0x7f7bdc03ad40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7be800f550 tx=0x7f7be800f4a0 comp rx=0 tx=0).stop 2023-09-21T12:48:38.035 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 msgr2=0x7f7bf81978b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:38.035 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 0x7f7bf81978b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b550 tx=0x7f7bf400b910 comp rx=0 tx=0).stop 2023-09-21T12:48:38.035 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 shutdown_connections 2023-09-21T12:48:38.035 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7bdc038880 0x7f7bdc03ad40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:38.035 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7bf819ff60 0x7f7bf81a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:38.036 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7be40062a0 0x7f7bf8196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:38.036 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 --2- 172.21.15.160:0/4014279010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7bf8197430 0x7f7bf81978b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:38.036 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 >> 172.21.15.160:0/4014279010 conn(0x7f7bf80fb3e0 msgr2=0x7f7bf8101470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:38.036 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.034+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 shutdown_connections 2023-09-21T12:48:38.037 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:38.035+0000 7f7bffac9700 1 -- 172.21.15.160:0/4014279010 wait complete. 2023-09-21T12:48:38.037 INFO:teuthology.orchestra.run.smithi160.stderr:dumped monmap epoch 3 2023-09-21T12:48:38.423 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-09-21T12:48:38.424 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph config generate-minimal-conf 2023-09-21T12:48:38.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:48:38.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.a calling monitor election 2023-09-21T12:48:38.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.c calling monitor election 2023-09-21T12:48:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:48:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:38.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:38.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-21T12:48:38.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:38.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: fsmap 2023-09-21T12:48:38.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:38.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mgrmap e13: x(active, since 55s) 2023-09-21T12:48:38.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-21T12:48:38.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-21T12:48:38.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-21T12:48:38.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.b (rank 2) addr [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] is down (out of quorum) 2023-09-21T12:48:38.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:38.660 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:38.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:38.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:38.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:38.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:38.661 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:39.165 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:39.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.b calling monitor election 2023-09-21T12:48:39.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.b calling monitor election 2023-09-21T12:48:39.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.c calling monitor election 2023-09-21T12:48:39.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.a calling monitor election 2023-09-21T12:48:39.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-21T12:48:39.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:39.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: fsmap 2023-09-21T12:48:39.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:39.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: mgrmap e13: x(active, since 57s) 2023-09-21T12:48:39.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-21T12:48:39.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Cluster is now healthy 2023-09-21T12:48:39.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: overall HEALTH_OK 2023-09-21T12:48:39.411 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.412 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:39.413 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.414 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.415 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mon.b calling monitor election 2023-09-21T12:48:39.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mon.b calling monitor election 2023-09-21T12:48:39.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mon.c calling monitor election 2023-09-21T12:48:39.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mon.a calling monitor election 2023-09-21T12:48:39.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-21T12:48:39.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:39.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: fsmap 2023-09-21T12:48:39.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:39.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: mgrmap e13: x(active, since 57s) 2023-09-21T12:48:39.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-21T12:48:39.421 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: Cluster is now healthy 2023-09-21T12:48:39.421 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: overall HEALTH_OK 2023-09-21T12:48:39.422 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.422 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.422 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.423 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.423 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:39.423 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.424 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.424 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.425 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mon.b calling monitor election 2023-09-21T12:48:39.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mon.b calling monitor election 2023-09-21T12:48:39.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mon.c calling monitor election 2023-09-21T12:48:39.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mon.a calling monitor election 2023-09-21T12:48:39.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-21T12:48:39.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: monmap e3: 3 mons at {a=[v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0],b=[v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0],c=[v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0]} removed_ranks: {} 2023-09-21T12:48:39.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: fsmap 2023-09-21T12:48:39.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: osdmap e4: 0 total, 0 up, 0 in 2023-09-21T12:48:39.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: mgrmap e13: x(active, since 57s) 2023-09-21T12:48:39.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-21T12:48:39.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: Cluster is now healthy 2023-09-21T12:48:39.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: overall HEALTH_OK 2023-09-21T12:48:39.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:39.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:48:39.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.442 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:39.443 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: Reconfiguring mon.a (unknown last config time)... 2023-09-21T12:48:40.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:40.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:40.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:40.340 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: Reconfiguring daemon mon.a on smithi142 2023-09-21T12:48:40.340 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:40.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: Reconfiguring mon.a (unknown last config time)... 2023-09-21T12:48:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: Reconfiguring daemon mon.a on smithi142 2023-09-21T12:48:40.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:40.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:40.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: Reconfiguring mon.a (unknown last config time)... 2023-09-21T12:48:40.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:40.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:40.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:40.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: Reconfiguring daemon mon.a on smithi142 2023-09-21T12:48:40.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:48:41.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.117+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/605789845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0106140 msgr2=0x7fd3e010dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:41.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.117+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/605789845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0106140 0x7fd3e010dd10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3d8009f90 tx=0x7fd3d800b330 comp rx=0 tx=0).stop 2023-09-21T12:48:41.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/605789845 shutdown_connections 2023-09-21T12:48:41.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/605789845 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0106140 0x7fd3e010dd10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/605789845 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0101060 0x7fd3e0101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/605789845 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101a10 0x7fd3e0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/605789845 >> 172.21.15.142:0/605789845 conn(0x7fd3e00fc8d0 msgr2=0x7fd3e00fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:41.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/605789845 shutdown_connections 2023-09-21T12:48:41.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.118+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/605789845 wait complete. 2023-09-21T12:48:41.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 Processor -- start 2023-09-21T12:48:41.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 -- start start 2023-09-21T12:48:41.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101060 0x7fd3e0199210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:41.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:41.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 0x7fd3e019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:41.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e019e1d0 con 0x7fd3e0101a10 2023-09-21T12:48:41.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e019e340 con 0x7fd3e0106140 2023-09-21T12:48:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.119+0000 7fd3e6bdc700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3e019e500 con 0x7fd3e0101060 2023-09-21T12:48:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3e5179700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 0x7fd3e019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56630/0 (socket says 172.21.15.142:56630) 2023-09-21T12:48:41.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 -- 172.21.15.142:0/2653597501 learned_addr learned my addr 172.21.15.142:0/2653597501 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:41.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3e4978700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101060 0x7fd3e0199210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:41.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 -- 172.21.15.142:0/2653597501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101060 msgr2=0x7fd3e0199210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:41.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101060 0x7fd3e0199210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 -- 172.21.15.142:0/2653597501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 msgr2=0x7fd3e019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:41.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 0x7fd3e019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 -- 172.21.15.142:0/2653597501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d4009520 con 0x7fd3e0101a10 2023-09-21T12:48:41.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3e5179700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 0x7fd3e019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:48:41.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.120+0000 7fd3dffff700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00ec70 tx=0x7fd3cc00ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:41.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.121+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc0099d0 con 0x7fd3e0101a10 2023-09-21T12:48:41.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.121+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3cc0044e0 con 0x7fd3e0101a10 2023-09-21T12:48:41.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.121+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3cc0095f0 con 0x7fd3e0101a10 2023-09-21T12:48:41.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.121+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3cc010430 con 0x7fd3e0101a10 2023-09-21T12:48:41.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.121+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d8009c40 con 0x7fd3e0101a10 2023-09-21T12:48:41.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.122+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7fd3cc004020 con 0x7fd3e0101a10 2023-09-21T12:48:41.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.122+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3e004eae0 con 0x7fd3e0101a10 2023-09-21T12:48:41.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.122+0000 7fd3ddffb700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 0x7fd3d003aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:41.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.122+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd3cc014070 con 0x7fd3e0101a10 2023-09-21T12:48:41.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.123+0000 7fd3e4978700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 0x7fd3d003aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:41.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.123+0000 7fd3e4978700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 0x7fd3d003aaf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009df0 tx=0x7fd3d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:41.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.128+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd3cc01f340 con 0x7fd3e0101a10 2023-09-21T12:48:41.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.327+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd3e0110fc0 con 0x7fd3e0101a10 2023-09-21T12:48:41.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.327+0000 7fd3ddffb700 1 -- 172.21.15.142:0/2653597501 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7fd3cc01f340 con 0x7fd3e0101a10 2023-09-21T12:48:41.327 INFO:teuthology.orchestra.run.smithi142.stdout:# minimal ceph.conf for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:41.328 INFO:teuthology.orchestra.run.smithi142.stdout:[global] 2023-09-21T12:48:41.328 INFO:teuthology.orchestra.run.smithi142.stdout: fsid = ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:48:41.328 INFO:teuthology.orchestra.run.smithi142.stdout: mon_host = [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] 2023-09-21T12:48:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.329+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 msgr2=0x7fd3d003aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.329+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 0x7fd3d003aaf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4009df0 tx=0x7fd3d4009260 comp rx=0 tx=0).stop 2023-09-21T12:48:41.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.329+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 msgr2=0x7fd3e0199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.329+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3cc00ec70 tx=0x7fd3cc00ef80 comp rx=0 tx=0).stop 2023-09-21T12:48:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 shutdown_connections 2023-09-21T12:48:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd3d0038630 0x7fd3d003aaf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd3e0106140 0x7fd3e019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3e0101060 0x7fd3e0199210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 --2- 172.21.15.142:0/2653597501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3e0101a10 0x7fd3e0199750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 >> 172.21.15.142:0/2653597501 conn(0x7fd3e00fc8d0 msgr2=0x7fd3e00fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:41.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 shutdown_connections 2023-09-21T12:48:41.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:41.330+0000 7fd3e6bdc700 1 -- 172.21.15.142:0/2653597501 wait complete. 2023-09-21T12:48:41.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:41.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:41.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:41.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:41 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2653597501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:41.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:41.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:41 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2653597501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:41.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:41.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:41.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:41.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:41 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2653597501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:41.851 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-09-21T12:48:41.852 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:48:41.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.conf 2023-09-21T12:48:41.923 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:48:41.924 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:42.032 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:48:42.033 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.conf 2023-09-21T12:48:42.063 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:48:42.063 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:42.130 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:48:42.131 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.conf 2023-09-21T12:48:42.165 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:48:42.166 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:48:42.233 INFO:tasks.cephadm:Adding mgr.x on smithi142 2023-09-21T12:48:42.233 INFO:tasks.cephadm:Adding mgr.y on smithi156 2023-09-21T12:48:42.234 INFO:tasks.cephadm:Adding mgr.z on smithi160 2023-09-21T12:48:42.234 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch apply mgr '3;smithi142=x;smithi156=y;smithi160=z' 2023-09-21T12:48:42.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: Reconfiguring mon.b (monmap changed)... 2023-09-21T12:48:42.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: Reconfiguring daemon mon.b on smithi156 2023-09-21T12:48:42.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:42.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:42.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:42.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: Reconfiguring mon.b (monmap changed)... 2023-09-21T12:48:42.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: Reconfiguring daemon mon.b on smithi156 2023-09-21T12:48:42.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:42.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:42.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:42.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: Reconfiguring mon.b (monmap changed)... 2023-09-21T12:48:42.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: Reconfiguring daemon mon.b on smithi156 2023-09-21T12:48:42.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:42.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-21T12:48:42.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-21T12:48:42.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:43.187 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:48:43.446 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: Reconfiguring mon.c (monmap changed)... 2023-09-21T12:48:43.447 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: Reconfiguring daemon mon.c on smithi160 2023-09-21T12:48:43.447 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:43.447 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.448 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.448 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:43.449 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:43.450 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:43.450 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: Reconfiguring mon.c (monmap changed)... 2023-09-21T12:48:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: Reconfiguring daemon mon.c on smithi160 2023-09-21T12:48:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:43.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:43.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:43.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: Reconfiguring mon.c (monmap changed)... 2023-09-21T12:48:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: Reconfiguring daemon mon.c on smithi160 2023-09-21T12:48:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:43.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:43.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:44.561 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 -- 172.21.15.160:0/4075752017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda78101940 msgr2=0x7fda781081f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:44.562 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/4075752017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda78101940 0x7fda781081f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fda7000b0a0 tx=0x7fda7000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.562 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 -- 172.21.15.160:0/4075752017 shutdown_connections 2023-09-21T12:48:44.562 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/4075752017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda780ffda0 0x7fda781001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.562 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/4075752017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda78101940 0x7fda781081f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.563 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/4075752017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda78101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.563 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 -- 172.21.15.160:0/4075752017 >> 172.21.15.160:0/4075752017 conn(0x7fda780fb360 msgr2=0x7fda780fd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:44.563 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 -- 172.21.15.160:0/4075752017 shutdown_connections 2023-09-21T12:48:44.563 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 -- 172.21.15.160:0/4075752017 wait complete. 2023-09-21T12:48:44.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.562+0000 7fda7c9c1700 1 Processor -- start 2023-09-21T12:48:44.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 -- start start 2023-09-21T12:48:44.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:44.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda781960b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:44.566 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda78101940 0x7fda7819d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:44.567 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819d700 con 0x7fda78101940 2023-09-21T12:48:44.567 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819d840 con 0x7fda78100fa0 2023-09-21T12:48:44.567 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7c9c1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda7819d9d0 con 0x7fda780ffda0 2023-09-21T12:48:44.567 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:44.567 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57602/0 (socket says 172.21.15.160:57602) 2023-09-21T12:48:44.568 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 -- 172.21.15.160:0/1986589197 learned_addr learned my addr 172.21.15.160:0/1986589197 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:48:44.568 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda75d9b700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda781960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:44.568 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 -- 172.21.15.160:0/1986589197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 msgr2=0x7fda781960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:44.568 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda781960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.568 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 -- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda78101940 msgr2=0x7fda7819d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:44.569 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda78101940 0x7fda7819d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.569 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 -- 172.21.15.160:0/1986589197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda70009d00 con 0x7fda780ffda0 2023-09-21T12:48:44.569 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda75d9b700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda781960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:48:44.569 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda7659c700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c9a0 tx=0x7fda6800cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:44.569 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68004220 con 0x7fda780ffda0 2023-09-21T12:48:44.570 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.563+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda68007d20 con 0x7fda780ffda0 2023-09-21T12:48:44.570 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda7819dcb0 con 0x7fda780ffda0 2023-09-21T12:48:44.570 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda68003d00 con 0x7fda780ffda0 2023-09-21T12:48:44.570 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda7819e1b0 con 0x7fda780ffda0 2023-09-21T12:48:44.571 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7fda6800f450 con 0x7fda780ffda0 2023-09-21T12:48:44.571 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7810b600 con 0x7fda780ffda0 2023-09-21T12:48:44.571 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.564+0000 7fda677fe700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 0x7fda6003aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:44.571 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.565+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fda6804aa50 con 0x7fda780ffda0 2023-09-21T12:48:44.571 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.565+0000 7fda75d9b700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 0x7fda6003aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:44.572 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.565+0000 7fda75d9b700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 0x7fda6003aaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005950 tx=0x7fda6c005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:44.572 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.569+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fda6801f710 con 0x7fda780ffda0 2023-09-21T12:48:44.770 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.770+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi142=x;smithi156=y;smithi160=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fda780697f0 con 0x7fda60038630 2023-09-21T12:48:44.777 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.778+0000 7fda677fe700 1 -- 172.21.15.160:0/1986589197 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fda780697f0 con 0x7fda60038630 2023-09-21T12:48:44.777 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mgr update... 2023-09-21T12:48:44.780 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 msgr2=0x7fda6003aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:44.780 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 0x7fda6003aaf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005950 tx=0x7fda6c005f50 comp rx=0 tx=0).stop 2023-09-21T12:48:44.780 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 msgr2=0x7fda78195b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:44.781 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fda6800c9a0 tx=0x7fda6800cd60 comp rx=0 tx=0).stop 2023-09-21T12:48:44.781 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 shutdown_connections 2023-09-21T12:48:44.781 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fda60038630 0x7fda6003aaf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.781 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda78101940 0x7fda7819d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.782 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda780ffda0 0x7fda78195b70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.782 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 --2- 172.21.15.160:0/1986589197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda78100fa0 0x7fda781960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:44.782 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 >> 172.21.15.160:0/1986589197 conn(0x7fda780fb360 msgr2=0x7fda780fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:44.782 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 shutdown_connections 2023-09-21T12:48:44.783 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:48:44.780+0000 7fda7c9c1700 1 -- 172.21.15.160:0/1986589197 wait complete. 2023-09-21T12:48:45.146 DEBUG:teuthology.orchestra.run.smithi156:mgr.y> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.y.service 2023-09-21T12:48:45.149 DEBUG:teuthology.orchestra.run.smithi160:mgr.z> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.z.service 2023-09-21T12:48:45.151 INFO:tasks.cephadm:Deploying OSDs... 2023-09-21T12:48:45.152 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:48:45.152 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/scratch_devs of=/dev/stdout 2023-09-21T12:48:45.181 INFO:journalctl@ceph.mgr.y.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:48:45.182 INFO:journalctl@ceph.mgr.z.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:48:45.196 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-21T12:48:45.196 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_1 2023-09-21T12:48:45.282 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-21T12:48:45.283 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:45.283 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-09-21T12:48:45.283 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:45.283 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:45.284 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-21 12:47:53.271933065 +0000 2023-09-21T12:48:45.284 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-21 12:42:11.735276557 +0000 2023-09-21T12:48:45.284 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-21 12:42:11.735276557 +0000 2023-09-21T12:48:45.284 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-21 12:42:11.706277077 +0000 2023-09-21T12:48:45.284 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-21T12:48:45.394 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-21T12:48:45.394 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-21T12:48:45.394 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000325519 s, 1.6 MB/s 2023-09-21T12:48:45.396 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-21T12:48:45.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:45 smithi160 ceph-mon[134450]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:45.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:45 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:45.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:45 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:45.442 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_2 2023-09-21T12:48:45.532 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-21T12:48:45.533 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:45.533 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-09-21T12:48:45.534 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:45.534 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:45.534 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-21 12:47:53.334931962 +0000 2023-09-21T12:48:45.535 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-21 12:42:12.544262047 +0000 2023-09-21T12:48:45.535 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-21 12:42:12.544262047 +0000 2023-09-21T12:48:45.535 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-21 12:42:12.515262567 +0000 2023-09-21T12:48:45.536 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-21T12:48:45.635 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:45 smithi142 ceph-mon[97663]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:45.635 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:45 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:45.636 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:45 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-21T12:48:45.641 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-21T12:48:45.642 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000310582 s, 1.6 MB/s 2023-09-21T12:48:45.644 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-21T12:48:45.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:45 smithi156 ceph-mon[134078]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:45.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:45 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:45.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:45 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:45.690 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_3 2023-09-21T12:48:45.774 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-21T12:48:45.775 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:45.775 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-09-21T12:48:45.775 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:45.775 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:45.775 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-21 12:47:53.393930928 +0000 2023-09-21T12:48:45.776 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-21 12:42:13.364247340 +0000 2023-09-21T12:48:45.776 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-21 12:42:13.364247340 +0000 2023-09-21T12:48:45.776 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-21 12:42:13.336247842 +0000 2023-09-21T12:48:45.776 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-21T12:48:45.882 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-21T12:48:45.883 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-21T12:48:45.883 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000295875 s, 1.7 MB/s 2023-09-21T12:48:45.884 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-21T12:48:45.930 DEBUG:teuthology.orchestra.run.smithi142:> stat /dev/vg_nvme/lv_4 2023-09-21T12:48:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-21T12:48:46.014 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:46.015 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-09-21T12:48:46.015 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:46.015 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:46.015 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-21 12:47:53.447929981 +0000 2023-09-21T12:48:46.015 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-21 12:42:14.196232418 +0000 2023-09-21T12:48:46.016 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-21 12:42:14.196232418 +0000 2023-09-21T12:48:46.016 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-21 12:42:14.168232921 +0000 2023-09-21T12:48:46.016 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-21T12:48:46.119 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records in 2023-09-21T12:48:46.120 INFO:teuthology.orchestra.run.smithi142.stderr:1+0 records out 2023-09-21T12:48:46.120 INFO:teuthology.orchestra.run.smithi142.stderr:512 bytes copied, 0.000430183 s, 1.2 MB/s 2023-09-21T12:48:46.122 DEBUG:teuthology.orchestra.run.smithi142:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-21T12:48:46.166 DEBUG:teuthology.orchestra.run.smithi156:> set -ex 2023-09-21T12:48:46.167 DEBUG:teuthology.orchestra.run.smithi156:> dd if=/scratch_devs of=/dev/stdout 2023-09-21T12:48:46.188 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-21T12:48:46.188 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_1 2023-09-21T12:48:46.250 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-21T12:48:46.250 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:46.250 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 388432 Links: 1 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-21 12:48:30.561407340 +0000 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-21 12:39:11.911292114 +0000 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-21 12:39:11.911292114 +0000 2023-09-21T12:48:46.251 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-21T12:48:46.252 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-21T12:48:46.322 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-21T12:48:46.322 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-21T12:48:46.322 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000130793 s, 3.9 MB/s 2023-09-21T12:48:46.323 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-21T12:48:46.385 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_2 2023-09-21T12:48:46.444 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-21T12:48:46.445 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:46.445 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 388473 Links: 1 2023-09-21T12:48:46.445 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:46.445 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:46.446 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-21 12:48:30.561407340 +0000 2023-09-21T12:48:46.446 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-21 12:39:12.412284748 +0000 2023-09-21T12:48:46.446 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-21 12:39:12.412284748 +0000 2023-09-21T12:48:46.446 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-21T12:48:46.447 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-21T12:48:46.515 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-21T12:48:46.515 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-21T12:48:46.515 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000133122 s, 3.8 MB/s 2023-09-21T12:48:46.516 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-21T12:48:46.577 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_3 2023-09-21T12:48:46.637 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-21T12:48:46.637 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:46.638 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 391390 Links: 1 2023-09-21T12:48:46.638 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:46.638 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:46.638 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-21 12:48:30.561407340 +0000 2023-09-21T12:48:46.638 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-21 12:39:12.902277543 +0000 2023-09-21T12:48:46.639 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-21 12:39:12.902277543 +0000 2023-09-21T12:48:46.639 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-21T12:48:46.639 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-21T12:48:46.705 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-21T12:48:46.706 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-21T12:48:46.706 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000134103 s, 3.8 MB/s 2023-09-21T12:48:46.707 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-21T12:48:46.767 DEBUG:teuthology.orchestra.run.smithi156:> stat /dev/vg_nvme/lv_4 2023-09-21T12:48:46.828 INFO:teuthology.orchestra.run.smithi156.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-21T12:48:46.828 INFO:teuthology.orchestra.run.smithi156.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:46.828 INFO:teuthology.orchestra.run.smithi156.stdout:Device: 6h/6d Inode: 388789 Links: 1 2023-09-21T12:48:46.829 INFO:teuthology.orchestra.run.smithi156.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:46.829 INFO:teuthology.orchestra.run.smithi156.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:46.829 INFO:teuthology.orchestra.run.smithi156.stdout:Access: 2023-09-21 12:48:30.561407340 +0000 2023-09-21T12:48:46.830 INFO:teuthology.orchestra.run.smithi156.stdout:Modify: 2023-09-21 12:39:13.401270206 +0000 2023-09-21T12:48:46.830 INFO:teuthology.orchestra.run.smithi156.stdout:Change: 2023-09-21 12:39:13.401270206 +0000 2023-09-21T12:48:46.831 INFO:teuthology.orchestra.run.smithi156.stdout: Birth: - 2023-09-21T12:48:46.831 DEBUG:teuthology.orchestra.run.smithi156:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-21T12:48:46.843 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi142=x;smithi156=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:46.843 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: Saving service mgr spec with placement smithi142=x;smithi156=y;smithi160=z;count:3 2023-09-21T12:48:46.843 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.844 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:46.844 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:46.845 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:46.845 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:46.845 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:46.846 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.846 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:46 smithi160 ceph-mon[134450]: Deploying daemon mgr.z on smithi160 2023-09-21T12:48:46.894 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi142=x;smithi156=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:46.895 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: Saving service mgr spec with placement smithi142=x;smithi156=y;smithi160=z;count:3 2023-09-21T12:48:46.895 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.895 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:46.895 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:46.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:46.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:46.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:46.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:46 smithi156 ceph-mon[134078]: Deploying daemon mgr.z on smithi160 2023-09-21T12:48:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records in 2023-09-21T12:48:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:1+0 records out 2023-09-21T12:48:46.898 INFO:teuthology.orchestra.run.smithi156.stderr:512 bytes copied, 0.000115229 s, 4.4 MB/s 2023-09-21T12:48:46.899 DEBUG:teuthology.orchestra.run.smithi156:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-21T12:48:46.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi142=x;smithi156=y;smithi160=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:46.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: Saving service mgr spec with placement smithi142=x;smithi156=y;smithi160=z;count:3 2023-09-21T12:48:46.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:46.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:46.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:46.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:46.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:46.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:46.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:46 smithi142 ceph-mon[97663]: Deploying daemon mgr.z on smithi160 2023-09-21T12:48:46.959 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2023-09-21T12:48:46.960 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2023-09-21T12:48:46.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-21T12:48:46.978 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2023-09-21T12:48:47.036 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-21T12:48:47.036 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:47.036 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 390417 Links: 1 2023-09-21T12:48:47.037 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:47.037 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:47.037 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-09-21 12:48:47.017133074 +0000 2023-09-21T12:48:47.037 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-09-21 12:39:11.473468219 +0000 2023-09-21T12:48:47.038 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-09-21 12:39:11.473468219 +0000 2023-09-21T12:48:47.038 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-09-21T12:48:47.038 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-21T12:48:47.111 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 systemd[1]: Starting Ceph mgr.z for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:48:47.114 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-09-21T12:48:47.114 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-09-21T12:48:47.115 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000213347 s, 2.4 MB/s 2023-09-21T12:48:47.116 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-21T12:48:47.176 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2023-09-21T12:48:47.234 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-21T12:48:47.235 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:47.235 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 383888 Links: 1 2023-09-21T12:48:47.235 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:47.235 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:47.236 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-09-21 12:48:47.017133074 +0000 2023-09-21T12:48:47.236 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-09-21 12:39:11.975459742 +0000 2023-09-21T12:48:47.236 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-09-21 12:39:11.975459742 +0000 2023-09-21T12:48:47.236 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-09-21T12:48:47.237 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-21T12:48:47.301 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-09-21T12:48:47.302 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-09-21T12:48:47.302 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000276939 s, 1.8 MB/s 2023-09-21T12:48:47.303 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-21T12:48:47.361 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2023-09-21T12:48:47.419 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-21T12:48:47.419 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:47.419 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 392207 Links: 1 2023-09-21T12:48:47.419 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:47.420 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:47.420 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-09-21 12:48:47.017133074 +0000 2023-09-21T12:48:47.420 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-09-21 12:39:12.487451097 +0000 2023-09-21T12:48:47.420 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-09-21 12:39:12.487451097 +0000 2023-09-21T12:48:47.420 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-09-21T12:48:47.421 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-21T12:48:47.486 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-09-21T12:48:47.486 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-09-21T12:48:47.486 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000229592 s, 2.2 MB/s 2023-09-21T12:48:47.487 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-21T12:48:47.545 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2023-09-21T12:48:47.602 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-21T12:48:47.603 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-21T12:48:47.603 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 6h/6d Inode: 387627 Links: 1 2023-09-21T12:48:47.603 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:48:47.603 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2023-09-21T12:48:47.603 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2023-09-21 12:48:47.017133074 +0000 2023-09-21T12:48:47.604 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2023-09-21 12:39:12.973442892 +0000 2023-09-21T12:48:47.604 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2023-09-21 12:39:12.973442892 +0000 2023-09-21T12:48:47.604 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: - 2023-09-21T12:48:47.604 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-21T12:48:47.630 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 podman[136407]: 2023-09-21T12:48:47.657 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2023-09-21T12:48:47.657 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2023-09-21T12:48:47.657 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000194621 s, 2.6 MB/s 2023-09-21T12:48:47.658 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-21T12:48:47.717 INFO:tasks.cephadm:Deploying osd.0 on smithi142 with /dev/vg_nvme/lv_4... 2023-09-21T12:48:47.718 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-21T12:48:47.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:47 smithi156 ceph-mon[134078]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:47 smithi142 ceph-mon[97663]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:47.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:47 smithi160 ceph-mon[134450]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:47.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 bash[136407]: cf06004fb71382fb158d7061ed4a2e32752d962965c1f6e4e916d4b46dcbef1a 2023-09-21T12:48:47.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 ceph-mgr[136590]: -- 172.21.15.160:0/1082359504 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cc9cd3f1e0 con 0x55cc9cd14c00 2023-09-21T12:48:47.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 systemd[1]: Started Ceph mgr.z for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:48:47.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:47.772+0000 7f500b9a7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:48:47.939 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:47.851+0000 7f500b9a7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:48:47.941 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:47.939+0000 7f500b9a7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:48:48.188 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.031+0000 7f500b9a7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:48:48.449 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:48.560 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.199+0000 7f500b9a7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:48:48.876 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.561+0000 7f500b9a7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:48:48.877 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.694+0000 7f500b9a7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:48:48.877 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.784+0000 7f500b9a7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:48:48.877 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:48.878 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:48.878 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:48.878 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:48.878 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:48.878 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:48.879 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:48.879 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-mon[134450]: Deploying daemon mgr.y on smithi156 2023-09-21T12:48:49.047 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.048 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.048 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.048 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:49.048 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:49.048 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:49.049 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:49.049 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:48 smithi142 ceph-mon[97663]: Deploying daemon mgr.y on smithi156 2023-09-21T12:48:49.113 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.114 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.114 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:49.114 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:49.114 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-21T12:48:49.115 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:49.115 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:49.115 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:48 smithi156 ceph-mon[134078]: Deploying daemon mgr.y on smithi156 2023-09-21T12:48:49.406 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:49 smithi156 systemd[1]: Starting Ceph mgr.y for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:48:49.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:48.878+0000 7f500b9a7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:48:49.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:49.295+0000 7f500b9a7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:48:49.870 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:49 smithi156 ceph-mon[134078]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:49.871 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:49 smithi156 podman[135538]: 2023-09-21T12:48:50.042 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:49 smithi160 ceph-mon[134450]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:50.043 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:49.960+0000 7f500b9a7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:48:50.155 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:49 smithi156 bash[135538]: 417de1d70747c611c05ed39e1169e41abc17cd70507f8d133f1862b1de2b7b55 2023-09-21T12:48:50.155 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:49 smithi156 ceph-mgr[135578]: -- 172.21.15.156:0/718581190 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556c8f7171e0 con 0x556c8f6ed000 2023-09-21T12:48:50.156 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:49 smithi156 systemd[1]: Started Ceph mgr.y for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:48:50.156 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.006+0000 7fbef6cb6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:48:50.156 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.086+0000 7fbef6cb6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:48:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:49 smithi142 ceph-mon[97663]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:50.438 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:50.043+0000 7f500b9a7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:48:50.459 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.176+0000 7fbef6cb6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:48:50.459 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.273+0000 7fbef6cb6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:48:50.459 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.460+0000 7fbef6cb6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:48:50.462 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-21T12:48:50.463 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-21T12:48:50.463 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2023-09-21T12:48:50.463 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2023-09-21T12:48:50.463 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296124 s, 354 MB/s 2023-09-21T12:48:50.463 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2023-09-21T12:48:51.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi142:vg_nvme/lv_4 2023-09-21T12:48:51.119 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:50.845+0000 7f500b9a7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:48:51.119 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:50.943+0000 7f500b9a7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:48:51.120 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.120 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.120 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.121 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.121 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:51.121 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:51.121 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.155 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:50.858+0000 7fbef6cb6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:48:51.156 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:51.002+0000 7fbef6cb6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:48:51.156 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:51.104+0000 7fbef6cb6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:48:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:51.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:51.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:51.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:51.418 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:51.120+0000 7f500b9a7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:48:51.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:51.213+0000 7fbef6cb6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:48:51.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:51.419+0000 7f500b9a7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:48:51.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:51.664+0000 7f500b9a7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:48:51.747 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:48:52.081 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:51.816+0000 7f500b9a7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:48:52.155 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:51.660+0000 7fbef6cb6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:48:52.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:52.345+0000 7fbef6cb6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:48:52.656 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:52.426+0000 7fbef6cb6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:48:52.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:52.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:52.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:52.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:52.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:52.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:52.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:52.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: Reconfiguring mgr.x (unknown last config time)... 2023-09-21T12:48:52.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:52.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:52.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:52.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: Reconfiguring daemon mgr.x on smithi142 2023-09-21T12:48:52.921 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:52 smithi142 ceph-mon[97663]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:53.107 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:52.082+0000 7f500b9a7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:48:53.108 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:52.784+0000 7f500b9a7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:48:53.108 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:52.914+0000 7f500b9a7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:48:53.110 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.110 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.111 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.111 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.111 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:53.111 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:53.112 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.112 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: Reconfiguring mgr.x (unknown last config time)... 2023-09-21T12:48:53.113 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:53.113 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:53.113 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:53.114 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: Reconfiguring daemon mgr.x on smithi142 2023-09-21T12:48:53.114 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:52 smithi160 ceph-mon[134450]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:53.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:53.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:53.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: Reconfiguring mgr.x (unknown last config time)... 2023-09-21T12:48:53.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-21T12:48:53.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-21T12:48:53.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:53.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: Reconfiguring daemon mgr.x on smithi142 2023-09-21T12:48:53.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:52 smithi156 ceph-mon[134078]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:53.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.303+0000 7fb219e3c700 1 -- 172.21.15.142:0/2249396254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 msgr2=0x7fb2141092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:53.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.303+0000 7fb219e3c700 1 --2- 172.21.15.142:0/2249396254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb2141092b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb20c009f90 tx=0x7fb20c00b330 comp rx=0 tx=0).stop 2023-09-21T12:48:53.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 -- 172.21.15.142:0/2249396254 shutdown_connections 2023-09-21T12:48:53.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 --2- 172.21.15.142:0/2249396254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb2141092b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:53.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 --2- 172.21.15.142:0/2249396254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 0x7fb214101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:53.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 --2- 172.21.15.142:0/2249396254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb214102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:53.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 -- 172.21.15.142:0/2249396254 >> 172.21.15.142:0/2249396254 conn(0x7fb2140fc3d0 msgr2=0x7fb2140fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:48:53.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 -- 172.21.15.142:0/2249396254 shutdown_connections 2023-09-21T12:48:53.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.304+0000 7fb219e3c700 1 -- 172.21.15.142:0/2249396254 wait complete. 2023-09-21T12:48:53.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 Processor -- start 2023-09-21T12:48:53.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 -- start start 2023-09-21T12:48:53.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 0x7fb214196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:53.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb2141971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:53.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb21419e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:53.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21419e800 con 0x7fb214102990 2023-09-21T12:48:53.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21419e940 con 0x7fb214100e70 2023-09-21T12:48:53.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.306+0000 7fb219e3c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb21419eb00 con 0x7fb214101fd0 2023-09-21T12:48:53.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb212ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb2141971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:53.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb212ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb2141971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:44818/0 (socket says 172.21.15.142:44818) 2023-09-21T12:48:53.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb212ffd700 1 -- 172.21.15.142:0/3681514689 learned_addr learned my addr 172.21.15.142:0/3681514689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:48:53.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb2137fe700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 0x7fb214196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:53.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb21419e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:53.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 -- 172.21.15.142:0/3681514689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 msgr2=0x7fb2141971c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:53.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb2141971c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:53.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 -- 172.21.15.142:0/3681514689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 msgr2=0x7fb214196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:48:53.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 0x7fb214196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:48:53.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 -- 172.21.15.142:0/3681514689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009c40 con 0x7fb214102990 2023-09-21T12:48:53.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb213fff700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb21419e230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb20c007930 tx=0x7fb20c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:53.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c00e040 con 0x7fb214102990 2023-09-21T12:48:53.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb20c008ef0 con 0x7fb214102990 2023-09-21T12:48:53.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.307+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0052a0 con 0x7fb214102990 2023-09-21T12:48:53.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.308+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21419ed80 con 0x7fb214102990 2023-09-21T12:48:53.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.308+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21419f1a0 con 0x7fb214102990 2023-09-21T12:48:53.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.309+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 13) v1 ==== 45388+0+0 (secure 0 0 0) 0x7fb20c01d470 con 0x7fb214102990 2023-09-21T12:48:53.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.309+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb214108400 con 0x7fb214102990 2023-09-21T12:48:53.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.309+0000 7fb210ff9700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 0x7fb1fc03aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:48:53.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.309+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb20c04c2a0 con 0x7fb214102990 2023-09-21T12:48:53.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.310+0000 7fb2137fe700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 0x7fb1fc03aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:48:53.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.310+0000 7fb2137fe700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 0x7fb1fc03aaf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb214197b60 tx=0x7fb204009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:48:53.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.315+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb20c025ba0 con 0x7fb214102990 2023-09-21T12:48:53.433 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:53.107+0000 7f500b9a7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:48:53.433 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:53.219+0000 7f500b9a7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:48:53.433 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:53.434+0000 7f500b9a7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:48:53.464 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:53.202+0000 7fbef6cb6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:48:53.464 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:53.292+0000 7fbef6cb6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:48:53.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:53.540+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb21402d2d0 con 0x7fb1fc038630 2023-09-21T12:48:53.740 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:53.465+0000 7fbef6cb6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:48:54.120 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:53.741+0000 7fbef6cb6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:48:54.120 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:53.971+0000 7fbef6cb6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:48:54.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-mon[134078]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:54.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:48:54.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:48:54.121 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:54.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:53 smithi142 ceph-mon[97663]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:54.269 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:48:54.270 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:48:54.270 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:54.271 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-mon[134450]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:48:54.271 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:48:54.272 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:48:54.272 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:54.383 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:54.121+0000 7fbef6cb6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:48:54.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:54.384+0000 7fbef6cb6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:48:54.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:48:54.300+0000 7f500b9a7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:48:54.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:54.994+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 14) v1 ==== 90296+0+0 (secure 0 0 0) 0x7fb20c02cd60 con 0x7fb214102990 2023-09-21T12:48:55.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:55.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:55.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:55.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:55.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: Standby manager daemon z started 2023-09-21T12:48:55.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:48:55.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:55.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:48:55.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:54 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:55.216 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:55.085+0000 7fbef6cb6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:48:55.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:55.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:55.217 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:55.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:55.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: Standby manager daemon z started 2023-09-21T12:48:55.218 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:48:55.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:55.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:48:55.219 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:54 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:55.263 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.264 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.264 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:48:55.264 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:48:55.264 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:48:55.264 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:48:55.265 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:55.265 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: Standby manager daemon z started 2023-09-21T12:48:55.265 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:48:55.265 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:55.265 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:48:55.266 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:54 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/514463457' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:55.522 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:55.217+0000 7fbef6cb6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:48:55.523 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:55.410+0000 7fbef6cb6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:48:55.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:55.523+0000 7fbef6cb6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:48:55.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:55.740+0000 7fbef6cb6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:48:56.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-mon[134078]: mgrmap e14: x(active, since 74s), standbys: z 2023-09-21T12:48:56.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:48:56.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:55 smithi142 ceph-mon[97663]: mgrmap e14: x(active, since 74s), standbys: z 2023-09-21T12:48:56.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:48:56.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:55 smithi160 ceph-mon[134450]: mgrmap e14: x(active, since 74s), standbys: z 2023-09-21T12:48:56.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:48:56.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:48:56.605+0000 7fbef6cb6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:48:57.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:57.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/300006858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]': finished 2023-09-21T12:48:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: osdmap e5: 1 total, 0 up, 1 in 2023-09-21T12:48:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:48:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: Standby manager daemon y started 2023-09-21T12:48:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:48:57.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:57.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:48:57.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:56 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/300006858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]': finished 2023-09-21T12:48:57.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: osdmap e5: 1 total, 0 up, 1 in 2023-09-21T12:48:57.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:48:57.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: Standby manager daemon y started 2023-09-21T12:48:57.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:48:57.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:57.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:48:57.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:56 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:57.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:57.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/300006858' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]: dispatch 2023-09-21T12:48:57.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7ea0a160-c930-4a0c-bec7-4613739a09d7"}]': finished 2023-09-21T12:48:57.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: osdmap e5: 1 total, 0 up, 1 in 2023-09-21T12:48:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:48:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: Standby manager daemon y started 2023-09-21T12:48:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:48:57.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:48:57.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:48:57.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:56 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/176157540' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:48:57.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:48:57.595+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mgrmap(e 15) v1 ==== 135204+0+0 (secure 0 0 0) 0x7fb20c005400 con 0x7fb214102990 2023-09-21T12:48:58.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:57 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/217652777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:48:58.418 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:57 smithi156 ceph-mon[134078]: mgrmap e15: x(active, since 77s), standbys: z, y 2023-09-21T12:48:58.419 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:48:58.420 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:57 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/217652777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:48:58.421 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:57 smithi142 ceph-mon[97663]: mgrmap e15: x(active, since 77s), standbys: z, y 2023-09-21T12:48:58.421 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:48:58.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:57 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/217652777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:48:58.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:57 smithi160 ceph-mon[134450]: mgrmap e15: x(active, since 77s), standbys: z, y 2023-09-21T12:48:58.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:48:59.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:48:59 smithi156 ceph-mon[134078]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:59.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:48:59 smithi142 ceph-mon[97663]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:48:59.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:48:59 smithi160 ceph-mon[134450]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:01 smithi156 ceph-mon[134078]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:01 smithi142 ceph-mon[97663]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:01 smithi160 ceph-mon[134450]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:03 smithi156 ceph-mon[134078]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:03 smithi142 ceph-mon[97663]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:03.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:03 smithi160 ceph-mon[134450]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:04.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-21T12:49:04.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-21T12:49:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-21T12:49:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:05 smithi156 ceph-mon[134078]: Deploying daemon osd.0 on smithi142 2023-09-21T12:49:05.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:05 smithi156 ceph-mon[134078]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:05 smithi142 ceph-mon[97663]: Deploying daemon osd.0 on smithi142 2023-09-21T12:49:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:05 smithi142 ceph-mon[97663]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:05 smithi160 ceph-mon[134450]: Deploying daemon osd.0 on smithi142 2023-09-21T12:49:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:05 smithi160 ceph-mon[134450]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:07 smithi156 ceph-mon[134078]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:07 smithi142 ceph-mon[97663]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:07 smithi160 ceph-mon[134450]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:09 smithi156 ceph-mon[134078]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:09.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:09 smithi142 ceph-mon[97663]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:09 smithi160 ceph-mon[134450]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:11.518 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.518 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.519 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:11 smithi142 ceph-mon[97663]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:11.519 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:11.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:11 smithi156 ceph-mon[134078]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:11 smithi160 ceph-mon[134450]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:13.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.657+0000 7fb210ff9700 1 -- 172.21.15.142:0/3681514689 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fb21402d2d0 con 0x7fb1fc038630 2023-09-21T12:49:13.657 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 0 on host 'smithi142' 2023-09-21T12:49:13.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 msgr2=0x7fb1fc03aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:13.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 0x7fb1fc03aaf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb214197b60 tx=0x7fb204009260 comp rx=0 tx=0).stop 2023-09-21T12:49:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 msgr2=0x7fb21419e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb21419e230 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb20c007930 tx=0x7fb20c004c80 comp rx=0 tx=0).stop 2023-09-21T12:49:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 shutdown_connections 2023-09-21T12:49:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb1fc038630 0x7fb1fc03aaf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb214102990 0x7fb21419e230 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb214100e70 0x7fb214196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 --2- 172.21.15.142:0/3681514689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb214101fd0 0x7fb2141971c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.659+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 >> 172.21.15.142:0/3681514689 conn(0x7fb2140fc3d0 msgr2=0x7fb214105540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:49:13.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.660+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 shutdown_connections 2023-09-21T12:49:13.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:49:13.660+0000 7fb219e3c700 1 -- 172.21.15.142:0/3681514689 wait complete. 2023-09-21T12:49:13.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:13.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.170 DEBUG:teuthology.orchestra.run.smithi142:osd.0> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.0.service 2023-09-21T12:49:14.175 INFO:tasks.cephadm:Deploying osd.1 on smithi156 with /dev/vg_nvme/lv_4... 2023-09-21T12:49:14.176 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-21T12:49:14.261 INFO:journalctl@ceph.osd.0.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:49:14.750 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:49:14.879 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.879 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.879 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:14.880 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:14 smithi142 ceph-mon[97663]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:14.880 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:14 smithi142 ceph-mon[97663]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:14 smithi156 ceph-mon[134078]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:14 smithi156 ceph-mon[134078]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:14.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:14.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:14.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:14 smithi160 ceph-mon[134450]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:14.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:14 smithi160 ceph-mon[134450]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-21T12:49:15.716 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:15.717 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-21T12:49:15.717 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: osdmap e6: 1 total, 0 up, 1 in 2023-09-21T12:49:15.717 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:15.717 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:15.717 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-mon[97663]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:15.718 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0[115994]: 2023-09-21T12:49:15.644+0000 7f68e76dc700 -1 osd.0 0 waiting for initial osdmap 2023-09-21T12:49:15.718 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:49:15 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0[115994]: 2023-09-21T12:49:15.648+0000 7f68dfcca700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:49:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-21T12:49:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: osdmap e6: 1 total, 0 up, 1 in 2023-09-21T12:49:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:15.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:15 smithi156 ceph-mon[134078]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-21T12:49:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: osdmap e6: 1 total, 0 up, 1 in 2023-09-21T12:49:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: from='osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:15 smithi160 ceph-mon[134450]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:49:16.227 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-21T12:49:16.227 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-21T12:49:16.228 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-09-21T12:49:16.228 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-09-21T12:49:16.228 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00833663 s, 1.3 GB/s 2023-09-21T12:49:16.228 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-09-21T12:49:16.688 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi156:vg_nvme/lv_4 2023-09-21T12:49:16.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:16 smithi156 ceph-mon[134078]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:49:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:16 smithi156 ceph-mon[134078]: osdmap e7: 1 total, 0 up, 1 in 2023-09-21T12:49:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:16 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:16 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:16 smithi142 ceph-mon[97663]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:49:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:16 smithi142 ceph-mon[97663]: osdmap e7: 1 total, 0 up, 1 in 2023-09-21T12:49:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:16 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:16 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:16 smithi160 ceph-mon[134450]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:49:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:16 smithi160 ceph-mon[134450]: osdmap e7: 1 total, 0 up, 1 in 2023-09-21T12:49:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:16 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:16.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:16 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:17.241 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:49:17.758 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:49:17.759 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:49:17.759 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:17.759 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] boot 2023-09-21T12:49:17.759 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: osdmap e8: 1 total, 1 up, 1 in 2023-09-21T12:49:17.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:17.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:17.761 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.761 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:17.761 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:17.761 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:49:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:49:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] boot 2023-09-21T12:49:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: osdmap e8: 1 total, 1 up, 1 in 2023-09-21T12:49:17.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:17.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:17.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:17.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:17.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:49:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:49:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-21T12:49:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: osd.0 [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] boot 2023-09-21T12:49:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: osdmap e8: 1 total, 1 up, 1 in 2023-09-21T12:49:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:49:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:17.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:17.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:17.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:17.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:18.445 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 -- 172.21.15.156:0/4158054902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4214101910 msgr2=0x7f42141081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:18.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 --2- 172.21.15.156:0/4158054902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4214101910 0x7f42141081c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f420c00b0d0 tx=0x7f420c00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 -- 172.21.15.156:0/4158054902 shutdown_connections 2023-09-21T12:49:18.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 --2- 172.21.15.156:0/4158054902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42140ffd70 0x7f4214100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.446 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 --2- 172.21.15.156:0/4158054902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4214101910 0x7f42141081c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 --2- 172.21.15.156:0/4158054902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214100f70 0x7f42141013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.445+0000 7f4218e5d700 1 -- 172.21.15.156:0/4158054902 >> 172.21.15.156:0/4158054902 conn(0x7f42140fb2f0 msgr2=0x7f42140fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:49:18.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- 172.21.15.156:0/4158054902 shutdown_connections 2023-09-21T12:49:18.447 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- 172.21.15.156:0/4158054902 wait complete. 2023-09-21T12:49:18.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 Processor -- start 2023-09-21T12:49:18.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- start start 2023-09-21T12:49:18.450 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4214100f70 0x7f421419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 0x7f421419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421419e710 con 0x7f4214100f70 2023-09-21T12:49:18.451 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421419e880 con 0x7f42140ffd70 2023-09-21T12:49:18.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.446+0000 7f4218e5d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421419ea40 con 0x7f4214101910 2023-09-21T12:49:18.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:18.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51346/0 (socket says 172.21.15.156:51346) 2023-09-21T12:49:18.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 -- 172.21.15.156:0/3572406360 learned_addr learned my addr 172.21.15.156:0/3572406360 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-21T12:49:18.452 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f4212d9d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 0x7f421419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:18.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 -- 172.21.15.156:0/3572406360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 msgr2=0x7f421419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:18.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 0x7f421419df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 -- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4214100f70 msgr2=0x7f421419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:18.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4214100f70 0x7f421419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:18.453 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 -- 172.21.15.156:0/3572406360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009d00 con 0x7f42140ffd70 2023-09-21T12:49:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f4212d9d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 0x7f421419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:49:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f421259c700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c970 tx=0x7f41fc00cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:49:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc004220 con 0x7f42140ffd70 2023-09-21T12:49:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41fc007d60 con 0x7f42140ffd70 2023-09-21T12:49:18.454 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f421419ed20 con 0x7f42140ffd70 2023-09-21T12:49:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc003d00 con 0x7f42140ffd70 2023-09-21T12:49:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.447+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f421419f170 con 0x7f42140ffd70 2023-09-21T12:49:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.448+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42141072f0 con 0x7f42140ffd70 2023-09-21T12:49:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.449+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 15) v1 ==== 135204+0+0 (secure 0 0 0) 0x7f41fc004380 con 0x7f42140ffd70 2023-09-21T12:49:18.455 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.450+0000 7f420b7fe700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 0x7f42000a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.450+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f41fc0ca0a0 con 0x7f42140ffd70 2023-09-21T12:49:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.450+0000 7f4211d9b700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 0x7f42000a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.451+0000 7f4211d9b700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 0x7f42000a2a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f420400a990 tx=0x7f4204005c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:49:18.456 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.454+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f41fc095640 con 0x7f42140ffd70 2023-09-21T12:49:18.651 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:18.651+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f421402d2e0 con 0x7f42000a05b0 2023-09-21T12:49:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:18 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi142 2023-09-21T12:49:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:18 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 17267M 2023-09-21T12:49:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:18 smithi142 ceph-mon[97663]: osdmap e9: 1 total, 1 up, 1 in 2023-09-21T12:49:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:18 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi142 2023-09-21T12:49:18.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:18 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 17267M 2023-09-21T12:49:18.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:18 smithi160 ceph-mon[134450]: osdmap e9: 1 total, 1 up, 1 in 2023-09-21T12:49:18.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:19.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:18 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi142 2023-09-21T12:49:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:18 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 17267M 2023-09-21T12:49:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:18 smithi156 ceph-mon[134078]: osdmap e9: 1 total, 1 up, 1 in 2023-09-21T12:49:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:19.783 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:19 smithi156 ceph-mon[134078]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:19.784 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:19 smithi156 ceph-mon[134078]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:19.784 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:19 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:19.784 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:19 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:19 smithi142 ceph-mon[97663]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:19 smithi142 ceph-mon[97663]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:19 smithi160 ceph-mon[134450]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:19 smithi160 ceph-mon[134450]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:19 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:19 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/1085736310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]': finished 2023-09-21T12:49:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: osdmap e10: 2 total, 1 up, 2 in 2023-09-21T12:49:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:21.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/45742897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/1085736310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]': finished 2023-09-21T12:49:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: osdmap e10: 2 total, 1 up, 2 in 2023-09-21T12:49:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/45742897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/1085736310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]: dispatch 2023-09-21T12:49:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6fbd4acd-e759-44ab-8f94-9cc17468eb03"}]': finished 2023-09-21T12:49:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: osdmap e10: 2 total, 1 up, 2 in 2023-09-21T12:49:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/45742897' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:23 smithi160 ceph-mon[134450]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:23 smithi156 ceph-mon[134078]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:24.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:23 smithi142 ceph-mon[97663]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:25 smithi160 ceph-mon[134450]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:26.004 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:25 smithi156 ceph-mon[134078]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:25 smithi142 ceph-mon[97663]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:27 smithi160 ceph-mon[134450]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:27 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-21T12:49:27.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:27 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:28.097 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:27 smithi156 ceph-mon[134078]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:28.097 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:27 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-21T12:49:28.097 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:27 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:27 smithi142 ceph-mon[97663]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:27 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-21T12:49:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:27 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:28.932 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:28 smithi156 ceph-mon[134078]: Deploying daemon osd.1 on smithi156 2023-09-21T12:49:28.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:28 smithi160 ceph-mon[134450]: Deploying daemon osd.1 on smithi156 2023-09-21T12:49:29.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:28 smithi142 ceph-mon[97663]: Deploying daemon osd.1 on smithi156 2023-09-21T12:49:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:29 smithi156 ceph-mon[134078]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:29 smithi142 ceph-mon[97663]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:29 smithi160 ceph-mon[134450]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:31 smithi156 ceph-mon[134078]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:31 smithi142 ceph-mon[97663]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:32.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:31 smithi160 ceph-mon[134450]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:32.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:32 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:32.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:32 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:32.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:32 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:32.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:32 smithi156 ceph-mon[134078]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:33.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:32 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:33.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:32 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:33.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:32 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:33.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:32 smithi142 ceph-mon[97663]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:32 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:32 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:32 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:33.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:32 smithi160 ceph-mon[134450]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:34.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.407+0000 7f420b7fe700 1 -- 172.21.15.156:0/3572406360 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f421402d2e0 con 0x7f42000a05b0 2023-09-21T12:49:34.408 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 1 on host 'smithi156' 2023-09-21T12:49:34.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 msgr2=0x7f42000a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:34.409 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 0x7f42000a2a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f420400a990 tx=0x7f4204005c80 comp rx=0 tx=0).stop 2023-09-21T12:49:34.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 msgr2=0x7f4214069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:34.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c970 tx=0x7f41fc00cd30 comp rx=0 tx=0).stop 2023-09-21T12:49:34.410 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 shutdown_connections 2023-09-21T12:49:34.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42000a05b0 0x7f42000a2a70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:34.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4214101910 0x7f421419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:34.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42140ffd70 0x7f4214069cf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:34.411 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 --2- 172.21.15.156:0/3572406360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4214100f70 0x7f421419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:34.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.409+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 >> 172.21.15.156:0/3572406360 conn(0x7f42140fb2f0 msgr2=0x7f4214104430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:49:34.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.410+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 shutdown_connections 2023-09-21T12:49:34.412 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:49:34.410+0000 7f4218e5d700 1 -- 172.21.15.156:0/3572406360 wait complete. 2023-09-21T12:49:34.830 DEBUG:teuthology.orchestra.run.smithi156:osd.1> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.1.service 2023-09-21T12:49:34.833 INFO:tasks.cephadm:Deploying osd.2 on smithi160 with /dev/vg_nvme/lv_4... 2023-09-21T12:49:34.833 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-21T12:49:34.863 INFO:journalctl@ceph.osd.1.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:49:35.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:35.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:35.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:35.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:35.401 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:49:35.905 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:49:35 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T12:49:35.809+0000 7fd6c7d2e640 -1 osd.1 0 log_to_monitors true 2023-09-21T12:49:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:36 smithi160 ceph-mon[134450]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:36 smithi160 ceph-mon[134450]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:36 smithi156 ceph-mon[134078]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:36 smithi156 ceph-mon[134078]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:36.908 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-21T12:49:36.909 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-21T12:49:36.909 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2023-09-21T12:49:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2023-09-21T12:49:36.910 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110395 s, 950 MB/s 2023-09-21T12:49:36.910 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2023-09-21T12:49:36.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:36 smithi142 ceph-mon[97663]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:36.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:36 smithi142 ceph-mon[97663]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-21T12:49:37.256 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi160:vg_nvme/lv_4 2023-09-21T12:49:37.810 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:49:37.905 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T12:49:37.642+0000 7fd6bd3a6700 -1 osd.1 0 waiting for initial osdmap 2023-09-21T12:49:37.906 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T12:49:37.646+0000 7fd6b7197700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:49:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-21T12:49:37.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: osdmap e11: 2 total, 1 up, 2 in 2023-09-21T12:49:37.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:37.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:37.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:37.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:37.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-21T12:49:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: osdmap e11: 2 total, 1 up, 2 in 2023-09-21T12:49:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:37.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:37.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:37.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-21T12:49:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: osdmap e11: 2 total, 1 up, 2 in 2023-09-21T12:49:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:37.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:49:37.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:37.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:37.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:37.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:37.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:38.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi156 2023-09-21T12:49:38.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 17168M 2023-09-21T12:49:38.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:49:38.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: osdmap e12: 2 total, 1 up, 2 in 2023-09-21T12:49:38.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:38.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:38.909 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi156 2023-09-21T12:49:38.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 17168M 2023-09-21T12:49:38.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:49:38.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: osdmap e12: 2 total, 1 up, 2 in 2023-09-21T12:49:38.910 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:38.911 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi156 2023-09-21T12:49:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 17168M 2023-09-21T12:49:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:49:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: osdmap e12: 2 total, 1 up, 2 in 2023-09-21T12:49:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:39.090 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 -- 172.21.15.160:0/3463554246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 msgr2=0x7f52981081c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 --2- 172.21.15.160:0/3463554246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f52981081c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f529000b0a0 tx=0x7f529000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 -- 172.21.15.160:0/3463554246 shutdown_connections 2023-09-21T12:49:39.091 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 --2- 172.21.15.160:0/3463554246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f52981081c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 --2- 172.21.15.160:0/3463554246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52980ffd70 0x7f5298100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 --2- 172.21.15.160:0/3463554246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5298100f70 0x7f52981013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 -- 172.21.15.160:0/3463554246 >> 172.21.15.160:0/3463554246 conn(0x7f52980fb2f0 msgr2=0x7f52980fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:49:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 -- 172.21.15.160:0/3463554246 shutdown_connections 2023-09-21T12:49:39.092 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.091+0000 7f529e0a9700 1 -- 172.21.15.160:0/3463554246 wait complete. 2023-09-21T12:49:39.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 Processor -- start 2023-09-21T12:49:39.095 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 -- start start 2023-09-21T12:49:39.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 0x7f5298196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:39.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5298100f70 0x7f52981971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:39.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:39.096 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819e7b0 con 0x7f52980ffd70 2023-09-21T12:49:39.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819e8f0 con 0x7f5298100f70 2023-09-21T12:49:39.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f529e0a9700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529819eab0 con 0x7f5298101910 2023-09-21T12:49:39.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:39.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57638/0 (socket says 172.21.15.160:57638) 2023-09-21T12:49:39.097 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 -- 172.21.15.160:0/4078329618 learned_addr learned my addr 172.21.15.160:0/4078329618 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:49:39.098 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f52977fe700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 0x7f5298196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:39.098 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5296ffd700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5298100f70 0x7f52981971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:39.098 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 -- 172.21.15.160:0/4078329618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5298100f70 msgr2=0x7f52981971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:39.098 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5298100f70 0x7f52981971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.098 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 -- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 msgr2=0x7f5298196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:39.099 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 0x7f5298196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:39.099 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f5297fff700 1 -- 172.21.15.160:0/4078329618 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5290009d00 con 0x7f5298101910 2023-09-21T12:49:39.099 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.092+0000 7f52977fe700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 0x7f5298196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:49:39.099 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f5297fff700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f529000b070 tx=0x7f5290004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:49:39.100 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000e040 con 0x7f5298101910 2023-09-21T12:49:39.100 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529819ed30 con 0x7f5298101910 2023-09-21T12:49:39.100 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5290009440 con 0x7f5298101910 2023-09-21T12:49:39.100 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290004020 con 0x7f5298101910 2023-09-21T12:49:39.100 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.093+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529819f1a0 con 0x7f5298101910 2023-09-21T12:49:39.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.094+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529810b5d0 con 0x7f5298101910 2023-09-21T12:49:39.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.095+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) v1 ==== 135204+0+0 (secure 0 0 0) 0x7f5290003a00 con 0x7f5298101910 2023-09-21T12:49:39.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.096+0000 7f5294ff9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 0x7f52800a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:49:39.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.096+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f52900cc030 con 0x7f5298101910 2023-09-21T12:49:39.101 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.096+0000 7f52977fe700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 0x7f52800a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:49:39.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.096+0000 7f52977fe700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 0x7f52800a2a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f528c005950 tx=0x7f528c0058e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:49:39.102 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.099+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5290097440 con 0x7f5298101910 2023-09-21T12:49:39.297 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:39.298+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5298069050 con 0x7f52800a05b0 2023-09-21T12:49:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:49:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:49:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:39.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:39.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] boot 2023-09-21T12:49:39.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: osdmap e13: 2 total, 2 up, 2 in 2023-09-21T12:49:39.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:39.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:39.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:39.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:49:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:49:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:39.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:39.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] boot 2023-09-21T12:49:39.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: osdmap e13: 2 total, 2 up, 2 in 2023-09-21T12:49:39.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:39.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:39.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:39.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:49:40.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:49:40.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-21T12:49:40.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:40.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: osd.1 [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] boot 2023-09-21T12:49:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: osdmap e13: 2 total, 2 up, 2 in 2023-09-21T12:49:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:49:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:49:40.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:49:40.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:40 smithi142 ceph-mon[97663]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:40 smithi142 ceph-mon[97663]: osdmap e14: 2 total, 2 up, 2 in 2023-09-21T12:49:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:40 smithi160 ceph-mon[134450]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:40 smithi160 ceph-mon[134450]: osdmap e14: 2 total, 2 up, 2 in 2023-09-21T12:49:41.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:40 smithi156 ceph-mon[134078]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:49:41.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:40 smithi156 ceph-mon[134078]: osdmap e14: 2 total, 2 up, 2 in 2023-09-21T12:49:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/3295634860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:41.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]': finished 2023-09-21T12:49:41.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: osdmap e15: 3 total, 2 up, 3 in 2023-09-21T12:49:41.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/3295634860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]': finished 2023-09-21T12:49:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: osdmap e15: 3 total, 2 up, 3 in 2023-09-21T12:49:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/3295634860' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]: dispatch 2023-09-21T12:49:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6abafec8-0f0f-46bd-a696-307d17b092ea"}]': finished 2023-09-21T12:49:42.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: osdmap e15: 3 total, 2 up, 3 in 2023-09-21T12:49:42.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:42.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:42 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/274624497' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:43.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:42 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/274624497' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:42 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/274624497' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:49:43.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:43 smithi160 ceph-mon[134450]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:43 smithi156 ceph-mon[134078]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:43 smithi142 ceph-mon[97663]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:45 smithi160 ceph-mon[134450]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:46.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:45 smithi156 ceph-mon[134078]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:45 smithi142 ceph-mon[97663]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:47.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:47 smithi160 ceph-mon[134450]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:47 smithi156 ceph-mon[134078]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:48.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:47 smithi142 ceph-mon[97663]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:48.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-21T12:49:48.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:49.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-21T12:49:49.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:49.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-21T12:49:49.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:49.886 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:49 smithi160 ceph-mon[134450]: Deploying daemon osd.2 on smithi160 2023-09-21T12:49:49.886 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:49 smithi160 ceph-mon[134450]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:49 smithi156 ceph-mon[134078]: Deploying daemon osd.2 on smithi160 2023-09-21T12:49:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:49 smithi156 ceph-mon[134078]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:49 smithi142 ceph-mon[97663]: Deploying daemon osd.2 on smithi160 2023-09-21T12:49:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:49 smithi142 ceph-mon[97663]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:51.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:51 smithi160 ceph-mon[134450]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:51 smithi156 ceph-mon[134078]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:51 smithi142 ceph-mon[97663]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:53.522 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:53 smithi160 ceph-mon[134450]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:53.522 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.523 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.523 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:53.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:53 smithi156 ceph-mon[134078]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:53.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:53 smithi142 ceph-mon[97663]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:54.994 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.994+0000 7f5294ff9700 1 -- 172.21.15.160:0/4078329618 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5298069050 con 0x7f52800a05b0 2023-09-21T12:49:54.995 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 2 on host 'smithi160' 2023-09-21T12:49:54.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 msgr2=0x7f52800a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:54.996 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 0x7f52800a2a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f528c005950 tx=0x7f528c0058e0 comp rx=0 tx=0).stop 2023-09-21T12:49:54.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 msgr2=0x7f529819e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:49:54.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f529000b070 tx=0x7f5290004d30 comp rx=0 tx=0).stop 2023-09-21T12:49:54.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 shutdown_connections 2023-09-21T12:49:54.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52800a05b0 0x7f52800a2a70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:54.997 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52980ffd70 0x7f5298196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:54.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5298101910 0x7f529819e1e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:54.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 --2- 172.21.15.160:0/4078329618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5298100f70 0x7f52981971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:49:54.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 >> 172.21.15.160:0/4078329618 conn(0x7f52980fb2f0 msgr2=0x7f5298068940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:49:54.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 shutdown_connections 2023-09-21T12:49:54.998 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:49:54.997+0000 7f529e0a9700 1 -- 172.21.15.160:0/4078329618 wait complete. 2023-09-21T12:49:55.391 DEBUG:teuthology.orchestra.run.smithi160:osd.2> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.2.service 2023-09-21T12:49:55.393 INFO:tasks.cephadm:Deploying osd.3 on smithi142 with /dev/vg_nvme/lv_3... 2023-09-21T12:49:55.394 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-21T12:49:55.422 INFO:journalctl@ceph.osd.2.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:49:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:55.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:55.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:55.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:49:56.119 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:49:56.640 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:49:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T12:49:56.354+0000 7fc036790640 -1 osd.2 0 log_to_monitors true 2023-09-21T12:49:56.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:56 smithi156 ceph-mon[134078]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:56.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:56 smithi156 ceph-mon[134078]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:56.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:56 smithi142 ceph-mon[97663]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:56.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:56 smithi142 ceph-mon[97663]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:56 smithi160 ceph-mon[134450]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:56 smithi160 ceph-mon[134450]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-21T12:49:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:57.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-21T12:49:57.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: osdmap e16: 3 total, 2 up, 3 in 2023-09-21T12:49:57.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:57.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:57 smithi156 ceph-mon[134078]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-21T12:49:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: osdmap e16: 3 total, 2 up, 3 in 2023-09-21T12:49:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:57 smithi142 ceph-mon[97663]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.938 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T12:49:57.651+0000 7fc02be08700 -1 osd.2 0 waiting for initial osdmap 2023-09-21T12:49:57.938 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T12:49:57.655+0000 7fc0253f8700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:49:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-21T12:49:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: osdmap e16: 3 total, 2 up, 3 in 2023-09-21T12:49:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: from='osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:57 smithi160 ceph-mon[134450]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:49:57.996 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-21T12:49:57.996 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-21T12:49:57.996 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2023-09-21T12:49:57.997 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2023-09-21T12:49:57.997 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0311221 s, 337 MB/s 2023-09-21T12:49:57.997 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2023-09-21T12:49:58.595 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi142:vg_nvme/lv_3 2023-09-21T12:49:58.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:49:58.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: osdmap e17: 3 total, 2 up, 3 in 2023-09-21T12:49:58.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:58.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:58.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:58.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:49:58.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: osdmap e17: 3 total, 2 up, 3 in 2023-09-21T12:49:58.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:58.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:58.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:58.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:49:58.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: osdmap e17: 3 total, 2 up, 3 in 2023-09-21T12:49:58.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:58.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:49:58.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:58.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:49:58.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:49:58.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:49:59.325 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:49:59.852 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:49:59.852 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:49:59.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi160 2023-09-21T12:49:59.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 17168M 2023-09-21T12:49:59.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:59.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] boot 2023-09-21T12:49:59.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: osdmap e18: 3 total, 3 up, 3 in 2023-09-21T12:49:59.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:49:59 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:59.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:49:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:49:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi160 2023-09-21T12:49:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 17168M 2023-09-21T12:49:59.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:59.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] boot 2023-09-21T12:49:59.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: osdmap e18: 3 total, 3 up, 3 in 2023-09-21T12:49:59.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:49:59 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:49:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:49:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:49:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi160 2023-09-21T12:49:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 17168M 2023-09-21T12:49:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-21T12:49:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: osd.2 [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] boot 2023-09-21T12:49:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: osdmap e18: 3 total, 3 up, 3 in 2023-09-21T12:49:59.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:49:59 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:50:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1442626988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc0737c0 msgr2=0x7f1ecc073c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1442626988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc073c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009990 tx=0x7f1ec0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1442626988 shutdown_connections 2023-09-21T12:50:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1442626988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 0x7f1ecc10b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1442626988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc074d90 0x7f1ecc0731f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1442626988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc073c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1442626988 >> 172.21.15.142:0/1442626988 conn(0x7f1ecc0fc460 msgr2=0x7f1ecc0fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:50:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1442626988 shutdown_connections 2023-09-21T12:50:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.767+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1442626988 wait complete. 2023-09-21T12:50:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.768+0000 7f1ed1d4d700 1 Processor -- start 2023-09-21T12:50:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.768+0000 7f1ed1d4d700 1 -- start start 2023-09-21T12:50:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 0x7f1ecc1a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1a0860 con 0x7f1ecc108de0 2023-09-21T12:50:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1a09a0 con 0x7f1ecc074d90 2023-09-21T12:50:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ed1d4d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ecc1a0b60 con 0x7f1ecc0737c0 2023-09-21T12:50:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 0x7f1ecc1a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34760/0 (socket says 172.21.15.142:34760) 2023-09-21T12:50:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecaffd700 1 -- 172.21.15.142:0/1114408966 learned_addr learned my addr 172.21.15.142:0/1114408966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:50:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 -- 172.21.15.142:0/1114408966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 msgr2=0x7f1ecc199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 -- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 msgr2=0x7f1ecc1a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 0x7f1ecc1a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecb7fe700 1 -- 172.21.15.142:0/1114408966 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ebc009520 con 0x7f1ecc0737c0 2023-09-21T12:50:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.769+0000 7f1ecaffd700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:50:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ecb7fe700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc198d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e9f0 tx=0x7f1ebc00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc00cb70 con 0x7f1ecc0737c0 2023-09-21T12:50:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec00095f0 con 0x7f1ecc0737c0 2023-09-21T12:50:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ebc00ee90 con 0x7f1ecc0737c0 2023-09-21T12:50:00.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc003cf0 con 0x7f1ecc0737c0 2023-09-21T12:50:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.770+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ecc1a11b0 con 0x7f1ecc0737c0 2023-09-21T12:50:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.771+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ecc1074e0 con 0x7f1ecc0737c0 2023-09-21T12:50:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.773+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 15) v1 ==== 135204+0+0 (secure 0 0 0) 0x7f1ebc00ccd0 con 0x7f1ecc0737c0 2023-09-21T12:50:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.774+0000 7f1ec8ff9700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 0x7f1eb40a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.774+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f1ebc014070 con 0x7f1ecc0737c0 2023-09-21T12:50:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.775+0000 7f1ecaffd700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 0x7f1eb40a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.775+0000 7f1ecaffd700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 0x7f1eb40a2a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b2e0 tx=0x7f1ec0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:00.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.777+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1ebc095a20 con 0x7f1ecc0737c0 2023-09-21T12:50:00.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:00.991+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ecc02d230 con 0x7f1eb40a05b0 2023-09-21T12:50:01.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:00 smithi156 ceph-mon[134078]: overall HEALTH_OK 2023-09-21T12:50:01.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:00 smithi156 ceph-mon[134078]: osdmap e19: 3 total, 3 up, 3 in 2023-09-21T12:50:01.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:00 smithi142 ceph-mon[97663]: overall HEALTH_OK 2023-09-21T12:50:01.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:00 smithi142 ceph-mon[97663]: osdmap e19: 3 total, 3 up, 3 in 2023-09-21T12:50:01.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:00 smithi160 ceph-mon[134450]: overall HEALTH_OK 2023-09-21T12:50:01.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:00 smithi160 ceph-mon[134450]: osdmap e19: 3 total, 3 up, 3 in 2023-09-21T12:50:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: pgmap v79: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:02.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:02.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:02.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: osdmap e20: 3 total, 3 up, 3 in 2023-09-21T12:50:02.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: pgmap v79: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:02.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:02.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:02.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:02.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:02.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:02.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: osdmap e20: 3 total, 3 up, 3 in 2023-09-21T12:50:02.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: pgmap v79: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:02.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:02.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:02.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:02.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:02.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:02.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: osdmap e20: 3 total, 3 up, 3 in 2023-09-21T12:50:02.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T12:50:03.315 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:03.316 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:03 smithi142 ceph-mon[97663]: osdmap e21: 3 total, 3 up, 3 in 2023-09-21T12:50:03.316 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:03 smithi142 ceph-mon[97663]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:03.316 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121856]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:03.317 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121856]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:03.317 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121856]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:03.317 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121856]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:03.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:03.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:03 smithi156 ceph-mon[134078]: osdmap e21: 3 total, 3 up, 3 in 2023-09-21T12:50:03.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:03 smithi156 ceph-mon[134078]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:03.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-21T12:50:03.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:03 smithi160 ceph-mon[134450]: osdmap e21: 3 total, 3 up, 3 in 2023-09-21T12:50:03.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:03 smithi160 ceph-mon[134450]: pgmap v82: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:04.132 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121893]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:04.132 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121893]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:04.133 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121893]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:04.133 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 12:50:03 smithi142 sudo[121893]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:04.369 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144077]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:04.369 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144077]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:04.369 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144077]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:04.370 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144077]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:04.370 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: osdmap e22: 3 total, 3 up, 3 in 2023-09-21T12:50:04.370 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:04.370 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/312007617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.371 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.371 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]': finished 2023-09-21T12:50:04.371 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: osdmap e23: 4 total, 3 up, 4 in 2023-09-21T12:50:04.371 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:04.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: osdmap e22: 3 total, 3 up, 3 in 2023-09-21T12:50:04.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:04.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/312007617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]': finished 2023-09-21T12:50:04.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: osdmap e23: 4 total, 3 up, 4 in 2023-09-21T12:50:04.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:04.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: osdmap e22: 3 total, 3 up, 3 in 2023-09-21T12:50:04.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:04.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/312007617' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]: dispatch 2023-09-21T12:50:04.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff8696c6-6583-4072-a479-2d6d0ce9ca37"}]': finished 2023-09-21T12:50:04.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: osdmap e23: 4 total, 3 up, 4 in 2023-09-21T12:50:04.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:04.655 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144080]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:04.655 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144080]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:04.656 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144080]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:04.656 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 12:50:04 smithi156 sudo[144080]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:04.889 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145717]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:04.889 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145717]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:04.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145717]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:04.890 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145717]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:05.188 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145720]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:05.188 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145720]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:05.188 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145720]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:05.188 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 12:50:04 smithi160 sudo[145720]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[121984]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[121984]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[121984]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:05.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[121984]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:06.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:05 smithi156 ceph-mon[134078]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:06.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/905253993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:06.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:05 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:06.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[122358]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:06.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[122358]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:06.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[122358]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:06.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 sudo[122358]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:06.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 ceph-mon[97663]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:06.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/905253993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:06.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:05 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:06.475 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145723]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:06.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145723]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:06.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145723]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:06.476 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145723]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:06.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:06.485+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1ebc095df0 con 0x7f1ecc0737c0 2023-09-21T12:50:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145726]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145726]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145726]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 sudo[145726]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: pgmap v85: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/905253993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:06.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144083]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-21T12:50:06.967 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144083]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:06.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144083]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:06.968 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144083]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:07.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144086]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-21T12:50:07.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144086]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-21T12:50:07.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144086]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-21T12:50:07.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 sudo[144086]: pam_unix(sudo:session): session closed for user root 2023-09-21T12:50:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-21T12:50:07.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.409 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.410 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:06 smithi156 ceph-mon[134078]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-21T12:50:07.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:07.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:06 smithi142 ceph-mon[97663]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-21T12:50:07.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:07.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:07.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-21T12:50:07.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:50:07.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:50:07.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:50:07.441 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:06 smithi160 ceph-mon[134450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-21T12:50:09.650 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:09 smithi142 ceph-mon[97663]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:09.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:09 smithi156 ceph-mon[134078]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:09.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:09 smithi160 ceph-mon[134450]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:11.637 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:11 smithi142 ceph-mon[97663]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-09-21T12:50:11.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:11 smithi156 ceph-mon[134078]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-09-21T12:50:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:11 smithi160 ceph-mon[134450]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.0 KiB/s rd, 196 KiB/s wr, 14 op/s 2023-09-21T12:50:12.649 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:12 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-21T12:50:12.650 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:12 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:12.651 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:12 smithi142 ceph-mon[97663]: Deploying daemon osd.3 on smithi142 2023-09-21T12:50:12.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:12 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-21T12:50:12.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:12 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:12.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:12 smithi156 ceph-mon[134078]: Deploying daemon osd.3 on smithi142 2023-09-21T12:50:12.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:12 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-21T12:50:12.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:12 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:12.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:12 smithi160 ceph-mon[134450]: Deploying daemon osd.3 on smithi142 2023-09-21T12:50:13.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:13 smithi156 ceph-mon[134078]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-09-21T12:50:13.658 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:13 smithi142 ceph-mon[97663]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-09-21T12:50:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:13 smithi160 ceph-mon[134450]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 131 KiB/s wr, 9 op/s 2023-09-21T12:50:15.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:15 smithi142 ceph-mon[97663]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-09-21T12:50:15.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:15 smithi156 ceph-mon[134078]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-09-21T12:50:15.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:15 smithi160 ceph-mon[134450]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.5 KiB/s rd, 98 KiB/s wr, 7 op/s 2023-09-21T12:50:17.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:16 smithi156 ceph-mon[134078]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-09-21T12:50:17.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:16 smithi142 ceph-mon[97663]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-09-21T12:50:17.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:16 smithi160 ceph-mon[134450]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 2.0 KiB/s rd, 78 KiB/s wr, 5 op/s 2023-09-21T12:50:19.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:19.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:18 smithi160 ceph-mon[134450]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:19.248 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.249 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.249 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:19.249 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:18 smithi142 ceph-mon[97663]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:19.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:19.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:19.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:18 smithi156 ceph-mon[134078]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:21.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.349+0000 7f1ec8ff9700 1 -- 172.21.15.142:0/1114408966 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1ecc02d230 con 0x7f1eb40a05b0 2023-09-21T12:50:21.350 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 3 on host 'smithi142' 2023-09-21T12:50:21.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 msgr2=0x7f1eb40a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:21.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 0x7f1eb40a2a70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ec000b2e0 tx=0x7f1ec0005fb0 comp rx=0 tx=0).stop 2023-09-21T12:50:21.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 msgr2=0x7f1ecc198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:21.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc198d10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00e9f0 tx=0x7f1ebc00ed00 comp rx=0 tx=0).stop 2023-09-21T12:50:21.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 shutdown_connections 2023-09-21T12:50:21.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1eb40a05b0 0x7f1eb40a2a70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:21.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1ecc108de0 0x7f1ecc1a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:21.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ecc0737c0 0x7f1ecc198d10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:21.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 --2- 172.21.15.142:0/1114408966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1ecc074d90 0x7f1ecc199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:21.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 >> 172.21.15.142:0/1114408966 conn(0x7f1ecc0fc460 msgr2=0x7f1ecc10b080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:50:21.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 shutdown_connections 2023-09-21T12:50:21.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:50:21.352+0000 7f1ed1d4d700 1 -- 172.21.15.142:0/1114408966 wait complete. 2023-09-21T12:50:21.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:21.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:21.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 65 KiB/s wr, 4 op/s 2023-09-21T12:50:21.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:21.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:21.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:21.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:21.848 DEBUG:teuthology.orchestra.run.smithi142:osd.3> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.3.service 2023-09-21T12:50:21.853 INFO:tasks.cephadm:Deploying osd.4 on smithi156 with /dev/vg_nvme/lv_3... 2023-09-21T12:50:21.853 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-21T12:50:21.941 INFO:journalctl@ceph.osd.3.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:50:22.166 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 12:50:21 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T12:50:21.940+0000 7f9bcb1d0640 -1 osd.3 0 log_to_monitors true 2023-09-21T12:50:22.419 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:50:22.629 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:22 smithi156 ceph-mon[134078]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-21T12:50:22.664 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:22 smithi142 ceph-mon[97663]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-21T12:50:22.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:22 smithi160 ceph-mon[134450]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-21T12:50:23.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:23 smithi156 ceph-mon[134078]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:23.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:23 smithi156 ceph-mon[134078]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-21T12:50:23.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:23 smithi156 ceph-mon[134078]: osdmap e24: 4 total, 3 up, 4 in 2023-09-21T12:50:23.437 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:23 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:23.438 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:23 smithi156 ceph-mon[134078]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:50:23.519 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-mon[97663]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:23.519 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-mon[97663]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-21T12:50:23.520 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-mon[97663]: osdmap e24: 4 total, 3 up, 4 in 2023-09-21T12:50:23.520 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:23.520 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-mon[97663]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:50:23.520 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T12:50:23.391+0000 7f9bc0848700 -1 osd.3 0 waiting for initial osdmap 2023-09-21T12:50:23.521 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 12:50:23 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T12:50:23.400+0000 7f9bba639700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:50:23.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:23 smithi160 ceph-mon[134450]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:23.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:23 smithi160 ceph-mon[134450]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-21T12:50:23.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:23 smithi160 ceph-mon[134450]: osdmap e24: 4 total, 3 up, 4 in 2023-09-21T12:50:23.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:23 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:23.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:23 smithi160 ceph-mon[134450]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:50:23.919 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-21T12:50:23.919 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-21T12:50:23.919 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-09-21T12:50:23.920 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-09-21T12:50:23.920 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00795474 s, 1.3 GB/s 2023-09-21T12:50:23.920 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-09-21T12:50:24.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi156:vg_nvme/lv_3 2023-09-21T12:50:24.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:50:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: osdmap e25: 4 total, 3 up, 4 in 2023-09-21T12:50:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] boot 2023-09-21T12:50:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: osdmap e26: 4 total, 4 up, 4 in 2023-09-21T12:50:24.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:50:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: osdmap e25: 4 total, 3 up, 4 in 2023-09-21T12:50:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] boot 2023-09-21T12:50:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: osdmap e26: 4 total, 4 up, 4 in 2023-09-21T12:50:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: from='osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:50:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: osdmap e25: 4 total, 3 up, 4 in 2023-09-21T12:50:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: osd.3 [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] boot 2023-09-21T12:50:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: osdmap e26: 4 total, 4 up, 4 in 2023-09-21T12:50:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:50:24.934 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:50:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:50:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:50:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:25.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:25 smithi156 ceph-mon[134078]: osdmap e27: 4 total, 4 up, 4 in 2023-09-21T12:50:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:50:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:50:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:25.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:25.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:25 smithi142 ceph-mon[97663]: osdmap e27: 4 total, 4 up, 4 in 2023-09-21T12:50:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:50:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:50:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-21T12:50:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:25.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:25.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:25.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:25 smithi160 ceph-mon[134450]: osdmap e27: 4 total, 4 up, 4 in 2023-09-21T12:50:26.230 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 -- 172.21.15.156:0/2218001353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310100f70 msgr2=0x7f13101013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:26.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 --2- 172.21.15.156:0/2218001353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310100f70 0x7f13101013d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13000099c0 tx=0x7f1300009cd0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.231 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 -- 172.21.15.156:0/2218001353 shutdown_connections 2023-09-21T12:50:26.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 --2- 172.21.15.156:0/2218001353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13100ffd70 0x7f1310100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 --2- 172.21.15.156:0/2218001353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1310101910 0x7f13101081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 --2- 172.21.15.156:0/2218001353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310100f70 0x7f13101013d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.232 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 -- 172.21.15.156:0/2218001353 >> 172.21.15.156:0/2218001353 conn(0x7f13100fb2f0 msgr2=0x7f13100fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:50:26.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 -- 172.21.15.156:0/2218001353 shutdown_connections 2023-09-21T12:50:26.233 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 -- 172.21.15.156:0/2218001353 wait complete. 2023-09-21T12:50:26.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.231+0000 7f1315107700 1 Processor -- start 2023-09-21T12:50:26.236 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 -- start start 2023-09-21T12:50:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13100ffd70 0x7f1310069c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1310100f70 0x7f131019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019e6f0 con 0x7f1310100f70 2023-09-21T12:50:26.237 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019e860 con 0x7f1310101910 2023-09-21T12:50:26.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f1315107700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f131019ea20 con 0x7f13100ffd70 2023-09-21T12:50:26.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:26.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51426/0 (socket says 172.21.15.156:51426) 2023-09-21T12:50:26.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 -- 172.21.15.156:0/3497187431 learned_addr learned my addr 172.21.15.156:0/3497187431 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-21T12:50:26.238 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130ed9d700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13100ffd70 0x7f1310069c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 -- 172.21.15.156:0/3497187431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13100ffd70 msgr2=0x7f1310069c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13100ffd70 0x7f1310069c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 -- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1310100f70 msgr2=0x7f131019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:26.239 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1310100f70 0x7f131019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 -- 172.21.15.156:0/3497187431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000095f0 con 0x7f1310101910 2023-09-21T12:50:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.232+0000 7f130f59e700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f130800b970 tx=0x7f130800bc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.233+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130800c930 con 0x7f1310101910 2023-09-21T12:50:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.233+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f131019ed00 con 0x7f1310101910 2023-09-21T12:50:26.240 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.233+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1308014440 con 0x7f1310101910 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.233+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13080075d0 con 0x7f1310101910 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.233+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f131019f1b0 con 0x7f1310101910 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.234+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1310107390 con 0x7f1310101910 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.235+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f13080145b0 con 0x7f1310101910 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.235+0000 7f12f7fff700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 0x7f12f80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:26.241 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.235+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f1308006e40 con 0x7f1310101910 2023-09-21T12:50:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.235+0000 7f130ed9d700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 0x7f12f80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.236+0000 7f130ed9d700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 0x7f12f80a2b00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1310100dd0 tx=0x7f130400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:26.242 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.240+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f130804ee10 con 0x7f1310101910 2023-09-21T12:50:26.442 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:26.442+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f131002d230 con 0x7f12f80a0640 2023-09-21T12:50:26.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:26 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi142 2023-09-21T12:50:26.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:26 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 8633M 2023-09-21T12:50:26.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:26 smithi156 ceph-mon[134078]: osdmap e28: 4 total, 4 up, 4 in 2023-09-21T12:50:26.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:26 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi142 2023-09-21T12:50:26.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:26 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 8633M 2023-09-21T12:50:26.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:26 smithi142 ceph-mon[97663]: osdmap e28: 4 total, 4 up, 4 in 2023-09-21T12:50:26.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:26 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi142 2023-09-21T12:50:26.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:26 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 8633M 2023-09-21T12:50:26.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:26 smithi160 ceph-mon[134450]: osdmap e28: 4 total, 4 up, 4 in 2023-09-21T12:50:27.556 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:27 smithi156 ceph-mon[134078]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:27.557 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:27 smithi156 ceph-mon[134078]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:27.557 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:27 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:27.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:27 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:27.558 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:27 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:27.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:27 smithi142 ceph-mon[97663]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:27.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:27 smithi142 ceph-mon[97663]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:27.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:27 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:27.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:27 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:27.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:27 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:27.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:27 smithi160 ceph-mon[134450]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:27.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:27 smithi160 ceph-mon[134450]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:27.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:27 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:27.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:27 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:27.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:27 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:28.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:28 smithi142 ceph-mon[97663]: osdmap e29: 4 total, 4 up, 4 in 2023-09-21T12:50:28.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:28 smithi160 ceph-mon[134450]: osdmap e29: 4 total, 4 up, 4 in 2023-09-21T12:50:28.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:28 smithi156 ceph-mon[134078]: osdmap e29: 4 total, 4 up, 4 in 2023-09-21T12:50:29.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:29.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: osdmap e30: 4 total, 4 up, 4 in 2023-09-21T12:50:29.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/1369302061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]': finished 2023-09-21T12:50:29.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: osdmap e31: 5 total, 4 up, 5 in 2023-09-21T12:50:29.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:29.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:29 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/3954308470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:29.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:29.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: osdmap e30: 4 total, 4 up, 4 in 2023-09-21T12:50:29.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/1369302061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]': finished 2023-09-21T12:50:29.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: osdmap e31: 5 total, 4 up, 5 in 2023-09-21T12:50:29.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:29.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:29 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/3954308470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: pgmap v103: 1 pgs: 1 remapped+peering; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: osdmap e30: 4 total, 4 up, 4 in 2023-09-21T12:50:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/1369302061' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]: dispatch 2023-09-21T12:50:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6992ad1c-863b-4ac1-8916-f4639f26cc5a"}]': finished 2023-09-21T12:50:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: osdmap e31: 5 total, 4 up, 5 in 2023-09-21T12:50:29.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:29.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:29 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/3954308470' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:31.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:31 smithi142 ceph-mon[97663]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:50:31.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:31 smithi160 ceph-mon[134450]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:50:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:31 smithi156 ceph-mon[134078]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:50:33.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:33 smithi160 ceph-mon[134450]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-09-21T12:50:33.773 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:33 smithi156 ceph-mon[134078]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-09-21T12:50:33.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:33 smithi142 ceph-mon[97663]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 97 KiB/s, 0 objects/s recovering 2023-09-21T12:50:35.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:35 smithi160 ceph-mon[134450]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-09-21T12:50:35.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:35 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-21T12:50:35.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:35 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:35.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:35 smithi156 ceph-mon[134078]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-09-21T12:50:35.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:35 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-21T12:50:35.760 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:35 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:35.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:35 smithi142 ceph-mon[97663]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2023-09-21T12:50:35.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:35 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-21T12:50:35.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:35 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:36.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:36 smithi160 ceph-mon[134450]: Deploying daemon osd.4 on smithi156 2023-09-21T12:50:36.688 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:36 smithi156 ceph-mon[134078]: Deploying daemon osd.4 on smithi156 2023-09-21T12:50:36.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:36 smithi142 ceph-mon[97663]: Deploying daemon osd.4 on smithi156 2023-09-21T12:50:37.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:37 smithi160 ceph-mon[134450]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:50:37.705 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:37 smithi156 ceph-mon[134078]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:50:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:37 smithi142 ceph-mon[97663]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:50:39.569 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:39 smithi156 ceph-mon[134078]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-21T12:50:39.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:39 smithi160 ceph-mon[134450]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-21T12:50:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:39 smithi142 ceph-mon[97663]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-09-21T12:50:40.770 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.771 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.771 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:41 smithi156 ceph-mon[134078]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-09-21T12:50:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:41 smithi142 ceph-mon[97663]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-09-21T12:50:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:41 smithi160 ceph-mon[134450]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-09-21T12:50:42.403 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.403+0000 7f12f7fff700 1 -- 172.21.15.156:0/3497187431 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f131002d230 con 0x7f12f80a0640 2023-09-21T12:50:42.404 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 4 on host 'smithi156' 2023-09-21T12:50:42.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.405+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 msgr2=0x7f12f80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:42.405 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.405+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 0x7f12f80a2b00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1310100dd0 tx=0x7f130400a380 comp rx=0 tx=0).stop 2023-09-21T12:50:42.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.405+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 msgr2=0x7f131019df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:42.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.405+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f130800b970 tx=0x7f130800bc80 comp rx=0 tx=0).stop 2023-09-21T12:50:42.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.405+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 shutdown_connections 2023-09-21T12:50:42.406 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12f80a0640 0x7f12f80a2b00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1310101910 0x7f131019df50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13100ffd70 0x7f1310069c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 --2- 172.21.15.156:0/3497187431 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1310100f70 0x7f131019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 >> 172.21.15.156:0/3497187431 conn(0x7f13100fb2f0 msgr2=0x7f13101044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:50:42.407 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 shutdown_connections 2023-09-21T12:50:42.408 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:50:42.406+0000 7f1315107700 1 -- 172.21.15.156:0/3497187431 wait complete. 2023-09-21T12:50:42.820 DEBUG:teuthology.orchestra.run.smithi156:osd.4> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.4.service 2023-09-21T12:50:42.823 INFO:tasks.cephadm:Deploying osd.5 on smithi160 with /dev/vg_nvme/lv_3... 2023-09-21T12:50:42.824 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-21T12:50:42.859 INFO:journalctl@ceph.osd.4.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:50:43.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:43.393 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:50:43.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:43.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:43.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:43.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:43.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:50:43.653 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 12:50:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T12:50:43.556+0000 7fbb3b625640 -1 osd.4 0 log_to_monitors true 2023-09-21T12:50:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:44 smithi160 ceph-mon[134450]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:44 smithi160 ceph-mon[134450]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:44 smithi156 ceph-mon[134078]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:44 smithi156 ceph-mon[134078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:44 smithi142 ceph-mon[97663]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:44 smithi142 ceph-mon[97663]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-21T12:50:44.877 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-21T12:50:44.877 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-21T12:50:44.877 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2023-09-21T12:50:44.878 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2023-09-21T12:50:44.878 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128009 s, 819 MB/s 2023-09-21T12:50:44.878 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2023-09-21T12:50:45.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-21T12:50:45.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: osdmap e32: 5 total, 4 up, 5 in 2023-09-21T12:50:45.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:45.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:45 smithi160 ceph-mon[134450]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:45.333 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi160:vg_nvme/lv_3 2023-09-21T12:50:45.403 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T12:50:45.056+0000 7fbb30c9d700 -1 osd.4 0 waiting for initial osdmap 2023-09-21T12:50:45.403 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T12:50:45.061+0000 7fbb2aa8e700 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:50:45.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-21T12:50:45.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: osdmap e32: 5 total, 4 up, 5 in 2023-09-21T12:50:45.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:45.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:45 smithi156 ceph-mon[134078]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:45.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-21T12:50:45.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: osdmap e32: 5 total, 4 up, 5 in 2023-09-21T12:50:45.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:45.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: from='osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:50:45.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:45 smithi142 ceph-mon[97663]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:45.891 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:50:46.397 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:50:46.397 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: osdmap e33: 5 total, 4 up, 5 in 2023-09-21T12:50:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi156 2023-09-21T12:50:46.398 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 8584M 2023-09-21T12:50:46.399 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:46.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:46.400 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:50:46.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: osdmap e33: 5 total, 4 up, 5 in 2023-09-21T12:50:46.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi156 2023-09-21T12:50:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 8584M 2023-09-21T12:50:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:46.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:46.408 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:50:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: osdmap e33: 5 total, 4 up, 5 in 2023-09-21T12:50:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi156 2023-09-21T12:50:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:50:46.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 8584M 2023-09-21T12:50:46.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:46.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:46.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:50:46.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:50:47.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 -- 172.21.15.160:0/3858359666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 msgr2=0x7f7c2c109030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:47.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 --2- 172.21.15.160:0/3858359666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c109030 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b0a0 tx=0x7f7c2400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 -- 172.21.15.160:0/3858359666 shutdown_connections 2023-09-21T12:50:47.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 --2- 172.21.15.160:0/3858359666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2c101960 0x7f7c2c103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 --2- 172.21.15.160:0/3858359666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c109030 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.072 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 --2- 172.21.15.160:0/3858359666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 0x7f7c2c106680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.072 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 -- 172.21.15.160:0/3858359666 >> 172.21.15.160:0/3858359666 conn(0x7f7c2c0fb370 msgr2=0x7f7c2c0fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:50:47.073 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 -- 172.21.15.160:0/3858359666 shutdown_connections 2023-09-21T12:50:47.073 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.068+0000 7f7c34503700 1 -- 172.21.15.160:0/3858359666 wait complete. 2023-09-21T12:50:47.073 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 Processor -- start 2023-09-21T12:50:47.074 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 -- start start 2023-09-21T12:50:47.074 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2c101960 0x7f7c2c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:47.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 0x7f7c2c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:47.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:47.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19e700 con 0x7f7c2c101960 2023-09-21T12:50:47.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19e840 con 0x7f7c2c104290 2023-09-21T12:50:47.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c34503700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19e9d0 con 0x7f7c2c106bc0 2023-09-21T12:50:47.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:47.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57720/0 (socket says 172.21.15.160:57720) 2023-09-21T12:50:47.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 -- 172.21.15.160:0/655916288 learned_addr learned my addr 172.21.15.160:0/655916288 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:50:47.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c31a9e700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 0x7f7c2c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:47.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 -- 172.21.15.160:0/655916288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 msgr2=0x7f7c2c1970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:47.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 0x7f7c2c1970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 -- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2c101960 msgr2=0x7f7c2c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:50:47.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2c101960 0x7f7c2c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:50:47.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 -- 172.21.15.160:0/655916288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24009d00 con 0x7f7c2c106bc0 2023-09-21T12:50:47.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.069+0000 7f7c32aa0700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c24006070 tx=0x7f7c24004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:47.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.070+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400e040 con 0x7f7c2c106bc0 2023-09-21T12:50:47.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.070+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c2400cea0 con 0x7f7c2c106bc0 2023-09-21T12:50:47.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.070+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24004020 con 0x7f7c2c106bc0 2023-09-21T12:50:47.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.070+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c0ff750 con 0x7f7c2c106bc0 2023-09-21T12:50:47.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.070+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c0ffc00 con 0x7f7c2c106bc0 2023-09-21T12:50:47.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.071+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c0fcef0 con 0x7f7c2c106bc0 2023-09-21T12:50:47.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.072+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f7c2401d690 con 0x7f7c2c106bc0 2023-09-21T12:50:47.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.072+0000 7f7c237fe700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 0x7f7c180a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:50:47.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.072+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f7c240cc530 con 0x7f7c2c106bc0 2023-09-21T12:50:47.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.073+0000 7f7c3229f700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 0x7f7c180a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:50:47.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.073+0000 7f7c3229f700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 0x7f7c180a2b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c28005fd0 tx=0x7f7c28005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:50:47.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.077+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7c24097160 con 0x7f7c2c106bc0 2023-09-21T12:50:47.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:50:47.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:50:47.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] boot 2023-09-21T12:50:47.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: osdmap e34: 5 total, 5 up, 5 in 2023-09-21T12:50:47.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:47.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:47 smithi160 ceph-mon[134450]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:47.275 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:50:47.275+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c2c02d190 con 0x7f7c180a06c0 2023-09-21T12:50:47.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:50:47.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:50:47.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] boot 2023-09-21T12:50:47.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: osdmap e34: 5 total, 5 up, 5 in 2023-09-21T12:50:47.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:47.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:47 smithi156 ceph-mon[134078]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:50:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:50:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: osd.4 [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] boot 2023-09-21T12:50:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: osdmap e34: 5 total, 5 up, 5 in 2023-09-21T12:50:47.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:50:47.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:47 smithi142 ceph-mon[97663]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-09-21T12:50:48.330 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:48 smithi160 ceph-mon[134450]: osdmap e35: 5 total, 5 up, 5 in 2023-09-21T12:50:48.330 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:48 smithi160 ceph-mon[134450]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:48.330 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:48.331 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:48.331 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:48.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:48 smithi156 ceph-mon[134078]: osdmap e35: 5 total, 5 up, 5 in 2023-09-21T12:50:48.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:48 smithi156 ceph-mon[134078]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:48.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:48.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:48.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:48.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:48 smithi142 ceph-mon[97663]: osdmap e35: 5 total, 5 up, 5 in 2023-09-21T12:50:48.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:48 smithi142 ceph-mon[97663]: from='client.24247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:50:48.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:50:48.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:50:48.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:49.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:49 smithi160 ceph-mon[134450]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:49.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:49 smithi156 ceph-mon[134078]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:49.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:49 smithi142 ceph-mon[97663]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:50.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:50 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/2958136652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:50 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:50 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]': finished 2023-09-21T12:50:50.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:50 smithi156 ceph-mon[134078]: osdmap e36: 6 total, 5 up, 6 in 2023-09-21T12:50:50.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:50:50.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:50 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/2958136652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:50 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:50 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]': finished 2023-09-21T12:50:50.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:50 smithi142 ceph-mon[97663]: osdmap e36: 6 total, 5 up, 6 in 2023-09-21T12:50:50.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:50:50.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:50 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/2958136652' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:50 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]: dispatch 2023-09-21T12:50:50.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:50 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ae7fea9-544d-49a6-9013-60b6856d3a0e"}]': finished 2023-09-21T12:50:50.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:50 smithi160 ceph-mon[134450]: osdmap e36: 6 total, 5 up, 6 in 2023-09-21T12:50:50.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:50:51.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:51 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/2470488984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:51.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:51 smithi156 ceph-mon[134078]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:51.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:51 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/2470488984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:51.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:51 smithi142 ceph-mon[97663]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:51.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:51 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/2470488984' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:50:51.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:51 smithi160 ceph-mon[134450]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:53.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:53 smithi156 ceph-mon[134078]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:53 smithi142 ceph-mon[97663]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:53.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:53 smithi160 ceph-mon[134450]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:55.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:55 smithi156 ceph-mon[134078]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:55 smithi142 ceph-mon[97663]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:55 smithi160 ceph-mon[134450]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:57.070 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-21T12:50:57.070 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:57.071 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:57 smithi160 ceph-mon[134450]: Deploying daemon osd.5 on smithi160 2023-09-21T12:50:57.071 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:57 smithi160 ceph-mon[134450]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:57.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-21T12:50:57.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:57.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:57 smithi156 ceph-mon[134078]: Deploying daemon osd.5 on smithi160 2023-09-21T12:50:57.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:57 smithi156 ceph-mon[134078]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-21T12:50:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:50:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:57 smithi142 ceph-mon[97663]: Deploying daemon osd.5 on smithi160 2023-09-21T12:50:57.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:57 smithi142 ceph-mon[97663]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:59.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:50:59 smithi156 ceph-mon[134078]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:59.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:50:59 smithi142 ceph-mon[97663]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:50:59.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:50:59 smithi160 ceph-mon[134450]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:01.578 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:01 smithi160 ceph-mon[134450]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:01.579 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.579 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.579 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:01 smithi156 ceph-mon[134078]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:01.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:01 smithi142 ceph-mon[97663]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:03.036 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.037+0000 7f7c237fe700 1 -- 172.21.15.160:0/655916288 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7c2c02d190 con 0x7f7c180a06c0 2023-09-21T12:51:03.037 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 5 on host 'smithi160' 2023-09-21T12:51:03.038 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 msgr2=0x7f7c180a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:03.038 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 0x7f7c180a2b80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c28005fd0 tx=0x7f7c28005d00 comp rx=0 tx=0).stop 2023-09-21T12:51:03.039 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 msgr2=0x7f7c2c19e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:03.039 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7c24006070 tx=0x7f7c24004d00 comp rx=0 tx=0).stop 2023-09-21T12:51:03.039 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 shutdown_connections 2023-09-21T12:51:03.039 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7c180a06c0 0x7f7c180a2b80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:03.040 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7c2c101960 0x7f7c2c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:03.040 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c2c106bc0 0x7f7c2c19e130 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:03.040 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 --2- 172.21.15.160:0/655916288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7c2c104290 0x7f7c2c1970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:03.040 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.039+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 >> 172.21.15.160:0/655916288 conn(0x7f7c2c0fb370 msgr2=0x7f7c2c1025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:03.040 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.040+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 shutdown_connections 2023-09-21T12:51:03.041 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:03.040+0000 7f7c34503700 1 -- 172.21.15.160:0/655916288 wait complete. 2023-09-21T12:51:03.381 DEBUG:teuthology.orchestra.run.smithi160:osd.5> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.5.service 2023-09-21T12:51:03.384 INFO:tasks.cephadm:Deploying osd.6 on smithi142 with /dev/vg_nvme/lv_2... 2023-09-21T12:51:03.384 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-21T12:51:03.425 INFO:journalctl@ceph.osd.5.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:51:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:03.918 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:03.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:03.919 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:03.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.920 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:03.921 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:04.128 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:51:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:04.662 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 12:51:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T12:51:04.370+0000 7f9e85ddd640 -1 osd.5 0 log_to_monitors true 2023-09-21T12:51:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:04 smithi142 ceph-mon[97663]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:04 smithi142 ceph-mon[97663]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:04 smithi160 ceph-mon[134450]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:04.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:04 smithi160 ceph-mon[134450]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:05.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:04 smithi156 ceph-mon[134078]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:05.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:04 smithi156 ceph-mon[134078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-21T12:51:05.938 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T12:51:05.680+0000 7f9e7b455700 -1 osd.5 0 waiting for initial osdmap 2023-09-21T12:51:05.939 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T12:51:05.686+0000 7f9e74a45700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:51:05.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:05.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-21T12:51:05.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: osdmap e37: 6 total, 5 up, 6 in 2023-09-21T12:51:05.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:05.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:05.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:05 smithi160 ceph-mon[134450]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:06.110 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-21T12:51:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-21T12:51:06.111 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2023-09-21T12:51:06.111 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2023-09-21T12:51:06.111 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0323194 s, 324 MB/s 2023-09-21T12:51:06.112 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2023-09-21T12:51:06.151 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:06.151 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-21T12:51:06.151 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: osdmap e37: 6 total, 5 up, 6 in 2023-09-21T12:51:06.152 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.152 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:06.152 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:05 smithi142 ceph-mon[97663]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-21T12:51:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: osdmap e37: 6 total, 5 up, 6 in 2023-09-21T12:51:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: from='osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:06.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:05 smithi156 ceph-mon[134078]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:51:06.605 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi142:vg_nvme/lv_2 2023-09-21T12:51:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:51:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: osdmap e38: 6 total, 5 up, 6 in 2023-09-21T12:51:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] boot 2023-09-21T12:51:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: osdmap e39: 6 total, 6 up, 6 in 2023-09-21T12:51:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:06.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:06.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:06.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:06.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:51:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: osdmap e38: 6 total, 5 up, 6 in 2023-09-21T12:51:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] boot 2023-09-21T12:51:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: osdmap e39: 6 total, 6 up, 6 in 2023-09-21T12:51:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:06.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:06.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:06.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:06.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:07.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:51:07.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: osdmap e38: 6 total, 5 up, 6 in 2023-09-21T12:51:07.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:07.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:07.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: osd.5 [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] boot 2023-09-21T12:51:07.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: osdmap e39: 6 total, 6 up, 6 in 2023-09-21T12:51:07.160 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:51:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:07.161 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:07.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:07.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:07.162 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:07.333 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:51:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:51:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:51:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi160 2023-09-21T12:51:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 8584M 2023-09-21T12:51:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:07 smithi142 ceph-mon[97663]: osdmap e40: 6 total, 6 up, 6 in 2023-09-21T12:51:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:51:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:51:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi160 2023-09-21T12:51:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 8584M 2023-09-21T12:51:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:07 smithi160 ceph-mon[134450]: osdmap e40: 6 total, 6 up, 6 in 2023-09-21T12:51:08.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:51:08.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:51:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi160 2023-09-21T12:51:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 8584M 2023-09-21T12:51:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-09-21T12:51:08.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:07 smithi156 ceph-mon[134078]: osdmap e40: 6 total, 6 up, 6 in 2023-09-21T12:51:08.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 -- 172.21.15.142:0/1411172852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634101fd0 msgr2=0x7ff634102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:08.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 --2- 172.21.15.142:0/1411172852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634101fd0 0x7ff634102450 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff628009990 tx=0x7ff628009ca0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 -- 172.21.15.142:0/1411172852 shutdown_connections 2023-09-21T12:51:08.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 --2- 172.21.15.142:0/1411172852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff6341092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 --2- 172.21.15.142:0/1411172852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634100e70 0x7ff634101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 --2- 172.21.15.142:0/1411172852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634101fd0 0x7ff634102450 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 -- 172.21.15.142:0/1411172852 >> 172.21.15.142:0/1411172852 conn(0x7ff6340fc3d0 msgr2=0x7ff6340fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:08.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 -- 172.21.15.142:0/1411172852 shutdown_connections 2023-09-21T12:51:08.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.813+0000 7ff638f6f700 1 -- 172.21.15.142:0/1411172852 wait complete. 2023-09-21T12:51:08.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.814+0000 7ff638f6f700 1 Processor -- start 2023-09-21T12:51:08.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.814+0000 7ff638f6f700 1 -- start start 2023-09-21T12:51:08.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:08.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634101fd0 0x7ff6340731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:08.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff634073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:08.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634073e90 con 0x7ff634100e70 2023-09-21T12:51:08.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634074000 con 0x7ff634102990 2023-09-21T12:51:08.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff638f6f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341a0bf0 con 0x7ff634101fd0 2023-09-21T12:51:08.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:08.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55424/0 (socket says 172.21.15.142:55424) 2023-09-21T12:51:08.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 -- 172.21.15.142:0/4192512401 learned_addr learned my addr 172.21.15.142:0/4192512401 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:51:08.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff631d9b700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634101fd0 0x7ff6340731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:08.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff632d9d700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff634073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:08.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 -- 172.21.15.142:0/4192512401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634101fd0 msgr2=0x7ff6340731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:08.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634101fd0 0x7ff6340731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 -- 172.21.15.142:0/4192512401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 msgr2=0x7ff634073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:08.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff634073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:08.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff63259c700 1 -- 172.21.15.142:0/4192512401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280095f0 con 0x7ff634100e70 2023-09-21T12:51:08.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.815+0000 7ff632d9d700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff634073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:51:08.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff63259c700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e9a0 tx=0x7ff62400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:08.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624009790 con 0x7ff634100e70 2023-09-21T12:51:08.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff62400cbd0 con 0x7ff634100e70 2023-09-21T12:51:08.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6341a0ed0 con 0x7ff634100e70 2023-09-21T12:51:08.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624018680 con 0x7ff634100e70 2023-09-21T12:51:08.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.816+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6341a12e0 con 0x7ff634100e70 2023-09-21T12:51:08.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.817+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63410c6d0 con 0x7ff634100e70 2023-09-21T12:51:08.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.819+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7ff62400cd40 con 0x7ff634100e70 2023-09-21T12:51:08.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.820+0000 7ff6237fe700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 0x7ff61c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:08.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.820+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4562+0+0 (secure 0 0 0) 0x7ff624014070 con 0x7ff634100e70 2023-09-21T12:51:08.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.821+0000 7ff631d9b700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 0x7ff61c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:08.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.821+0000 7ff631d9b700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 0x7ff61c0a2b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b2e0 tx=0x7ff628005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:08.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:08.823+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff624095c30 con 0x7ff634100e70 2023-09-21T12:51:09.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:09.033+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff634061220 con 0x7ff61c0a0640 2023-09-21T12:51:09.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:09 smithi156 ceph-mon[134078]: osdmap e41: 6 total, 6 up, 6 in 2023-09-21T12:51:09.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:09 smithi156 ceph-mon[134078]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:09.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:09 smithi142 ceph-mon[97663]: osdmap e41: 6 total, 6 up, 6 in 2023-09-21T12:51:09.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:09 smithi142 ceph-mon[97663]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:09.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:09 smithi160 ceph-mon[134450]: osdmap e41: 6 total, 6 up, 6 in 2023-09-21T12:51:09.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:09 smithi160 ceph-mon[134450]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:10.280 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:10 smithi142 ceph-mon[97663]: osdmap e42: 6 total, 6 up, 6 in 2023-09-21T12:51:10.281 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:10 smithi142 ceph-mon[97663]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:10.281 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:10.281 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:10.281 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:10 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:10.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:10 smithi156 ceph-mon[134078]: osdmap e42: 6 total, 6 up, 6 in 2023-09-21T12:51:10.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:10 smithi156 ceph-mon[134078]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:10 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:10 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:10 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:10.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:10 smithi160 ceph-mon[134450]: osdmap e42: 6 total, 6 up, 6 in 2023-09-21T12:51:10.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:10 smithi160 ceph-mon[134450]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:10.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:10 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:10.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:10 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:10.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:10 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:11.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:11 smithi156 ceph-mon[134078]: osdmap e43: 6 total, 6 up, 6 in 2023-09-21T12:51:11.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:11 smithi156 ceph-mon[134078]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:51:11.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:11 smithi142 ceph-mon[97663]: osdmap e43: 6 total, 6 up, 6 in 2023-09-21T12:51:11.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:11 smithi142 ceph-mon[97663]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:51:11.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:11 smithi160 ceph-mon[134450]: osdmap e43: 6 total, 6 up, 6 in 2023-09-21T12:51:11.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:11 smithi160 ceph-mon[134450]: pgmap v138: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:51:12.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:12 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]: dispatch 2023-09-21T12:51:12.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:12 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]': finished 2023-09-21T12:51:12.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:12 smithi156 ceph-mon[134078]: osdmap e44: 7 total, 6 up, 7 in 2023-09-21T12:51:12.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:12 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:12.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:12 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]: dispatch 2023-09-21T12:51:12.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:12 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]': finished 2023-09-21T12:51:12.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:12 smithi142 ceph-mon[97663]: osdmap e44: 7 total, 6 up, 7 in 2023-09-21T12:51:12.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:12 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:12.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:12 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]: dispatch 2023-09-21T12:51:12.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:12 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/938639826' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c35da40-e01d-46b9-bd3c-ddd75f470a44"}]': finished 2023-09-21T12:51:12.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:12 smithi160 ceph-mon[134450]: osdmap e44: 7 total, 6 up, 7 in 2023-09-21T12:51:12.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:12 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:13.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:13 smithi156 ceph-mon[134078]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:51:13.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:13 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2853587462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:13.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:13 smithi142 ceph-mon[97663]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:51:13.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:13 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2853587462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:13.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:13 smithi160 ceph-mon[134450]: pgmap v140: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:51:13.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:13 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2853587462' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:15.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:15 smithi156 ceph-mon[134078]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:51:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:15 smithi142 ceph-mon[97663]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:51:15.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:15 smithi160 ceph-mon[134450]: pgmap v141: 1 pgs: 1 peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:51:17.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:17 smithi156 ceph-mon[134078]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-21T12:51:17.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:17 smithi142 ceph-mon[97663]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-21T12:51:17.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:17 smithi160 ceph-mon[134450]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2023-09-21T12:51:19.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:19 smithi156 ceph-mon[134078]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:19 smithi142 ceph-mon[97663]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:19.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:19 smithi160 ceph-mon[134450]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:20.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:20 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-21T12:51:20.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:20 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:20.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:20 smithi156 ceph-mon[134078]: Deploying daemon osd.6 on smithi142 2023-09-21T12:51:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:20 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-21T12:51:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:20 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:20.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:20 smithi142 ceph-mon[97663]: Deploying daemon osd.6 on smithi142 2023-09-21T12:51:20.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:20 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-21T12:51:20.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:20 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:20.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:20 smithi160 ceph-mon[134450]: Deploying daemon osd.6 on smithi142 2023-09-21T12:51:21.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:21 smithi156 ceph-mon[134078]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:21 smithi142 ceph-mon[97663]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:21.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:21 smithi160 ceph-mon[134450]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:23.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:23 smithi156 ceph-mon[134078]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:23.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:23 smithi142 ceph-mon[97663]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:23.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:23 smithi160 ceph-mon[134450]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:25 smithi156 ceph-mon[134078]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:25.659 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:25 smithi142 ceph-mon[97663]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:25 smithi160 ceph-mon[134450]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:27.046 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:26 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.046 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:26 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.047 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:26 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:27.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:26 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:26 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:26 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:27.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:26 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:26 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:27.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:26 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:27 smithi142 ceph-mon[97663]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:27 smithi156 ceph-mon[134078]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:28.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:27 smithi160 ceph-mon[134450]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:29.140 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 6 on host 'smithi142' 2023-09-21T12:51:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.140+0000 7ff6237fe700 1 -- 172.21.15.142:0/4192512401 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff634061220 con 0x7ff61c0a0640 2023-09-21T12:51:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 msgr2=0x7ff61c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 0x7ff61c0a2b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff62800b2e0 tx=0x7ff628005fb0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 msgr2=0x7ff634074b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff62400e9a0 tx=0x7ff62400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 shutdown_connections 2023-09-21T12:51:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff61c0a0640 0x7ff61c0a2b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff634100e70 0x7ff634074b80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff634102990 0x7ff634073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 --2- 172.21.15.142:0/4192512401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff634101fd0 0x7ff6340731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:29.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.143+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 >> 172.21.15.142:0/4192512401 conn(0x7ff6340fc3d0 msgr2=0x7ff6340fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:29.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.144+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 shutdown_connections 2023-09-21T12:51:29.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:51:29.144+0000 7ff638f6f700 1 -- 172.21.15.142:0/4192512401 wait complete. 2023-09-21T12:51:29.662 DEBUG:teuthology.orchestra.run.smithi142:osd.6> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.6.service 2023-09-21T12:51:29.667 INFO:tasks.cephadm:Deploying osd.7 on smithi156 with /dev/vg_nvme/lv_2... 2023-09-21T12:51:29.667 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-21T12:51:29.747 INFO:journalctl@ceph.osd.6.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:51:29.916 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T12:51:29.772+0000 7f4a7e364640 -1 osd.6 0 log_to_monitors true 2023-09-21T12:51:29.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:29.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:29.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:29.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:29.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:29.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:29.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:29.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:29.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:29 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:29 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:30.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:29 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:30.250 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:51:30.804 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:30 smithi156 ceph-mon[134078]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:30.804 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:30 smithi156 ceph-mon[134078]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:30.883 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:30 smithi142 ceph-mon[97663]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:30.884 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:30 smithi142 ceph-mon[97663]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:30 smithi160 ceph-mon[134450]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:30 smithi160 ceph-mon[134450]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-21T12:51:31.768 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-21T12:51:31.769 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-21T12:51:31.769 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-09-21T12:51:31.769 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-09-21T12:51:31.769 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00825981 s, 1.3 GB/s 2023-09-21T12:51:31.769 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-09-21T12:51:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-21T12:51:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: osdmap e45: 7 total, 6 up, 7 in 2023-09-21T12:51:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:31 smithi156 ceph-mon[134078]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-21T12:51:32.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: osdmap e45: 7 total, 6 up, 7 in 2023-09-21T12:51:32.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:32.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-mon[97663]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.168 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T12:51:31.744+0000 7f4a739dc700 -1 osd.6 0 waiting for initial osdmap 2023-09-21T12:51:32.168 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 12:51:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T12:51:31.756+0000 7f4a6cfcc700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-21T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: osdmap e45: 7 total, 6 up, 7 in 2023-09-21T12:51:32.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:32.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: from='osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:31 smithi160 ceph-mon[134450]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:51:32.307 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi156:vg_nvme/lv_2 2023-09-21T12:51:32.864 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:51:32.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:32 smithi142 ceph-mon[97663]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:51:32.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:32 smithi142 ceph-mon[97663]: osdmap e46: 7 total, 6 up, 7 in 2023-09-21T12:51:32.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:32 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:32.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:32 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:33.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:32 smithi156 ceph-mon[134078]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:51:33.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:32 smithi156 ceph-mon[134078]: osdmap e46: 7 total, 6 up, 7 in 2023-09-21T12:51:33.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:32 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:33.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:32 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:32 smithi160 ceph-mon[134450]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:51:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:32 smithi160 ceph-mon[134450]: osdmap e46: 7 total, 6 up, 7 in 2023-09-21T12:51:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:32 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:32 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.025 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:51:34.025 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:51:34.025 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:34.025 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] boot 2023-09-21T12:51:34.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: osdmap e47: 7 total, 7 up, 7 in 2023-09-21T12:51:34.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.026 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.027 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:34.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:34.028 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:33 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:51:34.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:51:34.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:34.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] boot 2023-09-21T12:51:34.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: osdmap e47: 7 total, 7 up, 7 in 2023-09-21T12:51:34.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:34.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:34.170 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:33 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- 172.21.15.156:0/2725394708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 msgr2=0x7f6cb81013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 --2- 172.21.15.156:0/2725394708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81013d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6cb40099c0 tx=0x7f6cb4009cd0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- 172.21.15.156:0/2725394708 shutdown_connections 2023-09-21T12:51:34.179 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 --2- 172.21.15.156:0/2725394708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb81081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 --2- 172.21.15.156:0/2725394708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 0x7f6cb8100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 --2- 172.21.15.156:0/2725394708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81013d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- 172.21.15.156:0/2725394708 >> 172.21.15.156:0/2725394708 conn(0x7f6cb80fb2f0 msgr2=0x7f6cb80fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- 172.21.15.156:0/2725394708 shutdown_connections 2023-09-21T12:51:34.180 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- 172.21.15.156:0/2725394708 wait complete. 2023-09-21T12:51:34.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 Processor -- start 2023-09-21T12:51:34.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.179+0000 7f6cc0333700 1 -- start start 2023-09-21T12:51:34.183 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 0x7f6cb8196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb819e6f0 con 0x7f6cb8101910 2023-09-21T12:51:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb819e830 con 0x7f6cb8100f70 2023-09-21T12:51:34.184 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb819e9c0 con 0x7f6cb80ffd70 2023-09-21T12:51:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51534/0 (socket says 172.21.15.156:51534) 2023-09-21T12:51:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 -- 172.21.15.156:0/290597409 learned_addr learned my addr 172.21.15.156:0/290597409 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-21T12:51:34.185 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbe0cf700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 0x7f6cb8196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbe8d0700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 -- 172.21.15.156:0/290597409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 msgr2=0x7f6cb8196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 0x7f6cb8196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 -- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 msgr2=0x7f6cb819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:34.186 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 -- 172.21.15.156:0/290597409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb40095f0 con 0x7f6cb8100f70 2023-09-21T12:51:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbe8d0700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:51:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cbd8ce700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000c00 tx=0x7f6cb4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb401d070 con 0x7f6cb8100f70 2023-09-21T12:51:34.187 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6cb4004020 con 0x7f6cb8100f70 2023-09-21T12:51:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb4022d00 con 0x7f6cb8100f70 2023-09-21T12:51:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.180+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cb819ec40 con 0x7f6cb8100f70 2023-09-21T12:51:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.181+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cb819f000 con 0x7f6cb8100f70 2023-09-21T12:51:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.181+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cb810b660 con 0x7f6cb8100f70 2023-09-21T12:51:34.188 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.182+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f6cb4022470 con 0x7f6cb8100f70 2023-09-21T12:51:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.183+0000 7f6caf7fe700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 0x7f6ca40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.183+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f6cb40cc140 con 0x7f6cb8100f70 2023-09-21T12:51:34.189 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.184+0000 7f6cbe0cf700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 0x7f6ca40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:34.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:51:34.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:51:34.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-09-21T12:51:34.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: osd.6 [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] boot 2023-09-21T12:51:34.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: osdmap e47: 7 total, 7 up, 7 in 2023-09-21T12:51:34.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:51:34.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:34.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:34.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:34.193 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:33 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:34.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.184+0000 7f6cbe0cf700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 0x7f6ca40a2b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8100dd0 tx=0x7f6ca8007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:34.193 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.188+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6cb4096a10 con 0x7f6cb8100f70 2023-09-21T12:51:34.381 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:34.382+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cb80690b0 con 0x7f6ca40a0640 2023-09-21T12:51:35.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi142 2023-09-21T12:51:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 5755M 2023-09-21T12:51:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: osdmap e48: 7 total, 7 up, 7 in 2023-09-21T12:51:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:35.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:34 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi142 2023-09-21T12:51:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 5755M 2023-09-21T12:51:35.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: osdmap e48: 7 total, 7 up, 7 in 2023-09-21T12:51:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:35.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:34 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:35.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi142 2023-09-21T12:51:35.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 5755M 2023-09-21T12:51:35.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: osdmap e48: 7 total, 7 up, 7 in 2023-09-21T12:51:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:35.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:34 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:36.000 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:35 smithi156 ceph-mon[134078]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:36.001 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:35 smithi156 ceph-mon[134078]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:36.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:35 smithi142 ceph-mon[97663]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:36.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:35 smithi142 ceph-mon[97663]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:35 smithi160 ceph-mon[134450]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:35 smithi160 ceph-mon[134450]: from='client.24293 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:37.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:37.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/44192707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]': finished 2023-09-21T12:51:37.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: osdmap e49: 8 total, 7 up, 8 in 2023-09-21T12:51:37.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:37 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:37.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:37.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/44192707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]': finished 2023-09-21T12:51:37.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: osdmap e49: 8 total, 7 up, 8 in 2023-09-21T12:51:37.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:37 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:37.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:37.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/44192707' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]: dispatch 2023-09-21T12:51:37.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7529cf76-0674-4014-89b5-2468f2dc7dc3"}]': finished 2023-09-21T12:51:37.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: osdmap e49: 8 total, 7 up, 8 in 2023-09-21T12:51:37.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:37 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:38.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:38 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/3458769390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:38.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:38 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/3458769390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:38.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:38 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/3458769390' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:39.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:39 smithi156 ceph-mon[134078]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:39.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:39 smithi142 ceph-mon[97663]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:39.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:39 smithi160 ceph-mon[134450]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:41.642 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:41 smithi156 ceph-mon[134078]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:41.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:41 smithi142 ceph-mon[97663]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:41.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:41 smithi160 ceph-mon[134450]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:43.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:43 smithi156 ceph-mon[134078]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-21T12:51:43.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:43 smithi142 ceph-mon[97663]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-21T12:51:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:43.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:43 smithi160 ceph-mon[134450]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:43.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-21T12:51:43.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:44.653 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:44 smithi156 ceph-mon[134078]: Deploying daemon osd.7 on smithi156 2023-09-21T12:51:44.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:44 smithi142 ceph-mon[97663]: Deploying daemon osd.7 on smithi156 2023-09-21T12:51:44.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:44 smithi160 ceph-mon[134450]: Deploying daemon osd.7 on smithi156 2023-09-21T12:51:45.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:45 smithi156 ceph-mon[134078]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:45.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:45 smithi142 ceph-mon[97663]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:45.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:45 smithi160 ceph-mon[134450]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:47.332 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:47 smithi156 ceph-mon[134078]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:47 smithi142 ceph-mon[97663]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:47.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:47 smithi160 ceph-mon[134450]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:48.860 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.861 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.861 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:48 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:48.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:48 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:48.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:48.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:48 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:49.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:49 smithi156 ceph-mon[134078]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:49 smithi142 ceph-mon[97663]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:49 smithi160 ceph-mon[134450]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:50.294 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.294+0000 7f6caf7fe700 1 -- 172.21.15.156:0/290597409 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6cb80690b0 con 0x7f6ca40a0640 2023-09-21T12:51:50.295 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 7 on host 'smithi156' 2023-09-21T12:51:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 msgr2=0x7f6ca40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 0x7f6ca40a2b00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cb8100dd0 tx=0x7f6ca8007400 comp rx=0 tx=0).stop 2023-09-21T12:51:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 msgr2=0x7f6cb81970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:50.297 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4000c00 tx=0x7f6cb4004730 comp rx=0 tx=0).stop 2023-09-21T12:51:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 shutdown_connections 2023-09-21T12:51:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6ca40a0640 0x7f6ca40a2b00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6cb8101910 0x7f6cb819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:50.298 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cb80ffd70 0x7f6cb8196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:50.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 --2- 172.21.15.156:0/290597409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6cb8100f70 0x7f6cb81970a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:50.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 >> 172.21.15.156:0/290597409 conn(0x7f6cb80fb2f0 msgr2=0x7f6cb80689a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:50.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 shutdown_connections 2023-09-21T12:51:50.299 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:51:50.297+0000 7f6cc0333700 1 -- 172.21.15.156:0/290597409 wait complete. 2023-09-21T12:51:50.764 DEBUG:teuthology.orchestra.run.smithi156:osd.7> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.7.service 2023-09-21T12:51:50.768 INFO:tasks.cephadm:Deploying osd.8 on smithi160 with /dev/vg_nvme/lv_2... 2023-09-21T12:51:50.769 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-21T12:51:50.806 INFO:journalctl@ceph.osd.7.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:51:51.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:51.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:50 smithi156 ceph-mon[134078]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:51.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:51.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:50 smithi160 ceph-mon[134450]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:51.336 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:51:51.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:51.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:51:51.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:50 smithi142 ceph-mon[97663]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:51.797 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 12:51:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T12:51:51.537+0000 7f022459c640 -1 osd.7 0 log_to_monitors true 2023-09-21T12:51:52.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:52 smithi156 ceph-mon[134078]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:52 smithi156 ceph-mon[134078]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:52 smithi142 ceph-mon[97663]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:52 smithi142 ceph-mon[97663]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:52 smithi160 ceph-mon[134450]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:52 smithi160 ceph-mon[134450]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-21T12:51:52.853 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-21T12:51:52.854 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-21T12:51:52.854 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2023-09-21T12:51:52.854 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2023-09-21T12:51:52.854 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112246 s, 934 MB/s 2023-09-21T12:51:52.854 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2023-09-21T12:51:53.297 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi160:vg_nvme/lv_2 2023-09-21T12:51:53.655 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T12:51:53.284+0000 7f0219c14700 -1 osd.7 0 waiting for initial osdmap 2023-09-21T12:51:53.656 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T12:51:53.294+0000 7f0212a03700 -1 osd.7 51 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:51:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-21T12:51:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: osdmap e50: 8 total, 7 up, 8 in 2023-09-21T12:51:53.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:53.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:53 smithi156 ceph-mon[134078]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-21T12:51:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: osdmap e50: 8 total, 7 up, 8 in 2023-09-21T12:51:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:53 smithi142 ceph-mon[97663]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:53.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-21T12:51:53.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: osdmap e50: 8 total, 7 up, 8 in 2023-09-21T12:51:53.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:53.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: from='osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:51:53.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:53 smithi160 ceph-mon[134450]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:53.853 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:51:54.403 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:51:54.403 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: osdmap e51: 8 total, 7 up, 8 in 2023-09-21T12:51:54.404 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.404 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.404 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi156 2023-09-21T12:51:54.404 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.404 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.405 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.405 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.405 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.405 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 5722M 2023-09-21T12:51:54.406 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.406 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:54.406 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:54.406 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.406 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:51:54.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: osdmap e51: 8 total, 7 up, 8 in 2023-09-21T12:51:54.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi156 2023-09-21T12:51:54.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 5722M 2023-09-21T12:51:54.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:54.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:54.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:51:54.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: osdmap e51: 8 total, 7 up, 8 in 2023-09-21T12:51:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi156 2023-09-21T12:51:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:51:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 5722M 2023-09-21T12:51:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:54.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:51:54.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:51:54.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:55.054 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 -- 172.21.15.160:0/2346991106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 msgr2=0x7f27b41001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:55.054 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 --2- 172.21.15.160:0/2346991106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b41001b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f27a8009990 tx=0x7f27a8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.054 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 -- 172.21.15.160:0/2346991106 shutdown_connections 2023-09-21T12:51:55.055 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 --2- 172.21.15.160:0/2346991106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4101930 0x7f27b41081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.055 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 --2- 172.21.15.160:0/2346991106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b41001b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.055 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 --2- 172.21.15.160:0/2346991106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27b4100f90 0x7f27b41013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.055 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 -- 172.21.15.160:0/2346991106 >> 172.21.15.160:0/2346991106 conn(0x7f27b40fb350 msgr2=0x7f27b40fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:51:55.055 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 -- 172.21.15.160:0/2346991106 shutdown_connections 2023-09-21T12:51:55.056 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 -- 172.21.15.160:0/2346991106 wait complete. 2023-09-21T12:51:55.056 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.053+0000 7f27b9668700 1 Processor -- start 2023-09-21T12:51:55.056 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 -- start start 2023-09-21T12:51:55.056 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:55.056 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4100f90 0x7f27b4108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:55.057 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27b4101930 0x7f27b4109230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:55.057 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41099b0 con 0x7f27b4101930 2023-09-21T12:51:55.057 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b4109b20 con 0x7f27b4100f90 2023-09-21T12:51:55.057 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b41a0c80 con 0x7f27b40ffd90 2023-09-21T12:51:55.057 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:55.058 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57830/0 (socket says 172.21.15.160:57830) 2023-09-21T12:51:55.058 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 -- 172.21.15.160:0/557342597 learned_addr learned my addr 172.21.15.160:0/557342597 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:51:55.058 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b27fc700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4100f90 0x7f27b4108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:55.058 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 -- 172.21.15.160:0/557342597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4100f90 msgr2=0x7f27b4108cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:55.058 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4100f90 0x7f27b4108cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.059 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 -- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27b4101930 msgr2=0x7f27b4109230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:51:55.059 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27b4101930 0x7f27b4109230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:51:55.059 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 -- 172.21.15.160:0/557342597 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a80095f0 con 0x7f27b40ffd90 2023-09-21T12:51:55.059 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b2ffd700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27a8005b40 tx=0x7f27a800f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:55.059 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a801d070 con 0x7f27b40ffd90 2023-09-21T12:51:55.060 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27a8003e20 con 0x7f27b40ffd90 2023-09-21T12:51:55.060 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.054+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27b41a0f00 con 0x7f27b40ffd90 2023-09-21T12:51:55.060 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.055+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27a8005680 con 0x7f27b40ffd90 2023-09-21T12:51:55.060 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.055+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27b41a12e0 con 0x7f27b40ffd90 2023-09-21T12:51:55.061 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.055+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27b410c790 con 0x7f27b40ffd90 2023-09-21T12:51:55.061 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.057+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f27a800fc80 con 0x7f27b40ffd90 2023-09-21T12:51:55.062 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.057+0000 7f279bfff700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 0x7f279c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:51:55.062 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.057+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5430+0+0 (secure 0 0 0) 0x7f27a80cc340 con 0x7f27b40ffd90 2023-09-21T12:51:55.062 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.057+0000 7f27b27fc700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 0x7f279c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:51:55.062 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.058+0000 7f27b27fc700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 0x7f279c0a2b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009a10 tx=0x7f27a4009190 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:51:55.062 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.061+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f27a8096a40 con 0x7f27b40ffd90 2023-09-21T12:51:55.256 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:51:55.256+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f27b4061220 con 0x7f279c0a0640 2023-09-21T12:51:55.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:51:55.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:51:55.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] boot 2023-09-21T12:51:55.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: osdmap e52: 8 total, 8 up, 8 in 2023-09-21T12:51:55.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:55.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:55.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:55.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:55.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:55 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:51:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:51:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] boot 2023-09-21T12:51:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: osdmap e52: 8 total, 8 up, 8 in 2023-09-21T12:51:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:55.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:55.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:55 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:51:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:51:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: osd.7 [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] boot 2023-09-21T12:51:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: osdmap e52: 8 total, 8 up, 8 in 2023-09-21T12:51:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:51:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-09-21T12:51:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:51:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:51:55.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:55 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:51:56.310 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:56 smithi160 ceph-mon[134450]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:56.310 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:56 smithi160 ceph-mon[134450]: osdmap e53: 8 total, 8 up, 8 in 2023-09-21T12:51:56.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:56 smithi156 ceph-mon[134078]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:56.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:56 smithi156 ceph-mon[134078]: osdmap e53: 8 total, 8 up, 8 in 2023-09-21T12:51:56.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:56 smithi142 ceph-mon[97663]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:51:56.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:56 smithi142 ceph-mon[97663]: osdmap e53: 8 total, 8 up, 8 in 2023-09-21T12:51:57.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:57 smithi156 ceph-mon[134078]: osdmap e54: 8 total, 8 up, 8 in 2023-09-21T12:51:57.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:57 smithi156 ceph-mon[134078]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:51:57.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:57 smithi142 ceph-mon[97663]: osdmap e54: 8 total, 8 up, 8 in 2023-09-21T12:51:57.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:57 smithi142 ceph-mon[97663]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:51:57.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:57 smithi160 ceph-mon[134450]: osdmap e54: 8 total, 8 up, 8 in 2023-09-21T12:51:57.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:57 smithi160 ceph-mon[134450]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:51:58.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: osdmap e55: 8 total, 8 up, 8 in 2023-09-21T12:51:58.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/385316386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]': finished 2023-09-21T12:51:58.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: osdmap e56: 9 total, 8 up, 9 in 2023-09-21T12:51:58.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:51:58.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:58 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/1208226916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:58.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: osdmap e55: 8 total, 8 up, 8 in 2023-09-21T12:51:58.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/385316386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]': finished 2023-09-21T12:51:58.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: osdmap e56: 9 total, 8 up, 9 in 2023-09-21T12:51:58.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:51:58.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:58 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/1208226916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:58.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: osdmap e55: 8 total, 8 up, 8 in 2023-09-21T12:51:58.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/385316386' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]: dispatch 2023-09-21T12:51:58.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f108a2f-c86d-4470-bfa1-1309dc3a7ccf"}]': finished 2023-09-21T12:51:58.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: osdmap e56: 9 total, 8 up, 9 in 2023-09-21T12:51:58.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:51:58.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:58 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/1208226916' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:51:59.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:51:59 smithi156 ceph-mon[134078]: pgmap v175: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:51:59.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:51:59 smithi142 ceph-mon[97663]: pgmap v175: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:51:59.687 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:51:59 smithi160 ceph-mon[134450]: pgmap v175: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:01.592 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:01 smithi160 ceph-mon[134450]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:01.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:01 smithi156 ceph-mon[134078]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:01.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:01 smithi142 ceph-mon[97663]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:03.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:03 smithi156 ceph-mon[134078]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:03.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:03 smithi142 ceph-mon[97663]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:03.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:03 smithi160 ceph-mon[134450]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:04.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-21T12:52:04.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:04.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-21T12:52:04.657 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:04.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-21T12:52:04.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:05.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:05 smithi156 ceph-mon[134078]: Deploying daemon osd.8 on smithi160 2023-09-21T12:52:05.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:05 smithi156 ceph-mon[134078]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:05.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:05 smithi142 ceph-mon[97663]: Deploying daemon osd.8 on smithi160 2023-09-21T12:52:05.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:05 smithi142 ceph-mon[97663]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:05.687 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:05 smithi160 ceph-mon[134450]: Deploying daemon osd.8 on smithi160 2023-09-21T12:52:05.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:05 smithi160 ceph-mon[134450]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:07.381 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:07 smithi160 ceph-mon[134450]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:07.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:07 smithi156 ceph-mon[134078]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:07.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:07 smithi142 ceph-mon[97663]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:09.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:09 smithi160 ceph-mon[134450]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:09.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:09 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:09 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:09 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:09.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:09 smithi156 ceph-mon[134078]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:09.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:09 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:09 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:09 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:09.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:09 smithi142 ceph-mon[97663]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:09.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:09 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:09 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:09.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:09 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:11.068 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.068+0000 7f279bfff700 1 -- 172.21.15.160:0/557342597 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f27b4061220 con 0x7f279c0a0640 2023-09-21T12:52:11.068 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 8 on host 'smithi160' 2023-09-21T12:52:11.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 msgr2=0x7f279c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:11.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 0x7f279c0a2b00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009a10 tx=0x7f27a4009190 comp rx=0 tx=0).stop 2023-09-21T12:52:11.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 msgr2=0x7f27b410a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:11.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27a8005b40 tx=0x7f27a800f690 comp rx=0 tx=0).stop 2023-09-21T12:52:11.070 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 shutdown_connections 2023-09-21T12:52:11.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f279c0a0640 0x7f279c0a2b00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:11.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27b4101930 0x7f27b4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:11.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27b40ffd90 0x7f27b410a6a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:11.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 --2- 172.21.15.160:0/557342597 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27b4100f90 0x7f27b4108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:11.071 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 >> 172.21.15.160:0/557342597 conn(0x7f27b40fb350 msgr2=0x7f27b40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:52:11.072 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 shutdown_connections 2023-09-21T12:52:11.072 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:52:11.070+0000 7f27b9668700 1 -- 172.21.15.160:0/557342597 wait complete. 2023-09-21T12:52:11.535 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:11.535 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:11.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:11.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.536 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.537 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.537 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:11.538 DEBUG:teuthology.orchestra.run.smithi160:osd.8> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.8.service 2023-09-21T12:52:11.541 INFO:tasks.cephadm:Deploying osd.9 on smithi142 with /dev/vg_nvme/lv_1... 2023-09-21T12:52:11.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-21T12:52:11.576 INFO:journalctl@ceph.osd.8.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:52:11.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:11.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:11.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:11.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:11.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:11.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:11.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:12.270 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:52:12.688 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 12:52:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T12:52:12.371+0000 7f962f81d640 -1 osd.8 0 log_to_monitors true 2023-09-21T12:52:13.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:13 smithi142 ceph-mon[97663]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:13.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:13 smithi142 ceph-mon[97663]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:13.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:13 smithi142 ceph-mon[97663]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:13.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:13 smithi156 ceph-mon[134078]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:13 smithi156 ceph-mon[134078]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:13.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:13 smithi156 ceph-mon[134078]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:13.675 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:13 smithi160 ceph-mon[134450]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:13.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:13 smithi160 ceph-mon[134450]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:13.676 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:13 smithi160 ceph-mon[134450]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-21T12:52:14.293 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-21T12:52:14.294 INFO:teuthology.orchestra.run.smithi142.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-21T12:52:14.294 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10+0 records in 2023-09-21T12:52:14.294 INFO:teuthology.orchestra.run.smithi142.stderr:10+0 records out 2023-09-21T12:52:14.294 INFO:teuthology.orchestra.run.smithi142.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0311088 s, 337 MB/s 2023-09-21T12:52:14.295 INFO:teuthology.orchestra.run.smithi142.stderr:--> Zapping successful for: 2023-09-21T12:52:14.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-21T12:52:14.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: osdmap e57: 9 total, 8 up, 9 in 2023-09-21T12:52:14.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:14.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:14.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:14.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-21T12:52:14.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: osdmap e57: 9 total, 8 up, 9 in 2023-09-21T12:52:14.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:14.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:14.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:14.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.687 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T12:52:14.389+0000 7f9624e95700 -1 osd.8 0 waiting for initial osdmap 2023-09-21T12:52:14.688 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T12:52:14.400+0000 7f961dc84700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:52:14.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-21T12:52:14.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: osdmap e57: 9 total, 8 up, 9 in 2023-09-21T12:52:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:52:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:14.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:14.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:14.852 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi142:vg_nvme/lv_1 2023-09-21T12:52:15.578 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:52:15.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:52:15.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:52:15.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi160 2023-09-21T12:52:15.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 5722M 2023-09-21T12:52:15.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:15.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:52:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: osdmap e58: 9 total, 8 up, 9 in 2023-09-21T12:52:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] boot 2023-09-21T12:52:15.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: osdmap e59: 9 total, 9 up, 9 in 2023-09-21T12:52:15.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:15 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:52:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:52:15.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi160 2023-09-21T12:52:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 5722M 2023-09-21T12:52:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:52:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: osdmap e58: 9 total, 8 up, 9 in 2023-09-21T12:52:15.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] boot 2023-09-21T12:52:15.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: osdmap e59: 9 total, 9 up, 9 in 2023-09-21T12:52:15.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:15 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:52:15.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:52:15.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi160 2023-09-21T12:52:15.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 5722M 2023-09-21T12:52:15.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-21T12:52:15.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:52:15.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: osdmap e58: 9 total, 8 up, 9 in 2023-09-21T12:52:15.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:15.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: osd.8 [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] boot 2023-09-21T12:52:15.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: osdmap e59: 9 total, 9 up, 9 in 2023-09-21T12:52:15.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:15 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:52:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.096+0000 7f050c698700 1 -- 172.21.15.142:0/4207453310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 msgr2=0x7f0504102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.096+0000 7f050c698700 1 --2- 172.21.15.142:0/4207453310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504102450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04f4009990 tx=0x7f04f4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.096+0000 7f050c698700 1 -- 172.21.15.142:0/4207453310 shutdown_connections 2023-09-21T12:52:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 --2- 172.21.15.142:0/4207453310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 0x7f05041092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 --2- 172.21.15.142:0/4207453310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 --2- 172.21.15.142:0/4207453310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504102450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 -- 172.21.15.142:0/4207453310 >> 172.21.15.142:0/4207453310 conn(0x7f05040fc3d0 msgr2=0x7f05040fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:52:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 -- 172.21.15.142:0/4207453310 shutdown_connections 2023-09-21T12:52:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.097+0000 7f050c698700 1 -- 172.21.15.142:0/4207453310 wait complete. 2023-09-21T12:52:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.098+0000 7f050c698700 1 Processor -- start 2023-09-21T12:52:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.098+0000 7f050c698700 1 -- start start 2023-09-21T12:52:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504196b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 0x7f050419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050419e6a0 con 0x7f0504101fd0 2023-09-21T12:52:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050419e7e0 con 0x7f0504102990 2023-09-21T12:52:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050c698700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050419e970 con 0x7f0504100e70 2023-09-21T12:52:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56110/0 (socket says 172.21.15.142:56110) 2023-09-21T12:52:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 -- 172.21.15.142:0/3460563555 learned_addr learned my addr 172.21.15.142:0/3460563555 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:52:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050a434700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504196b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050ac35700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 0x7f050419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 -- 172.21.15.142:0/3460563555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 msgr2=0x7f0504196b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504196b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 -- 172.21.15.142:0/3460563555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 msgr2=0x7f050419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 0x7f050419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f0509c33700 1 -- 172.21.15.142:0/3460563555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f40095f0 con 0x7f0504101fd0 2023-09-21T12:52:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.099+0000 7f050a434700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:52:17.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f0509c33700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04f4000c00 tx=0x7f04f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:52:17.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f401d070 con 0x7f0504101fd0 2023-09-21T12:52:17.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f4005030 con 0x7f0504101fd0 2023-09-21T12:52:17.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050419ebf0 con 0x7f0504101fd0 2023-09-21T12:52:17.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f4004b80 con 0x7f0504101fd0 2023-09-21T12:52:17.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.100+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050419f000 con 0x7f0504101fd0 2023-09-21T12:52:17.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.101+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0504108460 con 0x7f0504101fd0 2023-09-21T12:52:17.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.103+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f04f40051a0 con 0x7f0504101fd0 2023-09-21T12:52:17.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.104+0000 7f04fb7fe700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:17.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.105+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f04f40cc2a0 con 0x7f0504101fd0 2023-09-21T12:52:17.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.105+0000 7f050a434700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:17.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.105+0000 7f050a434700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 0x7f04f00a2b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0500011490 tx=0x7f0500009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:52:17.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.109+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f04f4096750 con 0x7f0504101fd0 2023-09-21T12:52:17.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:17 smithi142 ceph-mon[97663]: osdmap e60: 9 total, 9 up, 9 in 2023-09-21T12:52:17.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:17 smithi142 ceph-mon[97663]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:17.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:17.319+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f050410c680 con 0x7f04f00a0640 2023-09-21T12:52:17.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:17 smithi156 ceph-mon[134078]: osdmap e60: 9 total, 9 up, 9 in 2023-09-21T12:52:17.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:17 smithi156 ceph-mon[134078]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:17.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:17 smithi160 ceph-mon[134450]: osdmap e60: 9 total, 9 up, 9 in 2023-09-21T12:52:17.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:17 smithi160 ceph-mon[134450]: pgmap v188: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:18.383 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:18 smithi142 ceph-mon[97663]: osdmap e61: 9 total, 9 up, 9 in 2023-09-21T12:52:18.383 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:18 smithi142 ceph-mon[97663]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:18.384 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:18.384 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:18.384 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:18.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:18 smithi156 ceph-mon[134078]: osdmap e61: 9 total, 9 up, 9 in 2023-09-21T12:52:18.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:18 smithi156 ceph-mon[134078]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:18.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:18.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:18.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:18.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:18 smithi160 ceph-mon[134450]: osdmap e61: 9 total, 9 up, 9 in 2023-09-21T12:52:18.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:18 smithi160 ceph-mon[134450]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi142:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:18.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:18.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:18.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:19.371 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:19 smithi142 ceph-mon[97663]: osdmap e62: 9 total, 9 up, 9 in 2023-09-21T12:52:19.372 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:19 smithi142 ceph-mon[97663]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:19.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:19 smithi156 ceph-mon[134078]: osdmap e62: 9 total, 9 up, 9 in 2023-09-21T12:52:19.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:19 smithi156 ceph-mon[134078]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:19.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:19 smithi160 ceph-mon[134450]: osdmap e62: 9 total, 9 up, 9 in 2023-09-21T12:52:19.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:19 smithi160 ceph-mon[134450]: pgmap v191: 1 pgs: 1 peering; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:20.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:20 smithi156 ceph-mon[134078]: osdmap e63: 9 total, 9 up, 9 in 2023-09-21T12:52:20.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:20 smithi142 ceph-mon[97663]: osdmap e63: 9 total, 9 up, 9 in 2023-09-21T12:52:20.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:20 smithi160 ceph-mon[134450]: osdmap e63: 9 total, 9 up, 9 in 2023-09-21T12:52:21.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:21 smithi156 ceph-mon[134078]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:52:21.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]: dispatch 2023-09-21T12:52:21.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]': finished 2023-09-21T12:52:21.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:21 smithi156 ceph-mon[134078]: osdmap e64: 10 total, 9 up, 10 in 2023-09-21T12:52:21.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:21.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:21 smithi142 ceph-mon[97663]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:52:21.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]: dispatch 2023-09-21T12:52:21.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]': finished 2023-09-21T12:52:21.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:21 smithi142 ceph-mon[97663]: osdmap e64: 10 total, 9 up, 10 in 2023-09-21T12:52:21.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:21.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:21 smithi160 ceph-mon[134450]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 133 KiB/s, 0 objects/s recovering 2023-09-21T12:52:21.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]: dispatch 2023-09-21T12:52:21.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/480446040' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "daf12b88-9896-4d51-9344-19982347fc29"}]': finished 2023-09-21T12:52:21.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:21 smithi160 ceph-mon[134450]: osdmap e64: 10 total, 9 up, 10 in 2023-09-21T12:52:21.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:22.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:22 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4033366458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:22.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:22 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4033366458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:22.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:22 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4033366458' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:23.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:23 smithi156 ceph-mon[134078]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-09-21T12:52:23.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:23 smithi142 ceph-mon[97663]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-09-21T12:52:23.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:23 smithi160 ceph-mon[134450]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 108 KiB/s, 0 objects/s recovering 2023-09-21T12:52:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:25 smithi156 ceph-mon[134078]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-09-21T12:52:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:25 smithi142 ceph-mon[97663]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-09-21T12:52:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:25 smithi160 ceph-mon[134450]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 91 KiB/s, 0 objects/s recovering 2023-09-21T12:52:27.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:27 smithi142 ceph-mon[97663]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:52:27.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:27 smithi156 ceph-mon[134078]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:52:27.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:27 smithi160 ceph-mon[134450]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-21T12:52:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-21T12:52:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:28 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:28.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:28 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-21T12:52:28.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:28 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:28.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-21T12:52:28.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:28 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:29.077 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:29 smithi142 ceph-mon[97663]: Deploying daemon osd.9 on smithi142 2023-09-21T12:52:29.078 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:29 smithi142 ceph-mon[97663]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-09-21T12:52:29.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:29 smithi156 ceph-mon[134078]: Deploying daemon osd.9 on smithi142 2023-09-21T12:52:29.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:29 smithi156 ceph-mon[134078]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-09-21T12:52:29.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:29 smithi160 ceph-mon[134450]: Deploying daemon osd.9 on smithi142 2023-09-21T12:52:29.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:29 smithi160 ceph-mon[134450]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2023-09-21T12:52:31.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:31 smithi156 ceph-mon[134078]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:31.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:31 smithi142 ceph-mon[97663]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:31.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:31 smithi160 ceph-mon[134450]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:33.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:33 smithi156 ceph-mon[134078]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:33.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:33 smithi142 ceph-mon[97663]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:33.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:33 smithi160 ceph-mon[134450]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:35.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:35 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:35 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:35 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:35.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:35 smithi160 ceph-mon[134450]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:35.509 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:35 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.510 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:35 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.510 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:35 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:35.510 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:35 smithi142 ceph-mon[97663]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:35.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:35 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:35 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:35.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:35 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:35.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:35 smithi156 ceph-mon[134078]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:37.345 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:37 smithi142 ceph-mon[97663]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:37.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:37 smithi156 ceph-mon[134078]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:37.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:37 smithi160 ceph-mon[134450]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:37.887 INFO:teuthology.orchestra.run.smithi142.stdout:Created osd(s) 9 on host 'smithi142' 2023-09-21T12:52:37.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.887+0000 7f04fb7fe700 1 -- 172.21.15.142:0/3460563555 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f050410c680 con 0x7f04f00a0640 2023-09-21T12:52:37.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 msgr2=0x7f04f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:37.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 0x7f04f00a2b00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0500011490 tx=0x7f0500009260 comp rx=0 tx=0).stop 2023-09-21T12:52:37.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 msgr2=0x7f0504197050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:37.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04f4000c00 tx=0x7f04f4004730 comp rx=0 tx=0).stop 2023-09-21T12:52:37.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 shutdown_connections 2023-09-21T12:52:37.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:37.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0504102990 0x7f050419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:37.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0504100e70 0x7f0504196b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:37.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 --2- 172.21.15.142:0/3460563555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0504101fd0 0x7f0504197050 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:37.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 >> 172.21.15.142:0/3460563555 conn(0x7f05040fc3d0 msgr2=0x7f05041055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:52:37.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 shutdown_connections 2023-09-21T12:52:37.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:52:37.890+0000 7f050c698700 1 -- 172.21.15.142:0/3460563555 wait complete. 2023-09-21T12:52:38.397 DEBUG:teuthology.orchestra.run.smithi142:osd.9> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.9.service 2023-09-21T12:52:38.402 INFO:tasks.cephadm:Deploying osd.10 on smithi156 with /dev/vg_nvme/lv_1... 2023-09-21T12:52:38.403 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-21T12:52:38.474 INFO:journalctl@ceph.osd.9.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:52:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:38.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:38 smithi142 ceph-mon[97663]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-21T12:52:38.970 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:52:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:39.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:38 smithi156 ceph-mon[134078]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-21T12:52:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:39.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:39.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:39.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:39.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:38 smithi160 ceph-mon[134450]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-21T12:52:39.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:39 smithi156 ceph-mon[134078]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:39 smithi156 ceph-mon[134078]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-21T12:52:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:39 smithi156 ceph-mon[134078]: osdmap e65: 10 total, 9 up, 10 in 2023-09-21T12:52:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:39 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:39 smithi156 ceph-mon[134078]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:52:40.056 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T12:52:39.856+0000 7f08e5cd4700 -1 osd.9 0 waiting for initial osdmap 2023-09-21T12:52:40.056 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T12:52:39.873+0000 7f08de2c2700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:52:40.057 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-mon[97663]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:40.057 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-mon[97663]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-21T12:52:40.057 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-mon[97663]: osdmap e65: 10 total, 9 up, 10 in 2023-09-21T12:52:40.057 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:40.058 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:39 smithi142 ceph-mon[97663]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:52:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:39 smithi160 ceph-mon[134450]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:39 smithi160 ceph-mon[134450]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-21T12:52:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:39 smithi160 ceph-mon[134450]: osdmap e65: 10 total, 9 up, 10 in 2023-09-21T12:52:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:39 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:40.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:39 smithi160 ceph-mon[134450]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]: dispatch 2023-09-21T12:52:40.563 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-21T12:52:40.563 INFO:teuthology.orchestra.run.smithi156.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-21T12:52:40.564 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10+0 records in 2023-09-21T12:52:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:10+0 records out 2023-09-21T12:52:40.564 INFO:teuthology.orchestra.run.smithi156.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00827123 s, 1.3 GB/s 2023-09-21T12:52:40.564 INFO:teuthology.orchestra.run.smithi156.stderr:--> Zapping successful for: 2023-09-21T12:52:41.030 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi156:vg_nvme/lv_1 2023-09-21T12:52:41.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:40 smithi156 ceph-mon[134078]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:52:41.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:40 smithi156 ceph-mon[134078]: osdmap e66: 10 total, 9 up, 10 in 2023-09-21T12:52:41.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:40 smithi156 ceph-mon[134078]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:41.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:40 smithi142 ceph-mon[97663]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:52:41.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:40 smithi142 ceph-mon[97663]: osdmap e66: 10 total, 9 up, 10 in 2023-09-21T12:52:41.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:40 smithi142 ceph-mon[97663]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:40 smithi160 ceph-mon[134450]: from='osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi142", "root=default"]}]': finished 2023-09-21T12:52:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:40 smithi160 ceph-mon[134450]: osdmap e66: 10 total, 9 up, 10 in 2023-09-21T12:52:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:40 smithi160 ceph-mon[134450]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-09-21T12:52:41.583 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T12:52:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:41 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:52:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:41 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:52:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:41 smithi156 ceph-mon[134078]: osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] boot 2023-09-21T12:52:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:41 smithi156 ceph-mon[134078]: osdmap e67: 10 total, 10 up, 10 in 2023-09-21T12:52:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:41 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:52:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:41 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:52:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:41 smithi142 ceph-mon[97663]: osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] boot 2023-09-21T12:52:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:41 smithi142 ceph-mon[97663]: osdmap e67: 10 total, 10 up, 10 in 2023-09-21T12:52:42.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:41 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:52:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:41 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:52:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:41 smithi160 ceph-mon[134450]: osd.9 [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] boot 2023-09-21T12:52:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:41 smithi160 ceph-mon[134450]: osdmap e67: 10 total, 10 up, 10 in 2023-09-21T12:52:42.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:52:42.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- 172.21.15.156:0/3738545376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf94101380 msgr2=0x7fcf941017a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:42.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/3738545376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf94101380 0x7fcf941017a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009990 tx=0x7fcf84009ca0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.891 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- 172.21.15.156:0/3738545376 shutdown_connections 2023-09-21T12:52:42.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/3738545376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94108240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/3738545376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf94101380 0x7fcf941017a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/3738545376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf940fffe0 0x7fcf94100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- 172.21.15.156:0/3738545376 >> 172.21.15.156:0/3738545376 conn(0x7fcf940faa90 msgr2=0x7fcf940fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:52:42.892 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- 172.21.15.156:0/3738545376 shutdown_connections 2023-09-21T12:52:42.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- 172.21.15.156:0/3738545376 wait complete. 2023-09-21T12:52:42.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 Processor -- start 2023-09-21T12:52:42.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.889+0000 7fcf9a1df700 1 -- start start 2023-09-21T12:52:42.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:42.893 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:42.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf94101380 0x7fcf9419e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:42.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9419e690 con 0x7fcf941009a0 2023-09-21T12:52:42.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9419e7d0 con 0x7fcf940fffe0 2023-09-21T12:52:42.894 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf9a1df700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9419e960 con 0x7fcf94101380 2023-09-21T12:52:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.156:51676/0 (socket says 172.21.15.156:51676) 2023-09-21T12:52:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 -- 172.21.15.156:0/608911450 learned_addr learned my addr 172.21.15.156:0/608911450 (peer_addr_for_me v2:172.21.15.156:0/0) 2023-09-21T12:52:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf92ffd700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:42.895 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf93fff700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf94101380 0x7fcf9419e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:42.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 -- 172.21.15.156:0/608911450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf94101380 msgr2=0x7fcf9419e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:42.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf94101380 0x7fcf9419e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 -- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 msgr2=0x7fcf94197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:42.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:42.896 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 -- 172.21.15.156:0/608911450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840095f0 con 0x7fcf940fffe0 2023-09-21T12:52:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf92ffd700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:52:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf937fe700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf84000c00 tx=0x7fcf8400f7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:52:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8401d070 con 0x7fcf940fffe0 2023-09-21T12:52:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf8400fca0 con 0x7fcf940fffe0 2023-09-21T12:52:42.897 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.890+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf84017720 con 0x7fcf940fffe0 2023-09-21T12:52:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.891+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf94108b40 con 0x7fcf940fffe0 2023-09-21T12:52:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.891+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94108f90 con 0x7fcf940fffe0 2023-09-21T12:52:42.898 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.891+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94107380 con 0x7fcf940fffe0 2023-09-21T12:52:42.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.893+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fcf84017880 con 0x7fcf940fffe0 2023-09-21T12:52:42.899 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.893+0000 7fcf90ff9700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 0x7fcf7c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:52:42.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.893+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fcf840ccd50 con 0x7fcf940fffe0 2023-09-21T12:52:42.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.893+0000 7fcf92ffd700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 0x7fcf7c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:52:42.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.894+0000 7fcf92ffd700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 0x7fcf7c0a2b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005950 tx=0x7fcf88005f50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:52:42.900 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:42.897+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcf84097110 con 0x7fcf940fffe0 2023-09-21T12:52:43.102 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:43.102+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf9410c6a0 con 0x7fcf7c0a0640 2023-09-21T12:52:43.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi142 2023-09-21T12:52:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 4316M 2023-09-21T12:52:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:43.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: osdmap e68: 10 total, 10 up, 10 in 2023-09-21T12:52:43.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:42 smithi156 ceph-mon[134078]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi142 2023-09-21T12:52:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 4316M 2023-09-21T12:52:43.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:43.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:43.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: osdmap e68: 10 total, 10 up, 10 in 2023-09-21T12:52:43.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:42 smithi142 ceph-mon[97663]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi142 2023-09-21T12:52:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:52:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 4316M 2023-09-21T12:52:43.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:43.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:52:43.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:43.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: osdmap e68: 10 total, 10 up, 10 in 2023-09-21T12:52:43.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:42 smithi160 ceph-mon[134450]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:44 smithi156 ceph-mon[134078]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:44 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:44 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:44 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:44.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:44 smithi142 ceph-mon[97663]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:44.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:44.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:44.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:44.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:44 smithi160 ceph-mon[134450]: from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi156:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:52:44.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:44 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:52:44.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:44 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:52:44.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:44 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:45.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:45 smithi156 ceph-mon[134078]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:45.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:45 smithi142 ceph-mon[97663]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:45.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:45 smithi160 ceph-mon[134450]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:46.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:46 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/3224813869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:46 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:46 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]': finished 2023-09-21T12:52:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:46 smithi156 ceph-mon[134078]: osdmap e69: 11 total, 10 up, 11 in 2023-09-21T12:52:46.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:46 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:52:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/3224813869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:46 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:46 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]': finished 2023-09-21T12:52:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:46 smithi142 ceph-mon[97663]: osdmap e69: 11 total, 10 up, 11 in 2023-09-21T12:52:46.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:46 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:52:46.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:46 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/3224813869' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:46 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]: dispatch 2023-09-21T12:52:46.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:46 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f5dfd0a-9c50-4263-a4ac-8e08f16b1017"}]': finished 2023-09-21T12:52:46.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:46 smithi160 ceph-mon[134450]: osdmap e69: 11 total, 10 up, 11 in 2023-09-21T12:52:46.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:46 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:52:47.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.156:0/158958818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:47.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:47 smithi156 ceph-mon[134078]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.156:0/158958818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:47.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:47 smithi142 ceph-mon[97663]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:47.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.156:0/158958818' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:52:47.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:47 smithi160 ceph-mon[134450]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:49.641 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:49 smithi156 ceph-mon[134078]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:49.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:49 smithi142 ceph-mon[97663]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:49.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:49 smithi160 ceph-mon[134450]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:51.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:51 smithi156 ceph-mon[134078]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:51.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:51 smithi142 ceph-mon[97663]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:51.687 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:51 smithi160 ceph-mon[134450]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:52.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-21T12:52:52.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:52 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:52.687 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-21T12:52:52.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:52 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:52.797 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-21T12:52:52.797 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:52 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:52:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:53 smithi142 ceph-mon[97663]: Deploying daemon osd.10 on smithi156 2023-09-21T12:52:53.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:53 smithi142 ceph-mon[97663]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:53.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:53 smithi156 ceph-mon[134078]: Deploying daemon osd.10 on smithi156 2023-09-21T12:52:53.675 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:53 smithi156 ceph-mon[134078]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:53.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:53 smithi160 ceph-mon[134450]: Deploying daemon osd.10 on smithi156 2023-09-21T12:52:53.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:53 smithi160 ceph-mon[134450]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:55.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:55 smithi142 ceph-mon[97663]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:55 smithi160 ceph-mon[134450]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:55.757 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:55 smithi156 ceph-mon[134078]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:57.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:57 smithi156 ceph-mon[134078]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:57.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:57 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:57 smithi142 ceph-mon[97663]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:57 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:57 smithi160 ceph-mon[134450]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:57.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:57 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:52:59.312 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.312+0000 7fcf90ff9700 1 -- 172.21.15.156:0/608911450 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fcf9410c6a0 con 0x7fcf7c0a0640 2023-09-21T12:52:59.312 INFO:teuthology.orchestra.run.smithi156.stdout:Created osd(s) 10 on host 'smithi156' 2023-09-21T12:52:59.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 msgr2=0x7fcf7c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:59.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 0x7fcf7c0a2b00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcf88005950 tx=0x7fcf88005f50 comp rx=0 tx=0).stop 2023-09-21T12:52:59.314 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 msgr2=0x7fcf94196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:52:59.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcf84000c00 tx=0x7fcf8400f7b0 comp rx=0 tx=0).stop 2023-09-21T12:52:59.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 shutdown_connections 2023-09-21T12:52:59.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf7c0a0640 0x7fcf7c0a2b00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:59.315 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf94101380 0x7fcf9419e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:59.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf940fffe0 0x7fcf94196b00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:59.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 --2- 172.21.15.156:0/608911450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf941009a0 0x7fcf94197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:52:59.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 >> 172.21.15.156:0/608911450 conn(0x7fcf940faa90 msgr2=0x7fcf941044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:52:59.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 shutdown_connections 2023-09-21T12:52:59.316 INFO:teuthology.orchestra.run.smithi156.stderr:2023-09-21T12:52:59.314+0000 7fcf9a1df700 1 -- 172.21.15.156:0/608911450 wait complete. 2023-09-21T12:52:59.785 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:59 smithi156 ceph-mon[134078]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:59.785 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:59 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:59 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:59 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.786 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:52:59 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.787 DEBUG:teuthology.orchestra.run.smithi156:osd.10> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.10.service 2023-09-21T12:52:59.791 INFO:tasks.cephadm:Deploying osd.11 on smithi160 with /dev/vg_nvme/lv_1... 2023-09-21T12:52:59.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-21T12:52:59.822 INFO:journalctl@ceph.osd.10.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:52:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:59 smithi142 ceph-mon[97663]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:59 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:59 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:59 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:52:59 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:59 smithi160 ceph-mon[134450]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:52:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:59 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:59 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:59 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:52:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:52:59 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:00.356 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:53:00.553 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 12:53:00 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T12:53:00.550+0000 7faab8728640 -1 osd.10 0 log_to_monitors true 2023-09-21T12:53:00.814 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:00 smithi156 ceph-mon[134078]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:00.815 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:00 smithi156 ceph-mon[134078]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:00.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:00 smithi160 ceph-mon[134450]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:00.835 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:00 smithi160 ceph-mon[134450]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:00.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:00 smithi142 ceph-mon[97663]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:00.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:00 smithi142 ceph-mon[97663]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-21T12:53:01.832 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-21T12:53:01.832 INFO:teuthology.orchestra.run.smithi160.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-21T12:53:01.832 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10+0 records in 2023-09-21T12:53:01.832 INFO:teuthology.orchestra.run.smithi160.stderr:10+0 records out 2023-09-21T12:53:01.833 INFO:teuthology.orchestra.run.smithi160.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111868 s, 937 MB/s 2023-09-21T12:53:01.833 INFO:teuthology.orchestra.run.smithi160.stderr:--> Zapping successful for: 2023-09-21T12:53:01.865 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:01.865 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-21T12:53:01.865 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: osdmap e70: 11 total, 10 up, 11 in 2023-09-21T12:53:01.866 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:01.866 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:01.866 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:01 smithi160 ceph-mon[134450]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:01.896 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T12:53:01.609+0000 7faaadda0700 -1 osd.10 0 waiting for initial osdmap 2023-09-21T12:53:01.896 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T12:53:01.620+0000 7faaa5b8d700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:53:01.896 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:01.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-21T12:53:01.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: osdmap e70: 11 total, 10 up, 11 in 2023-09-21T12:53:01.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:01.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:01.897 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:01 smithi156 ceph-mon[134078]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-21T12:53:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: osdmap e70: 11 total, 10 up, 11 in 2023-09-21T12:53:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: from='osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:01 smithi142 ceph-mon[97663]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]: dispatch 2023-09-21T12:53:02.310 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi160:vg_nvme/lv_1 2023-09-21T12:53:02.871 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:53:02.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:53:02.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: osdmap e71: 11 total, 10 up, 11 in 2023-09-21T12:53:02.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:02.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:02.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:53:02.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: osdmap e71: 11 total, 10 up, 11 in 2023-09-21T12:53:02.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:02.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:02.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi156", "root=default"]}]': finished 2023-09-21T12:53:02.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: osdmap e71: 11 total, 10 up, 11 in 2023-09-21T12:53:02.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:02.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:02.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:02.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:02.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:02.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:03.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:53:03.626 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:53:03.627 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:03.627 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi156 2023-09-21T12:53:03.627 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 4292M 2023-09-21T12:53:03.627 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.628 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] boot 2023-09-21T12:53:03.628 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: osdmap e72: 11 total, 11 up, 11 in 2023-09-21T12:53:03.628 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.629 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:03.629 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:03.885 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:03.885 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:03 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:53:03.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:53:03.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:03.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi156 2023-09-21T12:53:03.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 4292M 2023-09-21T12:53:03.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] boot 2023-09-21T12:53:03.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: osdmap e72: 11 total, 11 up, 11 in 2023-09-21T12:53:03.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:03.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:03.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:03.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:03 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:53:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:53:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-09-21T12:53:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi156 2023-09-21T12:53:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 4292M 2023-09-21T12:53:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: osd.10 [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] boot 2023-09-21T12:53:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: osdmap e72: 11 total, 11 up, 11 in 2023-09-21T12:53:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:53:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:03.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:03.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:03 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:04.074 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 -- 172.21.15.160:0/2369338051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4102990 msgr2=0x7f1eb41092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:04.074 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/2369338051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4102990 0x7f1eb41092b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00b0a0 tx=0x7f1eac00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 -- 172.21.15.160:0/2369338051 shutdown_connections 2023-09-21T12:53:04.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/2369338051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eb4100e70 0x7f1eb4101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/2369338051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4102990 0x7f1eb41092b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.075 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/2369338051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4101fd0 0x7f1eb4102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 -- 172.21.15.160:0/2369338051 >> 172.21.15.160:0/2369338051 conn(0x7f1eb40fc3d0 msgr2=0x7f1eb40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:04.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 -- 172.21.15.160:0/2369338051 shutdown_connections 2023-09-21T12:53:04.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.074+0000 7f1ebc05c700 1 -- 172.21.15.160:0/2369338051 wait complete. 2023-09-21T12:53:04.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 Processor -- start 2023-09-21T12:53:04.076 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 -- start start 2023-09-21T12:53:04.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eb4100e70 0x7f1eb4074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:04.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:04.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4102990 0x7f1eb4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:04.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4073e90 con 0x7f1eb4100e70 2023-09-21T12:53:04.077 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb4074000 con 0x7f1eb4102990 2023-09-21T12:53:04.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1ebc05c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb41a0ad0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:04.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:57978/0 (socket says 172.21.15.160:57978) 2023-09-21T12:53:04.078 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 -- 172.21.15.160:0/1892309204 learned_addr learned my addr 172.21.15.160:0/1892309204 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:53:04.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eba5f9700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4102990 0x7f1eb4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:04.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 -- 172.21.15.160:0/1892309204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4102990 msgr2=0x7f1eb4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:04.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4102990 0x7f1eb4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 -- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eb4100e70 msgr2=0x7f1eb4074b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:04.079 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eb4100e70 0x7f1eb4074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:04.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 -- 172.21.15.160:0/1892309204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac009d00 con 0x7f1eb4101fd0 2023-09-21T12:53:04.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.075+0000 7f1eb95f7700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400d950 tx=0x7f1ea400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:04.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.076+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4009b40 con 0x7f1eb4101fd0 2023-09-21T12:53:04.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.076+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ea4009ca0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.080 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.076+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb41a0db0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.076+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400f620 con 0x7f1eb4101fd0 2023-09-21T12:53:04.081 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.076+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb41a12f0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.077+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb41083b0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.078+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1ea4010460 con 0x7f1eb4101fd0 2023-09-21T12:53:04.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.078+0000 7f1eaaffd700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 0x7f1ea00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:04.082 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.078+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f1ea40cb870 con 0x7f1eb4101fd0 2023-09-21T12:53:04.083 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.078+0000 7f1eb9df8700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 0x7f1ea00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:04.083 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.079+0000 7f1eb9df8700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 0x7f1ea00a2b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097b0 tx=0x7f1eb0006d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:04.083 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.082+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1ea40959d0 con 0x7f1eb4101fd0 2023-09-21T12:53:04.278 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:04.280+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1eb402d1a0 con 0x7f1ea00a06c0 2023-09-21T12:53:04.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:04 smithi156 ceph-mon[134078]: osdmap e73: 11 total, 11 up, 11 in 2023-09-21T12:53:04.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:53:04.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:53:04.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:04 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:04 smithi142 ceph-mon[97663]: osdmap e73: 11 total, 11 up, 11 in 2023-09-21T12:53:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:53:04.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:53:04.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:04 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:04 smithi160 ceph-mon[134450]: osdmap e73: 11 total, 11 up, 11 in 2023-09-21T12:53:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-21T12:53:04.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-21T12:53:04.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:04 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:05.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:05 smithi160 ceph-mon[134450]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:05.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:05 smithi160 ceph-mon[134450]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:05.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:05 smithi160 ceph-mon[134450]: osdmap e74: 11 total, 11 up, 11 in 2023-09-21T12:53:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:05 smithi156 ceph-mon[134078]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:05.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:05 smithi156 ceph-mon[134078]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:05.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:05 smithi156 ceph-mon[134078]: osdmap e74: 11 total, 11 up, 11 in 2023-09-21T12:53:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:05 smithi142 ceph-mon[97663]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi160:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:05 smithi142 ceph-mon[97663]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:05 smithi142 ceph-mon[97663]: osdmap e74: 11 total, 11 up, 11 in 2023-09-21T12:53:06.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: osdmap e75: 11 total, 11 up, 11 in 2023-09-21T12:53:06.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/4055130177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]': finished 2023-09-21T12:53:06.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: osdmap e76: 12 total, 11 up, 12 in 2023-09-21T12:53:06.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:06 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: osdmap e75: 11 total, 11 up, 11 in 2023-09-21T12:53:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/4055130177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]': finished 2023-09-21T12:53:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: osdmap e76: 12 total, 11 up, 12 in 2023-09-21T12:53:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:06 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: osdmap e75: 11 total, 11 up, 11 in 2023-09-21T12:53:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/4055130177' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]: dispatch 2023-09-21T12:53:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f2973989-1721-4164-9d5e-a6fd05b73d52"}]': finished 2023-09-21T12:53:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: osdmap e76: 12 total, 11 up, 12 in 2023-09-21T12:53:06.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:06 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:07 smithi156 ceph-mon[134078]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:53:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:07 smithi156 ceph-mon[134078]: from='client.? 172.21.15.160:0/353047476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:53:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:07 smithi142 ceph-mon[97663]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:53:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:07 smithi142 ceph-mon[97663]: from='client.? 172.21.15.160:0/353047476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:53:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:07 smithi160 ceph-mon[134450]: pgmap v228: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-21T12:53:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:07 smithi160 ceph-mon[134450]: from='client.? 172.21.15.160:0/353047476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-21T12:53:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:09 smithi156 ceph-mon[134078]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 122 KiB/s, 0 objects/s recovering 2023-09-21T12:53:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:09 smithi142 ceph-mon[97663]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 122 KiB/s, 0 objects/s recovering 2023-09-21T12:53:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:09 smithi160 ceph-mon[134450]: pgmap v230: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 122 KiB/s, 0 objects/s recovering 2023-09-21T12:53:11.824 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:11 smithi160 ceph-mon[134450]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:53:11.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:11 smithi156 ceph-mon[134078]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:53:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:11 smithi142 ceph-mon[97663]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-21T12:53:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:13 smithi156 ceph-mon[134078]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-09-21T12:53:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-21T12:53:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:13 smithi142 ceph-mon[97663]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-09-21T12:53:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-21T12:53:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:13 smithi160 ceph-mon[134450]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-09-21T12:53:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-21T12:53:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:14.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:14 smithi156 ceph-mon[134078]: Deploying daemon osd.11 on smithi160 2023-09-21T12:53:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:14 smithi142 ceph-mon[97663]: Deploying daemon osd.11 on smithi160 2023-09-21T12:53:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:14 smithi160 ceph-mon[134450]: Deploying daemon osd.11 on smithi160 2023-09-21T12:53:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:15 smithi156 ceph-mon[134078]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:15 smithi142 ceph-mon[97663]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:15 smithi160 ceph-mon[134450]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:17.359 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:17 smithi160 ceph-mon[134450]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:17.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:17 smithi156 ceph-mon[134078]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:17.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:17 smithi142 ceph-mon[97663]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:19.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:19.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:19.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:19.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:19.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:19 smithi160 ceph-mon[134450]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:19 smithi156 ceph-mon[134078]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:19 smithi142 ceph-mon[97663]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:20.442 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.443+0000 7f1eaaffd700 1 -- 172.21.15.160:0/1892309204 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f1eb402d1a0 con 0x7f1ea00a06c0 2023-09-21T12:53:20.443 INFO:teuthology.orchestra.run.smithi160.stdout:Created osd(s) 11 on host 'smithi160' 2023-09-21T12:53:20.444 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 msgr2=0x7f1ea00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 0x7f1ea00a2b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1eb00097b0 tx=0x7f1eb0006d20 comp rx=0 tx=0).stop 2023-09-21T12:53:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 msgr2=0x7f1eb40731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400d950 tx=0x7f1ea400dd10 comp rx=0 tx=0).stop 2023-09-21T12:53:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 shutdown_connections 2023-09-21T12:53:20.445 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1ea00a06c0 0x7f1ea00a2b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:20.446 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1eb4100e70 0x7f1eb4074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:20.446 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1eb4102990 0x7f1eb4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:20.446 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 --2- 172.21.15.160:0/1892309204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1eb4101fd0 0x7f1eb40731d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:20.446 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 >> 172.21.15.160:0/1892309204 conn(0x7f1eb40fc3d0 msgr2=0x7f1eb41054f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:20.446 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 shutdown_connections 2023-09-21T12:53:20.447 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:20.445+0000 7f1ebc05c700 1 -- 172.21.15.160:0/1892309204 wait complete. 2023-09-21T12:53:20.872 DEBUG:teuthology.orchestra.run.smithi160:osd.11> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.11.service 2023-09-21T12:53:20.875 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-09-21T12:53:20.875 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd stat -f json 2023-09-21T12:53:20.910 INFO:journalctl@ceph.osd.11.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:53:21.604 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:53:21.609 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.610 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.610 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:21.610 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:21.610 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.611 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:21.611 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.611 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.611 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:21.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:21 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:21.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:21.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:21 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:21.930 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 12:53:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T12:53:21.641+0000 7fb0fa273640 -1 osd.11 0 log_to_monitors true 2023-09-21T12:53:22.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:22 smithi142 ceph-mon[97663]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:22.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:22 smithi142 ceph-mon[97663]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:22.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:22 smithi160 ceph-mon[134450]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:22.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:22 smithi160 ceph-mon[134450]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:22.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:22 smithi156 ceph-mon[134078]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:22.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:22 smithi156 ceph-mon[134078]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-21T12:53:23.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 -- 172.21.15.142:0/4126744958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304101fd0 msgr2=0x7fd304102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:23.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/4126744958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304101fd0 0x7fd304102450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd2f8009990 tx=0x7fd2f8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 -- 172.21.15.142:0/4126744958 shutdown_connections 2023-09-21T12:53:23.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/4126744958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304102990 0x7fd3041092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/4126744958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304100e70 0x7fd304101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/4126744958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304101fd0 0x7fd304102450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.132+0000 7fd30a2fd700 1 -- 172.21.15.142:0/4126744958 >> 172.21.15.142:0/4126744958 conn(0x7fd3040fc3d0 msgr2=0x7fd3040fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:23.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.133+0000 7fd30a2fd700 1 -- 172.21.15.142:0/4126744958 shutdown_connections 2023-09-21T12:53:23.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.133+0000 7fd30a2fd700 1 -- 172.21.15.142:0/4126744958 wait complete. 2023-09-21T12:53:23.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 Processor -- start 2023-09-21T12:53:23.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 -- start start 2023-09-21T12:53:23.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304100e70 0x7fd304198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:23.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304101fd0 0x7fd304199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:23.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:23.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041a0850 con 0x7fd304102990 2023-09-21T12:53:23.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041a0990 con 0x7fd304101fd0 2023-09-21T12:53:23.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30a2fd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3041a0b50 con 0x7fd304100e70 2023-09-21T12:53:23.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.134+0000 7fd30889a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:23.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53704/0 (socket says 172.21.15.142:53704) 2023-09-21T12:53:23.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 -- 172.21.15.142:0/3305095441 learned_addr learned my addr 172.21.15.142:0/3305095441 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd3037fe700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304101fd0 0x7fd304199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd303fff700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304100e70 0x7fd304198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 -- 172.21.15.142:0/3305095441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304100e70 msgr2=0x7fd304198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304100e70 0x7fd304198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 -- 172.21.15.142:0/3305095441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304101fd0 msgr2=0x7fd304199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:23.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304101fd0 0x7fd304199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 -- 172.21.15.142:0/3305095441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f80095f0 con 0x7fd304102990 2023-09-21T12:53:23.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30889a700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00ef30 tx=0x7fd2fc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:23.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc018070 con 0x7fd304102990 2023-09-21T12:53:23.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3041a0dd0 con 0x7fd304102990 2023-09-21T12:53:23.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2fc00f040 con 0x7fd304102990 2023-09-21T12:53:23.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.135+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc00cd00 con 0x7fd304102990 2023-09-21T12:53:23.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.136+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3041a1210 con 0x7fd304102990 2023-09-21T12:53:23.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.137+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd304193470 con 0x7fd304102990 2023-09-21T12:53:23.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.138+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fd2fc003a00 con 0x7fd304102990 2023-09-21T12:53:23.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.140+0000 7fd3017fa700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 0x7fd2ec0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:23.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.140+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6831+0+0 (secure 0 0 0) 0x7fd2fc0cb0c0 con 0x7fd304102990 2023-09-21T12:53:23.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.140+0000 7fd303fff700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 0x7fd2ec0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:23.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.141+0000 7fd303fff700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 0x7fd2ec0a2b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd30419a1e0 tx=0x7fd2f40073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:23.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.144+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd2fc0951b0 con 0x7fd304102990 2023-09-21T12:53:23.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.348+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd30410c680 con 0x7fd304102990 2023-09-21T12:53:23.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.349+0000 7fd3017fa700 1 -- 172.21.15.142:0/3305095441 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7fd2fc0987d0 con 0x7fd304102990 2023-09-21T12:53:23.349 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:23.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 msgr2=0x7fd2ec0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:23.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 0x7fd2ec0a2b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd30419a1e0 tx=0x7fd2f40073d0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 msgr2=0x7fd3041a0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:23.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00ef30 tx=0x7fd2fc00c3a0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 shutdown_connections 2023-09-21T12:53:23.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd2ec0a06c0 0x7fd2ec0a2b80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd304102990 0x7fd3041a0280 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd304100e70 0x7fd304198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 --2- 172.21.15.142:0/3305095441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd304101fd0 0x7fd304199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:23.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 >> 172.21.15.142:0/3305095441 conn(0x7fd3040fc3d0 msgr2=0x7fd304107940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:23.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 shutdown_connections 2023-09-21T12:53:23.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:23.351+0000 7fd30a2fd700 1 -- 172.21.15.142:0/3305095441 wait complete. 2023-09-21T12:53:23.438 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T12:53:23.322+0000 7fb0ef8eb700 -1 osd.11 0 waiting for initial osdmap 2023-09-21T12:53:23.438 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T12:53:23.335+0000 7fb0e8edb700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-21T12:53:23.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-21T12:53:23.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: osdmap e77: 12 total, 11 up, 12 in 2023-09-21T12:53:23.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:23.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:23 smithi160 ceph-mon[134450]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:23.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-21T12:53:23.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: osdmap e77: 12 total, 11 up, 12 in 2023-09-21T12:53:23.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:23.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:23 smithi156 ceph-mon[134078]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:23.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-21T12:53:23.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: osdmap e77: 12 total, 11 up, 12 in 2023-09-21T12:53:23.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:23.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: from='osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]: dispatch 2023-09-21T12:53:23.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:23 smithi142 ceph-mon[97663]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:23.783 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":78,"num_osds":12,"num_up_osds":11,"osd_up_since":1695300782,"num_in_osds":12,"osd_in_since":1695300786,"num_remapped_pgs":0} 2023-09-21T12:53:24.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:53:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: osdmap e78: 12 total, 11 up, 12 in 2023-09-21T12:53:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3305095441' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:24.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: Detected new or changed devices on smithi160 2023-09-21T12:53:24.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.657 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 4292M 2023-09-21T12:53:24.658 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:24.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:24.659 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:24 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:53:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: osdmap e78: 12 total, 11 up, 12 in 2023-09-21T12:53:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3305095441' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: Detected new or changed devices on smithi160 2023-09-21T12:53:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 4292M 2023-09-21T12:53:24.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:24.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:24.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:24 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi160", "root=default"]}]': finished 2023-09-21T12:53:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: osdmap e78: 12 total, 11 up, 12 in 2023-09-21T12:53:24.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3305095441' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: Detected new or changed devices on smithi160 2023-09-21T12:53:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:53:24.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 4292M 2023-09-21T12:53:24.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:24.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:24.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:24 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:24.785 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd stat -f json 2023-09-21T12:53:25.516 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:53:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: purged_snaps scrub starts 2023-09-21T12:53:25.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: purged_snaps scrub ok 2023-09-21T12:53:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] boot 2023-09-21T12:53:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: osdmap e79: 12 total, 12 up, 12 in 2023-09-21T12:53:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:25 smithi156 ceph-mon[134078]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: purged_snaps scrub starts 2023-09-21T12:53:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: purged_snaps scrub ok 2023-09-21T12:53:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] boot 2023-09-21T12:53:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: osdmap e79: 12 total, 12 up, 12 in 2023-09-21T12:53:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:25 smithi142 ceph-mon[97663]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: purged_snaps scrub starts 2023-09-21T12:53:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: purged_snaps scrub ok 2023-09-21T12:53:25.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: osd.11 [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] boot 2023-09-21T12:53:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: osdmap e79: 12 total, 12 up, 12 in 2023-09-21T12:53:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:53:25.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:25 smithi160 ceph-mon[134450]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-09-21T12:53:26.367 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:26 smithi142 ceph-mon[97663]: osdmap e80: 12 total, 12 up, 12 in 2023-09-21T12:53:26.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:26 smithi156 ceph-mon[134078]: osdmap e80: 12 total, 12 up, 12 in 2023-09-21T12:53:26.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:26 smithi160 ceph-mon[134450]: osdmap e80: 12 total, 12 up, 12 in 2023-09-21T12:53:27.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 -- 172.21.15.142:0/2855757837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 msgr2=0x7f65d0102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:27.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 --2- 172.21.15.142:0/2855757837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d0102450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009990 tx=0x7f65c0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 -- 172.21.15.142:0/2855757837 shutdown_connections 2023-09-21T12:53:27.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 --2- 172.21.15.142:0/2855757837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0102990 0x7f65d01092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 --2- 172.21.15.142:0/2855757837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0100e70 0x7f65d0101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 --2- 172.21.15.142:0/2855757837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d0102450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.011+0000 7f65d7b26700 1 -- 172.21.15.142:0/2855757837 >> 172.21.15.142:0/2855757837 conn(0x7f65d00fc3d0 msgr2=0x7f65d00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:27.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.012+0000 7f65d7b26700 1 -- 172.21.15.142:0/2855757837 shutdown_connections 2023-09-21T12:53:27.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.012+0000 7f65d7b26700 1 -- 172.21.15.142:0/2855757837 wait complete. 2023-09-21T12:53:27.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 Processor -- start 2023-09-21T12:53:27.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 -- start start 2023-09-21T12:53:27.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0100e70 0x7f65d0074b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:27.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:27.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0102990 0x7f65d0073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:27.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0073e90 con 0x7f65d0101fd0 2023-09-21T12:53:27.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d0074000 con 0x7f65d0100e70 2023-09-21T12:53:27.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d7b26700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d01a0c20 con 0x7f65d0102990 2023-09-21T12:53:27.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.013+0000 7f65d50c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:27.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39916/0 (socket says 172.21.15.142:39916) 2023-09-21T12:53:27.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 -- 172.21.15.142:0/961409166 learned_addr learned my addr 172.21.15.142:0/961409166 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:27.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d58c2700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0100e70 0x7f65d0074b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:27.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d60c3700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0102990 0x7f65d0073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:27.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 -- 172.21.15.142:0/961409166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0102990 msgr2=0x7f65d0073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:27.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0102990 0x7f65d0073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 -- 172.21.15.142:0/961409166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0100e70 msgr2=0x7f65d0074b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:27.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0100e70 0x7f65d0074b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 -- 172.21.15.142:0/961409166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c00095f0 con 0x7f65d0101fd0 2023-09-21T12:53:27.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65d50c1700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65c000b620 tx=0x7f65c0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:27.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.014+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c001d070 con 0x7f65d0101fd0 2023-09-21T12:53:27.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.015+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65c0022470 con 0x7f65d0101fd0 2023-09-21T12:53:27.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.015+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d01a0ea0 con 0x7f65d0101fd0 2023-09-21T12:53:27.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.015+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c0017650 con 0x7f65d0101fd0 2023-09-21T12:53:27.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.015+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d01a1250 con 0x7f65d0101fd0 2023-09-21T12:53:27.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.016+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d0108480 con 0x7f65d0101fd0 2023-09-21T12:53:27.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.017+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f65c00225e0 con 0x7f65d0101fd0 2023-09-21T12:53:27.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.020+0000 7f65c6ffd700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 0x7f65bc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:27.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.020+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f65c00ccc10 con 0x7f65d0101fd0 2023-09-21T12:53:27.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.020+0000 7f65d58c2700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 0x7f65bc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:27.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.021+0000 7f65d58c2700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 0x7f65bc0a2b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009c60 tx=0x7f65cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:27.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.024+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f65c0096cf0 con 0x7f65d0101fd0 2023-09-21T12:53:27.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.226+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f65d010c6f0 con 0x7f65d0101fd0 2023-09-21T12:53:27.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.226+0000 7f65c6ffd700 1 -- 172.21.15.142:0/961409166 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7f65c009a310 con 0x7f65d0101fd0 2023-09-21T12:53:27.226 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:27.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 msgr2=0x7f65bc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:27.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 0x7f65bc0a2b00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009c60 tx=0x7f65cc009260 comp rx=0 tx=0).stop 2023-09-21T12:53:27.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 msgr2=0x7f65d00731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:27.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f65c000b620 tx=0x7f65c0005740 comp rx=0 tx=0).stop 2023-09-21T12:53:27.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 shutdown_connections 2023-09-21T12:53:27.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f65bc0a0640 0x7f65bc0a2b00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65d0102990 0x7f65d0073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f65d0100e70 0x7f65d0074b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 --2- 172.21.15.142:0/961409166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f65d0101fd0 0x7f65d00731d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:27.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 >> 172.21.15.142:0/961409166 conn(0x7f65d00fc3d0 msgr2=0x7f65d01055c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:27.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 shutdown_connections 2023-09-21T12:53:27.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:27.229+0000 7f65d7b26700 1 -- 172.21.15.142:0/961409166 wait complete. 2023-09-21T12:53:27.655 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:27 smithi156 ceph-mon[134078]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:27.656 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:27 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/961409166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:27.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:27 smithi142 ceph-mon[97663]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:27.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:27 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/961409166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:27.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:27 smithi160 ceph-mon[134450]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:27.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:27 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/961409166' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-21T12:53:27.691 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1695300804,"num_in_osds":12,"osd_in_since":1695300786,"num_remapped_pgs":0} 2023-09-21T12:53:27.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-21T12:53:28.419 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:53:29.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:29 smithi142 ceph-mon[97663]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:29.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:29 smithi160 ceph-mon[134450]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:29 smithi156 ceph-mon[134078]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:29.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 -- 172.21.15.142:0/698071924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70101060 msgr2=0x7f9a70101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 --2- 172.21.15.142:0/698071924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70101060 0x7f9a70101440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009990 tx=0x7f9a60009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 -- 172.21.15.142:0/698071924 shutdown_connections 2023-09-21T12:53:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 --2- 172.21.15.142:0/698071924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70101060 0x7f9a70101440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 --2- 172.21.15.142:0/698071924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70106140 0x7f9a7010dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 --2- 172.21.15.142:0/698071924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 -- 172.21.15.142:0/698071924 >> 172.21.15.142:0/698071924 conn(0x7f9a700fc8d0 msgr2=0x7f9a700fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 -- 172.21.15.142:0/698071924 shutdown_connections 2023-09-21T12:53:29.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.947+0000 7f9a74e07700 1 -- 172.21.15.142:0/698071924 wait complete. 2023-09-21T12:53:29.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.948+0000 7f9a74e07700 1 Processor -- start 2023-09-21T12:53:29.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.948+0000 7f9a74e07700 1 -- start start 2023-09-21T12:53:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.948+0000 7f9a74e07700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70101060 0x7f9a701990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a74e07700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a74e07700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:29.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a74e07700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7019e0b0 con 0x7f9a70106140 2023-09-21T12:53:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a74e07700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7019e220 con 0x7f9a70101a10 2023-09-21T12:53:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a74e07700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7019e3e0 con 0x7f9a70101060 2023-09-21T12:53:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:29.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39940/0 (socket says 172.21.15.142:39940) 2023-09-21T12:53:29.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:42538/0 (socket says 172.21.15.142:42538) 2023-09-21T12:53:29.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 -- 172.21.15.142:0/1107446188 learned_addr learned my addr 172.21.15.142:0/1107446188 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:29.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6e59c700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70101060 0x7f9a701990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:29.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 -- 172.21.15.142:0/1107446188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70101060 msgr2=0x7f9a701990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70101060 0x7f9a701990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 -- 172.21.15.142:0/1107446188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 msgr2=0x7f9a70199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:29.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 -- 172.21.15.142:0/1107446188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600095f0 con 0x7f9a70106140 2023-09-21T12:53:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6dd9b700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.949+0000 7f9a6ed9d700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800ef30 tx=0x7f9a6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.950+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a68018070 con 0x7f9a70106140 2023-09-21T12:53:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.950+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a6800f040 con 0x7f9a70106140 2023-09-21T12:53:29.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.950+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7019e660 con 0x7f9a70106140 2023-09-21T12:53:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.950+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6800cd00 con 0x7f9a70106140 2023-09-21T12:53:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.950+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a701a5f20 con 0x7f9a70106140 2023-09-21T12:53:29.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.951+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7004eae0 con 0x7f9a70106140 2023-09-21T12:53:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.953+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f9a68003a00 con 0x7f9a70106140 2023-09-21T12:53:29.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.954+0000 7f9a5f7fe700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 0x7f9a580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.954+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9a680cb270 con 0x7f9a70106140 2023-09-21T12:53:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.954+0000 7f9a6e59c700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 0x7f9a580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.955+0000 7f9a6e59c700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 0x7f9a580a2b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b2e0 tx=0x7f9a60005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:29.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:29.958+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9a68095230 con 0x7f9a70106140 2023-09-21T12:53:30.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.159+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a70110e60 con 0x7f9a70106140 2023-09-21T12:53:30.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.160+0000 7f9a5f7fe700 1 -- 172.21.15.142:0/1107446188 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f9a68098850 con 0x7f9a70106140 2023-09-21T12:53:30.161 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:30.161 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":80,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:53:25.323578+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:53:30.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.162+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 msgr2=0x7f9a580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:30.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.162+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 0x7f9a580a2b00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a6000b2e0 tx=0x7f9a60005fd0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.162+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 msgr2=0x7f9a7019daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:30.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.162+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a6800ef30 tx=0x7f9a6800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 shutdown_connections 2023-09-21T12:53:30.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9a580a0640 0x7f9a580a2b00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9a70106140 0x7f9a7019daa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a70101060 0x7f9a701990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 --2- 172.21.15.142:0/1107446188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9a70101a10 0x7f9a70199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:30.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 >> 172.21.15.142:0/1107446188 conn(0x7f9a700fc8d0 msgr2=0x7f9a700fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:30.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 shutdown_connections 2023-09-21T12:53:30.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:30.163+0000 7f9a74e07700 1 -- 172.21.15.142:0/1107446188 wait complete. 2023-09-21T12:53:30.588 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:30 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1107446188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:30.590 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:53:30.591 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd pool get .mgr pg_num 2023-09-21T12:53:30.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:30 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1107446188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:30.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:30 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1107446188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:31.321 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:53:31.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:31 smithi142 ceph-mon[97663]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:31.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:31 smithi160 ceph-mon[134450]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:31 smithi156 ceph-mon[134078]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:32.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.709+0000 7f27fb485700 1 -- 172.21.15.142:0/2537598699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101060 msgr2=0x7f27f4101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:32.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.709+0000 7f27fb485700 1 --2- 172.21.15.142:0/2537598699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101060 0x7f27f4101440 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009990 tx=0x7f27f0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 -- 172.21.15.142:0/2537598699 shutdown_connections 2023-09-21T12:53:32.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 --2- 172.21.15.142:0/2537598699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101060 0x7f27f4101440 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 --2- 172.21.15.142:0/2537598699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4106140 0x7f27f410dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 --2- 172.21.15.142:0/2537598699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4101a10 0x7f27f4105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 -- 172.21.15.142:0/2537598699 >> 172.21.15.142:0/2537598699 conn(0x7f27f40fc8d0 msgr2=0x7f27f40fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:32.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 -- 172.21.15.142:0/2537598699 shutdown_connections 2023-09-21T12:53:32.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.710+0000 7f27fb485700 1 -- 172.21.15.142:0/2537598699 wait complete. 2023-09-21T12:53:32.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.711+0000 7f27fb485700 1 Processor -- start 2023-09-21T12:53:32.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.711+0000 7f27fb485700 1 -- start start 2023-09-21T12:53:32.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4101060 0x7f27f40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:32.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:32.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4106140 0x7f27f4073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:32.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41a53d0 con 0x7f27f4101a10 2023-09-21T12:53:32.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41a5540 con 0x7f27f4106140 2023-09-21T12:53:32.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27fb485700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f41a5700 con 0x7f27f4101060 2023-09-21T12:53:32.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27f8a20700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:32.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27f9221700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4101060 0x7f27f40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:32.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27f8a20700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39966/0 (socket says 172.21.15.142:39966) 2023-09-21T12:53:32.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27f8a20700 1 -- 172.21.15.142:0/580582698 learned_addr learned my addr 172.21.15.142:0/580582698 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:32.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.712+0000 7f27f9a22700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4106140 0x7f27f4073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:32.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 -- 172.21.15.142:0/580582698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4101060 msgr2=0x7f27f40730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:32.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4101060 0x7f27f40730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 -- 172.21.15.142:0/580582698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4106140 msgr2=0x7f27f4073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:32.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4106140 0x7f27f4073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 -- 172.21.15.142:0/580582698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00095f0 con 0x7f27f4101a10 2023-09-21T12:53:32.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27f8a20700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d980 tx=0x7f27e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:32.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4009930 con 0x7f27f4101a10 2023-09-21T12:53:32.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27e4010460 con 0x7f27f4101a10 2023-09-21T12:53:32.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400f620 con 0x7f27f4101a10 2023-09-21T12:53:32.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f41a59e0 con 0x7f27f4101a10 2023-09-21T12:53:32.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.713+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f41a5e90 con 0x7f27f4101a10 2023-09-21T12:53:32.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.714+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f404eae0 con 0x7f27f4101a10 2023-09-21T12:53:32.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.716+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f27e40108d0 con 0x7f27f4101a10 2023-09-21T12:53:32.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.717+0000 7f27ea7fc700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 0x7f27e00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:32.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.718+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f27e40cb1b0 con 0x7f27f4101a10 2023-09-21T12:53:32.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.718+0000 7f27f9221700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 0x7f27e00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:32.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.718+0000 7f27f9221700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 0x7f27e00a2b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b2e0 tx=0x7f27f0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:32.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.722+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f27e40950e0 con 0x7f27f4101a10 2023-09-21T12:53:32.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.922+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f4110fa0 con 0x7f27f4101a10 2023-09-21T12:53:32.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.922+0000 7f27ea7fc700 1 -- 172.21.15.142:0/580582698 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e4098700 con 0x7f27f4101a10 2023-09-21T12:53:32.922 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:53:32.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 msgr2=0x7f27e00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 0x7f27e00a2b80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f27f000b2e0 tx=0x7f27f0005fd0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 msgr2=0x7f27f4073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27e400d980 tx=0x7f27e400dc90 comp rx=0 tx=0).stop 2023-09-21T12:53:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 shutdown_connections 2023-09-21T12:53:32.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27e00a06c0 0x7f27e00a2b80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27f4106140 0x7f27f4073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27f4101060 0x7f27f40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 --2- 172.21.15.142:0/580582698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27f4101a10 0x7f27f4073620 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:32.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 >> 172.21.15.142:0/580582698 conn(0x7f27f40fc8d0 msgr2=0x7f27f40fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 shutdown_connections 2023-09-21T12:53:32.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:32.925+0000 7f27fb485700 1 -- 172.21.15.142:0/580582698 wait complete. 2023-09-21T12:53:33.502 INFO:tasks.cephadm:Adding mds.a on smithi142 2023-09-21T12:53:33.503 INFO:tasks.cephadm:Adding mds.d on smithi142 2023-09-21T12:53:33.503 INFO:tasks.cephadm:Adding mds.g on smithi142 2023-09-21T12:53:33.503 INFO:tasks.cephadm:Adding mds.j on smithi142 2023-09-21T12:53:33.504 INFO:tasks.cephadm:Adding mds.b on smithi156 2023-09-21T12:53:33.504 INFO:tasks.cephadm:Adding mds.e on smithi156 2023-09-21T12:53:33.504 INFO:tasks.cephadm:Adding mds.h on smithi156 2023-09-21T12:53:33.505 INFO:tasks.cephadm:Adding mds.k on smithi156 2023-09-21T12:53:33.505 INFO:tasks.cephadm:Adding mds.c on smithi160 2023-09-21T12:53:33.505 INFO:tasks.cephadm:Adding mds.f on smithi160 2023-09-21T12:53:33.506 INFO:tasks.cephadm:Adding mds.i on smithi160 2023-09-21T12:53:33.506 INFO:tasks.cephadm:Adding mds.l on smithi160 2023-09-21T12:53:33.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph orch apply mds all '12;smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l' 2023-09-21T12:53:33.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:33 smithi142 ceph-mon[97663]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:33.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:33 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/580582698' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:33.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:33 smithi160 ceph-mon[134450]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:33.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:33 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/580582698' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:33.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:33 smithi156 ceph-mon[134078]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:33.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:33 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/580582698' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:34.076 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T12:53:35.261 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- 172.21.15.160:0/1088458827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102bd0 msgr2=0x7fa1f0109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:35.261 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 --2- 172.21.15.160:0/1088458827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102bd0 0x7fa1f0109480 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1e800b0a0 tx=0x7fa1e800b3b0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.261 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- 172.21.15.160:0/1088458827 shutdown_connections 2023-09-21T12:53:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 --2- 172.21.15.160:0/1088458827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102bd0 0x7fa1f0109480 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 --2- 172.21.15.160:0/1088458827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 0x7fa1f00ff5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.262 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 --2- 172.21.15.160:0/1088458827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102230 0x7fa1f0102690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- 172.21.15.160:0/1088458827 >> 172.21.15.160:0/1088458827 conn(0x7fa1f00faaf0 msgr2=0x7fa1f00fcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- 172.21.15.160:0/1088458827 shutdown_connections 2023-09-21T12:53:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- 172.21.15.160:0/1088458827 wait complete. 2023-09-21T12:53:35.263 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 Processor -- start 2023-09-21T12:53:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.259+0000 7fa1f6549700 1 -- start start 2023-09-21T12:53:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 0x7fa1f0196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:35.264 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102bd0 0x7fa1f019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f019e810 con 0x7fa1f0102bd0 2023-09-21T12:53:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f019e950 con 0x7fa1f00ff1b0 2023-09-21T12:53:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f6549700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f019eb10 con 0x7fa1f0102230 2023-09-21T12:53:35.265 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:58110/0 (socket says 172.21.15.160:58110) 2023-09-21T12:53:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 -- 172.21.15.160:0/4017759439 learned_addr learned my addr 172.21.15.160:0/4017759439 (peer_addr_for_me v2:172.21.15.160:0/0) 2023-09-21T12:53:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1effff700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 0x7fa1f0196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:35.266 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 -- 172.21.15.160:0/4017759439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 msgr2=0x7fa1f0196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 0x7fa1f0196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 -- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102bd0 msgr2=0x7fa1f019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1f4ae6700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102bd0 0x7fa1f019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:35.267 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102bd0 0x7fa1f019e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 -- 172.21.15.160:0/4017759439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e8009d00 con 0x7fa1f0102230 2023-09-21T12:53:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.260+0000 7fa1ef7fe700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000b530 tx=0x7fa1e000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.261+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0011830 con 0x7fa1f0102230 2023-09-21T12:53:35.268 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.261+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1e0011e50 con 0x7fa1f0102230 2023-09-21T12:53:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.261+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f019edf0 con 0x7fa1f0102230 2023-09-21T12:53:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.261+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e000f2e0 con 0x7fa1f0102230 2023-09-21T12:53:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.261+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f019f2e0 con 0x7fa1f0102230 2023-09-21T12:53:35.269 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.262+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f0108590 con 0x7fa1f0102230 2023-09-21T12:53:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.263+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa1e0010380 con 0x7fa1f0102230 2023-09-21T12:53:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.263+0000 7fa1ed7fa700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 0x7fa1d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.263+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa1e00cb260 con 0x7fa1f0102230 2023-09-21T12:53:35.271 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.263+0000 7fa1effff700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 0x7fa1d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:35.272 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.264+0000 7fa1effff700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 0x7fa1d80a2b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0197b70 tx=0x7fa1e400a380 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:35.272 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.268+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa1e0095230 con 0x7fa1f0102230 2023-09-21T12:53:35.470 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.471+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1f0061220 con 0x7fa1d80a0640 2023-09-21T12:53:35.480 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.481+0000 7fa1ed7fa700 1 -- 172.21.15.160:0/4017759439 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa1f0061220 con 0x7fa1d80a0640 2023-09-21T12:53:35.480 INFO:teuthology.orchestra.run.smithi160.stdout:Scheduled mds.all update... 2023-09-21T12:53:35.482 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 msgr2=0x7fa1d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:35.483 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 0x7fa1d80a2b00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0197b70 tx=0x7fa1e400a380 comp rx=0 tx=0).stop 2023-09-21T12:53:35.483 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 msgr2=0x7fa1f01971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:35.483 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000b530 tx=0x7fa1e000b840 comp rx=0 tx=0).stop 2023-09-21T12:53:35.483 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 shutdown_connections 2023-09-21T12:53:35.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa1d80a0640 0x7fa1d80a2b00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1f0102bd0 0x7fa1f019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1f00ff1b0 0x7fa1f0196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 --2- 172.21.15.160:0/4017759439 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f0102230 0x7fa1f01971d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:35.484 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 >> 172.21.15.160:0/4017759439 conn(0x7fa1f00faaf0 msgr2=0x7fa1f01056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:35.485 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 shutdown_connections 2023-09-21T12:53:35.485 INFO:teuthology.orchestra.run.smithi160.stderr:2023-09-21T12:53:35.483+0000 7fa1f6549700 1 -- 172.21.15.160:0/4017759439 wait complete. 2023-09-21T12:53:35.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:35 smithi160 ceph-mon[134450]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:35.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:35 smithi156 ceph-mon[134078]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:35.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:35 smithi142 ceph-mon[97663]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:35.931 DEBUG:teuthology.orchestra.run.smithi142:mds.a> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.a.service 2023-09-21T12:53:35.938 DEBUG:teuthology.orchestra.run.smithi142:mds.d> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.d.service 2023-09-21T12:53:35.983 DEBUG:teuthology.orchestra.run.smithi142:mds.g> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.g.service 2023-09-21T12:53:36.018 INFO:journalctl@ceph.mds.a.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:53:36.022 DEBUG:teuthology.orchestra.run.smithi142:mds.j> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.j.service 2023-09-21T12:53:36.058 INFO:journalctl@ceph.mds.d.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:53:36.061 DEBUG:teuthology.orchestra.run.smithi156:mds.b> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.b.service 2023-09-21T12:53:36.064 DEBUG:teuthology.orchestra.run.smithi156:mds.e> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.e.service 2023-09-21T12:53:36.095 INFO:journalctl@ceph.mds.b.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:53:36.096 DEBUG:teuthology.orchestra.run.smithi156:mds.h> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.h.service 2023-09-21T12:53:36.097 INFO:journalctl@ceph.mds.g.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:53:36.121 INFO:journalctl@ceph.mds.e.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:53:36.122 DEBUG:teuthology.orchestra.run.smithi156:mds.k> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.k.service 2023-09-21T12:53:36.132 INFO:journalctl@ceph.mds.j.smithi142.stdout:-- Logs begin at Thu 2023-09-21 12:30:04 UTC. -- 2023-09-21T12:53:36.147 INFO:journalctl@ceph.mds.h.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:53:36.148 DEBUG:teuthology.orchestra.run.smithi160:mds.c> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.c.service 2023-09-21T12:53:36.150 DEBUG:teuthology.orchestra.run.smithi160:mds.f> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.f.service 2023-09-21T12:53:36.173 INFO:journalctl@ceph.mds.k.smithi156.stdout:-- Logs begin at Thu 2023-09-21 12:26:04 UTC. -- 2023-09-21T12:53:36.180 INFO:journalctl@ceph.mds.c.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:53:36.181 DEBUG:teuthology.orchestra.run.smithi160:mds.i> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.i.service 2023-09-21T12:53:36.207 INFO:journalctl@ceph.mds.f.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:53:36.208 DEBUG:teuthology.orchestra.run.smithi160:mds.l> sudo journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.l.service 2023-09-21T12:53:36.233 INFO:journalctl@ceph.mds.i.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:53:36.234 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-09-21T12:53:36.235 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:53:36.260 INFO:journalctl@ceph.mds.l.smithi160.stdout:-- Logs begin at Thu 2023-09-21 12:26:18 UTC. -- 2023-09-21T12:53:36.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 -- 172.21.15.142:0/3387978059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98101fe0 msgr2=0x7f8b98102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/3387978059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98101fe0 0x7f8b98102440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c0099c0 tx=0x7f8b8c009cd0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 -- 172.21.15.142:0/3387978059 shutdown_connections 2023-09-21T12:53:36.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/3387978059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 0x7f8b98101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/3387978059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98102980 0x7f8b98109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/3387978059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98101fe0 0x7f8b98102440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.447+0000 7f8b9cbff700 1 -- 172.21.15.142:0/3387978059 >> 172.21.15.142:0/3387978059 conn(0x7f8b980fc320 msgr2=0x7f8b980fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:36.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.448+0000 7f8b9cbff700 1 -- 172.21.15.142:0/3387978059 shutdown_connections 2023-09-21T12:53:36.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.448+0000 7f8b9cbff700 1 -- 172.21.15.142:0/3387978059 wait complete. 2023-09-21T12:53:36.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.448+0000 7f8b9cbff700 1 Processor -- start 2023-09-21T12:53:36.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 -- start start 2023-09-21T12:53:36.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 0x7f8b98198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98102980 0x7f8b981a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981a0810 con 0x7f8b98100df0 2023-09-21T12:53:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981a0980 con 0x7f8b98102980 2023-09-21T12:53:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9cbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b981a0b40 con 0x7f8b98101fe0 2023-09-21T12:53:36.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b95d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b9659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 0x7f8b98198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b95d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56206/0 (socket says 172.21.15.142:56206) 2023-09-21T12:53:36.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b95d9b700 1 -- 172.21.15.142:0/605426725 learned_addr learned my addr 172.21.15.142:0/605426725 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:36.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b96d9d700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98102980 0x7f8b981a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b95d9b700 1 -- 172.21.15.142:0/605426725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98102980 msgr2=0x7f8b981a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.449+0000 7f8b95d9b700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98102980 0x7f8b981a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b95d9b700 1 -- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 msgr2=0x7f8b98198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b95d9b700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 0x7f8b98198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b95d9b700 1 -- 172.21.15.142:0/605426725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0095f0 con 0x7f8b98101fe0 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b95d9b700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009fd0 tx=0x7f8b8c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:36.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c01d070 con 0x7f8b98101fe0 2023-09-21T12:53:36.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b8c005050 con 0x7f8b98101fe0 2023-09-21T12:53:36.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b981a0dc0 con 0x7f8b98101fe0 2023-09-21T12:53:36.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c004b30 con 0x7f8b98101fe0 2023-09-21T12:53:36.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.450+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b981a1190 con 0x7f8b98101fe0 2023-09-21T12:53:36.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.451+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9810c650 con 0x7f8b98101fe0 2023-09-21T12:53:36.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.453+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f8b8c004c90 con 0x7f8b98101fe0 2023-09-21T12:53:36.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.454+0000 7f8b877fe700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 0x7f8b800a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.454+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8b8c0cca20 con 0x7f8b98101fe0 2023-09-21T12:53:36.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.455+0000 7f8b9659c700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 0x7f8b800a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.455+0000 7f8b9659c700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 0x7f8b800a2b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b98199b70 tx=0x7f8b88009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:36.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.456+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8b8c0969e0 con 0x7f8b98101fe0 2023-09-21T12:53:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.664+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b981a1380 con 0x7f8b98101fe0 2023-09-21T12:53:36.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.666+0000 7f8b877fe700 1 -- 172.21.15.142:0/605426725 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18470 (secure 0 0 0) 0x7f8b8c09a000 con 0x7f8b98101fe0 2023-09-21T12:53:36.667 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: Saving service mds.all spec with placement smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2023-09-21T12:53:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:36.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:36.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:36 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:36.670 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":80,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:53:25.323578+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:53:36.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 msgr2=0x7f8b800a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 0x7f8b800a2b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8b98199b70 tx=0x7f8b88009260 comp rx=0 tx=0).stop 2023-09-21T12:53:36.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 msgr2=0x7f8b981991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c009fd0 tx=0x7f8b8c00f690 comp rx=0 tx=0).stop 2023-09-21T12:53:36.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 shutdown_connections 2023-09-21T12:53:36.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b800a0690 0x7f8b800a2b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b98100df0 0x7f8b98198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b98102980 0x7f8b981a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 --2- 172.21.15.142:0/605426725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b98101fe0 0x7f8b981991e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 >> 172.21.15.142:0/605426725 conn(0x7f8b980fc320 msgr2=0x7f8b98107860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.668+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 shutdown_connections 2023-09-21T12:53:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.669+0000 7f8b9cbff700 1 -- 172.21.15.142:0/605426725 wait complete. 2023-09-21T12:53:36.689 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:53:36.690 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:53:36.739 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:36.740 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: Saving service mds.all spec with placement smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2023-09-21T12:53:36.740 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.740 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:36.740 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:36.740 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:36.741 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.741 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:36.741 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:36.741 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:36 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:36.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 -- 172.21.15.142:0/1140900948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 msgr2=0x7f8150101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 --2- 172.21.15.142:0/1140900948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150101210 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f814c0099c0 tx=0x7f814c009cd0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 -- 172.21.15.142:0/1140900948 shutdown_connections 2023-09-21T12:53:36.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 --2- 172.21.15.142:0/1140900948 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f8150109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 --2- 172.21.15.142:0/1140900948 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150101210 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 --2- 172.21.15.142:0/1140900948 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 0x7f8150102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 -- 172.21.15.142:0/1140900948 >> 172.21.15.142:0/1140900948 conn(0x7f81500fc360 msgr2=0x7f81500fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:36.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 -- 172.21.15.142:0/1140900948 shutdown_connections 2023-09-21T12:53:36.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.890+0000 7f81581ff700 1 -- 172.21.15.142:0/1140900948 wait complete. 2023-09-21T12:53:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.891+0000 7f81581ff700 1 Processor -- start 2023-09-21T12:53:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.891+0000 7f81581ff700 1 -- start start 2023-09-21T12:53:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.891+0000 7f81581ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.891+0000 7f81581ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 0x7f8150199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f81581ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f81581ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501a0890 con 0x7f8150102980 2023-09-21T12:53:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f81581ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501a0a00 con 0x7f8150100df0 2023-09-21T12:53:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f81581ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81501a0bc0 con 0x7f8150101fe0 2023-09-21T12:53:36.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38726/0 (socket says 172.21.15.142:38726) 2023-09-21T12:53:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815579a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 0x7f8150199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 -- 172.21.15.142:0/2350421522 learned_addr learned my addr 172.21.15.142:0/2350421522 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f8155f9b700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 -- 172.21.15.142:0/2350421522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 msgr2=0x7f8150199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 0x7f8150199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 -- 172.21.15.142:0/2350421522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 msgr2=0x7f8150198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:36.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:36.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 -- 172.21.15.142:0/2350421522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c0095f0 con 0x7f8150102980 2023-09-21T12:53:36.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f8155f9b700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:36.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.892+0000 7f815679c700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f814800ef30 tx=0x7f814800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:36.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.893+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8148018070 con 0x7f8150102980 2023-09-21T12:53:36.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.893+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f814800f040 con 0x7f8150102980 2023-09-21T12:53:36.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.893+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81501a0e40 con 0x7f8150102980 2023-09-21T12:53:36.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.893+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814800cd00 con 0x7f8150102980 2023-09-21T12:53:36.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.893+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81501a12c0 con 0x7f8150102980 2023-09-21T12:53:36.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.894+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815010c650 con 0x7f8150102980 2023-09-21T12:53:36.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.896+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f8148003a00 con 0x7f8150102980 2023-09-21T12:53:36.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.897+0000 7f8146ffd700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 0x7f813c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:36.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.897+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f81480cb240 con 0x7f8150102980 2023-09-21T12:53:36.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.897+0000 7f8155f9b700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 0x7f813c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:36.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.898+0000 7f8155f9b700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 0x7f813c0a2b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f815019a220 tx=0x7f814c005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:36.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:36.901+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8148095200 con 0x7f8150102980 2023-09-21T12:53:36.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='client.24430 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:53:36.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: Saving service mds.all spec with placement smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2023-09-21T12:53:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:53:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:53:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:36 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:37.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.102+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81501a14e0 con 0x7f8150102980 2023-09-21T12:53:37.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.102+0000 7f8146ffd700 1 -- 172.21.15.142:0/2350421522 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8148098820 con 0x7f8150102980 2023-09-21T12:53:37.103 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:53:37.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 msgr2=0x7f813c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 0x7f813c0a2b80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f815019a220 tx=0x7f814c005fb0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 msgr2=0x7f81501a02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f814800ef30 tx=0x7f814800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 shutdown_connections 2023-09-21T12:53:37.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f813c0a06c0 0x7f813c0a2b80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8150102980 0x7f81501a02c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8150100df0 0x7f8150198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 --2- 172.21.15.142:0/2350421522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8150101fe0 0x7f8150199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 >> 172.21.15.142:0/2350421522 conn(0x7f81500fc360 msgr2=0x7f81500fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:37.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 shutdown_connections 2023-09-21T12:53:37.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.105+0000 7f81581ff700 1 -- 172.21.15.142:0/2350421522 wait complete. 2023-09-21T12:53:37.125 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:37.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 -- 172.21.15.142:0/1684677723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c101fd0 msgr2=0x7f1b3c102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 --2- 172.21.15.142:0/1684677723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c102430 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1b300099c0 tx=0x7f1b30009cd0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 -- 172.21.15.142:0/1684677723 shutdown_connections 2023-09-21T12:53:37.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 --2- 172.21.15.142:0/1684677723 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c102970 0x7f1b3c109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 --2- 172.21.15.142:0/1684677723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c100de0 0x7f1b3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 --2- 172.21.15.142:0/1684677723 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c102430 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.323+0000 7f1b40fff700 1 -- 172.21.15.142:0/1684677723 >> 172.21.15.142:0/1684677723 conn(0x7f1b3c0fc310 msgr2=0x7f1b3c0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:37.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.324+0000 7f1b40fff700 1 -- 172.21.15.142:0/1684677723 shutdown_connections 2023-09-21T12:53:37.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.324+0000 7f1b40fff700 1 -- 172.21.15.142:0/1684677723 wait complete. 2023-09-21T12:53:37.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.324+0000 7f1b40fff700 1 Processor -- start 2023-09-21T12:53:37.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 -- start start 2023-09-21T12:53:37.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:37.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:37.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c102970 0x7f1b3c073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:37.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c073eb0 con 0x7f1b3c100de0 2023-09-21T12:53:37.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c074020 con 0x7f1b3c101fd0 2023-09-21T12:53:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b40fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c1a0b90 con 0x7f1b3c102970 2023-09-21T12:53:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b3a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b3a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38746/0 (socket says 172.21.15.142:38746) 2023-09-21T12:53:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b3a59c700 1 -- 172.21.15.142:0/747603724 learned_addr learned my addr 172.21.15.142:0/747603724 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:37.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b3ad9d700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c102970 0x7f1b3c073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.325+0000 7f1b39d9b700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 -- 172.21.15.142:0/747603724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c102970 msgr2=0x7f1b3c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c102970 0x7f1b3c073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 -- 172.21.15.142:0/747603724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c101fd0 msgr2=0x7f1b3c0731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c0731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 -- 172.21.15.142:0/747603724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300095f0 con 0x7f1b3c100de0 2023-09-21T12:53:37.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b3a59c700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00e970 tx=0x7f1b2c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:37.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c009790 con 0x7f1b3c100de0 2023-09-21T12:53:37.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b2c00c7e0 con 0x7f1b3c100de0 2023-09-21T12:53:37.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c1a0e70 con 0x7f1b3c100de0 2023-09-21T12:53:37.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c003c70 con 0x7f1b3c100de0 2023-09-21T12:53:37.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.326+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c1a1290 con 0x7f1b3c100de0 2023-09-21T12:53:37.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.327+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c108370 con 0x7f1b3c100de0 2023-09-21T12:53:37.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.329+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1b2c00cc50 con 0x7f1b3c100de0 2023-09-21T12:53:37.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.330+0000 7f1b2b7fe700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 0x7f1b240a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:37.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.331+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1b2c014070 con 0x7f1b3c100de0 2023-09-21T12:53:37.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.331+0000 7f1b39d9b700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 0x7f1b240a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:37.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.331+0000 7f1b39d9b700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 0x7f1b240a2b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000b580 tx=0x7f1b30005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:37.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.334+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1b2c095880 con 0x7f1b3c100de0 2023-09-21T12:53:37.554 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 12:53:37 smithi160 systemd[1]: Starting Ceph mds.l for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:37.554 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:37 smithi160 ceph-mon[134450]: Deploying daemon mds.l on smithi160 2023-09-21T12:53:37.554 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:37 smithi160 ceph-mon[134450]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:37.555 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:37 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/605426725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:37.555 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:37 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2350421522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:37.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.578+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1b3c02cfa0 con 0x7f1b3c100de0 2023-09-21T12:53:37.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.579+0000 7f1b2b7fe700 1 -- 172.21.15.142:0/747603724 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f1b2c003dd0 con 0x7f1b3c100de0 2023-09-21T12:53:37.579 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:37.580 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-09-21T12:53:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.581+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 msgr2=0x7f1b240a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.581+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 0x7f1b240a2b50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000b580 tx=0x7f1b30005fb0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.581+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 msgr2=0x7f1b3c074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.581+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00e970 tx=0x7f1b2c00ec80 comp rx=0 tx=0).stop 2023-09-21T12:53:37.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.581+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 shutdown_connections 2023-09-21T12:53:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1b240a0690 0x7f1b240a2b50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b3c100de0 0x7f1b3c074b90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b3c102970 0x7f1b3c073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 --2- 172.21.15.142:0/747603724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b3c101fd0 0x7f1b3c0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 >> 172.21.15.142:0/747603724 conn(0x7f1b3c0fc310 msgr2=0x7f1b3c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 shutdown_connections 2023-09-21T12:53:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:37.582+0000 7f1b40fff700 1 -- 172.21.15.142:0/747603724 wait complete. 2023-09-21T12:53:37.584 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 1 2023-09-21T12:53:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:37 smithi156 ceph-mon[134078]: Deploying daemon mds.l on smithi160 2023-09-21T12:53:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:37 smithi156 ceph-mon[134078]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:37 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/605426725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:37 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2350421522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:37 smithi142 ceph-mon[97663]: Deploying daemon mds.l on smithi160 2023-09-21T12:53:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:37 smithi142 ceph-mon[97663]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:37 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/605426725' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:53:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:37 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2350421522' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:53:38.139 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 12:53:37 smithi160 podman[171120]: 2023-09-21T12:53:38.139 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 12:53:38 smithi160 bash[171120]: c958c6f37ea989948aa3e37d51ef1a1755f0b8ecef992b7ac54c15af199b38c1 2023-09-21T12:53:38.139 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-l[171136]: starting mds.l at 2023-09-21T12:53:38.438 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 12:53:38 smithi160 systemd[1]: Started Ceph mds.l for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:38.842 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/747603724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:38.845 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6832/3462586639,v1:172.21.15.160:6833/3462586639] up:boot 2023-09-21T12:53:38.845 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: fsmap 1 up:standby 2023-09-21T12:53:38.846 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:53:38.846 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.846 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.846 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.846 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:38.847 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:38.847 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:38 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:38.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/747603724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6832/3462586639,v1:172.21.15.160:6833/3462586639] up:boot 2023-09-21T12:53:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: fsmap 1 up:standby 2023-09-21T12:53:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:53:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:38.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:38.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:38 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/747603724' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6832/3462586639,v1:172.21.15.160:6833/3462586639] up:boot 2023-09-21T12:53:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: fsmap 1 up:standby 2023-09-21T12:53:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:53:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:38.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:38.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:38 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:39.602 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:39.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 -- 172.21.15.142:0/1571748568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0074e20 msgr2=0x7f75e0073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 --2- 172.21.15.142:0/1571748568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0074e20 0x7f75e0073270 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009990 tx=0x7f75dc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 -- 172.21.15.142:0/1571748568 shutdown_connections 2023-09-21T12:53:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 --2- 172.21.15.142:0/1571748568 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0074e20 0x7f75e0073270 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 --2- 172.21.15.142:0/1571748568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0108ca0 0x7f75e010b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 --2- 172.21.15.142:0/1571748568 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 -- 172.21.15.142:0/1571748568 >> 172.21.15.142:0/1571748568 conn(0x7f75e00fc370 msgr2=0x7f75e00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 -- 172.21.15.142:0/1571748568 shutdown_connections 2023-09-21T12:53:39.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.811+0000 7f75e87ff700 1 -- 172.21.15.142:0/1571748568 wait complete. 2023-09-21T12:53:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 Processor -- start 2023-09-21T12:53:39.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 -- start start 2023-09-21T12:53:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0074e20 0x7f75e0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 0x7f75e01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01a0830 con 0x7f75e0108ca0 2023-09-21T12:53:39.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01a09a0 con 0x7f75e0073840 2023-09-21T12:53:39.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e87ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e01a0b60 con 0x7f75e0074e20 2023-09-21T12:53:39.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e659b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:39.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e6d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 0x7f75e01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:39.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e659b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49970/0 (socket says 172.21.15.142:49970) 2023-09-21T12:53:39.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.812+0000 7f75e659b700 1 -- 172.21.15.142:0/2910260148 learned_addr learned my addr 172.21.15.142:0/2910260148 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:39.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e5d9a700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0074e20 0x7f75e0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:39.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 -- 172.21.15.142:0/2910260148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0074e20 msgr2=0x7f75e0199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:39.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0074e20 0x7f75e0199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 -- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 msgr2=0x7f75e01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:39.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 0x7f75e01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:39.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 -- 172.21.15.142:0/2910260148 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0009520 con 0x7f75e0073840 2023-09-21T12:53:39.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e6d9c700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 0x7f75e01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:39.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e659b700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75dc004730 tx=0x7f75dc004760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:39.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc01d070 con 0x7f75e0073840 2023-09-21T12:53:39.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75dc022470 con 0x7f75e0073840 2023-09-21T12:53:39.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc0095f0 con 0x7f75e0073840 2023-09-21T12:53:39.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.813+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75dc017650 con 0x7f75e0073840 2023-09-21T12:53:39.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.814+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e01a1070 con 0x7f75e0073840 2023-09-21T12:53:39.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.814+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e0107350 con 0x7f75e0073840 2023-09-21T12:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.816+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f75dc0225e0 con 0x7f75e0073840 2023-09-21T12:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.818+0000 7f75d77fe700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 0x7f75cc0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:39.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.818+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f75dc0cd4c0 con 0x7f75e0073840 2023-09-21T12:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.818+0000 7f75e5d9a700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 0x7f75cc0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.819+0000 7f75e5d9a700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 0x7f75cc0a2b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75e019a1c0 tx=0x7f75d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:39.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:39.820+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f75dc097480 con 0x7f75e0073840 2023-09-21T12:53:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:39 smithi156 ceph-mon[134078]: Deploying daemon mds.k on smithi156 2023-09-21T12:53:39.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:39 smithi156 ceph-mon[134078]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:39.906 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:39 smithi156 systemd[1]: Starting Ceph mds.k for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:39 smithi142 ceph-mon[97663]: Deploying daemon mds.k on smithi156 2023-09-21T12:53:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:39 smithi142 ceph-mon[97663]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:39 smithi160 ceph-mon[134450]: Deploying daemon mds.k on smithi156 2023-09-21T12:53:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:39 smithi160 ceph-mon[134450]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:40.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.066+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75e002d120 con 0x7f75e0073840 2023-09-21T12:53:40.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.067+0000 7f75d77fe700 1 -- 172.21.15.142:0/2910260148 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7f75dc09aaa0 con 0x7f75e0073840 2023-09-21T12:53:40.066 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:40.067 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-21T12:53:40.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 msgr2=0x7f75cc0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:40.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 0x7f75cc0a2b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f75e019a1c0 tx=0x7f75d0009260 comp rx=0 tx=0).stop 2023-09-21T12:53:40.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 msgr2=0x7f75e0198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:40.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f75dc004730 tx=0x7f75dc004760 comp rx=0 tx=0).stop 2023-09-21T12:53:40.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 shutdown_connections 2023-09-21T12:53:40.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75cc0a0690 0x7f75cc0a2b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:40.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f75e0108ca0 0x7f75e01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:40.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f75e0073840 0x7f75e0198cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:40.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 --2- 172.21.15.142:0/2910260148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75e0074e20 0x7f75e0199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:40.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 >> 172.21.15.142:0/2910260148 conn(0x7f75e00fc370 msgr2=0x7f75e00fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:40.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 shutdown_connections 2023-09-21T12:53:40.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:40.069+0000 7f75e87ff700 1 -- 172.21.15.142:0/2910260148 wait complete. 2023-09-21T12:53:40.071 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 2 2023-09-21T12:53:40.215 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:39 smithi156 podman[169404]: 2023-09-21T12:53:40.491 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:40 smithi156 bash[169404]: e8d7c26937688afb3e75e5fc4824a4cc4fa8ec02dfd1049e5dc2c0a22d58497d 2023-09-21T12:53:40.491 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mds[169444]: -- 172.21.15.156:0/2801415016 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b35bb31e0 con 0x564b35b88800 2023-09-21T12:53:40.491 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-k[169420]: starting mds.k at 2023-09-21T12:53:40.492 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 12:53:40 smithi156 systemd[1]: Started Ceph mds.k for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:40.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2910260148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2910260148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:40.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:40.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2910260148' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:41.575 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:41 smithi142 ceph-mon[97663]: Deploying daemon mds.j on smithi142 2023-09-21T12:53:41.575 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:41 smithi142 ceph-mon[97663]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:41.576 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:41 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6832/3649477303,v1:172.21.15.156:6833/3649477303] up:boot 2023-09-21T12:53:41.576 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:41 smithi142 ceph-mon[97663]: fsmap 2 up:standby 2023-09-21T12:53:41.576 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:53:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:41 smithi156 ceph-mon[134078]: Deploying daemon mds.j on smithi142 2023-09-21T12:53:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:41 smithi156 ceph-mon[134078]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:41 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6832/3649477303,v1:172.21.15.156:6833/3649477303] up:boot 2023-09-21T12:53:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:41 smithi156 ceph-mon[134078]: fsmap 2 up:standby 2023-09-21T12:53:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:53:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:41 smithi160 ceph-mon[134450]: Deploying daemon mds.j on smithi142 2023-09-21T12:53:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:41 smithi160 ceph-mon[134450]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:41 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6832/3649477303,v1:172.21.15.156:6833/3649477303] up:boot 2023-09-21T12:53:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:41 smithi160 ceph-mon[134450]: fsmap 2 up:standby 2023-09-21T12:53:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:53:42.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.343+0000 7fe45c7ff700 1 -- 172.21.15.142:0/3788811193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe45410d120 msgr2=0x7fe45410d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:42.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.343+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/3788811193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe45410d120 0x7fe45410d5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009990 tx=0x7fe44c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.345+0000 7fe45c7ff700 1 -- 172.21.15.142:0/3788811193 shutdown_connections 2023-09-21T12:53:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.345+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/3788811193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe454107de0 0x7fe45410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.345+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/3788811193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe45410d120 0x7fe45410d5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.345+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/3788811193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410a750 0x7fe45410cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.345+0000 7fe45c7ff700 1 -- 172.21.15.142:0/3788811193 >> 172.21.15.142:0/3788811193 conn(0x7fe45406dbe0 msgr2=0x7fe454070020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:42.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.347+0000 7fe45c7ff700 1 -- 172.21.15.142:0/3788811193 shutdown_connections 2023-09-21T12:53:42.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.347+0000 7fe45c7ff700 1 -- 172.21.15.142:0/3788811193 wait complete. 2023-09-21T12:53:42.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.348+0000 7fe45c7ff700 1 Processor -- start 2023-09-21T12:53:42.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.348+0000 7fe45c7ff700 1 -- start start 2023-09-21T12:53:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45410a750 0x7fe454116840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410d120 0x7fe4541b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:42.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454119920 con 0x7fe45410a750 2023-09-21T12:53:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454119a90 con 0x7fe45410d120 2023-09-21T12:53:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45c7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541b6030 con 0x7fe454107de0 2023-09-21T12:53:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45a59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45a59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56246/0 (socket says 172.21.15.142:56246) 2023-09-21T12:53:42.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45a59b700 1 -- 172.21.15.142:0/4104388176 learned_addr learned my addr 172.21.15.142:0/4104388176 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:42.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.349+0000 7fe45ad9c700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410d120 0x7fe4541b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 -- 172.21.15.142:0/4104388176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410d120 msgr2=0x7fe4541b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410d120 0x7fe4541b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 -- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45410a750 msgr2=0x7fe454116840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:53:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45410a750 0x7fe454116840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 -- 172.21.15.142:0/4104388176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe44c0095f0 con 0x7fe454107de0 2023-09-21T12:53:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45a59b700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b530 tx=0x7fe44400b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4440118f0 con 0x7fe454107de0 2023-09-21T12:53:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe444010380 con 0x7fe454107de0 2023-09-21T12:53:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44400f540 con 0x7fe454107de0 2023-09-21T12:53:42.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.350+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4541b61d0 con 0x7fe454107de0 2023-09-21T12:53:42.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.351+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4541b6660 con 0x7fe454107de0 2023-09-21T12:53:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.353+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45411b4b0 con 0x7fe454107de0 2023-09-21T12:53:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.354+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fe4440104f0 con 0x7fe454107de0 2023-09-21T12:53:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.356+0000 7fe44b7fe700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 0x7fe4400a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:42.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.356+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe4440cafd0 con 0x7fe454107de0 2023-09-21T12:53:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.356+0000 7fe459d9a700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 0x7fe4400a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:42.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.356+0000 7fe459d9a700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 0x7fe4400a2bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe450007fa0 tx=0x7fe4500074f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:42.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.360+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe444094f00 con 0x7fe454107de0 2023-09-21T12:53:42.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.623+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4541b6880 con 0x7fe454107de0 2023-09-21T12:53:42.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.625+0000 7fe44b7fe700 1 -- 172.21.15.142:0/4104388176 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2122 (secure 0 0 0) 0x7fe444010ed0 con 0x7fe454107de0 2023-09-21T12:53:42.624 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:42.624 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-21T12:53:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 msgr2=0x7fe4400a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 0x7fe4400a2bd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe450007fa0 tx=0x7fe4500074f0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 msgr2=0x7fe454116300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b530 tx=0x7fe44400b840 comp rx=0 tx=0).stop 2023-09-21T12:53:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 shutdown_connections 2023-09-21T12:53:42.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe4400a0710 0x7fe4400a2bd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe45410d120 0x7fe4541b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe454107de0 0x7fe454116300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 --2- 172.21.15.142:0/4104388176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe45410a750 0x7fe454116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:42.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 >> 172.21.15.142:0/4104388176 conn(0x7fe45406dbe0 msgr2=0x7fe45406ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.627+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 shutdown_connections 2023-09-21T12:53:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:42.628+0000 7fe45c7ff700 1 -- 172.21.15.142:0/4104388176 wait complete. 2023-09-21T12:53:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 3 2023-09-21T12:53:42.916 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:42 smithi142 systemd[1]: Starting Ceph mds.j for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:43.318 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:43 smithi142 podman[147631]: 2023-09-21T12:53:43.319 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:43 smithi142 bash[147631]: c2a6804cc09e3853770155e2df454a688c0f8b0c4c3f9f95b86c643ba3dad978 2023-09-21T12:53:43.319 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mds[147671]: -- 172.21.15.142:0/2067950290 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562032b171e0 con 0x562032aed000 2023-09-21T12:53:43.319 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-j[147647]: starting mds.j at 2023-09-21T12:53:43.666 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 12:53:43 smithi142 systemd[1]: Started Ceph mds.j for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:43.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4104388176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:43.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:43.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:43 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:43.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:43.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4104388176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:43.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:43.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:43.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:43 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:43.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:43.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4104388176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:43.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:43.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:43.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:43.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:43 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:44.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:44.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:44 smithi142 ceph-mon[97663]: Deploying daemon mds.d on smithi142 2023-09-21T12:53:44.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:44 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6834/2681250553,v1:172.21.15.142:6835/2681250553] up:boot 2023-09-21T12:53:44.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:44 smithi142 ceph-mon[97663]: fsmap 3 up:standby 2023-09-21T12:53:44.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:44 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:53:44.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.857+0000 7f981b5ff700 1 -- 172.21.15.142:0/2180632305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814100de0 msgr2=0x7f9814101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:44.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.857+0000 7f981b5ff700 1 --2- 172.21.15.142:0/2180632305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814100de0 0x7f9814101200 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f981000b0a0 tx=0x7f981000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 -- 172.21.15.142:0/2180632305 shutdown_connections 2023-09-21T12:53:44.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 --2- 172.21.15.142:0/2180632305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f9814109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 --2- 172.21.15.142:0/2180632305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814100de0 0x7f9814101200 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 --2- 172.21.15.142:0/2180632305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814101fd0 0x7f9814102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 -- 172.21.15.142:0/2180632305 >> 172.21.15.142:0/2180632305 conn(0x7f98140fc310 msgr2=0x7f98140fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:44.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 -- 172.21.15.142:0/2180632305 shutdown_connections 2023-09-21T12:53:44.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.858+0000 7f981b5ff700 1 -- 172.21.15.142:0/2180632305 wait complete. 2023-09-21T12:53:44.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 Processor -- start 2023-09-21T12:53:44.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 -- start start 2023-09-21T12:53:44.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 0x7f9814196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:44.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:44.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f981419e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:44.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981419e760 con 0x7f9814102970 2023-09-21T12:53:44.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981419e8a0 con 0x7f9814100de0 2023-09-21T12:53:44.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981b5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981419ea30 con 0x7f9814101fd0 2023-09-21T12:53:44.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f9818b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:44.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f9819b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f981419e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:44.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f9818b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33040/0 (socket says 172.21.15.142:33040) 2023-09-21T12:53:44.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f9818b9a700 1 -- 172.21.15.142:0/255949378 learned_addr learned my addr 172.21.15.142:0/255949378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:44.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.859+0000 7f981939b700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 0x7f9814196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:44.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 -- 172.21.15.142:0/255949378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 msgr2=0x7f9814197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:44.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 -- 172.21.15.142:0/255949378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 msgr2=0x7f9814196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:44.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 0x7f9814196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:44.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 -- 172.21.15.142:0/255949378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009d00 con 0x7f9814102970 2023-09-21T12:53:44.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9818b9a700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:44.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f981939b700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 0x7f9814196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:44.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f9819b9c700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f981419e190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f980c00e970 tx=0x7f980c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:44.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c004220 con 0x7f9814102970 2023-09-21T12:53:44.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981419ed10 con 0x7f9814102970 2023-09-21T12:53:44.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f980c004cf0 con 0x7f9814102970 2023-09-21T12:53:44.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c005660 con 0x7f9814102970 2023-09-21T12:53:44.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.860+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981419f210 con 0x7f9814102970 2023-09-21T12:53:44.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.861+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981410c5f0 con 0x7f9814102970 2023-09-21T12:53:44.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.863+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f980c004750 con 0x7f9814102970 2023-09-21T12:53:44.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.865+0000 7f980a7fc700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 0x7f98000a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:44.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.865+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f980c014070 con 0x7f9814102970 2023-09-21T12:53:44.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.865+0000 7f981939b700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 0x7f98000a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:44.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.865+0000 7f981939b700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 0x7f98000a2bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9810007a90 tx=0x7f981000b700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:44.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:44.867+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f980c0954b0 con 0x7f9814102970 2023-09-21T12:53:44.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:44 smithi156 ceph-mon[134078]: Deploying daemon mds.d on smithi142 2023-09-21T12:53:44.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:44 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6834/2681250553,v1:172.21.15.142:6835/2681250553] up:boot 2023-09-21T12:53:44.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:44 smithi156 ceph-mon[134078]: fsmap 3 up:standby 2023-09-21T12:53:44.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:44 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:53:44.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:44 smithi160 ceph-mon[134450]: Deploying daemon mds.d on smithi142 2023-09-21T12:53:44.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:44 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6834/2681250553,v1:172.21.15.142:6835/2681250553] up:boot 2023-09-21T12:53:44.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:44 smithi160 ceph-mon[134450]: fsmap 3 up:standby 2023-09-21T12:53:44.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:44 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:53:45.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.129+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9814107d00 con 0x7f9814102970 2023-09-21T12:53:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.129+0000 7f980a7fc700 1 -- 172.21.15.142:0/255949378 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2916 (secure 0 0 0) 0x7f980c004e60 con 0x7f9814102970 2023-09-21T12:53:45.129 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:45.129 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-21T12:53:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.131+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 msgr2=0x7f98000a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.131+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 0x7f98000a2bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9810007a90 tx=0x7f981000b700 comp rx=0 tx=0).stop 2023-09-21T12:53:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.131+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 msgr2=0x7f981419e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.131+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f981419e190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f980c00e970 tx=0x7f980c00ec80 comp rx=0 tx=0).stop 2023-09-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 shutdown_connections 2023-09-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98000a0710 0x7f98000a2bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9814102970 0x7f981419e190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9814100de0 0x7f9814196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 --2- 172.21.15.142:0/255949378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9814101fd0 0x7f9814197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 >> 172.21.15.142:0/255949378 conn(0x7f98140fc310 msgr2=0x7f98140fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 shutdown_connections 2023-09-21T12:53:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:45.132+0000 7f981b5ff700 1 -- 172.21.15.142:0/255949378 wait complete. 2023-09-21T12:53:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 4 2023-09-21T12:53:45.737 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:45 smithi142 ceph-mon[97663]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:45.738 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:45 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/255949378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:45.738 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:45 smithi142 systemd[1]: Starting Ceph mds.d for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:45 smithi156 ceph-mon[134078]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:45 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/255949378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:45 smithi160 ceph-mon[134450]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:45 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/255949378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:46.504 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:46 smithi142 podman[148021]: 2023-09-21T12:53:46.916 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:46 smithi142 bash[148021]: a383fa39620e4f54bc8d7b0c525473a6b78e8a27818c279a3ce4106a7417fdaa 2023-09-21T12:53:46.917 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:46 smithi142 ceph-mds[148061]: -- 172.21.15.142:0/3054348930 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e0b73511e0 con 0x55e0b7326800 2023-09-21T12:53:46.917 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-d[148037]: starting mds.d at 2023-09-21T12:53:46.917 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 12:53:46 smithi142 systemd[1]: Started Ceph mds.d for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:47.150 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:47.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/3103953400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8108cb0 msgr2=0x7f3fd810b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:47.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/3103953400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8108cb0 0x7f3fd810b140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000b0a0 tx=0x7f3fd000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/3103953400 shutdown_connections 2023-09-21T12:53:47.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/3103953400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8108cb0 0x7f3fd810b140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/3103953400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 0x7f3fd8073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/3103953400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8073840 0x7f3fd8073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/3103953400 >> 172.21.15.142:0/3103953400 conn(0x7f3fd80fc320 msgr2=0x7f3fd80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:47.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/3103953400 shutdown_connections 2023-09-21T12:53:47.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.355+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/3103953400 wait complete. 2023-09-21T12:53:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.356+0000 7f3fdd7ff700 1 Processor -- start 2023-09-21T12:53:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 -- start start 2023-09-21T12:53:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8073840 0x7f3fd8198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 0x7f3fd81992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:47.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:47.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81a08f0 con 0x7f3fd8108cb0 2023-09-21T12:53:47.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81a0a60 con 0x7f3fd8073840 2023-09-21T12:53:47.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fdd7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd81a0c20 con 0x7f3fd8074e20 2023-09-21T12:53:47.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:47.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8073840 0x7f3fd8198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:47.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40816/0 (socket says 172.21.15.142:40816) 2023-09-21T12:53:47.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd77fe700 1 -- 172.21.15.142:0/2950982287 learned_addr learned my addr 172.21.15.142:0/2950982287 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:47.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd67fc700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 0x7f3fd81992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:47.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd77fe700 1 -- 172.21.15.142:0/2950982287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 msgr2=0x7f3fd81992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:47.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.357+0000 7f3fd77fe700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 0x7f3fd81992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fd77fe700 1 -- 172.21.15.142:0/2950982287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8073840 msgr2=0x7f3fd8198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:47.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fd77fe700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8073840 0x7f3fd8198db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fd77fe700 1 -- 172.21.15.142:0/2950982287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fcc009520 con 0x7f3fd8108cb0 2023-09-21T12:53:47.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fd77fe700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009fd0 tx=0x7f3fd000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:47.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000e040 con 0x7f3fd8108cb0 2023-09-21T12:53:47.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd0009d00 con 0x7f3fd8108cb0 2023-09-21T12:53:47.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3fd0003e10 con 0x7f3fd8108cb0 2023-09-21T12:53:47.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd001b6a0 con 0x7f3fd8108cb0 2023-09-21T12:53:47.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.358+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd81a1130 con 0x7f3fd8108cb0 2023-09-21T12:53:47.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.359+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd8107360 con 0x7f3fd8108cb0 2023-09-21T12:53:47.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.361+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f3fd001d470 con 0x7f3fd8108cb0 2023-09-21T12:53:47.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.362+0000 7f3fbffff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 0x7f3fc00a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:47.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.363+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3fd00ccb20 con 0x7f3fd8108cb0 2023-09-21T12:53:47.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.363+0000 7f3fd6ffd700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 0x7f3fc00a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:47.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.363+0000 7f3fd6ffd700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 0x7f3fc00a2b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fd819a280 tx=0x7f3fc800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:47.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.366+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3fd0096ae0 con 0x7f3fd8108cb0 2023-09-21T12:53:47.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.609+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fd802d120 con 0x7f3fd8108cb0 2023-09-21T12:53:47.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.610+0000 7f3fbffff700 1 -- 172.21.15.142:0/2950982287 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3710 (secure 0 0 0) 0x7f3fd009a100 con 0x7f3fd8108cb0 2023-09-21T12:53:47.609 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:47.610 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[]} 2023-09-21T12:53:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 msgr2=0x7f3fc00a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 0x7f3fc00a2b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fd819a280 tx=0x7f3fc800b410 comp rx=0 tx=0).stop 2023-09-21T12:53:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 msgr2=0x7f3fd81a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:47.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009fd0 tx=0x7f3fd000bce0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 shutdown_connections 2023-09-21T12:53:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3fc00a0690 0x7f3fc00a2b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3fd8108cb0 0x7f3fd81a0320 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3fd8073840 0x7f3fd8198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 --2- 172.21.15.142:0/2950982287 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3fd8074e20 0x7f3fd81992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.612+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 >> 172.21.15.142:0/2950982287 conn(0x7f3fd80fc320 msgr2=0x7f3fd80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.613+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 shutdown_connections 2023-09-21T12:53:47.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:47.613+0000 7f3fdd7ff700 1 -- 172.21.15.142:0/2950982287 wait complete. 2023-09-21T12:53:47.615 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 5 2023-09-21T12:53:47.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:47.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: Deploying daemon mds.e on smithi156 2023-09-21T12:53:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6836/2227040296,v1:172.21.15.142:6837/2227040296] up:boot 2023-09-21T12:53:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: fsmap 4 up:standby 2023-09-21T12:53:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:53:47.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2950982287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: Deploying daemon mds.e on smithi156 2023-09-21T12:53:47.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6836/2227040296,v1:172.21.15.142:6837/2227040296] up:boot 2023-09-21T12:53:47.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: fsmap 4 up:standby 2023-09-21T12:53:47.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:53:47.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2950982287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:47.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:47.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:47.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:47.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:47.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:47.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: Deploying daemon mds.e on smithi156 2023-09-21T12:53:47.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6836/2227040296,v1:172.21.15.142:6837/2227040296] up:boot 2023-09-21T12:53:47.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: fsmap 4 up:standby 2023-09-21T12:53:47.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:53:47.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2950982287' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:48.405 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 systemd[1]: Starting Ceph mds.e for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:48.735 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 podman[169746]: 2023-09-21T12:53:49.155 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 ceph-mds[169786]: -- 172.21.15.156:0/41532110 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558c38cfb1e0 con 0x558c38cd0c00 2023-09-21T12:53:49.155 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-e[169762]: starting mds.e at 2023-09-21T12:53:49.156 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 bash[169746]: e3fd99f14a60ef6c13045a81f0ea2baea9ebcffc29a558f0dbb910f94e4f904d 2023-09-21T12:53:49.156 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 12:53:48 smithi156 systemd[1]: Started Ceph mds.e for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:49.632 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/3310007715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28102980 msgr2=0x7f1f28109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/3310007715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28102980 0x7f1f28109230 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000b0d0 tx=0x7f1f2000b3e0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/3310007715 shutdown_connections 2023-09-21T12:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/3310007715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28102980 0x7f1f28109230 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/3310007715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/3310007715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28101fe0 0x7f1f28102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/3310007715 >> 172.21.15.142:0/3310007715 conn(0x7f1f280fc320 msgr2=0x7f1f280fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:49.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/3310007715 shutdown_connections 2023-09-21T12:53:49.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.845+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/3310007715 wait complete. 2023-09-21T12:53:49.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.846+0000 7f1f2e7ff700 1 Processor -- start 2023-09-21T12:53:49.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 -- start start 2023-09-21T12:53:49.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 0x7f1f28199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28102980 0x7f1f281a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281a0900 con 0x7f1f28101fe0 2023-09-21T12:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281a0a70 con 0x7f1f28102980 2023-09-21T12:53:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2e7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f281a0c30 con 0x7f1f28100df0 2023-09-21T12:53:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 0x7f1f28199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f27fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f27fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33082/0 (socket says 172.21.15.142:33082) 2023-09-21T12:53:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f27fff700 1 -- 172.21.15.142:0/820652743 learned_addr learned my addr 172.21.15.142:0/820652743 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f277fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 0x7f1f28199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40822/0 (socket says 172.21.15.142:40822) 2023-09-21T12:53:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.847+0000 7f1f2cd9c700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28102980 0x7f1f281a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 -- 172.21.15.142:0/820652743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28102980 msgr2=0x7f1f281a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28102980 0x7f1f281a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 -- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 msgr2=0x7f1f28199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 0x7f1f28199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 -- 172.21.15.142:0/820652743 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009d00 con 0x7f1f28100df0 2023-09-21T12:53:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f27fff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e970 tx=0x7f1f1800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18009790 con 0x7f1f28100df0 2023-09-21T12:53:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f1800c7e0 con 0x7f1f28100df0 2023-09-21T12:53:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f281a0f10 con 0x7f1f28100df0 2023-09-21T12:53:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f18003c70 con 0x7f1f28100df0 2023-09-21T12:53:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.848+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f281a1330 con 0x7f1f28100df0 2023-09-21T12:53:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.849+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2810c660 con 0x7f1f28100df0 2023-09-21T12:53:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.851+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1f1800cc50 con 0x7f1f28100df0 2023-09-21T12:53:49.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.852+0000 7f1f257fa700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 0x7f1f100a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.852+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1f18014070 con 0x7f1f28100df0 2023-09-21T12:53:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.852+0000 7f1f277fe700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 0x7f1f100a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.853+0000 7f1f277fe700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 0x7f1f100a2b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005950 tx=0x7f1f1c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:49.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:49.856+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1f18095880 con 0x7f1f28100df0 2023-09-21T12:53:50.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.101+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f281a1580 con 0x7f1f28100df0 2023-09-21T12:53:50.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.102+0000 7f1f257fa700 1 -- 172.21.15.142:0/820652743 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4504 (secure 0 0 0) 0x7f1f18003dd0 con 0x7f1f28100df0 2023-09-21T12:53:50.101 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:50.101 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-09-21T12:53:50.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 msgr2=0x7f1f100a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:50.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 0x7f1f100a2b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c005950 tx=0x7f1f1c00b410 comp rx=0 tx=0).stop 2023-09-21T12:53:50.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 msgr2=0x7f1f28198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:50.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800e970 tx=0x7f1f1800ec80 comp rx=0 tx=0).stop 2023-09-21T12:53:50.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 shutdown_connections 2023-09-21T12:53:50.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1f100a0690 0x7f1f100a2b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:50.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f28102980 0x7f1f281a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:50.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f28100df0 0x7f1f28198dc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:50.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 --2- 172.21.15.142:0/820652743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f28101fe0 0x7f1f28199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:50.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 >> 172.21.15.142:0/820652743 conn(0x7f1f280fc320 msgr2=0x7f1f28107820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:50.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 shutdown_connections 2023-09-21T12:53:50.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:50.104+0000 7f1f2e7ff700 1 -- 172.21.15.142:0/820652743 wait complete. 2023-09-21T12:53:50.107 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 6 2023-09-21T12:53:50.117 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:50.117 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.117 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:50.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:50.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:50.118 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6834/3821479486,v1:172.21.15.156:6835/3821479486] up:boot 2023-09-21T12:53:50.119 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: fsmap 5 up:standby 2023-09-21T12:53:50.119 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:49 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:53:50.120 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:50.120 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.120 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.120 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:50.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:50.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:50.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6834/3821479486,v1:172.21.15.156:6835/3821479486] up:boot 2023-09-21T12:53:50.121 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: fsmap 5 up:standby 2023-09-21T12:53:50.122 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:49 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:53:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6834/3821479486,v1:172.21.15.156:6835/3821479486] up:boot 2023-09-21T12:53:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: fsmap 5 up:standby 2023-09-21T12:53:50.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:49 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:53:50.688 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:50 smithi160 systemd[1]: Starting Ceph mds.f for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:51.074 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:50 smithi160 ceph-mon[134450]: Deploying daemon mds.f on smithi160 2023-09-21T12:53:51.074 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:50 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/820652743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:51.075 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:50 smithi160 podman[171463]: 2023-09-21T12:53:51.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:50 smithi156 ceph-mon[134078]: Deploying daemon mds.f on smithi160 2023-09-21T12:53:51.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:50 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/820652743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:51.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:50 smithi142 ceph-mon[97663]: Deploying daemon mds.f on smithi160 2023-09-21T12:53:51.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:50 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/820652743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:51.438 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mds[171503]: -- 172.21.15.160:0/3079873688 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56073e9051e0 con 0x56073e8dac00 2023-09-21T12:53:51.438 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:51 smithi160 bash[171463]: 2188fefd9a9cb68b7879864d266b8899a3095e87338bf9073f8b159c5208a5bb 2023-09-21T12:53:51.439 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: starting mds.f at 2023-09-21T12:53:51.439 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 12:53:51 smithi160 systemd[1]: Started Ceph mds.f for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:52.068 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:52.069 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.069 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.069 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.069 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:52.070 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:52.070 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:52.070 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:51 smithi160 ceph-mon[134450]: Deploying daemon mds.c on smithi160 2023-09-21T12:53:52.124 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:52.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:51 smithi156 ceph-mon[134078]: Deploying daemon mds.c on smithi160 2023-09-21T12:53:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:52.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:52.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:52.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:52.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:51 smithi142 ceph-mon[97663]: Deploying daemon mds.c on smithi160 2023-09-21T12:53:52.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.332+0000 7fa79ffff700 1 -- 172.21.15.142:0/1108664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798100de0 msgr2=0x7fa798101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:52.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.332+0000 7fa79ffff700 1 --2- 172.21.15.142:0/1108664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798100de0 0x7fa798101200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa794009990 tx=0x7fa794009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 -- 172.21.15.142:0/1108664680 shutdown_connections 2023-09-21T12:53:52.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 --2- 172.21.15.142:0/1108664680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798102970 0x7fa798109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 --2- 172.21.15.142:0/1108664680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798100de0 0x7fa798101200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 --2- 172.21.15.142:0/1108664680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798101fd0 0x7fa798102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 -- 172.21.15.142:0/1108664680 >> 172.21.15.142:0/1108664680 conn(0x7fa7980fc310 msgr2=0x7fa7980fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:52.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 -- 172.21.15.142:0/1108664680 shutdown_connections 2023-09-21T12:53:52.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.333+0000 7fa79ffff700 1 -- 172.21.15.142:0/1108664680 wait complete. 2023-09-21T12:53:52.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 Processor -- start 2023-09-21T12:53:52.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 -- start start 2023-09-21T12:53:52.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:52.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798101fd0 0x7fa798197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:52.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 0x7fa79819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:52.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79819e640 con 0x7fa798100de0 2023-09-21T12:53:52.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79819e780 con 0x7fa798101fd0 2023-09-21T12:53:52.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79ffff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79819e910 con 0x7fa798102970 2023-09-21T12:53:52.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:52.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79dd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40834/0 (socket says 172.21.15.142:40834) 2023-09-21T12:53:52.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79dd9b700 1 -- 172.21.15.142:0/389983440 learned_addr learned my addr 172.21.15.142:0/389983440 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:52.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79e59c700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 0x7fa79819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:52.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.334+0000 7fa79d59a700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798101fd0 0x7fa798197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:52.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 -- 172.21.15.142:0/389983440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 msgr2=0x7fa79819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:52.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 0x7fa79819e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 -- 172.21.15.142:0/389983440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798101fd0 msgr2=0x7fa798197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:52.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798101fd0 0x7fa798197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 -- 172.21.15.142:0/389983440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940095f0 con 0x7fa798100de0 2023-09-21T12:53:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79e59c700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 0x7fa79819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79dd9b700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa79400b680 tx=0x7fa794005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79401d070 con 0x7fa798100de0 2023-09-21T12:53:52.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79819eb90 con 0x7fa798100de0 2023-09-21T12:53:52.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa794021410 con 0x7fa798100de0 2023-09-21T12:53:52.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa794017650 con 0x7fa798100de0 2023-09-21T12:53:52.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.335+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79819efc0 con 0x7fa798100de0 2023-09-21T12:53:52.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.336+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa798108390 con 0x7fa798100de0 2023-09-21T12:53:52.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.338+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa794021580 con 0x7fa798100de0 2023-09-21T12:53:52.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.339+0000 7fa78effd700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 0x7fa7840a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:52.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.340+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa7940ccc00 con 0x7fa798100de0 2023-09-21T12:53:52.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.340+0000 7fa79d59a700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 0x7fa7840a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:52.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.340+0000 7fa79d59a700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 0x7fa7840a2bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa788009c60 tx=0x7fa788009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:52.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.344+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa794096bc0 con 0x7fa798100de0 2023-09-21T12:53:52.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.585+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa79810c640 con 0x7fa798100de0 2023-09-21T12:53:52.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.586+0000 7fa78effd700 1 -- 172.21.15.142:0/389983440 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5298 (secure 0 0 0) 0x7fa79409a1e0 con 0x7fa798100de0 2023-09-21T12:53:52.586 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:52.586 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7}],"filesystems":[]} 2023-09-21T12:53:52.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 msgr2=0x7fa7840a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:52.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 0x7fa7840a2bd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa788009c60 tx=0x7fa788009260 comp rx=0 tx=0).stop 2023-09-21T12:53:52.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 msgr2=0x7fa798196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:52.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa79400b680 tx=0x7fa794005740 comp rx=0 tx=0).stop 2023-09-21T12:53:52.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 shutdown_connections 2023-09-21T12:53:52.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7840a0710 0x7fa7840a2bd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa798100de0 0x7fa798196ac0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa798102970 0x7fa79819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 --2- 172.21.15.142:0/389983440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa798101fd0 0x7fa798197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:52.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 >> 172.21.15.142:0/389983440 conn(0x7fa7980fc310 msgr2=0x7fa7981054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:52.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.588+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 shutdown_connections 2023-09-21T12:53:52.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:52.589+0000 7fa79ffff700 1 -- 172.21.15.142:0/389983440 wait complete. 2023-09-21T12:53:52.590 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 7 2023-09-21T12:53:52.688 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:52 smithi160 systemd[1]: Starting Ceph mds.c for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:53.200 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:52 smithi160 podman[171807]: 2023-09-21T12:53:53.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6834/2687704828,v1:172.21.15.160:6835/2687704828] up:boot 2023-09-21T12:53:53.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mon[134450]: fsmap 6 up:standby 2023-09-21T12:53:53.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:53:53.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mon[134450]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:53.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/389983440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:53.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:53 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6834/2687704828,v1:172.21.15.160:6835/2687704828] up:boot 2023-09-21T12:53:53.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:53 smithi156 ceph-mon[134078]: fsmap 6 up:standby 2023-09-21T12:53:53.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:53 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:53:53.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:53 smithi156 ceph-mon[134078]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:53.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:53 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/389983440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:53.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:53 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6834/2687704828,v1:172.21.15.160:6835/2687704828] up:boot 2023-09-21T12:53:53.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:53 smithi142 ceph-mon[97663]: fsmap 6 up:standby 2023-09-21T12:53:53.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:53 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:53:53.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:53 smithi142 ceph-mon[97663]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:53.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:53 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/389983440' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:53.688 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-mds[171847]: -- 172.21.15.160:0/983655642 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56341ea771e0 con 0x56341ea4c800 2023-09-21T12:53:53.688 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: starting mds.c at 2023-09-21T12:53:53.688 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:53 smithi160 bash[171807]: 09d9fa4f796c0cff65f0cc4a9dda80e6512dca606bd692126ff61c86236330be 2023-09-21T12:53:53.689 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 12:53:53 smithi160 systemd[1]: Started Ceph mds.c for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:54.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.570 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:54.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:54.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:54.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: Deploying daemon mds.h on smithi156 2023-09-21T12:53:54.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:boot 2023-09-21T12:53:54.571 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: fsmap 7 up:standby 2023-09-21T12:53:54.572 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:54 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:53:54.609 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:54.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: Deploying daemon mds.h on smithi156 2023-09-21T12:53:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:boot 2023-09-21T12:53:54.668 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: fsmap 7 up:standby 2023-09-21T12:53:54.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:54 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:53:54.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:54.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:54.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:54.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:54.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: Deploying daemon mds.h on smithi156 2023-09-21T12:53:54.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:boot 2023-09-21T12:53:54.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: fsmap 7 up:standby 2023-09-21T12:53:54.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:54 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:53:54.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.818+0000 7fcb08dff700 1 -- 172.21.15.142:0/3664965641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04073840 msgr2=0x7fcb04073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:54.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.818+0000 7fcb08dff700 1 --2- 172.21.15.142:0/3664965641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04073840 0x7fcb04073cc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8009990 tx=0x7fcaf8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.818+0000 7fcb08dff700 1 -- 172.21.15.142:0/3664965641 shutdown_connections 2023-09-21T12:53:54.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.818+0000 7fcb08dff700 1 --2- 172.21.15.142:0/3664965641 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04108cb0 0x7fcb0410b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.819+0000 7fcb08dff700 1 --2- 172.21.15.142:0/3664965641 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb04073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.819+0000 7fcb08dff700 1 --2- 172.21.15.142:0/3664965641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04073840 0x7fcb04073cc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.819+0000 7fcb08dff700 1 -- 172.21.15.142:0/3664965641 >> 172.21.15.142:0/3664965641 conn(0x7fcb040fc320 msgr2=0x7fcb040fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:54.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.819+0000 7fcb08dff700 1 -- 172.21.15.142:0/3664965641 shutdown_connections 2023-09-21T12:53:54.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.819+0000 7fcb08dff700 1 -- 172.21.15.142:0/3664965641 wait complete. 2023-09-21T12:53:54.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 Processor -- start 2023-09-21T12:53:54.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 -- start start 2023-09-21T12:53:54.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04073840 0x7fcb04198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:54.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:54.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04108cb0 0x7fcb041a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:54.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a07f0 con 0x7fcb04073840 2023-09-21T12:53:54.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a0960 con 0x7fcb04074e20 2023-09-21T12:53:54.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb08dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb041a0b20 con 0x7fcb04108cb0 2023-09-21T12:53:54.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:54.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb0259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04073840 0x7fcb04198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:54.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38624/0 (socket says 172.21.15.142:38624) 2023-09-21T12:53:54.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb01d9b700 1 -- 172.21.15.142:0/1481490847 learned_addr learned my addr 172.21.15.142:0/1481490847 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:54.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.820+0000 7fcb02d9d700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04108cb0 0x7fcb041a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:54.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 -- 172.21.15.142:0/1481490847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04108cb0 msgr2=0x7fcb041a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:54.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04108cb0 0x7fcb041a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 -- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04073840 msgr2=0x7fcb04198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:54.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04073840 0x7fcb04198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:54.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 -- 172.21.15.142:0/1481490847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009520 con 0x7fcb04074e20 2023-09-21T12:53:54.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb01d9b700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:54.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf801d070 con 0x7fcb04074e20 2023-09-21T12:53:54.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcaf8022470 con 0x7fcb04074e20 2023-09-21T12:53:54.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc009c40 con 0x7fcb04074e20 2023-09-21T12:53:54.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8017650 con 0x7fcb04074e20 2023-09-21T12:53:54.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.821+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf80095f0 con 0x7fcb04074e20 2023-09-21T12:53:54.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.822+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb04107360 con 0x7fcb04074e20 2023-09-21T12:53:54.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.824+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fcaf80225e0 con 0x7fcb04074e20 2023-09-21T12:53:54.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.825+0000 7fcaf37fe700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 0x7fcaec0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:54.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.825+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fcaf80cd060 con 0x7fcb04074e20 2023-09-21T12:53:54.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.825+0000 7fcb0259c700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 0x7fcaec0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:54.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.826+0000 7fcb0259c700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 0x7fcaec0a2b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb04199b50 tx=0x7fcaf4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:54.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:54.828+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcaf8097020 con 0x7fcb04074e20 2023-09-21T12:53:55.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.070+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb0402d110 con 0x7fcb04074e20 2023-09-21T12:53:55.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.070+0000 7fcaf37fe700 1 -- 172.21.15.142:0/1481490847 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6092 (secure 0 0 0) 0x7fcaf809a640 con 0x7fcb04074e20 2023-09-21T12:53:55.070 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:55.070 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-21T12:53:55.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 msgr2=0x7fcaec0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:55.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 0x7fcaec0a2b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb04199b50 tx=0x7fcaf4009260 comp rx=0 tx=0).stop 2023-09-21T12:53:55.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 msgr2=0x7fcb041991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:55.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8005720 comp rx=0 tx=0).stop 2023-09-21T12:53:55.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 shutdown_connections 2023-09-21T12:53:55.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcaec0a0690 0x7fcaec0a2b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:55.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcb04073840 0x7fcb04198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:55.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcb04108cb0 0x7fcb041a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:55.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 --2- 172.21.15.142:0/1481490847 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcb04074e20 0x7fcb041991c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:55.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 >> 172.21.15.142:0/1481490847 conn(0x7fcb040fc320 msgr2=0x7fcb040fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:55.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 shutdown_connections 2023-09-21T12:53:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:55.073+0000 7fcb08dff700 1 -- 172.21.15.142:0/1481490847 wait complete. 2023-09-21T12:53:55.075 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 8 2023-09-21T12:53:55.155 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:54 smithi156 systemd[1]: Starting Ceph mds.h for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:55.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:55 smithi142 ceph-mon[97663]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:55.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:55 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1481490847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:55.528 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:55 smithi156 podman[170089]: 2023-09-21T12:53:55.529 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:55 smithi156 ceph-mon[134078]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:55.529 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:55 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1481490847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:55 smithi160 ceph-mon[134450]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:55.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:55 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1481490847' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:55.905 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:55 smithi156 ceph-mds[170129]: -- 172.21.15.156:0/590568662 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5600463131e0 con 0x5600462e8800 2023-09-21T12:53:55.906 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:55 smithi156 bash[170089]: 4aa378705319b97dfe600c61d167758302e191675755e508d49d6461f6b5492a 2023-09-21T12:53:55.906 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: starting mds.h at 2023-09-21T12:53:55.906 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 12:53:55 smithi156 systemd[1]: Started Ceph mds.h for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:56.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: Deploying daemon mds.i on smithi160 2023-09-21T12:53:56.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6836/3800669997,v1:172.21.15.156:6837/3800669997] up:boot 2023-09-21T12:53:56.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: fsmap 8 up:standby 2023-09-21T12:53:56.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:56 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:53:57.092 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:57.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:57.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:57.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: Deploying daemon mds.i on smithi160 2023-09-21T12:53:57.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6836/3800669997,v1:172.21.15.156:6837/3800669997] up:boot 2023-09-21T12:53:57.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: fsmap 8 up:standby 2023-09-21T12:53:57.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:56 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:53:57.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:57.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:57.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:57.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:57.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: Deploying daemon mds.i on smithi160 2023-09-21T12:53:57.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6836/3800669997,v1:172.21.15.156:6837/3800669997] up:boot 2023-09-21T12:53:57.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: fsmap 8 up:standby 2023-09-21T12:53:57.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:56 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:53:57.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 -- 172.21.15.142:0/2204927886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 msgr2=0x7f62d8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:57.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 --2- 172.21.15.142:0/2204927886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8102440 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009990 tx=0x7f62c4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 -- 172.21.15.142:0/2204927886 shutdown_connections 2023-09-21T12:53:57.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 --2- 172.21.15.142:0/2204927886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8100df0 0x7f62d8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 --2- 172.21.15.142:0/2204927886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8102980 0x7f62d8109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 --2- 172.21.15.142:0/2204927886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8102440 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 -- 172.21.15.142:0/2204927886 >> 172.21.15.142:0/2204927886 conn(0x7f62d80fc320 msgr2=0x7f62d80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:57.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 -- 172.21.15.142:0/2204927886 shutdown_connections 2023-09-21T12:53:57.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.301+0000 7f62dedff700 1 -- 172.21.15.142:0/2204927886 wait complete. 2023-09-21T12:53:57.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.302+0000 7f62dedff700 1 Processor -- start 2023-09-21T12:53:57.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.302+0000 7f62dedff700 1 -- start start 2023-09-21T12:53:57.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 0x7f62d8196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:57.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:57.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 0x7f62d819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:57.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d819e610 con 0x7f62d8102980 2023-09-21T12:53:57.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d819e750 con 0x7f62d8100df0 2023-09-21T12:53:57.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dedff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d819e8e0 con 0x7f62d8101fe0 2023-09-21T12:53:57.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:57.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dcb9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 0x7f62d8196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:57.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53460/0 (socket says 172.21.15.142:53460) 2023-09-21T12:53:57.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 -- 172.21.15.142:0/2971609834 learned_addr learned my addr 172.21.15.142:0/2971609834 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:57.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dd39c700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 0x7f62d819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:57.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 -- 172.21.15.142:0/2971609834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 msgr2=0x7f62d8196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:57.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 0x7f62d8196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 -- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 msgr2=0x7f62d819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:57.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 0x7f62d819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 -- 172.21.15.142:0/2971609834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c40095f0 con 0x7f62d8101fe0 2023-09-21T12:53:57.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dd39c700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 0x7f62d819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:53:57.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62dcb9b700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 0x7f62d8196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:57.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.303+0000 7f62d7fff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62c4004740 tx=0x7f62c4009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:57.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.304+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c401d070 con 0x7f62d8101fe0 2023-09-21T12:53:57.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.304+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d819eb60 con 0x7f62d8101fe0 2023-09-21T12:53:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.304+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62c4004830 con 0x7f62d8101fe0 2023-09-21T12:53:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.304+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c4005440 con 0x7f62d8101fe0 2023-09-21T12:53:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.304+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d819ef30 con 0x7f62d8101fe0 2023-09-21T12:53:57.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.305+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d8108360 con 0x7f62d8101fe0 2023-09-21T12:53:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.307+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f62c400fb00 con 0x7f62d8101fe0 2023-09-21T12:53:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.308+0000 7f62d5ffb700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 0x7f62c80a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.308+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f62c40ccf20 con 0x7f62d8101fe0 2023-09-21T12:53:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.308+0000 7f62dcb9b700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 0x7f62c80a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:57.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.309+0000 7f62dcb9b700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 0x7f62c80a2b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62d8101e40 tx=0x7f62cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:57.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.313+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f62c4096ee0 con 0x7f62d8101fe0 2023-09-21T12:53:57.438 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 systemd[1]: Starting Ceph mds.i for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:53:57.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.557+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62d810c8a0 con 0x7f62d8101fe0 2023-09-21T12:53:57.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.558+0000 7f62d5ffb700 1 -- 172.21.15.142:0/2971609834 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6886 (secure 0 0 0) 0x7f62c409a500 con 0x7f62d8101fe0 2023-09-21T12:53:57.558 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:53:57.558 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-09-21T12:53:57.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 msgr2=0x7f62c80a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 0x7f62c80a2b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62d8101e40 tx=0x7f62cc009260 comp rx=0 tx=0).stop 2023-09-21T12:53:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 msgr2=0x7f62d8196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f62c4004740 tx=0x7f62c4009580 comp rx=0 tx=0).stop 2023-09-21T12:53:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 shutdown_connections 2023-09-21T12:53:57.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62c80a0690 0x7f62c80a2b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f62d8102980 0x7f62d819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f62d8100df0 0x7f62d8196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 --2- 172.21.15.142:0/2971609834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d8101fe0 0x7f62d8196fd0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:57.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 >> 172.21.15.142:0/2971609834 conn(0x7f62d80fc320 msgr2=0x7f62d81054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 shutdown_connections 2023-09-21T12:53:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:57.561+0000 7f62dedff700 1 -- 172.21.15.142:0/2971609834 wait complete. 2023-09-21T12:53:57.563 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 9 2023-09-21T12:53:57.799 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:57 smithi160 ceph-mon[134450]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:57.800 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:57 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2971609834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:57.800 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 podman[172147]: 2023-09-21T12:53:57.800 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 bash[172147]: ffad7dbb76cf511387d6ac0dc3efdb86c3022e0faa90c342841227bf9f353ff9 2023-09-21T12:53:57.801 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/323439262 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556f803f51e0 con 0x556f803cb000 2023-09-21T12:53:57.801 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T12:53:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:57 smithi142 ceph-mon[97663]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:57.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:57 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2971609834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:57 smithi156 ceph-mon[134078]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:57 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2971609834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:53:58.188 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 12:53:57 smithi160 systemd[1]: Started Ceph mds.i for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:53:59.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:59.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:59.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:59.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: Deploying daemon mds.g on smithi142 2023-09-21T12:53:59.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:59.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/39574793,v1:172.21.15.160:6839/39574793] up:boot 2023-09-21T12:53:59.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: fsmap 9 up:standby 2023-09-21T12:53:59.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:53:58 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:53:59.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:59.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:59.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:59.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: Deploying daemon mds.g on smithi142 2023-09-21T12:53:59.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:59.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/39574793,v1:172.21.15.160:6839/39574793] up:boot 2023-09-21T12:53:59.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: fsmap 9 up:standby 2023-09-21T12:53:59.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:53:58 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:53:59.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:53:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:53:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:53:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:53:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: Deploying daemon mds.g on smithi142 2023-09-21T12:53:59.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:53:59.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/39574793,v1:172.21.15.160:6839/39574793] up:boot 2023-09-21T12:53:59.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: fsmap 9 up:standby 2023-09-21T12:53:59.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:53:58 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:53:59.580 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:53:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 -- 172.21.15.142:0/3829948325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538101fd0 msgr2=0x7fa538102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 --2- 172.21.15.142:0/3829948325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538101fd0 0x7fa538102430 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa528009920 tx=0x7fa528009c30 comp rx=0 tx=0).stop 2023-09-21T12:53:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 -- 172.21.15.142:0/3829948325 shutdown_connections 2023-09-21T12:53:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 --2- 172.21.15.142:0/3829948325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538102970 0x7fa538109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 --2- 172.21.15.142:0/3829948325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538100de0 0x7fa538101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 --2- 172.21.15.142:0/3829948325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538101fd0 0x7fa538102430 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 -- 172.21.15.142:0/3829948325 >> 172.21.15.142:0/3829948325 conn(0x7fa5380fc330 msgr2=0x7fa5380fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:53:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 -- 172.21.15.142:0/3829948325 shutdown_connections 2023-09-21T12:53:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.801+0000 7fa5407ff700 1 -- 172.21.15.142:0/3829948325 wait complete. 2023-09-21T12:53:59.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 Processor -- start 2023-09-21T12:53:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 -- start start 2023-09-21T12:53:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538100de0 0x7fa538198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 0x7fa538199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381a0890 con 0x7fa538102970 2023-09-21T12:53:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381a0a00 con 0x7fa538101fd0 2023-09-21T12:53:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa5407ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5381a0bc0 con 0x7fa538100de0 2023-09-21T12:53:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa53ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa53ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52782/0 (socket says 172.21.15.142:52782) 2023-09-21T12:53:59.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa53ed9c700 1 -- 172.21.15.142:0/2221977647 learned_addr learned my addr 172.21.15.142:0/2221977647 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:53:59.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa53dd9a700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 0x7fa538199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:59.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.803+0000 7fa53e59b700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538100de0 0x7fa538198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:59.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 -- 172.21.15.142:0/2221977647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538100de0 msgr2=0x7fa538198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538100de0 0x7fa538198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 -- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 msgr2=0x7fa5381a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:53:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:53:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 -- 172.21.15.142:0/2221977647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa528009520 con 0x7fa538101fd0 2023-09-21T12:53:59.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53ed9c700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:53:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa53dd9a700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 0x7fa538199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa528000c00 tx=0x7fa52800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52801c070 con 0x7fa538101fd0 2023-09-21T12:53:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5381a0e40 con 0x7fa538101fd0 2023-09-21T12:53:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa52800f7d0 con 0x7fa538101fd0 2023-09-21T12:53:59.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280038e0 con 0x7fa538101fd0 2023-09-21T12:53:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.804+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5381a11b0 con 0x7fa538101fd0 2023-09-21T12:53:59.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.806+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa538193430 con 0x7fa538101fd0 2023-09-21T12:53:59.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.807+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa528020030 con 0x7fa538101fd0 2023-09-21T12:53:59.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.809+0000 7fa52f7fe700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 0x7fa5240a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:53:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.809+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa5280ccc50 con 0x7fa538101fd0 2023-09-21T12:53:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.809+0000 7fa53e59b700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 0x7fa5240a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:53:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.810+0000 7fa53e59b700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 0x7fa5240a2b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa53819a220 tx=0x7fa534009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:53:59.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:53:59.811+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa528096c10 con 0x7fa538101fd0 2023-09-21T12:54:00.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.083+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa53802d1f0 con 0x7fa538101fd0 2023-09-21T12:54:00.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.084+0000 7fa52f7fe700 1 -- 172.21.15.142:0/2221977647 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7676 (secure 0 0 0) 0x7fa52809a230 con 0x7fa538101fd0 2023-09-21T12:54:00.083 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:00.084 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24535,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-21T12:54:00.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.086+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 msgr2=0x7fa5240a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:00.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.086+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 0x7fa5240a2b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa53819a220 tx=0x7fa534009310 comp rx=0 tx=0).stop 2023-09-21T12:54:00.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.086+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 msgr2=0x7fa538199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.086+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 0x7fa538199290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa528000c00 tx=0x7fa52800b790 comp rx=0 tx=0).stop 2023-09-21T12:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 shutdown_connections 2023-09-21T12:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5240a0690 0x7fa5240a2b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa538102970 0x7fa5381a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:00.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa538100de0 0x7fa538198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:00.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 --2- 172.21.15.142:0/2221977647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa538101fd0 0x7fa538199290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:00.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 >> 172.21.15.142:0/2221977647 conn(0x7fa5380fc330 msgr2=0x7fa538107900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:00.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 shutdown_connections 2023-09-21T12:54:00.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:00.087+0000 7fa5407ff700 1 -- 172.21.15.142:0/2221977647 wait complete. 2023-09-21T12:54:00.089 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 10 2023-09-21T12:54:00.250 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:00 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2221977647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:00.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:00 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2221977647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:00.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:00 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2221977647' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:00.666 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:00 smithi142 systemd[1]: Starting Ceph mds.g for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:54:00.994 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:00 smithi142 podman[148632]: 2023-09-21T12:54:01.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:01.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:01.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:01.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:01 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:01.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:01.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:01.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:01.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:01 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:01.418 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:00 smithi142 bash[148632]: 590e890b698d8f3ef4f8254031840f6d66d26805cead3bc175fef80d30f712bb 2023-09-21T12:54:01.418 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:00 smithi142 ceph-mds[148672]: -- 172.21.15.142:0/2483951061 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5593919151e0 con 0x5593918ea800 2023-09-21T12:54:01.418 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-g[148648]: starting mds.g at 2023-09-21T12:54:01.418 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 12:54:01 smithi142 systemd[1]: Started Ceph mds.g for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:54:01.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:01.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:01.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:01.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:01.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:01 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:02.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:54:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 -- 172.21.15.142:0/2437920759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 msgr2=0x7f7f2c102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2437920759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c102440 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7f200099c0 tx=0x7f7f20009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 -- 172.21.15.142:0/2437920759 shutdown_connections 2023-09-21T12:54:02.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2437920759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c102980 0x7f7f2c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2437920759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c100df0 0x7f7f2c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2437920759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c102440 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 -- 172.21.15.142:0/2437920759 >> 172.21.15.142:0/2437920759 conn(0x7f7f2c0fc320 msgr2=0x7f7f2c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:02.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 -- 172.21.15.142:0/2437920759 shutdown_connections 2023-09-21T12:54:02.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.317+0000 7f7f31bff700 1 -- 172.21.15.142:0/2437920759 wait complete. 2023-09-21T12:54:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.318+0000 7f7f31bff700 1 Processor -- start 2023-09-21T12:54:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.318+0000 7f7f31bff700 1 -- start start 2023-09-21T12:54:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:02.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:02.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c102980 0x7f7f2c1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:02.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1a07b0 con 0x7f7f2c101fe0 2023-09-21T12:54:02.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1a0920 con 0x7f7f2c100df0 2023-09-21T12:54:02.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f31bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c1a0ae0 con 0x7f7f2c102980 2023-09-21T12:54:02.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:02.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:02.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38706/0 (socket says 172.21.15.142:38706) 2023-09-21T12:54:02.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 -- 172.21.15.142:0/2745550141 learned_addr learned my addr 172.21.15.142:0/2745550141 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:02.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2bfff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c102980 0x7f7f2c1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:02.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 -- 172.21.15.142:0/2745550141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c102980 msgr2=0x7f7f2c1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:02.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c102980 0x7f7f2c1a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 -- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 msgr2=0x7f7f2c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:02.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2b7fe700 1 -- 172.21.15.142:0/2745550141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200095f0 con 0x7f7f2c100df0 2023-09-21T12:54:02.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.319+0000 7f7f2affd700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:02.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f2b7fe700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e970 tx=0x7f7f1c00ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:02.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c009790 con 0x7f7f2c100df0 2023-09-21T12:54:02.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c1a0dc0 con 0x7f7f2c100df0 2023-09-21T12:54:02.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f1c00c7e0 con 0x7f7f2c100df0 2023-09-21T12:54:02.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c003c70 con 0x7f7f2c100df0 2023-09-21T12:54:02.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.320+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c1a1240 con 0x7f7f2c100df0 2023-09-21T12:54:02.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.321+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c10c600 con 0x7f7f2c100df0 2023-09-21T12:54:02.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.325+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f7f1c00cc50 con 0x7f7f2c100df0 2023-09-21T12:54:02.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.326+0000 7f7f28ff9700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 0x7f7f140a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:02.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.326+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7f1c014070 con 0x7f7f2c100df0 2023-09-21T12:54:02.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.326+0000 7f7f2affd700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 0x7f7f140a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:02.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.327+0000 7f7f2affd700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 0x7f7f140a2bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b580 tx=0x7f7f2001a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:02.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.330+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7f1c095850 con 0x7f7f2c100df0 2023-09-21T12:54:02.404 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:02 smithi142 ceph-mon[97663]: Deploying daemon mds.a on smithi142 2023-09-21T12:54:02.405 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:02 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6838/445702531,v1:172.21.15.142:6839/445702531] up:boot 2023-09-21T12:54:02.405 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:02 smithi142 ceph-mon[97663]: fsmap 10 up:standby 2023-09-21T12:54:02.405 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:02 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:54:02.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:02 smithi156 ceph-mon[134078]: Deploying daemon mds.a on smithi142 2023-09-21T12:54:02.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:02 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6838/445702531,v1:172.21.15.142:6839/445702531] up:boot 2023-09-21T12:54:02.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:02 smithi156 ceph-mon[134078]: fsmap 10 up:standby 2023-09-21T12:54:02.407 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:02 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:54:02.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:02 smithi160 ceph-mon[134450]: Deploying daemon mds.a on smithi142 2023-09-21T12:54:02.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:02 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6838/445702531,v1:172.21.15.142:6839/445702531] up:boot 2023-09-21T12:54:02.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:02 smithi160 ceph-mon[134450]: fsmap 10 up:standby 2023-09-21T12:54:02.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:02 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:54:02.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.594+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f2c10c810 con 0x7f7f2c100df0 2023-09-21T12:54:02.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.595+0000 7f7f28ff9700 1 -- 172.21.15.142:0/2745550141 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8468 (secure 0 0 0) 0x7f7f1c003dd0 con 0x7f7f2c100df0 2023-09-21T12:54:02.594 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:02.594 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24535,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-21T12:54:02.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 msgr2=0x7f7f140a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 0x7f7f140a2bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000b580 tx=0x7f7f2001a040 comp rx=0 tx=0).stop 2023-09-21T12:54:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 msgr2=0x7f7f2c198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00e970 tx=0x7f7f1c00ec80 comp rx=0 tx=0).stop 2023-09-21T12:54:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 shutdown_connections 2023-09-21T12:54:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7f140a0710 0x7f7f140a2bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f2c102980 0x7f7f2c1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7f2c100df0 0x7f7f2c198c70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 --2- 172.21.15.142:0/2745550141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7f2c101fe0 0x7f7f2c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 >> 172.21.15.142:0/2745550141 conn(0x7f7f2c0fc320 msgr2=0x7f7f2c0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:02.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 shutdown_connections 2023-09-21T12:54:02.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:02.597+0000 7f7f31bff700 1 -- 172.21.15.142:0/2745550141 wait complete. 2023-09-21T12:54:02.599 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 11 2023-09-21T12:54:03.319 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:03 smithi142 ceph-mon[97663]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:03.320 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2745550141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:03.320 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:03 smithi142 systemd[1]: Starting Ceph mds.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:54:03.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:03 smithi156 ceph-mon[134078]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:03.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2745550141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:03.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:03 smithi160 ceph-mon[134450]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:03.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2745550141' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:04.046 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:03 smithi142 podman[149020]: 2023-09-21T12:54:04.416 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:04 smithi142 bash[149020]: 0078e2cd103f23ac1a95ba0ec6e0a89ab91529a99ca0535131bf64dee4bdd9b9 2023-09-21T12:54:04.416 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:04 smithi142 ceph-mds[149060]: -- 172.21.15.142:0/4035103985 <== mon.0 v2:172.21.15.142:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5630dbf131e0 con 0x5630dbee9000 2023-09-21T12:54:04.417 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:04 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: starting mds.a at 2023-09-21T12:54:04.417 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 12:54:04 smithi142 systemd[1]: Started Ceph mds.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:54:04.617 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:54:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 -- 172.21.15.142:0/3125870330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80100de0 msgr2=0x7eff80101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:04.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 --2- 172.21.15.142:0/3125870330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80100de0 0x7eff80101200 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7eff700099c0 tx=0x7eff70009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 -- 172.21.15.142:0/3125870330 shutdown_connections 2023-09-21T12:54:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 --2- 172.21.15.142:0/3125870330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80100de0 0x7eff80101200 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 --2- 172.21.15.142:0/3125870330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff80102970 0x7eff80109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 --2- 172.21.15.142:0/3125870330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80101fd0 0x7eff80102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 -- 172.21.15.142:0/3125870330 >> 172.21.15.142:0/3125870330 conn(0x7eff800fc310 msgr2=0x7eff800fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.821+0000 7eff853ff700 1 -- 172.21.15.142:0/3125870330 shutdown_connections 2023-09-21T12:54:04.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.822+0000 7eff853ff700 1 -- 172.21.15.142:0/3125870330 wait complete. 2023-09-21T12:54:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.822+0000 7eff853ff700 1 Processor -- start 2023-09-21T12:54:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 -- start start 2023-09-21T12:54:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:04.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80101fd0 0x7eff80196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:04.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff80102970 0x7eff8019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:04.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019e600 con 0x7eff80101fd0 2023-09-21T12:54:04.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019e740 con 0x7eff80100de0 2023-09-21T12:54:04.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff853ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8019e8d0 con 0x7eff80102970 2023-09-21T12:54:04.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:04.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80101fd0 0x7eff80196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:04.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55844/0 (socket says 172.21.15.142:55844) 2023-09-21T12:54:04.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7effd700 1 -- 172.21.15.142:0/2708127909 learned_addr learned my addr 172.21.15.142:0/2708127909 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:04.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7effd700 1 -- 172.21.15.142:0/2708127909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff80102970 msgr2=0x7eff8019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:04.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.823+0000 7eff7effd700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff80102970 0x7eff8019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff7effd700 1 -- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80101fd0 msgr2=0x7eff80196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:04.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff7effd700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80101fd0 0x7eff80196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:04.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff7effd700 1 -- 172.21.15.142:0/2708127909 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74009520 con 0x7eff80100de0 2023-09-21T12:54:04.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff7effd700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff700058e0 tx=0x7eff7000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:04.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7001d070 con 0x7eff80100de0 2023-09-21T12:54:04.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff70005510 con 0x7eff80100de0 2023-09-21T12:54:04.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff700095f0 con 0x7eff80100de0 2023-09-21T12:54:04.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff70004bd0 con 0x7eff80100de0 2023-09-21T12:54:04.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.824+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8019ede0 con 0x7eff80100de0 2023-09-21T12:54:04.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.825+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8010c5f0 con 0x7eff80100de0 2023-09-21T12:54:04.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.827+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7eff7000fbb0 con 0x7eff80100de0 2023-09-21T12:54:04.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.828+0000 7eff67fff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 0x7eff680a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:04.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.828+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7eff700ccbe0 con 0x7eff80100de0 2023-09-21T12:54:04.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.829+0000 7eff7e7fc700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 0x7eff680a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:04.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.829+0000 7eff7e7fc700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 0x7eff680a2b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff74009df0 tx=0x7eff74009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:04.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:04.830+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7eff70096ba0 con 0x7eff80100de0 2023-09-21T12:54:05.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.073+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff80107d00 con 0x7eff80100de0 2023-09-21T12:54:05.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.074+0000 7eff67fff700 1 -- 172.21.15.142:0/2708127909 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9263 (secure 0 0 0) 0x7eff7009a1c0 con 0x7eff80100de0 2023-09-21T12:54:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:05.074 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24535,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[]} 2023-09-21T12:54:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 msgr2=0x7eff680a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 0x7eff680a2b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7eff74009df0 tx=0x7eff74009260 comp rx=0 tx=0).stop 2023-09-21T12:54:05.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 msgr2=0x7eff80196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff700058e0 tx=0x7eff7000f690 comp rx=0 tx=0).stop 2023-09-21T12:54:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 shutdown_connections 2023-09-21T12:54:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7eff680a0690 0x7eff680a2b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:05.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff80102970 0x7eff8019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7eff80100de0 0x7eff80196a80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 --2- 172.21.15.142:0/2708127909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7eff80101fd0 0x7eff80196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.076+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 >> 172.21.15.142:0/2708127909 conn(0x7eff800fc310 msgr2=0x7eff800fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.077+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 shutdown_connections 2023-09-21T12:54:05.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:05.077+0000 7eff853ff700 1 -- 172.21.15.142:0/2708127909 wait complete. 2023-09-21T12:54:05.079 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 12 2023-09-21T12:54:05.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:boot 2023-09-21T12:54:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: fsmap 11 up:standby 2023-09-21T12:54:05.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:54:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:05.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: Deploying daemon mds.b on smithi156 2023-09-21T12:54:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:05.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2708127909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:05.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:boot 2023-09-21T12:54:05.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: fsmap 11 up:standby 2023-09-21T12:54:05.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:54:05.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:05.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:05.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:05.418 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: Deploying daemon mds.b on smithi156 2023-09-21T12:54:05.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:05.419 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2708127909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:05.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:boot 2023-09-21T12:54:05.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: fsmap 11 up:standby 2023-09-21T12:54:05.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:54:05.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:05.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-21T12:54:05.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-21T12:54:05.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:05.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: Deploying daemon mds.b on smithi156 2023-09-21T12:54:05.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:05.440 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:05 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2708127909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:06.151 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:05 smithi156 systemd[1]: Starting Ceph mds.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T12:54:06.405 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:06 smithi156 podman[170428]: 2023-09-21T12:54:06.905 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:06 smithi156 ceph-mds[170468]: -- 172.21.15.156:0/4229205055 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56384aa531e0 con 0x56384aa28c00 2023-09-21T12:54:06.905 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: starting mds.b at 2023-09-21T12:54:06.906 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:06 smithi156 bash[170428]: a93b787f7a5170de84a94676a234e438182cd7869a6f947908d508efdf33f36e 2023-09-21T12:54:06.906 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:06 smithi156 systemd[1]: Started Ceph mds.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T12:54:07.096 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:54:07.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 -- 172.21.15.142:0/3052629999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554100df0 msgr2=0x7fa554101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3052629999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554100df0 0x7fa554101210 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa544009920 tx=0x7fa544009c30 comp rx=0 tx=0).stop 2023-09-21T12:54:07.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 -- 172.21.15.142:0/3052629999 shutdown_connections 2023-09-21T12:54:07.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3052629999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554100df0 0x7fa554101210 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3052629999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554102980 0x7fa554109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3052629999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554101fe0 0x7fa554102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 -- 172.21.15.142:0/3052629999 >> 172.21.15.142:0/3052629999 conn(0x7fa5540fc320 msgr2=0x7fa5540fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 -- 172.21.15.142:0/3052629999 shutdown_connections 2023-09-21T12:54:07.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.301+0000 7fa5591ff700 1 -- 172.21.15.142:0/3052629999 wait complete. 2023-09-21T12:54:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 Processor -- start 2023-09-21T12:54:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 -- start start 2023-09-21T12:54:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554101fe0 0x7fa5541992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 0x7fa5541a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.302+0000 7fa5591ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541a08f0 con 0x7fa554102980 2023-09-21T12:54:07.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa5591ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541a0a30 con 0x7fa554101fe0 2023-09-21T12:54:07.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa5591ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5541a0bc0 con 0x7fa554100df0 2023-09-21T12:54:07.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59664/0 (socket says 172.21.15.142:59664) 2023-09-21T12:54:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 -- 172.21.15.142:0/3585874634 learned_addr learned my addr 172.21.15.142:0/3585874634 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa55259c700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554101fe0 0x7fa5541992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa55359e700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 0x7fa5541a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 -- 172.21.15.142:0/3585874634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554101fe0 msgr2=0x7fa5541992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554101fe0 0x7fa5541992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 -- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 msgr2=0x7fa5541a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 0x7fa5541a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 -- 172.21.15.142:0/3585874634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5480095f0 con 0x7fa554100df0 2023-09-21T12:54:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa55359e700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 0x7fa5541a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:07.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.303+0000 7fa552d9d700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa544009230 tx=0x7fa54400b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.304+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54401c070 con 0x7fa554100df0 2023-09-21T12:54:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.304+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa54400f7d0 con 0x7fa554100df0 2023-09-21T12:54:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.304+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa54c009c40 con 0x7fa554100df0 2023-09-21T12:54:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.304+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa544004990 con 0x7fa554100df0 2023-09-21T12:54:07.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.304+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa544009520 con 0x7fa554100df0 2023-09-21T12:54:07.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.305+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55410c650 con 0x7fa554100df0 2023-09-21T12:54:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.307+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa544020070 con 0x7fa554100df0 2023-09-21T12:54:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.308+0000 7fa53bfff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 0x7fa53c0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.308+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa5440cca80 con 0x7fa554100df0 2023-09-21T12:54:07.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.308+0000 7fa55259c700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 0x7fa53c0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.309+0000 7fa55259c700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 0x7fa53c0a2b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa548005fd0 tx=0x7fa548009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:07.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.314+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa544096a40 con 0x7fa554100df0 2023-09-21T12:54:07.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.581+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5541a1080 con 0x7fa554100df0 2023-09-21T12:54:07.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.582+0000 7fa53bfff700 1 -- 172.21.15.142:0/3585874634 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10058 (secure 0 0 0) 0x7fa54409a060 con 0x7fa554100df0 2023-09-21T12:54:07.582 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:07.582 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24502,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24533,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24535,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24559,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24578,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-09-21T12:54:07.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.584+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 msgr2=0x7fa53c0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.584+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 0x7fa53c0a2b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa548005fd0 tx=0x7fa548009310 comp rx=0 tx=0).stop 2023-09-21T12:54:07.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 msgr2=0x7fa554198d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa544009230 tx=0x7fa54400b790 comp rx=0 tx=0).stop 2023-09-21T12:54:07.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 shutdown_connections 2023-09-21T12:54:07.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa53c0a0690 0x7fa53c0a2b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa554102980 0x7fa5541a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa554100df0 0x7fa554198d70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 --2- 172.21.15.142:0/3585874634 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa554101fe0 0x7fa5541992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 >> 172.21.15.142:0/3585874634 conn(0x7fa5540fc320 msgr2=0x7fa5540fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:07.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 shutdown_connections 2023-09-21T12:54:07.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.585+0000 7fa5591ff700 1 -- 172.21.15.142:0/3585874634 wait complete. 2023-09-21T12:54:07.587 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 13 2023-09-21T12:54:07.604 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:54:07.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 -- 172.21.15.142:0/3797180814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020102970 msgr2=0x7fd020109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 --2- 172.21.15.142:0/3797180814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020102970 0x7fd020109220 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd01800b0a0 tx=0x7fd01800b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 -- 172.21.15.142:0/3797180814 shutdown_connections 2023-09-21T12:54:07.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 --2- 172.21.15.142:0/3797180814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 0x7fd020101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 --2- 172.21.15.142:0/3797180814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020102970 0x7fd020109220 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 --2- 172.21.15.142:0/3797180814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020101fd0 0x7fd020102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 -- 172.21.15.142:0/3797180814 >> 172.21.15.142:0/3797180814 conn(0x7fd0200fc310 msgr2=0x7fd0200fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:07.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 -- 172.21.15.142:0/3797180814 shutdown_connections 2023-09-21T12:54:07.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.814+0000 7fd026fff700 1 -- 172.21.15.142:0/3797180814 wait complete. 2023-09-21T12:54:07.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.815+0000 7fd026fff700 1 Processor -- start 2023-09-21T12:54:07.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.815+0000 7fd026fff700 1 -- start start 2023-09-21T12:54:07.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 0x7fd020074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020102970 0x7fd020073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020073eb0 con 0x7fd020100de0 2023-09-21T12:54:07.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020074020 con 0x7fd020102970 2023-09-21T12:54:07.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd026fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201a0bf0 con 0x7fd020101fd0 2023-09-21T12:54:07.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd024d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 0x7fd020074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59682/0 (socket says 172.21.15.142:59682) 2023-09-21T12:54:07.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 -- 172.21.15.142:0/179551102 learned_addr learned my addr 172.21.15.142:0/179551102 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:07.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd02559c700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020102970 0x7fd020073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 -- 172.21.15.142:0/179551102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020102970 msgr2=0x7fd020073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020102970 0x7fd020073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 -- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 msgr2=0x7fd020074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:07.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 0x7fd020074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 -- 172.21.15.142:0/179551102 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018009d00 con 0x7fd020101fd0 2023-09-21T12:54:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.816+0000 7fd01ffff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00e9a0 tx=0x7fd00c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.817+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c009790 con 0x7fd020101fd0 2023-09-21T12:54:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.817+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd00c010430 con 0x7fd020101fd0 2023-09-21T12:54:07.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.817+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0201a0ed0 con 0x7fd020101fd0 2023-09-21T12:54:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.817+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00c018680 con 0x7fd020101fd0 2023-09-21T12:54:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.817+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0201a1350 con 0x7fd020101fd0 2023-09-21T12:54:07.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.818+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0201082e0 con 0x7fd020101fd0 2023-09-21T12:54:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.820+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fd00c0105a0 con 0x7fd020101fd0 2023-09-21T12:54:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.821+0000 7fd01dffb700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 0x7fd0100a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:07.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.821+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd00c014070 con 0x7fd020101fd0 2023-09-21T12:54:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.821+0000 7fd024d9b700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 0x7fd0100a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.822+0000 7fd024d9b700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 0x7fd0100a2bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd020101e30 tx=0x7fd014009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:07.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:07.823+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd00c095ad0 con 0x7fd020101fd0 2023-09-21T12:54:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:07.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:boot 2023-09-21T12:54:07.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: fsmap 12 up:standby 2023-09-21T12:54:07.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:07 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:54:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:07.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:boot 2023-09-21T12:54:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: fsmap 12 up:standby 2023-09-21T12:54:07.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:07 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:54:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:07.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:07.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:boot 2023-09-21T12:54:07.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: fsmap 12 up:standby 2023-09-21T12:54:07.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:07 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:54:08.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.050+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd0200008d0 con 0x7fd020101fd0 2023-09-21T12:54:08.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.051+0000 7fd01dffb700 1 -- 172.21.15.142:0/179551102 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18470 (secure 0 0 0) 0x7fd00c0990f0 con 0x7fd020101fd0 2023-09-21T12:54:08.050 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:08.051 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":80,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:53:25.323578+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:08.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.053+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 msgr2=0x7fd0100a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.053+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 0x7fd0100a2bd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd020101e30 tx=0x7fd014009260 comp rx=0 tx=0).stop 2023-09-21T12:54:08.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.053+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 msgr2=0x7fd0200731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.053+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00e9a0 tx=0x7fd00c00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 shutdown_connections 2023-09-21T12:54:08.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0100a0710 0x7fd0100a2bd0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd020100de0 0x7fd020074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd020102970 0x7fd020073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 --2- 172.21.15.142:0/179551102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd020101fd0 0x7fd0200731d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 >> 172.21.15.142:0/179551102 conn(0x7fd0200fc310 msgr2=0x7fd020105420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:08.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 shutdown_connections 2023-09-21T12:54:08.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.054+0000 7fd026fff700 1 -- 172.21.15.142:0/179551102 wait complete. 2023-09-21T12:54:08.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:54:08.074 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:54:08.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 -- 172.21.15.142:0/1552550474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800ff640 msgr2=0x7f47800ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 --2- 172.21.15.142:0/1552550474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800ff640 0x7f47800ffa60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4770009990 tx=0x7f4770009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 -- 172.21.15.142:0/1552550474 shutdown_connections 2023-09-21T12:54:08.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 --2- 172.21.15.142:0/1552550474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4780100960 0x7f4780100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 --2- 172.21.15.142:0/1552550474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800ff640 0x7f47800ffa60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 --2- 172.21.15.142:0/1552550474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47800fffa0 0x7f4780100420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.291+0000 7f4784fff700 1 -- 172.21.15.142:0/1552550474 >> 172.21.15.142:0/1552550474 conn(0x7f47800fb240 msgr2=0x7f47800fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:08.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.292+0000 7f4784fff700 1 -- 172.21.15.142:0/1552550474 shutdown_connections 2023-09-21T12:54:08.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.292+0000 7f4784fff700 1 -- 172.21.15.142:0/1552550474 wait complete. 2023-09-21T12:54:08.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 Processor -- start 2023-09-21T12:54:08.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 -- start start 2023-09-21T12:54:08.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800fffa0 0x7f47801991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4780100960 0x7f47801a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a0810 con 0x7f4780100960 2023-09-21T12:54:08.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a0980 con 0x7f47800fffa0 2023-09-21T12:54:08.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f4784fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47801a0b40 con 0x7f47800ff640 2023-09-21T12:54:08.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f477e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f477ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4780100960 0x7f47801a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f477dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800fffa0 0x7f47801991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f477e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59698/0 (socket says 172.21.15.142:59698) 2023-09-21T12:54:08.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.293+0000 7f477e59c700 1 -- 172.21.15.142:0/3316410310 learned_addr learned my addr 172.21.15.142:0/3316410310 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:08.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 -- 172.21.15.142:0/3316410310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800fffa0 msgr2=0x7f47801991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800fffa0 0x7f47801991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 -- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4780100960 msgr2=0x7f47801a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4780100960 0x7f47801a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 -- 172.21.15.142:0/3316410310 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700095f0 con 0x7f47800ff640 2023-09-21T12:54:08.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f477e59c700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4770000c00 tx=0x7f47700057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:08.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477001d070 con 0x7f47800ff640 2023-09-21T12:54:08.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47801a0dc0 con 0x7f47800ff640 2023-09-21T12:54:08.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f477000fb90 con 0x7f47800ff640 2023-09-21T12:54:08.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700173f0 con 0x7f47800ff640 2023-09-21T12:54:08.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.294+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47801a11c0 con 0x7f47800ff640 2023-09-21T12:54:08.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.295+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f478010a420 con 0x7f47800ff640 2023-09-21T12:54:08.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.297+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f4770021410 con 0x7f47800ff640 2023-09-21T12:54:08.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.298+0000 7f476f7fe700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 0x7f47680a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.299+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f47700cd390 con 0x7f47800ff640 2023-09-21T12:54:08.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.299+0000 7f477dd9b700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 0x7f47680a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.299+0000 7f477dd9b700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 0x7f47680a2b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f478019a1a0 tx=0x7f4774009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:08.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.300+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4770097350 con 0x7f47800ff640 2023-09-21T12:54:08.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.517+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f478010ea00 con 0x7f47800ff640 2023-09-21T12:54:08.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.518+0000 7f476f7fe700 1 -- 172.21.15.142:0/3316410310 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f477009a970 con 0x7f47800ff640 2023-09-21T12:54:08.517 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:54:08.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 msgr2=0x7f47680a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 0x7f47680a2b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f478019a1a0 tx=0x7f4774009260 comp rx=0 tx=0).stop 2023-09-21T12:54:08.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 msgr2=0x7f4780198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4770000c00 tx=0x7f47700057a0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 shutdown_connections 2023-09-21T12:54:08.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47680a0640 0x7f47680a2b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4780100960 0x7f47801a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47800ff640 0x7f4780198ca0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 --2- 172.21.15.142:0/3316410310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47800fffa0 0x7f47801991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.520+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 >> 172.21.15.142:0/3316410310 conn(0x7f47800fb240 msgr2=0x7f47800fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:08.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.521+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 shutdown_connections 2023-09-21T12:54:08.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.521+0000 7f4784fff700 1 -- 172.21.15.142:0/3316410310 wait complete. 2023-09-21T12:54:08.539 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-21T12:54:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 -- 172.21.15.142:0/1310046715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458102980 msgr2=0x7f4458109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 --2- 172.21.15.142:0/1310046715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458102980 0x7f4458109230 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f445000b0d0 tx=0x7f445000b3e0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 -- 172.21.15.142:0/1310046715 shutdown_connections 2023-09-21T12:54:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 --2- 172.21.15.142:0/1310046715 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458102980 0x7f4458109230 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 --2- 172.21.15.142:0/1310046715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458100df0 0x7f4458101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 --2- 172.21.15.142:0/1310046715 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458101fe0 0x7f4458102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 -- 172.21.15.142:0/1310046715 >> 172.21.15.142:0/1310046715 conn(0x7f44580fc320 msgr2=0x7f44580fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:08.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 -- 172.21.15.142:0/1310046715 shutdown_connections 2023-09-21T12:54:08.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.748+0000 7f445efff700 1 -- 172.21.15.142:0/1310046715 wait complete. 2023-09-21T12:54:08.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.749+0000 7f445efff700 1 Processor -- start 2023-09-21T12:54:08.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.749+0000 7f445efff700 1 -- start start 2023-09-21T12:54:08.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458101fe0 0x7f4458199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458102980 0x7f44581a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581a08d0 con 0x7f4458102980 2023-09-21T12:54:08.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581a0a10 con 0x7f4458100df0 2023-09-21T12:54:08.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445efff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44581a0ba0 con 0x7f4458101fe0 2023-09-21T12:54:08.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55938/0 (socket says 172.21.15.142:55938) 2023-09-21T12:54:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 -- 172.21.15.142:0/2944195312 learned_addr learned my addr 172.21.15.142:0/2944195312 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f4457fff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458101fe0 0x7f4458199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445d59c700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458102980 0x7f44581a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 -- 172.21.15.142:0/2944195312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458101fe0 msgr2=0x7f4458199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458101fe0 0x7f4458199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 -- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458102980 msgr2=0x7f44581a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458102980 0x7f44581a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.750+0000 7f445cd9b700 1 -- 172.21.15.142:0/2944195312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4450009d00 con 0x7f4458100df0 2023-09-21T12:54:08.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f445cd9b700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f444c00d980 tx=0x7f444c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c004020 con 0x7f4458100df0 2023-09-21T12:54:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44581a0e80 con 0x7f4458100df0 2023-09-21T12:54:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f444c009730 con 0x7f4458100df0 2023-09-21T12:54:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c003a30 con 0x7f4458100df0 2023-09-21T12:54:08.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.751+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44581a12a0 con 0x7f4458100df0 2023-09-21T12:54:08.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.752+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445810c680 con 0x7f4458100df0 2023-09-21T12:54:08.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.754+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f444c0098a0 con 0x7f4458100df0 2023-09-21T12:54:08.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.755+0000 7f4455ffb700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 0x7f44480a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:08.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.755+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f444c0cb400 con 0x7f4458100df0 2023-09-21T12:54:08.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.755+0000 7f4457fff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 0x7f44480a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:08.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.756+0000 7f4457fff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 0x7f44480a2b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4444009c60 tx=0x7f4444009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:08.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.758+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f444c095330 con 0x7f4458100df0 2023-09-21T12:54:08.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:08 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3585874634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:08 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/179551102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:08 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3316410310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:54:08.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:08 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3585874634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:08 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/179551102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:08 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3316410310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:54:08.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:08 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3585874634' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:08 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/179551102' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:08.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:08 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3316410310' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:54:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.988+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f445810c870 con 0x7f4458100df0 2023-09-21T12:54:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.989+0000 7f4455ffb700 1 -- 172.21.15.142:0/2944195312 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f444c098950 con 0x7f4458100df0 2023-09-21T12:54:08.989 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:08.989 INFO:teuthology.orchestra.run.smithi142.stdout:[ 2023-09-21T12:54:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T12:54:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: "poolnum": 1, 2023-09-21T12:54:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: "poolname": ".mgr" 2023-09-21T12:54:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:54:08.990 INFO:teuthology.orchestra.run.smithi142.stdout:] 2023-09-21T12:54:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 msgr2=0x7f44480a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 0x7f44480a2b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4444009c60 tx=0x7f4444009260 comp rx=0 tx=0).stop 2023-09-21T12:54:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 msgr2=0x7f4458198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f444c00d980 tx=0x7f444c00dc90 comp rx=0 tx=0).stop 2023-09-21T12:54:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 shutdown_connections 2023-09-21T12:54:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f44480a0690 0x7f44480a2b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4458102980 0x7f44581a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4458100df0 0x7f4458198d50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 --2- 172.21.15.142:0/2944195312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4458101fe0 0x7f4458199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 >> 172.21.15.142:0/2944195312 conn(0x7f44580fc320 msgr2=0x7f44581077c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 shutdown_connections 2023-09-21T12:54:08.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:08.992+0000 7f445efff700 1 -- 172.21.15.142:0/2944195312 wait complete. 2023-09-21T12:54:09.011 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-21T12:54:09.012 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-21T12:54:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 -- 172.21.15.142:0/1119983521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc108cc0 msgr2=0x7f32cc10b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1119983521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc108cc0 0x7f32cc10b130 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f32c400b0a0 tx=0x7f32c400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 -- 172.21.15.142:0/1119983521 shutdown_connections 2023-09-21T12:54:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1119983521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc108cc0 0x7f32cc10b130 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1119983521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc074dc0 0x7f32cc073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1119983521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc0737e0 0x7f32cc073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 -- 172.21.15.142:0/1119983521 >> 172.21.15.142:0/1119983521 conn(0x7f32cc0fc360 msgr2=0x7f32cc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 -- 172.21.15.142:0/1119983521 shutdown_connections 2023-09-21T12:54:09.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.246+0000 7f32d1bff700 1 -- 172.21.15.142:0/1119983521 wait complete. 2023-09-21T12:54:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.247+0000 7f32d1bff700 1 Processor -- start 2023-09-21T12:54:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.247+0000 7f32d1bff700 1 -- start start 2023-09-21T12:54:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc074dc0 0x7f32cc199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc108cc0 0x7f32cc1a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1a0950 con 0x7f32cc0737e0 2023-09-21T12:54:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1a0a90 con 0x7f32cc074dc0 2023-09-21T12:54:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32d1bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32cc1a0c20 con 0x7f32cc108cc0 2023-09-21T12:54:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55860/0 (socket says 172.21.15.142:55860) 2023-09-21T12:54:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 -- 172.21.15.142:0/1417034807 learned_addr learned my addr 172.21.15.142:0/1417034807 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cbfff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc108cc0 0x7f32cc1a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32caffd700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc074dc0 0x7f32cc199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 -- 172.21.15.142:0/1417034807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc108cc0 msgr2=0x7f32cc1a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc108cc0 0x7f32cc1a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 -- 172.21.15.142:0/1417034807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc074dc0 msgr2=0x7f32cc199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc074dc0 0x7f32cc199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 -- 172.21.15.142:0/1417034807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c0009520 con 0x7f32cc0737e0 2023-09-21T12:54:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.248+0000 7f32cb7fe700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00e9a0 tx=0x7f32bc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.249+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc009790 con 0x7f32cc0737e0 2023-09-21T12:54:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.249+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32bc010430 con 0x7f32cc0737e0 2023-09-21T12:54:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.249+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c4009d00 con 0x7f32cc0737e0 2023-09-21T12:54:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.249+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc018680 con 0x7f32cc0737e0 2023-09-21T12:54:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.249+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32cc1a11d0 con 0x7f32cc0737e0 2023-09-21T12:54:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.250+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32cc1073c0 con 0x7f32cc0737e0 2023-09-21T12:54:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.252+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f32bc0105a0 con 0x7f32cc0737e0 2023-09-21T12:54:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.253+0000 7f32c8ff9700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 0x7f32b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.253+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f32bc014070 con 0x7f32cc0737e0 2023-09-21T12:54:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.253+0000 7f32caffd700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 0x7f32b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.254+0000 7f32caffd700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 0x7f32b40a2b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009df0 tx=0x7f32c0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.257+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f32bc051e10 con 0x7f32cc0737e0 2023-09-21T12:54:09.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:09.476+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f32cc10e830 con 0x7f32cc0737e0 2023-09-21T12:54:10.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:09 smithi156 ceph-mon[134078]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:09 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2944195312' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-21T12:54:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:09 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:09 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:09 smithi142 ceph-mon[97663]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:10.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:09 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2944195312' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-21T12:54:10.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:09 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:09 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:09 smithi160 ceph-mon[134450]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:10.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:09 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2944195312' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-21T12:54:10.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:09 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:09 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:10.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.443+0000 7f32c8ff9700 1 -- 172.21.15.142:0/1417034807 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32bc095850 con 0x7f32cc0737e0 2023-09-21T12:54:10.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.448+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 msgr2=0x7f32b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:10.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.448+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 0x7f32b40a2b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009df0 tx=0x7f32c0009260 comp rx=0 tx=0).stop 2023-09-21T12:54:10.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.448+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 msgr2=0x7f32cc198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:10.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.448+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00e9a0 tx=0x7f32bc00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 shutdown_connections 2023-09-21T12:54:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32b40a0640 0x7f32b40a2b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32cc0737e0 0x7f32cc198dd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32cc108cc0 0x7f32cc1a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 --2- 172.21.15.142:0/1417034807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32cc074dc0 0x7f32cc199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 >> 172.21.15.142:0/1417034807 conn(0x7f32cc0fc360 msgr2=0x7f32cc0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 shutdown_connections 2023-09-21T12:54:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.449+0000 7f32d1bff700 1 -- 172.21.15.142:0/1417034807 wait complete. 2023-09-21T12:54:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' created 2023-09-21T12:54:10.470 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-21T12:54:10.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.680+0000 7fee629ff700 1 -- 172.21.15.142:0/3163831718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c073840 msgr2=0x7fee5c073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:10.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.680+0000 7fee629ff700 1 --2- 172.21.15.142:0/3163831718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c073840 0x7fee5c073cc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee50009990 tx=0x7fee50009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 -- 172.21.15.142:0/3163831718 shutdown_connections 2023-09-21T12:54:10.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 --2- 172.21.15.142:0/3163831718 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c10d3a0 0x7fee5c10f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 --2- 172.21.15.142:0/3163831718 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c074e20 0x7fee5c073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 --2- 172.21.15.142:0/3163831718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c073840 0x7fee5c073cc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 -- 172.21.15.142:0/3163831718 >> 172.21.15.142:0/3163831718 conn(0x7fee5c0fc320 msgr2=0x7fee5c0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:10.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 -- 172.21.15.142:0/3163831718 shutdown_connections 2023-09-21T12:54:10.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.681+0000 7fee629ff700 1 -- 172.21.15.142:0/3163831718 wait complete. 2023-09-21T12:54:10.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.682+0000 7fee629ff700 1 Processor -- start 2023-09-21T12:54:10.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.682+0000 7fee629ff700 1 -- start start 2023-09-21T12:54:10.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:10.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c074e20 0x7fee5c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:10.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c10d3a0 0x7fee5c1a4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:10.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a4ce0 con 0x7fee5c074e20 2023-09-21T12:54:10.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a4e20 con 0x7fee5c073840 2023-09-21T12:54:10.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee629ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5c1a4fb0 con 0x7fee5c10d3a0 2023-09-21T12:54:10.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:10.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55954/0 (socket says 172.21.15.142:55954) 2023-09-21T12:54:10.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c074e20 0x7fee5c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:10.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5bfff700 1 -- 172.21.15.142:0/95238031 learned_addr learned my addr 172.21.15.142:0/95238031 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:10.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee60f9c700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c10d3a0 0x7fee5c1a4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:10.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5bfff700 1 -- 172.21.15.142:0/95238031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c10d3a0 msgr2=0x7fee5c1a4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:10.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.683+0000 7fee5bfff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c10d3a0 0x7fee5c1a4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee5bfff700 1 -- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c074e20 msgr2=0x7fee5c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:10.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee5bfff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c074e20 0x7fee5c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:10.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee5bfff700 1 -- 172.21.15.142:0/95238031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500095f0 con 0x7fee5c073840 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee5bfff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e9a0 tx=0x7fee4c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c009790 con 0x7fee5c073840 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee5c1a5290 con 0x7fee5c073840 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee4c00cbd0 con 0x7fee5c073840 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c018680 con 0x7fee5c073840 2023-09-21T12:54:10.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.684+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee5c1a57a0 con 0x7fee5c073840 2023-09-21T12:54:10.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.685+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee5c102ef0 con 0x7fee5c073840 2023-09-21T12:54:10.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.687+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fee4c00cd40 con 0x7fee5c073840 2023-09-21T12:54:10.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.689+0000 7fee597fa700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 0x7fee440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:10.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.689+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fee4c014070 con 0x7fee5c073840 2023-09-21T12:54:10.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.689+0000 7fee5b7fe700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 0x7fee440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:10.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.690+0000 7fee5b7fe700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 0x7fee440a2b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee5000b2e0 tx=0x7fee50005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:10.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.691+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fee4c095ce0 con 0x7fee5c073840 2023-09-21T12:54:10.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:10.911+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fee5c112c10 con 0x7fee5c073840 2023-09-21T12:54:11.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.451+0000 7fee597fa700 1 -- 172.21.15.142:0/95238031 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7fee4c099300 con 0x7fee5c073840 2023-09-21T12:54:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 msgr2=0x7fee440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 0x7fee440a2b00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fee5000b2e0 tx=0x7fee50005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 msgr2=0x7fee5c19d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00e9a0 tx=0x7fee4c00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 shutdown_connections 2023-09-21T12:54:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fee440a0640 0x7fee440a2b00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee5c10d3a0 0x7fee5c1a4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fee5c073840 0x7fee5c19d160 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 --2- 172.21.15.142:0/95238031 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fee5c074e20 0x7fee5c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 >> 172.21.15.142:0/95238031 conn(0x7fee5c0fc320 msgr2=0x7fee5c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 shutdown_connections 2023-09-21T12:54:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.464+0000 7fee629ff700 1 -- 172.21.15.142:0/95238031 wait complete. 2023-09-21T12:54:11.470 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' created 2023-09-21T12:54:11.489 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-21T12:54:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-21T12:54:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:11.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:11.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-21T12:54:11.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: osdmap e81: 12 total, 12 up, 12 in 2023-09-21T12:54:11.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:11.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:11 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/95238031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:11.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 -- 172.21.15.142:0/2485802128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 msgr2=0x7f3f40073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:11.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2485802128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40073cc0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009990 tx=0x7f3f34009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 -- 172.21.15.142:0/2485802128 shutdown_connections 2023-09-21T12:54:11.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2485802128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40074e20 0x7f3f40073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2485802128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40108cb0 0x7f3f4010b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2485802128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40073cc0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 -- 172.21.15.142:0/2485802128 >> 172.21.15.142:0/2485802128 conn(0x7f3f400fc360 msgr2=0x7f3f400fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:11.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 -- 172.21.15.142:0/2485802128 shutdown_connections 2023-09-21T12:54:11.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.702+0000 7f3f459ff700 1 -- 172.21.15.142:0/2485802128 wait complete. 2023-09-21T12:54:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 Processor -- start 2023-09-21T12:54:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 -- start start 2023-09-21T12:54:11.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40108cb0 0x7f3f401a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401a0830 con 0x7f3f40108cb0 2023-09-21T12:54:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401a09a0 con 0x7f3f40074e20 2023-09-21T12:54:11.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f459ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f401a0b60 con 0x7f3f40073840 2023-09-21T12:54:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f3effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.703+0000 7f3f3e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59768/0 (socket says 172.21.15.142:59768) 2023-09-21T12:54:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55968/0 (socket says 172.21.15.142:55968) 2023-09-21T12:54:11.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3effd700 1 -- 172.21.15.142:0/2758412702 learned_addr learned my addr 172.21.15.142:0/2758412702 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3f7fe700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40108cb0 0x7f3f401a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 -- 172.21.15.142:0/2758412702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 msgr2=0x7f3f40198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 -- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40108cb0 msgr2=0x7f3f401a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:11.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40108cb0 0x7f3f401a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 -- 172.21.15.142:0/2758412702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340095f0 con 0x7f3f40074e20 2023-09-21T12:54:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3effd700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f3e7fc700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f34000c00 tx=0x7f3f34005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3401d070 con 0x7f3f40074e20 2023-09-21T12:54:11.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f34022470 con 0x7f3f40074e20 2023-09-21T12:54:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.704+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f401a0de0 con 0x7f3f40074e20 2023-09-21T12:54:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.705+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34017650 con 0x7f3f40074e20 2023-09-21T12:54:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.705+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f401a11b0 con 0x7f3f40074e20 2023-09-21T12:54:11.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.706+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f40107360 con 0x7f3f40074e20 2023-09-21T12:54:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.708+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f3f340225e0 con 0x7f3f40074e20 2023-09-21T12:54:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.710+0000 7f3f449fd700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 0x7f3f280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:11.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.710+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f3f340cd6b0 con 0x7f3f40074e20 2023-09-21T12:54:11.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.710+0000 7f3f3effd700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 0x7f3f280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:11.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.711+0000 7f3f3effd700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 0x7f3f280a2b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f4019a1c0 tx=0x7f3f30009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:11.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.715+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3f34097380 con 0x7f3f40074e20 2023-09-21T12:54:11.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-21T12:54:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:11.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:11.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-21T12:54:11.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: osdmap e81: 12 total, 12 up, 12 in 2023-09-21T12:54:11.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:11.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:11 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/95238031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-21T12:54:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:11.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:11.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:11.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:11.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1417034807' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-21T12:54:11.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: osdmap e81: 12 total, 12 up, 12 in 2023-09-21T12:54:11.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:54:11.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:11 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/95238031' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:11.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:11.982+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3f4002d1d0 con 0x7f3f40074e20 2023-09-21T12:54:12.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.461+0000 7f3f449fd700 1 -- 172.21.15.142:0/2758412702 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3f3409a9a0 con 0x7f3f40074e20 2023-09-21T12:54:12.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.466+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 msgr2=0x7f3f280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.466+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 0x7f3f280a2b00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f4019a1c0 tx=0x7f3f30009260 comp rx=0 tx=0).stop 2023-09-21T12:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.466+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 msgr2=0x7f3f40199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.466+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3f34000c00 tx=0x7f3f34005720 comp rx=0 tx=0).stop 2023-09-21T12:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 shutdown_connections 2023-09-21T12:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3f280a0640 0x7f3f280a2b00 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3f40108cb0 0x7f3f401a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f40073840 0x7f3f40198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 --2- 172.21.15.142:0/2758412702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3f40074e20 0x7f3f40199230 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 >> 172.21.15.142:0/2758412702 conn(0x7f3f400fc360 msgr2=0x7f3f400fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:12.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 shutdown_connections 2023-09-21T12:54:12.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.467+0000 7f3f459ff700 1 -- 172.21.15.142:0/2758412702 wait complete. 2023-09-21T12:54:12.469 INFO:teuthology.orchestra.run.smithi142.stderr:new fs with metadata pool 2 and data pool 3 2023-09-21T12:54:12.487 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:54:12.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:12.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-21T12:54:12.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: osdmap e82: 12 total, 12 up, 12 in 2023-09-21T12:54:12.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2758412702' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:12 smithi160 ceph-mon[134450]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-21T12:54:12.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 -- 172.21.15.142:0/3935752459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4100df0 msgr2=0x7f01c4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/3935752459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4100df0 0x7f01c4101210 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f01b40099c0 tx=0x7f01b4009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 -- 172.21.15.142:0/3935752459 shutdown_connections 2023-09-21T12:54:12.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/3935752459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4100df0 0x7f01c4101210 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/3935752459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4102980 0x7f01c4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/3935752459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 -- 172.21.15.142:0/3935752459 >> 172.21.15.142:0/3935752459 conn(0x7f01c40fc320 msgr2=0x7f01c40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:12.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 -- 172.21.15.142:0/3935752459 shutdown_connections 2023-09-21T12:54:12.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.697+0000 7f01ca1ff700 1 -- 172.21.15.142:0/3935752459 wait complete. 2023-09-21T12:54:12.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.698+0000 7f01ca1ff700 1 Processor -- start 2023-09-21T12:54:12.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.698+0000 7f01ca1ff700 1 -- start start 2023-09-21T12:54:12.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 0x7f01c4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:12.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:12.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 0x7f01c4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:12.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4073eb0 con 0x7f01c4102980 2023-09-21T12:54:12.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c4074020 con 0x7f01c4100df0 2023-09-21T12:54:12.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01ca1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c41a0b10 con 0x7f01c4101fe0 2023-09-21T12:54:12.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:12.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 0x7f01c4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:12.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 0x7f01c4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:12.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59792/0 (socket says 172.21.15.142:59792) 2023-09-21T12:54:12.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 -- 172.21.15.142:0/1134965451 learned_addr learned my addr 172.21.15.142:0/1134965451 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 -- 172.21.15.142:0/1134965451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 msgr2=0x7f01c4074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 0x7f01c4074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 -- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 msgr2=0x7f01c4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 0x7f01c4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c2ffd700 1 -- 172.21.15.142:0/1134965451 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40095f0 con 0x7f01c4101fe0 2023-09-21T12:54:12.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c37fe700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 0x7f01c4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:12.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.699+0000 7f01c3fff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 0x7f01c4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:12.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01c2ffd700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9a0 tx=0x7f01b800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:12.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8009790 con 0x7f01c4101fe0 2023-09-21T12:54:12.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c41a0df0 con 0x7f01c4101fe0 2023-09-21T12:54:12.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b8010430 con 0x7f01c4101fe0 2023-09-21T12:54:12.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b8018680 con 0x7f01c4101fe0 2023-09-21T12:54:12.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.700+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c41a12d0 con 0x7f01c4101fe0 2023-09-21T12:54:12.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.701+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c410c650 con 0x7f01c4101fe0 2023-09-21T12:54:12.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.703+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f01b80105a0 con 0x7f01c4101fe0 2023-09-21T12:54:12.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.704+0000 7f01c0ff9700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 0x7f01ac0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:12.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.705+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f01b8014070 con 0x7f01c4101fe0 2023-09-21T12:54:12.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.705+0000 7f01c37fe700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 0x7f01ac0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:12.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.705+0000 7f01c37fe700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 0x7f01ac0a2b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009990 tx=0x7f01b401a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:12.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.707+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f01b8095b10 con 0x7f01c4101fe0 2023-09-21T12:54:12.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:12.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-21T12:54:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: osdmap e82: 12 total, 12 up, 12 in 2023-09-21T12:54:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2758412702' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:12 smithi156 ceph-mon[134078]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-21T12:54:12.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-21T12:54:12.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-21T12:54:12.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: osdmap e82: 12 total, 12 up, 12 in 2023-09-21T12:54:12.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2758412702' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-21T12:54:12.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:12 smithi142 ceph-mon[97663]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-21T12:54:12.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.927+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01c4107ca0 con 0x7f01c4101fe0 2023-09-21T12:54:12.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.930+0000 7f01c0ff9700 1 -- 172.21.15.142:0/1134965451 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22180 (secure 0 0 0) 0x7f01b8099130 con 0x7f01c4101fe0 2023-09-21T12:54:12.929 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:12.930 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:11.984669+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:12.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 msgr2=0x7f01ac0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 0x7f01ac0a2b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f01b4009990 tx=0x7f01b401a040 comp rx=0 tx=0).stop 2023-09-21T12:54:12.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 msgr2=0x7f01c40731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:12.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01b800e9a0 tx=0x7f01b800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 shutdown_connections 2023-09-21T12:54:12.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f01ac0a0690 0x7f01ac0a2b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f01c4102980 0x7f01c4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01c4100df0 0x7f01c4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 --2- 172.21.15.142:0/1134965451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01c4101fe0 0x7f01c40731d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 >> 172.21.15.142:0/1134965451 conn(0x7f01c40fc320 msgr2=0x7f01c40fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:12.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 shutdown_connections 2023-09-21T12:54:12.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:12.932+0000 7f01ca1ff700 1 -- 172.21.15.142:0/1134965451 wait complete. 2023-09-21T12:54:12.954 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:54:13.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 -- 172.21.15.142:0/3651251748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0101fd0 msgr2=0x7f38f0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 --2- 172.21.15.142:0/3651251748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0101fd0 0x7f38f0102430 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f38e00099c0 tx=0x7f38e0009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 -- 172.21.15.142:0/3651251748 shutdown_connections 2023-09-21T12:54:13.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 --2- 172.21.15.142:0/3651251748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0102970 0x7f38f0109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 --2- 172.21.15.142:0/3651251748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 --2- 172.21.15.142:0/3651251748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0101fd0 0x7f38f0102430 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.162+0000 7f38f83ff700 1 -- 172.21.15.142:0/3651251748 >> 172.21.15.142:0/3651251748 conn(0x7f38f00fc370 msgr2=0x7f38f00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:13.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.163+0000 7f38f83ff700 1 -- 172.21.15.142:0/3651251748 shutdown_connections 2023-09-21T12:54:13.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.163+0000 7f38f83ff700 1 -- 172.21.15.142:0/3651251748 wait complete. 2023-09-21T12:54:13.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 Processor -- start 2023-09-21T12:54:13.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 -- start start 2023-09-21T12:54:13.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0101fd0 0x7f38f0197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 0x7f38f019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f019e660 con 0x7f38f0102970 2023-09-21T12:54:13.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f019e7a0 con 0x7f38f0101fd0 2023-09-21T12:54:13.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f83ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f019e930 con 0x7f38f0100de0 2023-09-21T12:54:13.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 0x7f38f019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f699c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 0x7f38f019e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55914/0 (socket says 172.21.15.142:55914) 2023-09-21T12:54:13.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f699c700 1 -- 172.21.15.142:0/420696998 learned_addr learned my addr 172.21.15.142:0/420696998 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:13.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f619b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.164+0000 7f38f599a700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0101fd0 0x7f38f0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 -- 172.21.15.142:0/420696998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0101fd0 msgr2=0x7f38f0197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0101fd0 0x7f38f0197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 -- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 msgr2=0x7f38f019e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 0x7f38f019e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 -- 172.21.15.142:0/420696998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009c40 con 0x7f38f0100de0 2023-09-21T12:54:13.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f619b700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0196ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00e9c0 tx=0x7f38ec00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:13.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec004220 con 0x7f38f0100de0 2023-09-21T12:54:13.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38ec004380 con 0x7f38f0100de0 2023-09-21T12:54:13.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e00095f0 con 0x7f38f0100de0 2023-09-21T12:54:13.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec003be0 con 0x7f38f0100de0 2023-09-21T12:54:13.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.165+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f019ef90 con 0x7f38f0100de0 2023-09-21T12:54:13.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.166+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f01083d0 con 0x7f38f0100de0 2023-09-21T12:54:13.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.168+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f38ec003d40 con 0x7f38f0100de0 2023-09-21T12:54:13.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.170+0000 7f38e77fe700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 0x7f38dc0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.170+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f38ec014070 con 0x7f38f0100de0 2023-09-21T12:54:13.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.170+0000 7f38f599a700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 0x7f38dc0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.170+0000 7f38f599a700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 0x7f38dc0a2b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f38e000b580 tx=0x7f38e0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:13.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.174+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f38ec095970 con 0x7f38f0100de0 2023-09-21T12:54:13.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.400+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38f010c640 con 0x7f38f0100de0 2023-09-21T12:54:13.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.402+0000 7f38e77fe700 1 -- 172.21.15.142:0/420696998 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22180 (secure 0 0 0) 0x7f38ec098f90 con 0x7f38f0100de0 2023-09-21T12:54:13.402 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:13.402 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":83,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:11.984669+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:13.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 msgr2=0x7f38dc0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 0x7f38dc0a2b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f38e000b580 tx=0x7f38e0005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 msgr2=0x7f38f0196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0196ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38ec00e9c0 tx=0x7f38ec00ecd0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 shutdown_connections 2023-09-21T12:54:13.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f38dc0a0690 0x7f38dc0a2b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38f0102970 0x7f38f019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38f0100de0 0x7f38f0196ae0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 --2- 172.21.15.142:0/420696998 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38f0101fd0 0x7f38f0197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 >> 172.21.15.142:0/420696998 conn(0x7f38f00fc370 msgr2=0x7f38f0105510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:13.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 shutdown_connections 2023-09-21T12:54:13.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.405+0000 7f38f83ff700 1 -- 172.21.15.142:0/420696998 wait complete. 2023-09-21T12:54:13.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-21T12:54:13.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.639+0000 7fcc88dff700 1 -- 172.21.15.142:0/1257231828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84102980 msgr2=0x7fcc84109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.639+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1257231828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84102980 0x7fcc84109230 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00b0d0 tx=0x7fcc7c00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 -- 172.21.15.142:0/1257231828 shutdown_connections 2023-09-21T12:54:13.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1257231828 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84102980 0x7fcc84109230 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1257231828 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84100df0 0x7fcc84101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1257231828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84101fe0 0x7fcc84102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 -- 172.21.15.142:0/1257231828 >> 172.21.15.142:0/1257231828 conn(0x7fcc840fc360 msgr2=0x7fcc840fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:13.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 -- 172.21.15.142:0/1257231828 shutdown_connections 2023-09-21T12:54:13.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.640+0000 7fcc88dff700 1 -- 172.21.15.142:0/1257231828 wait complete. 2023-09-21T12:54:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 Processor -- start 2023-09-21T12:54:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 -- start start 2023-09-21T12:54:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 0x7fcc84199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84102980 0x7fcc841a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc841a0990 con 0x7fcc84100df0 2023-09-21T12:54:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc841a0ad0 con 0x7fcc84101fe0 2023-09-21T12:54:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.641+0000 7fcc88dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc841a0c60 con 0x7fcc84102980 2023-09-21T12:54:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc8259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 0x7fcc84199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc8259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55940/0 (socket says 172.21.15.142:55940) 2023-09-21T12:54:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc8259c700 1 -- 172.21.15.142:0/1274763646 learned_addr learned my addr 172.21.15.142:0/1274763646 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc82d9d700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84102980 0x7fcc841a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 -- 172.21.15.142:0/1274763646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84102980 msgr2=0x7fcc841a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84102980 0x7fcc841a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 -- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 msgr2=0x7fcc84198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 -- 172.21.15.142:0/1274763646 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc74009520 con 0x7fcc84101fe0 2023-09-21T12:54:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc8259c700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc81d9b700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 0x7fcc84199350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800e9f0 tx=0x7fcc7800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.642+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7800c9c0 con 0x7fcc84101fe0 2023-09-21T12:54:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.643+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc78010430 con 0x7fcc84101fe0 2023-09-21T12:54:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.643+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c009d00 con 0x7fcc84101fe0 2023-09-21T12:54:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.643+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc78018680 con 0x7fcc84101fe0 2023-09-21T12:54:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.643+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc841a1280 con 0x7fcc84101fe0 2023-09-21T12:54:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.644+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8410c6d0 con 0x7fcc84101fe0 2023-09-21T12:54:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.646+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fcc78010860 con 0x7fcc84101fe0 2023-09-21T12:54:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.648+0000 7fcc737fe700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 0x7fcc6c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.648+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcc78014070 con 0x7fcc84101fe0 2023-09-21T12:54:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.648+0000 7fcc8259c700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 0x7fcc6c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.649+0000 7fcc8259c700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 0x7fcc6c0a2b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009fd0 tx=0x7fcc74009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.652+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcc78051e10 con 0x7fcc84101fe0 2023-09-21T12:54:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: pgmap v268: 97 pgs: 10 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:13.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: osdmap e83: 12 total, 12 up, 12 in 2023-09-21T12:54:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-21T12:54:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-21T12:54:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-21T12:54:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-21T12:54:13.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1134965451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:13.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:13 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/420696998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: pgmap v268: 97 pgs: 10 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: osdmap e83: 12 total, 12 up, 12 in 2023-09-21T12:54:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-21T12:54:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-21T12:54:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-21T12:54:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-21T12:54:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1134965451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:13.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:13 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/420696998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:13.912+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc8410c890 con 0x7fcc84101fe0 2023-09-21T12:54:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: pgmap v268: 97 pgs: 10 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:54:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: osdmap e83: 12 total, 12 up, 12 in 2023-09-21T12:54:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-21T12:54:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-21T12:54:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-21T12:54:13.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-21T12:54:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1134965451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:13.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:13 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/420696998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:14.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.467+0000 7fcc737fe700 1 -- 172.21.15.142:0/1274763646 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc78095750 con 0x7fcc84101fe0 2023-09-21T12:54:14.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 msgr2=0x7fcc6c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:14.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 0x7fcc6c0a2b80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcc74009fd0 tx=0x7fcc74009260 comp rx=0 tx=0).stop 2023-09-21T12:54:14.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 msgr2=0x7fcc84199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:14.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 0x7fcc84199350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800e9f0 tx=0x7fcc7800ed00 comp rx=0 tx=0).stop 2023-09-21T12:54:14.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 shutdown_connections 2023-09-21T12:54:14.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcc6c0a06c0 0x7fcc6c0a2b80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc84100df0 0x7fcc84198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84102980 0x7fcc841a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 --2- 172.21.15.142:0/1274763646 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc84101fe0 0x7fcc84199350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 >> 172.21.15.142:0/1274763646 conn(0x7fcc840fc360 msgr2=0x7fcc840fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:14.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 shutdown_connections 2023-09-21T12:54:14.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.470+0000 7fcc88dff700 1 -- 172.21.15.142:0/1274763646 wait complete. 2023-09-21T12:54:14.490 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2023-09-21T12:54:14.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-09-21T12:54:14.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: osdmap e84: 12 total, 12 up, 12 in 2023-09-21T12:54:14.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:active 2023-09-21T12:54:14.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1274763646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:14.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1994369985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101fe0 msgr2=0x7f02f8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1994369985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101fe0 0x7f02f8102440 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0099c0 tx=0x7f02ec009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1994369985 shutdown_connections 2023-09-21T12:54:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1994369985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8102980 0x7f02f8109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1994369985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8100df0 0x7f02f8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1994369985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101fe0 0x7f02f8102440 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1994369985 >> 172.21.15.142:0/1994369985 conn(0x7f02f80fc360 msgr2=0x7f02f80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:14.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1994369985 shutdown_connections 2023-09-21T12:54:14.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.693+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1994369985 wait complete. 2023-09-21T12:54:14.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 Processor -- start 2023-09-21T12:54:14.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 -- start start 2023-09-21T12:54:14.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:14.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 0x7f02f8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:14.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8102980 0x7f02f81a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:14.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81a0870 con 0x7f02f8100df0 2023-09-21T12:54:14.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81a09e0 con 0x7f02f8102980 2023-09-21T12:54:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02fe1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f81a0ba0 con 0x7f02f8101fe0 2023-09-21T12:54:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.694+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55216/0 (socket says 172.21.15.142:55216) 2023-09-21T12:54:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 -- 172.21.15.142:0/1723981257 learned_addr learned my addr 172.21.15.142:0/1723981257 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:14.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f6ffd700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 0x7f02f8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f7fff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8102980 0x7f02f81a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 -- 172.21.15.142:0/1723981257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 msgr2=0x7f02f8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 0x7f02f8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 -- 172.21.15.142:0/1723981257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8102980 msgr2=0x7f02f81a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8102980 0x7f02f81a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 -- 172.21.15.142:0/1723981257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec0095f0 con 0x7f02f8100df0 2023-09-21T12:54:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f6ffd700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 0x7f02f8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f77fe700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e970 tx=0x7f02e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8009790 con 0x7f02f8100df0 2023-09-21T12:54:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e800eec0 con 0x7f02f8100df0 2023-09-21T12:54:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f81a0e80 con 0x7f02f8100df0 2023-09-21T12:54:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8003cf0 con 0x7f02f8100df0 2023-09-21T12:54:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.695+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f81a12a0 con 0x7f02f8100df0 2023-09-21T12:54:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.696+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f8193440 con 0x7f02f8100df0 2023-09-21T12:54:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.699+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f02e800ccd0 con 0x7f02f8100df0 2023-09-21T12:54:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.700+0000 7f02f4ff9700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 0x7f02e00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.700+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f02e8014070 con 0x7f02f8100df0 2023-09-21T12:54:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.700+0000 7f02f6ffd700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 0x7f02e00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.701+0000 7f02f6ffd700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 0x7f02e00a2b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b580 tx=0x7f02ec01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.702+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f02e8095a90 con 0x7f02f8100df0 2023-09-21T12:54:14.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: osdmap e84: 12 total, 12 up, 12 in 2023-09-21T12:54:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:active 2023-09-21T12:54:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1274763646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: osdmap e84: 12 total, 12 up, 12 in 2023-09-21T12:54:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] up:active 2023-09-21T12:54:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1274763646' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-21T12:54:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:54:14.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:54:14.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:54:14.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:14.946+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f02f802cfa0 con 0x7f02f8100df0 2023-09-21T12:54:15.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.475+0000 7f02f4ff9700 1 -- 172.21.15.142:0/1723981257 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f02e80990b0 con 0x7f02f8100df0 2023-09-21T12:54:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.477+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 msgr2=0x7f02e00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.477+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 0x7f02e00a2b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b580 tx=0x7f02ec01a040 comp rx=0 tx=0).stop 2023-09-21T12:54:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.477+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 msgr2=0x7f02f8198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.477+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e970 tx=0x7f02e800ec80 comp rx=0 tx=0).stop 2023-09-21T12:54:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 shutdown_connections 2023-09-21T12:54:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0640 0x7f02e00a2b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8100df0 0x7f02f8198d30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8102980 0x7f02f81a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 --2- 172.21.15.142:0/1723981257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101fe0 0x7f02f8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 >> 172.21.15.142:0/1723981257 conn(0x7f02f80fc360 msgr2=0x7f02f8107910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 shutdown_connections 2023-09-21T12:54:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.478+0000 7f02fe1ff700 1 -- 172.21.15.142:0/1723981257 wait complete. 2023-09-21T12:54:15.504 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-09-21T12:54:15.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 -- 172.21.15.142:0/2000865941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 msgr2=0x7ff54c102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:15.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 --2- 172.21.15.142:0/2000865941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c102440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff5400099c0 tx=0x7ff540009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 -- 172.21.15.142:0/2000865941 shutdown_connections 2023-09-21T12:54:15.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 --2- 172.21.15.142:0/2000865941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 0x7ff54c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 --2- 172.21.15.142:0/2000865941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 --2- 172.21.15.142:0/2000865941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c102440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 -- 172.21.15.142:0/2000865941 >> 172.21.15.142:0/2000865941 conn(0x7ff54c0fc360 msgr2=0x7ff54c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:15.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 -- 172.21.15.142:0/2000865941 shutdown_connections 2023-09-21T12:54:15.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.705+0000 7ff5509ff700 1 -- 172.21.15.142:0/2000865941 wait complete. 2023-09-21T12:54:15.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 Processor -- start 2023-09-21T12:54:15.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 -- start start 2023-09-21T12:54:15.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:15.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:15.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 0x7ff54c073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:15.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c073eb0 con 0x7ff54c101fe0 2023-09-21T12:54:15.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c074020 con 0x7ff54c100df0 2023-09-21T12:54:15.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.706+0000 7ff5509ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c1a0b40 con 0x7ff54c102980 2023-09-21T12:54:15.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff549d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:15.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:15.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff549d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c0731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55246/0 (socket says 172.21.15.142:55246) 2023-09-21T12:54:15.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff549d9b700 1 -- 172.21.15.142:0/1613957180 learned_addr learned my addr 172.21.15.142:0/1613957180 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:15.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54ad9d700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 0x7ff54c073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:15.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 -- 172.21.15.142:0/1613957180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 msgr2=0x7ff54c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:15.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 0x7ff54c073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 -- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 msgr2=0x7ff54c0731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:15.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c0731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:15.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 -- 172.21.15.142:0/1613957180 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c009520 con 0x7ff54c100df0 2023-09-21T12:54:15.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff54a59c700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c074b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e9c0 tx=0x7ff53c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:15.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.707+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c00cb70 con 0x7ff54c100df0 2023-09-21T12:54:15.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.708+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5400095f0 con 0x7ff54c100df0 2023-09-21T12:54:15.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.708+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff53c00ee60 con 0x7ff54c100df0 2023-09-21T12:54:15.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.708+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53c018680 con 0x7ff54c100df0 2023-09-21T12:54:15.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.708+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff54c1a11a0 con 0x7ff54c100df0 2023-09-21T12:54:15.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.709+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff54c1083d0 con 0x7ff54c100df0 2023-09-21T12:54:15.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.711+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7ff53c010430 con 0x7ff54c100df0 2023-09-21T12:54:15.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.712+0000 7ff53b7fe700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 0x7ff5340a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:15.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.712+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff53c014070 con 0x7ff54c100df0 2023-09-21T12:54:15.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.712+0000 7ff549d9b700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 0x7ff5340a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:15.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.713+0000 7ff549d9b700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 0x7ff5340a2b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff540000c00 tx=0x7ff540005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:15.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.714+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff53c095e80 con 0x7ff54c100df0 2023-09-21T12:54:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: pgmap v271: 97 pgs: 10 creating+peering, 33 active+clean, 54 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-09-21T12:54:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-21T12:54:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-09-21T12:54:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-09-21T12:54:15.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:15 smithi156 ceph-mon[134078]: Cluster is now healthy 2023-09-21T12:54:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: pgmap v271: 97 pgs: 10 creating+peering, 33 active+clean, 54 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-09-21T12:54:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-21T12:54:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-09-21T12:54:15.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-09-21T12:54:15.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:15 smithi142 ceph-mon[97663]: Cluster is now healthy 2023-09-21T12:54:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: pgmap v271: 97 pgs: 10 creating+peering, 33 active+clean, 54 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 767 B/s wr, 2 op/s 2023-09-21T12:54:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-21T12:54:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-09-21T12:54:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2023-09-21T12:54:15.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:15 smithi160 ceph-mon[134450]: Cluster is now healthy 2023-09-21T12:54:15.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:15.958+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff54c02d140 con 0x7ff54c100df0 2023-09-21T12:54:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.425+0000 7ff53b7fe700 1 -- 172.21.15.142:0/1613957180 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff53c0994a0 con 0x7ff54c100df0 2023-09-21T12:54:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 msgr2=0x7ff5340a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 0x7ff5340a2b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff540000c00 tx=0x7ff540005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 msgr2=0x7ff54c074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c074b90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00e9c0 tx=0x7ff53c00ecd0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 shutdown_connections 2023-09-21T12:54:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff5340a0640 0x7ff5340a2b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff54c102980 0x7ff54c073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff54c100df0 0x7ff54c074b90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 --2- 172.21.15.142:0/1613957180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff54c101fe0 0x7ff54c0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 >> 172.21.15.142:0/1613957180 conn(0x7ff54c0fc360 msgr2=0x7ff54c105510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:16.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 shutdown_connections 2023-09-21T12:54:16.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.428+0000 7ff5509ff700 1 -- 172.21.15.142:0/1613957180 wait complete. 2023-09-21T12:54:16.452 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-09-21T12:54:16.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 -- 172.21.15.142:0/4195537450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4100df0 msgr2=0x7f77b4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:16.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 --2- 172.21.15.142:0/4195537450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4100df0 0x7f77b4101210 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77a40099c0 tx=0x7f77a4009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 -- 172.21.15.142:0/4195537450 shutdown_connections 2023-09-21T12:54:16.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 --2- 172.21.15.142:0/4195537450 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4100df0 0x7f77b4101210 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 --2- 172.21.15.142:0/4195537450 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4102980 0x7f77b4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 --2- 172.21.15.142:0/4195537450 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4101fe0 0x7f77b4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 -- 172.21.15.142:0/4195537450 >> 172.21.15.142:0/4195537450 conn(0x7f77b40fc360 msgr2=0x7f77b40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:16.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 -- 172.21.15.142:0/4195537450 shutdown_connections 2023-09-21T12:54:16.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.654+0000 7f77b97ff700 1 -- 172.21.15.142:0/4195537450 wait complete. 2023-09-21T12:54:16.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.655+0000 7f77b97ff700 1 Processor -- start 2023-09-21T12:54:16.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.655+0000 7f77b97ff700 1 -- start start 2023-09-21T12:54:16.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.655+0000 7f77b97ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4100df0 0x7f77b4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:16.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.655+0000 7f77b97ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4101fe0 0x7f77b40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:16.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b97ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:16.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b97ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4073eb0 con 0x7f77b4102980 2023-09-21T12:54:16.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b97ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4074020 con 0x7f77b4100df0 2023-09-21T12:54:16.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b97ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b41a0b30 con 0x7f77b4101fe0 2023-09-21T12:54:16.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:16.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55274/0 (socket says 172.21.15.142:55274) 2023-09-21T12:54:16.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 -- 172.21.15.142:0/857577961 learned_addr learned my addr 172.21.15.142:0/857577961 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:16.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b27fc700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4101fe0 0x7f77b40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:16.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b2ffd700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4100df0 0x7f77b4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:16.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 -- 172.21.15.142:0/857577961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4101fe0 msgr2=0x7f77b40731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:16.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4101fe0 0x7f77b40731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 -- 172.21.15.142:0/857577961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4100df0 msgr2=0x7f77b4074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:16.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4100df0 0x7f77b4074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:16.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 -- 172.21.15.142:0/857577961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40095f0 con 0x7f77b4102980 2023-09-21T12:54:16.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.656+0000 7f77b37fe700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00ef30 tx=0x7f77ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:16.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.657+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac018070 con 0x7f77b4102980 2023-09-21T12:54:16.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.657+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b41a0db0 con 0x7f77b4102980 2023-09-21T12:54:16.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.657+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f77ac00f040 con 0x7f77b4102980 2023-09-21T12:54:16.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.657+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00cd00 con 0x7f77b4102980 2023-09-21T12:54:16.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.657+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b41a1230 con 0x7f77b4102980 2023-09-21T12:54:16.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.658+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b41083e0 con 0x7f77b4102980 2023-09-21T12:54:16.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.660+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f77ac003a00 con 0x7f77b4102980 2023-09-21T12:54:16.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.661+0000 7f779bfff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 0x7f779c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:16.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.661+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f77ac0cb5e0 con 0x7f77b4102980 2023-09-21T12:54:16.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.661+0000 7f77b2ffd700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 0x7f779c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:16.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.662+0000 7f77b2ffd700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 0x7f779c0a2b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009fd0 tx=0x7f77a4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:16.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.665+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f77ac095250 con 0x7f77b4102980 2023-09-21T12:54:16.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-21T12:54:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-09-21T12:54:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-21T12:54:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-09-21T12:54:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-09-21T12:54:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1613957180' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:active 2023-09-21T12:54:16.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-21T12:54:16.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-21T12:54:16.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-21T12:54:16.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: Cluster is now healthy 2023-09-21T12:54:16.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 2 up:standby-replay 8 up:standby 2023-09-21T12:54:16.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:16.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:16 smithi156 ceph-mon[134078]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-21T12:54:16.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:16.916+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f77b410c600 con 0x7f77b4102980 2023-09-21T12:54:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-21T12:54:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-09-21T12:54:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-21T12:54:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-09-21T12:54:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-09-21T12:54:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1613957180' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:active 2023-09-21T12:54:16.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-21T12:54:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-21T12:54:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-21T12:54:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: Cluster is now healthy 2023-09-21T12:54:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 2 up:standby-replay 8 up:standby 2023-09-21T12:54:16.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:16.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:16 smithi142 ceph-mon[97663]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-21T12:54:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-21T12:54:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1723981257' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-09-21T12:54:16.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: daemon mds.a assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-21T12:54:16.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-21T12:54:16.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: fsmap cephfs:2 {0=b=up:active,1=a=up:creating} 10 up:standby 2023-09-21T12:54:16.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: daemon mds.a is now active in filesystem cephfs as rank 1 2023-09-21T12:54:16.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1613957180' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-21T12:54:16.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] up:active 2023-09-21T12:54:16.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-21T12:54:16.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-21T12:54:16.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-21T12:54:16.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: Cluster is now healthy 2023-09-21T12:54:16.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: fsmap cephfs:2 {0=b=up:active,1=a=up:active} 2 up:standby-replay 8 up:standby 2023-09-21T12:54:16.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:creating} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:16.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:16 smithi160 ceph-mon[134450]: daemon mds.c is now active in filesystem cephfs as rank 2 2023-09-21T12:54:17.405 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: 2023-09-21T12:54:17.058+0000 7f7694d40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-21T12:54:17.405 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: 2023-09-21T12:54:17.058+0000 7f7694d40700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-21T12:54:17.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.431+0000 7f779bfff700 1 -- 172.21.15.142:0/857577961 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f77ac098870 con 0x7f77b4102980 2023-09-21T12:54:17.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 msgr2=0x7f779c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 0x7f779c0a2b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009fd0 tx=0x7f77a4005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 msgr2=0x7f77b4073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00ef30 tx=0x7f77ac00c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 shutdown_connections 2023-09-21T12:54:17.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f779c0a0640 0x7f779c0a2b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f77b4102980 0x7f77b4073710 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f77b4100df0 0x7f77b4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 --2- 172.21.15.142:0/857577961 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77b4101fe0 0x7f77b40731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 >> 172.21.15.142:0/857577961 conn(0x7f77b40fc360 msgr2=0x7f77b4105520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:17.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 shutdown_connections 2023-09-21T12:54:17.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.434+0000 7f77b97ff700 1 -- 172.21.15.142:0/857577961 wait complete. 2023-09-21T12:54:17.454 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2023-09-21T12:54:17.454 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-09-21T12:54:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 -- 172.21.15.142:0/4117218371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741018b0 msgr2=0x7f2774103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 --2- 172.21.15.142:0/4117218371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741018b0 0x7f2774103ca0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2770009990 tx=0x7f2770009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 -- 172.21.15.142:0/4117218371 shutdown_connections 2023-09-21T12:54:17.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 --2- 172.21.15.142:0/4117218371 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741018b0 0x7f2774103ca0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 --2- 172.21.15.142:0/4117218371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2774106b10 0x7f2774108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 --2- 172.21.15.142:0/4117218371 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f27741041e0 0x7f27741065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 -- 172.21.15.142:0/4117218371 >> 172.21.15.142:0/4117218371 conn(0x7f27740fb240 msgr2=0x7f27740fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:17.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 -- 172.21.15.142:0/4117218371 shutdown_connections 2023-09-21T12:54:17.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.656+0000 7f277b5ff700 1 -- 172.21.15.142:0/4117218371 wait complete. 2023-09-21T12:54:17.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.657+0000 7f277b5ff700 1 Processor -- start 2023-09-21T12:54:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.657+0000 7f277b5ff700 1 -- start start 2023-09-21T12:54:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27741018b0 0x7f2774101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 0x7f27740ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:17.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2774100540 con 0x7f27741041e0 2023-09-21T12:54:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741006b0 con 0x7f2774106b10 2023-09-21T12:54:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277b5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27741a0ba0 con 0x7f27741018b0 2023-09-21T12:54:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:17.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55294/0 (socket says 172.21.15.142:55294) 2023-09-21T12:54:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f277939b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27741018b0 0x7f2774101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 -- 172.21.15.142:0/3124817003 learned_addr learned my addr 172.21.15.142:0/3124817003 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2779b9c700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 0x7f27740ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 -- 172.21.15.142:0/3124817003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27741018b0 msgr2=0x7f2774101220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27741018b0 0x7f2774101220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 -- 172.21.15.142:0/3124817003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 msgr2=0x7f27740ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 0x7f27740ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 -- 172.21.15.142:0/3124817003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2764009520 con 0x7f27741041e0 2023-09-21T12:54:17.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2779b9c700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 0x7f27740ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:17.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.658+0000 7f2778b9a700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f276400eb30 tx=0x7f276400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:17.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.659+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764009880 con 0x7f27741041e0 2023-09-21T12:54:17.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.659+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27700095f0 con 0x7f27741041e0 2023-09-21T12:54:17.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.659+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27640044e0 con 0x7f27741041e0 2023-09-21T12:54:17.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.659+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764003e90 con 0x7f27741041e0 2023-09-21T12:54:17.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.659+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27741a11f0 con 0x7f27741041e0 2023-09-21T12:54:17.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.660+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27740fcdc0 con 0x7f27741041e0 2023-09-21T12:54:17.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.662+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f2764004000 con 0x7f27741041e0 2023-09-21T12:54:17.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.663+0000 7f276a7fc700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 0x7f27600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:17.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.663+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2764014070 con 0x7f27741041e0 2023-09-21T12:54:17.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.663+0000 7f277939b700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 0x7f27600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:17.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.664+0000 7f277939b700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 0x7f27600a2b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f277000b2e0 tx=0x7f2770005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:17.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.667+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2764095af0 con 0x7f27741041e0 2023-09-21T12:54:17.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.900+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f277402d1a0 con 0x7f27600a0640 2023-09-21T12:54:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: pgmap v272: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2023-09-21T12:54:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-21T12:54:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:active 2023-09-21T12:54:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-21T12:54:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:17 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:54:17.907 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: pgmap v272: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2023-09-21T12:54:17.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-21T12:54:17.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:active 2023-09-21T12:54:17.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-21T12:54:17.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:17.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:54:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: pgmap v272: 97 pgs: 7 creating+peering, 90 active+clean; 579 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2023-09-21T12:54:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-21T12:54:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] up:active 2023-09-21T12:54:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/857577961' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-21T12:54:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T12:54:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:17 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:54:17.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.946+0000 7f276a7fc700 1 -- 172.21.15.142:0/3124817003 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f277402d1a0 con 0x7f27600a0640 2023-09-21T12:54:17.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 msgr2=0x7f27600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 0x7f27600a2b00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f277000b2e0 tx=0x7f2770005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 msgr2=0x7f27740ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:17.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f276400eb30 tx=0x7f276400ee40 comp rx=0 tx=0).stop 2023-09-21T12:54:17.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 shutdown_connections 2023-09-21T12:54:17.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f27600a0640 0x7f27600a2b00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2774106b10 0x7f27740ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27741018b0 0x7f2774101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 --2- 172.21.15.142:0/3124817003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f27741041e0 0x7f27740ff860 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:17.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.948+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 >> 172.21.15.142:0/3124817003 conn(0x7f27740fb240 msgr2=0x7f2774102520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:17.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.949+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 shutdown_connections 2023-09-21T12:54:17.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:17.949+0000 7f277b5ff700 1 -- 172.21.15.142:0/3124817003 wait complete. 2023-09-21T12:54:17.967 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-09-21T12:54:18.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:54:17.907+0000 7fa7511e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:54:18.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:54:17.907+0000 7fa7511e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:54:18.167 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:54:17.907+0000 7fa7511e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:54:18.167 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:54:17.907+0000 7fa7511e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:54:18.167 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:54:17 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:54:17.907+0000 7fa7511e5700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:54:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.168+0000 7f12837ff700 1 -- 172.21.15.142:0/2080639268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 msgr2=0x7f127c102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.168+0000 7f12837ff700 1 --2- 172.21.15.142:0/2080639268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c102420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f126c0099c0 tx=0x7f126c009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 -- 172.21.15.142:0/2080639268 shutdown_connections 2023-09-21T12:54:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 --2- 172.21.15.142:0/2080639268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 0x7f127c109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 --2- 172.21.15.142:0/2080639268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 --2- 172.21.15.142:0/2080639268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c102420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 -- 172.21.15.142:0/2080639268 >> 172.21.15.142:0/2080639268 conn(0x7f127c0fc320 msgr2=0x7f127c0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:18.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 -- 172.21.15.142:0/2080639268 shutdown_connections 2023-09-21T12:54:18.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.169+0000 7f12837ff700 1 -- 172.21.15.142:0/2080639268 wait complete. 2023-09-21T12:54:18.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 Processor -- start 2023-09-21T12:54:18.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 -- start start 2023-09-21T12:54:18.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 0x7f127c073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c073eb0 con 0x7f127c101fc0 2023-09-21T12:54:18.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c074020 con 0x7f127c100dd0 2023-09-21T12:54:18.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f12837ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1a0b50 con 0x7f127c102960 2023-09-21T12:54:18.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f1280d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f1280d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55332/0 (socket says 172.21.15.142:55332) 2023-09-21T12:54:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.170+0000 7f1280d9a700 1 -- 172.21.15.142:0/2533044657 learned_addr learned my addr 172.21.15.142:0/2533044657 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f128159b700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1281d9c700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 0x7f127c073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 -- 172.21.15.142:0/2533044657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 msgr2=0x7f127c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 0x7f127c073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 -- 172.21.15.142:0/2533044657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 msgr2=0x7f127c074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 -- 172.21.15.142:0/2533044657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0095f0 con 0x7f127c101fc0 2023-09-21T12:54:18.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f128159b700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:18.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f1280d9a700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f126c009fd0 tx=0x7f126c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:18.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c01d070 con 0x7f127c101fc0 2023-09-21T12:54:18.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f126c005510 con 0x7f127c101fc0 2023-09-21T12:54:18.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c1a0dd0 con 0x7f127c101fc0 2023-09-21T12:54:18.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c004b90 con 0x7f127c101fc0 2023-09-21T12:54:18.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.171+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c1a11f0 con 0x7f127c101fc0 2023-09-21T12:54:18.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.172+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c10c630 con 0x7f127c101fc0 2023-09-21T12:54:18.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.174+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 16) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f126c004d50 con 0x7f127c101fc0 2023-09-21T12:54:18.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.177+0000 7f12727fc700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 0x7f12680a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.177+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f126c0ccd40 con 0x7f127c101fc0 2023-09-21T12:54:18.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.177+0000 7f128159b700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 0x7f12680a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.177+0000 7f128159b700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 0x7f12680a2b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f127c101e20 tx=0x7f1278009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:18.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.179+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f126c0969b0 con 0x7f127c101fc0 2023-09-21T12:54:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.412+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f127c061220 con 0x7f12680a06c0 2023-09-21T12:54:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.416+0000 7f12727fc700 1 -- 172.21.15.142:0/2533044657 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f127c061220 con 0x7f12680a06c0 2023-09-21T12:54:18.415 INFO:teuthology.orchestra.run.smithi142.stdout:/volumes/_nogroup/sv_0/63517ae1-4bc3-4d96-9f36-78bcf519bb29 2023-09-21T12:54:18.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 msgr2=0x7f12680a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 0x7f12680a2b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f127c101e20 tx=0x7f1278009260 comp rx=0 tx=0).stop 2023-09-21T12:54:18.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 msgr2=0x7f127c0731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f126c009fd0 tx=0x7f126c00f740 comp rx=0 tx=0).stop 2023-09-21T12:54:18.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 shutdown_connections 2023-09-21T12:54:18.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f12680a06c0 0x7f12680a2b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c102960 0x7f127c073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f127c100dd0 0x7f127c074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 --2- 172.21.15.142:0/2533044657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f127c101fc0 0x7f127c0731d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.418+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 >> 172.21.15.142:0/2533044657 conn(0x7f127c0fc320 msgr2=0x7f127c0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:18.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.419+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 shutdown_connections 2023-09-21T12:54:18.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.419+0000 7f12837ff700 1 -- 172.21.15.142:0/2533044657 wait complete. 2023-09-21T12:54:18.437 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-09-21T12:54:18.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 -- 172.21.15.142:0/1677476201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530100df0 msgr2=0x7f0530101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 --2- 172.21.15.142:0/1677476201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530100df0 0x7f0530101210 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05200099c0 tx=0x7f0520009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 -- 172.21.15.142:0/1677476201 shutdown_connections 2023-09-21T12:54:18.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 --2- 172.21.15.142:0/1677476201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530100df0 0x7f0530101210 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 --2- 172.21.15.142:0/1677476201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530102980 0x7f0530109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 --2- 172.21.15.142:0/1677476201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530101fe0 0x7f0530102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 -- 172.21.15.142:0/1677476201 >> 172.21.15.142:0/1677476201 conn(0x7f05300fc360 msgr2=0x7f05300fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:18.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 -- 172.21.15.142:0/1677476201 shutdown_connections 2023-09-21T12:54:18.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.644+0000 7f05349ff700 1 -- 172.21.15.142:0/1677476201 wait complete. 2023-09-21T12:54:18.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.645+0000 7f05349ff700 1 Processor -- start 2023-09-21T12:54:18.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.645+0000 7f05349ff700 1 -- start start 2023-09-21T12:54:18.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 0x7f0530074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530073eb0 con 0x7f0530102980 2023-09-21T12:54:18.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530074020 con 0x7f0530100df0 2023-09-21T12:54:18.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f05349ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05301a0b70 con 0x7f0530101fe0 2023-09-21T12:54:18.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 0x7f0530074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55364/0 (socket says 172.21.15.142:55364) 2023-09-21T12:54:18.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 0x7f0530074b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38172/0 (socket says 172.21.15.142:38172) 2023-09-21T12:54:18.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53120/0 (socket says 172.21.15.142:53120) 2023-09-21T12:54:18.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052ed9d700 1 -- 172.21.15.142:0/1507662444 learned_addr learned my addr 172.21.15.142:0/1507662444 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:18.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 -- 172.21.15.142:0/1507662444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 msgr2=0x7f0530074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 0x7f0530074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 -- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 msgr2=0x7f0530073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052dd9b700 1 -- 172.21.15.142:0/1507662444 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200095f0 con 0x7f0530101fe0 2023-09-21T12:54:18.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.646+0000 7f052ed9d700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:18.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f052dd9b700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f052400e9f0 tx=0x7f052400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:18.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400c9c0 con 0x7f0530101fe0 2023-09-21T12:54:18.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05301a0e50 con 0x7f0530101fe0 2023-09-21T12:54:18.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0524010430 con 0x7f0530101fe0 2023-09-21T12:54:18.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524018680 con 0x7f0530101fe0 2023-09-21T12:54:18.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.647+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05301a12d0 con 0x7f0530101fe0 2023-09-21T12:54:18.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.648+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0530107d70 con 0x7f0530101fe0 2023-09-21T12:54:18.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.650+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f0524010860 con 0x7f0530101fe0 2023-09-21T12:54:18.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.651+0000 7f051f7fe700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 0x7f05180a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:18.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.652+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0524014070 con 0x7f0530101fe0 2023-09-21T12:54:18.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.652+0000 7f052e59c700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 0x7f05180a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:18.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.652+0000 7f052e59c700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 0x7f05180a2b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0520009990 tx=0x7f0520005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:18.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.654+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0524095a70 con 0x7f0530101fe0 2023-09-21T12:54:18.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.890+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f053002d260 con 0x7f05180a06d0 2023-09-21T12:54:18.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.914+0000 7f051f7fe700 1 -- 172.21.15.142:0/1507662444 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f053002d260 con 0x7f05180a06d0 2023-09-21T12:54:18.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.916+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 msgr2=0x7f05180a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.916+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 0x7f05180a2b90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0520009990 tx=0x7f0520005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.916+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 msgr2=0x7f05300731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.916+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f052400e9f0 tx=0x7f052400ed00 comp rx=0 tx=0).stop 2023-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 shutdown_connections 2023-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05180a06d0 0x7f05180a2b90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0530102980 0x7f0530073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0530100df0 0x7f0530074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 --2- 172.21.15.142:0/1507662444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0530101fe0 0x7f05300731d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 >> 172.21.15.142:0/1507662444 conn(0x7f05300fc360 msgr2=0x7f05300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 shutdown_connections 2023-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:18.917+0000 7f05349ff700 1 -- 172.21.15.142:0/1507662444 wait complete. 2023-09-21T12:54:18.935 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-09-21T12:54:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 -- 172.21.15.142:0/3550280553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88101fc0 msgr2=0x7f3c88102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/3550280553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88101fc0 0x7f3c88102420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3c780099c0 tx=0x7f3c78009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 -- 172.21.15.142:0/3550280553 shutdown_connections 2023-09-21T12:54:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/3550280553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88102960 0x7f3c88109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/3550280553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88100dd0 0x7f3c881011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/3550280553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88101fc0 0x7f3c88102420 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 -- 172.21.15.142:0/3550280553 >> 172.21.15.142:0/3550280553 conn(0x7f3c880fc320 msgr2=0x7f3c880fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 -- 172.21.15.142:0/3550280553 shutdown_connections 2023-09-21T12:54:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.137+0000 7f3c8fdff700 1 -- 172.21.15.142:0/3550280553 wait complete. 2023-09-21T12:54:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.138+0000 7f3c8fdff700 1 Processor -- start 2023-09-21T12:54:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 -- start start 2023-09-21T12:54:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 0x7f3c88197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 0x7f3c8819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8819e6a0 con 0x7f3c88100dd0 2023-09-21T12:54:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8819e7e0 con 0x7f3c88101fc0 2023-09-21T12:54:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c8819e970 con 0x7f3c88102960 2023-09-21T12:54:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55386/0 (socket says 172.21.15.142:55386) 2023-09-21T12:54:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 -- 172.21.15.142:0/1189386462 learned_addr learned my addr 172.21.15.142:0/1189386462 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8e39c700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 0x7f3c8819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8d39a700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 0x7f3c88197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 -- 172.21.15.142:0/1189386462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 msgr2=0x7f3c8819e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 0x7f3c8819e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 -- 172.21.15.142:0/1189386462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 msgr2=0x7f3c88197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 0x7f3c88197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8db9b700 1 -- 172.21.15.142:0/1189386462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c780095f0 con 0x7f3c88100dd0 2023-09-21T12:54:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8d39a700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 0x7f3c88197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:19.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.139+0000 7f3c8e39c700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 0x7f3c8819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:19.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c8db9b700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400d980 tx=0x7f3c8400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:19.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400bb60 con 0x7f3c88100dd0 2023-09-21T12:54:19.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c8819ec50 con 0x7f3c88100dd0 2023-09-21T12:54:19.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c84007620 con 0x7f3c88100dd0 2023-09-21T12:54:19.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c8400f620 con 0x7f3c88100dd0 2023-09-21T12:54:19.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.140+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c8819f160 con 0x7f3c88100dd0 2023-09-21T12:54:19.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.141+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8810c630 con 0x7f3c88100dd0 2023-09-21T12:54:19.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.143+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f3c84010460 con 0x7f3c88100dd0 2023-09-21T12:54:19.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.144+0000 7f3c7effd700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 0x7f3c740a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.144+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3c840cbca0 con 0x7f3c88100dd0 2023-09-21T12:54:19.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.144+0000 7f3c8d39a700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 0x7f3c740a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.145+0000 7f3c8d39a700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 0x7f3c740a2b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b580 tx=0x7f3c7801a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:19.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.148+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3c84095720 con 0x7f3c88100dd0 2023-09-21T12:54:19.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.383+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c88061220 con 0x7f3c740a06d0 2023-09-21T12:54:19.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.387+0000 7f3c7effd700 1 -- 172.21.15.142:0/1189386462 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f3c88061220 con 0x7f3c740a06d0 2023-09-21T12:54:19.387 INFO:teuthology.orchestra.run.smithi142.stdout:/volumes/_nogroup/sv_1/4f22885d-ff40-4d39-87c7-0279654a3fb4 2023-09-21T12:54:19.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 msgr2=0x7f3c740a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 0x7f3c740a2b90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800b580 tx=0x7f3c7801a040 comp rx=0 tx=0).stop 2023-09-21T12:54:19.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 msgr2=0x7f3c88196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400d980 tx=0x7f3c8400dd40 comp rx=0 tx=0).stop 2023-09-21T12:54:19.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 shutdown_connections 2023-09-21T12:54:19.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f3c740a06d0 0x7f3c740a2b90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3c88100dd0 0x7f3c88196b20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c88102960 0x7f3c8819e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 --2- 172.21.15.142:0/1189386462 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3c88101fc0 0x7f3c88197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 >> 172.21.15.142:0/1189386462 conn(0x7f3c880fc320 msgr2=0x7f3c880fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:19.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 shutdown_connections 2023-09-21T12:54:19.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.390+0000 7f3c8fdff700 1 -- 172.21.15.142:0/1189386462 wait complete. 2023-09-21T12:54:19.408 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:54:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 -- 172.21.15.142:0/4265390606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 msgr2=0x7fd074109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 --2- 172.21.15.142:0/4265390606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd074109230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd06c00b0a0 tx=0x7fd06c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 -- 172.21.15.142:0/4265390606 shutdown_connections 2023-09-21T12:54:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 --2- 172.21.15.142:0/4265390606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd074109230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 --2- 172.21.15.142:0/4265390606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 0x7fd074101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 --2- 172.21.15.142:0/4265390606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 -- 172.21.15.142:0/4265390606 >> 172.21.15.142:0/4265390606 conn(0x7fd0740fc320 msgr2=0x7fd0740fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 -- 172.21.15.142:0/4265390606 shutdown_connections 2023-09-21T12:54:19.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.610+0000 7fd07adff700 1 -- 172.21.15.142:0/4265390606 wait complete. 2023-09-21T12:54:19.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 Processor -- start 2023-09-21T12:54:19.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 -- start start 2023-09-21T12:54:19.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 0x7fd074198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd0741a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0741a0900 con 0x7fd074101fe0 2023-09-21T12:54:19.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0741a0a70 con 0x7fd074100df0 2023-09-21T12:54:19.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.611+0000 7fd07adff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0741a0c30 con 0x7fd074102980 2023-09-21T12:54:19.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55408/0 (socket says 172.21.15.142:55408) 2023-09-21T12:54:19.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 -- 172.21.15.142:0/4010387190 learned_addr learned my addr 172.21.15.142:0/4010387190 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:19.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd078b9b700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 0x7fd074198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd07939c700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd0741a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 -- 172.21.15.142:0/4010387190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 msgr2=0x7fd0741a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd0741a0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 -- 172.21.15.142:0/4010387190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 msgr2=0x7fd074198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 0x7fd074198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 -- 172.21.15.142:0/4010387190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd060009520 con 0x7fd074101fe0 2023-09-21T12:54:19.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd07939c700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd0741a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:19.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd073fff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd06000eb30 tx=0x7fd06000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:19.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060009880 con 0x7fd074101fe0 2023-09-21T12:54:19.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06c009d00 con 0x7fd074101fe0 2023-09-21T12:54:19.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.612+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0600044e0 con 0x7fd074101fe0 2023-09-21T12:54:19.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.613+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060003e90 con 0x7fd074101fe0 2023-09-21T12:54:19.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.613+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0741a11d0 con 0x7fd074101fe0 2023-09-21T12:54:19.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.614+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07410c660 con 0x7fd074101fe0 2023-09-21T12:54:19.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.616+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fd060004000 con 0x7fd074101fe0 2023-09-21T12:54:19.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.618+0000 7fd071ffb700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 0x7fd0640a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:19.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.618+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd060014070 con 0x7fd074101fe0 2023-09-21T12:54:19.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.618+0000 7fd078b9b700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 0x7fd0640a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:19.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.618+0000 7fd078b9b700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 0x7fd0640a2bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd07419a290 tx=0x7fd068009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:19.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.622+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd060095b50 con 0x7fd074101fe0 2023-09-21T12:54:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:19 smithi142 ceph-mon[97663]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:19 smithi142 ceph-mon[97663]: pgmap v273: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 3.6 KiB/s wr, 9 op/s 2023-09-21T12:54:19.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:19 smithi142 ceph-mon[97663]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:19 smithi142 ceph-mon[97663]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-21T12:54:19.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.867+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd07410c850 con 0x7fd074101fe0 2023-09-21T12:54:19.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.868+0000 7fd071ffb700 1 -- 172.21.15.142:0/4010387190 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7fd060099170 con 0x7fd074101fe0 2023-09-21T12:54:19.867 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:19.868 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:54:19.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 msgr2=0x7fd0640a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 0x7fd0640a2bd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd07419a290 tx=0x7fd068009260 comp rx=0 tx=0).stop 2023-09-21T12:54:19.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 msgr2=0x7fd074199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:19.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd06000eb30 tx=0x7fd06000ee40 comp rx=0 tx=0).stop 2023-09-21T12:54:19.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 shutdown_connections 2023-09-21T12:54:19.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd0640a0710 0x7fd0640a2bd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd074102980 0x7fd0741a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd074100df0 0x7fd074198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 --2- 172.21.15.142:0/4010387190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd074101fe0 0x7fd074199300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:19.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 >> 172.21.15.142:0/4010387190 conn(0x7fd0740fc320 msgr2=0x7fd074107830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:19.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 shutdown_connections 2023-09-21T12:54:19.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:19.870+0000 7fd07adff700 1 -- 172.21.15.142:0/4010387190 wait complete. 2023-09-21T12:54:19.873 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:54:19.888 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:54:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:19 smithi156 ceph-mon[134078]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:19 smithi156 ceph-mon[134078]: pgmap v273: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 3.6 KiB/s wr, 9 op/s 2023-09-21T12:54:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:19 smithi156 ceph-mon[134078]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:19 smithi156 ceph-mon[134078]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-21T12:54:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:19 smithi160 ceph-mon[134450]: from='client.14607 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:19 smithi160 ceph-mon[134450]: pgmap v273: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 887 B/s rd, 3.6 KiB/s wr, 9 op/s 2023-09-21T12:54:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:19 smithi160 ceph-mon[134450]: from='client.14619 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:19 smithi160 ceph-mon[134450]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-21T12:54:20.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 -- 172.21.15.142:0/2656390954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 msgr2=0x7febd8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 --2- 172.21.15.142:0/2656390954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8101200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7febd40099c0 tx=0x7febd4009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 -- 172.21.15.142:0/2656390954 shutdown_connections 2023-09-21T12:54:20.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 --2- 172.21.15.142:0/2656390954 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8101200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 --2- 172.21.15.142:0/2656390954 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8102970 0x7febd8109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 --2- 172.21.15.142:0/2656390954 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8101fd0 0x7febd8102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 -- 172.21.15.142:0/2656390954 >> 172.21.15.142:0/2656390954 conn(0x7febd80fc310 msgr2=0x7febd80fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:20.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 -- 172.21.15.142:0/2656390954 shutdown_connections 2023-09-21T12:54:20.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.087+0000 7febdf5ff700 1 -- 172.21.15.142:0/2656390954 wait complete. 2023-09-21T12:54:20.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.088+0000 7febdf5ff700 1 Processor -- start 2023-09-21T12:54:20.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.088+0000 7febdf5ff700 1 -- start start 2023-09-21T12:54:20.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.088+0000 7febdf5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.088+0000 7febdf5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 0x7febd8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdf5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8102970 0x7febd819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdf5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd819e5d0 con 0x7febd8100de0 2023-09-21T12:54:20.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdf5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd819e710 con 0x7febd8101fd0 2023-09-21T12:54:20.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdf5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd819e8a0 con 0x7febd8102970 2023-09-21T12:54:20.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55422/0 (socket says 172.21.15.142:55422) 2023-09-21T12:54:20.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 -- 172.21.15.142:0/776279150 learned_addr learned my addr 172.21.15.142:0/776279150 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:20.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdcb9a700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 0x7febd8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febddb9c700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8102970 0x7febd819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 -- 172.21.15.142:0/776279150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8102970 msgr2=0x7febd819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8102970 0x7febd819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 -- 172.21.15.142:0/776279150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 msgr2=0x7febd8196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 0x7febd8196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 -- 172.21.15.142:0/776279150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40095f0 con 0x7febd8100de0 2023-09-21T12:54:20.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdcb9a700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 0x7febd8196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:20.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.089+0000 7febdd39b700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7febd40058e0 tx=0x7febd400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:20.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.090+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd401d070 con 0x7febd8100de0 2023-09-21T12:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.090+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7febd4005510 con 0x7febd8100de0 2023-09-21T12:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.090+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd819eb20 con 0x7febd8100de0 2023-09-21T12:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.090+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4004c70 con 0x7febd8100de0 2023-09-21T12:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.090+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd819efa0 con 0x7febd8100de0 2023-09-21T12:54:20.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.091+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd810c5f0 con 0x7febd8100de0 2023-09-21T12:54:20.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.093+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7febd400fc60 con 0x7febd8100de0 2023-09-21T12:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.094+0000 7febce7fc700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 0x7febc40a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.094+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7febd40ccf60 con 0x7febd8100de0 2023-09-21T12:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.094+0000 7febdcb9a700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 0x7febc40a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.095+0000 7febdcb9a700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 0x7febc40a2c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7febc8009cb0 tx=0x7febc8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:20.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.096+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7febd4096a70 con 0x7febd8100de0 2023-09-21T12:54:20.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.298+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febd8107ce0 con 0x7febd8100de0 2023-09-21T12:54:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.299+0000 7febce7fc700 1 -- 172.21.15.142:0/776279150 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22167 (secure 0 0 0) 0x7febd409a090 con 0x7febd8100de0 2023-09-21T12:54:20.301 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:20.302 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":84,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:13.422565+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.301+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 msgr2=0x7febc40a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.301+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 0x7febc40a2c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7febc8009cb0 tx=0x7febc8009260 comp rx=0 tx=0).stop 2023-09-21T12:54:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 msgr2=0x7febd8196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7febd40058e0 tx=0x7febd400f740 comp rx=0 tx=0).stop 2023-09-21T12:54:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 shutdown_connections 2023-09-21T12:54:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7febc40a0790 0x7febc40a2c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7febd8100de0 0x7febd8196a50 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febd8102970 0x7febd819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 --2- 172.21.15.142:0/776279150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7febd8101fd0 0x7febd8196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 >> 172.21.15.142:0/776279150 conn(0x7febd80fc310 msgr2=0x7febd80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 shutdown_connections 2023-09-21T12:54:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.302+0000 7febdf5ff700 1 -- 172.21.15.142:0/776279150 wait complete. 2023-09-21T12:54:20.320 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-21T12:54:20.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T12:54:20.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 -- 172.21.15.142:0/2177225498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 msgr2=0x7f9ed410b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/2177225498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed410b140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00b0a0 tx=0x7f9ecc00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 -- 172.21.15.142:0/2177225498 shutdown_connections 2023-09-21T12:54:20.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/2177225498 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed410b140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/2177225498 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/2177225498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 -- 172.21.15.142:0/2177225498 >> 172.21.15.142:0/2177225498 conn(0x7f9ed40fc320 msgr2=0x7f9ed40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:20.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.525+0000 7f9edb3ff700 1 -- 172.21.15.142:0/2177225498 shutdown_connections 2023-09-21T12:54:20.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.526+0000 7f9edb3ff700 1 -- 172.21.15.142:0/2177225498 wait complete. 2023-09-21T12:54:20.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.526+0000 7f9edb3ff700 1 Processor -- start 2023-09-21T12:54:20.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 -- start start 2023-09-21T12:54:20.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a08d0 con 0x7f9ed4108cb0 2023-09-21T12:54:20.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a0a10 con 0x7f9ed4074e20 2023-09-21T12:54:20.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9edb3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed41a0ba0 con 0x7f9ed4073840 2023-09-21T12:54:20.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed899a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55452/0 (socket says 172.21.15.142:55452) 2023-09-21T12:54:20.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed899a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38242/0 (socket says 172.21.15.142:38242) 2023-09-21T12:54:20.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed999c700 1 -- 172.21.15.142:0/3427111458 learned_addr learned my addr 172.21.15.142:0/3427111458 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:20.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.527+0000 7f9ed919b700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 -- 172.21.15.142:0/3427111458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 msgr2=0x7f9ed4198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 -- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 msgr2=0x7f9ed41a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 -- 172.21.15.142:0/3427111458 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc009d00 con 0x7f9ed4074e20 2023-09-21T12:54:20.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed919b700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed999c700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9ed899a700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d720 tx=0x7f9ec400da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4004a30 con 0x7f9ed4074e20 2023-09-21T12:54:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ec40054e0 con 0x7f9ed4074e20 2023-09-21T12:54:20.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed41a0e80 con 0x7f9ed4074e20 2023-09-21T12:54:20.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400fc30 con 0x7f9ed4074e20 2023-09-21T12:54:20.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.528+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed41a1300 con 0x7f9ed4074e20 2023-09-21T12:54:20.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.529+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed4107360 con 0x7f9ed4074e20 2023-09-21T12:54:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.531+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f9ec400fd90 con 0x7f9ed4074e20 2023-09-21T12:54:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.532+0000 7f9eca7fc700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 0x7f9ec00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:20.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.532+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ec40cba80 con 0x7f9ed4074e20 2023-09-21T12:54:20.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.533+0000 7f9ed919b700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 0x7f9ec00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:20.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.533+0000 7f9ed919b700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 0x7f9ec00a2bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009c90 tx=0x7f9ed0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:20.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.536+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9ec4095500 con 0x7f9ed4074e20 2023-09-21T12:54:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:20 smithi142 ceph-mon[97663]: from='client.24664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:20 smithi142 ceph-mon[97663]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:20 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4010387190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:20.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:20 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/776279150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:20.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.737+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ed402d260 con 0x7f9ec00a0710 2023-09-21T12:54:20.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.750+0000 7f9eca7fc700 1 -- 172.21.15.142:0/3427111458 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335595 (secure 0 0 0) 0x7f9ed402d260 con 0x7f9ec00a0710 2023-09-21T12:54:20.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:20.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.754+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 msgr2=0x7f9ec00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.754+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 0x7f9ec00a2bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009c90 tx=0x7f9ed0009260 comp rx=0 tx=0).stop 2023-09-21T12:54:20.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.754+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 msgr2=0x7f9ed4199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:20.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.754+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9ec400d720 tx=0x7f9ec400da30 comp rx=0 tx=0).stop 2023-09-21T12:54:20.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.754+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 shutdown_connections 2023-09-21T12:54:20.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f9ec00a0710 0x7f9ec00a2bd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9ed4108cb0 0x7f9ed41a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ed4073840 0x7f9ed4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 --2- 172.21.15.142:0/3427111458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9ed4074e20 0x7f9ed4199290 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:20.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 >> 172.21.15.142:0/3427111458 conn(0x7f9ed40fc320 msgr2=0x7f9ed40fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:20.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 shutdown_connections 2023-09-21T12:54:20.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:20.755+0000 7f9edb3ff700 1 -- 172.21.15.142:0/3427111458 wait complete. 2023-09-21T12:54:20.761 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:54:20.773 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2023-09-21T12:54:20.368236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":613067,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":289,"num_write_kb":2987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335120,"kb_used_data":10924,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606704,"statfs":{"total":1151940427776,"available":1151597264896,"internally_reserved":0,"allocated":11186176,"data_stored":6985696,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22699,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":23,"num_read_kb":35,"num_write":108,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467903+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:54:13.467903+0000","last_peered":"2023-09-21T12:54:13.467903+0000","last_clean":"2023-09-21T12:54:13.467903+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:54:13.467903+0000","last_undegraded":"2023-09-21T12:54:13.467903+0000","last_fullsized":"2023-09-21T12:54:13.467903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467996+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:54:13.467996+0000","last_peered":"2023-09-21T12:54:13.467996+0000","last_clean":"2023-09-21T12:54:13.467996+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:54:13.467996+0000","last_undegraded":"2023-09-21T12:54:13.467996+0000","last_fullsized":"2023-09-21T12:54:13.467996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468340+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:54:13.468340+0000","last_peered":"2023-09-21T12:54:13.468340+0000","last_clean":"2023-09-21T12:54:13.468340+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:54:13.468340+0000","last_undegraded":"2023-09-21T12:54:13.468340+0000","last_fullsized":"2023-09-21T12:54:13.468340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467279+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:54:13.467279+0000","last_peered":"2023-09-21T12:54:13.467279+0000","last_clean":"2023-09-21T12:54:13.467279+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:54:13.467279+0000","last_undegraded":"2023-09-21T12:54:13.467279+0000","last_fullsized":"2023-09-21T12:54:13.467279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431149+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:54:13.431149+0000","last_peered":"2023-09-21T12:54:13.431149+0000","last_clean":"2023-09-21T12:54:13.431149+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:54:13.431149+0000","last_undegraded":"2023-09-21T12:54:13.431149+0000","last_fullsized":"2023-09-21T12:54:13.431149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430488+0000","last_change":"2023-09-21T12:54:12.453774+0000","last_active":"2023-09-21T12:54:13.430488+0000","last_peered":"2023-09-21T12:54:13.430488+0000","last_clean":"2023-09-21T12:54:13.430488+0000","last_became_active":"2023-09-21T12:54:12.453438+0000","last_became_peered":"2023-09-21T12:54:12.453438+0000","last_unstale":"2023-09-21T12:54:13.430488+0000","last_undegraded":"2023-09-21T12:54:13.430488+0000","last_fullsized":"2023-09-21T12:54:13.430488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:38:18.631438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554371+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:54:13.554371+0000","last_peered":"2023-09-21T12:54:13.554371+0000","last_clean":"2023-09-21T12:54:13.554371+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:54:13.554371+0000","last_undegraded":"2023-09-21T12:54:13.554371+0000","last_fullsized":"2023-09-21T12:54:13.554371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469358+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:54:13.469358+0000","last_peered":"2023-09-21T12:54:13.469358+0000","last_clean":"2023-09-21T12:54:13.469358+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:54:13.469358+0000","last_undegraded":"2023-09-21T12:54:13.469358+0000","last_fullsized":"2023-09-21T12:54:13.469358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451415+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:54:13.451415+0000","last_peered":"2023-09-21T12:54:13.451415+0000","last_clean":"2023-09-21T12:54:13.451415+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:54:13.451415+0000","last_undegraded":"2023-09-21T12:54:13.451415+0000","last_fullsized":"2023-09-21T12:54:13.451415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430793+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:54:13.430793+0000","last_peered":"2023-09-21T12:54:13.430793+0000","last_clean":"2023-09-21T12:54:13.430793+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:54:13.430793+0000","last_undegraded":"2023-09-21T12:54:13.430793+0000","last_fullsized":"2023-09-21T12:54:13.430793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554670+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:54:13.554670+0000","last_peered":"2023-09-21T12:54:13.554670+0000","last_clean":"2023-09-21T12:54:13.554670+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:54:13.554670+0000","last_undegraded":"2023-09-21T12:54:13.554670+0000","last_fullsized":"2023-09-21T12:54:13.554670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467153+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:54:13.467153+0000","last_peered":"2023-09-21T12:54:13.467153+0000","last_clean":"2023-09-21T12:54:13.467153+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:54:13.467153+0000","last_undegraded":"2023-09-21T12:54:13.467153+0000","last_fullsized":"2023-09-21T12:54:13.467153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468743+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:54:13.468743+0000","last_peered":"2023-09-21T12:54:13.468743+0000","last_clean":"2023-09-21T12:54:13.468743+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:54:13.468743+0000","last_undegraded":"2023-09-21T12:54:13.468743+0000","last_fullsized":"2023-09-21T12:54:13.468743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467873+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:54:13.467873+0000","last_peered":"2023-09-21T12:54:13.467873+0000","last_clean":"2023-09-21T12:54:13.467873+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:54:13.467873+0000","last_undegraded":"2023-09-21T12:54:13.467873+0000","last_fullsized":"2023-09-21T12:54:13.467873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467785+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:54:13.467785+0000","last_peered":"2023-09-21T12:54:13.467785+0000","last_clean":"2023-09-21T12:54:13.467785+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:54:13.467785+0000","last_undegraded":"2023-09-21T12:54:13.467785+0000","last_fullsized":"2023-09-21T12:54:13.467785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.450959+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:54:13.450959+0000","last_peered":"2023-09-21T12:54:13.450959+0000","last_clean":"2023-09-21T12:54:13.450959+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:54:13.450959+0000","last_undegraded":"2023-09-21T12:54:13.450959+0000","last_fullsized":"2023-09-21T12:54:13.450959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468168+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:54:13.468168+0000","last_peered":"2023-09-21T12:54:13.468168+0000","last_clean":"2023-09-21T12:54:13.468168+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:54:13.468168+0000","last_undegraded":"2023-09-21T12:54:13.468168+0000","last_fullsized":"2023-09-21T12:54:13.468168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431042+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:54:13.431042+0000","last_peered":"2023-09-21T12:54:13.431042+0000","last_clean":"2023-09-21T12:54:13.431042+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:54:13.431042+0000","last_undegraded":"2023-09-21T12:54:13.431042+0000","last_fullsized":"2023-09-21T12:54:13.431042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467944+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:54:13.467944+0000","last_peered":"2023-09-21T12:54:13.467944+0000","last_clean":"2023-09-21T12:54:13.467944+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:54:13.467944+0000","last_undegraded":"2023-09-21T12:54:13.467944+0000","last_fullsized":"2023-09-21T12:54:13.467944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.471061+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:12.471061+0000","last_peered":"2023-09-21T12:54:12.471061+0000","last_clean":"2023-09-21T12:54:12.471061+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:12.471061+0000","last_undegraded":"2023-09-21T12:54:12.471061+0000","last_fullsized":"2023-09-21T12:54:12.471061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469957+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:54:13.469957+0000","last_peered":"2023-09-21T12:54:13.469957+0000","last_clean":"2023-09-21T12:54:13.469957+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:54:13.469957+0000","last_undegraded":"2023-09-21T12:54:13.469957+0000","last_fullsized":"2023-09-21T12:54:13.469957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:14.412370+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:14.412370+0000","last_peered":"2023-09-21T12:54:14.412370+0000","last_clean":"2023-09-21T12:54:14.412370+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:14.412370+0000","last_undegraded":"2023-09-21T12:54:14.412370+0000","last_fullsized":"2023-09-21T12:54:14.412370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469087+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:54:13.469087+0000","last_peered":"2023-09-21T12:54:13.469087+0000","last_clean":"2023-09-21T12:54:13.469087+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:54:13.469087+0000","last_undegraded":"2023-09-21T12:54:13.469087+0000","last_fullsized":"2023-09-21T12:54:13.469087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431381+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:13.431381+0000","last_peered":"2023-09-21T12:54:13.431381+0000","last_clean":"2023-09-21T12:54:13.431381+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:13.431381+0000","last_undegraded":"2023-09-21T12:54:13.431381+0000","last_fullsized":"2023-09-21T12:54:13.431381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451178+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:54:13.451178+0000","last_peered":"2023-09-21T12:54:13.451178+0000","last_clean":"2023-09-21T12:54:13.451178+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:54:13.451178+0000","last_undegraded":"2023-09-21T12:54:13.451178+0000","last_fullsized":"2023-09-21T12:54:13.451178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431282+0000","last_change":"2023-09-21T12:54:11.459569+0000","last_active":"2023-09-21T12:54:13.431282+0000","last_peered":"2023-09-21T12:54:13.431282+0000","last_clean":"2023-09-21T12:54:13.431282+0000","last_became_active":"2023-09-21T12:54:11.459253+0000","last_became_peered":"2023-09-21T12:54:11.459253+0000","last_unstale":"2023-09-21T12:54:13.431282+0000","last_undegraded":"2023-09-21T12:54:13.431282+0000","last_fullsized":"2023-09-21T12:54:13.431282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:56:53.213394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468154+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:54:13.468154+0000","last_peered":"2023-09-21T12:54:13.468154+0000","last_clean":"2023-09-21T12:54:13.468154+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:54:13.468154+0000","last_undegraded":"2023-09-21T12:54:13.468154+0000","last_fullsized":"2023-09-21T12:54:13.468154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.430625+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:54:16.430625+0000","last_peered":"2023-09-21T12:54:16.430625+0000","last_clean":"2023-09-21T12:54:16.430625+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:54:16.430625+0000","last_undegraded":"2023-09-21T12:54:16.430625+0000","last_fullsized":"2023-09-21T12:54:16.430625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431146+0000","last_change":"2023-09-21T12:54:12.454672+0000","last_active":"2023-09-21T12:54:13.431146+0000","last_peered":"2023-09-21T12:54:13.431146+0000","last_clean":"2023-09-21T12:54:13.431146+0000","last_became_active":"2023-09-21T12:54:12.454341+0000","last_became_peered":"2023-09-21T12:54:12.454341+0000","last_unstale":"2023-09-21T12:54:13.431146+0000","last_undegraded":"2023-09-21T12:54:13.431146+0000","last_fullsized":"2023-09-21T12:54:13.431146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:57:32.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.439263+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:16.439263+0000","last_peered":"2023-09-21T12:54:16.439263+0000","last_clean":"2023-09-21T12:54:16.439263+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:16.439263+0000","last_undegraded":"2023-09-21T12:54:16.439263+0000","last_fullsized":"2023-09-21T12:54:16.439263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468120+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:54:13.468120+0000","last_peered":"2023-09-21T12:54:13.468120+0000","last_clean":"2023-09-21T12:54:13.468120+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:54:13.468120+0000","last_undegraded":"2023-09-21T12:54:13.468120+0000","last_fullsized":"2023-09-21T12:54:13.468120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.439965+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:16.439965+0000","last_peered":"2023-09-21T12:54:16.439965+0000","last_clean":"2023-09-21T12:54:16.439965+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:16.439965+0000","last_undegraded":"2023-09-21T12:54:16.439965+0000","last_fullsized":"2023-09-21T12:54:16.439965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469811+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:54:13.469811+0000","last_peered":"2023-09-21T12:54:13.469811+0000","last_clean":"2023-09-21T12:54:13.469811+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:54:13.469811+0000","last_undegraded":"2023-09-21T12:54:13.469811+0000","last_fullsized":"2023-09-21T12:54:13.469811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467030+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:13.467030+0000","last_peered":"2023-09-21T12:54:13.467030+0000","last_clean":"2023-09-21T12:54:13.467030+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:13.467030+0000","last_undegraded":"2023-09-21T12:54:13.467030+0000","last_fullsized":"2023-09-21T12:54:13.467030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430772+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:54:13.430772+0000","last_peered":"2023-09-21T12:54:13.430772+0000","last_clean":"2023-09-21T12:54:13.430772+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:54:13.430772+0000","last_undegraded":"2023-09-21T12:54:13.430772+0000","last_fullsized":"2023-09-21T12:54:13.430772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:17.433028+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:54:17.433028+0000","last_peered":"2023-09-21T12:54:17.433028+0000","last_clean":"2023-09-21T12:54:17.433028+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:54:17.433028+0000","last_undegraded":"2023-09-21T12:54:17.433028+0000","last_fullsized":"2023-09-21T12:54:17.433028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451314+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:54:13.451314+0000","last_peered":"2023-09-21T12:54:13.451314+0000","last_clean":"2023-09-21T12:54:13.451314+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:54:13.451314+0000","last_undegraded":"2023-09-21T12:54:13.451314+0000","last_fullsized":"2023-09-21T12:54:13.451314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493093+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:15.493093+0000","last_peered":"2023-09-21T12:54:15.493093+0000","last_clean":"2023-09-21T12:54:15.493093+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:15.493093+0000","last_undegraded":"2023-09-21T12:54:15.493093+0000","last_fullsized":"2023-09-21T12:54:15.493093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468929+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:54:13.468929+0000","last_peered":"2023-09-21T12:54:13.468929+0000","last_clean":"2023-09-21T12:54:13.468929+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:54:13.468929+0000","last_undegraded":"2023-09-21T12:54:13.468929+0000","last_fullsized":"2023-09-21T12:54:13.468929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493068+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:15.493068+0000","last_peered":"2023-09-21T12:54:15.493068+0000","last_clean":"2023-09-21T12:54:15.493068+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:15.493068+0000","last_undegraded":"2023-09-21T12:54:15.493068+0000","last_fullsized":"2023-09-21T12:54:15.493068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451350+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:54:13.451350+0000","last_peered":"2023-09-21T12:54:13.451350+0000","last_clean":"2023-09-21T12:54:13.451350+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:54:13.451350+0000","last_undegraded":"2023-09-21T12:54:13.451350+0000","last_fullsized":"2023-09-21T12:54:13.451350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'14","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:18.436605+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:54:18.436605+0000","last_peered":"2023-09-21T12:54:18.436605+0000","last_clean":"2023-09-21T12:54:18.436605+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:54:18.436605+0000","last_undegraded":"2023-09-21T12:54:18.436605+0000","last_fullsized":"2023-09-21T12:54:18.436605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":22,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431243+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:54:13.431243+0000","last_peered":"2023-09-21T12:54:13.431243+0000","last_clean":"2023-09-21T12:54:13.431243+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:54:13.431243+0000","last_undegraded":"2023-09-21T12:54:13.431243+0000","last_fullsized":"2023-09-21T12:54:13.431243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.440826+0000","last_change":"2023-09-21T12:54:11.460253+0000","last_active":"2023-09-21T12:54:16.440826+0000","last_peered":"2023-09-21T12:54:16.440826+0000","last_clean":"2023-09-21T12:54:16.440826+0000","last_became_active":"2023-09-21T12:54:11.459940+0000","last_became_peered":"2023-09-21T12:54:11.459940+0000","last_unstale":"2023-09-21T12:54:16.440826+0000","last_undegraded":"2023-09-21T12:54:16.440826+0000","last_fullsized":"2023-09-21T12:54:16.440826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:41:42.521687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467879+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:54:13.467879+0000","last_peered":"2023-09-21T12:54:13.467879+0000","last_clean":"2023-09-21T12:54:13.467879+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:54:13.467879+0000","last_undegraded":"2023-09-21T12:54:13.467879+0000","last_fullsized":"2023-09-21T12:54:13.467879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.495149+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:15.495149+0000","last_peered":"2023-09-21T12:54:15.495149+0000","last_clean":"2023-09-21T12:54:15.495149+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:15.495149+0000","last_undegraded":"2023-09-21T12:54:15.495149+0000","last_fullsized":"2023-09-21T12:54:15.495149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554623+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:54:13.554623+0000","last_peered":"2023-09-21T12:54:13.554623+0000","last_clean":"2023-09-21T12:54:13.554623+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:54:13.554623+0000","last_undegraded":"2023-09-21T12:54:13.554623+0000","last_fullsized":"2023-09-21T12:54:13.554623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.438076+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:54:16.438076+0000","last_peered":"2023-09-21T12:54:16.438076+0000","last_clean":"2023-09-21T12:54:16.438076+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:54:16.438076+0000","last_undegraded":"2023-09-21T12:54:16.438076+0000","last_fullsized":"2023-09-21T12:54:16.438076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554243+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:54:13.554243+0000","last_peered":"2023-09-21T12:54:13.554243+0000","last_clean":"2023-09-21T12:54:13.554243+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:54:13.554243+0000","last_undegraded":"2023-09-21T12:54:13.554243+0000","last_fullsized":"2023-09-21T12:54:13.554243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430963+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:13.430963+0000","last_peered":"2023-09-21T12:54:13.430963+0000","last_clean":"2023-09-21T12:54:13.430963+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:13.430963+0000","last_undegraded":"2023-09-21T12:54:13.430963+0000","last_fullsized":"2023-09-21T12:54:13.430963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467521+0000","last_change":"2023-09-21T12:54:12.437253+0000","last_active":"2023-09-21T12:54:13.467521+0000","last_peered":"2023-09-21T12:54:13.467521+0000","last_clean":"2023-09-21T12:54:13.467521+0000","last_became_active":"2023-09-21T12:54:12.436916+0000","last_became_peered":"2023-09-21T12:54:12.436916+0000","last_unstale":"2023-09-21T12:54:13.467521+0000","last_undegraded":"2023-09-21T12:54:13.467521+0000","last_fullsized":"2023-09-21T12:54:13.467521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:21:56.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431354+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:13.431354+0000","last_peered":"2023-09-21T12:54:13.431354+0000","last_clean":"2023-09-21T12:54:13.431354+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:13.431354+0000","last_undegraded":"2023-09-21T12:54:13.431354+0000","last_fullsized":"2023-09-21T12:54:13.431354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467505+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:54:13.467505+0000","last_peered":"2023-09-21T12:54:13.467505+0000","last_clean":"2023-09-21T12:54:13.467505+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:54:13.467505+0000","last_undegraded":"2023-09-21T12:54:13.467505+0000","last_fullsized":"2023-09-21T12:54:13.467505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.451555+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:12.451555+0000","last_peered":"2023-09-21T12:54:12.451555+0000","last_clean":"2023-09-21T12:54:12.451555+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:12.451555+0000","last_undegraded":"2023-09-21T12:54:12.451555+0000","last_fullsized":"2023-09-21T12:54:12.451555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.614146+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:54:13.614146+0000","last_peered":"2023-09-21T12:54:13.614146+0000","last_clean":"2023-09-21T12:54:13.614146+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:54:13.614146+0000","last_undegraded":"2023-09-21T12:54:13.614146+0000","last_fullsized":"2023-09-21T12:54:13.614146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.291696+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:15.291696+0000","last_peered":"2023-09-21T12:54:15.291696+0000","last_clean":"2023-09-21T12:54:15.291696+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:15.291696+0000","last_undegraded":"2023-09-21T12:54:15.291696+0000","last_fullsized":"2023-09-21T12:54:15.291696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430512+0000","last_change":"2023-09-21T12:54:12.451114+0000","last_active":"2023-09-21T12:54:13.430512+0000","last_peered":"2023-09-21T12:54:13.430512+0000","last_clean":"2023-09-21T12:54:13.430512+0000","last_became_active":"2023-09-21T12:54:12.450775+0000","last_became_peered":"2023-09-21T12:54:12.450775+0000","last_unstale":"2023-09-21T12:54:13.430512+0000","last_undegraded":"2023-09-21T12:54:13.430512+0000","last_fullsized":"2023-09-21T12:54:13.430512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:42:14.922579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467674+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:54:13.467674+0000","last_peered":"2023-09-21T12:54:13.467674+0000","last_clean":"2023-09-21T12:54:13.467674+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:54:13.467674+0000","last_undegraded":"2023-09-21T12:54:13.467674+0000","last_fullsized":"2023-09-21T12:54:13.467674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:17.440428+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:54:17.440428+0000","last_peered":"2023-09-21T12:54:17.440428+0000","last_clean":"2023-09-21T12:54:17.440428+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:54:17.440428+0000","last_undegraded":"2023-09-21T12:54:17.440428+0000","last_fullsized":"2023-09-21T12:54:17.440428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469956+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:54:13.469956+0000","last_peered":"2023-09-21T12:54:13.469956+0000","last_clean":"2023-09-21T12:54:13.469956+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:54:13.469956+0000","last_undegraded":"2023-09-21T12:54:13.469956+0000","last_fullsized":"2023-09-21T12:54:13.469956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.428268+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:16.428268+0000","last_peered":"2023-09-21T12:54:16.428268+0000","last_clean":"2023-09-21T12:54:16.428268+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:16.428268+0000","last_undegraded":"2023-09-21T12:54:16.428268+0000","last_fullsized":"2023-09-21T12:54:16.428268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":318,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.435413+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:12.435413+0000","last_peered":"2023-09-21T12:54:12.435413+0000","last_clean":"2023-09-21T12:54:12.435413+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:12.435413+0000","last_undegraded":"2023-09-21T12:54:12.435413+0000","last_fullsized":"2023-09-21T12:54:12.435413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468300+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:54:13.468300+0000","last_peered":"2023-09-21T12:54:13.468300+0000","last_clean":"2023-09-21T12:54:13.468300+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:54:13.468300+0000","last_undegraded":"2023-09-21T12:54:13.468300+0000","last_fullsized":"2023-09-21T12:54:13.468300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.438858+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:16.438858+0000","last_peered":"2023-09-21T12:54:16.438858+0000","last_clean":"2023-09-21T12:54:16.438858+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:16.438858+0000","last_undegraded":"2023-09-21T12:54:16.438858+0000","last_fullsized":"2023-09-21T12:54:16.438858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431306+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:13.431306+0000","last_peered":"2023-09-21T12:54:13.431306+0000","last_clean":"2023-09-21T12:54:13.431306+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:13.431306+0000","last_undegraded":"2023-09-21T12:54:13.431306+0000","last_fullsized":"2023-09-21T12:54:13.431306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468019+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:54:13.468019+0000","last_peered":"2023-09-21T12:54:13.468019+0000","last_clean":"2023-09-21T12:54:13.468019+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:54:13.468019+0000","last_undegraded":"2023-09-21T12:54:13.468019+0000","last_fullsized":"2023-09-21T12:54:13.468019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.453261+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:12.453261+0000","last_peered":"2023-09-21T12:54:12.453261+0000","last_clean":"2023-09-21T12:54:12.453261+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:12.453261+0000","last_undegraded":"2023-09-21T12:54:12.453261+0000","last_fullsized":"2023-09-21T12:54:12.453261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469914+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:54:13.469914+0000","last_peered":"2023-09-21T12:54:13.469914+0000","last_clean":"2023-09-21T12:54:13.469914+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:54:13.469914+0000","last_undegraded":"2023-09-21T12:54:13.469914+0000","last_fullsized":"2023-09-21T12:54:13.469914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.491818+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:15.491818+0000","last_peered":"2023-09-21T12:54:15.491818+0000","last_clean":"2023-09-21T12:54:15.491818+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:15.491818+0000","last_undegraded":"2023-09-21T12:54:15.491818+0000","last_fullsized":"2023-09-21T12:54:15.491818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468136+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:54:13.468136+0000","last_peered":"2023-09-21T12:54:13.468136+0000","last_clean":"2023-09-21T12:54:13.468136+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:54:13.468136+0000","last_undegraded":"2023-09-21T12:54:13.468136+0000","last_fullsized":"2023-09-21T12:54:13.468136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493328+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:15.493328+0000","last_peered":"2023-09-21T12:54:15.493328+0000","last_clean":"2023-09-21T12:54:15.493328+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:15.493328+0000","last_undegraded":"2023-09-21T12:54:15.493328+0000","last_fullsized":"2023-09-21T12:54:15.493328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431041+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:54:13.431041+0000","last_peered":"2023-09-21T12:54:13.431041+0000","last_clean":"2023-09-21T12:54:13.431041+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:54:13.431041+0000","last_undegraded":"2023-09-21T12:54:13.431041+0000","last_fullsized":"2023-09-21T12:54:13.431041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.494996+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:15.494996+0000","last_peered":"2023-09-21T12:54:15.494996+0000","last_clean":"2023-09-21T12:54:15.494996+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:15.494996+0000","last_undegraded":"2023-09-21T12:54:15.494996+0000","last_fullsized":"2023-09-21T12:54:15.494996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467357+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:54:13.467357+0000","last_peered":"2023-09-21T12:54:13.467357+0000","last_clean":"2023-09-21T12:54:13.467357+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:54:13.467357+0000","last_undegraded":"2023-09-21T12:54:13.467357+0000","last_fullsized":"2023-09-21T12:54:13.467357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:14.669902+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:14.669902+0000","last_peered":"2023-09-21T12:54:14.669902+0000","last_clean":"2023-09-21T12:54:14.669902+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:14.669902+0000","last_undegraded":"2023-09-21T12:54:14.669902+0000","last_fullsized":"2023-09-21T12:54:14.669902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469575+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:54:13.469575+0000","last_peered":"2023-09-21T12:54:13.469575+0000","last_clean":"2023-09-21T12:54:13.469575+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:54:13.469575+0000","last_undegraded":"2023-09-21T12:54:13.469575+0000","last_fullsized":"2023-09-21T12:54:13.469575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431087+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:13.431087+0000","last_peered":"2023-09-21T12:54:13.431087+0000","last_clean":"2023-09-21T12:54:13.431087+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:13.431087+0000","last_undegraded":"2023-09-21T12:54:13.431087+0000","last_fullsized":"2023-09-21T12:54:13.431087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554614+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:54:13.554614+0000","last_peered":"2023-09-21T12:54:13.554614+0000","last_clean":"2023-09-21T12:54:13.554614+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:54:13.554614+0000","last_undegraded":"2023-09-21T12:54:13.554614+0000","last_fullsized":"2023-09-21T12:54:13.554614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.441234+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:16.441234+0000","last_peered":"2023-09-21T12:54:16.441234+0000","last_clean":"2023-09-21T12:54:16.441234+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:16.441234+0000","last_undegraded":"2023-09-21T12:54:16.441234+0000","last_fullsized":"2023-09-21T12:54:16.441234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554600+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:54:13.554600+0000","last_peered":"2023-09-21T12:54:13.554600+0000","last_clean":"2023-09-21T12:54:13.554600+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:54:13.554600+0000","last_undegraded":"2023-09-21T12:54:13.554600+0000","last_fullsized":"2023-09-21T12:54:13.554600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468046+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:13.468046+0000","last_peered":"2023-09-21T12:54:13.468046+0000","last_clean":"2023-09-21T12:54:13.468046+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:13.468046+0000","last_undegraded":"2023-09-21T12:54:13.468046+0000","last_fullsized":"2023-09-21T12:54:13.468046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.291738+0000","last_change":"2023-09-21T12:54:12.449227+0000","last_active":"2023-09-21T12:54:15.291738+0000","last_peered":"2023-09-21T12:54:15.291738+0000","last_clean":"2023-09-21T12:54:15.291738+0000","last_became_active":"2023-09-21T12:54:12.448921+0000","last_became_peered":"2023-09-21T12:54:12.448921+0000","last_unstale":"2023-09-21T12:54:15.291738+0000","last_undegraded":"2023-09-21T12:54:15.291738+0000","last_fullsized":"2023-09-21T12:54:15.291738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:54:06.372900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468223+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:13.468223+0000","last_peered":"2023-09-21T12:54:13.468223+0000","last_clean":"2023-09-21T12:54:13.468223+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:13.468223+0000","last_undegraded":"2023-09-21T12:54:13.468223+0000","last_fullsized":"2023-09-21T12:54:13.468223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554636+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:54:13.554636+0000","last_peered":"2023-09-21T12:54:13.554636+0000","last_clean":"2023-09-21T12:54:13.554636+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:54:13.554636+0000","last_undegraded":"2023-09-21T12:54:13.554636+0000","last_fullsized":"2023-09-21T12:54:13.554636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467295+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:54:13.467295+0000","last_peered":"2023-09-21T12:54:13.467295+0000","last_clean":"2023-09-21T12:54:13.467295+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:54:13.467295+0000","last_undegraded":"2023-09-21T12:54:13.467295+0000","last_fullsized":"2023-09-21T12:54:13.467295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467909+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:54:13.467909+0000","last_peered":"2023-09-21T12:54:13.467909+0000","last_clean":"2023-09-21T12:54:13.467909+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:54:13.467909+0000","last_undegraded":"2023-09-21T12:54:13.467909+0000","last_fullsized":"2023-09-21T12:54:13.467909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467418+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:54:13.467418+0000","last_peered":"2023-09-21T12:54:13.467418+0000","last_clean":"2023-09-21T12:54:13.467418+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:54:13.467418+0000","last_undegraded":"2023-09-21T12:54:13.467418+0000","last_fullsized":"2023-09-21T12:54:13.467418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469199+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:54:13.469199+0000","last_peered":"2023-09-21T12:54:13.469199+0000","last_clean":"2023-09-21T12:54:13.469199+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:54:13.469199+0000","last_undegraded":"2023-09-21T12:54:13.469199+0000","last_fullsized":"2023-09-21T12:54:13.469199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468101+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:54:13.468101+0000","last_peered":"2023-09-21T12:54:13.468101+0000","last_clean":"2023-09-21T12:54:13.468101+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:54:13.468101+0000","last_undegraded":"2023-09-21T12:54:13.468101+0000","last_fullsized":"2023-09-21T12:54:13.468101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467367+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:54:13.467367+0000","last_peered":"2023-09-21T12:54:13.467367+0000","last_clean":"2023-09-21T12:54:13.467367+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:54:13.467367+0000","last_undegraded":"2023-09-21T12:54:13.467367+0000","last_fullsized":"2023-09-21T12:54:13.467367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467837+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:54:13.467837+0000","last_peered":"2023-09-21T12:54:13.467837+0000","last_clean":"2023-09-21T12:54:13.467837+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:54:13.467837+0000","last_undegraded":"2023-09-21T12:54:13.467837+0000","last_fullsized":"2023-09-21T12:54:13.467837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469905+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:54:13.469905+0000","last_peered":"2023-09-21T12:54:13.469905+0000","last_clean":"2023-09-21T12:54:13.469905+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:54:13.469905+0000","last_undegraded":"2023-09-21T12:54:13.469905+0000","last_fullsized":"2023-09-21T12:54:13.469905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467110+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:54:13.467110+0000","last_peered":"2023-09-21T12:54:13.467110+0000","last_clean":"2023-09-21T12:54:13.467110+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:54:13.467110+0000","last_undegraded":"2023-09-21T12:54:13.467110+0000","last_fullsized":"2023-09-21T12:54:13.467110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.470086+0000","last_change":"2023-09-21T12:54:12.435902+0000","last_active":"2023-09-21T12:54:13.470086+0000","last_peered":"2023-09-21T12:54:13.470086+0000","last_clean":"2023-09-21T12:54:13.470086+0000","last_became_active":"2023-09-21T12:54:12.435569+0000","last_became_peered":"2023-09-21T12:54:12.435569+0000","last_unstale":"2023-09-21T12:54:13.470086+0000","last_undegraded":"2023-09-21T12:54:13.470086+0000","last_fullsized":"2023-09-21T12:54:13.470086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:39:09.116415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451154+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:54:13.451154+0000","last_peered":"2023-09-21T12:54:13.451154+0000","last_clean":"2023-09-21T12:54:13.451154+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:54:13.451154+0000","last_undegraded":"2023-09-21T12:54:13.451154+0000","last_fullsized":"2023-09-21T12:54:13.451154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468613+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:54:13.468613+0000","last_peered":"2023-09-21T12:54:13.468613+0000","last_clean":"2023-09-21T12:54:13.468613+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:54:13.468613+0000","last_undegraded":"2023-09-21T12:54:13.468613+0000","last_fullsized":"2023-09-21T12:54:13.468613+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467553+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:54:13.467553+0000","last_peered":"2023-09-21T12:54:13.467553+0000","last_clean":"2023-09-21T12:54:13.467553+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:54:13.467553+0000","last_undegraded":"2023-09-21T12:54:13.467553+0000","last_fullsized":"2023-09-21T12:54:13.467553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22453,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":35,"num_write":106,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":103769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":429451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645328,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":1039974,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.747}]},{"osd":3,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81599999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.58699999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":9,"up_from":67,"seq":287762808853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.748}]},{"osd":2,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.504},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.629}]},{"osd":5,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.79800000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":429473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501}]},{"osd":1,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:53:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1021932,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41599999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.505},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.71399999999999997}]},{"osd":8,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":428959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.437},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.244,"15min":1.244},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.028,"15min":1.028},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.752},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88700000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:53:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96799999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":447573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.505,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.51900000000000002,"15min":0.48499999999999999},"min":{"1min":0.47299999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.44,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.77200000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.754},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.504,"15min":0.499},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Sep 21 12:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Sep 21 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.82399999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.93100000000000005}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.88},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.97399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55400000000000005,"15min":0.498},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.121,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.748}]},{"osd":2,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88500000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Sep 21 12:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.629,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.55100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.329,"15min":1.329},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78100000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:53:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":449586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.54200000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.372,"15min":0.372},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Sep 21 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56699999999999995,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Sep 21 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85099999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.94299999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":429399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58699999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.44,"15min":0.42399999999999999},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.746,"15min":0.746},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.51500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.5},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84999999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.48099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Sep 21 12:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.069,"15min":1.069},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":0.999,"15min":0.999},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71099999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888108,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":429240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.375},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.54700000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497}]},{"osd":3,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.498,"5min":0.38,"15min":0.38},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.52900000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.876,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.56000000000000005},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96599999999999997,"5min":1,"15min":1},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.628,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.60099999999999998,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.65100000000000002}]},{"osd":9,"last update":"Thu Sep 21 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74099999999999999}]},{"osd":10,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":1020382,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.33500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.745}]},{"osd":1,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.5}]},{"osd":2,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":0.622,"15min":0.622},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64600000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.877,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.82399999999999995}]},{"osd":10,"last update":"Thu Sep 21 12:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":38025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:54:20.783 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T12:54:20.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:20 smithi156 ceph-mon[134078]: from='client.24664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:20 smithi156 ceph-mon[134078]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:20 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4010387190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:20.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:20 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/776279150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:20 smithi160 ceph-mon[134450]: from='client.24664 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:20 smithi160 ceph-mon[134450]: from='client.14631 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:54:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:20 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4010387190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:54:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:20 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/776279150' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:21.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 -- 172.21.15.142:0/1813769601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 msgr2=0x7fba84102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:21.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 --2- 172.21.15.142:0/1813769601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba84102430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba780099c0 tx=0x7fba78009cd0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 -- 172.21.15.142:0/1813769601 shutdown_connections 2023-09-21T12:54:21.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 --2- 172.21.15.142:0/1813769601 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84102970 0x7fba84109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 --2- 172.21.15.142:0/1813769601 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84100de0 0x7fba84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 --2- 172.21.15.142:0/1813769601 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba84102430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 -- 172.21.15.142:0/1813769601 >> 172.21.15.142:0/1813769601 conn(0x7fba840fc310 msgr2=0x7fba840fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:21.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 -- 172.21.15.142:0/1813769601 shutdown_connections 2023-09-21T12:54:21.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.010+0000 7fba893ff700 1 -- 172.21.15.142:0/1813769601 wait complete. 2023-09-21T12:54:21.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.011+0000 7fba893ff700 1 Processor -- start 2023-09-21T12:54:21.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.011+0000 7fba893ff700 1 -- start start 2023-09-21T12:54:21.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:21.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba841991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:21.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84102970 0x7fba841a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:21.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba841a0810 con 0x7fba84101fd0 2023-09-21T12:54:21.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba841a0980 con 0x7fba84100de0 2023-09-21T12:54:21.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba893ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba841a0b40 con 0x7fba84102970 2023-09-21T12:54:21.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba841991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:21.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba82ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:21.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba82ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38260/0 (socket says 172.21.15.142:38260) 2023-09-21T12:54:21.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba82ffd700 1 -- 172.21.15.142:0/895676844 learned_addr learned my addr 172.21.15.142:0/895676844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:21.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba837fe700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84102970 0x7fba841a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:21.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 -- 172.21.15.142:0/895676844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84102970 msgr2=0x7fba841a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:21.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84102970 0x7fba841a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 -- 172.21.15.142:0/895676844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 msgr2=0x7fba84198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:21.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba827fc700 1 -- 172.21.15.142:0/895676844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba780095f0 con 0x7fba84101fd0 2023-09-21T12:54:21.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.012+0000 7fba82ffd700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:21.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba827fc700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba841991e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba78009fd0 tx=0x7fba78009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:21.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7801d070 con 0x7fba84101fd0 2023-09-21T12:54:21.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba78005020 con 0x7fba84101fd0 2023-09-21T12:54:21.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba841a0dc0 con 0x7fba84101fd0 2023-09-21T12:54:21.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78004a90 con 0x7fba84101fd0 2023-09-21T12:54:21.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.013+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba841a1190 con 0x7fba84101fd0 2023-09-21T12:54:21.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.014+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8410c5f0 con 0x7fba84101fd0 2023-09-21T12:54:21.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.016+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fba78005190 con 0x7fba84101fd0 2023-09-21T12:54:21.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.017+0000 7fba6bfff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 0x7fba6c0a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:21.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.017+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fba780cc650 con 0x7fba84101fd0 2023-09-21T12:54:21.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.017+0000 7fba82ffd700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 0x7fba6c0a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:21.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.018+0000 7fba82ffd700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 0x7fba6c0a2c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba84199b70 tx=0x7fba74009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:21.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.021+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fba78096160 con 0x7fba84101fd0 2023-09-21T12:54:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.218+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba84108920 con 0x7fba6c0a0790 2023-09-21T12:54:21.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.228+0000 7fba6bfff700 1 -- 172.21.15.142:0/895676844 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335595 (secure 0 0 0) 0x7fba84108920 con 0x7fba6c0a0790 2023-09-21T12:54:21.232 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 msgr2=0x7fba6c0a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 0x7fba6c0a2c50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba84199b70 tx=0x7fba74009260 comp rx=0 tx=0).stop 2023-09-21T12:54:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 msgr2=0x7fba841991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba841991e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba78009fd0 tx=0x7fba78009580 comp rx=0 tx=0).stop 2023-09-21T12:54:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 shutdown_connections 2023-09-21T12:54:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba6c0a0790 0x7fba6c0a2c50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba84102970 0x7fba841a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba84100de0 0x7fba84198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 --2- 172.21.15.142:0/895676844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba84101fd0 0x7fba841991e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 >> 172.21.15.142:0/895676844 conn(0x7fba840fc310 msgr2=0x7fba840fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 shutdown_connections 2023-09-21T12:54:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:21.233+0000 7fba893ff700 1 -- 172.21.15.142:0/895676844 wait complete. 2023-09-21T12:54:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:54:21.251 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2023-09-21T12:54:20.368236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":613067,"num_objects":52,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":159,"num_read_kb":154,"num_write":289,"num_write_kb":2987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335120,"kb_used_data":10924,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606704,"statfs":{"total":1151940427776,"available":1151597264896,"internally_reserved":0,"allocated":11186176,"data_stored":6985696,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22699,"num_objects":50,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":23,"num_read_kb":35,"num_write":108,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001809"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467903+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:54:13.467903+0000","last_peered":"2023-09-21T12:54:13.467903+0000","last_clean":"2023-09-21T12:54:13.467903+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:54:13.467903+0000","last_undegraded":"2023-09-21T12:54:13.467903+0000","last_fullsized":"2023-09-21T12:54:13.467903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467996+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:54:13.467996+0000","last_peered":"2023-09-21T12:54:13.467996+0000","last_clean":"2023-09-21T12:54:13.467996+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:54:13.467996+0000","last_undegraded":"2023-09-21T12:54:13.467996+0000","last_fullsized":"2023-09-21T12:54:13.467996+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468340+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:54:13.468340+0000","last_peered":"2023-09-21T12:54:13.468340+0000","last_clean":"2023-09-21T12:54:13.468340+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:54:13.468340+0000","last_undegraded":"2023-09-21T12:54:13.468340+0000","last_fullsized":"2023-09-21T12:54:13.468340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467279+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:54:13.467279+0000","last_peered":"2023-09-21T12:54:13.467279+0000","last_clean":"2023-09-21T12:54:13.467279+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:54:13.467279+0000","last_undegraded":"2023-09-21T12:54:13.467279+0000","last_fullsized":"2023-09-21T12:54:13.467279+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431149+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:54:13.431149+0000","last_peered":"2023-09-21T12:54:13.431149+0000","last_clean":"2023-09-21T12:54:13.431149+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:54:13.431149+0000","last_undegraded":"2023-09-21T12:54:13.431149+0000","last_fullsized":"2023-09-21T12:54:13.431149+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430488+0000","last_change":"2023-09-21T12:54:12.453774+0000","last_active":"2023-09-21T12:54:13.430488+0000","last_peered":"2023-09-21T12:54:13.430488+0000","last_clean":"2023-09-21T12:54:13.430488+0000","last_became_active":"2023-09-21T12:54:12.453438+0000","last_became_peered":"2023-09-21T12:54:12.453438+0000","last_unstale":"2023-09-21T12:54:13.430488+0000","last_undegraded":"2023-09-21T12:54:13.430488+0000","last_fullsized":"2023-09-21T12:54:13.430488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:38:18.631438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554371+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:54:13.554371+0000","last_peered":"2023-09-21T12:54:13.554371+0000","last_clean":"2023-09-21T12:54:13.554371+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:54:13.554371+0000","last_undegraded":"2023-09-21T12:54:13.554371+0000","last_fullsized":"2023-09-21T12:54:13.554371+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469358+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:54:13.469358+0000","last_peered":"2023-09-21T12:54:13.469358+0000","last_clean":"2023-09-21T12:54:13.469358+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:54:13.469358+0000","last_undegraded":"2023-09-21T12:54:13.469358+0000","last_fullsized":"2023-09-21T12:54:13.469358+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451415+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:54:13.451415+0000","last_peered":"2023-09-21T12:54:13.451415+0000","last_clean":"2023-09-21T12:54:13.451415+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:54:13.451415+0000","last_undegraded":"2023-09-21T12:54:13.451415+0000","last_fullsized":"2023-09-21T12:54:13.451415+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430793+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:54:13.430793+0000","last_peered":"2023-09-21T12:54:13.430793+0000","last_clean":"2023-09-21T12:54:13.430793+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:54:13.430793+0000","last_undegraded":"2023-09-21T12:54:13.430793+0000","last_fullsized":"2023-09-21T12:54:13.430793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554670+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:54:13.554670+0000","last_peered":"2023-09-21T12:54:13.554670+0000","last_clean":"2023-09-21T12:54:13.554670+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:54:13.554670+0000","last_undegraded":"2023-09-21T12:54:13.554670+0000","last_fullsized":"2023-09-21T12:54:13.554670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467153+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:54:13.467153+0000","last_peered":"2023-09-21T12:54:13.467153+0000","last_clean":"2023-09-21T12:54:13.467153+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:54:13.467153+0000","last_undegraded":"2023-09-21T12:54:13.467153+0000","last_fullsized":"2023-09-21T12:54:13.467153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468743+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:54:13.468743+0000","last_peered":"2023-09-21T12:54:13.468743+0000","last_clean":"2023-09-21T12:54:13.468743+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:54:13.468743+0000","last_undegraded":"2023-09-21T12:54:13.468743+0000","last_fullsized":"2023-09-21T12:54:13.468743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467873+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:54:13.467873+0000","last_peered":"2023-09-21T12:54:13.467873+0000","last_clean":"2023-09-21T12:54:13.467873+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:54:13.467873+0000","last_undegraded":"2023-09-21T12:54:13.467873+0000","last_fullsized":"2023-09-21T12:54:13.467873+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467785+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:54:13.467785+0000","last_peered":"2023-09-21T12:54:13.467785+0000","last_clean":"2023-09-21T12:54:13.467785+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:54:13.467785+0000","last_undegraded":"2023-09-21T12:54:13.467785+0000","last_fullsized":"2023-09-21T12:54:13.467785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.450959+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:54:13.450959+0000","last_peered":"2023-09-21T12:54:13.450959+0000","last_clean":"2023-09-21T12:54:13.450959+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:54:13.450959+0000","last_undegraded":"2023-09-21T12:54:13.450959+0000","last_fullsized":"2023-09-21T12:54:13.450959+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468168+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:54:13.468168+0000","last_peered":"2023-09-21T12:54:13.468168+0000","last_clean":"2023-09-21T12:54:13.468168+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:54:13.468168+0000","last_undegraded":"2023-09-21T12:54:13.468168+0000","last_fullsized":"2023-09-21T12:54:13.468168+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431042+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:54:13.431042+0000","last_peered":"2023-09-21T12:54:13.431042+0000","last_clean":"2023-09-21T12:54:13.431042+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:54:13.431042+0000","last_undegraded":"2023-09-21T12:54:13.431042+0000","last_fullsized":"2023-09-21T12:54:13.431042+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467944+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:54:13.467944+0000","last_peered":"2023-09-21T12:54:13.467944+0000","last_clean":"2023-09-21T12:54:13.467944+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:54:13.467944+0000","last_undegraded":"2023-09-21T12:54:13.467944+0000","last_fullsized":"2023-09-21T12:54:13.467944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.471061+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:12.471061+0000","last_peered":"2023-09-21T12:54:12.471061+0000","last_clean":"2023-09-21T12:54:12.471061+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:12.471061+0000","last_undegraded":"2023-09-21T12:54:12.471061+0000","last_fullsized":"2023-09-21T12:54:12.471061+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469957+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:54:13.469957+0000","last_peered":"2023-09-21T12:54:13.469957+0000","last_clean":"2023-09-21T12:54:13.469957+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:54:13.469957+0000","last_undegraded":"2023-09-21T12:54:13.469957+0000","last_fullsized":"2023-09-21T12:54:13.469957+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:14.412370+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:14.412370+0000","last_peered":"2023-09-21T12:54:14.412370+0000","last_clean":"2023-09-21T12:54:14.412370+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:14.412370+0000","last_undegraded":"2023-09-21T12:54:14.412370+0000","last_fullsized":"2023-09-21T12:54:14.412370+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469087+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:54:13.469087+0000","last_peered":"2023-09-21T12:54:13.469087+0000","last_clean":"2023-09-21T12:54:13.469087+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:54:13.469087+0000","last_undegraded":"2023-09-21T12:54:13.469087+0000","last_fullsized":"2023-09-21T12:54:13.469087+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431381+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:13.431381+0000","last_peered":"2023-09-21T12:54:13.431381+0000","last_clean":"2023-09-21T12:54:13.431381+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:13.431381+0000","last_undegraded":"2023-09-21T12:54:13.431381+0000","last_fullsized":"2023-09-21T12:54:13.431381+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451178+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:54:13.451178+0000","last_peered":"2023-09-21T12:54:13.451178+0000","last_clean":"2023-09-21T12:54:13.451178+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:54:13.451178+0000","last_undegraded":"2023-09-21T12:54:13.451178+0000","last_fullsized":"2023-09-21T12:54:13.451178+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431282+0000","last_change":"2023-09-21T12:54:11.459569+0000","last_active":"2023-09-21T12:54:13.431282+0000","last_peered":"2023-09-21T12:54:13.431282+0000","last_clean":"2023-09-21T12:54:13.431282+0000","last_became_active":"2023-09-21T12:54:11.459253+0000","last_became_peered":"2023-09-21T12:54:11.459253+0000","last_unstale":"2023-09-21T12:54:13.431282+0000","last_undegraded":"2023-09-21T12:54:13.431282+0000","last_fullsized":"2023-09-21T12:54:13.431282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:56:53.213394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468154+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:54:13.468154+0000","last_peered":"2023-09-21T12:54:13.468154+0000","last_clean":"2023-09-21T12:54:13.468154+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:54:13.468154+0000","last_undegraded":"2023-09-21T12:54:13.468154+0000","last_fullsized":"2023-09-21T12:54:13.468154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.430625+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:54:16.430625+0000","last_peered":"2023-09-21T12:54:16.430625+0000","last_clean":"2023-09-21T12:54:16.430625+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:54:16.430625+0000","last_undegraded":"2023-09-21T12:54:16.430625+0000","last_fullsized":"2023-09-21T12:54:16.430625+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431146+0000","last_change":"2023-09-21T12:54:12.454672+0000","last_active":"2023-09-21T12:54:13.431146+0000","last_peered":"2023-09-21T12:54:13.431146+0000","last_clean":"2023-09-21T12:54:13.431146+0000","last_became_active":"2023-09-21T12:54:12.454341+0000","last_became_peered":"2023-09-21T12:54:12.454341+0000","last_unstale":"2023-09-21T12:54:13.431146+0000","last_undegraded":"2023-09-21T12:54:13.431146+0000","last_fullsized":"2023-09-21T12:54:13.431146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:57:32.260515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.439263+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:16.439263+0000","last_peered":"2023-09-21T12:54:16.439263+0000","last_clean":"2023-09-21T12:54:16.439263+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:16.439263+0000","last_undegraded":"2023-09-21T12:54:16.439263+0000","last_fullsized":"2023-09-21T12:54:16.439263+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468120+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:54:13.468120+0000","last_peered":"2023-09-21T12:54:13.468120+0000","last_clean":"2023-09-21T12:54:13.468120+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:54:13.468120+0000","last_undegraded":"2023-09-21T12:54:13.468120+0000","last_fullsized":"2023-09-21T12:54:13.468120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.439965+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:16.439965+0000","last_peered":"2023-09-21T12:54:16.439965+0000","last_clean":"2023-09-21T12:54:16.439965+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:16.439965+0000","last_undegraded":"2023-09-21T12:54:16.439965+0000","last_fullsized":"2023-09-21T12:54:16.439965+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469811+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:54:13.469811+0000","last_peered":"2023-09-21T12:54:13.469811+0000","last_clean":"2023-09-21T12:54:13.469811+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:54:13.469811+0000","last_undegraded":"2023-09-21T12:54:13.469811+0000","last_fullsized":"2023-09-21T12:54:13.469811+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467030+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:13.467030+0000","last_peered":"2023-09-21T12:54:13.467030+0000","last_clean":"2023-09-21T12:54:13.467030+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:13.467030+0000","last_undegraded":"2023-09-21T12:54:13.467030+0000","last_fullsized":"2023-09-21T12:54:13.467030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430772+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:54:13.430772+0000","last_peered":"2023-09-21T12:54:13.430772+0000","last_clean":"2023-09-21T12:54:13.430772+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:54:13.430772+0000","last_undegraded":"2023-09-21T12:54:13.430772+0000","last_fullsized":"2023-09-21T12:54:13.430772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:17.433028+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:54:17.433028+0000","last_peered":"2023-09-21T12:54:17.433028+0000","last_clean":"2023-09-21T12:54:17.433028+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:54:17.433028+0000","last_undegraded":"2023-09-21T12:54:17.433028+0000","last_fullsized":"2023-09-21T12:54:17.433028+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451314+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:54:13.451314+0000","last_peered":"2023-09-21T12:54:13.451314+0000","last_clean":"2023-09-21T12:54:13.451314+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:54:13.451314+0000","last_undegraded":"2023-09-21T12:54:13.451314+0000","last_fullsized":"2023-09-21T12:54:13.451314+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493093+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:15.493093+0000","last_peered":"2023-09-21T12:54:15.493093+0000","last_clean":"2023-09-21T12:54:15.493093+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:15.493093+0000","last_undegraded":"2023-09-21T12:54:15.493093+0000","last_fullsized":"2023-09-21T12:54:15.493093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468929+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:54:13.468929+0000","last_peered":"2023-09-21T12:54:13.468929+0000","last_clean":"2023-09-21T12:54:13.468929+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:54:13.468929+0000","last_undegraded":"2023-09-21T12:54:13.468929+0000","last_fullsized":"2023-09-21T12:54:13.468929+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493068+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:15.493068+0000","last_peered":"2023-09-21T12:54:15.493068+0000","last_clean":"2023-09-21T12:54:15.493068+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:15.493068+0000","last_undegraded":"2023-09-21T12:54:15.493068+0000","last_fullsized":"2023-09-21T12:54:15.493068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451350+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:54:13.451350+0000","last_peered":"2023-09-21T12:54:13.451350+0000","last_clean":"2023-09-21T12:54:13.451350+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:54:13.451350+0000","last_undegraded":"2023-09-21T12:54:13.451350+0000","last_fullsized":"2023-09-21T12:54:13.451350+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'14","reported_seq":36,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:18.436605+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:54:18.436605+0000","last_peered":"2023-09-21T12:54:18.436605+0000","last_clean":"2023-09-21T12:54:18.436605+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:54:18.436605+0000","last_undegraded":"2023-09-21T12:54:18.436605+0000","last_fullsized":"2023-09-21T12:54:18.436605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":22,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431243+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:54:13.431243+0000","last_peered":"2023-09-21T12:54:13.431243+0000","last_clean":"2023-09-21T12:54:13.431243+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:54:13.431243+0000","last_undegraded":"2023-09-21T12:54:13.431243+0000","last_fullsized":"2023-09-21T12:54:13.431243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.440826+0000","last_change":"2023-09-21T12:54:11.460253+0000","last_active":"2023-09-21T12:54:16.440826+0000","last_peered":"2023-09-21T12:54:16.440826+0000","last_clean":"2023-09-21T12:54:16.440826+0000","last_became_active":"2023-09-21T12:54:11.459940+0000","last_became_peered":"2023-09-21T12:54:11.459940+0000","last_unstale":"2023-09-21T12:54:16.440826+0000","last_undegraded":"2023-09-21T12:54:16.440826+0000","last_fullsized":"2023-09-21T12:54:16.440826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:41:42.521687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467879+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:54:13.467879+0000","last_peered":"2023-09-21T12:54:13.467879+0000","last_clean":"2023-09-21T12:54:13.467879+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:54:13.467879+0000","last_undegraded":"2023-09-21T12:54:13.467879+0000","last_fullsized":"2023-09-21T12:54:13.467879+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.495149+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:15.495149+0000","last_peered":"2023-09-21T12:54:15.495149+0000","last_clean":"2023-09-21T12:54:15.495149+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:15.495149+0000","last_undegraded":"2023-09-21T12:54:15.495149+0000","last_fullsized":"2023-09-21T12:54:15.495149+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554623+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:54:13.554623+0000","last_peered":"2023-09-21T12:54:13.554623+0000","last_clean":"2023-09-21T12:54:13.554623+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:54:13.554623+0000","last_undegraded":"2023-09-21T12:54:13.554623+0000","last_fullsized":"2023-09-21T12:54:13.554623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.438076+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:54:16.438076+0000","last_peered":"2023-09-21T12:54:16.438076+0000","last_clean":"2023-09-21T12:54:16.438076+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:54:16.438076+0000","last_undegraded":"2023-09-21T12:54:16.438076+0000","last_fullsized":"2023-09-21T12:54:16.438076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554243+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:54:13.554243+0000","last_peered":"2023-09-21T12:54:13.554243+0000","last_clean":"2023-09-21T12:54:13.554243+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:54:13.554243+0000","last_undegraded":"2023-09-21T12:54:13.554243+0000","last_fullsized":"2023-09-21T12:54:13.554243+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430963+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:13.430963+0000","last_peered":"2023-09-21T12:54:13.430963+0000","last_clean":"2023-09-21T12:54:13.430963+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:13.430963+0000","last_undegraded":"2023-09-21T12:54:13.430963+0000","last_fullsized":"2023-09-21T12:54:13.430963+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467521+0000","last_change":"2023-09-21T12:54:12.437253+0000","last_active":"2023-09-21T12:54:13.467521+0000","last_peered":"2023-09-21T12:54:13.467521+0000","last_clean":"2023-09-21T12:54:13.467521+0000","last_became_active":"2023-09-21T12:54:12.436916+0000","last_became_peered":"2023-09-21T12:54:12.436916+0000","last_unstale":"2023-09-21T12:54:13.467521+0000","last_undegraded":"2023-09-21T12:54:13.467521+0000","last_fullsized":"2023-09-21T12:54:13.467521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:21:56.334337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431354+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:13.431354+0000","last_peered":"2023-09-21T12:54:13.431354+0000","last_clean":"2023-09-21T12:54:13.431354+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:13.431354+0000","last_undegraded":"2023-09-21T12:54:13.431354+0000","last_fullsized":"2023-09-21T12:54:13.431354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467505+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:54:13.467505+0000","last_peered":"2023-09-21T12:54:13.467505+0000","last_clean":"2023-09-21T12:54:13.467505+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:54:13.467505+0000","last_undegraded":"2023-09-21T12:54:13.467505+0000","last_fullsized":"2023-09-21T12:54:13.467505+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.451555+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:12.451555+0000","last_peered":"2023-09-21T12:54:12.451555+0000","last_clean":"2023-09-21T12:54:12.451555+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:12.451555+0000","last_undegraded":"2023-09-21T12:54:12.451555+0000","last_fullsized":"2023-09-21T12:54:12.451555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.614146+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:54:13.614146+0000","last_peered":"2023-09-21T12:54:13.614146+0000","last_clean":"2023-09-21T12:54:13.614146+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:54:13.614146+0000","last_undegraded":"2023-09-21T12:54:13.614146+0000","last_fullsized":"2023-09-21T12:54:13.614146+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.291696+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:15.291696+0000","last_peered":"2023-09-21T12:54:15.291696+0000","last_clean":"2023-09-21T12:54:15.291696+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:15.291696+0000","last_undegraded":"2023-09-21T12:54:15.291696+0000","last_fullsized":"2023-09-21T12:54:15.291696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.430512+0000","last_change":"2023-09-21T12:54:12.451114+0000","last_active":"2023-09-21T12:54:13.430512+0000","last_peered":"2023-09-21T12:54:13.430512+0000","last_clean":"2023-09-21T12:54:13.430512+0000","last_became_active":"2023-09-21T12:54:12.450775+0000","last_became_peered":"2023-09-21T12:54:12.450775+0000","last_unstale":"2023-09-21T12:54:13.430512+0000","last_undegraded":"2023-09-21T12:54:13.430512+0000","last_fullsized":"2023-09-21T12:54:13.430512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:42:14.922579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467674+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:54:13.467674+0000","last_peered":"2023-09-21T12:54:13.467674+0000","last_clean":"2023-09-21T12:54:13.467674+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:54:13.467674+0000","last_undegraded":"2023-09-21T12:54:13.467674+0000","last_fullsized":"2023-09-21T12:54:13.467674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:17.440428+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:54:17.440428+0000","last_peered":"2023-09-21T12:54:17.440428+0000","last_clean":"2023-09-21T12:54:17.440428+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:54:17.440428+0000","last_undegraded":"2023-09-21T12:54:17.440428+0000","last_fullsized":"2023-09-21T12:54:17.440428+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469956+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:54:13.469956+0000","last_peered":"2023-09-21T12:54:13.469956+0000","last_clean":"2023-09-21T12:54:13.469956+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:54:13.469956+0000","last_undegraded":"2023-09-21T12:54:13.469956+0000","last_fullsized":"2023-09-21T12:54:13.469956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.428268+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:16.428268+0000","last_peered":"2023-09-21T12:54:16.428268+0000","last_clean":"2023-09-21T12:54:16.428268+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:16.428268+0000","last_undegraded":"2023-09-21T12:54:16.428268+0000","last_fullsized":"2023-09-21T12:54:16.428268+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":318,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.435413+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:12.435413+0000","last_peered":"2023-09-21T12:54:12.435413+0000","last_clean":"2023-09-21T12:54:12.435413+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:12.435413+0000","last_undegraded":"2023-09-21T12:54:12.435413+0000","last_fullsized":"2023-09-21T12:54:12.435413+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468300+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:54:13.468300+0000","last_peered":"2023-09-21T12:54:13.468300+0000","last_clean":"2023-09-21T12:54:13.468300+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:54:13.468300+0000","last_undegraded":"2023-09-21T12:54:13.468300+0000","last_fullsized":"2023-09-21T12:54:13.468300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.438858+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:16.438858+0000","last_peered":"2023-09-21T12:54:16.438858+0000","last_clean":"2023-09-21T12:54:16.438858+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:16.438858+0000","last_undegraded":"2023-09-21T12:54:16.438858+0000","last_fullsized":"2023-09-21T12:54:16.438858+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431306+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:13.431306+0000","last_peered":"2023-09-21T12:54:13.431306+0000","last_clean":"2023-09-21T12:54:13.431306+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:13.431306+0000","last_undegraded":"2023-09-21T12:54:13.431306+0000","last_fullsized":"2023-09-21T12:54:13.431306+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468019+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:54:13.468019+0000","last_peered":"2023-09-21T12:54:13.468019+0000","last_clean":"2023-09-21T12:54:13.468019+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:54:13.468019+0000","last_undegraded":"2023-09-21T12:54:13.468019+0000","last_fullsized":"2023-09-21T12:54:13.468019+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-21T12:54:12.453261+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:12.453261+0000","last_peered":"2023-09-21T12:54:12.453261+0000","last_clean":"2023-09-21T12:54:12.453261+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:12.453261+0000","last_undegraded":"2023-09-21T12:54:12.453261+0000","last_fullsized":"2023-09-21T12:54:12.453261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469914+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:54:13.469914+0000","last_peered":"2023-09-21T12:54:13.469914+0000","last_clean":"2023-09-21T12:54:13.469914+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:54:13.469914+0000","last_undegraded":"2023-09-21T12:54:13.469914+0000","last_fullsized":"2023-09-21T12:54:13.469914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.491818+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:15.491818+0000","last_peered":"2023-09-21T12:54:15.491818+0000","last_clean":"2023-09-21T12:54:15.491818+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:15.491818+0000","last_undegraded":"2023-09-21T12:54:15.491818+0000","last_fullsized":"2023-09-21T12:54:15.491818+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468136+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:54:13.468136+0000","last_peered":"2023-09-21T12:54:13.468136+0000","last_clean":"2023-09-21T12:54:13.468136+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:54:13.468136+0000","last_undegraded":"2023-09-21T12:54:13.468136+0000","last_fullsized":"2023-09-21T12:54:13.468136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.493328+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:15.493328+0000","last_peered":"2023-09-21T12:54:15.493328+0000","last_clean":"2023-09-21T12:54:15.493328+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:15.493328+0000","last_undegraded":"2023-09-21T12:54:15.493328+0000","last_fullsized":"2023-09-21T12:54:15.493328+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431041+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:54:13.431041+0000","last_peered":"2023-09-21T12:54:13.431041+0000","last_clean":"2023-09-21T12:54:13.431041+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:54:13.431041+0000","last_undegraded":"2023-09-21T12:54:13.431041+0000","last_fullsized":"2023-09-21T12:54:13.431041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.494996+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:15.494996+0000","last_peered":"2023-09-21T12:54:15.494996+0000","last_clean":"2023-09-21T12:54:15.494996+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:15.494996+0000","last_undegraded":"2023-09-21T12:54:15.494996+0000","last_fullsized":"2023-09-21T12:54:15.494996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467357+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:54:13.467357+0000","last_peered":"2023-09-21T12:54:13.467357+0000","last_clean":"2023-09-21T12:54:13.467357+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:54:13.467357+0000","last_undegraded":"2023-09-21T12:54:13.467357+0000","last_fullsized":"2023-09-21T12:54:13.467357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:14.669902+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:14.669902+0000","last_peered":"2023-09-21T12:54:14.669902+0000","last_clean":"2023-09-21T12:54:14.669902+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:14.669902+0000","last_undegraded":"2023-09-21T12:54:14.669902+0000","last_fullsized":"2023-09-21T12:54:14.669902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469575+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:54:13.469575+0000","last_peered":"2023-09-21T12:54:13.469575+0000","last_clean":"2023-09-21T12:54:13.469575+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:54:13.469575+0000","last_undegraded":"2023-09-21T12:54:13.469575+0000","last_fullsized":"2023-09-21T12:54:13.469575+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.431087+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:13.431087+0000","last_peered":"2023-09-21T12:54:13.431087+0000","last_clean":"2023-09-21T12:54:13.431087+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:13.431087+0000","last_undegraded":"2023-09-21T12:54:13.431087+0000","last_fullsized":"2023-09-21T12:54:13.431087+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554614+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:54:13.554614+0000","last_peered":"2023-09-21T12:54:13.554614+0000","last_clean":"2023-09-21T12:54:13.554614+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:54:13.554614+0000","last_undegraded":"2023-09-21T12:54:13.554614+0000","last_fullsized":"2023-09-21T12:54:13.554614+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:16.441234+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:16.441234+0000","last_peered":"2023-09-21T12:54:16.441234+0000","last_clean":"2023-09-21T12:54:16.441234+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:16.441234+0000","last_undegraded":"2023-09-21T12:54:16.441234+0000","last_fullsized":"2023-09-21T12:54:16.441234+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554600+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:54:13.554600+0000","last_peered":"2023-09-21T12:54:13.554600+0000","last_clean":"2023-09-21T12:54:13.554600+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:54:13.554600+0000","last_undegraded":"2023-09-21T12:54:13.554600+0000","last_fullsized":"2023-09-21T12:54:13.554600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468046+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:13.468046+0000","last_peered":"2023-09-21T12:54:13.468046+0000","last_clean":"2023-09-21T12:54:13.468046+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:13.468046+0000","last_undegraded":"2023-09-21T12:54:13.468046+0000","last_fullsized":"2023-09-21T12:54:13.468046+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:15.291738+0000","last_change":"2023-09-21T12:54:12.449227+0000","last_active":"2023-09-21T12:54:15.291738+0000","last_peered":"2023-09-21T12:54:15.291738+0000","last_clean":"2023-09-21T12:54:15.291738+0000","last_became_active":"2023-09-21T12:54:12.448921+0000","last_became_peered":"2023-09-21T12:54:12.448921+0000","last_unstale":"2023-09-21T12:54:15.291738+0000","last_undegraded":"2023-09-21T12:54:15.291738+0000","last_fullsized":"2023-09-21T12:54:15.291738+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:54:06.372900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468223+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:13.468223+0000","last_peered":"2023-09-21T12:54:13.468223+0000","last_clean":"2023-09-21T12:54:13.468223+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:13.468223+0000","last_undegraded":"2023-09-21T12:54:13.468223+0000","last_fullsized":"2023-09-21T12:54:13.468223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.554636+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:54:13.554636+0000","last_peered":"2023-09-21T12:54:13.554636+0000","last_clean":"2023-09-21T12:54:13.554636+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:54:13.554636+0000","last_undegraded":"2023-09-21T12:54:13.554636+0000","last_fullsized":"2023-09-21T12:54:13.554636+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467295+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:54:13.467295+0000","last_peered":"2023-09-21T12:54:13.467295+0000","last_clean":"2023-09-21T12:54:13.467295+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:54:13.467295+0000","last_undegraded":"2023-09-21T12:54:13.467295+0000","last_fullsized":"2023-09-21T12:54:13.467295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467909+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:54:13.467909+0000","last_peered":"2023-09-21T12:54:13.467909+0000","last_clean":"2023-09-21T12:54:13.467909+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:54:13.467909+0000","last_undegraded":"2023-09-21T12:54:13.467909+0000","last_fullsized":"2023-09-21T12:54:13.467909+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467418+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:54:13.467418+0000","last_peered":"2023-09-21T12:54:13.467418+0000","last_clean":"2023-09-21T12:54:13.467418+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:54:13.467418+0000","last_undegraded":"2023-09-21T12:54:13.467418+0000","last_fullsized":"2023-09-21T12:54:13.467418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469199+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:54:13.469199+0000","last_peered":"2023-09-21T12:54:13.469199+0000","last_clean":"2023-09-21T12:54:13.469199+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:54:13.469199+0000","last_undegraded":"2023-09-21T12:54:13.469199+0000","last_fullsized":"2023-09-21T12:54:13.469199+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468101+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:54:13.468101+0000","last_peered":"2023-09-21T12:54:13.468101+0000","last_clean":"2023-09-21T12:54:13.468101+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:54:13.468101+0000","last_undegraded":"2023-09-21T12:54:13.468101+0000","last_fullsized":"2023-09-21T12:54:13.468101+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467367+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:54:13.467367+0000","last_peered":"2023-09-21T12:54:13.467367+0000","last_clean":"2023-09-21T12:54:13.467367+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:54:13.467367+0000","last_undegraded":"2023-09-21T12:54:13.467367+0000","last_fullsized":"2023-09-21T12:54:13.467367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467837+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:54:13.467837+0000","last_peered":"2023-09-21T12:54:13.467837+0000","last_clean":"2023-09-21T12:54:13.467837+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:54:13.467837+0000","last_undegraded":"2023-09-21T12:54:13.467837+0000","last_fullsized":"2023-09-21T12:54:13.467837+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.469905+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:54:13.469905+0000","last_peered":"2023-09-21T12:54:13.469905+0000","last_clean":"2023-09-21T12:54:13.469905+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:54:13.469905+0000","last_undegraded":"2023-09-21T12:54:13.469905+0000","last_fullsized":"2023-09-21T12:54:13.469905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467110+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:54:13.467110+0000","last_peered":"2023-09-21T12:54:13.467110+0000","last_clean":"2023-09-21T12:54:13.467110+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:54:13.467110+0000","last_undegraded":"2023-09-21T12:54:13.467110+0000","last_fullsized":"2023-09-21T12:54:13.467110+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.470086+0000","last_change":"2023-09-21T12:54:12.435902+0000","last_active":"2023-09-21T12:54:13.470086+0000","last_peered":"2023-09-21T12:54:13.470086+0000","last_clean":"2023-09-21T12:54:13.470086+0000","last_became_active":"2023-09-21T12:54:12.435569+0000","last_became_peered":"2023-09-21T12:54:12.435569+0000","last_unstale":"2023-09-21T12:54:13.470086+0000","last_undegraded":"2023-09-21T12:54:13.470086+0000","last_fullsized":"2023-09-21T12:54:13.470086+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:39:09.116415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.451154+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:54:13.451154+0000","last_peered":"2023-09-21T12:54:13.451154+0000","last_clean":"2023-09-21T12:54:13.451154+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:54:13.451154+0000","last_undegraded":"2023-09-21T12:54:13.451154+0000","last_fullsized":"2023-09-21T12:54:13.451154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.468613+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:54:13.468613+0000","last_peered":"2023-09-21T12:54:13.468613+0000","last_clean":"2023-09-21T12:54:13.468613+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:54:13.468613+0000","last_undegraded":"2023-09-21T12:54:13.468613+0000","last_fullsized":"2023-09-21T12:54:13.468613+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-21T12:54:13.467553+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:54:13.467553+0000","last_peered":"2023-09-21T12:54:13.467553+0000","last_clean":"2023-09-21T12:54:13.467553+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:54:13.467553+0000","last_undegraded":"2023-09-21T12:54:13.467553+0000","last_fullsized":"2023-09-21T12:54:13.467553+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22453,"num_objects":48,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":23,"num_read_kb":35,"num_write":106,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":103769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416398,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":429451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645328,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":1039974,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.747}]},{"osd":3,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.628},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71499999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.81599999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.58699999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.84899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":9,"up_from":67,"seq":287762808853,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":429653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.33700000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.748}]},{"osd":2,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.504},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.75700000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.629}]},{"osd":5,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.492,"5min":1.492,"15min":1.492},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.78100000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.52100000000000002},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.58899999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.79800000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070490,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":905216,"data_stored":429473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.501}]},{"osd":1,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.63},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53200000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.70999999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:53:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299424,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1021932,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.438,"15min":0.436},"min":{"1min":0.32900000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.41599999999999998,"15min":0.41099999999999998},"min":{"1min":0.28499999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.754,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63300000000000001,"15min":0.63},"min":{"1min":0.43099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.505},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.627,"15min":0.626},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84499999999999997,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.32500000000000001,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.35599999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64500000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.63800000000000001}]},{"osd":6,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72899999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.71399999999999997}]},{"osd":8,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.84499999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72799999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.69799999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":6,"up_from":47,"seq":201863462948,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":428959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.45900000000000002,"15min":0.45100000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.437},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.47199999999999998,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.42099999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.58099999999999996,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.85199999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.63300000000000001,"15min":0.623},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59799999999999998,"15min":0.59399999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.75900000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68300000000000005,"15min":0.67700000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.51300000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.2070000000000001,"5min":1.244,"15min":1.244},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Sep 21 12:53:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69099999999999995,"15min":0.68799999999999994},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.71599999999999997,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.98799999999999999,"5min":1.028,"15min":1.028},"last":0.58599999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.747,"15min":0.74399999999999999},"min":{"1min":0.56299999999999994,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.752},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.77800000000000002,"15min":0.77600000000000002},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.88700000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:53:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.70099999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:53:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96799999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":447573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.505,"15min":0.47899999999999998},"min":{"1min":0.38500000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70699999999999996,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.51900000000000002,"15min":0.48499999999999999},"min":{"1min":0.47299999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.749,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.71099999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:53:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.56200000000000006,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84099999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.55600000000000005,"15min":0.54100000000000004},"min":{"1min":0.44,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.754,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.77200000000000002,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.754},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.504,"15min":0.499},"min":{"1min":0.32800000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Sep 21 12:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.80700000000000005}]},{"osd":6,"last update":"Thu Sep 21 12:53:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.65800000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60099999999999998,"15min":0.60199999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65100000000000002,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.82399999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.93100000000000005}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85099999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.88},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.97399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":430074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.55400000000000005,"15min":0.498},"min":{"1min":0.41099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.121,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.57899999999999996,"15min":0.52900000000000003},"min":{"1min":0.40200000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.95399999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.748}]},{"osd":2,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88500000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Sep 21 12:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:53:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.629,"15min":0.60299999999999998},"min":{"1min":0.46200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60799999999999998,"15min":0.59799999999999998},"min":{"1min":0.46200000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.55100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.44400000000000001,"5min":0.38,"15min":0.38},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70099999999999996,"15min":0.70299999999999996},"min":{"1min":0.42399999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.048,"5min":1.329,"15min":1.329},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.78100000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:53:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":2,"up_from":18,"seq":77309411383,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":449586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.54200000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57499999999999996}]},{"osd":1,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.74199999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:53:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56899999999999995},"min":{"1min":0.375,"5min":0.372,"15min":0.372},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58199999999999996,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85699999999999998,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Sep 21 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56699999999999995,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Sep 21 12:53:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68400000000000005,"15min":0.68899999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.66200000000000003},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.85099999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.94299999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.91600000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149745,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":921600,"data_stored":429399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.40600000000000003,"15min":0.39600000000000002},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58699999999999997,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.44,"15min":0.42399999999999999},"min":{"1min":0.34399999999999997,"5min":0.31,"15min":0.31},"max":{"1min":0.67000000000000004,"5min":0.746,"15min":0.746},"last":0.36199999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60899999999999999,"15min":0.59299999999999997},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.61699999999999999,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60799999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:53:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.51500000000000001,"5min":0.438,"15min":0.438},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.625,"15min":0.61799999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.46400000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.5},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.63400000000000001,"15min":0.61899999999999999},"min":{"1min":0.44500000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.84999999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:53:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.58099999999999996,"15min":0.56399999999999995},"min":{"1min":0.48099999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.626,"15min":0.60699999999999998},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.63900000000000001}]},{"osd":7,"last update":"Thu Sep 21 12:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.52800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.0069999999999999,"5min":1.069,"15min":1.069},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77700000000000002,"15min":0.77500000000000002},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":0.98799999999999999,"5min":0.999,"15min":0.999},"last":0.67100000000000004}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.71099999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69399999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]}]},{"osd":4,"up_from":34,"seq":146028888108,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":429240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.39100000000000001,"15min":0.374},"min":{"1min":0.27200000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.39100000000000001,"15min":0.375},"min":{"1min":0.252,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.59099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.54700000000000004,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.55400000000000005,"15min":0.52800000000000002},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.497}]},{"osd":3,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.59599999999999997,"15min":0.56000000000000005},"min":{"1min":0.498,"5min":0.38,"15min":0.38},"max":{"1min":3.157,"5min":3.157,"15min":3.157},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.58199999999999996,"15min":0.56000000000000005},"min":{"1min":0.52900000000000003,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.876,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.56000000000000005},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96599999999999997,"5min":1,"15min":1},"last":0.42399999999999999}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.46100000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.628,"15min":0.62},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.40500000000000003,"5min":0.315,"15min":0.315},"max":{"1min":0.997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.60099999999999998,"15min":0.58599999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.874,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.63600000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:53:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.65100000000000002}]},{"osd":9,"last update":"Thu Sep 21 12:53:41 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":3.1139999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74099999999999999}]},{"osd":10,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.68100000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":5,"up_from":39,"seq":167503724584,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":970752,"data_stored":1020382,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.33500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.745}]},{"osd":1,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.5}]},{"osd":2,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":0.622,"15min":0.622},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64600000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.77600000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.622},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.52200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:53:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.64500000000000002,"15min":0.64100000000000001},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.877,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.45100000000000001,"5min":0.434,"15min":0.434},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.84699999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64700000000000002,"15min":0.64400000000000002},"min":{"1min":0.41899999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.43099999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.57899999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:53:17 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59699999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:53:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.82399999999999995}]},{"osd":10,"last update":"Thu Sep 21 12:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.73299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":36285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":38025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":20945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:54:21.264 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-21T12:54:21.265 INFO:tasks.cephadm:Setting up client nodes... 2023-09-21T12:54:21.265 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-09-21T12:54:21.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:21 smithi156 ceph-mon[134078]: pgmap v274: 97 pgs: 97 active+clean; 599 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-09-21T12:54:21.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:21 smithi156 ceph-mon[134078]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:21.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:21 smithi142 ceph-mon[97663]: pgmap v274: 97 pgs: 97 active+clean; 599 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-09-21T12:54:21.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:21 smithi142 ceph-mon[97663]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:21 smithi160 ceph-mon[134450]: pgmap v274: 97 pgs: 97 active+clean; 599 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 6.1 KiB/s wr, 16 op/s 2023-09-21T12:54:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:21 smithi160 ceph-mon[134450]: from='client.24704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:22.013 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:22.626 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:22 smithi142 ceph-mon[97663]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:22.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:22 smithi156 ceph-mon[134078]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:22.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:22 smithi160 ceph-mon[134450]: from='client.14655 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:54:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 -- 172.21.15.142:0/3377954332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 msgr2=0x7f5e201024c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:23.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/3377954332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e201024c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c009990 tx=0x7f5e0c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 -- 172.21.15.142:0/3377954332 shutdown_connections 2023-09-21T12:54:23.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/3377954332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 0x7f5e20109320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/3377954332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 0x7f5e20101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/3377954332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e201024c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.687+0000 7f5e26ec2700 1 -- 172.21.15.142:0/3377954332 >> 172.21.15.142:0/3377954332 conn(0x7f5e200fc460 msgr2=0x7f5e200fe880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:23.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.688+0000 7f5e26ec2700 1 -- 172.21.15.142:0/3377954332 shutdown_connections 2023-09-21T12:54:23.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.688+0000 7f5e26ec2700 1 -- 172.21.15.142:0/3377954332 wait complete. 2023-09-21T12:54:23.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 Processor -- start 2023-09-21T12:54:23.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 -- start start 2023-09-21T12:54:23.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 0x7f5e20196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 0x7f5e2019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2019e750 con 0x7f5e20102040 2023-09-21T12:54:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2019e890 con 0x7f5e20102a00 2023-09-21T12:54:23.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e26ec2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2019ea20 con 0x7f5e20100e50 2023-09-21T12:54:23.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:23.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55486/0 (socket says 172.21.15.142:55486) 2023-09-21T12:54:23.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e1ffff700 1 -- 172.21.15.142:0/170316273 learned_addr learned my addr 172.21.15.142:0/170316273 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:23.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e24c5e700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 0x7f5e20196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:23.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.689+0000 7f5e2545f700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 0x7f5e2019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:23.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 -- 172.21.15.142:0/170316273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 msgr2=0x7f5e20196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:23.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 0x7f5e20196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 -- 172.21.15.142:0/170316273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 msgr2=0x7f5e2019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:23.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 0x7f5e2019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 -- 172.21.15.142:0/170316273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0c0095f0 con 0x7f5e20102040 2023-09-21T12:54:23.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1ffff700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00c010 tx=0x7f5e0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:23.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c01d070 con 0x7f5e20102040 2023-09-21T12:54:23.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e2019eca0 con 0x7f5e20102040 2023-09-21T12:54:23.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e0c005030 con 0x7f5e20102040 2023-09-21T12:54:23.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c004bc0 con 0x7f5e20102040 2023-09-21T12:54:23.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.690+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2019f0b0 con 0x7f5e20102040 2023-09-21T12:54:23.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.691+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e2010c790 con 0x7f5e20102040 2023-09-21T12:54:23.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.693+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f5e0c0051a0 con 0x7f5e20102040 2023-09-21T12:54:23.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.695+0000 7f5e1dffb700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 0x7f5e100a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:23.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.696+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5e0c0ccee0 con 0x7f5e20102040 2023-09-21T12:54:23.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.696+0000 7f5e24c5e700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 0x7f5e100a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:23.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.696+0000 7f5e24c5e700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 0x7f5e100a2b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e20101bb0 tx=0x7f5e14009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:23.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.700+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5e0c05ae10 con 0x7f5e20102040 2023-09-21T12:54:23.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:23 smithi156 ceph-mon[134078]: pgmap v275: 97 pgs: 97 active+clean; 600 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.0 KiB/s wr, 18 op/s 2023-09-21T12:54:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:23 smithi142 ceph-mon[97663]: pgmap v275: 97 pgs: 97 active+clean; 600 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.0 KiB/s wr, 18 op/s 2023-09-21T12:54:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:23 smithi160 ceph-mon[134450]: pgmap v275: 97 pgs: 97 active+clean; 600 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 6.0 KiB/s wr, 18 op/s 2023-09-21T12:54:23.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.980+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f5e20107e60 con 0x7f5e20102040 2023-09-21T12:54:23.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.985+0000 7f5e1dffb700 1 -- 172.21.15.142:0/170316273 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f5e0c0969f0 con 0x7f5e20102040 2023-09-21T12:54:23.985 INFO:teuthology.orchestra.run.smithi142.stdout:[client.0] 2023-09-21T12:54:23.985 INFO:teuthology.orchestra.run.smithi142.stdout: key = AQD/PAxlkcuMOhAA53z95eHzuS6lE2EmincHWg== 2023-09-21T12:54:23.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 msgr2=0x7f5e100a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:23.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 0x7f5e100a2b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e20101bb0 tx=0x7f5e14009260 comp rx=0 tx=0).stop 2023-09-21T12:54:23.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 msgr2=0x7f5e20197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:23.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c00c010 tx=0x7f5e0c004730 comp rx=0 tx=0).stop 2023-09-21T12:54:23.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 shutdown_connections 2023-09-21T12:54:23.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5e100a06d0 0x7f5e100a2b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e20102a00 0x7f5e2019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e20100e50 0x7f5e20196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 --2- 172.21.15.142:0/170316273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e20102040 0x7f5e20197100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:23.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 >> 172.21.15.142:0/170316273 conn(0x7f5e200fc460 msgr2=0x7f5e200fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:23.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 shutdown_connections 2023-09-21T12:54:23.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:23.988+0000 7f5e26ec2700 1 -- 172.21.15.142:0/170316273 wait complete. 2023-09-21T12:54:24.486 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:54:24.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-09-21T12:54:24.486 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-21T12:54:24.587 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-21T12:54:24.588 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-09-21T12:54:24.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph mgr dump --format=json 2023-09-21T12:54:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:24 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-21T12:54:24.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:24 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-21T12:54:24.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:24 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-21T12:54:24.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:24 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-21T12:54:24.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:24 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-21T12:54:24.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:24 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/170316273' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-21T12:54:25.352 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:25.773 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:25 smithi142 ceph-mon[97663]: pgmap v276: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-09-21T12:54:25.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:25 smithi156 ceph-mon[134078]: pgmap v276: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-09-21T12:54:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:25 smithi160 ceph-mon[134450]: pgmap v276: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.5 KiB/s wr, 18 op/s 2023-09-21T12:54:26.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 -- 172.21.15.142:0/3308184699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101a10 msgr2=0x7ff620105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:26.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 --2- 172.21.15.142:0/3308184699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101a10 0x7ff620105a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff6140098f0 tx=0x7ff614009c00 comp rx=0 tx=0).stop 2023-09-21T12:54:26.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 -- 172.21.15.142:0/3308184699 shutdown_connections 2023-09-21T12:54:26.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 --2- 172.21.15.142:0/3308184699 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62010dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:26.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 --2- 172.21.15.142:0/3308184699 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101060 0x7ff620101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:26.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 --2- 172.21.15.142:0/3308184699 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101a10 0x7ff620105a60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:26.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 -- 172.21.15.142:0/3308184699 >> 172.21.15.142:0/3308184699 conn(0x7ff6200fc8d0 msgr2=0x7ff6200fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:26.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 -- 172.21.15.142:0/3308184699 shutdown_connections 2023-09-21T12:54:26.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.887+0000 7ff624e36700 1 -- 172.21.15.142:0/3308184699 wait complete. 2023-09-21T12:54:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.888+0000 7ff624e36700 1 Processor -- start 2023-09-21T12:54:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.888+0000 7ff624e36700 1 -- start start 2023-09-21T12:54:26.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 0x7ff620197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:26.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101a10 0x7ff620197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:26.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:26.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019bfc0 con 0x7ff620106140 2023-09-21T12:54:26.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019c130 con 0x7ff620101060 2023-09-21T12:54:26.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff624e36700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62019c2f0 con 0x7ff620101a10 2023-09-21T12:54:26.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:26.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52008/0 (socket says 172.21.15.142:52008) 2023-09-21T12:54:26.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 -- 172.21.15.142:0/647058629 learned_addr learned my addr 172.21.15.142:0/647058629 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:26.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61e59c700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 0x7ff620197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:26.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61dd9b700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101a10 0x7ff620197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 -- 172.21.15.142:0/647058629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101a10 msgr2=0x7ff620197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101a10 0x7ff620197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 -- 172.21.15.142:0/647058629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 msgr2=0x7ff620197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.889+0000 7ff61ed9d700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 0x7ff620197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff61ed9d700 1 -- 172.21.15.142:0/647058629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff618009c40 con 0x7ff620106140 2023-09-21T12:54:26.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff61e59c700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 0x7ff620197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:26.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff61ed9d700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c370 tx=0x7ff61800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:26.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618017070 con 0x7ff620106140 2023-09-21T12:54:26.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff61800f040 con 0x7ff620106140 2023-09-21T12:54:26.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff614009520 con 0x7ff620106140 2023-09-21T12:54:26.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800e050 con 0x7ff620106140 2023-09-21T12:54:26.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.890+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6201a3c60 con 0x7ff620106140 2023-09-21T12:54:26.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.891+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62004eae0 con 0x7ff620106140 2023-09-21T12:54:26.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.893+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7ff618003a00 con 0x7ff620106140 2023-09-21T12:54:26.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.895+0000 7ff60f7fe700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 0x7ff6080a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:26.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.895+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff6180cb470 con 0x7ff620106140 2023-09-21T12:54:26.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.896+0000 7ff61e59c700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 0x7ff6080a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:26.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.896+0000 7ff61e59c700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 0x7ff6080a2c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff610005fd0 tx=0x7ff610009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:26.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:26.900+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff618094ef0 con 0x7ff620106140 2023-09-21T12:54:27.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.155+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff620110df0 con 0x7ff620106140 2023-09-21T12:54:27.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.160+0000 7ff60f7fe700 1 -- 172.21.15.142:0/647058629 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+259027 (secure 0 0 0) 0x7ff618098510 con 0x7ff620106140 2023-09-21T12:54:27.165 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:27.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 msgr2=0x7ff6080a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:27.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 0x7ff6080a2c10 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff610005fd0 tx=0x7ff610009310 comp rx=0 tx=0).stop 2023-09-21T12:54:27.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 msgr2=0x7ff62019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:27.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff61800c370 tx=0x7ff61800c680 comp rx=0 tx=0).stop 2023-09-21T12:54:27.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 shutdown_connections 2023-09-21T12:54:27.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0750 0x7ff6080a2c10 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:27.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620106140 0x7ff62019b9b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101060 0x7ff620197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 --2- 172.21.15.142:0/647058629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620101a10 0x7ff620197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 >> 172.21.15.142:0/647058629 conn(0x7ff6200fc8d0 msgr2=0x7ff6200fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 shutdown_connections 2023-09-21T12:54:27.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:27.165+0000 7ff624e36700 1 -- 172.21.15.142:0/647058629 wait complete. 2023-09-21T12:54:27.623 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":17,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6800","nonce":3499877374},{"type":"v1","addr":"172.21.15.142:6801","nonce":3499877374}]},"active_addr":"172.21.15.142:6801/3499877374","active_change":"2023-09-21T12:47:40.288986+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.142:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":3896559715}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1844445290}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":2723441093}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":969325249}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.142:0","nonce":1712006015}]}]} 2023-09-21T12:54:27.629 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-09-21T12:54:27.630 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-09-21T12:54:27.630 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-21T12:54:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:27 smithi156 ceph-mon[134078]: pgmap v277: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2023-09-21T12:54:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:27 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/647058629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-21T12:54:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:27 smithi142 ceph-mon[97663]: pgmap v277: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2023-09-21T12:54:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:27 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/647058629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-21T12:54:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:27 smithi160 ceph-mon[134450]: pgmap v277: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.7 KiB/s wr, 16 op/s 2023-09-21T12:54:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:27 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/647058629' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-21T12:54:28.359 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:29.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 -- 172.21.15.142:0/2585522612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284101060 msgr2=0x7f9284101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:29.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 --2- 172.21.15.142:0/2585522612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284101060 0x7f9284101440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9274009990 tx=0x7f9274009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 -- 172.21.15.142:0/2585522612 shutdown_connections 2023-09-21T12:54:29.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 --2- 172.21.15.142:0/2585522612 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284101060 0x7f9284101440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 --2- 172.21.15.142:0/2585522612 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284106140 0x7f928410dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 --2- 172.21.15.142:0/2585522612 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101a10 0x7f9284105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 -- 172.21.15.142:0/2585522612 >> 172.21.15.142:0/2585522612 conn(0x7f92840fc8d0 msgr2=0x7f92840fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:29.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 -- 172.21.15.142:0/2585522612 shutdown_connections 2023-09-21T12:54:29.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.902+0000 7f9288996700 1 -- 172.21.15.142:0/2585522612 wait complete. 2023-09-21T12:54:29.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:29 smithi156 ceph-mon[134078]: pgmap v278: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-09-21T12:54:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.903+0000 7f9288996700 1 Processor -- start 2023-09-21T12:54:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.903+0000 7f9288996700 1 -- start start 2023-09-21T12:54:29.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284101a10 0x7f9284073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:29.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841a9a90 con 0x7f9284106140 2023-09-21T12:54:29.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841a9bd0 con 0x7f9284101060 2023-09-21T12:54:29.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9288996700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92841a9d10 con 0x7f9284101a10 2023-09-21T12:54:29.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9282d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:29.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:29.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9282d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52026/0 (socket says 172.21.15.142:52026) 2023-09-21T12:54:29.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9281d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284101a10 0x7f9284073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:29.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9282d9d700 1 -- 172.21.15.142:0/421768816 learned_addr learned my addr 172.21.15.142:0/421768816 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:29.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39192/0 (socket says 172.21.15.142:39192) 2023-09-21T12:54:29.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 -- 172.21.15.142:0/421768816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284101a10 msgr2=0x7f9284073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:29.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284101a10 0x7f9284073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 -- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 msgr2=0x7f9284073b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:29.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:29.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f928259c700 1 -- 172.21.15.142:0/421768816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9278009520 con 0x7f9284101060 2023-09-21T12:54:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.904+0000 7f9282d9d700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f928259c700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9274009990 tx=0x7f9274009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927401d070 con 0x7f9284101060 2023-09-21T12:54:29.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92740095f0 con 0x7f9284101060 2023-09-21T12:54:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9274021410 con 0x7f9284101060 2023-09-21T12:54:29.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9274017650 con 0x7f9284101060 2023-09-21T12:54:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.905+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92841aa210 con 0x7f9284101060 2023-09-21T12:54:29.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.906+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928404eae0 con 0x7f9284101060 2023-09-21T12:54:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.908+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f927400fad0 con 0x7f9284101060 2023-09-21T12:54:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.909+0000 7f92737fe700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 0x7f926c0a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:29.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.909+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f92740cd570 con 0x7f9284101060 2023-09-21T12:54:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.909+0000 7f9281d9b700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 0x7f926c0a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.910+0000 7f9281d9b700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 0x7f926c0a2c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f92840748d0 tx=0x7f9278009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:29.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:29.912+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9274097080 con 0x7f9284101060 2023-09-21T12:54:29.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:29 smithi142 ceph-mon[97663]: pgmap v278: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-09-21T12:54:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:29 smithi160 ceph-mon[134450]: pgmap v278: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2023-09-21T12:54:30.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.112+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9284110e70 con 0x7f9284101060 2023-09-21T12:54:30.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.114+0000 7f92737fe700 1 -- 172.21.15.142:0/421768816 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22167 (secure 0 0 0) 0x7f927409a6a0 con 0x7f9284101060 2023-09-21T12:54:30.113 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:30.114 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":84,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:13.422565+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 msgr2=0x7f926c0a2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:30.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 0x7f926c0a2c90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f92840748d0 tx=0x7f9278009260 comp rx=0 tx=0).stop 2023-09-21T12:54:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 msgr2=0x7f92840730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9274009990 tx=0x7f9274009580 comp rx=0 tx=0).stop 2023-09-21T12:54:30.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 shutdown_connections 2023-09-21T12:54:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f926c0a07d0 0x7f926c0a2c90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9284106140 0x7f9284073b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:30.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9284101060 0x7f92840730e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 --2- 172.21.15.142:0/421768816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9284101a10 0x7f9284073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.116+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 >> 172.21.15.142:0/421768816 conn(0x7f92840fc8d0 msgr2=0x7f92840fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:30.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.117+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 shutdown_connections 2023-09-21T12:54:30.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:30.117+0000 7f9288996700 1 -- 172.21.15.142:0/421768816 wait complete. 2023-09-21T12:54:30.636 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-09-21T12:54:30.637 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-21T12:54:30.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:30 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/421768816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:30.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:30 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/421768816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:30.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:30 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/421768816' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:31.366 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:31.789 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:31 smithi142 ceph-mon[97663]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-09-21T12:54:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:31 smithi156 ceph-mon[134078]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-09-21T12:54:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:31 smithi160 ceph-mon[134450]: pgmap v279: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-09-21T12:54:32.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 -- 172.21.15.142:0/2198054724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20106140 msgr2=0x7f8b2010dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:32.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 --2- 172.21.15.142:0/2198054724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20106140 0x7f8b2010dd10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8b1800b0a0 tx=0x7f8b1800b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 -- 172.21.15.142:0/2198054724 shutdown_connections 2023-09-21T12:54:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 --2- 172.21.15.142:0/2198054724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20106140 0x7f8b2010dd10 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 --2- 172.21.15.142:0/2198054724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101060 0x7f8b20101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 --2- 172.21.15.142:0/2198054724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20101a10 0x7f8b20105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.876+0000 7f8b262c2700 1 -- 172.21.15.142:0/2198054724 >> 172.21.15.142:0/2198054724 conn(0x7f8b200fc8d0 msgr2=0x7f8b200fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.877+0000 7f8b262c2700 1 -- 172.21.15.142:0/2198054724 shutdown_connections 2023-09-21T12:54:32.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.877+0000 7f8b262c2700 1 -- 172.21.15.142:0/2198054724 wait complete. 2023-09-21T12:54:32.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 Processor -- start 2023-09-21T12:54:32.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 -- start start 2023-09-21T12:54:32.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:32.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101a10 0x7f8b201997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20106140 0x7f8b2019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2019e220 con 0x7f8b20101060 2023-09-21T12:54:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2019e390 con 0x7f8b20101a10 2023-09-21T12:54:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b262c2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2019e550 con 0x7f8b20106140 2023-09-21T12:54:32.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b1ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:52044/0 (socket says 172.21.15.142:52044) 2023-09-21T12:54:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.878+0000 7f8b1ffff700 1 -- 172.21.15.142:0/3572379575 learned_addr learned my addr 172.21.15.142:0/3572379575 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b17fff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101a10 0x7f8b201997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b2485f700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20106140 0x7f8b2019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:32.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 -- 172.21.15.142:0/3572379575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20106140 msgr2=0x7f8b2019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20106140 0x7f8b2019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 -- 172.21.15.142:0/3572379575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101a10 msgr2=0x7f8b201997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101a10 0x7f8b201997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 -- 172.21.15.142:0/3572379575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b18009d00 con 0x7f8b20101060 2023-09-21T12:54:32.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1ffff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000e9a0 tx=0x7f8b1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:32.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10009790 con 0x7f8b20101060 2023-09-21T12:54:32.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b10010430 con 0x7f8b20101060 2023-09-21T12:54:32.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2019e830 con 0x7f8b20101060 2023-09-21T12:54:32.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.879+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b10018680 con 0x7f8b20101060 2023-09-21T12:54:32.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.880+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b201a6090 con 0x7f8b20101060 2023-09-21T12:54:32.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.881+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b2004eae0 con 0x7f8b20101060 2023-09-21T12:54:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.883+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f8b100105a0 con 0x7f8b20101060 2023-09-21T12:54:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.884+0000 7f8b1dffb700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 0x7f8b0c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:32.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.884+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8b10014070 con 0x7f8b20101060 2023-09-21T12:54:32.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.884+0000 7f8b17fff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 0x7f8b0c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:32.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.885+0000 7f8b17fff700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 0x7f8b0c0a2b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b2019a880 tx=0x7f8b080073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:32.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:32.886+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8b10095ab0 con 0x7f8b20101060 2023-09-21T12:54:33.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.089+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b20110f20 con 0x7f8b20101060 2023-09-21T12:54:33.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.091+0000 7f8b1dffb700 1 -- 172.21.15.142:0/3572379575 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22167 (secure 0 0 0) 0x7f8b10026090 con 0x7f8b20101060 2023-09-21T12:54:33.091 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:54:33.092 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":84,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:13.422565+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:54:33.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 msgr2=0x7f8b0c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 0x7f8b0c0a2b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8b2019a880 tx=0x7f8b080073d0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 msgr2=0x7f8b20199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000e9a0 tx=0x7f8b1000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 shutdown_connections 2023-09-21T12:54:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8b0c0a06d0 0x7f8b0c0a2b90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b20101060 0x7f8b20199260 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b20106140 0x7f8b2019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 --2- 172.21.15.142:0/3572379575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b20101a10 0x7f8b201997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:33.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 >> 172.21.15.142:0/3572379575 conn(0x7f8b200fc8d0 msgr2=0x7f8b200fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 shutdown_connections 2023-09-21T12:54:33.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:33.093+0000 7f8b262c2700 1 -- 172.21.15.142:0/3572379575 wait complete. 2023-09-21T12:54:33.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.0 flush_pg_stats 2023-09-21T12:54:33.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.1 flush_pg_stats 2023-09-21T12:54:33.549 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.2 flush_pg_stats 2023-09-21T12:54:33.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.3 flush_pg_stats 2023-09-21T12:54:33.551 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.4 flush_pg_stats 2023-09-21T12:54:33.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.5 flush_pg_stats 2023-09-21T12:54:33.552 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.6 flush_pg_stats 2023-09-21T12:54:33.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.7 flush_pg_stats 2023-09-21T12:54:33.553 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.8 flush_pg_stats 2023-09-21T12:54:33.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.9 flush_pg_stats 2023-09-21T12:54:33.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.10 flush_pg_stats 2023-09-21T12:54:33.555 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph tell osd.11 flush_pg_stats 2023-09-21T12:54:33.784 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:33 smithi142 ceph-mon[97663]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2023-09-21T12:54:33.784 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:33 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3572379575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:33.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:33 smithi156 ceph-mon[134078]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2023-09-21T12:54:33.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:33 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3572379575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:33.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:33 smithi160 ceph-mon[134450]: pgmap v280: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.3 KiB/s wr, 10 op/s 2023-09-21T12:54:33.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:33 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3572379575' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:54:34.913 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:35.474 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:35.722 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:35.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:35 smithi156 ceph-mon[134078]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2023-09-21T12:54:35.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:35 smithi142 ceph-mon[97663]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2023-09-21T12:54:35.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:35 smithi160 ceph-mon[134450]: pgmap v281: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.4 KiB/s wr, 8 op/s 2023-09-21T12:54:36.028 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:36.396 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:37.440 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 -- 172.21.15.142:0/2204762806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8106130 msgr2=0x7f31b810dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 --2- 172.21.15.142:0/2204762806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8106130 0x7f31b810dd00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f31b000b0a0 tx=0x7f31b000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 -- 172.21.15.142:0/2204762806 shutdown_connections 2023-09-21T12:54:37.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 --2- 172.21.15.142:0/2204762806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8106130 0x7f31b810dd00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 --2- 172.21.15.142:0/2204762806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b8101050 0x7f31b8101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 --2- 172.21.15.142:0/2204762806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 0x7f31b8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 -- 172.21.15.142:0/2204762806 >> 172.21.15.142:0/2204762806 conn(0x7f31b80fc8e0 msgr2=0x7f31b80fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:37.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 -- 172.21.15.142:0/2204762806 shutdown_connections 2023-09-21T12:54:37.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.655+0000 7f31be41a700 1 -- 172.21.15.142:0/2204762806 wait complete. 2023-09-21T12:54:37.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.657+0000 7f31be41a700 1 Processor -- start 2023-09-21T12:54:37.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.657+0000 7f31be41a700 1 -- start start 2023-09-21T12:54:37.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8101050 0x7f31b80730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:37.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 0x7f31b8073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:37.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b8106130 0x7f31b8073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:37.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81a54e0 con 0x7f31b8101050 2023-09-21T12:54:37.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81a5650 con 0x7f31b8106130 2023-09-21T12:54:37.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31be41a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b81a5810 con 0x7f31b8101a00 2023-09-21T12:54:37.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 0x7f31b8073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:37.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8101050 0x7f31b80730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:37.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 0x7f31b8073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43190/0 (socket says 172.21.15.142:43190) 2023-09-21T12:54:37.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b77fe700 1 -- 172.21.15.142:0/2270267540 learned_addr learned my addr 172.21.15.142:0/2270267540 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:37.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31bc9b7700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b8106130 0x7f31b8073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:37.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 -- 172.21.15.142:0/2270267540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 msgr2=0x7f31b8073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31b8101a00 0x7f31b8073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 -- 172.21.15.142:0/2270267540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b8106130 msgr2=0x7f31b8073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31b8106130 0x7f31b8073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.658+0000 7f31b7fff700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8009520 con 0x7f31b8101050 2023-09-21T12:54:37.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31b7fff700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8101050 0x7f31b80730e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31a800e9f0 tx=0x7f31a800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:37.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a800cb70 con 0x7f31b8101050 2023-09-21T12:54:37.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31a800ee90 con 0x7f31b8101050 2023-09-21T12:54:37.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b0009d00 con 0x7f31b8101050 2023-09-21T12:54:37.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a8003cf0 con 0x7f31b8101050 2023-09-21T12:54:37.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.659+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b81a5eb0 con 0x7f31b8101050 2023-09-21T12:54:37.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.660+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f31b8110fa0 con 0x7f31b8101050 2023-09-21T12:54:37.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.662+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f31a800ccd0 con 0x7f31b8101050 2023-09-21T12:54:37.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b57fa700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f31a00a0750 0x7f31a00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:37.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f31a8014070 con 0x7f31b8101050 2023-09-21T12:54:37.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b77fe700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f31a00a0750 0x7f31a00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:37.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b57fa700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] conn(0x7f31a00a9f30 0x7f31a00ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:37.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31a00aca00 con 0x7f31a00a9f30 2023-09-21T12:54:37.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.664+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a80cc310 con 0x7f31b8101050 2023-09-21T12:54:37.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.665+0000 7f31bc9b7700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] conn(0x7f31a00a9f30 0x7f31a00ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:37.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.665+0000 7f31b77fe700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f31a00a0750 0x7f31a00a2c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31b80748d0 tx=0x7f31ac009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:37.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.665+0000 7f31bc9b7700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] conn(0x7f31a00a9f30 0x7f31a00ac350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:37.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.666+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== osd.0 v2:172.21.15.142:6802/3599687873 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f31a00aca00 con 0x7f31a00a9f30 2023-09-21T12:54:37.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.683+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 --> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f31b804eae0 con 0x7f31a00a9f30 2023-09-21T12:54:37.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.683+0000 7f31b57fa700 1 -- 172.21.15.142:0/2270267540 <== osd.0 v2:172.21.15.142:6802/3599687873 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f31b804eae0 con 0x7f31a00a9f30 2023-09-21T12:54:37.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] conn(0x7f31a00a9f30 msgr2=0x7f31a00ac350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] conn(0x7f31a00a9f30 0x7f31a00ac350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:37.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f31a00a0750 msgr2=0x7f31a00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f31a00a0750 0x7f31a00a2c10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f31b80748d0 tx=0x7f31ac009260 comp rx=0 tx=0).stop 2023-09-21T12:54:37.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8101050 msgr2=0x7f31b80730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:37.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 --2- 172.21.15.142:0/2270267540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f31b8101050 0x7f31b80730e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31a800e9f0 tx=0x7f31a800ed00 comp rx=0 tx=0).stop 2023-09-21T12:54:37.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31bc9b7700 1 -- 172.21.15.142:0/2270267540 reap_dead start 2023-09-21T12:54:37.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 shutdown_connections 2023-09-21T12:54:37.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 >> 172.21.15.142:0/2270267540 conn(0x7f31b80fc8e0 msgr2=0x7f31b80fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:37.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 shutdown_connections 2023-09-21T12:54:37.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:37.684+0000 7f31be41a700 1 -- 172.21.15.142:0/2270267540 wait complete. 2023-09-21T12:54:37.723 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:37.725 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:37.801 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:37.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:37 smithi142 ceph-mon[97663]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2023-09-21T12:54:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:37 smithi156 ceph-mon[134078]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2023-09-21T12:54:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:37 smithi160 ceph-mon[134450]: pgmap v282: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.6 KiB/s wr, 5 op/s 2023-09-21T12:54:38.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 -- 172.21.15.142:0/2017794650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c106140 msgr2=0x7f847c10dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 --2- 172.21.15.142:0/2017794650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c106140 0x7f847c10dd10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f847400b0a0 tx=0x7f847400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 -- 172.21.15.142:0/2017794650 shutdown_connections 2023-09-21T12:54:38.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 --2- 172.21.15.142:0/2017794650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c106140 0x7f847c10dd10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 --2- 172.21.15.142:0/2017794650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101060 0x7f847c101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 --2- 172.21.15.142:0/2017794650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c101a10 0x7f847c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 -- 172.21.15.142:0/2017794650 >> 172.21.15.142:0/2017794650 conn(0x7f847c0fc8d0 msgr2=0x7f847c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:38.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.146+0000 7f8482dd3700 1 -- 172.21.15.142:0/2017794650 shutdown_connections 2023-09-21T12:54:38.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.147+0000 7f8482dd3700 1 -- 172.21.15.142:0/2017794650 wait complete. 2023-09-21T12:54:38.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.147+0000 7f8482dd3700 1 Processor -- start 2023-09-21T12:54:38.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 -- start start 2023-09-21T12:54:38.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 0x7f847c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:38.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101a10 0x7f847c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:38.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c106140 0x7f847c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:38.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1a5550 con 0x7f847c101060 2023-09-21T12:54:38.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1a56c0 con 0x7f847c101a10 2023-09-21T12:54:38.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8482dd3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1a5880 con 0x7f847c106140 2023-09-21T12:54:38.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8480b6f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 0x7f847c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:38.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8480b6f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 0x7f847c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48104/0 (socket says 172.21.15.142:48104) 2023-09-21T12:54:38.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f8480b6f700 1 -- 172.21.15.142:0/794243266 learned_addr learned my addr 172.21.15.142:0/794243266 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:38.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.148+0000 7f847bfff700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101a10 0x7f847c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:38.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8481370700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c106140 0x7f847c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:38.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 -- 172.21.15.142:0/794243266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c106140 msgr2=0x7f847c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c106140 0x7f847c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 -- 172.21.15.142:0/794243266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101a10 msgr2=0x7f847c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101a10 0x7f847c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474009d00 con 0x7f847c101060 2023-09-21T12:54:38.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8481370700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f847c106140 0x7f847c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:38.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f847bfff700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f847c101a10 0x7f847c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:38.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8480b6f700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 0x7f847c0730e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f847000e9a0 tx=0x7f847000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:38.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470009790 con 0x7f847c101060 2023-09-21T12:54:38.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c1a5b60 con 0x7f847c101060 2023-09-21T12:54:38.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f847000cbd0 con 0x7f847c101060 2023-09-21T12:54:38.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470018680 con 0x7f847c101060 2023-09-21T12:54:38.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.149+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847c1a6060 con 0x7f847c101060 2023-09-21T12:54:38.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.150+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f847c111010 con 0x7f847c101060 2023-09-21T12:54:38.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.152+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f847000cd40 con 0x7f847c101060 2023-09-21T12:54:38.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8479ffb700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f846c0a06d0 0x7f846c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:38.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8470014070 con 0x7f847c101060 2023-09-21T12:54:38.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f847bfff700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f846c0a06d0 0x7f846c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:38.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8479ffb700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] conn(0x7f846c0a9eb0 0x7f846c0ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:38.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f846c0ac980 con 0x7f846c0a9eb0 2023-09-21T12:54:38.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84700cc620 con 0x7f847c101060 2023-09-21T12:54:38.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f8481370700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] conn(0x7f846c0a9eb0 0x7f846c0ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.154+0000 7f847bfff700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f846c0a06d0 0x7f846c0a2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f847c0748d0 tx=0x7f8468009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.155+0000 7f8481370700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] conn(0x7f846c0a9eb0 0x7f846c0ac2d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.156+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== osd.3 v2:172.21.15.142:6810/3058352987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f846c0ac980 con 0x7f846c0a9eb0 2023-09-21T12:54:38.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.173+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 --> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f847c04eae0 con 0x7f846c0a9eb0 2023-09-21T12:54:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.173+0000 7f8479ffb700 1 -- 172.21.15.142:0/794243266 <== osd.3 v2:172.21.15.142:6810/3058352987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f847c04eae0 con 0x7f846c0a9eb0 2023-09-21T12:54:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] conn(0x7f846c0a9eb0 msgr2=0x7f846c0ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] conn(0x7f846c0a9eb0 0x7f846c0ac2d0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f846c0a06d0 msgr2=0x7f846c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f846c0a06d0 0x7f846c0a2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f847c0748d0 tx=0x7f8468009260 comp rx=0 tx=0).stop 2023-09-21T12:54:38.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 msgr2=0x7f847c0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:38.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 --2- 172.21.15.142:0/794243266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f847c101060 0x7f847c0730e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f847000e9a0 tx=0x7f847000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:38.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8481370700 1 -- 172.21.15.142:0/794243266 reap_dead start 2023-09-21T12:54:38.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 shutdown_connections 2023-09-21T12:54:38.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 >> 172.21.15.142:0/794243266 conn(0x7f847c0fc8d0 msgr2=0x7f847c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:38.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 shutdown_connections 2023-09-21T12:54:38.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:38.174+0000 7f8482dd3700 1 -- 172.21.15.142:0/794243266 wait complete. 2023-09-21T12:54:39.750 INFO:teuthology.orchestra.run.smithi142.stdout:34359738436 2023-09-21T12:54:39.751 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.0 2023-09-21T12:54:39.819 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:39 smithi142 ceph-mon[97663]: pgmap v283: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-09-21T12:54:39.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:39 smithi156 ceph-mon[134078]: pgmap v283: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-09-21T12:54:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:39 smithi160 ceph-mon[134450]: pgmap v283: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-09-21T12:54:40.153 INFO:teuthology.orchestra.run.smithi142.stdout:111669149749 2023-09-21T12:54:40.154 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.3 2023-09-21T12:54:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:40.835 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-09-21T12:54:40.835 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-09-21T12:54:40.835 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-09-21T12:54:40.835 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.836 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-09-21T12:54:40.836 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-09-21T12:54:40.836 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.836 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:40 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-21T12:54:40.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-09-21T12:54:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-09-21T12:54:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-09-21T12:54:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-09-21T12:54:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-09-21T12:54:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:40 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-21T12:54:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2023-09-21T12:54:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]: dispatch 2023-09-21T12:54:40.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-09-21T12:54:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-09-21T12:54:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]: dispatch 2023-09-21T12:54:40.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]: dispatch 2023-09-21T12:54:40.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:40 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-21T12:54:41.819 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:41.825 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:41.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-09-21T12:54:41.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-09-21T12:54:41.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-09-21T12:54:41.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-09-21T12:54:41.854 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-09-21T12:54:41.855 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-09-21T12:54:41.855 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-09-21T12:54:41.855 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-09-21T12:54:41.855 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-21T12:54:41.855 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:41 smithi142 ceph-mon[97663]: osdmap e85: 12 total, 12 up, 12 in 2023-09-21T12:54:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-09-21T12:54:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-09-21T12:54:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-09-21T12:54:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-09-21T12:54:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-09-21T12:54:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-09-21T12:54:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-09-21T12:54:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-09-21T12:54:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-21T12:54:41.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:41 smithi156 ceph-mon[134078]: osdmap e85: 12 total, 12 up, 12 in 2023-09-21T12:54:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2023-09-21T12:54:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2023-09-21T12:54:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2023-09-21T12:54:41.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-09-21T12:54:41.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2023-09-21T12:54:41.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-09-21T12:54:41.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 6]}]': finished 2023-09-21T12:54:41.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.29", "id": [3, 9]}]': finished 2023-09-21T12:54:41.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-21T12:54:41.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:41 smithi160 ceph-mon[134450]: osdmap e85: 12 total, 12 up, 12 in 2023-09-21T12:54:42.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 -- 172.21.15.142:0/3001144232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4073aa0 msgr2=0x7f6fc41118d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/3001144232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4073aa0 0x7f6fc41118d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009990 tx=0x7f6fb4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 -- 172.21.15.142:0/3001144232 shutdown_connections 2023-09-21T12:54:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/3001144232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fc4111e10 0x7f6fc4114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/3001144232 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 0x7f6fc4073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/3001144232 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4073aa0 0x7f6fc41118d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 -- 172.21.15.142:0/3001144232 >> 172.21.15.142:0/3001144232 conn(0x7f6fc40fc8d0 msgr2=0x7f6fc40fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 -- 172.21.15.142:0/3001144232 shutdown_connections 2023-09-21T12:54:42.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.136+0000 7f6fcbe09700 1 -- 172.21.15.142:0/3001144232 wait complete. 2023-09-21T12:54:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.137+0000 7f6fcbe09700 1 Processor -- start 2023-09-21T12:54:42.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.137+0000 7f6fcbe09700 1 -- start start 2023-09-21T12:54:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.137+0000 7f6fcbe09700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 0x7f6fc419d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fcbe09700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fc4073aa0 0x7f6fc419da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fcbe09700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4111e10 0x7f6fc41a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fcbe09700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41a24d0 con 0x7f6fc4111e10 2023-09-21T12:54:42.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fcbe09700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41a2640 con 0x7f6fc4073180 2023-09-21T12:54:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fcbe09700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41a2800 con 0x7f6fc4073aa0 2023-09-21T12:54:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fc9ba5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 0x7f6fc419d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fc9ba5700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 0x7f6fc419d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37682/0 (socket says 172.21.15.142:37682) 2023-09-21T12:54:42.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4111e10 0x7f6fc41a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fc9ba5700 1 -- 172.21.15.142:0/2329779884 learned_addr learned my addr 172.21.15.142:0/2329779884 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fc93a4700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fc4073aa0 0x7f6fc419da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 -- 172.21.15.142:0/2329779884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fc4073aa0 msgr2=0x7f6fc419da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6fc4073aa0 0x7f6fc419da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 -- 172.21.15.142:0/2329779884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 msgr2=0x7f6fc419d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6fc4073180 0x7f6fc419d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.138+0000 7f6fca3a6700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40095f0 con 0x7f6fc4111e10 2023-09-21T12:54:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fca3a6700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4111e10 0x7f6fc41a1ec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007ee0 tx=0x7f6fbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc009ea0 con 0x7f6fc4111e10 2023-09-21T12:54:42.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc41a2ae0 con 0x7f6fc4111e10 2023-09-21T12:54:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fbc00f040 con 0x7f6fc4111e10 2023-09-21T12:54:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc004280 con 0x7f6fc4111e10 2023-09-21T12:54:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.139+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc41aa340 con 0x7f6fc4111e10 2023-09-21T12:54:42.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.140+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fc404eae0 con 0x7f6fc4111e10 2023-09-21T12:54:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.142+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f6fbc00db20 con 0x7f6fc4111e10 2023-09-21T12:54:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fbaffd700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6fb00a0750 0x7f6fb00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6fbc0cc280 con 0x7f6fc4111e10 2023-09-21T12:54:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fc9ba5700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6fb00a0750 0x7f6fb00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fbaffd700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] conn(0x7f6fb00aa290 0x7f6fb00ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fb00ace00 con 0x7f6fb00aa290 2023-09-21T12:54:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fbc0cc5f0 con 0x7f6fc4111e10 2023-09-21T12:54:42.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.144+0000 7f6fc93a4700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] conn(0x7f6fb00aa290 0x7f6fb00ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.145+0000 7f6fc9ba5700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6fb00a0750 0x7f6fb00a2c10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0005950 tx=0x7f6fc000b500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.145+0000 7f6fc93a4700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] conn(0x7f6fb00aa290 0x7f6fb00ac730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.146+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== osd.6 v2:172.21.15.142:6818/231467539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6fb00ace00 con 0x7f6fb00aa290 2023-09-21T12:54:42.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.163+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 --> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fc4117680 con 0x7f6fb00aa290 2023-09-21T12:54:42.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.163+0000 7f6fbaffd700 1 -- 172.21.15.142:0/2329779884 <== osd.6 v2:172.21.15.142:6818/231467539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6fb401e040 con 0x7f6fb00aa290 2023-09-21T12:54:42.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] conn(0x7f6fb00aa290 msgr2=0x7f6fb00ac730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] conn(0x7f6fb00aa290 0x7f6fb00ac730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6fb00a0750 msgr2=0x7f6fb00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6fb00a0750 0x7f6fb00a2c10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6fc0005950 tx=0x7f6fc000b500 comp rx=0 tx=0).stop 2023-09-21T12:54:42.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4111e10 msgr2=0x7f6fc41a1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 --2- 172.21.15.142:0/2329779884 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6fc4111e10 0x7f6fc41a1ec0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc007ee0 tx=0x7f6fbc00d3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fca3a6700 1 -- 172.21.15.142:0/2329779884 reap_dead start 2023-09-21T12:54:42.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 shutdown_connections 2023-09-21T12:54:42.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 >> 172.21.15.142:0/2329779884 conn(0x7f6fc40fc8d0 msgr2=0x7f6fc40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 shutdown_connections 2023-09-21T12:54:42.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.164+0000 7f6fcbe09700 1 -- 172.21.15.142:0/2329779884 wait complete. 2023-09-21T12:54:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 -- 172.21.15.142:0/590939674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 msgr2=0x7fafa810dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 --2- 172.21.15.142:0/590939674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa810dd10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fafa000b0a0 tx=0x7fafa000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 -- 172.21.15.142:0/590939674 shutdown_connections 2023-09-21T12:54:42.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 --2- 172.21.15.142:0/590939674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa810dd10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 --2- 172.21.15.142:0/590939674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 --2- 172.21.15.142:0/590939674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 0x7fafa8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 -- 172.21.15.142:0/590939674 >> 172.21.15.142:0/590939674 conn(0x7fafa80fc8d0 msgr2=0x7fafa80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 -- 172.21.15.142:0/590939674 shutdown_connections 2023-09-21T12:54:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.343+0000 7fafaf88d700 1 -- 172.21.15.142:0/590939674 wait complete. 2023-09-21T12:54:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.344+0000 7fafaf88d700 1 Processor -- start 2023-09-21T12:54:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.344+0000 7fafaf88d700 1 -- start start 2023-09-21T12:54:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.344+0000 7fafaf88d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafaf88d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 0x7fafa81997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafaf88d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa819dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafaf88d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa819e230 con 0x7fafa8106140 2023-09-21T12:54:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafaf88d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa819e3a0 con 0x7fafa8101a10 2023-09-21T12:54:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafaf88d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa819e560 con 0x7fafa8101060 2023-09-21T12:54:42.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa819dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafad629700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa819dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48140/0 (socket says 172.21.15.142:48140) 2023-09-21T12:54:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafad629700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43240/0 (socket says 172.21.15.142:43240) 2023-09-21T12:54:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 -- 172.21.15.142:0/412581842 learned_addr learned my addr 172.21.15.142:0/412581842 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:42.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7faface28700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 0x7fafa81997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 -- 172.21.15.142:0/412581842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 msgr2=0x7fafa8199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 -- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 msgr2=0x7fafa81997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 0x7fafa81997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafade2a700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa0009d00 con 0x7fafa8106140 2023-09-21T12:54:42.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7fafad629700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafa8101060 0x7fafa8199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:42.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.345+0000 7faface28700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fafa8101a10 0x7fafa81997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:42.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7fafade2a700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa819dc20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa000e040 con 0x7fafa8106140 2023-09-21T12:54:42.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa819e7e0 con 0x7fafa8106140 2023-09-21T12:54:42.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafa00094c0 con 0x7fafa8106140 2023-09-21T12:54:42.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa00052a0 con 0x7fafa8106140 2023-09-21T12:54:42.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.346+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa81a60a0 con 0x7fafa8106140 2023-09-21T12:54:42.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.347+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafa81110d0 con 0x7fafa8106140 2023-09-21T12:54:42.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.349+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fafa001d470 con 0x7fafa8106140 2023-09-21T12:54:42.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7faf9e7fc700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7faf940a06d0 0x7faf940a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fafa00cd960 con 0x7fafa8106140 2023-09-21T12:54:42.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7fafad629700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7faf940a06d0 0x7faf940a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7faf9e7fc700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] conn(0x7faf940aa210 0x7faf940ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf940acd80 con 0x7faf940aa210 2023-09-21T12:54:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.351+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafa00cdd70 con 0x7fafa8106140 2023-09-21T12:54:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.352+0000 7faface28700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] conn(0x7faf940aa210 0x7faf940ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.352+0000 7fafad629700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7faf940a06d0 0x7faf940a2b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafa4011490 tx=0x7fafa4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.352+0000 7faface28700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] conn(0x7faf940aa210 0x7faf940ac6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.353+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== osd.7 v2:172.21.15.156:6816/129918073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7faf940acd80 con 0x7faf940aa210 2023-09-21T12:54:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.370+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 --> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fafa804eae0 con 0x7faf940aa210 2023-09-21T12:54:42.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7faf9e7fc700 1 -- 172.21.15.142:0/412581842 <== osd.7 v2:172.21.15.156:6816/129918073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fafa804eae0 con 0x7faf940aa210 2023-09-21T12:54:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] conn(0x7faf940aa210 msgr2=0x7faf940ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] conn(0x7faf940aa210 0x7faf940ac6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7faf940a06d0 msgr2=0x7faf940a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7faf940a06d0 0x7faf940a2b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fafa4011490 tx=0x7fafa4009260 comp rx=0 tx=0).stop 2023-09-21T12:54:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 msgr2=0x7fafa819dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafaf88d700 1 --2- 172.21.15.142:0/412581842 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fafa8106140 0x7fafa819dc20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009fd0 tx=0x7fafa000bce0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.371+0000 7fafade2a700 1 -- 172.21.15.142:0/412581842 reap_dead start 2023-09-21T12:54:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.372+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 shutdown_connections 2023-09-21T12:54:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.372+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 >> 172.21.15.142:0/412581842 conn(0x7fafa80fc8d0 msgr2=0x7fafa80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.372+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 shutdown_connections 2023-09-21T12:54:42.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.372+0000 7fafaf88d700 1 -- 172.21.15.142:0/412581842 wait complete. 2023-09-21T12:54:42.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2590635785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 msgr2=0x7f4e600735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2590635785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e600735f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e500098f0 tx=0x7f4e50009c00 comp rx=0 tx=0).stop 2023-09-21T12:54:42.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2590635785 shutdown_connections 2023-09-21T12:54:42.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2590635785 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e600735f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2590635785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 0x7f4e6010fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2590635785 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60073b30 0x7f4e6010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.391+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2590635785 >> 172.21.15.142:0/2590635785 conn(0x7f4e600fc8d0 msgr2=0x7f4e600fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.392+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2590635785 shutdown_connections 2023-09-21T12:54:42.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.392+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2590635785 wait complete. 2023-09-21T12:54:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 Processor -- start 2023-09-21T12:54:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 -- start start 2023-09-21T12:54:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e60199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60073b30 0x7f4e60199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 0x7f4e6019dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e0f0 con 0x7f4e60073210 2023-09-21T12:54:42.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e260 con 0x7f4e60073b30 2023-09-21T12:54:42.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.393+0000 7f4e65c8f700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e420 con 0x7f4e6010d640 2023-09-21T12:54:42.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e60199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e60199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48156/0 (socket says 172.21.15.142:48156) 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 -- 172.21.15.142:0/2083199268 learned_addr learned my addr 172.21.15.142:0/2083199268 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5effd700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60073b30 0x7f4e60199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5ffff700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 0x7f4e6019dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 -- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 msgr2=0x7f4e6019dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 0x7f4e6019dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 -- 172.21.15.142:0/2083199268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60073b30 msgr2=0x7f4e60199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60073b30 0x7f4e60199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50009520 con 0x7f4e60073210 2023-09-21T12:54:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5ffff700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d640 0x7f4e6019dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:42.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.394+0000 7f4e5f7fe700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e60199130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009230 tx=0x7f4e5000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.395+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5001c070 con 0x7f4e60073210 2023-09-21T12:54:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.395+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e50005040 con 0x7f4e60073210 2023-09-21T12:54:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.395+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6019e6a0 con 0x7f4e60073210 2023-09-21T12:54:42.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.395+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500038e0 con 0x7f4e60073210 2023-09-21T12:54:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.395+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601a5f60 con 0x7f4e60073210 2023-09-21T12:54:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.396+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e60113210 con 0x7f4e60073210 2023-09-21T12:54:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.398+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f4e50020030 con 0x7f4e60073210 2023-09-21T12:54:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.399+0000 7f4e5cff9700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f4e480a06d0 0x7f4e480a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4e500ccf80 con 0x7f4e60073210 2023-09-21T12:54:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5effd700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f4e480a06d0 0x7f4e480a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5cff9700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] conn(0x7f4e480aa210 0x7f4e480ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e480acd80 con 0x7f4e480aa210 2023-09-21T12:54:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e500cd2f0 con 0x7f4e60073210 2023-09-21T12:54:42.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5effd700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f4e480a06d0 0x7f4e480a2b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e6019a750 tx=0x7f4e54009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.400+0000 7f4e5ffff700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] conn(0x7f4e480aa210 0x7f4e480ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:42.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.401+0000 7f4e5ffff700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] conn(0x7f4e480aa210 0x7f4e480ac6b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:42.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.402+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== osd.11 v2:172.21.15.160:6824/742511667 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f4e480acd80 con 0x7f4e480aa210 2023-09-21T12:54:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.419+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 --> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e6019e970 con 0x7f4e480aa210 2023-09-21T12:54:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e5cff9700 1 -- 172.21.15.142:0/2083199268 <== osd.11 v2:172.21.15.160:6824/742511667 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4e5800f040 con 0x7f4e480aa210 2023-09-21T12:54:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] conn(0x7f4e480aa210 msgr2=0x7f4e480ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] conn(0x7f4e480aa210 0x7f4e480ac6b0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f4e480a06d0 msgr2=0x7f4e480a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f4e480a06d0 0x7f4e480a2b90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e6019a750 tx=0x7f4e54009310 comp rx=0 tx=0).stop 2023-09-21T12:54:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 msgr2=0x7f4e60199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:42.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 --2- 172.21.15.142:0/2083199268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60073210 0x7f4e60199130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e50009230 tx=0x7f4e5000b560 comp rx=0 tx=0).stop 2023-09-21T12:54:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e5ffff700 1 -- 172.21.15.142:0/2083199268 reap_dead start 2023-09-21T12:54:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 shutdown_connections 2023-09-21T12:54:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 >> 172.21.15.142:0/2083199268 conn(0x7f4e600fc8d0 msgr2=0x7f4e6010f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 shutdown_connections 2023-09-21T12:54:42.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:42.420+0000 7f4e65c8f700 1 -- 172.21.15.142:0/2083199268 wait complete. 2023-09-21T12:54:42.500 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:42.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:42 smithi156 ceph-mon[134078]: osdmap e86: 12 total, 12 up, 12 in 2023-09-21T12:54:42.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:42 smithi142 ceph-mon[97663]: osdmap e86: 12 total, 12 up, 12 in 2023-09-21T12:54:42.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:42 smithi160 ceph-mon[134450]: osdmap e86: 12 total, 12 up, 12 in 2023-09-21T12:54:43.490 INFO:teuthology.orchestra.run.smithi142.stdout:339302416403 2023-09-21T12:54:43.491 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.11 2023-09-21T12:54:43.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:43 smithi156 ceph-mon[134078]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 5 op/s; 15 B/s, 0 objects/s recovering 2023-09-21T12:54:43.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:43 smithi142 ceph-mon[97663]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 5 op/s; 15 B/s, 0 objects/s recovering 2023-09-21T12:54:43.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:43 smithi160 ceph-mon[134450]: pgmap v287: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 383 B/s wr, 5 op/s; 15 B/s, 0 objects/s recovering 2023-09-21T12:54:44.422 INFO:teuthology.orchestra.run.smithi142.stdout:201863462953 2023-09-21T12:54:44.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.6 2023-09-21T12:54:45.025 INFO:teuthology.orchestra.run.smithi142.stdout:223338299429 2023-09-21T12:54:45.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.7 2023-09-21T12:54:45.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 -- 172.21.15.142:0/1152397964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 msgr2=0x7fe7cc10ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/1152397964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 0x7fe7cc10ae80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009990 tx=0x7fe7c0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 -- 172.21.15.142:0/1152397964 shutdown_connections 2023-09-21T12:54:45.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/1152397964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc102070 0x7fe7cc102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/1152397964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7cc10b450 0x7fe7cc10d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/1152397964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 0x7fe7cc10ae80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 -- 172.21.15.142:0/1152397964 >> 172.21.15.142:0/1152397964 conn(0x7fe7cc0fb7a0 msgr2=0x7fe7cc0fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:45.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 -- 172.21.15.142:0/1152397964 shutdown_connections 2023-09-21T12:54:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.860+0000 7fe7d1c78700 1 -- 172.21.15.142:0/1152397964 wait complete. 2023-09-21T12:54:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 Processor -- start 2023-09-21T12:54:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 -- start start 2023-09-21T12:54:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7cc102070 0x7fe7cc199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 0x7fe7cc199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 0x7fe7cc19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc19e0d0 con 0x7fe7cc10b450 2023-09-21T12:54:45.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc19e240 con 0x7fe7cc102070 2023-09-21T12:54:45.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.861+0000 7fe7d1c78700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc19e400 con 0x7fe7cc102990 2023-09-21T12:54:45.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 0x7fe7cc19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 0x7fe7cc19dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48838/0 (socket says 172.21.15.142:48838) 2023-09-21T12:54:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 -- 172.21.15.142:0/2329316253 learned_addr learned my addr 172.21.15.142:0/2329316253 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7caffd700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 0x7fe7cc199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cb7fe700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7cc102070 0x7fe7cc199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 -- 172.21.15.142:0/2329316253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 msgr2=0x7fe7cc199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7cc102990 0x7fe7cc199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 -- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7cc102070 msgr2=0x7fe7cc199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7cc102070 0x7fe7cc199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc009520 con 0x7fe7cc10b450 2023-09-21T12:54:45.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.862+0000 7fe7cbfff700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 0x7fe7cc19dac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400ef30 tx=0x7fe7c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.863+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4018070 con 0x7fe7cc10b450 2023-09-21T12:54:45.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.863+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7c400f040 con 0x7fe7cc10b450 2023-09-21T12:54:45.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.863+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400cd00 con 0x7fe7cc10b450 2023-09-21T12:54:45.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.864+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c00095f0 con 0x7fe7cc10b450 2023-09-21T12:54:45.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.864+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc1a5d70 con 0x7fe7cc10b450 2023-09-21T12:54:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.865+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe7cc111040 con 0x7fe7cc10b450 2023-09-21T12:54:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.868+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fe7c4003a00 con 0x7fe7cc10b450 2023-09-21T12:54:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.869+0000 7fe7c8ff9700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe7b40a0820 0x7fe7b40a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.869+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe7c40cba30 con 0x7fe7cc10b450 2023-09-21T12:54:45.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7cb7fe700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe7b40a0820 0x7fe7b40a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7c8ff9700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] conn(0x7fe7b40aa360 0x7fe7b40ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe7b40aced0 con 0x7fe7b40aa360 2023-09-21T12:54:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7c40cbe40 con 0x7fe7cc10b450 2023-09-21T12:54:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7caffd700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] conn(0x7fe7b40aa360 0x7fe7b40ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.870+0000 7fe7cb7fe700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe7b40a0820 0x7fe7b40a2ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009df0 tx=0x7fe7bc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.871+0000 7fe7caffd700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] conn(0x7fe7b40aa360 0x7fe7b40ac800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.872+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== osd.10 v2:172.21.15.156:6824/2737214225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe7b40aced0 con 0x7fe7b40aa360 2023-09-21T12:54:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.888+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 --> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7cc04eae0 con 0x7fe7b40aa360 2023-09-21T12:54:45.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7c8ff9700 1 -- 172.21.15.142:0/2329316253 <== osd.10 v2:172.21.15.156:6824/2737214225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe7cc04eae0 con 0x7fe7b40aa360 2023-09-21T12:54:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] conn(0x7fe7b40aa360 msgr2=0x7fe7b40ac800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] conn(0x7fe7b40aa360 0x7fe7b40ac800 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe7b40a0820 msgr2=0x7fe7b40a2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe7b40a0820 0x7fe7b40a2ce0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc009df0 tx=0x7fe7bc009260 comp rx=0 tx=0).stop 2023-09-21T12:54:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 msgr2=0x7fe7cc19dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 --2- 172.21.15.142:0/2329316253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7cc10b450 0x7fe7cc19dac0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400ef30 tx=0x7fe7c400c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7cbfff700 1 -- 172.21.15.142:0/2329316253 reap_dead start 2023-09-21T12:54:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.889+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 shutdown_connections 2023-09-21T12:54:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.890+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 >> 172.21.15.142:0/2329316253 conn(0x7fe7cc0fb7a0 msgr2=0x7fe7cc10d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.890+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 shutdown_connections 2023-09-21T12:54:45.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.890+0000 7fe7d1c78700 1 -- 172.21.15.142:0/2329316253 wait complete. 2023-09-21T12:54:45.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:45 smithi142 ceph-mon[97663]: pgmap v288: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:45 smithi156 ceph-mon[134078]: pgmap v288: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:45 smithi160 ceph-mon[134450]: pgmap v288: 97 pgs: 1 peering, 96 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:45.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.773+0000 7f5fc191d700 1 -- 172.21.15.142:0/41544292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 msgr2=0x7f5fbc0735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.773+0000 7f5fc191d700 1 --2- 172.21.15.142:0/41544292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 0x7f5fbc0735f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009990 tx=0x7f5fac009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 -- 172.21.15.142:0/41544292 shutdown_connections 2023-09-21T12:54:45.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 --2- 172.21.15.142:0/41544292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc10d640 0x7f5fbc10fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 --2- 172.21.15.142:0/41544292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 0x7f5fbc0735f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 --2- 172.21.15.142:0/41544292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc073b30 0x7f5fbc10d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 -- 172.21.15.142:0/41544292 >> 172.21.15.142:0/41544292 conn(0x7f5fbc0fc8d0 msgr2=0x7f5fbc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 -- 172.21.15.142:0/41544292 shutdown_connections 2023-09-21T12:54:45.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.774+0000 7f5fc191d700 1 -- 172.21.15.142:0/41544292 wait complete. 2023-09-21T12:54:45.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.775+0000 7f5fc191d700 1 Processor -- start 2023-09-21T12:54:45.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 -- start start 2023-09-21T12:54:45.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 0x7f5fbc199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 0x7f5fbc199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc10d640 0x7f5fbc19dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc19e0e0 con 0x7f5fbc10d640 2023-09-21T12:54:45.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc19e250 con 0x7f5fbc073210 2023-09-21T12:54:45.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fc191d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc19e410 con 0x7f5fbc073b30 2023-09-21T12:54:45.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fba7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 0x7f5fbc199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fbaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 0x7f5fbc199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fba7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 0x7f5fbc199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35776/0 (socket says 172.21.15.142:35776) 2023-09-21T12:54:45.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fba7fc700 1 -- 172.21.15.142:0/2881013914 learned_addr learned my addr 172.21.15.142:0/2881013914 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:45.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.776+0000 7f5fbb7fe700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc10d640 0x7f5fbc19dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fbb7fe700 1 -- 172.21.15.142:0/2881013914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 msgr2=0x7f5fbc199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fbb7fe700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 0x7f5fbc199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fbb7fe700 1 -- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 msgr2=0x7f5fbc199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fbb7fe700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fbc073210 0x7f5fbc199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fbb7fe700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0095f0 con 0x7f5fbc10d640 2023-09-21T12:54:45.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.777+0000 7f5fba7fc700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fbc073b30 0x7f5fbc199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:54:45.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fbb7fe700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc10d640 0x7f5fbc19dad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400efc0 tx=0x7f5fb400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4018070 con 0x7f5fbc10d640 2023-09-21T12:54:45.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fb400f040 con 0x7f5fbc10d640 2023-09-21T12:54:45.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400cd90 con 0x7f5fbc10d640 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc19e690 con 0x7f5fbc10d640 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.778+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc1a5f50 con 0x7f5fbc10d640 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.779+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fbc1132a0 con 0x7f5fbc10d640 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.782+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f5fb4003a00 con 0x7f5fbc10d640 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fc091b700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5fa40a0750 0x7f5fa40a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5fb40cb750 con 0x7f5fbc10d640 2023-09-21T12:54:45.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fbaffd700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5fa40a0750 0x7f5fa40a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fc091b700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] conn(0x7f5fa40aa290 0x7f5fa40ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fa40ace00 con 0x7f5fa40aa290 2023-09-21T12:54:45.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.784+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb40cddd0 con 0x7f5fbc10d640 2023-09-21T12:54:45.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.785+0000 7f5fbaffd700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5fa40a0750 0x7f5fa40a2c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00b2e0 tx=0x7f5fac005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.785+0000 7f5fba7fc700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] conn(0x7f5fa40aa290 0x7f5fa40ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.785+0000 7f5fba7fc700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] conn(0x7f5fa40aa290 0x7f5fa40ac730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.786+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== osd.4 v2:172.21.15.156:6808/3785987022 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5fa40ace00 con 0x7f5fa40aa290 2023-09-21T12:54:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.805+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 --> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5fbc04eae0 con 0x7f5fa40aa290 2023-09-21T12:54:45.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc091b700 1 -- 172.21.15.142:0/2881013914 <== osd.4 v2:172.21.15.156:6808/3785987022 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5fbc04eae0 con 0x7f5fa40aa290 2023-09-21T12:54:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] conn(0x7f5fa40aa290 msgr2=0x7f5fa40ac730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] conn(0x7f5fa40aa290 0x7f5fa40ac730 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5fa40a0750 msgr2=0x7f5fa40a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5fa40a0750 0x7f5fa40a2c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00b2e0 tx=0x7f5fac005fb0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc10d640 msgr2=0x7f5fbc19dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 --2- 172.21.15.142:0/2881013914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fbc10d640 0x7f5fbc19dad0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5fb400efc0 tx=0x7f5fb400c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fbb7fe700 1 -- 172.21.15.142:0/2881013914 reap_dead start 2023-09-21T12:54:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 shutdown_connections 2023-09-21T12:54:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.806+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 >> 172.21.15.142:0/2881013914 conn(0x7f5fbc0fc8d0 msgr2=0x7f5fbc10f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:45.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.807+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 shutdown_connections 2023-09-21T12:54:45.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:44.807+0000 7f5fc191d700 1 -- 172.21.15.142:0/2881013914 wait complete. 2023-09-21T12:54:45.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.991+0000 7fd7b2b45700 1 -- 172.21.15.142:0/724813734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 msgr2=0x7fd7ac103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.991+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/724813734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 0x7fd7ac103830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00098f0 tx=0x7fd7a0009c00 comp rx=0 tx=0).stop 2023-09-21T12:54:45.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 -- 172.21.15.142:0/724813734 shutdown_connections 2023-09-21T12:54:45.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/724813734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac068900 0x7fd7ac068d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/724813734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 0x7fd7ac103830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/724813734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac103d70 0x7fd7ac1041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 -- 172.21.15.142:0/724813734 >> 172.21.15.142:0/724813734 conn(0x7fd7ac076de0 msgr2=0x7fd7ac0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:45.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 -- 172.21.15.142:0/724813734 shutdown_connections 2023-09-21T12:54:45.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.992+0000 7fd7b2b45700 1 -- 172.21.15.142:0/724813734 wait complete. 2023-09-21T12:54:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.993+0000 7fd7b2b45700 1 Processor -- start 2023-09-21T12:54:45.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.993+0000 7fd7b2b45700 1 -- start start 2023-09-21T12:54:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac068900 0x7fd7ac19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 0x7fd7ac19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 0x7fd7ac1a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1a2520 con 0x7fd7ac103d70 2023-09-21T12:54:45.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1a2690 con 0x7fd7ac105da0 2023-09-21T12:54:45.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7b2b45700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac1a2850 con 0x7fd7ac068900 2023-09-21T12:54:45.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 0x7fd7ac19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 0x7fd7ac19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48858/0 (socket says 172.21.15.142:48858) 2023-09-21T12:54:45.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.994+0000 7fd7abfff700 1 -- 172.21.15.142:0/927671278 learned_addr learned my addr 172.21.15.142:0/927671278 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:45.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac068900 0x7fd7ac19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b10e2700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 0x7fd7ac1a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:45.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 -- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 msgr2=0x7fd7ac1a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7ac105da0 0x7fd7ac1a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 -- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 msgr2=0x7fd7ac19daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:45.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 0x7fd7ac19daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:45.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a4009d00 con 0x7fd7ac068900 2023-09-21T12:54:45.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7abfff700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd7ac103d70 0x7fd7ac19daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:45.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.995+0000 7fd7b08e1700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac068900 0x7fd7ac19d560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009810 tx=0x7fd7a000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:46.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.996+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a001c070 con 0x7fd7ac068900 2023-09-21T12:54:46.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.996+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a0009520 con 0x7fd7ac068900 2023-09-21T12:54:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.996+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7a000bba0 con 0x7fd7ac068900 2023-09-21T12:54:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.996+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a0003970 con 0x7fd7ac068900 2023-09-21T12:54:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.996+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ac1aa1c0 con 0x7fd7ac068900 2023-09-21T12:54:46.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:45.997+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7ac04eae0 con 0x7fd7ac068900 2023-09-21T12:54:46.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.000+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fd7a0020030 con 0x7fd7ac068900 2023-09-21T12:54:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.002+0000 7fd7a9ffb700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd79c0a0750 0x7fd79c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd7a00ccaa0 con 0x7fd7ac068900 2023-09-21T12:54:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7abfff700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd79c0a0750 0x7fd79c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:46.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7a9ffb700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] conn(0x7fd79c0aa290 0x7fd79c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd79c0ace00 con 0x7fd79c0aa290 2023-09-21T12:54:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7a00d12a0 con 0x7fd7ac068900 2023-09-21T12:54:46.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.003+0000 7fd7b10e2700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] conn(0x7fd79c0aa290 0x7fd79c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.004+0000 7fd7abfff700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd79c0a0750 0x7fd79c0a2c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac19eb80 tx=0x7fd798009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.004+0000 7fd7b10e2700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] conn(0x7fd79c0aa290 0x7fd79c0ac730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:46.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.005+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== osd.1 v2:172.21.15.156:6800/247411952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd79c0ace00 con 0x7fd79c0aa290 2023-09-21T12:54:46.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.024+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 --> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7ac117670 con 0x7fd79c0aa290 2023-09-21T12:54:46.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.025+0000 7fd7a9ffb700 1 -- 172.21.15.142:0/927671278 <== osd.1 v2:172.21.15.156:6800/247411952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7a400f040 con 0x7fd79c0aa290 2023-09-21T12:54:46.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.025+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] conn(0x7fd79c0aa290 msgr2=0x7fd79c0ac730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:46.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.025+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] conn(0x7fd79c0aa290 0x7fd79c0ac730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:46.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd79c0a0750 msgr2=0x7fd79c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:46.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd79c0a0750 0x7fd79c0a2c10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac19eb80 tx=0x7fd798009260 comp rx=0 tx=0).stop 2023-09-21T12:54:46.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac068900 msgr2=0x7fd7ac19d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:46.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 --2- 172.21.15.142:0/927671278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7ac068900 0x7fd7ac19d560 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0009810 tx=0x7fd7a000fa00 comp rx=0 tx=0).stop 2023-09-21T12:54:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b10e2700 1 -- 172.21.15.142:0/927671278 reap_dead start 2023-09-21T12:54:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 shutdown_connections 2023-09-21T12:54:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 >> 172.21.15.142:0/927671278 conn(0x7fd7ac076de0 msgr2=0x7fd7ac0fdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:46.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 shutdown_connections 2023-09-21T12:54:46.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:46.026+0000 7fd7b2b45700 1 -- 172.21.15.142:0/927671278 wait complete. 2023-09-21T12:54:47.835 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:47 smithi142 ceph-mon[97663]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:47.841 INFO:teuthology.orchestra.run.smithi142.stdout:146028888114 2023-09-21T12:54:47.842 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.4 2023-09-21T12:54:47.890 INFO:teuthology.orchestra.run.smithi142.stdout:55834574913 2023-09-21T12:54:47.891 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.1 2023-09-21T12:54:47.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:47 smithi156 ceph-mon[134078]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:47.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:47 smithi160 ceph-mon[134450]: pgmap v289: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 383 B/s wr, 7 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 -- 172.21.15.142:0/1623371236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c810d640 msgr2=0x7f25c810fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 --2- 172.21.15.142:0/1623371236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c810d640 0x7f25c810fab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f25c000b0a0 tx=0x7f25c000b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 -- 172.21.15.142:0/1623371236 shutdown_connections 2023-09-21T12:54:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 --2- 172.21.15.142:0/1623371236 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c810d640 0x7f25c810fab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 --2- 172.21.15.142:0/1623371236 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073210 0x7f25c80735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 --2- 172.21.15.142:0/1623371236 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c8073b30 0x7f25c810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.046+0000 7f25d0681700 1 -- 172.21.15.142:0/1623371236 >> 172.21.15.142:0/1623371236 conn(0x7f25c80fc8d0 msgr2=0x7f25c80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.047+0000 7f25d0681700 1 -- 172.21.15.142:0/1623371236 shutdown_connections 2023-09-21T12:54:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.047+0000 7f25d0681700 1 -- 172.21.15.142:0/1623371236 wait complete. 2023-09-21T12:54:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 Processor -- start 2023-09-21T12:54:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 -- start start 2023-09-21T12:54:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 0x7f25c8199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073b30 0x7f25c8199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c810d640 0x7f25c819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c819e210 con 0x7f25c8073210 2023-09-21T12:54:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c819e380 con 0x7f25c8073b30 2023-09-21T12:54:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.048+0000 7f25d0681700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c819e540 con 0x7f25c810d640 2023-09-21T12:54:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 0x7f25c8199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 0x7f25c8199250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48882/0 (socket says 172.21.15.142:48882) 2023-09-21T12:54:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 -- 172.21.15.142:0/518520270 learned_addr learned my addr 172.21.15.142:0/518520270 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25cdc1c700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073b30 0x7f25c8199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25cec1e700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c810d640 0x7f25c819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 -- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c810d640 msgr2=0x7f25c819dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c810d640 0x7f25c819dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 -- 172.21.15.142:0/518520270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073b30 msgr2=0x7f25c8199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073b30 0x7f25c8199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25ce41d700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c0009d00 con 0x7f25c8073210 2023-09-21T12:54:48.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.049+0000 7f25cdc1c700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f25c8073b30 0x7f25c8199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:48.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25ce41d700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 0x7f25c8199250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e9a0 tx=0x7f25c400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4009790 con 0x7f25c8073210 2023-09-21T12:54:48.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c819e820 con 0x7f25c8073210 2023-09-21T12:54:48.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25c4010430 con 0x7f25c8073210 2023-09-21T12:54:48.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c4018680 con 0x7f25c8073210 2023-09-21T12:54:48.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.050+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c81a6080 con 0x7f25c8073210 2023-09-21T12:54:48.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.051+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f25c8113260 con 0x7f25c8073210 2023-09-21T12:54:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.055+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f25c40105a0 con 0x7f25c8073210 2023-09-21T12:54:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.056+0000 7f25bf7fe700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25b40a06d0 0x7f25b40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.056+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25c4014070 con 0x7f25c8073210 2023-09-21T12:54:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.056+0000 7f25cdc1c700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25b40a06d0 0x7f25b40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.056+0000 7f25bf7fe700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] conn(0x7f25b40aa210 0x7f25b40ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.057+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f25b40acd80 con 0x7f25b40aa210 2023-09-21T12:54:48.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.057+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c40ccca0 con 0x7f25c8073210 2023-09-21T12:54:48.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.057+0000 7f25cec1e700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] conn(0x7f25b40aa210 0x7f25b40ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.057+0000 7f25cdc1c700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25b40a06d0 0x7f25b40a2b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25c819a870 tx=0x7f25b8009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.057+0000 7f25cec1e700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] conn(0x7f25b40aa210 0x7f25b40ac6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.058+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== osd.5 v2:172.21.15.160:6808/4176368552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f25b40acd80 con 0x7f25b40aa210 2023-09-21T12:54:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.080+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 --> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f25c804eae0 con 0x7f25b40aa210 2023-09-21T12:54:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.081+0000 7f25bf7fe700 1 -- 172.21.15.142:0/518520270 <== osd.5 v2:172.21.15.160:6808/4176368552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f25c804eae0 con 0x7f25b40aa210 2023-09-21T12:54:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] conn(0x7f25b40aa210 msgr2=0x7f25b40ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] conn(0x7f25b40aa210 0x7f25b40ac6b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25b40a06d0 msgr2=0x7f25b40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25b40a06d0 0x7f25b40a2b90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f25c819a870 tx=0x7f25b8009260 comp rx=0 tx=0).stop 2023-09-21T12:54:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 msgr2=0x7f25c8199250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 --2- 172.21.15.142:0/518520270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f25c8073210 0x7f25c8199250 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f25c400e9a0 tx=0x7f25c400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25cec1e700 1 -- 172.21.15.142:0/518520270 reap_dead start 2023-09-21T12:54:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 shutdown_connections 2023-09-21T12:54:48.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.082+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 >> 172.21.15.142:0/518520270 conn(0x7f25c80fc8d0 msgr2=0x7f25c810f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.083+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 shutdown_connections 2023-09-21T12:54:48.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.084+0000 7f25d0681700 1 -- 172.21.15.142:0/518520270 wait complete. 2023-09-21T12:54:48.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 -- 172.21.15.142:0/3918561882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8101070 msgr2=0x7fa7c8101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/3918561882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8101070 0x7fa7c8101450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009990 tx=0x7fa7b0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 -- 172.21.15.142:0/3918561882 shutdown_connections 2023-09-21T12:54:48.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/3918561882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8101070 0x7fa7c8101450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/3918561882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8106150 0x7fa7c810dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/3918561882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7c8101a20 0x7fa7c8105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.617+0000 7fa7ce86c700 1 -- 172.21.15.142:0/3918561882 >> 172.21.15.142:0/3918561882 conn(0x7fa7c80fc900 msgr2=0x7fa7c80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:48.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.618+0000 7fa7ce86c700 1 -- 172.21.15.142:0/3918561882 shutdown_connections 2023-09-21T12:54:48.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.618+0000 7fa7ce86c700 1 -- 172.21.15.142:0/3918561882 wait complete. 2023-09-21T12:54:48.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.619+0000 7fa7ce86c700 1 Processor -- start 2023-09-21T12:54:48.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 -- start start 2023-09-21T12:54:48.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8101070 0x7fa7c8196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7c8101a20 0x7fa7c81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8106150 0x7fa7c819b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819be60 con 0x7fa7c8106150 2023-09-21T12:54:48.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819bfd0 con 0x7fa7c8101070 2023-09-21T12:54:48.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.620+0000 7fa7ce86c700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c819c190 con 0x7fa7c8101a20 2023-09-21T12:54:48.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8106150 0x7fa7c819b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8101070 0x7fa7c8196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7c77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7c8101a20 0x7fa7c81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8101070 0x7fa7c8196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56590/0 (socket says 172.21.15.142:56590) 2023-09-21T12:54:48.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7c7fff700 1 -- 172.21.15.142:0/264075664 learned_addr learned my addr 172.21.15.142:0/264075664 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:48.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 -- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7c8101a20 msgr2=0x7fa7c81973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7c8101a20 0x7fa7c81973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 -- 172.21.15.142:0/264075664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8101070 msgr2=0x7fa7c8196ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa7c8101070 0x7fa7c8196ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0009c40 con 0x7fa7c8106150 2023-09-21T12:54:48.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7cce09700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8106150 0x7fa7c819b850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000efb0 tx=0x7fa7c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.621+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0003a00 con 0x7fa7c8106150 2023-09-21T12:54:48.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.622+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b00095f0 con 0x7fa7c8106150 2023-09-21T12:54:48.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.622+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7c000f040 con 0x7fa7c8106150 2023-09-21T12:54:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.622+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004540 con 0x7fa7c8106150 2023-09-21T12:54:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.622+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c81a3b00 con 0x7fa7c8106150 2023-09-21T12:54:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.623+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa7c8111070 con 0x7fa7c8106150 2023-09-21T12:54:48.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.625+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fa7c0003bf0 con 0x7fa7c8106150 2023-09-21T12:54:48.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c57fa700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7b40a06d0 0x7fa7b40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa7c00cbe20 con 0x7fa7c8106150 2023-09-21T12:54:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c7fff700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7b40a06d0 0x7fa7b40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c57fa700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] conn(0x7fa7b40aa210 0x7fa7b40ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7b40acd80 con 0x7fa7b40aa210 2023-09-21T12:54:48.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.627+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c00cc230 con 0x7fa7c8106150 2023-09-21T12:54:48.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.628+0000 7fa7c7fff700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7b40a06d0 0x7fa7b40a2b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0005cd0 tx=0x7fa7b0005bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.628+0000 7fa7c77fe700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] conn(0x7fa7b40aa210 0x7fa7b40ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:48.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.629+0000 7fa7c77fe700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] conn(0x7fa7b40aa210 0x7fa7b40ac6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:48.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.630+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== osd.8 v2:172.21.15.160:6816/2074363946 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa7b40acd80 con 0x7fa7b40aa210 2023-09-21T12:54:48.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.647+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 --> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa7c804eae0 con 0x7fa7b40aa210 2023-09-21T12:54:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.647+0000 7fa7c57fa700 1 -- 172.21.15.142:0/264075664 <== osd.8 v2:172.21.15.160:6816/2074363946 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa7c804eae0 con 0x7fa7b40aa210 2023-09-21T12:54:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] conn(0x7fa7b40aa210 msgr2=0x7fa7b40ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] conn(0x7fa7b40aa210 0x7fa7b40ac6b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7b40a06d0 msgr2=0x7fa7b40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7b40a06d0 0x7fa7b40a2b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0005cd0 tx=0x7fa7b0005bc0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8106150 msgr2=0x7fa7c819b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 --2- 172.21.15.142:0/264075664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa7c8106150 0x7fa7c819b850 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000efb0 tx=0x7fa7c000c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7cce09700 1 -- 172.21.15.142:0/264075664 reap_dead start 2023-09-21T12:54:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 shutdown_connections 2023-09-21T12:54:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 >> 172.21.15.142:0/264075664 conn(0x7fa7c80fc900 msgr2=0x7fa7c8104a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 shutdown_connections 2023-09-21T12:54:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:48.648+0000 7fa7ce86c700 1 -- 172.21.15.142:0/264075664 wait complete. 2023-09-21T12:54:49.279 INFO:teuthology.orchestra.run.smithi142.stdout:167503724591 2023-09-21T12:54:49.280 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.5 2023-09-21T12:54:49.673 INFO:teuthology.orchestra.run.smithi142.stdout:309237645334 2023-09-21T12:54:49.674 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.10 2023-09-21T12:54:49.686 INFO:teuthology.orchestra.run.smithi142.stdout:253403070497 2023-09-21T12:54:49.686 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.8 2023-09-21T12:54:49.793 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:49 smithi142 ceph-mon[97663]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:49.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 -- 172.21.15.142:0/255209708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 msgr2=0x7f6b64101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/255209708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b64101440 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009990 tx=0x7f6b58009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 -- 172.21.15.142:0/255209708 shutdown_connections 2023-09-21T12:54:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/255209708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 0x7f6b6410dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/255209708 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b64101440 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/255209708 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b64101a10 0x7f6b64105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.816+0000 7f6b6adb1700 1 -- 172.21.15.142:0/255209708 >> 172.21.15.142:0/255209708 conn(0x7f6b640fc8d0 msgr2=0x7f6b640fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:49.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.819+0000 7f6b6adb1700 1 -- 172.21.15.142:0/255209708 shutdown_connections 2023-09-21T12:54:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.819+0000 7f6b6adb1700 1 -- 172.21.15.142:0/255209708 wait complete. 2023-09-21T12:54:49.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.820+0000 7f6b6adb1700 1 Processor -- start 2023-09-21T12:54:49.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.820+0000 7f6b6adb1700 1 -- start start 2023-09-21T12:54:49.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b641a2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:49.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b64101a10 0x7f6b641a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:49.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 0x7f6b6410ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:49.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6410d100 con 0x7f6b64101a10 2023-09-21T12:54:49.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6410d270 con 0x7f6b64101060 2023-09-21T12:54:49.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.821+0000 7f6b6adb1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6410d430 con 0x7f6b64106140 2023-09-21T12:54:49.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b68b4d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b641a2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:49.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b68b4d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b641a2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56612/0 (socket says 172.21.15.142:56612) 2023-09-21T12:54:49.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b63fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b64101a10 0x7f6b641a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:49.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 0x7f6b6410ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:49.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b68b4d700 1 -- 172.21.15.142:0/3903633856 learned_addr learned my addr 172.21.15.142:0/3903633856 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 -- 172.21.15.142:0/3903633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 msgr2=0x7f6b641a2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b64101060 0x7f6b641a2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 -- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b64101a10 msgr2=0x7f6b641a27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b64101a10 0x7f6b641a27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b50009520 con 0x7f6b64106140 2023-09-21T12:54:49.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.822+0000 7f6b6934e700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 0x7f6b6410ca20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00efc0 tx=0x7f6b5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:49.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.823+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c018070 con 0x7f6b64106140 2023-09-21T12:54:49.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.823+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b580095f0 con 0x7f6b64106140 2023-09-21T12:54:49.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.823+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b5c00f040 con 0x7f6b64106140 2023-09-21T12:54:49.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.823+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c00cd40 con 0x7f6b64106140 2023-09-21T12:54:49.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.823+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b641aa1a0 con 0x7f6b64106140 2023-09-21T12:54:49.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.824+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b64111060 con 0x7f6b64106140 2023-09-21T12:54:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.826+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f6b5c003a00 con 0x7f6b64106140 2023-09-21T12:54:49.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.827+0000 7f6b61ffb700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6b540a06d0 0x7f6b540a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.827+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6b5c0cb8c0 con 0x7f6b64106140 2023-09-21T12:54:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.827+0000 7f6b68b4d700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6b540a06d0 0x7f6b540a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.828+0000 7f6b61ffb700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] conn(0x7f6b540aa210 0x7f6b540ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.828+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b540acd80 con 0x7f6b540aa210 2023-09-21T12:54:49.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.828+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5c0d02a0 con 0x7f6b64106140 2023-09-21T12:54:49.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.828+0000 7f6b63fff700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] conn(0x7f6b540aa210 0x7f6b540ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:49.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.828+0000 7f6b68b4d700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6b540a06d0 0x7f6b540a2b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b6410dc60 tx=0x7f6b5800b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:49.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.829+0000 7f6b63fff700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] conn(0x7f6b540aa210 0x7f6b540ac6b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:49.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.830+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== osd.9 v2:172.21.15.142:6826/1610185584 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6b540acd80 con 0x7f6b540aa210 2023-09-21T12:54:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.850+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 --> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b6404eae0 con 0x7f6b540aa210 2023-09-21T12:54:49.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.851+0000 7f6b61ffb700 1 -- 172.21.15.142:0/3903633856 <== osd.9 v2:172.21.15.142:6826/1610185584 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6b6404eae0 con 0x7f6b540aa210 2023-09-21T12:54:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] conn(0x7f6b540aa210 msgr2=0x7f6b540ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] conn(0x7f6b540aa210 0x7f6b540ac6b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6b540a06d0 msgr2=0x7f6b540a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6b540a06d0 0x7f6b540a2b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b6410dc60 tx=0x7f6b5800b260 comp rx=0 tx=0).stop 2023-09-21T12:54:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 msgr2=0x7f6b6410ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 --2- 172.21.15.142:0/3903633856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b64106140 0x7f6b6410ca20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00efc0 tx=0x7f6b5c00c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6934e700 1 -- 172.21.15.142:0/3903633856 reap_dead start 2023-09-21T12:54:49.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 shutdown_connections 2023-09-21T12:54:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 >> 172.21.15.142:0/3903633856 conn(0x7f6b640fc8d0 msgr2=0x7f6b64102a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 shutdown_connections 2023-09-21T12:54:49.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:49.852+0000 7f6b6adb1700 1 -- 172.21.15.142:0/3903633856 wait complete. 2023-09-21T12:54:49.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:49 smithi156 ceph-mon[134078]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:49 smithi160 ceph-mon[134450]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 5 op/s; 19 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 -- 172.21.15.142:0/524182181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 msgr2=0x7fcfb41061b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 --2- 172.21.15.142:0/524182181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 0x7fcfb41061b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4009990 tx=0x7fcfa4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 -- 172.21.15.142:0/524182181 shutdown_connections 2023-09-21T12:54:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 --2- 172.21.15.142:0/524182181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 0x7fcfb41061b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 --2- 172.21.15.142:0/524182181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb41006e0 0x7fcfb410cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 --2- 172.21.15.142:0/524182181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb40ffd20 0x7fcfb41001a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 -- 172.21.15.142:0/524182181 >> 172.21.15.142:0/524182181 conn(0x7fcfb4076de0 msgr2=0x7fcfb40771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 -- 172.21.15.142:0/524182181 shutdown_connections 2023-09-21T12:54:50.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.531+0000 7fcfb92da700 1 -- 172.21.15.142:0/524182181 wait complete. 2023-09-21T12:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.532+0000 7fcfb92da700 1 Processor -- start 2023-09-21T12:54:50.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.532+0000 7fcfb92da700 1 -- start start 2023-09-21T12:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 0x7fcfb4199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb41006e0 0x7fcfb4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 0x7fcfb419da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb419e010 con 0x7fcfb4105dd0 2023-09-21T12:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb419e180 con 0x7fcfb40ffd20 2023-09-21T12:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb92da700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb419e340 con 0x7fcfb41006e0 2023-09-21T12:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 0x7fcfb4199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb41006e0 0x7fcfb4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 0x7fcfb4199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56626/0 (socket says 172.21.15.142:56626) 2023-09-21T12:54:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 -- 172.21.15.142:0/2067924373 learned_addr learned my addr 172.21.15.142:0/2067924373 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:50.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb37fe700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 0x7fcfb419da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 -- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb41006e0 msgr2=0x7fcfb4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb41006e0 0x7fcfb4199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 -- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 msgr2=0x7fcfb419da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.533+0000 7fcfb2ffd700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfb4105dd0 0x7fcfb419da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcfb2ffd700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac009c40 con 0x7fcfb40ffd20 2023-09-21T12:54:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcfb2ffd700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 0x7fcfb4199050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa401d070 con 0x7fcfb40ffd20 2023-09-21T12:54:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa40095f0 con 0x7fcfb40ffd20 2023-09-21T12:54:50.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfa4021410 con 0x7fcfb40ffd20 2023-09-21T12:54:50.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4017650 con 0x7fcfb40ffd20 2023-09-21T12:54:50.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.534+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb41a5cb0 con 0x7fcfb40ffd20 2023-09-21T12:54:50.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.535+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcfb404eae0 con 0x7fcfb40ffd20 2023-09-21T12:54:50.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.537+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fcfa40217f0 con 0x7fcfb40ffd20 2023-09-21T12:54:50.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcf9bfff700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf9c0a06d0 0x7fcf9c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcfa40cd6b0 con 0x7fcfb40ffd20 2023-09-21T12:54:50.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcfb27fc700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf9c0a06d0 0x7fcf9c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcf9bfff700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] conn(0x7fcf9c0aa210 0x7fcf9c0ac6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf9c0acd80 con 0x7fcf9c0aa210 2023-09-21T12:54:50.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.539+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfa40cda20 con 0x7fcfb40ffd20 2023-09-21T12:54:50.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.540+0000 7fcfb37fe700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] conn(0x7fcf9c0aa210 0x7fcf9c0ac6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.540+0000 7fcfb27fc700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf9c0a06d0 0x7fcf9c0a2b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfb419a670 tx=0x7fcfa800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:50.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.540+0000 7fcfb37fe700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] conn(0x7fcf9c0aa210 0x7fcf9c0ac6b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:50.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.541+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== osd.2 v2:172.21.15.160:6800/3134850125 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcf9c0acd80 con 0x7fcf9c0aa210 2023-09-21T12:54:50.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.562+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 --> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcfb410ff30 con 0x7fcf9c0aa210 2023-09-21T12:54:50.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.563+0000 7fcf9bfff700 1 -- 172.21.15.142:0/2067924373 <== osd.2 v2:172.21.15.160:6800/3134850125 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcfac00f040 con 0x7fcf9c0aa210 2023-09-21T12:54:50.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.563+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] conn(0x7fcf9c0aa210 msgr2=0x7fcf9c0ac6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.563+0000 7fcfb92da700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] conn(0x7fcf9c0aa210 0x7fcf9c0ac6b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.564+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf9c0a06d0 msgr2=0x7fcf9c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.564+0000 7fcfb92da700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fcf9c0a06d0 0x7fcf9c0a2b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcfb419a670 tx=0x7fcfa800b410 comp rx=0 tx=0).stop 2023-09-21T12:54:50.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.564+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 msgr2=0x7fcfb4199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.564+0000 7fcfb92da700 1 --2- 172.21.15.142:0/2067924373 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfb40ffd20 0x7fcfb4199050 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000c00 tx=0x7fcfa40047b0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.564+0000 7fcfb37fe700 1 -- 172.21.15.142:0/2067924373 reap_dead start 2023-09-21T12:54:50.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.565+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 shutdown_connections 2023-09-21T12:54:50.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.565+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 >> 172.21.15.142:0/2067924373 conn(0x7fcfb4076de0 msgr2=0x7fcfb40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:50.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.565+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 shutdown_connections 2023-09-21T12:54:50.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.565+0000 7fcfb92da700 1 -- 172.21.15.142:0/2067924373 wait complete. 2023-09-21T12:54:50.573 INFO:teuthology.orchestra.run.smithi142.stdout:287762808860 2023-09-21T12:54:50.573 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.9 2023-09-21T12:54:50.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.909+0000 7f06060bf700 1 -- 172.21.15.142:0/490519357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101060 msgr2=0x7f0600101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.909+0000 7f06060bf700 1 --2- 172.21.15.142:0/490519357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101060 0x7f0600101440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f05f00098f0 tx=0x7f05f0009c00 comp rx=0 tx=0).stop 2023-09-21T12:54:50.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 -- 172.21.15.142:0/490519357 shutdown_connections 2023-09-21T12:54:50.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 --2- 172.21.15.142:0/490519357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600106140 0x7f060010dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 --2- 172.21.15.142:0/490519357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101060 0x7f0600101440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 --2- 172.21.15.142:0/490519357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600101a10 0x7f0600105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 -- 172.21.15.142:0/490519357 >> 172.21.15.142:0/490519357 conn(0x7f06000fc8d0 msgr2=0x7f06000fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:50.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 -- 172.21.15.142:0/490519357 shutdown_connections 2023-09-21T12:54:50.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.910+0000 7f06060bf700 1 -- 172.21.15.142:0/490519357 wait complete. 2023-09-21T12:54:50.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.911+0000 7f06060bf700 1 Processor -- start 2023-09-21T12:54:50.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.911+0000 7f06060bf700 1 -- start start 2023-09-21T12:54:50.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 0x7f0600199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 0x7f06001996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 0x7f060019db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019e120 con 0x7f0600101060 2023-09-21T12:54:50.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019e290 con 0x7f0600101a10 2023-09-21T12:54:50.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f06060bf700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060019e450 con 0x7f0600106140 2023-09-21T12:54:50.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f05ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 0x7f0600199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f05ff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 0x7f0600199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48966/0 (socket says 172.21.15.142:48966) 2023-09-21T12:54:50.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f05ff7fe700 1 -- 172.21.15.142:0/3566002074 learned_addr learned my addr 172.21.15.142:0/3566002074 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:50.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f05fffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 0x7f060019db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.912+0000 7f05feffd700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 0x7f06001996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 -- 172.21.15.142:0/3566002074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 msgr2=0x7f06001996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 0x7f06001996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 -- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 msgr2=0x7f0600199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:50.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 0x7f0600199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:50.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 -- 172.21.15.142:0/3566002074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009520 con 0x7f0600106140 2023-09-21T12:54:50.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05feffd700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 0x7f06001996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:50.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.913+0000 7f05fffff700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 0x7f060019db10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05f800efc0 tx=0x7f05f800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:50.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.914+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8018070 con 0x7f0600106140 2023-09-21T12:54:50.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.914+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f060019e6d0 con 0x7f0600106140 2023-09-21T12:54:50.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.914+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06001a5f90 con 0x7f0600106140 2023-09-21T12:54:50.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.914+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05f800f040 con 0x7f0600106140 2023-09-21T12:54:50.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.914+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800cbe0 con 0x7f0600106140 2023-09-21T12:54:50.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.915+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec005320 con 0x7f0600106140 2023-09-21T12:54:50.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.918+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f05f8003a00 con 0x7f0600106140 2023-09-21T12:54:50.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.920+0000 7f05fcff9700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 0x7f05e80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:50.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.920+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f05f80cb680 con 0x7f0600106140 2023-09-21T12:54:50.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.921+0000 7f05ff7fe700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 0x7f05e80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:50.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.921+0000 7f05ff7fe700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 0x7f05e80a2b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05f00098c0 tx=0x7f05f0019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:50.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:50.924+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f05f80950f0 con 0x7f0600106140 2023-09-21T12:54:50.933 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.066 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.106 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.222+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f05ec005190 con 0x7f0600106140 2023-09-21T12:54:51.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.222+0000 7f05fcff9700 1 -- 172.21.15.142:0/3566002074 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05f8098710 con 0x7f0600106140 2023-09-21T12:54:51.222 INFO:teuthology.orchestra.run.smithi142.stdout:34359738438 2023-09-21T12:54:51.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.224+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 msgr2=0x7f05e80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:51.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.224+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 0x7f05e80a2b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05f00098c0 tx=0x7f05f0019040 comp rx=0 tx=0).stop 2023-09-21T12:54:51.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 msgr2=0x7f060019db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 0x7f060019db10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f05f800efc0 tx=0x7f05f800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 shutdown_connections 2023-09-21T12:54:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05e80a06d0 0x7f05e80a2b90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0600101060 0x7f0600199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:51.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0600106140 0x7f060019db10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 --2- 172.21.15.142:0/3566002074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0600101a10 0x7f06001996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 >> 172.21.15.142:0/3566002074 conn(0x7f06000fc8d0 msgr2=0x7f06000fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 shutdown_connections 2023-09-21T12:54:51.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:51.225+0000 7f06060bf700 1 -- 172.21.15.142:0/3566002074 wait complete. 2023-09-21T12:54:51.246 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.494 INFO:teuthology.orchestra.run.smithi142.stdout:77309411390 2023-09-21T12:54:51.495 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.2 2023-09-21T12:54:51.798 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.802 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:51.865 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:51 smithi142 ceph-mon[97663]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:51.865 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:51 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3566002074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-21T12:54:51.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:51 smithi156 ceph-mon[134078]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:51.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:51 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3566002074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-21T12:54:51.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:51 smithi160 ceph-mon[134450]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s; 15 B/s, 1 keys/s, 0 objects/s recovering 2023-09-21T12:54:51.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:51 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3566002074' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-21T12:54:53.867 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:53 smithi142 ceph-mon[97663]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:53.869 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738436 got 34359738438 for osd.0 2023-09-21T12:54:53.870 DEBUG:teuthology.parallel:result is None 2023-09-21T12:54:53.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:53 smithi156 ceph-mon[134078]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:53.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:53 smithi160 ceph-mon[134450]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 6 op/s; 14 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 -- 172.21.15.142:0/2807264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 msgr2=0x7fc220068d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 --2- 172.21.15.142:0/2807264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220068d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc214009990 tx=0x7fc214009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 -- 172.21.15.142:0/2807264852 shutdown_connections 2023-09-21T12:54:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 --2- 172.21.15.142:0/2807264852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc2200692c0 0x7fc22010dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 --2- 172.21.15.142:0/2807264852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc220106f70 0x7fc220107350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 --2- 172.21.15.142:0/2807264852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220068d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 -- 172.21.15.142:0/2807264852 >> 172.21.15.142:0/2807264852 conn(0x7fc220076de0 msgr2=0x7fc2200771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 -- 172.21.15.142:0/2807264852 shutdown_connections 2023-09-21T12:54:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.797+0000 7fc22503a700 1 -- 172.21.15.142:0/2807264852 wait complete. 2023-09-21T12:54:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.798+0000 7fc22503a700 1 Processor -- start 2023-09-21T12:54:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.798+0000 7fc22503a700 1 -- start start 2023-09-21T12:54:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2200692c0 0x7fc2201995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220106f70 0x7fc22019da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019e030 con 0x7fc220068900 2023-09-21T12:54:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019e1a0 con 0x7fc220106f70 2023-09-21T12:54:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc22503a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019e360 con 0x7fc2200692c0 2023-09-21T12:54:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59304/0 (socket says 172.21.15.142:59304) 2023-09-21T12:54:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 -- 172.21.15.142:0/2761707741 learned_addr learned my addr 172.21.15.142:0/2761707741 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21e59c700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2200692c0 0x7fc2201995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21f59e700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220106f70 0x7fc22019da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 -- 172.21.15.142:0/2761707741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2200692c0 msgr2=0x7fc2201995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2200692c0 0x7fc2201995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 -- 172.21.15.142:0/2761707741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220106f70 msgr2=0x7fc22019da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220106f70 0x7fc22019da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.799+0000 7fc21ed9d700 1 -- 172.21.15.142:0/2761707741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2140095f0 con 0x7fc220068900 2023-09-21T12:54:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc21ed9d700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d950 tx=0x7fc21000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000f890 con 0x7fc220068900 2023-09-21T12:54:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22019e640 con 0x7fc220068900 2023-09-21T12:54:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc210010460 con 0x7fc220068900 2023-09-21T12:54:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000e610 con 0x7fc220068900 2023-09-21T12:54:55.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.800+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2201a5ea0 con 0x7fc220068900 2023-09-21T12:54:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.803+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc22004eae0 con 0x7fc220068900 2023-09-21T12:54:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.805+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fc2100108d0 con 0x7fc220068900 2023-09-21T12:54:55.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.807+0000 7fc207fff700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 0x7fc2080a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.808+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc2100cbe10 con 0x7fc220068900 2023-09-21T12:54:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.808+0000 7fc21e59c700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 0x7fc2080a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.809+0000 7fc21e59c700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 0x7fc2080a2c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc22019a690 tx=0x7fc214005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.812+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc2100957f0 con 0x7fc220068900 2023-09-21T12:54:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:55 smithi156 ceph-mon[134078]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:55.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:55 smithi142 ceph-mon[97663]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:55.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:55 smithi160 ceph-mon[134450]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s; 2 B/s, 0 keys/s, 0 objects/s recovering 2023-09-21T12:54:55.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.977+0000 7f0db0ecd700 1 -- 172.21.15.142:0/1948084334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073b30 msgr2=0x7f0dac10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:55.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.977+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/1948084334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073b30 0x7f0dac10d100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0da0009990 tx=0x7f0da0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 -- 172.21.15.142:0/1948084334 shutdown_connections 2023-09-21T12:54:55.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/1948084334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073210 0x7f0dac0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/1948084334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac10fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/1948084334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073b30 0x7f0dac10d100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 -- 172.21.15.142:0/1948084334 >> 172.21.15.142:0/1948084334 conn(0x7f0dac0fc8d0 msgr2=0x7f0dac0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:55.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 -- 172.21.15.142:0/1948084334 shutdown_connections 2023-09-21T12:54:55.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.978+0000 7f0db0ecd700 1 -- 172.21.15.142:0/1948084334 wait complete. 2023-09-21T12:54:55.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.979+0000 7f0db0ecd700 1 Processor -- start 2023-09-21T12:54:55.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.979+0000 7f0db0ecd700 1 -- start start 2023-09-21T12:54:55.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.979+0000 7f0db0ecd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073210 0x7f0dac1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0db0ecd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073b30 0x7f0dac199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0db0ecd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0db0ecd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac19e0b0 con 0x7f0dac073b30 2023-09-21T12:54:55.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0db0ecd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac19e220 con 0x7f0dac10d640 2023-09-21T12:54:55.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0db0ecd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac19e3e0 con 0x7f0dac073210 2023-09-21T12:54:55.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0da9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073b30 0x7f0dac199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45640/0 (socket says 172.21.15.142:45640) 2023-09-21T12:54:55.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 -- 172.21.15.142:0/885545455 learned_addr learned my addr 172.21.15.142:0/885545455 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:55.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 -- 172.21.15.142:0/885545455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073210 msgr2=0x7f0dac1990f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T12:54:55.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073210 0x7f0dac1990f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 -- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073b30 msgr2=0x7f0dac199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:55.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073b30 0x7f0dac199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:55.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.980+0000 7f0daad9d700 1 -- 172.21.15.142:0/885545455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da00095f0 con 0x7f0dac10d640 2023-09-21T12:54:55.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0daad9d700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0da400ef30 tx=0x7f0da400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:55.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4018070 con 0x7f0dac10d640 2023-09-21T12:54:55.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac19e660 con 0x7f0dac10d640 2023-09-21T12:54:55.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac1a5f20 con 0x7f0dac10d640 2023-09-21T12:54:55.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0da400f040 con 0x7f0dac10d640 2023-09-21T12:54:55.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.981+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400cd90 con 0x7f0dac10d640 2023-09-21T12:54:55.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.983+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c005320 con 0x7f0dac10d640 2023-09-21T12:54:55.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.985+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f0da4004ad0 con 0x7f0dac10d640 2023-09-21T12:54:55.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.986+0000 7f0d9b7fe700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 0x7f0d940a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:55.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.986+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0da40cb7a0 con 0x7f0dac10d640 2023-09-21T12:54:55.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.987+0000 7f0daa59c700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 0x7f0d940a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:55.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.987+0000 7f0daa59c700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 0x7f0d940a2c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00ba10 tx=0x7f0d9c00b3f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:55.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:55.990+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0da40951b0 con 0x7f0dac10d640 2023-09-21T12:54:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.077+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc220110e90 con 0x7fc220068900 2023-09-21T12:54:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.077+0000 7fc207fff700 1 -- 172.21.15.142:0/2761707741 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc210098e10 con 0x7fc220068900 2023-09-21T12:54:56.077 INFO:teuthology.orchestra.run.smithi142.stdout:167503724592 2023-09-21T12:54:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.080+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 msgr2=0x7fc2080a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.080+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 0x7fc2080a2c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc22019a690 tx=0x7fc214005fd0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.080+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 msgr2=0x7fc220199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.080+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc21000d950 tx=0x7fc21000dc60 comp rx=0 tx=0).stop 2023-09-21T12:54:56.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 shutdown_connections 2023-09-21T12:54:56.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc2080a0750 0x7fc2080a2c10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc220068900 0x7fc220199070 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc220106f70 0x7fc22019da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 --2- 172.21.15.142:0/2761707741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2200692c0 0x7fc2201995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 >> 172.21.15.142:0/2761707741 conn(0x7fc220076de0 msgr2=0x7fc22010bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 shutdown_connections 2023-09-21T12:54:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.082+0000 7fc22503a700 1 -- 172.21.15.142:0/2761707741 wait complete. 2023-09-21T12:54:56.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.234+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f0d8c005190 con 0x7f0dac10d640 2023-09-21T12:54:56.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.235+0000 7f0d9b7fe700 1 -- 172.21.15.142:0/885545455 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f0da40987d0 con 0x7f0dac10d640 2023-09-21T12:54:56.235 INFO:teuthology.orchestra.run.smithi142.stdout:339302416405 2023-09-21T12:54:56.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 msgr2=0x7f0d940a2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:56.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 0x7f0d940a2c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00ba10 tx=0x7f0d9c00b3f0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 msgr2=0x7f0dac19daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:56.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0da400ef30 tx=0x7f0da400c3a0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 shutdown_connections 2023-09-21T12:54:56.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f0d940a07d0 0x7f0d940a2c90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0dac10d640 0x7f0dac19daa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dac073210 0x7f0dac1990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 --2- 172.21.15.142:0/885545455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0dac073b30 0x7f0dac199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:56.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.237+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 >> 172.21.15.142:0/885545455 conn(0x7f0dac0fc8d0 msgr2=0x7f0dac10f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:56.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.238+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 shutdown_connections 2023-09-21T12:54:56.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:56.238+0000 7f0db0ecd700 1 -- 172.21.15.142:0/885545455 wait complete. 2023-09-21T12:54:56.841 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:56 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2761707741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-21T12:54:56.841 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:56 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/885545455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-21T12:54:56.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:56 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2761707741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-21T12:54:56.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:56 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/885545455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-21T12:54:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:56 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2761707741' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-21T12:54:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:56 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/885545455' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-21T12:54:57.354 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416403 got 339302416405 for osd.11 2023-09-21T12:54:57.355 DEBUG:teuthology.parallel:result is None 2023-09-21T12:54:57.853 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:57 smithi142 ceph-mon[97663]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:54:57.883 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:57 smithi156 ceph-mon[134078]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:54:57.913 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724591 got 167503724592 for osd.5 2023-09-21T12:54:57.914 DEBUG:teuthology.parallel:result is None 2023-09-21T12:54:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:57 smithi160 ceph-mon[134450]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:54:58.272 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 -- 172.21.15.142:0/3118194896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc111e10 msgr2=0x7f52dc114200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 --2- 172.21.15.142:0/3118194896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc111e10 0x7f52dc114200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f52d400b0a0 tx=0x7f52d400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 -- 172.21.15.142:0/3118194896 shutdown_connections 2023-09-21T12:54:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 --2- 172.21.15.142:0/3118194896 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc111e10 0x7f52dc114200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 --2- 172.21.15.142:0/3118194896 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073180 0x7f52dc073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 --2- 172.21.15.142:0/3118194896 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc073aa0 0x7f52dc1118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 -- 172.21.15.142:0/3118194896 >> 172.21.15.142:0/3118194896 conn(0x7f52dc0fc8d0 msgr2=0x7f52dc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:58.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.361+0000 7f52e373d700 1 -- 172.21.15.142:0/3118194896 shutdown_connections 2023-09-21T12:54:58.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.362+0000 7f52e373d700 1 -- 172.21.15.142:0/3118194896 wait complete. 2023-09-21T12:54:58.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.362+0000 7f52e373d700 1 Processor -- start 2023-09-21T12:54:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 -- start start 2023-09-21T12:54:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 0x7f52dc19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 0x7f52dc1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1a2590 con 0x7f52dc073180 2023-09-21T12:54:58.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1a2700 con 0x7f52dc073aa0 2023-09-21T12:54:58.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e373d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1a28c0 con 0x7f52dc111e10 2023-09-21T12:54:58.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e14d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e1cda700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 0x7f52dc1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e14d9700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59338/0 (socket says 172.21.15.142:59338) 2023-09-21T12:54:58.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e1cda700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 0x7f52dc1a1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45548/0 (socket says 172.21.15.142:45548) 2023-09-21T12:54:58.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e14d9700 1 -- 172.21.15.142:0/1997955474 learned_addr learned my addr 172.21.15.142:0/1997955474 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:58.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.363+0000 7f52e0cd8700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 0x7f52dc19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 -- 172.21.15.142:0/1997955474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 msgr2=0x7f52dc1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 0x7f52dc1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 -- 172.21.15.142:0/1997955474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 msgr2=0x7f52dc19db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 0x7f52dc19db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 -- 172.21.15.142:0/1997955474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d8009520 con 0x7f52dc073180 2023-09-21T12:54:58.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e0cd8700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 0x7f52dc19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:58.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e14d9700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52d800eb30 tx=0x7f52d800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:58.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8009880 con 0x7f52dc073180 2023-09-21T12:54:58.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52d80044e0 con 0x7f52dc073180 2023-09-21T12:54:58.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8003d80 con 0x7f52dc073180 2023-09-21T12:54:58.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc009520 con 0x7f52dc073180 2023-09-21T12:54:58.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.364+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d4009d00 con 0x7f52dc073180 2023-09-21T12:54:58.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.365+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc1042f0 con 0x7f52dc073180 2023-09-21T12:54:58.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.368+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f52d8003f00 con 0x7f52dc073180 2023-09-21T12:54:58.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.369+0000 7f52d27fc700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 0x7f52c80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.369+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f52d8014070 con 0x7f52dc073180 2023-09-21T12:54:58.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.369+0000 7f52e0cd8700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 0x7f52c80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.370+0000 7f52e0cd8700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 0x7f52c80a2b90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52dc19ebf0 tx=0x7f52cc009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:58.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.371+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f52d8095d80 con 0x7f52dc073180 2023-09-21T12:54:58.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.602+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f52dc117340 con 0x7f52dc073180 2023-09-21T12:54:58.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.602+0000 7f52d27fc700 1 -- 172.21.15.142:0/1997955474 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f52d800fe60 con 0x7f52dc073180 2023-09-21T12:54:58.602 INFO:teuthology.orchestra.run.smithi142.stdout:201863462956 2023-09-21T12:54:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 msgr2=0x7f52c80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 0x7f52c80a2b90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52dc19ebf0 tx=0x7f52cc009260 comp rx=0 tx=0).stop 2023-09-21T12:54:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 msgr2=0x7f52dc19d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52d800eb30 tx=0x7f52d800ee40 comp rx=0 tx=0).stop 2023-09-21T12:54:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 shutdown_connections 2023-09-21T12:54:58.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f52c80a06d0 0x7f52c80a2b90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f52dc073180 0x7f52dc19d5d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52dc111e10 0x7f52dc1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 --2- 172.21.15.142:0/1997955474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f52dc073aa0 0x7f52dc19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 >> 172.21.15.142:0/1997955474 conn(0x7f52dc0fc8d0 msgr2=0x7f52dc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:58.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 shutdown_connections 2023-09-21T12:54:58.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.605+0000 7f52e373d700 1 -- 172.21.15.142:0/1997955474 wait complete. 2023-09-21T12:54:58.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.430+0000 7fc3765dd700 1 -- 172.21.15.142:0/4067283872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073210 msgr2=0x7fc3700735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.430+0000 7fc3765dd700 1 --2- 172.21.15.142:0/4067283872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073210 0x7fc3700735f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc360009990 tx=0x7fc360009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 -- 172.21.15.142:0/4067283872 shutdown_connections 2023-09-21T12:54:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 --2- 172.21.15.142:0/4067283872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc37010d640 0x7fc37010fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 --2- 172.21.15.142:0/4067283872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073210 0x7fc3700735f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 --2- 172.21.15.142:0/4067283872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc370073b30 0x7fc37010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 -- 172.21.15.142:0/4067283872 >> 172.21.15.142:0/4067283872 conn(0x7fc3700fc8d0 msgr2=0x7fc3700fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 -- 172.21.15.142:0/4067283872 shutdown_connections 2023-09-21T12:54:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.431+0000 7fc3765dd700 1 -- 172.21.15.142:0/4067283872 wait complete. 2023-09-21T12:54:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 Processor -- start 2023-09-21T12:54:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 -- start start 2023-09-21T12:54:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37010d640 0x7fc37019daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019e0b0 con 0x7fc370073210 2023-09-21T12:54:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019e220 con 0x7fc37010d640 2023-09-21T12:54:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc3765dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37019e3e0 con 0x7fc370073b30 2023-09-21T12:54:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc36f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.432+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45570/0 (socket says 172.21.15.142:45570) 2023-09-21T12:54:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59368/0 (socket says 172.21.15.142:59368) 2023-09-21T12:54:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 -- 172.21.15.142:0/410118737 learned_addr learned my addr 172.21.15.142:0/410118737 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc374b7a700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37010d640 0x7fc37019daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 -- 172.21.15.142:0/410118737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37010d640 msgr2=0x7fc37019daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37010d640 0x7fc37019daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 -- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 msgr2=0x7fc3701990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 -- 172.21.15.142:0/410118737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3600095f0 con 0x7fc370073b30 2023-09-21T12:54:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36ffff700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36f7fe700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc36400e9a0 tx=0x7fc36400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364009790 con 0x7fc370073b30 2023-09-21T12:54:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.433+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc36400cbd0 con 0x7fc370073b30 2023-09-21T12:54:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.434+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364018680 con 0x7fc370073b30 2023-09-21T12:54:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.434+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37019e6c0 con 0x7fc370073b30 2023-09-21T12:54:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.434+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3701a5f20 con 0x7fc370073b30 2023-09-21T12:54:58.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.435+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc37004eae0 con 0x7fc370073b30 2023-09-21T12:54:58.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.437+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fc36400cd40 con 0x7fc370073b30 2023-09-21T12:54:58.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.438+0000 7fc36d7fa700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 0x7fc3580a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:58.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.438+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc364014070 con 0x7fc370073b30 2023-09-21T12:54:58.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.439+0000 7fc36ffff700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 0x7fc3580a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:58.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.439+0000 7fc36ffff700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 0x7fc3580a2c10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b2e0 tx=0x7fc360005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:58.743 INFO:teuthology.orchestra.run.smithi142.stdout:55834574915 2023-09-21T12:54:58.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.440+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc364095bd0 con 0x7fc370073b30 2023-09-21T12:54:58.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.682+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc37019a450 con 0x7fc370073b30 2023-09-21T12:54:58.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.682+0000 7fc36d7fa700 1 -- 172.21.15.142:0/410118737 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3640991f0 con 0x7fc370073b30 2023-09-21T12:54:58.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 msgr2=0x7fc3580a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 0x7fc3580a2c10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b2e0 tx=0x7fc360005fd0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 msgr2=0x7fc370199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:58.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc36400e9a0 tx=0x7fc36400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 shutdown_connections 2023-09-21T12:54:58.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3580a0750 0x7fc3580a2c10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc370073210 0x7fc3701990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc37010d640 0x7fc37019daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 --2- 172.21.15.142:0/410118737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc370073b30 0x7fc370199630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:58.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 >> 172.21.15.142:0/410118737 conn(0x7fc3700fc8d0 msgr2=0x7fc37010f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:58.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 shutdown_connections 2023-09-21T12:54:58.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:58.685+0000 7fc3765dd700 1 -- 172.21.15.142:0/410118737 wait complete. 2023-09-21T12:54:58.862 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:54:59.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 -- 172.21.15.142:0/3328702380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c101060 msgr2=0x7f622c101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:59.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 --2- 172.21.15.142:0/3328702380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c101060 0x7f622c101440 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f621c009990 tx=0x7f621c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 -- 172.21.15.142:0/3328702380 shutdown_connections 2023-09-21T12:54:59.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 --2- 172.21.15.142:0/3328702380 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c106140 0x7f622c10dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 --2- 172.21.15.142:0/3328702380 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c101060 0x7f622c101440 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 --2- 172.21.15.142:0/3328702380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101a10 0x7f622c105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 -- 172.21.15.142:0/3328702380 >> 172.21.15.142:0/3328702380 conn(0x7f622c0fc8d0 msgr2=0x7f622c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:59.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 -- 172.21.15.142:0/3328702380 shutdown_connections 2023-09-21T12:54:59.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.335+0000 7f6231f08700 1 -- 172.21.15.142:0/3328702380 wait complete. 2023-09-21T12:54:59.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.336+0000 7f6231f08700 1 Processor -- start 2023-09-21T12:54:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 -- start start 2023-09-21T12:54:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101060 0x7f622c196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 0x7f622c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:59.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c19bec0 con 0x7f622c101a10 2023-09-21T12:54:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c19c030 con 0x7f622c106140 2023-09-21T12:54:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f6231f08700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c19c1f0 con 0x7f622c101060 2023-09-21T12:54:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f622affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f622affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59388/0 (socket says 172.21.15.142:59388) 2023-09-21T12:54:59.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f622affd700 1 -- 172.21.15.142:0/3764108088 learned_addr learned my addr 172.21.15.142:0/3764108088 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:54:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f622b7fe700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101060 0x7f622c196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.337+0000 7f622bfff700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 0x7f622c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 -- 172.21.15.142:0/3764108088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101060 msgr2=0x7f622c196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101060 0x7f622c196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 -- 172.21.15.142:0/3764108088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 msgr2=0x7f622c19b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:59.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 0x7f622c19b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 -- 172.21.15.142:0/3764108088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621c0095f0 con 0x7f622c101a10 2023-09-21T12:54:59.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622bfff700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 0x7f622c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:54:59.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f622affd700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f622000e970 tx=0x7f622000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:59.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6220009790 con 0x7f622c101a10 2023-09-21T12:54:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f622000c7e0 con 0x7f622c101a10 2023-09-21T12:54:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200054e0 con 0x7f622c101a10 2023-09-21T12:54:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c19c4d0 con 0x7f622c101a10 2023-09-21T12:54:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.338+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c1a3d30 con 0x7f622c101a10 2023-09-21T12:54:59.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.339+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c04eae0 con 0x7f622c101a10 2023-09-21T12:54:59.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.341+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f622000c950 con 0x7f622c101a10 2023-09-21T12:54:59.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.344+0000 7f6228ff9700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 0x7f62140a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:54:59.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.344+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6220014070 con 0x7f622c101a10 2023-09-21T12:54:59.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.344+0000 7f622b7fe700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 0x7f62140a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:54:59.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.344+0000 7f622b7fe700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 0x7f62140a2b90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b2e0 tx=0x7f621c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:54:59.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.348+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6220095930 con 0x7f622c101a10 2023-09-21T12:54:59.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.560+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f622c198260 con 0x7f622c101a10 2023-09-21T12:54:59.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.561+0000 7f6228ff9700 1 -- 172.21.15.142:0/3764108088 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f6220098f50 con 0x7f622c101a10 2023-09-21T12:54:59.561 INFO:teuthology.orchestra.run.smithi142.stdout:111669149753 2023-09-21T12:54:59.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 msgr2=0x7f62140a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:59.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 0x7f62140a2b90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f621c00b2e0 tx=0x7f621c005960 comp rx=0 tx=0).stop 2023-09-21T12:54:59.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 msgr2=0x7f622c197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:54:59.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f622000e970 tx=0x7f622000ec80 comp rx=0 tx=0).stop 2023-09-21T12:54:59.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 shutdown_connections 2023-09-21T12:54:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f62140a06d0 0x7f62140a2b90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f622c106140 0x7f622c19b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f622c101060 0x7f622c196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 --2- 172.21.15.142:0/3764108088 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f622c101a10 0x7f622c197440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:54:59.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 >> 172.21.15.142:0/3764108088 conn(0x7f622c0fc8d0 msgr2=0x7f622c104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:54:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 shutdown_connections 2023-09-21T12:54:59.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:54:59.563+0000 7f6231f08700 1 -- 172.21.15.142:0/3764108088 wait complete. 2023-09-21T12:54:59.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:59 smithi156 ceph-mon[134078]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-09-21T12:54:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:59 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1997955474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-21T12:54:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:59 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/410118737' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-21T12:54:59.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:54:59 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3764108088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-21T12:54:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:59 smithi142 ceph-mon[97663]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-09-21T12:54:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:59 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1997955474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-21T12:54:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:59 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/410118737' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-21T12:54:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:54:59 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3764108088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-21T12:54:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:59 smithi160 ceph-mon[134450]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2023-09-21T12:54:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:59 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1997955474' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-21T12:54:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:59 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/410118737' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-21T12:54:59.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:54:59 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3764108088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-21T12:55:00.718 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574913 got 55834574915 for osd.1 2023-09-21T12:55:00.719 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:00.774 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462953 got 201863462956 for osd.6 2023-09-21T12:55:00.774 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:00.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 -- 172.21.15.142:0/3480570706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073210 msgr2=0x7f35700735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:00.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 --2- 172.21.15.142:0/3480570706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073210 0x7f35700735f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f356c009990 tx=0x7f356c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 -- 172.21.15.142:0/3480570706 shutdown_connections 2023-09-21T12:55:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 --2- 172.21.15.142:0/3480570706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f357010d640 0x7f357010fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 --2- 172.21.15.142:0/3480570706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073210 0x7f35700735f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 --2- 172.21.15.142:0/3480570706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3570073b30 0x7f357010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 -- 172.21.15.142:0/3480570706 >> 172.21.15.142:0/3480570706 conn(0x7f35700fc8d0 msgr2=0x7f35700fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:00.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 -- 172.21.15.142:0/3480570706 shutdown_connections 2023-09-21T12:55:00.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.809+0000 7f35781dd700 1 -- 172.21.15.142:0/3480570706 wait complete. 2023-09-21T12:55:00.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.810+0000 7f35781dd700 1 Processor -- start 2023-09-21T12:55:00.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.810+0000 7f35781dd700 1 -- start start 2023-09-21T12:55:00.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 0x7f35701996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f357010d640 0x7f357019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357019e170 con 0x7f3570073210 2023-09-21T12:55:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357019e2e0 con 0x7f357010d640 2023-09-21T12:55:00.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f35781dd700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357019e4a0 con 0x7f3570073b30 2023-09-21T12:55:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f3575f79700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f3575f79700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59402/0 (socket says 172.21.15.142:59402) 2023-09-21T12:55:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f3575f79700 1 -- 172.21.15.142:0/2568588742 learned_addr learned my addr 172.21.15.142:0/2568588742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f3575778700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 0x7f35701996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:00.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.811+0000 7f357677a700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f357010d640 0x7f357019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 -- 172.21.15.142:0/2568588742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f357010d640 msgr2=0x7f357019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f357010d640 0x7f357019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 -- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 msgr2=0x7f35701991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:00.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 -- 172.21.15.142:0/2568588742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0095f0 con 0x7f3570073b30 2023-09-21T12:55:00.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575f79700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:00.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3575778700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 0x7f35701996f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f356000b450 tx=0x7f356000b760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:00.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3560011830 con 0x7f3570073b30 2023-09-21T12:55:00.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357019e780 con 0x7f3570073b30 2023-09-21T12:55:00.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f356000be60 con 0x7f3570073b30 2023-09-21T12:55:00.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35701a5fe0 con 0x7f3570073b30 2023-09-21T12:55:00.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.812+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356001ad10 con 0x7f3570073b30 2023-09-21T12:55:00.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.814+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357004eae0 con 0x7f3570073b30 2023-09-21T12:55:00.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.816+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f356001a400 con 0x7f3570073b30 2023-09-21T12:55:00.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.818+0000 7f3566ffd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 0x7f355c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:00.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.818+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f35600cba80 con 0x7f3570073b30 2023-09-21T12:55:00.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.819+0000 7f3575f79700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 0x7f355c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:00.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.819+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3560095510 con 0x7f3570073b30 2023-09-21T12:55:00.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:00.820+0000 7f3575f79700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 0x7f355c0a2b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f356c006010 tx=0x7f356c00b540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:01.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.065+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f357019e5e0 con 0x7f3570073b30 2023-09-21T12:55:01.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.066+0000 7f3566ffd700 1 -- 172.21.15.142:0/2568588742 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f357019e5e0 con 0x7f3570073b30 2023-09-21T12:55:01.066 INFO:teuthology.orchestra.run.smithi142.stdout:223338299433 2023-09-21T12:55:01.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 msgr2=0x7f355c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 0x7f355c0a2b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f356c006010 tx=0x7f356c00b540 comp rx=0 tx=0).stop 2023-09-21T12:55:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 msgr2=0x7f35701996f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 0x7f35701996f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f356000b450 tx=0x7f356000b760 comp rx=0 tx=0).stop 2023-09-21T12:55:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 shutdown_connections 2023-09-21T12:55:01.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f355c0a06d0 0x7f355c0a2b90 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f356c006010 tx=0x7f356c00b540 comp rx=0 tx=0).stop 2023-09-21T12:55:01.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3570073210 0x7f35701991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:01.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f357010d640 0x7f357019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:01.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 --2- 172.21.15.142:0/2568588742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3570073b30 0x7f35701996f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:01.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.068+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 >> 172.21.15.142:0/2568588742 conn(0x7f35700fc8d0 msgr2=0x7f357010f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:01.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.069+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 shutdown_connections 2023-09-21T12:55:01.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.069+0000 7f35781dd700 1 -- 172.21.15.142:0/2568588742 wait complete. 2023-09-21T12:55:01.845 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:01 smithi142 ceph-mon[97663]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-09-21T12:55:01.845 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:01 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2568588742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-21T12:55:01.845 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:01 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3866936378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-21T12:55:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:01 smithi156 ceph-mon[134078]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-09-21T12:55:01.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:01 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2568588742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-21T12:55:01.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:01 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3866936378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-21T12:55:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:01 smithi160 ceph-mon[134450]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-09-21T12:55:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:01 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2568588742' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-21T12:55:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:01 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3866936378' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-21T12:55:02.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 -- 172.21.15.142:0/3601743245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073180 msgr2=0x7feb9c073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 --2- 172.21.15.142:0/3601743245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073180 0x7feb9c073560 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009990 tx=0x7feb8c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 -- 172.21.15.142:0/3601743245 shutdown_connections 2023-09-21T12:55:02.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 --2- 172.21.15.142:0/3601743245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073180 0x7feb9c073560 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 --2- 172.21.15.142:0/3601743245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c114200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 --2- 172.21.15.142:0/3601743245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073aa0 0x7feb9c1118d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 -- 172.21.15.142:0/3601743245 >> 172.21.15.142:0/3601743245 conn(0x7feb9c0fc8d0 msgr2=0x7feb9c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:02.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 -- 172.21.15.142:0/3601743245 shutdown_connections 2023-09-21T12:55:02.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.616+0000 7feba25e0700 1 -- 172.21.15.142:0/3601743245 wait complete. 2023-09-21T12:55:02.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.617+0000 7feba25e0700 1 Processor -- start 2023-09-21T12:55:02.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.617+0000 7feba25e0700 1 -- start start 2023-09-21T12:55:02.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073180 0x7feb9c19d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c1a1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a2510 con 0x7feb9c073aa0 2023-09-21T12:55:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a2680 con 0x7feb9c111e10 2023-09-21T12:55:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba25e0700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c1a2840 con 0x7feb9c073180 2023-09-21T12:55:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feba0b7d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c1a1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feb9b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59450/0 (socket says 172.21.15.142:59450) 2023-09-21T12:55:02.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feb9b7fe700 1 -- 172.21.15.142:0/122765037 learned_addr learned my addr 172.21.15.142:0/122765037 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:02.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.618+0000 7feb9bfff700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073180 0x7feb9c19d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 -- 172.21.15.142:0/122765037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073180 msgr2=0x7feb9c19d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073180 0x7feb9c19d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 -- 172.21.15.142:0/122765037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 msgr2=0x7feb9c1a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c1a1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 -- 172.21.15.142:0/122765037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c0095f0 con 0x7feb9c073aa0 2023-09-21T12:55:02.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feba0b7d700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:02.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb9b7fe700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb9000e9a0 tx=0x7feb9000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90009790 con 0x7feb9c073aa0 2023-09-21T12:55:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c1a2b20 con 0x7feb9c073aa0 2023-09-21T12:55:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb90010430 con 0x7feb9c073aa0 2023-09-21T12:55:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90018680 con 0x7feb9c073aa0 2023-09-21T12:55:02.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.619+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c1aa380 con 0x7feb9c073aa0 2023-09-21T12:55:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.621+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c1042f0 con 0x7feb9c073aa0 2023-09-21T12:55:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.622+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7feb900105a0 con 0x7feb9c073aa0 2023-09-21T12:55:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.624+0000 7feb997fa700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 0x7feb840a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.624+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feb90014070 con 0x7feb9c073aa0 2023-09-21T12:55:02.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.624+0000 7feb9bfff700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 0x7feb840a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.625+0000 7feb9bfff700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 0x7feb840a2b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00b2e0 tx=0x7feb8c005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.628+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7feb90051e10 con 0x7feb9c073aa0 2023-09-21T12:55:02.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.838+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7feb9c1173c0 con 0x7feb9c073aa0 2023-09-21T12:55:02.137 INFO:teuthology.orchestra.run.smithi142.stdout:146028888117 2023-09-21T12:55:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.838+0000 7feb997fa700 1 -- 172.21.15.142:0/122765037 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feb90095070 con 0x7feb9c073aa0 2023-09-21T12:55:02.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.840+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 msgr2=0x7feb840a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 0x7feb840a2b90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00b2e0 tx=0x7feb8c005fd0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 msgr2=0x7feb9c19da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feb9000e9a0 tx=0x7feb9000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 shutdown_connections 2023-09-21T12:55:02.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7feb840a06d0 0x7feb840a2b90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feb9c111e10 0x7feb9c1a1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feb9c073180 0x7feb9c19d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 --2- 172.21.15.142:0/122765037 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feb9c073aa0 0x7feb9c19da90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 >> 172.21.15.142:0/122765037 conn(0x7feb9c0fc8d0 msgr2=0x7feb9c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:02.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 shutdown_connections 2023-09-21T12:55:02.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.841+0000 7feba25e0700 1 -- 172.21.15.142:0/122765037 wait complete. 2023-09-21T12:55:02.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:02 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/122765037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-21T12:55:02.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:02 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/122765037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-21T12:55:02.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:02 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/122765037' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-21T12:55:02.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 -- 172.21.15.142:0/2101884545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101060 msgr2=0x7f02f8101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 --2- 172.21.15.142:0/2101884545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101060 0x7f02f8101440 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f02e8009990 tx=0x7f02e8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 -- 172.21.15.142:0/2101884545 shutdown_connections 2023-09-21T12:55:02.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 --2- 172.21.15.142:0/2101884545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101060 0x7f02f8101440 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 --2- 172.21.15.142:0/2101884545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8106140 0x7f02f810dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 --2- 172.21.15.142:0/2101884545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8101a10 0x7f02f8105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 -- 172.21.15.142:0/2101884545 >> 172.21.15.142:0/2101884545 conn(0x7f02f80fc8d0 msgr2=0x7f02f80fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:02.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 -- 172.21.15.142:0/2101884545 shutdown_connections 2023-09-21T12:55:02.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.305+0000 7f02fe8f3700 1 -- 172.21.15.142:0/2101884545 wait complete. 2023-09-21T12:55:02.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.306+0000 7f02fe8f3700 1 Processor -- start 2023-09-21T12:55:02.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.306+0000 7f02fe8f3700 1 -- start start 2023-09-21T12:55:02.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101a10 0x7f02f8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8106140 0x7f02f819dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f819e0f0 con 0x7f02f8101a10 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f819e260 con 0x7f02f8101060 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fe8f3700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f819e420 con 0x7f02f8106140 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02f7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45740/0 (socket says 172.21.15.142:45740) 2023-09-21T12:55:02.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02f7fff700 1 -- 172.21.15.142:0/3866936378 learned_addr learned my addr 172.21.15.142:0/3866936378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:02.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02f77fe700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101a10 0x7f02f8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.307+0000 7f02fce90700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8106140 0x7f02f819dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 -- 172.21.15.142:0/3866936378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8106140 msgr2=0x7f02f819dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8106140 0x7f02f819dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 -- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101a10 msgr2=0x7f02f8199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101a10 0x7f02f8199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 -- 172.21.15.142:0/3866936378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80095f0 con 0x7f02f8101060 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f7fff700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e8005910 tx=0x7f02e8005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.308+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e801d070 con 0x7f02f8101060 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.309+0000 7f02fe8f3700 1 -- 172.21.15.142:0/3866936378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f819e6a0 con 0x7f02f8101060 2023-09-21T12:55:02.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.309+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e8022470 con 0x7f02f8101060 2023-09-21T12:55:02.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.309+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e8017650 con 0x7f02f8101060 2023-09-21T12:55:02.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.309+0000 7f02fe8f3700 1 -- 172.21.15.142:0/3866936378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f81a5f60 con 0x7f02f8101060 2023-09-21T12:55:02.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.310+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d80052f0 con 0x7f02f8101060 2023-09-21T12:55:02.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.313+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f02e80225e0 con 0x7f02f8101060 2023-09-21T12:55:02.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.314+0000 7f02f57fa700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 0x7f02e00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:02.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.314+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02e80cd670 con 0x7f02f8101060 2023-09-21T12:55:02.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.315+0000 7f02f77fe700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 0x7f02e00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:02.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.315+0000 7f02f77fe700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 0x7f02e00a2c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02f819a750 tx=0x7f02ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:02.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.316+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f02e8097080 con 0x7f02f8101060 2023-09-21T12:55:02.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.550+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f02d8005160 con 0x7f02f8101060 2023-09-21T12:55:02.976 INFO:teuthology.orchestra.run.smithi142.stdout:253403070499 2023-09-21T12:55:02.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.551+0000 7f02f57fa700 1 -- 172.21.15.142:0/3866936378 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f02e809a6a0 con 0x7f02f8101060 2023-09-21T12:55:02.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.553+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 msgr2=0x7f02e00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.553+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 0x7f02e00a2c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f02f819a750 tx=0x7f02ec009260 comp rx=0 tx=0).stop 2023-09-21T12:55:02.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.553+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 msgr2=0x7f02f8199130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:02.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.553+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f02e8005910 tx=0x7f02e8005720 comp rx=0 tx=0).stop 2023-09-21T12:55:02.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 shutdown_connections 2023-09-21T12:55:02.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f02e00a0750 0x7f02e00a2c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02f8106140 0x7f02f819dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f02f8101060 0x7f02f8199130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 --2- 172.21.15.142:0/3866936378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f02f8101a10 0x7f02f8199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:02.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 >> 172.21.15.142:0/3866936378 conn(0x7f02f80fc8d0 msgr2=0x7f02f80fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:02.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 shutdown_connections 2023-09-21T12:55:02.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:01.554+0000 7f02deffd700 1 -- 172.21.15.142:0/3866936378 wait complete. 2023-09-21T12:55:03.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149749 got 111669149753 for osd.3 2023-09-21T12:55:03.249 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:03.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888114 got 146028888117 for osd.4 2023-09-21T12:55:03.253 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:03.723 INFO:tasks.cephadm.ceph_manager.ceph:need seq 223338299429 got 223338299433 for osd.7 2023-09-21T12:55:03.724 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:03.886 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:03 smithi142 ceph-mon[97663]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:03 smithi156 ceph-mon[134078]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:03.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:03 smithi160 ceph-mon[134450]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:04.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070497 got 253403070499 for osd.8 2023-09-21T12:55:04.119 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:04.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 -- 172.21.15.142:0/3907183528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 msgr2=0x7fa2d010dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/3907183528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d010dd10 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800b0a0 tx=0x7fa2c800b3b0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 -- 172.21.15.142:0/3907183528 shutdown_connections 2023-09-21T12:55:04.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/3907183528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d010dd10 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/3907183528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/3907183528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 -- 172.21.15.142:0/3907183528 >> 172.21.15.142:0/3907183528 conn(0x7fa2d00fc8d0 msgr2=0x7fa2d00fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 -- 172.21.15.142:0/3907183528 shutdown_connections 2023-09-21T12:55:04.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.244+0000 7fa2d60ad700 1 -- 172.21.15.142:0/3907183528 wait complete. 2023-09-21T12:55:04.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.245+0000 7fa2d60ad700 1 Processor -- start 2023-09-21T12:55:04.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.245+0000 7fa2d60ad700 1 -- start start 2023-09-21T12:55:04.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.245+0000 7fa2d60ad700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.245+0000 7fa2d60ad700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.245+0000 7fa2d60ad700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2d60ad700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d019bfc0 con 0x7fa2d0106140 2023-09-21T12:55:04.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2d60ad700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d019c130 con 0x7fa2d0101a10 2023-09-21T12:55:04.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2d60ad700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d019c2f0 con 0x7fa2d0101060 2023-09-21T12:55:04.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35930/0 (socket says 172.21.15.142:35930) 2023-09-21T12:55:04.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cffff700 1 -- 172.21.15.142:0/1822467727 learned_addr learned my addr 172.21.15.142:0/1822467727 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:04.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2ceffd700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 -- 172.21.15.142:0/1822467727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 msgr2=0x7fa2d0197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 -- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 msgr2=0x7fa2d019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cf7fe700 1 -- 172.21.15.142:0/1822467727 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c8009d00 con 0x7fa2d0101060 2023-09-21T12:55:04.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2ceffd700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:04.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.246+0000 7fa2cffff700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:04.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2cf7fe700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0197000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d950 tx=0x7fa2c000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000f890 con 0x7fa2d0101060 2023-09-21T12:55:04.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d019c5d0 con 0x7fa2d0101060 2023-09-21T12:55:04.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2c0010460 con 0x7fa2d0101060 2023-09-21T12:55:04.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000e610 con 0x7fa2d0101060 2023-09-21T12:55:04.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.247+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d01a3e30 con 0x7fa2d0101060 2023-09-21T12:55:04.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.248+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d004eae0 con 0x7fa2d0101060 2023-09-21T12:55:04.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.250+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fa2c00105d0 con 0x7fa2d0101060 2023-09-21T12:55:04.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.251+0000 7fa2ccff9700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 0x7fa2b80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.251+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa2c00cb9e0 con 0x7fa2d0101060 2023-09-21T12:55:04.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.252+0000 7fa2ceffd700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 0x7fa2b80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.252+0000 7fa2ceffd700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 0x7fa2b80a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0198620 tx=0x7fa2c4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.256+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa2c0095360 con 0x7fa2d0101060 2023-09-21T12:55:04.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.471+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fa2d0110fa0 con 0x7fa2d0101060 2023-09-21T12:55:04.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.471+0000 7fa2ccff9700 1 -- 172.21.15.142:0/1822467727 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fa2c0016090 con 0x7fa2d0101060 2023-09-21T12:55:04.471 INFO:teuthology.orchestra.run.smithi142.stdout:287762808863 2023-09-21T12:55:04.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 msgr2=0x7fa2b80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 0x7fa2b80a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa2d0198620 tx=0x7fa2c4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:04.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 msgr2=0x7fa2d0197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0197000 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d950 tx=0x7fa2c000dc60 comp rx=0 tx=0).stop 2023-09-21T12:55:04.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 shutdown_connections 2023-09-21T12:55:04.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2b80a06d0 0x7fa2b80a2b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa2d0106140 0x7fa2d019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2d0101060 0x7fa2d0197000 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 --2- 172.21.15.142:0/1822467727 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa2d0101a10 0x7fa2d0197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 >> 172.21.15.142:0/1822467727 conn(0x7fa2d00fc8d0 msgr2=0x7fa2d00fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 shutdown_connections 2023-09-21T12:55:04.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.474+0000 7fa2d60ad700 1 -- 172.21.15.142:0/1822467727 wait complete. 2023-09-21T12:55:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 -- 172.21.15.142:0/1081817259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba7410d650 msgr2=0x7fba7410fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/1081817259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba7410d650 0x7fba7410fac0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00b0a0 tx=0x7fba6c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 -- 172.21.15.142:0/1081817259 shutdown_connections 2023-09-21T12:55:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/1081817259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba7410d650 0x7fba7410fac0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/1081817259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba74073210 0x7fba740735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/1081817259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba7410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.558+0000 7fba7bc8b700 1 -- 172.21.15.142:0/1081817259 >> 172.21.15.142:0/1081817259 conn(0x7fba740fc900 msgr2=0x7fba740fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.559+0000 7fba7bc8b700 1 -- 172.21.15.142:0/1081817259 shutdown_connections 2023-09-21T12:55:04.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.559+0000 7fba7bc8b700 1 -- 172.21.15.142:0/1081817259 wait complete. 2023-09-21T12:55:04.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.560+0000 7fba7bc8b700 1 Processor -- start 2023-09-21T12:55:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.560+0000 7fba7bc8b700 1 -- start start 2023-09-21T12:55:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 0x7fba741991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba74199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 0x7fba7419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419e1a0 con 0x7fba74073210 2023-09-21T12:55:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419e310 con 0x7fba7410d650 2023-09-21T12:55:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7bc8b700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7419e4d0 con 0x7fba74073b30 2023-09-21T12:55:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba79226700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba74199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba79a27700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 0x7fba741991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba79226700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba74199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47258/0 (socket says 172.21.15.142:47258) 2023-09-21T12:55:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba79226700 1 -- 172.21.15.142:0/67929351 learned_addr learned my addr 172.21.15.142:0/67929351 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.561+0000 7fba7a228700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 0x7fba7419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 -- 172.21.15.142:0/67929351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 msgr2=0x7fba74199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba74199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 -- 172.21.15.142:0/67929351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 msgr2=0x7fba7419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 0x7fba7419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 -- 172.21.15.142:0/67929351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009d00 con 0x7fba74073210 2023-09-21T12:55:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba7a228700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 0x7fba7419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba79a27700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 0x7fba741991e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba7000e9f0 tx=0x7fba7000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7000c9c0 con 0x7fba74073210 2023-09-21T12:55:04.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fba70010430 con 0x7fba74073210 2023-09-21T12:55:04.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba70018680 con 0x7fba74073210 2023-09-21T12:55:04.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.562+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7419e7b0 con 0x7fba74073210 2023-09-21T12:55:04.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.563+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba741a6010 con 0x7fba74073210 2023-09-21T12:55:04.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.564+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba74107f70 con 0x7fba74073210 2023-09-21T12:55:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.566+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fba70010860 con 0x7fba74073210 2023-09-21T12:55:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.567+0000 7fba6affd700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 0x7fba600a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.567+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fba70014070 con 0x7fba74073210 2023-09-21T12:55:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.567+0000 7fba79226700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 0x7fba600a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.568+0000 7fba79226700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 0x7fba600a2c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba7419a800 tx=0x7fba64009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.571+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fba70051e10 con 0x7fba74073210 2023-09-21T12:55:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 -- 172.21.15.142:0/900166548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101060 msgr2=0x7f7424101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 --2- 172.21.15.142:0/900166548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101060 0x7f7424101440 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74140098f0 tx=0x7f7414009c00 comp rx=0 tx=0).stop 2023-09-21T12:55:04.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 -- 172.21.15.142:0/900166548 shutdown_connections 2023-09-21T12:55:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 --2- 172.21.15.142:0/900166548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742410dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 --2- 172.21.15.142:0/900166548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101060 0x7f7424101440 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 --2- 172.21.15.142:0/900166548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101a10 0x7f7424105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.644+0000 7f7429b06700 1 -- 172.21.15.142:0/900166548 >> 172.21.15.142:0/900166548 conn(0x7f74240fc8d0 msgr2=0x7f74240fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.645+0000 7f7429b06700 1 -- 172.21.15.142:0/900166548 shutdown_connections 2023-09-21T12:55:04.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.645+0000 7f7429b06700 1 -- 172.21.15.142:0/900166548 wait complete. 2023-09-21T12:55:04.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 Processor -- start 2023-09-21T12:55:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 -- start start 2023-09-21T12:55:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 0x7f7424199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 0x7f74241996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419e140 con 0x7f7424106140 2023-09-21T12:55:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419e2b0 con 0x7f7424101060 2023-09-21T12:55:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.646+0000 7f7429b06700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742419e470 con 0x7f7424101a10 2023-09-21T12:55:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7422ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 0x7f74241996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35964/0 (socket says 172.21.15.142:35964) 2023-09-21T12:55:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 -- 172.21.15.142:0/3285794934 learned_addr learned my addr 172.21.15.142:0/3285794934 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f74237fe700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 0x7f7424199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 -- 172.21.15.142:0/3285794934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 msgr2=0x7f74241996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 0x7f74241996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 -- 172.21.15.142:0/3285794934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 msgr2=0x7f7424199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 0x7f7424199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 -- 172.21.15.142:0/3285794934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009520 con 0x7f7424106140 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7422ffd700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 0x7f74241996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f74237fe700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 0x7f7424199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.647+0000 7f7423fff700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c110 tx=0x7f741c00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.648+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c017070 con 0x7f7424106140 2023-09-21T12:55:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.648+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f741c00e050 con 0x7f7424106140 2023-09-21T12:55:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.648+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c0078f0 con 0x7f7424106140 2023-09-21T12:55:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.648+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f742419e6f0 con 0x7f7424106140 2023-09-21T12:55:04.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.648+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74241a5fb0 con 0x7f7424106140 2023-09-21T12:55:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.649+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f742404eae0 con 0x7f7424106140 2023-09-21T12:55:04.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.651+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f741c007a50 con 0x7f7424106140 2023-09-21T12:55:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.652+0000 7f7420ff9700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 0x7f740c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.652+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f741c0cb6f0 con 0x7f7424106140 2023-09-21T12:55:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.652+0000 7f74237fe700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 0x7f740c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:04.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.653+0000 7f74237fe700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 0x7f740c0a2c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7414005e90 tx=0x7f7414019040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:04.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.661+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f741c095070 con 0x7f7424106140 2023-09-21T12:55:04.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.802+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fba7404eb30 con 0x7fba74073210 2023-09-21T12:55:04.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.803+0000 7fba6affd700 1 -- 172.21.15.142:0/67929351 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba70095780 con 0x7fba74073210 2023-09-21T12:55:04.803 INFO:teuthology.orchestra.run.smithi142.stdout:77309411392 2023-09-21T12:55:04.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.805+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 msgr2=0x7fba600a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.805+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 0x7fba600a2c10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fba7419a800 tx=0x7fba64009260 comp rx=0 tx=0).stop 2023-09-21T12:55:04.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.805+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 msgr2=0x7fba741991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.805+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 0x7fba741991e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba7000e9f0 tx=0x7fba7000ed00 comp rx=0 tx=0).stop 2023-09-21T12:55:04.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 shutdown_connections 2023-09-21T12:55:04.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fba600a0750 0x7fba600a2c10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba74073210 0x7fba741991e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba7410d650 0x7fba7419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 --2- 172.21.15.142:0/67929351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba74073b30 0x7fba74199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 >> 172.21.15.142:0/67929351 conn(0x7fba740fc900 msgr2=0x7fba741050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 shutdown_connections 2023-09-21T12:55:04.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.806+0000 7fba7bc8b700 1 -- 172.21.15.142:0/67929351 wait complete. 2023-09-21T12:55:04.827 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1822467727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-21T12:55:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.869+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f7424110e60 con 0x7f7424106140 2023-09-21T12:55:04.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.870+0000 7f7420ff9700 1 -- 172.21.15.142:0/3285794934 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f741c098690 con 0x7f7424106140 2023-09-21T12:55:04.869 INFO:teuthology.orchestra.run.smithi142.stdout:309237645338 2023-09-21T12:55:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 msgr2=0x7f740c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 0x7f740c0a2c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7414005e90 tx=0x7f7414019040 comp rx=0 tx=0).stop 2023-09-21T12:55:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 msgr2=0x7f742419db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:04.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c110 tx=0x7f741c00c420 comp rx=0 tx=0).stop 2023-09-21T12:55:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 shutdown_connections 2023-09-21T12:55:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f740c0a0750 0x7f740c0a2c10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7424106140 0x7f742419db30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7424101060 0x7f7424199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 --2- 172.21.15.142:0/3285794934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7424101a10 0x7f74241996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 >> 172.21.15.142:0/3285794934 conn(0x7f74240fc8d0 msgr2=0x7f74240fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 shutdown_connections 2023-09-21T12:55:04.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:04.872+0000 7f7429b06700 1 -- 172.21.15.142:0/3285794934 wait complete. 2023-09-21T12:55:04.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:04 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1822467727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-21T12:55:04.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:04 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1822467727' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-21T12:55:05.254 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808860 got 287762808863 for osd.9 2023-09-21T12:55:05.255 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:05.580 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645334 got 309237645338 for osd.10 2023-09-21T12:55:05.581 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:05.874 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:05 smithi142 ceph-mon[97663]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:05.875 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/67929351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-21T12:55:05.875 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3285794934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-21T12:55:05.877 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411390 got 77309411392 for osd.2 2023-09-21T12:55:05.878 DEBUG:teuthology.parallel:result is None 2023-09-21T12:55:05.878 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-09-21T12:55:05.879 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph pg dump --format=json 2023-09-21T12:55:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:05 smithi156 ceph-mon[134078]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/67929351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-21T12:55:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3285794934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-21T12:55:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:05 smithi160 ceph-mon[134450]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:05 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/67929351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-21T12:55:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:05 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3285794934' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-21T12:55:06.605 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:07 smithi156 ceph-mon[134078]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:07 smithi142 ceph-mon[97663]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:07 smithi160 ceph-mon[134450]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:08.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.311+0000 7f7de0a8a700 1 -- 172.21.15.142:0/845312268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101060 msgr2=0x7f7ddc101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:08.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.311+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/845312268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101060 0x7f7ddc101440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009990 tx=0x7f7dcc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 -- 172.21.15.142:0/845312268 shutdown_connections 2023-09-21T12:55:08.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/845312268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101060 0x7f7ddc101440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/845312268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc106140 0x7f7ddc10dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/845312268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc101a10 0x7f7ddc105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 -- 172.21.15.142:0/845312268 >> 172.21.15.142:0/845312268 conn(0x7f7ddc0fc8d0 msgr2=0x7f7ddc0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:08.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 -- 172.21.15.142:0/845312268 shutdown_connections 2023-09-21T12:55:08.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.312+0000 7f7de0a8a700 1 -- 172.21.15.142:0/845312268 wait complete. 2023-09-21T12:55:08.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 Processor -- start 2023-09-21T12:55:08.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 -- start start 2023-09-21T12:55:08.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc101060 0x7f7ddc199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc106140 0x7f7ddc19db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc19e110 con 0x7f7ddc101a10 2023-09-21T12:55:08.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc19e280 con 0x7f7ddc101060 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7de0a8a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ddc19e440 con 0x7f7ddc106140 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.313+0000 7f7dd9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35996/0 (socket says 172.21.15.142:35996) 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 -- 172.21.15.142:0/2804389734 learned_addr learned my addr 172.21.15.142:0/2804389734 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dda59c700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc101060 0x7f7ddc199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:08.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7ddad9d700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc106140 0x7f7ddc19db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:08.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 -- 172.21.15.142:0/2804389734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc106140 msgr2=0x7f7ddc19db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:08.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc106140 0x7f7ddc19db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 -- 172.21.15.142:0/2804389734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc101060 msgr2=0x7f7ddc199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:08.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc101060 0x7f7ddc199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 -- 172.21.15.142:0/2804389734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dcc0095f0 con 0x7f7ddc101a10 2023-09-21T12:55:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dd9d9b700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d950 tx=0x7f7dd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004220 con 0x7f7ddc101a10 2023-09-21T12:55:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7dd0007620 con 0x7f7ddc101a10 2023-09-21T12:55:08.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc19e720 con 0x7f7ddc101a10 2023-09-21T12:55:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.314+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd00056c0 con 0x7f7ddc101a10 2023-09-21T12:55:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.315+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ddc1a5f80 con 0x7f7ddc101a10 2023-09-21T12:55:08.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.316+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ddc04eae0 con 0x7f7ddc101a10 2023-09-21T12:55:08.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.317+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f7dd0004380 con 0x7f7ddc101a10 2023-09-21T12:55:08.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.319+0000 7f7dcb7fe700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 0x7f7dc40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:08.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.320+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7dd00cbab0 con 0x7f7ddc101a10 2023-09-21T12:55:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.320+0000 7f7dda59c700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 0x7f7dc40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:08.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.320+0000 7f7dda59c700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 0x7f7dc40a2b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b5c0 tx=0x7f7dcc005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:08.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.324+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7dd0095430 con 0x7f7ddc101a10 2023-09-21T12:55:08.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.529+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ddc110f10 con 0x7f7dc40a06d0 2023-09-21T12:55:08.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.540+0000 7f7dcb7fe700 1 -- 172.21.15.142:0/2804389734 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340706 (secure 0 0 0) 0x7f7ddc110f10 con 0x7f7dc40a06d0 2023-09-21T12:55:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:08.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 msgr2=0x7f7dc40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:08.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 0x7f7dc40a2b90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc00b5c0 tx=0x7f7dcc005fd0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 msgr2=0x7f7ddc199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:08.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d950 tx=0x7f7dd000dc60 comp rx=0 tx=0).stop 2023-09-21T12:55:08.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 shutdown_connections 2023-09-21T12:55:08.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7dc40a06d0 0x7f7dc40a2b90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ddc106140 0x7f7ddc19db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7ddc101060 0x7f7ddc199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 --2- 172.21.15.142:0/2804389734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7ddc101a10 0x7f7ddc199690 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:08.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 >> 172.21.15.142:0/2804389734 conn(0x7f7ddc0fc8d0 msgr2=0x7f7ddc0fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:08.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 shutdown_connections 2023-09-21T12:55:08.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:08.545+0000 7f7de0a8a700 1 -- 172.21.15.142:0/2804389734 wait complete. 2023-09-21T12:55:08.550 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:55:09.082 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":300,"stamp":"2023-09-21T12:55:08.380736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651998,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":455,"num_read_kb":340,"num_write":332,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180893,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335612,"kb_used_data":11344,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606212,"statfs":{"total":1151940427776,"available":1151596761088,"internally_reserved":0,"allocated":11616256,"data_stored":7308949,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":30,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003527"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558543+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:54:40.558543+0000","last_peered":"2023-09-21T12:54:40.558543+0000","last_clean":"2023-09-21T12:54:40.558543+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:54:40.558543+0000","last_undegraded":"2023-09-21T12:54:40.558543+0000","last_fullsized":"2023-09-21T12:54:40.558543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559889+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:54:40.559889+0000","last_peered":"2023-09-21T12:54:40.559889+0000","last_clean":"2023-09-21T12:54:40.559889+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:54:40.559889+0000","last_undegraded":"2023-09-21T12:54:40.559889+0000","last_fullsized":"2023-09-21T12:54:40.559889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559813+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:54:40.559813+0000","last_peered":"2023-09-21T12:54:40.559813+0000","last_clean":"2023-09-21T12:54:40.559813+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:54:40.559813+0000","last_undegraded":"2023-09-21T12:54:40.559813+0000","last_fullsized":"2023-09-21T12:54:40.559813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560397+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:54:40.560397+0000","last_peered":"2023-09-21T12:54:40.560397+0000","last_clean":"2023-09-21T12:54:40.560397+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:54:40.560397+0000","last_undegraded":"2023-09-21T12:54:40.560397+0000","last_fullsized":"2023-09-21T12:54:40.560397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557793+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:54:40.557793+0000","last_peered":"2023-09-21T12:54:40.557793+0000","last_clean":"2023-09-21T12:54:40.557793+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:54:40.557793+0000","last_undegraded":"2023-09-21T12:54:40.557793+0000","last_fullsized":"2023-09-21T12:54:40.557793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.568064+0000","last_change":"2023-09-21T12:54:41.568064+0000","last_active":"2023-09-21T12:54:41.568064+0000","last_peered":"2023-09-21T12:54:41.568064+0000","last_clean":"2023-09-21T12:54:41.568064+0000","last_became_active":"2023-09-21T12:54:41.567634+0000","last_became_peered":"2023-09-21T12:54:41.567634+0000","last_unstale":"2023-09-21T12:54:41.568064+0000","last_undegraded":"2023-09-21T12:54:41.568064+0000","last_fullsized":"2023-09-21T12:54:41.568064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:25:07.646626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560221+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:54:40.560221+0000","last_peered":"2023-09-21T12:54:40.560221+0000","last_clean":"2023-09-21T12:54:40.560221+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:54:40.560221+0000","last_undegraded":"2023-09-21T12:54:40.560221+0000","last_fullsized":"2023-09-21T12:54:40.560221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562970+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:54:40.562970+0000","last_peered":"2023-09-21T12:54:40.562970+0000","last_clean":"2023-09-21T12:54:40.562970+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:54:40.562970+0000","last_undegraded":"2023-09-21T12:54:40.562970+0000","last_fullsized":"2023-09-21T12:54:40.562970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555944+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:54:40.555944+0000","last_peered":"2023-09-21T12:54:40.555944+0000","last_clean":"2023-09-21T12:54:40.555944+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:54:40.555944+0000","last_undegraded":"2023-09-21T12:54:40.555944+0000","last_fullsized":"2023-09-21T12:54:40.555944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558079+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:54:40.558079+0000","last_peered":"2023-09-21T12:54:40.558079+0000","last_clean":"2023-09-21T12:54:40.558079+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:54:40.558079+0000","last_undegraded":"2023-09-21T12:54:40.558079+0000","last_fullsized":"2023-09-21T12:54:40.558079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561148+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:54:40.561148+0000","last_peered":"2023-09-21T12:54:40.561148+0000","last_clean":"2023-09-21T12:54:40.561148+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:54:40.561148+0000","last_undegraded":"2023-09-21T12:54:40.561148+0000","last_fullsized":"2023-09-21T12:54:40.561148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560223+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:54:40.560223+0000","last_peered":"2023-09-21T12:54:40.560223+0000","last_clean":"2023-09-21T12:54:40.560223+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:54:40.560223+0000","last_undegraded":"2023-09-21T12:54:40.560223+0000","last_fullsized":"2023-09-21T12:54:40.560223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561256+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:54:40.561256+0000","last_peered":"2023-09-21T12:54:40.561256+0000","last_clean":"2023-09-21T12:54:40.561256+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:54:40.561256+0000","last_undegraded":"2023-09-21T12:54:40.561256+0000","last_fullsized":"2023-09-21T12:54:40.561256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560061+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:54:40.560061+0000","last_peered":"2023-09-21T12:54:40.560061+0000","last_clean":"2023-09-21T12:54:40.560061+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:54:40.560061+0000","last_undegraded":"2023-09-21T12:54:40.560061+0000","last_fullsized":"2023-09-21T12:54:40.560061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559862+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:54:40.559862+0000","last_peered":"2023-09-21T12:54:40.559862+0000","last_clean":"2023-09-21T12:54:40.559862+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:54:40.559862+0000","last_undegraded":"2023-09-21T12:54:40.559862+0000","last_fullsized":"2023-09-21T12:54:40.559862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555428+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:54:40.555428+0000","last_peered":"2023-09-21T12:54:40.555428+0000","last_clean":"2023-09-21T12:54:40.555428+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:54:40.555428+0000","last_undegraded":"2023-09-21T12:54:40.555428+0000","last_fullsized":"2023-09-21T12:54:40.555428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560292+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:54:40.560292+0000","last_peered":"2023-09-21T12:54:40.560292+0000","last_clean":"2023-09-21T12:54:40.560292+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:54:40.560292+0000","last_undegraded":"2023-09-21T12:54:40.560292+0000","last_fullsized":"2023-09-21T12:54:40.560292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555143+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:54:40.555143+0000","last_peered":"2023-09-21T12:54:40.555143+0000","last_clean":"2023-09-21T12:54:40.555143+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:54:40.555143+0000","last_undegraded":"2023-09-21T12:54:40.555143+0000","last_fullsized":"2023-09-21T12:54:40.555143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561459+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:54:40.561459+0000","last_peered":"2023-09-21T12:54:40.561459+0000","last_clean":"2023-09-21T12:54:40.561459+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:54:40.561459+0000","last_undegraded":"2023-09-21T12:54:40.561459+0000","last_fullsized":"2023-09-21T12:54:40.561459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555018+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:40.555018+0000","last_peered":"2023-09-21T12:54:40.555018+0000","last_clean":"2023-09-21T12:54:40.555018+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:40.555018+0000","last_undegraded":"2023-09-21T12:54:40.555018+0000","last_fullsized":"2023-09-21T12:54:40.555018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563413+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:54:40.563413+0000","last_peered":"2023-09-21T12:54:40.563413+0000","last_clean":"2023-09-21T12:54:40.563413+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:54:40.563413+0000","last_undegraded":"2023-09-21T12:54:40.563413+0000","last_fullsized":"2023-09-21T12:54:40.563413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563487+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:40.563487+0000","last_peered":"2023-09-21T12:54:40.563487+0000","last_clean":"2023-09-21T12:54:40.563487+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:40.563487+0000","last_undegraded":"2023-09-21T12:54:40.563487+0000","last_fullsized":"2023-09-21T12:54:40.563487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560420+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:54:40.560420+0000","last_peered":"2023-09-21T12:54:40.560420+0000","last_clean":"2023-09-21T12:54:40.560420+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:54:40.560420+0000","last_undegraded":"2023-09-21T12:54:40.560420+0000","last_fullsized":"2023-09-21T12:54:40.560420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559289+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:40.559289+0000","last_peered":"2023-09-21T12:54:40.559289+0000","last_clean":"2023-09-21T12:54:40.559289+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:40.559289+0000","last_undegraded":"2023-09-21T12:54:40.559289+0000","last_fullsized":"2023-09-21T12:54:40.559289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556068+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:54:40.556068+0000","last_peered":"2023-09-21T12:54:40.556068+0000","last_clean":"2023-09-21T12:54:40.556068+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:54:40.556068+0000","last_undegraded":"2023-09-21T12:54:40.556068+0000","last_fullsized":"2023-09-21T12:54:40.556068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574116+0000","last_change":"2023-09-21T12:54:41.573641+0000","last_active":"2023-09-21T12:54:41.574116+0000","last_peered":"2023-09-21T12:54:41.574116+0000","last_clean":"2023-09-21T12:54:41.574116+0000","last_became_active":"2023-09-21T12:54:41.570382+0000","last_became_peered":"2023-09-21T12:54:41.570382+0000","last_unstale":"2023-09-21T12:54:41.574116+0000","last_undegraded":"2023-09-21T12:54:41.574116+0000","last_fullsized":"2023-09-21T12:54:41.574116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:47:35.642160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556355+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:54:40.556355+0000","last_peered":"2023-09-21T12:54:40.556355+0000","last_clean":"2023-09-21T12:54:40.556355+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:54:40.556355+0000","last_undegraded":"2023-09-21T12:54:40.556355+0000","last_fullsized":"2023-09-21T12:54:40.556355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:05.508586+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:55:05.508586+0000","last_peered":"2023-09-21T12:55:05.508586+0000","last_clean":"2023-09-21T12:55:05.508586+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:55:05.508586+0000","last_undegraded":"2023-09-21T12:55:05.508586+0000","last_fullsized":"2023-09-21T12:55:05.508586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.717011+0000","last_change":"2023-09-21T12:54:41.717011+0000","last_active":"2023-09-21T12:54:41.717011+0000","last_peered":"2023-09-21T12:54:41.717011+0000","last_clean":"2023-09-21T12:54:41.717011+0000","last_became_active":"2023-09-21T12:54:41.716663+0000","last_became_peered":"2023-09-21T12:54:41.716663+0000","last_unstale":"2023-09-21T12:54:41.717011+0000","last_undegraded":"2023-09-21T12:54:41.717011+0000","last_fullsized":"2023-09-21T12:54:41.717011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:24:43.714781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557437+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:40.557437+0000","last_peered":"2023-09-21T12:54:40.557437+0000","last_clean":"2023-09-21T12:54:40.557437+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:40.557437+0000","last_undegraded":"2023-09-21T12:54:40.557437+0000","last_fullsized":"2023-09-21T12:54:40.557437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556772+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:54:40.556772+0000","last_peered":"2023-09-21T12:54:40.556772+0000","last_clean":"2023-09-21T12:54:40.556772+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:54:40.556772+0000","last_undegraded":"2023-09-21T12:54:40.556772+0000","last_fullsized":"2023-09-21T12:54:40.556772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561561+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:40.561561+0000","last_peered":"2023-09-21T12:54:40.561561+0000","last_clean":"2023-09-21T12:54:40.561561+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:40.561561+0000","last_undegraded":"2023-09-21T12:54:40.561561+0000","last_fullsized":"2023-09-21T12:54:40.561561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562872+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:54:40.562872+0000","last_peered":"2023-09-21T12:54:40.562872+0000","last_clean":"2023-09-21T12:54:40.562872+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:54:40.562872+0000","last_undegraded":"2023-09-21T12:54:40.562872+0000","last_fullsized":"2023-09-21T12:54:40.562872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555803+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:40.555803+0000","last_peered":"2023-09-21T12:54:40.555803+0000","last_clean":"2023-09-21T12:54:40.555803+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:40.555803+0000","last_undegraded":"2023-09-21T12:54:40.555803+0000","last_fullsized":"2023-09-21T12:54:40.555803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.554966+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:54:40.554966+0000","last_peered":"2023-09-21T12:54:40.554966+0000","last_clean":"2023-09-21T12:54:40.554966+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:54:40.554966+0000","last_undegraded":"2023-09-21T12:54:40.554966+0000","last_fullsized":"2023-09-21T12:54:40.554966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:02.502551+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:55:02.502551+0000","last_peered":"2023-09-21T12:55:02.502551+0000","last_clean":"2023-09-21T12:55:02.502551+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:55:02.502551+0000","last_undegraded":"2023-09-21T12:55:02.502551+0000","last_fullsized":"2023-09-21T12:55:02.502551+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":48,"num_read_kb":48,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555878+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:54:40.555878+0000","last_peered":"2023-09-21T12:54:40.555878+0000","last_clean":"2023-09-21T12:54:40.555878+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:54:40.555878+0000","last_undegraded":"2023-09-21T12:54:40.555878+0000","last_fullsized":"2023-09-21T12:54:40.555878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561279+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:40.561279+0000","last_peered":"2023-09-21T12:54:40.561279+0000","last_clean":"2023-09-21T12:54:40.561279+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:40.561279+0000","last_undegraded":"2023-09-21T12:54:40.561279+0000","last_fullsized":"2023-09-21T12:54:40.561279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560340+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:54:40.560340+0000","last_peered":"2023-09-21T12:54:40.560340+0000","last_clean":"2023-09-21T12:54:40.560340+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:54:40.560340+0000","last_undegraded":"2023-09-21T12:54:40.560340+0000","last_fullsized":"2023-09-21T12:54:40.560340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557100+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:40.557100+0000","last_peered":"2023-09-21T12:54:40.557100+0000","last_clean":"2023-09-21T12:54:40.557100+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:40.557100+0000","last_undegraded":"2023-09-21T12:54:40.557100+0000","last_fullsized":"2023-09-21T12:54:40.557100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556312+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:54:40.556312+0000","last_peered":"2023-09-21T12:54:40.556312+0000","last_clean":"2023-09-21T12:54:40.556312+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:54:40.556312+0000","last_undegraded":"2023-09-21T12:54:40.556312+0000","last_fullsized":"2023-09-21T12:54:40.556312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'26","reported_seq":144,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:03.513392+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:55:03.513392+0000","last_peered":"2023-09-21T12:55:03.513392+0000","last_clean":"2023-09-21T12:55:03.513392+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:55:03.513392+0000","last_undegraded":"2023-09-21T12:55:03.513392+0000","last_fullsized":"2023-09-21T12:55:03.513392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56994,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":103,"num_read_kb":106,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559026+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:54:40.559026+0000","last_peered":"2023-09-21T12:54:40.559026+0000","last_clean":"2023-09-21T12:54:40.559026+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:54:40.559026+0000","last_undegraded":"2023-09-21T12:54:40.559026+0000","last_fullsized":"2023-09-21T12:54:40.559026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.581333+0000","last_change":"2023-09-21T12:54:41.580944+0000","last_active":"2023-09-21T12:54:41.581333+0000","last_peered":"2023-09-21T12:54:41.581333+0000","last_clean":"2023-09-21T12:54:41.581333+0000","last_became_active":"2023-09-21T12:54:41.571007+0000","last_became_peered":"2023-09-21T12:54:41.571007+0000","last_unstale":"2023-09-21T12:54:41.581333+0000","last_undegraded":"2023-09-21T12:54:41.581333+0000","last_fullsized":"2023-09-21T12:54:41.581333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:54:34.209661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561170+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:54:40.561170+0000","last_peered":"2023-09-21T12:54:40.561170+0000","last_clean":"2023-09-21T12:54:40.561170+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:54:40.561170+0000","last_undegraded":"2023-09-21T12:54:40.561170+0000","last_fullsized":"2023-09-21T12:54:40.561170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556559+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:40.556559+0000","last_peered":"2023-09-21T12:54:40.556559+0000","last_clean":"2023-09-21T12:54:40.556559+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:40.556559+0000","last_undegraded":"2023-09-21T12:54:40.556559+0000","last_fullsized":"2023-09-21T12:54:40.556559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560674+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:54:40.560674+0000","last_peered":"2023-09-21T12:54:40.560674+0000","last_clean":"2023-09-21T12:54:40.560674+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:54:40.560674+0000","last_undegraded":"2023-09-21T12:54:40.560674+0000","last_fullsized":"2023-09-21T12:54:40.560674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":72,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:05.530894+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:55:05.530894+0000","last_peered":"2023-09-21T12:55:05.530894+0000","last_clean":"2023-09-21T12:55:05.530894+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:55:05.530894+0000","last_undegraded":"2023-09-21T12:55:05.530894+0000","last_fullsized":"2023-09-21T12:55:05.530894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559737+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:54:40.559737+0000","last_peered":"2023-09-21T12:54:40.559737+0000","last_clean":"2023-09-21T12:54:40.559737+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:54:40.559737+0000","last_undegraded":"2023-09-21T12:54:40.559737+0000","last_fullsized":"2023-09-21T12:54:40.559737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557457+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:40.557457+0000","last_peered":"2023-09-21T12:54:40.557457+0000","last_clean":"2023-09-21T12:54:40.557457+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:40.557457+0000","last_undegraded":"2023-09-21T12:54:40.557457+0000","last_fullsized":"2023-09-21T12:54:40.557457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.570475+0000","last_change":"2023-09-21T12:54:41.570475+0000","last_active":"2023-09-21T12:54:41.570475+0000","last_peered":"2023-09-21T12:54:41.570475+0000","last_clean":"2023-09-21T12:54:41.570475+0000","last_became_active":"2023-09-21T12:54:41.570069+0000","last_became_peered":"2023-09-21T12:54:41.570069+0000","last_unstale":"2023-09-21T12:54:41.570475+0000","last_undegraded":"2023-09-21T12:54:41.570475+0000","last_fullsized":"2023-09-21T12:54:41.570475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:07:47.022244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559676+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:40.559676+0000","last_peered":"2023-09-21T12:54:40.559676+0000","last_clean":"2023-09-21T12:54:40.559676+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:40.559676+0000","last_undegraded":"2023-09-21T12:54:40.559676+0000","last_fullsized":"2023-09-21T12:54:40.559676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558585+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:54:40.558585+0000","last_peered":"2023-09-21T12:54:40.558585+0000","last_clean":"2023-09-21T12:54:40.558585+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:54:40.558585+0000","last_undegraded":"2023-09-21T12:54:40.558585+0000","last_fullsized":"2023-09-21T12:54:40.558585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555077+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:40.555077+0000","last_peered":"2023-09-21T12:54:40.555077+0000","last_clean":"2023-09-21T12:54:40.555077+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:40.555077+0000","last_undegraded":"2023-09-21T12:54:40.555077+0000","last_fullsized":"2023-09-21T12:54:40.555077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557823+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:54:40.557823+0000","last_peered":"2023-09-21T12:54:40.557823+0000","last_clean":"2023-09-21T12:54:40.557823+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:54:40.557823+0000","last_undegraded":"2023-09-21T12:54:40.557823+0000","last_fullsized":"2023-09-21T12:54:40.557823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561037+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:40.561037+0000","last_peered":"2023-09-21T12:54:40.561037+0000","last_clean":"2023-09-21T12:54:40.561037+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:40.561037+0000","last_undegraded":"2023-09-21T12:54:40.561037+0000","last_fullsized":"2023-09-21T12:54:40.561037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.862117+0000","last_change":"2023-09-21T12:54:41.862117+0000","last_active":"2023-09-21T12:54:41.862117+0000","last_peered":"2023-09-21T12:54:41.862117+0000","last_clean":"2023-09-21T12:54:41.862117+0000","last_became_active":"2023-09-21T12:54:41.861717+0000","last_became_peered":"2023-09-21T12:54:41.861717+0000","last_unstale":"2023-09-21T12:54:41.862117+0000","last_undegraded":"2023-09-21T12:54:41.862117+0000","last_fullsized":"2023-09-21T12:54:41.862117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:25:46.138394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555920+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:54:40.555920+0000","last_peered":"2023-09-21T12:54:40.555920+0000","last_clean":"2023-09-21T12:54:40.555920+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:54:40.555920+0000","last_undegraded":"2023-09-21T12:54:40.555920+0000","last_fullsized":"2023-09-21T12:54:40.555920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":66,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:02.524294+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:55:02.524294+0000","last_peered":"2023-09-21T12:55:02.524294+0000","last_clean":"2023-09-21T12:55:02.524294+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:55:02.524294+0000","last_undegraded":"2023-09-21T12:55:02.524294+0000","last_fullsized":"2023-09-21T12:55:02.524294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563521+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:54:40.563521+0000","last_peered":"2023-09-21T12:54:40.563521+0000","last_clean":"2023-09-21T12:54:40.563521+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:54:40.563521+0000","last_undegraded":"2023-09-21T12:54:40.563521+0000","last_fullsized":"2023-09-21T12:54:40.563521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560769+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:40.560769+0000","last_peered":"2023-09-21T12:54:40.560769+0000","last_clean":"2023-09-21T12:54:40.560769+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:40.560769+0000","last_undegraded":"2023-09-21T12:54:40.560769+0000","last_fullsized":"2023-09-21T12:54:40.560769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559925+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:40.559925+0000","last_peered":"2023-09-21T12:54:40.559925+0000","last_clean":"2023-09-21T12:54:40.559925+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:40.559925+0000","last_undegraded":"2023-09-21T12:54:40.559925+0000","last_fullsized":"2023-09-21T12:54:40.559925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561378+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:54:40.561378+0000","last_peered":"2023-09-21T12:54:40.561378+0000","last_clean":"2023-09-21T12:54:40.561378+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:54:40.561378+0000","last_undegraded":"2023-09-21T12:54:40.561378+0000","last_fullsized":"2023-09-21T12:54:40.561378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560099+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:40.560099+0000","last_peered":"2023-09-21T12:54:40.560099+0000","last_clean":"2023-09-21T12:54:40.560099+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:40.560099+0000","last_undegraded":"2023-09-21T12:54:40.560099+0000","last_fullsized":"2023-09-21T12:54:40.560099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559181+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:40.559181+0000","last_peered":"2023-09-21T12:54:40.559181+0000","last_clean":"2023-09-21T12:54:40.559181+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:40.559181+0000","last_undegraded":"2023-09-21T12:54:40.559181+0000","last_fullsized":"2023-09-21T12:54:40.559181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561408+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:54:40.561408+0000","last_peered":"2023-09-21T12:54:40.561408+0000","last_clean":"2023-09-21T12:54:40.561408+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:54:40.561408+0000","last_undegraded":"2023-09-21T12:54:40.561408+0000","last_fullsized":"2023-09-21T12:54:40.561408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555092+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:40.555092+0000","last_peered":"2023-09-21T12:54:40.555092+0000","last_clean":"2023-09-21T12:54:40.555092+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:40.555092+0000","last_undegraded":"2023-09-21T12:54:40.555092+0000","last_fullsized":"2023-09-21T12:54:40.555092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563425+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:54:40.563425+0000","last_peered":"2023-09-21T12:54:40.563425+0000","last_clean":"2023-09-21T12:54:40.563425+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:54:40.563425+0000","last_undegraded":"2023-09-21T12:54:40.563425+0000","last_fullsized":"2023-09-21T12:54:40.563425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561295+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:40.561295+0000","last_peered":"2023-09-21T12:54:40.561295+0000","last_clean":"2023-09-21T12:54:40.561295+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:40.561295+0000","last_undegraded":"2023-09-21T12:54:40.561295+0000","last_fullsized":"2023-09-21T12:54:40.561295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559981+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:54:40.559981+0000","last_peered":"2023-09-21T12:54:40.559981+0000","last_clean":"2023-09-21T12:54:40.559981+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:54:40.559981+0000","last_undegraded":"2023-09-21T12:54:40.559981+0000","last_fullsized":"2023-09-21T12:54:40.559981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555440+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:40.555440+0000","last_peered":"2023-09-21T12:54:40.555440+0000","last_clean":"2023-09-21T12:54:40.555440+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:40.555440+0000","last_undegraded":"2023-09-21T12:54:40.555440+0000","last_fullsized":"2023-09-21T12:54:40.555440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557328+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:54:40.557328+0000","last_peered":"2023-09-21T12:54:40.557328+0000","last_clean":"2023-09-21T12:54:40.557328+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:54:40.557328+0000","last_undegraded":"2023-09-21T12:54:40.557328+0000","last_fullsized":"2023-09-21T12:54:40.557328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563079+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:40.563079+0000","last_peered":"2023-09-21T12:54:40.563079+0000","last_clean":"2023-09-21T12:54:40.563079+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:40.563079+0000","last_undegraded":"2023-09-21T12:54:40.563079+0000","last_fullsized":"2023-09-21T12:54:40.563079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558128+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:54:40.558128+0000","last_peered":"2023-09-21T12:54:40.558128+0000","last_clean":"2023-09-21T12:54:40.558128+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:54:40.558128+0000","last_undegraded":"2023-09-21T12:54:40.558128+0000","last_fullsized":"2023-09-21T12:54:40.558128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561350+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:40.561350+0000","last_peered":"2023-09-21T12:54:40.561350+0000","last_clean":"2023-09-21T12:54:40.561350+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:40.561350+0000","last_undegraded":"2023-09-21T12:54:40.561350+0000","last_fullsized":"2023-09-21T12:54:40.561350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563218+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:54:40.563218+0000","last_peered":"2023-09-21T12:54:40.563218+0000","last_clean":"2023-09-21T12:54:40.563218+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:54:40.563218+0000","last_undegraded":"2023-09-21T12:54:40.563218+0000","last_fullsized":"2023-09-21T12:54:40.563218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557905+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:40.557905+0000","last_peered":"2023-09-21T12:54:40.557905+0000","last_clean":"2023-09-21T12:54:40.557905+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:40.557905+0000","last_undegraded":"2023-09-21T12:54:40.557905+0000","last_fullsized":"2023-09-21T12:54:40.557905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561154+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:54:40.561154+0000","last_peered":"2023-09-21T12:54:40.561154+0000","last_clean":"2023-09-21T12:54:40.561154+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:54:40.561154+0000","last_undegraded":"2023-09-21T12:54:40.561154+0000","last_fullsized":"2023-09-21T12:54:40.561154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561605+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:40.561605+0000","last_peered":"2023-09-21T12:54:40.561605+0000","last_clean":"2023-09-21T12:54:40.561605+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:40.561605+0000","last_undegraded":"2023-09-21T12:54:40.561605+0000","last_fullsized":"2023-09-21T12:54:40.561605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561214+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:54:40.561214+0000","last_peered":"2023-09-21T12:54:40.561214+0000","last_clean":"2023-09-21T12:54:40.561214+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:54:40.561214+0000","last_undegraded":"2023-09-21T12:54:40.561214+0000","last_fullsized":"2023-09-21T12:54:40.561214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556244+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:40.556244+0000","last_peered":"2023-09-21T12:54:40.556244+0000","last_clean":"2023-09-21T12:54:40.556244+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:40.556244+0000","last_undegraded":"2023-09-21T12:54:40.556244+0000","last_fullsized":"2023-09-21T12:54:40.556244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574550+0000","last_change":"2023-09-21T12:54:41.574550+0000","last_active":"2023-09-21T12:54:41.574550+0000","last_peered":"2023-09-21T12:54:41.574550+0000","last_clean":"2023-09-21T12:54:41.574550+0000","last_became_active":"2023-09-21T12:54:41.568847+0000","last_became_peered":"2023-09-21T12:54:41.568847+0000","last_unstale":"2023-09-21T12:54:41.574550+0000","last_undegraded":"2023-09-21T12:54:41.574550+0000","last_fullsized":"2023-09-21T12:54:41.574550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:40:47.869112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561711+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:40.561711+0000","last_peered":"2023-09-21T12:54:40.561711+0000","last_clean":"2023-09-21T12:54:40.561711+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:40.561711+0000","last_undegraded":"2023-09-21T12:54:40.561711+0000","last_fullsized":"2023-09-21T12:54:40.561711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561514+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:54:40.561514+0000","last_peered":"2023-09-21T12:54:40.561514+0000","last_clean":"2023-09-21T12:54:40.561514+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:54:40.561514+0000","last_undegraded":"2023-09-21T12:54:40.561514+0000","last_fullsized":"2023-09-21T12:54:40.561514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558218+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:54:40.558218+0000","last_peered":"2023-09-21T12:54:40.558218+0000","last_clean":"2023-09-21T12:54:40.558218+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:54:40.558218+0000","last_undegraded":"2023-09-21T12:54:40.558218+0000","last_fullsized":"2023-09-21T12:54:40.558218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562453+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:54:40.562453+0000","last_peered":"2023-09-21T12:54:40.562453+0000","last_clean":"2023-09-21T12:54:40.562453+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:54:40.562453+0000","last_undegraded":"2023-09-21T12:54:40.562453+0000","last_fullsized":"2023-09-21T12:54:40.562453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561230+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:54:40.561230+0000","last_peered":"2023-09-21T12:54:40.561230+0000","last_clean":"2023-09-21T12:54:40.561230+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:54:40.561230+0000","last_undegraded":"2023-09-21T12:54:40.561230+0000","last_fullsized":"2023-09-21T12:54:40.561230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560338+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:54:40.560338+0000","last_peered":"2023-09-21T12:54:40.560338+0000","last_clean":"2023-09-21T12:54:40.560338+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:54:40.560338+0000","last_undegraded":"2023-09-21T12:54:40.560338+0000","last_fullsized":"2023-09-21T12:54:40.560338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561482+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:54:40.561482+0000","last_peered":"2023-09-21T12:54:40.561482+0000","last_clean":"2023-09-21T12:54:40.561482+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:54:40.561482+0000","last_undegraded":"2023-09-21T12:54:40.561482+0000","last_fullsized":"2023-09-21T12:54:40.561482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558405+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:54:40.558405+0000","last_peered":"2023-09-21T12:54:40.558405+0000","last_clean":"2023-09-21T12:54:40.558405+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:54:40.558405+0000","last_undegraded":"2023-09-21T12:54:40.558405+0000","last_fullsized":"2023-09-21T12:54:40.558405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561527+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:54:40.561527+0000","last_peered":"2023-09-21T12:54:40.561527+0000","last_clean":"2023-09-21T12:54:40.561527+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:54:40.561527+0000","last_undegraded":"2023-09-21T12:54:40.561527+0000","last_fullsized":"2023-09-21T12:54:40.561527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563346+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:54:40.563346+0000","last_peered":"2023-09-21T12:54:40.563346+0000","last_clean":"2023-09-21T12:54:40.563346+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:54:40.563346+0000","last_undegraded":"2023-09-21T12:54:40.563346+0000","last_fullsized":"2023-09-21T12:54:40.563346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555853+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:54:40.555853+0000","last_peered":"2023-09-21T12:54:40.555853+0000","last_clean":"2023-09-21T12:54:40.555853+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:54:40.555853+0000","last_undegraded":"2023-09-21T12:54:40.555853+0000","last_fullsized":"2023-09-21T12:54:40.555853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.568252+0000","last_change":"2023-09-21T12:54:41.568252+0000","last_active":"2023-09-21T12:54:41.568252+0000","last_peered":"2023-09-21T12:54:41.568252+0000","last_clean":"2023-09-21T12:54:41.568252+0000","last_became_active":"2023-09-21T12:54:41.567653+0000","last_became_peered":"2023-09-21T12:54:41.567653+0000","last_unstale":"2023-09-21T12:54:41.568252+0000","last_undegraded":"2023-09-21T12:54:41.568252+0000","last_fullsized":"2023-09-21T12:54:41.568252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:09:31.075023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555616+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:54:40.555616+0000","last_peered":"2023-09-21T12:54:40.555616+0000","last_clean":"2023-09-21T12:54:40.555616+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:54:40.555616+0000","last_undegraded":"2023-09-21T12:54:40.555616+0000","last_fullsized":"2023-09-21T12:54:40.555616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561181+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:54:40.561181+0000","last_peered":"2023-09-21T12:54:40.561181+0000","last_clean":"2023-09-21T12:54:40.561181+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:54:40.561181+0000","last_undegraded":"2023-09-21T12:54:40.561181+0000","last_fullsized":"2023-09-21T12:54:40.561181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559563+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:54:40.559563+0000","last_peered":"2023-09-21T12:54:40.559563+0000","last_clean":"2023-09-21T12:54:40.559563+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:54:40.559563+0000","last_undegraded":"2023-09-21T12:54:40.559563+0000","last_fullsized":"2023-09-21T12:54:40.559563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61384,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":319,"num_read_kb":221,"num_write":149,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416408,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":446819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.503},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.379},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.624},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.77700000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":9,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.75}]},{"osd":10,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76300000000000001}]}]},{"osd":10,"up_from":72,"seq":309237645338,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1095325,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.90900000000000003}]},{"osd":3,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.745}]},{"osd":4,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.99199999999999999}]},{"osd":8,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.92700000000000005}]},{"osd":9,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.88700000000000001}]},{"osd":11,"last update":"Thu Sep 21 12:54:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.96699999999999997}]}]},{"osd":9,"up_from":67,"seq":287762808864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":447144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.749,"15min":0.77100000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80200000000000005,"5min":1.028,"15min":1.028},"last":0.627},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.83199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.871,"5min":1.149,"15min":1.149},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.502,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.89800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86199999999999999,"5min":1.492,"15min":1.492},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.02,"5min":1.456,"15min":1.456},"last":0.751}]},{"osd":6,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2110000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.94899999999999995,"15min":0.98599999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91200000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.042,"15min":1.032},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.70599999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94699999999999995,"15min":0.96299999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.96699999999999997,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95199999999999996,"5min":1.548,"15min":1.548},"last":0.66500000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":446941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.024,"15min":1.024},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73799999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.874},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299434,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1039266,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51200000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65600000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77700000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55500000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69899999999999995,"5min":0.88,"15min":0.88},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.47799999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81499999999999995,"5min":1.095,"15min":1.095},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.111,"15min":1.111},"last":0.58199999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.78800000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1100000000000001,"5min":1.135,"15min":1.135},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.63200000000000001}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":1.052,"15min":1.052},"last":0.755},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.71699999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]}]},{"osd":6,"up_from":47,"seq":201863462958,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":446416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.45000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66600000000000004,"5min":0.87,"15min":0.87},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.96699999999999997}]},{"osd":1,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.46300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.78000000000000003}]},{"osd":3,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83299999999999996,"5min":1.04,"15min":1.04},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.67800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.875,"5min":1.008,"15min":1.008},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.57299999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92500000000000004,"5min":1.244,"15min":1.244},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.92900000000000005}]},{"osd":7,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.119},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.097,"5min":0.84299999999999997,"15min":0.79800000000000004},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.3570000000000002,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.53800000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.90500000000000003,"5min":1.016,"15min":1.016},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92600000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.75800000000000001}]},{"osd":9,"last update":"Thu Sep 21 12:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.83799999999999997},"min":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.57899999999999996}]},{"osd":10,"last update":"Thu Sep 21 12:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.88700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":502924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.55500000000000005,"15min":0.497},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Sep 21 12:54:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.40400000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.39500000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.74299999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.36399999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":0.871,"15min":0.871},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Sep 21 12:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91800000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:55:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.75800000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.877},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.83799999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.78700000000000003,"15min":0.77100000000000002},"min":{"1min":0.66800000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.81299999999999994}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.82599999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":447408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.58799999999999997,"15min":0.51000000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.54700000000000004},"min":{"1min":0.46899999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88500000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Sep 21 12:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.66800000000000004,"15min":0.61599999999999999},"min":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.55100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.022,"5min":1.329,"15min":1.329},"last":0.375}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.421,"15min":1.421},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86499999999999999,"5min":1.054,"15min":1.054},"last":0.68899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.70499999999999996}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.86199999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.754},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.222,"15min":1.222},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Sep 21 12:54:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78000000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":504903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55900000000000005,"15min":0.54200000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80800000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:54:07 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.55400000000000005,"15min":0.52000000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.878},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70099999999999996}]},{"osd":3,"last update":"Thu Sep 21 12:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.79300000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.495},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71099999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.68100000000000005}]},{"osd":4,"last update":"Thu Sep 21 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56699999999999995,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.749},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.82599999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.60999999999999999}]},{"osd":6,"last update":"Thu Sep 21 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.70799999999999996,"15min":0.69699999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.58499999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.621},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94299999999999995,"5min":1.026,"15min":1.026},"last":0.71299999999999997}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.55100000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.72599999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:54:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.92800000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":3,"up_from":26,"seq":111669149755,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":446610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":0.57399999999999995,"15min":0.45200000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":14.457000000000001,"5min":14.457000000000001,"15min":14.457000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":0.60899999999999999,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":14.156000000000001,"5min":14.156000000000001,"15min":14.156000000000001},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.746},{"interface":"front","average":{"1min":1.01,"5min":0.69699999999999995,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.9119999999999999,"5min":6.9119999999999999,"15min":6.9119999999999999},"last":0.624}]},{"osd":2,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":0.77100000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":13.997,"5min":13.997,"15min":13.997},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.60499999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.82399999999999995,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":14.121,"5min":14.121,"15min":14.121},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.625},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.64700000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.64000000000000001}]},{"osd":6,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.47899999999999998},{"interface":"front","average":{"1min":1.101,"5min":0.72599999999999998,"15min":0.64000000000000001},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.7329999999999997,"5min":6.7329999999999997,"15min":6.7329999999999997},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Sep 21 12:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":0.83699999999999997,"15min":0.76300000000000001},"min":{"1min":0.623,"5min":0.499,"15min":0.499},"max":{"1min":6.8399999999999999,"5min":6.8399999999999999,"15min":6.8399999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.872,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.69999999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.008,"15min":0.90800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":14.189,"5min":14.189,"15min":14.189},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.86299999999999999,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.78200000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.75700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":446964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60599999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.91100000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.47799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63,"15min":0.57099999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.61399999999999999,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.876,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.56000000000000005},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96599999999999997,"5min":1,"15min":1},"last":0.622}]},{"osd":6,"last update":"Thu Sep 21 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.47199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.753}]},{"osd":7,"last update":"Thu Sep 21 12:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.442}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95099999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":1.077,"15min":1.077},"last":0.69899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86599999999999999,"15min":0.88400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.871},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.60499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94699999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":1038229,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.33500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":0.622,"15min":0.622},"last":0.503},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64600000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Sep 21 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.51200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.54700000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.95399999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.72399999999999998}]},{"osd":8,"last update":"Thu Sep 21 12:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.629},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56200000000000006}]},{"osd":9,"last update":"Thu Sep 21 12:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:55:09.091 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph pg dump --format=json 2023-09-21T12:55:09.818 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:09 smithi156 ceph-mon[134078]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:09 smithi156 ceph-mon[134078]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:09 smithi142 ceph-mon[97663]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:09 smithi142 ceph-mon[97663]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:09 smithi160 ceph-mon[134450]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:09 smithi160 ceph-mon[134450]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:11.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 -- 172.21.15.142:0/433000542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101a10 msgr2=0x7f801c105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:11.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 --2- 172.21.15.142:0/433000542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101a10 0x7f801c105a60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f800c009990 tx=0x7f800c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 -- 172.21.15.142:0/433000542 shutdown_connections 2023-09-21T12:55:11.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 --2- 172.21.15.142:0/433000542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c106140 0x7f801c10dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 --2- 172.21.15.142:0/433000542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c101060 0x7f801c101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 --2- 172.21.15.142:0/433000542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101a10 0x7f801c105a60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 -- 172.21.15.142:0/433000542 >> 172.21.15.142:0/433000542 conn(0x7f801c0fc8d0 msgr2=0x7f801c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:11.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 -- 172.21.15.142:0/433000542 shutdown_connections 2023-09-21T12:55:11.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.505+0000 7f80233ab700 1 -- 172.21.15.142:0/433000542 wait complete. 2023-09-21T12:55:11.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.506+0000 7f80233ab700 1 Processor -- start 2023-09-21T12:55:11.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 -- start start 2023-09-21T12:55:11.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:11.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c101a10 0x7f801c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:11.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c106140 0x7f801c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:11.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1a5400 con 0x7f801c101060 2023-09-21T12:55:11.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1a5570 con 0x7f801c106140 2023-09-21T12:55:11.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f80233ab700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801c1a5730 con 0x7f801c101a10 2023-09-21T12:55:11.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f8021147700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f8021147700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36026/0 (socket says 172.21.15.142:36026) 2023-09-21T12:55:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f8021147700 1 -- 172.21.15.142:0/1060379064 learned_addr learned my addr 172.21.15.142:0/1060379064 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f8020946700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c101a10 0x7f801c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.507+0000 7f8021948700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c106140 0x7f801c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:11.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 -- 172.21.15.142:0/1060379064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c101a10 msgr2=0x7f801c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:11.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c101a10 0x7f801c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 -- 172.21.15.142:0/1060379064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c106140 msgr2=0x7f801c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:11.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c106140 0x7f801c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 -- 172.21.15.142:0/1060379064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0095f0 con 0x7f801c101060 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f8021147700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f801800e9a0 tx=0x7f801800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018009790 con 0x7f801c101060 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8018010430 con 0x7f801c101060 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801c1a5a10 con 0x7f801c101060 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018018680 con 0x7f801c101060 2023-09-21T12:55:11.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.508+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801c1a5ee0 con 0x7f801c101060 2023-09-21T12:55:11.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.509+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801c04eae0 con 0x7f801c101060 2023-09-21T12:55:11.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.511+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f80180105a0 con 0x7f801c101060 2023-09-21T12:55:11.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.512+0000 7f80127fc700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 0x7f80080a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:11.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.513+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8018014070 con 0x7f801c101060 2023-09-21T12:55:11.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.513+0000 7f8020946700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 0x7f80080a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:11.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.513+0000 7f8020946700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 0x7f80080a2b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f800c006010 tx=0x7f800c005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:11.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.517+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8018051e10 con 0x7f801c101060 2023-09-21T12:55:11.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.716+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f801c0008d0 con 0x7f80080a06d0 2023-09-21T12:55:11.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.726+0000 7f80127fc700 1 -- 172.21.15.142:0/1060379064 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340576 (secure 0 0 0) 0x7f801c0008d0 con 0x7f80080a06d0 2023-09-21T12:55:11.731 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:11.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 msgr2=0x7f80080a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:11.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 0x7f80080a2b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f800c006010 tx=0x7f800c005960 comp rx=0 tx=0).stop 2023-09-21T12:55:11.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 msgr2=0x7f801c0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:11.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f801800e9a0 tx=0x7f801800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 shutdown_connections 2023-09-21T12:55:11.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f80080a06d0 0x7f80080a2b90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f801c101060 0x7f801c0730e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f801c106140 0x7f801c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 --2- 172.21.15.142:0/1060379064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801c101a10 0x7f801c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:11.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 >> 172.21.15.142:0/1060379064 conn(0x7f801c0fc8d0 msgr2=0x7f801c0fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:11.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 shutdown_connections 2023-09-21T12:55:11.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:11.732+0000 7f80233ab700 1 -- 172.21.15.142:0/1060379064 wait complete. 2023-09-21T12:55:11.736 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:55:11.896 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:11 smithi142 ceph-mon[97663]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:11.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:11 smithi156 ceph-mon[134078]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:11.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:11 smithi160 ceph-mon[134450]: pgmap v301: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:12.301 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-09-21T12:55:10.381161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651998,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":475,"num_read_kb":355,"num_write":332,"num_write_kb":3042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180893,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335612,"kb_used_data":11344,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606212,"statfs":{"total":1151940427776,"available":1151596761088,"internally_reserved":0,"allocated":11616256,"data_stored":7308949,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003260"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558543+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:54:40.558543+0000","last_peered":"2023-09-21T12:54:40.558543+0000","last_clean":"2023-09-21T12:54:40.558543+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:54:40.558543+0000","last_undegraded":"2023-09-21T12:54:40.558543+0000","last_fullsized":"2023-09-21T12:54:40.558543+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559889+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:54:40.559889+0000","last_peered":"2023-09-21T12:54:40.559889+0000","last_clean":"2023-09-21T12:54:40.559889+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:54:40.559889+0000","last_undegraded":"2023-09-21T12:54:40.559889+0000","last_fullsized":"2023-09-21T12:54:40.559889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559813+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:54:40.559813+0000","last_peered":"2023-09-21T12:54:40.559813+0000","last_clean":"2023-09-21T12:54:40.559813+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:54:40.559813+0000","last_undegraded":"2023-09-21T12:54:40.559813+0000","last_fullsized":"2023-09-21T12:54:40.559813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560397+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:54:40.560397+0000","last_peered":"2023-09-21T12:54:40.560397+0000","last_clean":"2023-09-21T12:54:40.560397+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:54:40.560397+0000","last_undegraded":"2023-09-21T12:54:40.560397+0000","last_fullsized":"2023-09-21T12:54:40.560397+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557793+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:54:40.557793+0000","last_peered":"2023-09-21T12:54:40.557793+0000","last_clean":"2023-09-21T12:54:40.557793+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:54:40.557793+0000","last_undegraded":"2023-09-21T12:54:40.557793+0000","last_fullsized":"2023-09-21T12:54:40.557793+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.568064+0000","last_change":"2023-09-21T12:54:41.568064+0000","last_active":"2023-09-21T12:54:41.568064+0000","last_peered":"2023-09-21T12:54:41.568064+0000","last_clean":"2023-09-21T12:54:41.568064+0000","last_became_active":"2023-09-21T12:54:41.567634+0000","last_became_peered":"2023-09-21T12:54:41.567634+0000","last_unstale":"2023-09-21T12:54:41.568064+0000","last_undegraded":"2023-09-21T12:54:41.568064+0000","last_fullsized":"2023-09-21T12:54:41.568064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:25:07.646626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560221+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:54:40.560221+0000","last_peered":"2023-09-21T12:54:40.560221+0000","last_clean":"2023-09-21T12:54:40.560221+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:54:40.560221+0000","last_undegraded":"2023-09-21T12:54:40.560221+0000","last_fullsized":"2023-09-21T12:54:40.560221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562970+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:54:40.562970+0000","last_peered":"2023-09-21T12:54:40.562970+0000","last_clean":"2023-09-21T12:54:40.562970+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:54:40.562970+0000","last_undegraded":"2023-09-21T12:54:40.562970+0000","last_fullsized":"2023-09-21T12:54:40.562970+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555944+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:54:40.555944+0000","last_peered":"2023-09-21T12:54:40.555944+0000","last_clean":"2023-09-21T12:54:40.555944+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:54:40.555944+0000","last_undegraded":"2023-09-21T12:54:40.555944+0000","last_fullsized":"2023-09-21T12:54:40.555944+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558079+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:54:40.558079+0000","last_peered":"2023-09-21T12:54:40.558079+0000","last_clean":"2023-09-21T12:54:40.558079+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:54:40.558079+0000","last_undegraded":"2023-09-21T12:54:40.558079+0000","last_fullsized":"2023-09-21T12:54:40.558079+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561148+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:54:40.561148+0000","last_peered":"2023-09-21T12:54:40.561148+0000","last_clean":"2023-09-21T12:54:40.561148+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:54:40.561148+0000","last_undegraded":"2023-09-21T12:54:40.561148+0000","last_fullsized":"2023-09-21T12:54:40.561148+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560223+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:54:40.560223+0000","last_peered":"2023-09-21T12:54:40.560223+0000","last_clean":"2023-09-21T12:54:40.560223+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:54:40.560223+0000","last_undegraded":"2023-09-21T12:54:40.560223+0000","last_fullsized":"2023-09-21T12:54:40.560223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561256+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:54:40.561256+0000","last_peered":"2023-09-21T12:54:40.561256+0000","last_clean":"2023-09-21T12:54:40.561256+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:54:40.561256+0000","last_undegraded":"2023-09-21T12:54:40.561256+0000","last_fullsized":"2023-09-21T12:54:40.561256+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560061+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:54:40.560061+0000","last_peered":"2023-09-21T12:54:40.560061+0000","last_clean":"2023-09-21T12:54:40.560061+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:54:40.560061+0000","last_undegraded":"2023-09-21T12:54:40.560061+0000","last_fullsized":"2023-09-21T12:54:40.560061+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559862+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:54:40.559862+0000","last_peered":"2023-09-21T12:54:40.559862+0000","last_clean":"2023-09-21T12:54:40.559862+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:54:40.559862+0000","last_undegraded":"2023-09-21T12:54:40.559862+0000","last_fullsized":"2023-09-21T12:54:40.559862+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555428+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:54:40.555428+0000","last_peered":"2023-09-21T12:54:40.555428+0000","last_clean":"2023-09-21T12:54:40.555428+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:54:40.555428+0000","last_undegraded":"2023-09-21T12:54:40.555428+0000","last_fullsized":"2023-09-21T12:54:40.555428+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560292+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:54:40.560292+0000","last_peered":"2023-09-21T12:54:40.560292+0000","last_clean":"2023-09-21T12:54:40.560292+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:54:40.560292+0000","last_undegraded":"2023-09-21T12:54:40.560292+0000","last_fullsized":"2023-09-21T12:54:40.560292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555143+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:54:40.555143+0000","last_peered":"2023-09-21T12:54:40.555143+0000","last_clean":"2023-09-21T12:54:40.555143+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:54:40.555143+0000","last_undegraded":"2023-09-21T12:54:40.555143+0000","last_fullsized":"2023-09-21T12:54:40.555143+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561459+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:54:40.561459+0000","last_peered":"2023-09-21T12:54:40.561459+0000","last_clean":"2023-09-21T12:54:40.561459+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:54:40.561459+0000","last_undegraded":"2023-09-21T12:54:40.561459+0000","last_fullsized":"2023-09-21T12:54:40.561459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555018+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:40.555018+0000","last_peered":"2023-09-21T12:54:40.555018+0000","last_clean":"2023-09-21T12:54:40.555018+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:40.555018+0000","last_undegraded":"2023-09-21T12:54:40.555018+0000","last_fullsized":"2023-09-21T12:54:40.555018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563413+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:54:40.563413+0000","last_peered":"2023-09-21T12:54:40.563413+0000","last_clean":"2023-09-21T12:54:40.563413+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:54:40.563413+0000","last_undegraded":"2023-09-21T12:54:40.563413+0000","last_fullsized":"2023-09-21T12:54:40.563413+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563487+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:40.563487+0000","last_peered":"2023-09-21T12:54:40.563487+0000","last_clean":"2023-09-21T12:54:40.563487+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:40.563487+0000","last_undegraded":"2023-09-21T12:54:40.563487+0000","last_fullsized":"2023-09-21T12:54:40.563487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560420+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:54:40.560420+0000","last_peered":"2023-09-21T12:54:40.560420+0000","last_clean":"2023-09-21T12:54:40.560420+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:54:40.560420+0000","last_undegraded":"2023-09-21T12:54:40.560420+0000","last_fullsized":"2023-09-21T12:54:40.560420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559289+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:40.559289+0000","last_peered":"2023-09-21T12:54:40.559289+0000","last_clean":"2023-09-21T12:54:40.559289+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:40.559289+0000","last_undegraded":"2023-09-21T12:54:40.559289+0000","last_fullsized":"2023-09-21T12:54:40.559289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556068+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:54:40.556068+0000","last_peered":"2023-09-21T12:54:40.556068+0000","last_clean":"2023-09-21T12:54:40.556068+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:54:40.556068+0000","last_undegraded":"2023-09-21T12:54:40.556068+0000","last_fullsized":"2023-09-21T12:54:40.556068+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574116+0000","last_change":"2023-09-21T12:54:41.573641+0000","last_active":"2023-09-21T12:54:41.574116+0000","last_peered":"2023-09-21T12:54:41.574116+0000","last_clean":"2023-09-21T12:54:41.574116+0000","last_became_active":"2023-09-21T12:54:41.570382+0000","last_became_peered":"2023-09-21T12:54:41.570382+0000","last_unstale":"2023-09-21T12:54:41.574116+0000","last_undegraded":"2023-09-21T12:54:41.574116+0000","last_fullsized":"2023-09-21T12:54:41.574116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:47:35.642160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556355+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:54:40.556355+0000","last_peered":"2023-09-21T12:54:40.556355+0000","last_clean":"2023-09-21T12:54:40.556355+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:54:40.556355+0000","last_undegraded":"2023-09-21T12:54:40.556355+0000","last_fullsized":"2023-09-21T12:54:40.556355+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":75,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:05.508586+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:55:05.508586+0000","last_peered":"2023-09-21T12:55:05.508586+0000","last_clean":"2023-09-21T12:55:05.508586+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:55:05.508586+0000","last_undegraded":"2023-09-21T12:55:05.508586+0000","last_fullsized":"2023-09-21T12:55:05.508586+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.717011+0000","last_change":"2023-09-21T12:54:41.717011+0000","last_active":"2023-09-21T12:54:41.717011+0000","last_peered":"2023-09-21T12:54:41.717011+0000","last_clean":"2023-09-21T12:54:41.717011+0000","last_became_active":"2023-09-21T12:54:41.716663+0000","last_became_peered":"2023-09-21T12:54:41.716663+0000","last_unstale":"2023-09-21T12:54:41.717011+0000","last_undegraded":"2023-09-21T12:54:41.717011+0000","last_fullsized":"2023-09-21T12:54:41.717011+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:24:43.714781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557437+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:40.557437+0000","last_peered":"2023-09-21T12:54:40.557437+0000","last_clean":"2023-09-21T12:54:40.557437+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:40.557437+0000","last_undegraded":"2023-09-21T12:54:40.557437+0000","last_fullsized":"2023-09-21T12:54:40.557437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556772+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:54:40.556772+0000","last_peered":"2023-09-21T12:54:40.556772+0000","last_clean":"2023-09-21T12:54:40.556772+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:54:40.556772+0000","last_undegraded":"2023-09-21T12:54:40.556772+0000","last_fullsized":"2023-09-21T12:54:40.556772+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561561+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:40.561561+0000","last_peered":"2023-09-21T12:54:40.561561+0000","last_clean":"2023-09-21T12:54:40.561561+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:40.561561+0000","last_undegraded":"2023-09-21T12:54:40.561561+0000","last_fullsized":"2023-09-21T12:54:40.561561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562872+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:54:40.562872+0000","last_peered":"2023-09-21T12:54:40.562872+0000","last_clean":"2023-09-21T12:54:40.562872+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:54:40.562872+0000","last_undegraded":"2023-09-21T12:54:40.562872+0000","last_fullsized":"2023-09-21T12:54:40.562872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555803+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:40.555803+0000","last_peered":"2023-09-21T12:54:40.555803+0000","last_clean":"2023-09-21T12:54:40.555803+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:40.555803+0000","last_undegraded":"2023-09-21T12:54:40.555803+0000","last_fullsized":"2023-09-21T12:54:40.555803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.554966+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:54:40.554966+0000","last_peered":"2023-09-21T12:54:40.554966+0000","last_clean":"2023-09-21T12:54:40.554966+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:54:40.554966+0000","last_undegraded":"2023-09-21T12:54:40.554966+0000","last_fullsized":"2023-09-21T12:54:40.554966+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'3","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:07.510835+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:55:07.510835+0000","last_peered":"2023-09-21T12:55:07.510835+0000","last_clean":"2023-09-21T12:55:07.510835+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:55:07.510835+0000","last_undegraded":"2023-09-21T12:55:07.510835+0000","last_fullsized":"2023-09-21T12:55:07.510835+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555878+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:54:40.555878+0000","last_peered":"2023-09-21T12:54:40.555878+0000","last_clean":"2023-09-21T12:54:40.555878+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:54:40.555878+0000","last_undegraded":"2023-09-21T12:54:40.555878+0000","last_fullsized":"2023-09-21T12:54:40.555878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561279+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:40.561279+0000","last_peered":"2023-09-21T12:54:40.561279+0000","last_clean":"2023-09-21T12:54:40.561279+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:40.561279+0000","last_undegraded":"2023-09-21T12:54:40.561279+0000","last_fullsized":"2023-09-21T12:54:40.561279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560340+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:54:40.560340+0000","last_peered":"2023-09-21T12:54:40.560340+0000","last_clean":"2023-09-21T12:54:40.560340+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:54:40.560340+0000","last_undegraded":"2023-09-21T12:54:40.560340+0000","last_fullsized":"2023-09-21T12:54:40.560340+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557100+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:40.557100+0000","last_peered":"2023-09-21T12:54:40.557100+0000","last_clean":"2023-09-21T12:54:40.557100+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:40.557100+0000","last_undegraded":"2023-09-21T12:54:40.557100+0000","last_fullsized":"2023-09-21T12:54:40.557100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556312+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:54:40.556312+0000","last_peered":"2023-09-21T12:54:40.556312+0000","last_clean":"2023-09-21T12:54:40.556312+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:54:40.556312+0000","last_undegraded":"2023-09-21T12:54:40.556312+0000","last_fullsized":"2023-09-21T12:54:40.556312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'26","reported_seq":154,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:08.521522+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:55:08.521522+0000","last_peered":"2023-09-21T12:55:08.521522+0000","last_clean":"2023-09-21T12:55:08.521522+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:55:08.521522+0000","last_undegraded":"2023-09-21T12:55:08.521522+0000","last_fullsized":"2023-09-21T12:55:08.521522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56994,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":27,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559026+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:54:40.559026+0000","last_peered":"2023-09-21T12:54:40.559026+0000","last_clean":"2023-09-21T12:54:40.559026+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:54:40.559026+0000","last_undegraded":"2023-09-21T12:54:40.559026+0000","last_fullsized":"2023-09-21T12:54:40.559026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.581333+0000","last_change":"2023-09-21T12:54:41.580944+0000","last_active":"2023-09-21T12:54:41.581333+0000","last_peered":"2023-09-21T12:54:41.581333+0000","last_clean":"2023-09-21T12:54:41.581333+0000","last_became_active":"2023-09-21T12:54:41.571007+0000","last_became_peered":"2023-09-21T12:54:41.571007+0000","last_unstale":"2023-09-21T12:54:41.581333+0000","last_undegraded":"2023-09-21T12:54:41.581333+0000","last_fullsized":"2023-09-21T12:54:41.581333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:54:34.209661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561170+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:54:40.561170+0000","last_peered":"2023-09-21T12:54:40.561170+0000","last_clean":"2023-09-21T12:54:40.561170+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:54:40.561170+0000","last_undegraded":"2023-09-21T12:54:40.561170+0000","last_fullsized":"2023-09-21T12:54:40.561170+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556559+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:40.556559+0000","last_peered":"2023-09-21T12:54:40.556559+0000","last_clean":"2023-09-21T12:54:40.556559+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:40.556559+0000","last_undegraded":"2023-09-21T12:54:40.556559+0000","last_fullsized":"2023-09-21T12:54:40.556559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560674+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:54:40.560674+0000","last_peered":"2023-09-21T12:54:40.560674+0000","last_clean":"2023-09-21T12:54:40.560674+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:54:40.560674+0000","last_undegraded":"2023-09-21T12:54:40.560674+0000","last_fullsized":"2023-09-21T12:54:40.560674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'4","reported_seq":72,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:05.530894+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:55:05.530894+0000","last_peered":"2023-09-21T12:55:05.530894+0000","last_clean":"2023-09-21T12:55:05.530894+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:55:05.530894+0000","last_undegraded":"2023-09-21T12:55:05.530894+0000","last_fullsized":"2023-09-21T12:55:05.530894+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559737+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:54:40.559737+0000","last_peered":"2023-09-21T12:54:40.559737+0000","last_clean":"2023-09-21T12:54:40.559737+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:54:40.559737+0000","last_undegraded":"2023-09-21T12:54:40.559737+0000","last_fullsized":"2023-09-21T12:54:40.559737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557457+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:40.557457+0000","last_peered":"2023-09-21T12:54:40.557457+0000","last_clean":"2023-09-21T12:54:40.557457+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:40.557457+0000","last_undegraded":"2023-09-21T12:54:40.557457+0000","last_fullsized":"2023-09-21T12:54:40.557457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.570475+0000","last_change":"2023-09-21T12:54:41.570475+0000","last_active":"2023-09-21T12:54:41.570475+0000","last_peered":"2023-09-21T12:54:41.570475+0000","last_clean":"2023-09-21T12:54:41.570475+0000","last_became_active":"2023-09-21T12:54:41.570069+0000","last_became_peered":"2023-09-21T12:54:41.570069+0000","last_unstale":"2023-09-21T12:54:41.570475+0000","last_undegraded":"2023-09-21T12:54:41.570475+0000","last_fullsized":"2023-09-21T12:54:41.570475+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:07:47.022244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559676+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:40.559676+0000","last_peered":"2023-09-21T12:54:40.559676+0000","last_clean":"2023-09-21T12:54:40.559676+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:40.559676+0000","last_undegraded":"2023-09-21T12:54:40.559676+0000","last_fullsized":"2023-09-21T12:54:40.559676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558585+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:54:40.558585+0000","last_peered":"2023-09-21T12:54:40.558585+0000","last_clean":"2023-09-21T12:54:40.558585+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:54:40.558585+0000","last_undegraded":"2023-09-21T12:54:40.558585+0000","last_fullsized":"2023-09-21T12:54:40.558585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555077+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:40.555077+0000","last_peered":"2023-09-21T12:54:40.555077+0000","last_clean":"2023-09-21T12:54:40.555077+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:40.555077+0000","last_undegraded":"2023-09-21T12:54:40.555077+0000","last_fullsized":"2023-09-21T12:54:40.555077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557823+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:54:40.557823+0000","last_peered":"2023-09-21T12:54:40.557823+0000","last_clean":"2023-09-21T12:54:40.557823+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:54:40.557823+0000","last_undegraded":"2023-09-21T12:54:40.557823+0000","last_fullsized":"2023-09-21T12:54:40.557823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561037+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:40.561037+0000","last_peered":"2023-09-21T12:54:40.561037+0000","last_clean":"2023-09-21T12:54:40.561037+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:40.561037+0000","last_undegraded":"2023-09-21T12:54:40.561037+0000","last_fullsized":"2023-09-21T12:54:40.561037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.862117+0000","last_change":"2023-09-21T12:54:41.862117+0000","last_active":"2023-09-21T12:54:41.862117+0000","last_peered":"2023-09-21T12:54:41.862117+0000","last_clean":"2023-09-21T12:54:41.862117+0000","last_became_active":"2023-09-21T12:54:41.861717+0000","last_became_peered":"2023-09-21T12:54:41.861717+0000","last_unstale":"2023-09-21T12:54:41.862117+0000","last_undegraded":"2023-09-21T12:54:41.862117+0000","last_fullsized":"2023-09-21T12:54:41.862117+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:25:46.138394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555920+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:54:40.555920+0000","last_peered":"2023-09-21T12:54:40.555920+0000","last_clean":"2023-09-21T12:54:40.555920+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:54:40.555920+0000","last_undegraded":"2023-09-21T12:54:40.555920+0000","last_fullsized":"2023-09-21T12:54:40.555920+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'4","reported_seq":71,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:07.533501+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:55:07.533501+0000","last_peered":"2023-09-21T12:55:07.533501+0000","last_clean":"2023-09-21T12:55:07.533501+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:55:07.533501+0000","last_undegraded":"2023-09-21T12:55:07.533501+0000","last_fullsized":"2023-09-21T12:55:07.533501+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563521+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:54:40.563521+0000","last_peered":"2023-09-21T12:54:40.563521+0000","last_clean":"2023-09-21T12:54:40.563521+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:54:40.563521+0000","last_undegraded":"2023-09-21T12:54:40.563521+0000","last_fullsized":"2023-09-21T12:54:40.563521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560769+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:40.560769+0000","last_peered":"2023-09-21T12:54:40.560769+0000","last_clean":"2023-09-21T12:54:40.560769+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:40.560769+0000","last_undegraded":"2023-09-21T12:54:40.560769+0000","last_fullsized":"2023-09-21T12:54:40.560769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":320,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559925+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:40.559925+0000","last_peered":"2023-09-21T12:54:40.559925+0000","last_clean":"2023-09-21T12:54:40.559925+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:40.559925+0000","last_undegraded":"2023-09-21T12:54:40.559925+0000","last_fullsized":"2023-09-21T12:54:40.559925+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561378+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:54:40.561378+0000","last_peered":"2023-09-21T12:54:40.561378+0000","last_clean":"2023-09-21T12:54:40.561378+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:54:40.561378+0000","last_undegraded":"2023-09-21T12:54:40.561378+0000","last_fullsized":"2023-09-21T12:54:40.561378+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560099+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:40.560099+0000","last_peered":"2023-09-21T12:54:40.560099+0000","last_clean":"2023-09-21T12:54:40.560099+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:40.560099+0000","last_undegraded":"2023-09-21T12:54:40.560099+0000","last_fullsized":"2023-09-21T12:54:40.560099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559181+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:40.559181+0000","last_peered":"2023-09-21T12:54:40.559181+0000","last_clean":"2023-09-21T12:54:40.559181+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:40.559181+0000","last_undegraded":"2023-09-21T12:54:40.559181+0000","last_fullsized":"2023-09-21T12:54:40.559181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561408+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:54:40.561408+0000","last_peered":"2023-09-21T12:54:40.561408+0000","last_clean":"2023-09-21T12:54:40.561408+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:54:40.561408+0000","last_undegraded":"2023-09-21T12:54:40.561408+0000","last_fullsized":"2023-09-21T12:54:40.561408+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555092+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:40.555092+0000","last_peered":"2023-09-21T12:54:40.555092+0000","last_clean":"2023-09-21T12:54:40.555092+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:40.555092+0000","last_undegraded":"2023-09-21T12:54:40.555092+0000","last_fullsized":"2023-09-21T12:54:40.555092+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563425+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:54:40.563425+0000","last_peered":"2023-09-21T12:54:40.563425+0000","last_clean":"2023-09-21T12:54:40.563425+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:54:40.563425+0000","last_undegraded":"2023-09-21T12:54:40.563425+0000","last_fullsized":"2023-09-21T12:54:40.563425+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561295+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:40.561295+0000","last_peered":"2023-09-21T12:54:40.561295+0000","last_clean":"2023-09-21T12:54:40.561295+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:40.561295+0000","last_undegraded":"2023-09-21T12:54:40.561295+0000","last_fullsized":"2023-09-21T12:54:40.561295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559981+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:54:40.559981+0000","last_peered":"2023-09-21T12:54:40.559981+0000","last_clean":"2023-09-21T12:54:40.559981+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:54:40.559981+0000","last_undegraded":"2023-09-21T12:54:40.559981+0000","last_fullsized":"2023-09-21T12:54:40.559981+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555440+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:40.555440+0000","last_peered":"2023-09-21T12:54:40.555440+0000","last_clean":"2023-09-21T12:54:40.555440+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:40.555440+0000","last_undegraded":"2023-09-21T12:54:40.555440+0000","last_fullsized":"2023-09-21T12:54:40.555440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557328+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:54:40.557328+0000","last_peered":"2023-09-21T12:54:40.557328+0000","last_clean":"2023-09-21T12:54:40.557328+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:54:40.557328+0000","last_undegraded":"2023-09-21T12:54:40.557328+0000","last_fullsized":"2023-09-21T12:54:40.557328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563079+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:40.563079+0000","last_peered":"2023-09-21T12:54:40.563079+0000","last_clean":"2023-09-21T12:54:40.563079+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:40.563079+0000","last_undegraded":"2023-09-21T12:54:40.563079+0000","last_fullsized":"2023-09-21T12:54:40.563079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558128+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:54:40.558128+0000","last_peered":"2023-09-21T12:54:40.558128+0000","last_clean":"2023-09-21T12:54:40.558128+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:54:40.558128+0000","last_undegraded":"2023-09-21T12:54:40.558128+0000","last_fullsized":"2023-09-21T12:54:40.558128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561350+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:40.561350+0000","last_peered":"2023-09-21T12:54:40.561350+0000","last_clean":"2023-09-21T12:54:40.561350+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:40.561350+0000","last_undegraded":"2023-09-21T12:54:40.561350+0000","last_fullsized":"2023-09-21T12:54:40.561350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563218+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:54:40.563218+0000","last_peered":"2023-09-21T12:54:40.563218+0000","last_clean":"2023-09-21T12:54:40.563218+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:54:40.563218+0000","last_undegraded":"2023-09-21T12:54:40.563218+0000","last_fullsized":"2023-09-21T12:54:40.563218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557905+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:40.557905+0000","last_peered":"2023-09-21T12:54:40.557905+0000","last_clean":"2023-09-21T12:54:40.557905+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:40.557905+0000","last_undegraded":"2023-09-21T12:54:40.557905+0000","last_fullsized":"2023-09-21T12:54:40.557905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561154+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:54:40.561154+0000","last_peered":"2023-09-21T12:54:40.561154+0000","last_clean":"2023-09-21T12:54:40.561154+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:54:40.561154+0000","last_undegraded":"2023-09-21T12:54:40.561154+0000","last_fullsized":"2023-09-21T12:54:40.561154+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561605+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:40.561605+0000","last_peered":"2023-09-21T12:54:40.561605+0000","last_clean":"2023-09-21T12:54:40.561605+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:40.561605+0000","last_undegraded":"2023-09-21T12:54:40.561605+0000","last_fullsized":"2023-09-21T12:54:40.561605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561214+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:54:40.561214+0000","last_peered":"2023-09-21T12:54:40.561214+0000","last_clean":"2023-09-21T12:54:40.561214+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:54:40.561214+0000","last_undegraded":"2023-09-21T12:54:40.561214+0000","last_fullsized":"2023-09-21T12:54:40.561214+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556244+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:40.556244+0000","last_peered":"2023-09-21T12:54:40.556244+0000","last_clean":"2023-09-21T12:54:40.556244+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:40.556244+0000","last_undegraded":"2023-09-21T12:54:40.556244+0000","last_fullsized":"2023-09-21T12:54:40.556244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574550+0000","last_change":"2023-09-21T12:54:41.574550+0000","last_active":"2023-09-21T12:54:41.574550+0000","last_peered":"2023-09-21T12:54:41.574550+0000","last_clean":"2023-09-21T12:54:41.574550+0000","last_became_active":"2023-09-21T12:54:41.568847+0000","last_became_peered":"2023-09-21T12:54:41.568847+0000","last_unstale":"2023-09-21T12:54:41.574550+0000","last_undegraded":"2023-09-21T12:54:41.574550+0000","last_fullsized":"2023-09-21T12:54:41.574550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:40:47.869112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561711+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:40.561711+0000","last_peered":"2023-09-21T12:54:40.561711+0000","last_clean":"2023-09-21T12:54:40.561711+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:40.561711+0000","last_undegraded":"2023-09-21T12:54:40.561711+0000","last_fullsized":"2023-09-21T12:54:40.561711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561514+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:54:40.561514+0000","last_peered":"2023-09-21T12:54:40.561514+0000","last_clean":"2023-09-21T12:54:40.561514+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:54:40.561514+0000","last_undegraded":"2023-09-21T12:54:40.561514+0000","last_fullsized":"2023-09-21T12:54:40.561514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558218+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:54:40.558218+0000","last_peered":"2023-09-21T12:54:40.558218+0000","last_clean":"2023-09-21T12:54:40.558218+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:54:40.558218+0000","last_undegraded":"2023-09-21T12:54:40.558218+0000","last_fullsized":"2023-09-21T12:54:40.558218+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.562453+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:54:40.562453+0000","last_peered":"2023-09-21T12:54:40.562453+0000","last_clean":"2023-09-21T12:54:40.562453+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:54:40.562453+0000","last_undegraded":"2023-09-21T12:54:40.562453+0000","last_fullsized":"2023-09-21T12:54:40.562453+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561230+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:54:40.561230+0000","last_peered":"2023-09-21T12:54:40.561230+0000","last_clean":"2023-09-21T12:54:40.561230+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:54:40.561230+0000","last_undegraded":"2023-09-21T12:54:40.561230+0000","last_fullsized":"2023-09-21T12:54:40.561230+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560338+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:54:40.560338+0000","last_peered":"2023-09-21T12:54:40.560338+0000","last_clean":"2023-09-21T12:54:40.560338+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:54:40.560338+0000","last_undegraded":"2023-09-21T12:54:40.560338+0000","last_fullsized":"2023-09-21T12:54:40.560338+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561482+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:54:40.561482+0000","last_peered":"2023-09-21T12:54:40.561482+0000","last_clean":"2023-09-21T12:54:40.561482+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:54:40.561482+0000","last_undegraded":"2023-09-21T12:54:40.561482+0000","last_fullsized":"2023-09-21T12:54:40.561482+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.558405+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:54:40.558405+0000","last_peered":"2023-09-21T12:54:40.558405+0000","last_clean":"2023-09-21T12:54:40.558405+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:54:40.558405+0000","last_undegraded":"2023-09-21T12:54:40.558405+0000","last_fullsized":"2023-09-21T12:54:40.558405+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561527+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:54:40.561527+0000","last_peered":"2023-09-21T12:54:40.561527+0000","last_clean":"2023-09-21T12:54:40.561527+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:54:40.561527+0000","last_undegraded":"2023-09-21T12:54:40.561527+0000","last_fullsized":"2023-09-21T12:54:40.561527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563346+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:54:40.563346+0000","last_peered":"2023-09-21T12:54:40.563346+0000","last_clean":"2023-09-21T12:54:40.563346+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:54:40.563346+0000","last_undegraded":"2023-09-21T12:54:40.563346+0000","last_fullsized":"2023-09-21T12:54:40.563346+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555853+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:54:40.555853+0000","last_peered":"2023-09-21T12:54:40.555853+0000","last_clean":"2023-09-21T12:54:40.555853+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:54:40.555853+0000","last_undegraded":"2023-09-21T12:54:40.555853+0000","last_fullsized":"2023-09-21T12:54:40.555853+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.568252+0000","last_change":"2023-09-21T12:54:41.568252+0000","last_active":"2023-09-21T12:54:41.568252+0000","last_peered":"2023-09-21T12:54:41.568252+0000","last_clean":"2023-09-21T12:54:41.568252+0000","last_became_active":"2023-09-21T12:54:41.567653+0000","last_became_peered":"2023-09-21T12:54:41.567653+0000","last_unstale":"2023-09-21T12:54:41.568252+0000","last_undegraded":"2023-09-21T12:54:41.568252+0000","last_fullsized":"2023-09-21T12:54:41.568252+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:09:31.075023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555616+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:54:40.555616+0000","last_peered":"2023-09-21T12:54:40.555616+0000","last_clean":"2023-09-21T12:54:40.555616+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:54:40.555616+0000","last_undegraded":"2023-09-21T12:54:40.555616+0000","last_fullsized":"2023-09-21T12:54:40.555616+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561181+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:54:40.561181+0000","last_peered":"2023-09-21T12:54:40.561181+0000","last_clean":"2023-09-21T12:54:40.561181+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:54:40.561181+0000","last_undegraded":"2023-09-21T12:54:40.561181+0000","last_fullsized":"2023-09-21T12:54:40.561181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559563+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:54:40.559563+0000","last_peered":"2023-09-21T12:54:40.559563+0000","last_clean":"2023-09-21T12:54:40.559563+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:54:40.559563+0000","last_undegraded":"2023-09-21T12:54:40.559563+0000","last_fullsized":"2023-09-21T12:54:40.559563+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61384,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":339,"num_read_kb":236,"num_write":149,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":184152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416409,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":446819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.505}]},{"osd":1,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.874},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.56200000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.752},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.73699999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":9,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.91200000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.85999999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645339,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1069056,"data_stored":1095325,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.621,"15min":0.62},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.81899999999999995}]},{"osd":3,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.746}]},{"osd":4,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.89200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":1.345,"15min":1.345},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84199999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:54:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.873},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.0109999999999999}]},{"osd":8,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.98499999999999999}]},{"osd":9,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":1.0609999999999999}]},{"osd":11,"last update":"Thu Sep 21 12:54:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.03}]}]},{"osd":9,"up_from":67,"seq":287762808864,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":447144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":6.335,"5min":6.335,"15min":6.335},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.58099999999999996,"15min":0.59099999999999997},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.749,"15min":0.77100000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.80200000000000005,"5min":1.028,"15min":1.028},"last":0.627},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.81200000000000006,"15min":0.83199999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":2.2759999999999998,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.747,"15min":0.76900000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.871,"5min":1.149,"15min":1.149},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.502,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.77000000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.76900000000000002,"15min":0.76700000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":4.633,"5min":4.633,"15min":4.633},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77000000000000002,"15min":0.77800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.86799999999999999,"15min":0.89800000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.86199999999999999,"5min":1.492,"15min":1.492},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.84499999999999997,"15min":0.86399999999999999},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.02,"5min":1.456,"15min":1.456},"last":0.751}]},{"osd":6,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.2110000000000001,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.498},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.89900000000000002,"15min":0.91600000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.94899999999999995,"15min":0.98599999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.91200000000000003,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.042,"15min":1.032},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":6.9420000000000002,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.70599999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.94699999999999995,"15min":0.96299999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.516,"5min":2.516,"15min":2.516},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.96699999999999997,"15min":1.0009999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.95199999999999996,"5min":1.548,"15min":1.548},"last":0.66500000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":8,"up_from":59,"seq":253403070501,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":446941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":1.024,"15min":1.024},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.73799999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.59999999999999998,"15min":0.60799999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.38600000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.27400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.46300000000000002,"15min":0.46899999999999997},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54400000000000004}]},{"osd":3,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57299999999999995,"15min":0.58099999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.74399999999999999,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.64800000000000002,"15min":0.65200000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.85599999999999998}]},{"osd":4,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.64900000000000002,"15min":0.65500000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82799999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.80500000000000005}]},{"osd":5,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.54400000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.54600000000000004},"min":{"1min":0.316,"5min":0.311,"15min":0.311},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70299999999999996}]},{"osd":6,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.71599999999999997},"min":{"1min":0.47299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.68799999999999994,"15min":0.69399999999999995},"min":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:54:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68000000000000005,"15min":0.68400000000000005},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71499999999999997,"15min":0.72499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.874},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.72699999999999998,"15min":0.72099999999999997},"min":{"1min":0.58699999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.96499999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:54:04 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]}]},{"osd":7,"up_from":52,"seq":223338299435,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":1039266,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51200000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65600000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77700000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69899999999999995,"5min":0.88,"15min":0.88},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.48399999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81499999999999995,"5min":1.095,"15min":1.095},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.111,"15min":1.111},"last":0.58299999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67900000000000005,"15min":0.67500000000000004},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.71399999999999997,"15min":0.70799999999999996},"min":{"1min":0.47899999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.69099999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1100000000000001,"5min":1.135,"15min":1.135},"last":0.625},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.75800000000000001}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":1.052,"15min":1.052},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.79200000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]}]},{"osd":6,"up_from":47,"seq":201863462959,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":446416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45400000000000001,"15min":0.45000000000000001},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.66600000000000004,"5min":0.87,"15min":0.87},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.45900000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.78600000000000003,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.63200000000000001,"15min":0.629},"min":{"1min":0.45400000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.46300000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.72099999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.624},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.76400000000000001,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.501}]},{"osd":3,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83299999999999996,"5min":1.04,"15min":1.04},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60099999999999998,"15min":0.59499999999999997},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68500000000000005,"15min":0.67800000000000005},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.875,"5min":1.008,"15min":1.008},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.71399999999999997,"15min":0.70899999999999996},"min":{"1min":0.57299999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92500000000000004,"5min":1.244,"15min":1.244},"last":0.745}]},{"osd":5,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68100000000000005,"15min":0.68500000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.82499999999999996,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.65900000000000003}]},{"osd":7,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.119},"last":0.77500000000000002},{"interface":"front","average":{"1min":1.097,"5min":0.84299999999999997,"15min":0.79800000000000004},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.3570000000000002,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.68799999999999994}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75700000000000001,"15min":0.76100000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.90500000000000003,"5min":1.016,"15min":1.016},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.81299999999999994,"15min":0.82499999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92600000000000005,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.73799999999999999}]},{"osd":9,"last update":"Thu Sep 21 12:54:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85999999999999999,"15min":0.874},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.95099999999999996,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.82199999999999995,"15min":0.83799999999999997},"min":{"1min":0.51300000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.96799999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:54:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.83299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574918,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":502924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.57899999999999996,"15min":0.503},"min":{"1min":0.40699999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":5.7750000000000004,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.55500000000000005,"15min":0.497},"min":{"1min":0.45300000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84999999999999998,"5min":0.878,"15min":0.878},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.57899999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.73199999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57099999999999995,"15min":0.54700000000000004},"min":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.63900000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.45800000000000002,"15min":0.436},"min":{"1min":0.36399999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.33900000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.79800000000000004,"5min":0.871,"15min":0.871},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Sep 21 12:54:13 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.45400000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.82499999999999996,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.749},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.627,"15min":0.61499999999999999},"min":{"1min":0.50900000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78200000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66400000000000003,"15min":0.66200000000000003},"min":{"1min":0.51000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.67600000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91800000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.76700000000000002}]},{"osd":7,"last update":"Thu Sep 21 12:55:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.84899999999999998}]},{"osd":8,"last update":"Thu Sep 21 12:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.504,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.68899999999999995},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82399999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.78700000000000003,"15min":0.77100000000000002},"min":{"1min":0.66800000000000004,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.79200000000000004,"15min":0.78000000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.96699999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.55700000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97599999999999998,"5min":0.995,"15min":0.995},"last":0.98199999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":447408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.58799999999999997,"15min":0.51000000000000001},"min":{"1min":0.372,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89400000000000002,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.63200000000000001,"15min":0.54700000000000004},"min":{"1min":0.46899999999999997,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.88500000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.61099999999999999,"15min":0.57899999999999996},"min":{"1min":0.38300000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.63600000000000001}]},{"osd":3,"last update":"Thu Sep 21 12:52:26 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48799999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.63,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:54:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.66800000000000004,"15min":0.61599999999999999},"min":{"1min":0.39600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.44400000000000001}]},{"osd":5,"last update":"Thu Sep 21 12:54:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.67700000000000005,"15min":0.66200000000000003},"min":{"1min":0.55100000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63800000000000001,"15min":0.64000000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.84999999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:54:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.66000000000000003,"15min":0.65200000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.68300000000000005,"15min":0.69699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":1.022,"5min":1.329,"15min":1.329},"last":0.375}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:54:18 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.81799999999999995,"15min":0.83099999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0329999999999999,"5min":1.421,"15min":1.421},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.79100000000000004,"15min":0.80100000000000005},"min":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":0.86499999999999999,"5min":1.054,"15min":1.054},"last":0.68899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78000000000000003,"15min":0.78400000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.8169999999999999,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.86399999999999999,"15min":0.85999999999999999},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.3109999999999999,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.70499999999999996}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.86199999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.754},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.222,"15min":1.222},"last":0.61799999999999999}]},{"osd":11,"last update":"Thu Sep 21 12:54:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.78000000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":504903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59599999999999997,"15min":0.53400000000000003},"min":{"1min":0.48699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.53600000000000003},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.39400000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.79300000000000004,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.443},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.57999999999999996,"15min":0.56899999999999995},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.71099999999999997,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Sep 21 12:53:53 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.56699999999999995,"15min":0.54500000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.56599999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:54:16 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.81499999999999995,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84099999999999997,"5min":0.876,"15min":0.876},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:35 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.70799999999999996,"15min":0.69699999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.5449999999999999,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.60699999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.621,"15min":0.621},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.94299999999999995,"5min":1.026,"15min":1.026},"last":0.80900000000000005}]},{"osd":9,"last update":"Thu Sep 21 12:54:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.77300000000000002,"15min":0.75700000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":2.9710000000000001,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.55100000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.9870000000000001,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.66100000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149756,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":446610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":0.57399999999999995,"15min":0.45200000000000001},"min":{"1min":0.312,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":14.457000000000001,"5min":14.457000000000001,"15min":14.457000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":1.2609999999999999,"5min":0.60899999999999999,"15min":0.47999999999999998},"min":{"1min":0.33500000000000002,"5min":0.31,"15min":0.31},"max":{"1min":14.156000000000001,"5min":14.156000000000001,"15min":14.156000000000001},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:54:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.622},{"interface":"front","average":{"1min":1.01,"5min":0.69699999999999995,"15min":0.63900000000000001},"min":{"1min":0.49299999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":6.9119999999999999,"5min":6.9119999999999999,"15min":6.9119999999999999},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Sep 21 12:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":0.77100000000000002,"15min":0.65200000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":13.997,"5min":13.997,"15min":13.997},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63900000000000001,"15min":0.623},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.82399999999999995,"15min":0.67800000000000005},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":14.121,"5min":14.121,"15min":14.121},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.625},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Thu Sep 21 12:54:11 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64200000000000002,"15min":0.63800000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65700000000000003,"15min":0.64500000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90200000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60599999999999998,"15min":0.57199999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.994,"5min":1.994,"15min":1.994},"last":0.379},{"interface":"front","average":{"1min":1.101,"5min":0.72599999999999998,"15min":0.64000000000000001},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":6.7329999999999997,"5min":6.7329999999999997,"15min":6.7329999999999997},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Sep 21 12:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":0.83699999999999997,"15min":0.76300000000000001},"min":{"1min":0.623,"5min":0.499,"15min":0.499},"max":{"1min":6.8399999999999999,"5min":6.8399999999999999,"15min":6.8399999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.872,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.66000000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:54:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.008,"15min":0.90800000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":14.189,"5min":14.189,"15min":14.189},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.86299999999999999,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.54500000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":0.93999999999999995,"15min":0.89100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.8789999999999996,"5min":6.8789999999999996,"15min":6.8789999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1040000000000001,"15min":0.95799999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":14.083,"5min":14.083,"15min":14.083},"last":0.67300000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":34,"seq":146028888119,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":446964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.40000000000000002,"15min":0.377},"min":{"1min":0.29199999999999998,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.60599999999999998,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40400000000000003,"15min":0.379},"min":{"1min":0.29299999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.56599999999999995,"15min":0.53000000000000003},"min":{"1min":0.34399999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.91100000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.47799999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.79100000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":3,"last update":"Thu Sep 21 12:54:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.63,"15min":0.57099999999999995},"min":{"1min":0.38200000000000001,"5min":0.38,"15min":0.38},"max":{"1min":3.7229999999999999,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.61399999999999999,"15min":0.56999999999999995},"min":{"1min":0.38900000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":3.851,"5min":3.851,"15min":3.851},"last":0.73699999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:54:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.48599999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.876,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.56000000000000005},"min":{"1min":0.47499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96599999999999997,"5min":1,"15min":1},"last":0.622}]},{"osd":6,"last update":"Thu Sep 21 12:54:37 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61899999999999999,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.622},"min":{"1min":0.47199999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92300000000000004,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.753}]},{"osd":7,"last update":"Thu Sep 21 12:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.442}]},{"osd":8,"last update":"Thu Sep 21 12:54:20 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72799999999999998,"15min":0.72599999999999998},"min":{"1min":0.505,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.95099999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.54800000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.89900000000000002,"5min":1.077,"15min":1.077},"last":0.69899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:54:42 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.86599999999999999,"15min":0.88400000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0029999999999999,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.871},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.60499999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94699999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.80300000000000005}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.52500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724595,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":999424,"data_stored":1038229,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51800000000000002,"15min":0.498},"min":{"1min":0.377,"5min":0.318,"15min":0.318},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.52400000000000002,"15min":0.50800000000000001},"min":{"1min":0.33500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58099999999999996,"15min":0.56999999999999995},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.70999999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41799999999999998,"15min":0.42199999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":0.622,"15min":0.622},"last":0.503},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.437,"15min":0.439},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.64600000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.53800000000000003},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:54:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.60399999999999998,"15min":0.59699999999999998},"min":{"1min":0.46000000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.59399999999999997,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Sep 21 12:54:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.65900000000000003,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.68300000000000005,"15min":0.66000000000000003},"min":{"1min":0.51200000000000001,"5min":0.434,"15min":0.434},"max":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.73599999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.54700000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.95399999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.72399999999999998}]},{"osd":8,"last update":"Thu Sep 21 12:54:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63,"15min":0.629},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58299999999999996,"15min":0.58499999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.56200000000000006}]},{"osd":9,"last update":"Thu Sep 21 12:54:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":58700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:55:12.308 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-09-21T12:55:12.308 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-21T12:55:12.309 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-09-21T12:55:12.309 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph health --format=json 2023-09-21T12:55:12.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:12 smithi156 ceph-mon[134078]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:12.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:12 smithi142 ceph-mon[97663]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:12.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:12 smithi160 ceph-mon[134450]: from='client.14835 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:55:13.036 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:13 smithi156 ceph-mon[134078]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:13 smithi142 ceph-mon[97663]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:13 smithi160 ceph-mon[134450]: pgmap v302: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:14.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 -- 172.21.15.142:0/262475354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073210 msgr2=0x7f25780735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 --2- 172.21.15.142:0/262475354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073210 0x7f25780735f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2574009990 tx=0x7f2574009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 -- 172.21.15.142:0/262475354 shutdown_connections 2023-09-21T12:55:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 --2- 172.21.15.142:0/262475354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 0x7f257810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 --2- 172.21.15.142:0/262475354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073210 0x7f25780735f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 --2- 172.21.15.142:0/262475354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073b30 0x7f257810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 -- 172.21.15.142:0/262475354 >> 172.21.15.142:0/262475354 conn(0x7f25780fc8d0 msgr2=0x7f25780fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 -- 172.21.15.142:0/262475354 shutdown_connections 2023-09-21T12:55:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.699+0000 7f257faf2700 1 -- 172.21.15.142:0/262475354 wait complete. 2023-09-21T12:55:14.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.700+0000 7f257faf2700 1 Processor -- start 2023-09-21T12:55:14.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.700+0000 7f257faf2700 1 -- start start 2023-09-21T12:55:14.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:14.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 0x7f257819daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257819e100 con 0x7f257810d640 2023-09-21T12:55:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257819e270 con 0x7f2578073210 2023-09-21T12:55:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257faf2700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f257819e430 con 0x7f2578073b30 2023-09-21T12:55:14.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d88e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35924/0 (socket says 172.21.15.142:35924) 2023-09-21T12:55:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 -- 172.21.15.142:0/248607448 learned_addr learned my addr 172.21.15.142:0/248607448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d88e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60150/0 (socket says 172.21.15.142:60150) 2023-09-21T12:55:14.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257e08f700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 0x7f257819daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 -- 172.21.15.142:0/248607448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 msgr2=0x7f2578199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 -- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 msgr2=0x7f257819daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 0x7f257819daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.701+0000 7f257d08d700 1 -- 172.21.15.142:0/248607448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570009c40 con 0x7f2578073b30 2023-09-21T12:55:14.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f257d88e700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:14.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f257d08d700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f256800e9a0 tx=0x7f256800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:14.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568009790 con 0x7f2578073b30 2023-09-21T12:55:14.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25740095f0 con 0x7f2578073b30 2023-09-21T12:55:14.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f256800ce80 con 0x7f2578073b30 2023-09-21T12:55:14.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2568018680 con 0x7f2578073b30 2023-09-21T12:55:14.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.702+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25781a5da0 con 0x7f2578073b30 2023-09-21T12:55:14.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.703+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257804eae0 con 0x7f2578073b30 2023-09-21T12:55:14.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.705+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f2568010430 con 0x7f2578073b30 2023-09-21T12:55:14.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.707+0000 7f256effd700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 0x7f25640a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:14.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.707+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2568014070 con 0x7f2578073b30 2023-09-21T12:55:14.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.707+0000 7f257d88e700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 0x7f25640a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:14.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.707+0000 7f257d88e700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 0x7f25640a2c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f257400b2e0 tx=0x7f2574005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:14.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.712+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2568095c70 con 0x7f2578073b30 2023-09-21T12:55:14.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:14 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:55:14.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:14 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:55:14.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:14 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:55:14.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.964+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f257819a4a0 con 0x7f2578073b30 2023-09-21T12:55:14.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.964+0000 7f256effd700 1 -- 172.21.15.142:0/248607448 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2568099290 con 0x7f2578073b30 2023-09-21T12:55:14.964 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:14.964 INFO:teuthology.orchestra.run.smithi142.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-21T12:55:14.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.966+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 msgr2=0x7f25640a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:14.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.966+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 0x7f25640a2c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f257400b2e0 tx=0x7f2574005fd0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.966+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 msgr2=0x7f2578199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:14.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.966+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f256800e9a0 tx=0x7f256800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 shutdown_connections 2023-09-21T12:55:14.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25640a0750 0x7f25640a2c10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f257810d640 0x7f257819daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2578073210 0x7f2578199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 --2- 172.21.15.142:0/248607448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2578073b30 0x7f2578199680 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:14.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 >> 172.21.15.142:0/248607448 conn(0x7f25780fc8d0 msgr2=0x7f257810f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:14.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 shutdown_connections 2023-09-21T12:55:14.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:14.967+0000 7f257faf2700 1 -- 172.21.15.142:0/248607448 wait complete. 2023-09-21T12:55:15.621 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-09-21T12:55:15.622 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 -- 172.21.15.142:0/3394008630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0074e20 msgr2=0x7ffaf0073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/3394008630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0074e20 0x7ffaf0073270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffae00098f0 tx=0x7ffae0009c00 comp rx=0 tx=0).stop 2023-09-21T12:55:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 -- 172.21.15.142:0/3394008630 shutdown_connections 2023-09-21T12:55:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/3394008630 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0108cb0 0x7ffaf010b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/3394008630 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0074e20 0x7ffaf0073270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/3394008630 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0073840 0x7ffaf0073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 -- 172.21.15.142:0/3394008630 >> 172.21.15.142:0/3394008630 conn(0x7ffaf00fc320 msgr2=0x7ffaf00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 -- 172.21.15.142:0/3394008630 shutdown_connections 2023-09-21T12:55:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.833+0000 7ffaf55ff700 1 -- 172.21.15.142:0/3394008630 wait complete. 2023-09-21T12:55:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.834+0000 7ffaf55ff700 1 Processor -- start 2023-09-21T12:55:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 -- start start 2023-09-21T12:55:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 0x7ffaf0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 0x7ffaf01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01a0890 con 0x7ffaf0074e20 2023-09-21T12:55:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01a0a00 con 0x7ffaf0073840 2023-09-21T12:55:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaf55ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf01a0bc0 con 0x7ffaf0108cb0 2023-09-21T12:55:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaeeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 0x7ffaf0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38352/0 (socket says 172.21.15.142:38352) 2023-09-21T12:55:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffae7fff700 1 -- 172.21.15.142:0/2441812075 learned_addr learned my addr 172.21.15.142:0/2441812075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.835+0000 7ffaef7fe700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 0x7ffaf01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 -- 172.21.15.142:0/2441812075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 msgr2=0x7ffaf01a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 0x7ffaf01a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 -- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 msgr2=0x7ffaf0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:15.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 -- 172.21.15.142:0/2441812075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad80095f0 con 0x7ffaf0073840 2023-09-21T12:55:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaef7fe700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 0x7ffaf01a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:55:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffae7fff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaeeffd700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 0x7ffaf0198d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae000b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:15.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae001c070 con 0x7ffaf0073840 2023-09-21T12:55:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffae000f7d0 con 0x7ffaf0073840 2023-09-21T12:55:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffae8009c40 con 0x7ffaf0073840 2023-09-21T12:55:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0003a40 con 0x7ffaf0073840 2023-09-21T12:55:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.836+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae0009520 con 0x7ffaf0073840 2023-09-21T12:55:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.838+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf0107360 con 0x7ffaf0073840 2023-09-21T12:55:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.839+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7ffae0020030 con 0x7ffaf0073840 2023-09-21T12:55:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.840+0000 7ffaecff9700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 0x7ffadc0a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.841+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffae00ccce0 con 0x7ffaf0073840 2023-09-21T12:55:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.841+0000 7ffae7fff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 0x7ffadc0a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.841+0000 7ffae7fff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 0x7ffadc0a2c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005950 tx=0x7ffad8009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:15.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:15.844+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ffae00966f0 con 0x7ffaf0073840 2023-09-21T12:55:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:15 smithi142 ceph-mon[97663]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:15 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/248607448' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-21T12:55:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:15 smithi160 ceph-mon[134450]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:15 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/248607448' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-21T12:55:16.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.061+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf010e7e0 con 0x7ffaf0073840 2023-09-21T12:55:16.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.062+0000 7ffaecff9700 1 -- 172.21.15.142:0/2441812075 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7ffae0099d10 con 0x7ffaf0073840 2023-09-21T12:55:16.062 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:16.063 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:16.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 msgr2=0x7ffadc0a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 0x7ffadc0a2c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffad8005950 tx=0x7ffad8009310 comp rx=0 tx=0).stop 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 msgr2=0x7ffaf0198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 0x7ffaf0198d50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffae0000c00 tx=0x7ffae000b790 comp rx=0 tx=0).stop 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 shutdown_connections 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffadc0a0790 0x7ffadc0a2c50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffaf0108cb0 0x7ffaf01a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffaf0073840 0x7ffaf0198d50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 --2- 172.21.15.142:0/2441812075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffaf0074e20 0x7ffaf0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 >> 172.21.15.142:0/2441812075 conn(0x7ffaf00fc320 msgr2=0x7ffaf00fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 shutdown_connections 2023-09-21T12:55:16.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.065+0000 7ffaf55ff700 1 -- 172.21.15.142:0/2441812075 wait complete. 2023-09-21T12:55:16.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:16.084 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:16.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:15 smithi156 ceph-mon[134078]: pgmap v303: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:16.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:15 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/248607448' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-21T12:55:16.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 -- 172.21.15.142:0/3110352523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260074e20 msgr2=0x7fa260073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 --2- 172.21.15.142:0/3110352523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260074e20 0x7fa260073270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa250009990 tx=0x7fa250009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 -- 172.21.15.142:0/3110352523 shutdown_connections 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 --2- 172.21.15.142:0/3110352523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260074e20 0x7fa260073270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 --2- 172.21.15.142:0/3110352523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260108cb0 0x7fa26010b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 --2- 172.21.15.142:0/3110352523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260073840 0x7fa260073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.295+0000 7fa264dff700 1 -- 172.21.15.142:0/3110352523 >> 172.21.15.142:0/3110352523 conn(0x7fa2600fc360 msgr2=0x7fa2600fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:16.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.296+0000 7fa264dff700 1 -- 172.21.15.142:0/3110352523 shutdown_connections 2023-09-21T12:55:16.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.296+0000 7fa264dff700 1 -- 172.21.15.142:0/3110352523 wait complete. 2023-09-21T12:55:16.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.296+0000 7fa264dff700 1 Processor -- start 2023-09-21T12:55:16.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 -- start start 2023-09-21T12:55:16.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 0x7fa260198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 0x7fa260199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260108cb0 0x7fa2601a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601a0880 con 0x7fa260073840 2023-09-21T12:55:16.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601a09f0 con 0x7fa260074e20 2023-09-21T12:55:16.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa264dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601a0bb0 con 0x7fa260108cb0 2023-09-21T12:55:16.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa25e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 0x7fa260198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa25dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 0x7fa260199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa25e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 0x7fa260198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38376/0 (socket says 172.21.15.142:38376) 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa25e59c700 1 -- 172.21.15.142:0/984361017 learned_addr learned my addr 172.21.15.142:0/984361017 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.297+0000 7fa25ed9d700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260108cb0 0x7fa2601a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 -- 172.21.15.142:0/984361017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260108cb0 msgr2=0x7fa2601a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260108cb0 0x7fa2601a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 -- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 msgr2=0x7fa260198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 0x7fa260198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 -- 172.21.15.142:0/984361017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2500095f0 con 0x7fa260074e20 2023-09-21T12:55:16.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa25dd9b700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 0x7fa260199280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e9c0 tx=0x7fa25400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:16.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254004220 con 0x7fa260074e20 2023-09-21T12:55:16.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa254004380 con 0x7fa260074e20 2023-09-21T12:55:16.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2601a0e90 con 0x7fa260074e20 2023-09-21T12:55:16.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254003be0 con 0x7fa260074e20 2023-09-21T12:55:16.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.298+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2601a1310 con 0x7fa260074e20 2023-09-21T12:55:16.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.299+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa260107360 con 0x7fa260074e20 2023-09-21T12:55:16.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.301+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fa254003d40 con 0x7fa260074e20 2023-09-21T12:55:16.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.303+0000 7fa24f7fe700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 0x7fa2480a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.303+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa254014070 con 0x7fa260074e20 2023-09-21T12:55:16.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.303+0000 7fa25e59c700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 0x7fa2480a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.304+0000 7fa25e59c700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 0x7fa2480a2c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa25000b2e0 tx=0x7fa250005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:16.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.304+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa254095bc0 con 0x7fa260074e20 2023-09-21T12:55:16.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.535+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa26010ea80 con 0x7fa260074e20 2023-09-21T12:55:16.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.536+0000 7fa24f7fe700 1 -- 172.21.15.142:0/984361017 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa2540991e0 con 0x7fa260074e20 2023-09-21T12:55:16.535 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:16.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 msgr2=0x7fa2480a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 0x7fa2480a2c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa25000b2e0 tx=0x7fa250005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 msgr2=0x7fa260199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 0x7fa260199280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e9c0 tx=0x7fa25400ecd0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 shutdown_connections 2023-09-21T12:55:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa2480a0750 0x7fa2480a2c10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa260073840 0x7fa260198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa260108cb0 0x7fa2601a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 --2- 172.21.15.142:0/984361017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa260074e20 0x7fa260199280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 >> 172.21.15.142:0/984361017 conn(0x7fa2600fc360 msgr2=0x7fa2600fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:16.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 shutdown_connections 2023-09-21T12:55:16.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.539+0000 7fa264dff700 1 -- 172.21.15.142:0/984361017 wait complete. 2023-09-21T12:55:16.560 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:16.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 -- 172.21.15.142:0/2441909603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700103000 msgr2=0x7f6700103420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 --2- 172.21.15.142:0/2441909603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700103000 0x7f6700103420 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f66f0009990 tx=0x7f66f0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 -- 172.21.15.142:0/2441909603 shutdown_connections 2023-09-21T12:55:16.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 --2- 172.21.15.142:0/2441909603 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6700104b90 0x7f670010b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 --2- 172.21.15.142:0/2441909603 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700103000 0x7f6700103420 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 --2- 172.21.15.142:0/2441909603 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f67001041f0 0x7f6700104650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 -- 172.21.15.142:0/2441909603 >> 172.21.15.142:0/2441909603 conn(0x7f67000fe590 msgr2=0x7f67001009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:16.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 -- 172.21.15.142:0/2441909603 shutdown_connections 2023-09-21T12:55:16.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.770+0000 7f6704dff700 1 -- 172.21.15.142:0/2441909603 wait complete. 2023-09-21T12:55:16.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 Processor -- start 2023-09-21T12:55:16.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 -- start start 2023-09-21T12:55:16.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700103000 0x7f6700198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700104b90 0x7f67001a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001a08c0 con 0x7f6700103000 2023-09-21T12:55:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001a0a00 con 0x7f67001041f0 2023-09-21T12:55:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.772+0000 7f6704dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67001a0b90 con 0x7f6700104b90 2023-09-21T12:55:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60192/0 (socket says 172.21.15.142:60192) 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 -- 172.21.15.142:0/73663277 learned_addr learned my addr 172.21.15.142:0/73663277 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fe59c700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700103000 0x7f6700198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 -- 172.21.15.142:0/73663277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700104b90 msgr2=0x7f67001a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700104b90 0x7f67001a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 -- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700103000 msgr2=0x7f6700198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700103000 0x7f6700198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 -- 172.21.15.142:0/73663277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f4009520 con 0x7f67001041f0 2023-09-21T12:55:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66fdd9b700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66f400eb30 tx=0x7f66f400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4009880 con 0x7f67001041f0 2023-09-21T12:55:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66f40044e0 con 0x7f67001041f0 2023-09-21T12:55:16.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f00095f0 con 0x7f67001041f0 2023-09-21T12:55:16.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.773+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f4003df0 con 0x7f67001041f0 2023-09-21T12:55:16.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.774+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67001a11e0 con 0x7f67001041f0 2023-09-21T12:55:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.775+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6700109f80 con 0x7f67001041f0 2023-09-21T12:55:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.776+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f66f4003f50 con 0x7f67001041f0 2023-09-21T12:55:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.779+0000 7f66ef7fe700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 0x7f66e80a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.779+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66f4014070 con 0x7f67001041f0 2023-09-21T12:55:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.780+0000 7f66fe59c700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 0x7f66e80a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.781+0000 7f66fe59c700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 0x7f66e80a2c10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b2e0 tx=0x7f66f0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:16.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.784+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f66f4095a30 con 0x7f67001041f0 2023-09-21T12:55:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:16 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2441812075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:16 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/984361017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:16 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2441812075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:16 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/984361017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:16.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.998+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f670010e860 con 0x7f67001041f0 2023-09-21T12:55:16.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:16.999+0000 7f66ef7fe700 1 -- 172.21.15.142:0/73663277 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66f4099050 con 0x7f67001041f0 2023-09-21T12:55:16.999 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:55:17.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.001+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 msgr2=0x7f66e80a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.001+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 0x7f66e80a2c10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f66f000b2e0 tx=0x7f66f0005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.001+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 msgr2=0x7f6700199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.001+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f66f400eb30 tx=0x7f66f400ee40 comp rx=0 tx=0).stop 2023-09-21T12:55:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 shutdown_connections 2023-09-21T12:55:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f66e80a0750 0x7f66e80a2c10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6700103000 0x7f6700198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6700104b90 0x7f67001a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 --2- 172.21.15.142:0/73663277 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f67001041f0 0x7f6700199280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 >> 172.21.15.142:0/73663277 conn(0x7f67000fe590 msgr2=0x7f6700100810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:17.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 shutdown_connections 2023-09-21T12:55:17.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.002+0000 7f6704dff700 1 -- 172.21.15.142:0/73663277 wait complete. 2023-09-21T12:55:17.020 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:55:17.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:16 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2441812075' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:17.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:16 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/984361017' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:17.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 -- 172.21.15.142:0/752639270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8100dd0 msgr2=0x7fb9d81011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/752639270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8100dd0 0x7fb9d81011f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4009990 tx=0x7fb9d4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 -- 172.21.15.142:0/752639270 shutdown_connections 2023-09-21T12:55:17.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/752639270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8102960 0x7fb9d8109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/752639270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8100dd0 0x7fb9d81011f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/752639270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 0x7fb9d8102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 -- 172.21.15.142:0/752639270 >> 172.21.15.142:0/752639270 conn(0x7fb9d80fc360 msgr2=0x7fb9d80fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:17.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 -- 172.21.15.142:0/752639270 shutdown_connections 2023-09-21T12:55:17.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.242+0000 7fb9e03ff700 1 -- 172.21.15.142:0/752639270 wait complete. 2023-09-21T12:55:17.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.243+0000 7fb9e03ff700 1 Processor -- start 2023-09-21T12:55:17.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.243+0000 7fb9e03ff700 1 -- start start 2023-09-21T12:55:17.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8100dd0 0x7fb9d8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 0x7fb9d8199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81a0880 con 0x7fb9d8100dd0 2023-09-21T12:55:17.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81a09f0 con 0x7fb9d8101fc0 2023-09-21T12:55:17.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9e03ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d81a0bb0 con 0x7fb9d8102960 2023-09-21T12:55:17.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8100dd0 0x7fb9d8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9dd99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 0x7fb9d8199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35984/0 (socket says 172.21.15.142:35984) 2023-09-21T12:55:17.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 -- 172.21.15.142:0/401730647 learned_addr learned my addr 172.21.15.142:0/401730647 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:17.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 -- 172.21.15.142:0/401730647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 msgr2=0x7fb9d8199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 0x7fb9d8199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 -- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8100dd0 msgr2=0x7fb9d8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8100dd0 0x7fb9d8198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.244+0000 7fb9de99c700 1 -- 172.21.15.142:0/401730647 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40095f0 con 0x7fb9d8102960 2023-09-21T12:55:17.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9de99c700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000ef30 tx=0x7fb9d000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:17.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0018070 con 0x7fb9d8102960 2023-09-21T12:55:17.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9d000f040 con 0x7fb9d8102960 2023-09-21T12:55:17.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d81a0e30 con 0x7fb9d8102960 2023-09-21T12:55:17.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000cd00 con 0x7fb9d8102960 2023-09-21T12:55:17.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.245+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d81a1250 con 0x7fb9d8102960 2023-09-21T12:55:17.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.246+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d8193420 con 0x7fb9d8102960 2023-09-21T12:55:17.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.248+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fb9d0003a00 con 0x7fb9d8102960 2023-09-21T12:55:17.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.249+0000 7fb9cf7fe700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 0x7fb9c40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.249+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb9d00cbfa0 con 0x7fb9d8102960 2023-09-21T12:55:17.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.249+0000 7fb9de19b700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 0x7fb9c40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.250+0000 7fb9de19b700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 0x7fb9c40a2b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000c00 tx=0x7fb9d4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:17.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.251+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb9d0095a10 con 0x7fb9d8102960 2023-09-21T12:55:17.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.462+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9d810c880 con 0x7fb9d8102960 2023-09-21T12:55:17.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.463+0000 7fb9cf7fe700 1 -- 172.21.15.142:0/401730647 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9d0005020 con 0x7fb9d8102960 2023-09-21T12:55:17.463 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:55:17.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 msgr2=0x7fb9c40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 0x7fb9c40a2b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb9d4000c00 tx=0x7fb9d4005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 msgr2=0x7fb9d81a02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9d000ef30 tx=0x7fb9d000c3a0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 shutdown_connections 2023-09-21T12:55:17.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9c40a06d0 0x7fb9c40a2b90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9d8100dd0 0x7fb9d8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9d8102960 0x7fb9d81a02b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 --2- 172.21.15.142:0/401730647 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9d8101fc0 0x7fb9d8199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.465+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 >> 172.21.15.142:0/401730647 conn(0x7fb9d80fc360 msgr2=0x7fb9d81078e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:17.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.466+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 shutdown_connections 2023-09-21T12:55:17.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.466+0000 7fb9e03ff700 1 -- 172.21.15.142:0/401730647 wait complete. 2023-09-21T12:55:17.484 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:55:17.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 -- 172.21.15.142:0/1600955263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 msgr2=0x7f82f4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/1600955263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4101210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009990 tx=0x7f82f0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 -- 172.21.15.142:0/1600955263 shutdown_connections 2023-09-21T12:55:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/1600955263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 0x7f82f4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/1600955263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4101210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/1600955263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 0x7f82f4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 -- 172.21.15.142:0/1600955263 >> 172.21.15.142:0/1600955263 conn(0x7f82f40fc320 msgr2=0x7f82f40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 -- 172.21.15.142:0/1600955263 shutdown_connections 2023-09-21T12:55:17.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.697+0000 7f82fc5ff700 1 -- 172.21.15.142:0/1600955263 wait complete. 2023-09-21T12:55:17.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.698+0000 7f82fc5ff700 1 Processor -- start 2023-09-21T12:55:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.698+0000 7f82fc5ff700 1 -- start start 2023-09-21T12:55:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.698+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.698+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 0x7f82f4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fc5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 0x7f82f41a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41a0840 con 0x7f82f4102980 2023-09-21T12:55:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41a09b0 con 0x7f82f4101fe0 2023-09-21T12:55:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fc5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f41a0b70 con 0x7f82f4100df0 2023-09-21T12:55:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 0x7f82f41a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36010/0 (socket says 172.21.15.142:36010) 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 -- 172.21.15.142:0/3737640858 learned_addr learned my addr 172.21.15.142:0/3737640858 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82f9b9a700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 0x7f82f4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 -- 172.21.15.142:0/3737640858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 msgr2=0x7f82f4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 0x7f82f4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 -- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 msgr2=0x7f82f41a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 0x7f82f41a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 -- 172.21.15.142:0/3737640858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f00095f0 con 0x7f82f4100df0 2023-09-21T12:55:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.699+0000 7f82fa39b700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82f0005720 tx=0x7f82f0009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.700+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f001d070 con 0x7f82f4100df0 2023-09-21T12:55:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.700+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82f0021410 con 0x7f82f4100df0 2023-09-21T12:55:17.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.700+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0017650 con 0x7f82f4100df0 2023-09-21T12:55:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.700+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f41a0df0 con 0x7f82f4100df0 2023-09-21T12:55:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.700+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f41a11c0 con 0x7f82f4100df0 2023-09-21T12:55:17.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.701+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f410c650 con 0x7f82f4100df0 2023-09-21T12:55:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.703+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f82f0021580 con 0x7f82f4100df0 2023-09-21T12:55:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.704+0000 7f82eb7fe700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 0x7f82e00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:17.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.704+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f82f00ccff0 con 0x7f82f4100df0 2023-09-21T12:55:17.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.704+0000 7f82f9b9a700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 0x7f82e00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:17.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.705+0000 7f82f9b9a700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 0x7f82e00a2bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009bf0 tx=0x7f82e4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:17.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.707+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f82f0096b40 con 0x7f82f4100df0 2023-09-21T12:55:17.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:17.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/73663277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:17 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/401730647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:17.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/73663277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:17.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:17 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/401730647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:17.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.974+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82f41a1350 con 0x7f82f4100df0 2023-09-21T12:55:17.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.975+0000 7f82eb7fe700 1 -- 172.21.15.142:0/3737640858 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f82f0026090 con 0x7f82f4100df0 2023-09-21T12:55:17.975 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:17.975 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:55:17.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 msgr2=0x7f82e00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 0x7f82e00a2bd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009bf0 tx=0x7f82e4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:17.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 msgr2=0x7f82f4198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:17.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82f0005720 tx=0x7f82f0009580 comp rx=0 tx=0).stop 2023-09-21T12:55:17.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 shutdown_connections 2023-09-21T12:55:17.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f82e00a0710 0x7f82e00a2bd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f82f4102980 0x7f82f41a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82f4100df0 0x7f82f4198d00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 --2- 172.21.15.142:0/3737640858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f82f4101fe0 0x7f82f4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:17.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 >> 172.21.15.142:0/3737640858 conn(0x7f82f40fc320 msgr2=0x7f82f40fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:17.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 shutdown_connections 2023-09-21T12:55:17.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:17.978+0000 7f82fc5ff700 1 -- 172.21.15.142:0/3737640858 wait complete. 2023-09-21T12:55:17.980 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:17.997 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:18.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: pgmap v304: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:18.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/73663277' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:18.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:17 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/401730647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:18.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 -- 172.21.15.142:0/2269181823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 msgr2=0x7f60e8100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 --2- 172.21.15.142:0/2269181823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8100390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009990 tx=0x7f60dc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 -- 172.21.15.142:0/2269181823 shutdown_connections 2023-09-21T12:55:18.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 --2- 172.21.15.142:0/2269181823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 0x7f60e8108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 --2- 172.21.15.142:0/2269181823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 0x7f60e8101770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.227+0000 7f60edfff700 1 --2- 172.21.15.142:0/2269181823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8100390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.228+0000 7f60edfff700 1 -- 172.21.15.142:0/2269181823 >> 172.21.15.142:0/2269181823 conn(0x7f60e80fa9a0 msgr2=0x7f60e80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:18.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.228+0000 7f60edfff700 1 -- 172.21.15.142:0/2269181823 shutdown_connections 2023-09-21T12:55:18.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.228+0000 7f60edfff700 1 -- 172.21.15.142:0/2269181823 wait complete. 2023-09-21T12:55:18.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 Processor -- start 2023-09-21T12:55:18.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 -- start start 2023-09-21T12:55:18.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 0x7f60e8196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 0x7f60e819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e819e5c0 con 0x7f60e80fff10 2023-09-21T12:55:18.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e819e700 con 0x7f60e8101350 2023-09-21T12:55:18.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60edfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e819e890 con 0x7f60e81008d0 2023-09-21T12:55:18.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60e77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38454/0 (socket says 172.21.15.142:38454) 2023-09-21T12:55:18.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.229+0000 7f60e77fe700 1 -- 172.21.15.142:0/472901454 learned_addr learned my addr 172.21.15.142:0/472901454 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:18.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e7fff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 0x7f60e819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e6ffd700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 0x7f60e8196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 -- 172.21.15.142:0/472901454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 msgr2=0x7f60e8196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 0x7f60e8196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 -- 172.21.15.142:0/472901454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 msgr2=0x7f60e819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 0x7f60e819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 -- 172.21.15.142:0/472901454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0095f0 con 0x7f60e80fff10 2023-09-21T12:55:18.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e77fe700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60d800e9a0 tx=0x7f60d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:18.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8009790 con 0x7f60e80fff10 2023-09-21T12:55:18.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60d800cbd0 con 0x7f60e80fff10 2023-09-21T12:55:18.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e8108b80 con 0x7f60e80fff10 2023-09-21T12:55:18.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60d8018680 con 0x7f60e80fff10 2023-09-21T12:55:18.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.230+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e81090e0 con 0x7f60e80fff10 2023-09-21T12:55:18.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.232+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e810c5e0 con 0x7f60e80fff10 2023-09-21T12:55:18.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.234+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f60d800cd40 con 0x7f60e80fff10 2023-09-21T12:55:18.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.235+0000 7f60e4ff9700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 0x7f60d00a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.235+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60d8014070 con 0x7f60e80fff10 2023-09-21T12:55:18.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.235+0000 7f60e6ffd700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 0x7f60d00a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.236+0000 7f60e6ffd700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 0x7f60d00a2c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60dc006010 tx=0x7f60dc00b260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:18.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.239+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f60d8051e10 con 0x7f60e80fff10 2023-09-21T12:55:18.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.449+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60e810c7d0 con 0x7f60e80fff10 2023-09-21T12:55:18.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.450+0000 7f60e4ff9700 1 -- 172.21.15.142:0/472901454 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f60d8095960 con 0x7f60e80fff10 2023-09-21T12:55:18.450 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:18.451 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:18.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 msgr2=0x7f60d00a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 0x7f60d00a2c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f60dc006010 tx=0x7f60dc00b260 comp rx=0 tx=0).stop 2023-09-21T12:55:18.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 msgr2=0x7f60e8196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f60d800e9a0 tx=0x7f60d800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 shutdown_connections 2023-09-21T12:55:18.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f60d00a0790 0x7f60d00a2c50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60e80fff10 0x7f60e8196a40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60e8101350 0x7f60e819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 --2- 172.21.15.142:0/472901454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60e81008d0 0x7f60e8196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 >> 172.21.15.142:0/472901454 conn(0x7f60e80fa9a0 msgr2=0x7f60e80fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:18.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 shutdown_connections 2023-09-21T12:55:18.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.454+0000 7f60edfff700 1 -- 172.21.15.142:0/472901454 wait complete. 2023-09-21T12:55:18.474 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:18.475 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:18.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 -- 172.21.15.142:0/168084102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548102960 msgr2=0x7f3548109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 --2- 172.21.15.142:0/168084102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548102960 0x7f3548109210 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f354000b0d0 tx=0x7f354000b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 -- 172.21.15.142:0/168084102 shutdown_connections 2023-09-21T12:55:18.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 --2- 172.21.15.142:0/168084102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548102960 0x7f3548109210 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 --2- 172.21.15.142:0/168084102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548100dd0 0x7f35481011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 --2- 172.21.15.142:0/168084102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548101fc0 0x7f3548102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 -- 172.21.15.142:0/168084102 >> 172.21.15.142:0/168084102 conn(0x7f35480fc320 msgr2=0x7f35480fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:18.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 -- 172.21.15.142:0/168084102 shutdown_connections 2023-09-21T12:55:18.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.683+0000 7f35507ff700 1 -- 172.21.15.142:0/168084102 wait complete. 2023-09-21T12:55:18.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 Processor -- start 2023-09-21T12:55:18.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 -- start start 2023-09-21T12:55:18.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 0x7f3548196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 0x7f3548197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548102960 0x7f354819e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354819e770 con 0x7f3548100dd0 2023-09-21T12:55:18.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354819e8b0 con 0x7f3548102960 2023-09-21T12:55:18.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.684+0000 7f35507ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354819ea40 con 0x7f3548101fc0 2023-09-21T12:55:18.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 0x7f3548196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 0x7f3548197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 0x7f3548196bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38472/0 (socket says 172.21.15.142:38472) 2023-09-21T12:55:18.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354e59b700 1 -- 172.21.15.142:0/1103679671 learned_addr learned my addr 172.21.15.142:0/1103679671 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:18.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354ed9c700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548102960 0x7f354819e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 -- 172.21.15.142:0/1103679671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548102960 msgr2=0x7f354819e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548102960 0x7f354819e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 -- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 msgr2=0x7f3548196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 0x7f3548196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 -- 172.21.15.142:0/1103679671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009d00 con 0x7f3548101fc0 2023-09-21T12:55:18.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.685+0000 7f354dd9a700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 0x7f3548197130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f353800e9f0 tx=0x7f353800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:18.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.686+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353800c9c0 con 0x7f3548101fc0 2023-09-21T12:55:18.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.686+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3538010430 con 0x7f3548101fc0 2023-09-21T12:55:18.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.686+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354819ed20 con 0x7f3548101fc0 2023-09-21T12:55:18.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.686+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538018680 con 0x7f3548101fc0 2023-09-21T12:55:18.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.686+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354819f1d0 con 0x7f3548101fc0 2023-09-21T12:55:18.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.687+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354810c640 con 0x7f3548101fc0 2023-09-21T12:55:18.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.689+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f3538010860 con 0x7f3548101fc0 2023-09-21T12:55:18.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.690+0000 7f353f7fe700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 0x7f35340a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:18.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.690+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3538014070 con 0x7f3548101fc0 2023-09-21T12:55:18.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.690+0000 7f354e59b700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 0x7f35340a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:18.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.691+0000 7f354e59b700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 0x7f35340a2b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3544005950 tx=0x7f3544009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:18.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.694+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3538051e10 con 0x7f3548101fc0 2023-09-21T12:55:18.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.901+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3548107cb0 con 0x7f3548101fc0 2023-09-21T12:55:18.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.902+0000 7f353f7fe700 1 -- 172.21.15.142:0/1103679671 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3538095810 con 0x7f3548101fc0 2023-09-21T12:55:18.902 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:18.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.904+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 msgr2=0x7f35340a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.904+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 0x7f35340a2b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3544005950 tx=0x7f3544009260 comp rx=0 tx=0).stop 2023-09-21T12:55:18.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.904+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 msgr2=0x7f3548197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:18.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.904+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 0x7f3548197130 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f353800e9f0 tx=0x7f353800ed00 comp rx=0 tx=0).stop 2023-09-21T12:55:18.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 shutdown_connections 2023-09-21T12:55:18.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f35340a06d0 0x7f35340a2b90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3548100dd0 0x7f3548196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3548102960 0x7f354819e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 --2- 172.21.15.142:0/1103679671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3548101fc0 0x7f3548197130 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:18.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 >> 172.21.15.142:0/1103679671 conn(0x7f35480fc320 msgr2=0x7f35480fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:18.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 shutdown_connections 2023-09-21T12:55:18.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:18.905+0000 7f35507ff700 1 -- 172.21.15.142:0/1103679671 wait complete. 2023-09-21T12:55:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:18 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3737640858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:18 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:18 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/472901454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:18.923 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:18 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3737640858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:18 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:18 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/472901454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 -- 172.21.15.142:0/2506083993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 msgr2=0x7f93980731f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 --2- 172.21.15.142:0/2506083993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93980731f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9388009990 tx=0x7f9388009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 -- 172.21.15.142:0/2506083993 shutdown_connections 2023-09-21T12:55:19.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 --2- 172.21.15.142:0/2506083993 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9398108cc0 0x7f939810b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 --2- 172.21.15.142:0/2506083993 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93980731f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 --2- 172.21.15.142:0/2506083993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93980737c0 0x7f9398073c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 -- 172.21.15.142:0/2506083993 >> 172.21.15.142:0/2506083993 conn(0x7f93980fc360 msgr2=0x7f93980fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:19.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 -- 172.21.15.142:0/2506083993 shutdown_connections 2023-09-21T12:55:19.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.133+0000 7f939d7ff700 1 -- 172.21.15.142:0/2506083993 wait complete. 2023-09-21T12:55:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.134+0000 7f939d7ff700 1 Processor -- start 2023-09-21T12:55:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 -- start start 2023-09-21T12:55:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93981991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9398108cc0 0x7f93981a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981a0810 con 0x7f93980737c0 2023-09-21T12:55:19.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981a0980 con 0x7f9398074da0 2023-09-21T12:55:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f939d7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93981a0b40 con 0x7f9398108cc0 2023-09-21T12:55:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f9396ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f93967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93981991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f93967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93981991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60266/0 (socket says 172.21.15.142:60266) 2023-09-21T12:55:19.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f93967fc700 1 -- 172.21.15.142:0/859220858 learned_addr learned my addr 172.21.15.142:0/859220858 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:19.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f9396ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38484/0 (socket says 172.21.15.142:38484) 2023-09-21T12:55:19.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f93977fe700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9398108cc0 0x7f93981a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f9396ffd700 1 -- 172.21.15.142:0/859220858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9398108cc0 msgr2=0x7f93981a0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f9396ffd700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9398108cc0 0x7f93981a0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.135+0000 7f9396ffd700 1 -- 172.21.15.142:0/859220858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 msgr2=0x7f93981991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f9396ffd700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93981991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f9396ffd700 1 -- 172.21.15.142:0/859220858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93880095f0 con 0x7f93980737c0 2023-09-21T12:55:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f9396ffd700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f938800b680 tx=0x7f9388009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938801d070 con 0x7f93980737c0 2023-09-21T12:55:19.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93981a0dc0 con 0x7f93980737c0 2023-09-21T12:55:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9388021410 con 0x7f93980737c0 2023-09-21T12:55:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388017650 con 0x7f93980737c0 2023-09-21T12:55:19.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.136+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93981a1190 con 0x7f93980737c0 2023-09-21T12:55:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.138+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93981073c0 con 0x7f93980737c0 2023-09-21T12:55:19.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.139+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f9388021810 con 0x7f93980737c0 2023-09-21T12:55:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.141+0000 7f937ffff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 0x7f93800a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.141+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f93880cd110 con 0x7f93980737c0 2023-09-21T12:55:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.141+0000 7f93967fc700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 0x7f93800a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.141+0000 7f93967fc700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 0x7f93800a2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f939819a1a0 tx=0x7f938c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:19.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.144+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9388096b20 con 0x7f93980737c0 2023-09-21T12:55:19.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:18 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3737640858' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:19.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:18 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:19.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:18 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/472901454' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:19.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.374+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f939810e9c0 con 0x7f93980737c0 2023-09-21T12:55:19.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.375+0000 7f937ffff700 1 -- 172.21.15.142:0/859220858 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f938809a140 con 0x7f93980737c0 2023-09-21T12:55:19.375 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:55:19.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 msgr2=0x7f93800a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 0x7f93800a2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f939819a1a0 tx=0x7f938c009260 comp rx=0 tx=0).stop 2023-09-21T12:55:19.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 msgr2=0x7f9398198ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f938800b680 tx=0x7f9388009580 comp rx=0 tx=0).stop 2023-09-21T12:55:19.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 shutdown_connections 2023-09-21T12:55:19.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f93800a06d0 0x7f93800a2b90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f93980737c0 0x7f9398198ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9398108cc0 0x7f93981a0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 --2- 172.21.15.142:0/859220858 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9398074da0 0x7f93981991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 >> 172.21.15.142:0/859220858 conn(0x7f93980fc360 msgr2=0x7f93980fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:19.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.377+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 shutdown_connections 2023-09-21T12:55:19.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.378+0000 7f939d7ff700 1 -- 172.21.15.142:0/859220858 wait complete. 2023-09-21T12:55:19.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:55:19.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 -- 172.21.15.142:0/2743921505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0102960 msgr2=0x7f7cc0109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/2743921505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0102960 0x7f7cc0109210 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7cb800b0d0 tx=0x7f7cb800b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 -- 172.21.15.142:0/2743921505 shutdown_connections 2023-09-21T12:55:19.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/2743921505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0102960 0x7f7cc0109210 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/2743921505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0100dd0 0x7f7cc01011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/2743921505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 0x7f7cc0102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 -- 172.21.15.142:0/2743921505 >> 172.21.15.142:0/2743921505 conn(0x7f7cc00fc320 msgr2=0x7f7cc00fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:19.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 -- 172.21.15.142:0/2743921505 shutdown_connections 2023-09-21T12:55:19.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.602+0000 7f7cc5fff700 1 -- 172.21.15.142:0/2743921505 wait complete. 2023-09-21T12:55:19.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.603+0000 7f7cc5fff700 1 Processor -- start 2023-09-21T12:55:19.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.603+0000 7f7cc5fff700 1 -- start start 2023-09-21T12:55:19.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 0x7f7cc00731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0102960 0x7f7cc0073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0073eb0 con 0x7f7cc0100dd0 2023-09-21T12:55:19.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0074020 con 0x7f7cc0102960 2023-09-21T12:55:19.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cc5fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc01a0bf0 con 0x7f7cc0101fc0 2023-09-21T12:55:19.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 0x7f7cc00731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38488/0 (socket says 172.21.15.142:38488) 2023-09-21T12:55:19.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 -- 172.21.15.142:0/1184867520 learned_addr learned my addr 172.21.15.142:0/1184867520 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:19.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbffff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0102960 0x7f7cc0073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 -- 172.21.15.142:0/1184867520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 msgr2=0x7f7cc00731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 0x7f7cc00731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 -- 172.21.15.142:0/1184867520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0102960 msgr2=0x7f7cc0073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0102960 0x7f7cc0073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.604+0000 7f7cbf7fe700 1 -- 172.21.15.142:0/1184867520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0009520 con 0x7f7cc0100dd0 2023-09-21T12:55:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cbf7fe700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ea50 tx=0x7f7cb000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb000cbd0 con 0x7f7cc0100dd0 2023-09-21T12:55:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7cb000cd30 con 0x7f7cc0100dd0 2023-09-21T12:55:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0018680 con 0x7f7cc0100dd0 2023-09-21T12:55:19.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb8009d00 con 0x7f7cc0100dd0 2023-09-21T12:55:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.605+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc01a11a0 con 0x7f7cc0100dd0 2023-09-21T12:55:19.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.606+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0108320 con 0x7f7cc0100dd0 2023-09-21T12:55:19.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.608+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f7cb0010430 con 0x7f7cc0100dd0 2023-09-21T12:55:19.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.609+0000 7f7cbcff9700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 0x7f7ca80a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:19.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.609+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7cb0014070 con 0x7f7cc0100dd0 2023-09-21T12:55:19.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.610+0000 7f7cbeffd700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 0x7f7ca80a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:19.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.610+0000 7f7cbeffd700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 0x7f7ca80a2c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009c60 tx=0x7f7cb4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:19.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.613+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7cb0095b40 con 0x7f7cc0100dd0 2023-09-21T12:55:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.817+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7cc010c8a0 con 0x7f7cc0100dd0 2023-09-21T12:55:19.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.818+0000 7f7cbcff9700 1 -- 172.21.15.142:0/1184867520 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7cb0099160 con 0x7f7cc0100dd0 2023-09-21T12:55:19.817 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:55:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.820+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 msgr2=0x7f7ca80a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.820+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 0x7f7ca80a2c10 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4009c60 tx=0x7f7cb4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.820+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 msgr2=0x7f7cc0074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.820+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000ea50 tx=0x7f7cb000ed60 comp rx=0 tx=0).stop 2023-09-21T12:55:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 shutdown_connections 2023-09-21T12:55:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f7ca80a0750 0x7f7ca80a2c10 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7cc0100dd0 0x7f7cc0074b90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7cc0102960 0x7f7cc0073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 --2- 172.21.15.142:0/1184867520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cc0101fc0 0x7f7cc00731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 >> 172.21.15.142:0/1184867520 conn(0x7f7cc00fc320 msgr2=0x7f7cc0105460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 shutdown_connections 2023-09-21T12:55:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:19.821+0000 7f7cc5fff700 1 -- 172.21.15.142:0/1184867520 wait complete. 2023-09-21T12:55:19.839 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:55:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1103679671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:55:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:55:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:19.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:19 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/859220858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 -- 172.21.15.142:0/3976812390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc101fe0 msgr2=0x7f83fc102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 --2- 172.21.15.142:0/3976812390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc101fe0 0x7f83fc102440 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f83f00099c0 tx=0x7f83f0009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 -- 172.21.15.142:0/3976812390 shutdown_connections 2023-09-21T12:55:20.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 --2- 172.21.15.142:0/3976812390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc102980 0x7f83fc109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 --2- 172.21.15.142:0/3976812390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 0x7f83fc101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 --2- 172.21.15.142:0/3976812390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc101fe0 0x7f83fc102440 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 -- 172.21.15.142:0/3976812390 >> 172.21.15.142:0/3976812390 conn(0x7f83fc0fc320 msgr2=0x7f83fc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:20.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 -- 172.21.15.142:0/3976812390 shutdown_connections 2023-09-21T12:55:20.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.037+0000 7f84029ff700 1 -- 172.21.15.142:0/3976812390 wait complete. 2023-09-21T12:55:20.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 Processor -- start 2023-09-21T12:55:20.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 -- start start 2023-09-21T12:55:20.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 0x7f83fc074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc101fe0 0x7f83fc0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc073eb0 con 0x7f83fc102980 2023-09-21T12:55:20.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc074020 con 0x7f83fc101fe0 2023-09-21T12:55:20.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.038+0000 7f84029ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1a0af0 con 0x7f83fc100df0 2023-09-21T12:55:20.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38500/0 (socket says 172.21.15.142:38500) 2023-09-21T12:55:20.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 -- 172.21.15.142:0/4269915118 learned_addr learned my addr 172.21.15.142:0/4269915118 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:20.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f83fb7fe700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc101fe0 0x7f83fc0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f83fbfff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 0x7f83fc074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 -- 172.21.15.142:0/4269915118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 msgr2=0x7f83fc074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 0x7f83fc074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 -- 172.21.15.142:0/4269915118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc101fe0 msgr2=0x7f83fc0731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc101fe0 0x7f83fc0731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 -- 172.21.15.142:0/4269915118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00095f0 con 0x7f83fc102980 2023-09-21T12:55:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f8400f9c700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83f400ef30 tx=0x7f83f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4018070 con 0x7f83fc102980 2023-09-21T12:55:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83f400f040 con 0x7f83fc102980 2023-09-21T12:55:20.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.039+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc1a0d70 con 0x7f83fc102980 2023-09-21T12:55:20.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.040+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400cd00 con 0x7f83fc102980 2023-09-21T12:55:20.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.040+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc1a1220 con 0x7f83fc102980 2023-09-21T12:55:20.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.041+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc10c650 con 0x7f83fc102980 2023-09-21T12:55:20.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.042+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f83f4003a00 con 0x7f83fc102980 2023-09-21T12:55:20.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.044+0000 7f83f97fa700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 0x7f83e40a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.044+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f83f40cb870 con 0x7f83fc102980 2023-09-21T12:55:20.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.044+0000 7f83fbfff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 0x7f83e40a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.045+0000 7f83fbfff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 0x7f83e40a2bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83fc101e40 tx=0x7f83ec009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.048+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f83f4095280 con 0x7f83fc102980 2023-09-21T12:55:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1103679671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:55:20.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:55:20.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:20.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:19 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/859220858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: pgmap v305: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1103679671' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:55:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:55:20.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: from='mgr.14150 172.21.15.142:0/3459719076' entity='mgr.x' 2023-09-21T12:55:20.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:19 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/859220858' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.290+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83fc107c80 con 0x7f83fc102980 2023-09-21T12:55:20.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.291+0000 7f83f97fa700 1 -- 172.21.15.142:0/4269915118 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f83f40988a0 con 0x7f83fc102980 2023-09-21T12:55:20.290 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:20.290 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:55:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 msgr2=0x7f83e40a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 0x7f83e40a2bd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f83fc101e40 tx=0x7f83ec009260 comp rx=0 tx=0).stop 2023-09-21T12:55:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 msgr2=0x7f83fc073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f83f400ef30 tx=0x7f83f400c3a0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 shutdown_connections 2023-09-21T12:55:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f83e40a0710 0x7f83e40a2bd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f83fc102980 0x7f83fc073710 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83fc100df0 0x7f83fc074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 --2- 172.21.15.142:0/4269915118 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f83fc101fe0 0x7f83fc0731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 >> 172.21.15.142:0/4269915118 conn(0x7f83fc0fc320 msgr2=0x7f83fc0fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 shutdown_connections 2023-09-21T12:55:20.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.293+0000 7f84029ff700 1 -- 172.21.15.142:0/4269915118 wait complete. 2023-09-21T12:55:20.295 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:20.312 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:20.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 -- 172.21.15.142:0/3556357648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 msgr2=0x7f5798101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 --2- 172.21.15.142:0/3556357648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798101200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f57880099c0 tx=0x7f5788009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 -- 172.21.15.142:0/3556357648 shutdown_connections 2023-09-21T12:55:20.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 --2- 172.21.15.142:0/3556357648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798101200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 --2- 172.21.15.142:0/3556357648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 0x7f5798109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 --2- 172.21.15.142:0/3556357648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 0x7f5798102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 -- 172.21.15.142:0/3556357648 >> 172.21.15.142:0/3556357648 conn(0x7f57980fc310 msgr2=0x7f57980fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:20.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 -- 172.21.15.142:0/3556357648 shutdown_connections 2023-09-21T12:55:20.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.512+0000 7f579cfff700 1 -- 172.21.15.142:0/3556357648 wait complete. 2023-09-21T12:55:20.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.513+0000 7f579cfff700 1 Processor -- start 2023-09-21T12:55:20.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.513+0000 7f579cfff700 1 -- start start 2023-09-21T12:55:20.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.513+0000 7f579cfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.513+0000 7f579cfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 0x7f5798199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579cfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 0x7f57981a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579cfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a0860 con 0x7f5798100de0 2023-09-21T12:55:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579cfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a09d0 con 0x7f5798102970 2023-09-21T12:55:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579cfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a0b90 con 0x7f5798101fd0 2023-09-21T12:55:20.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38518/0 (socket says 172.21.15.142:38518) 2023-09-21T12:55:20.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 -- 172.21.15.142:0/886842010 learned_addr learned my addr 172.21.15.142:0/886842010 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:20.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f5795d9b700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 0x7f5798199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f5796d9d700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 0x7f57981a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 -- 172.21.15.142:0/886842010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 msgr2=0x7f5798199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 0x7f5798199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 -- 172.21.15.142:0/886842010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 msgr2=0x7f57981a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 0x7f57981a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 -- 172.21.15.142:0/886842010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009c40 con 0x7f5798100de0 2023-09-21T12:55:20.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.514+0000 7f579659c700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5788009990 tx=0x7f578800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.515+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578801d070 con 0x7f5798100de0 2023-09-21T12:55:20.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.515+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57880054f0 con 0x7f5798100de0 2023-09-21T12:55:20.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.515+0000 7f579cfff700 1 -- 172.21.15.142:0/886842010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57880095f0 con 0x7f5798100de0 2023-09-21T12:55:20.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.515+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788004a40 con 0x7f5798100de0 2023-09-21T12:55:20.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.515+0000 7f579cfff700 1 -- 172.21.15.142:0/886842010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57981a10a0 con 0x7f5798100de0 2023-09-21T12:55:20.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.516+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577c0052f0 con 0x7f5798100de0 2023-09-21T12:55:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.518+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f5788004c00 con 0x7f5798100de0 2023-09-21T12:55:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.519+0000 7f57877fe700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 0x7f57800a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.519+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57880cca40 con 0x7f5798100de0 2023-09-21T12:55:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.519+0000 7f5795d9b700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 0x7f57800a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.520+0000 7f5795d9b700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 0x7f57800a2bd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f578c009c60 tx=0x7f578c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.522+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5788096450 con 0x7f5798100de0 2023-09-21T12:55:20.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.727+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f577c005160 con 0x7f5798100de0 2023-09-21T12:55:20.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.728+0000 7f57877fe700 1 -- 172.21.15.142:0/886842010 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f5788099a70 con 0x7f5798100de0 2023-09-21T12:55:20.728 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:20.728 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:20.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 msgr2=0x7f57800a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 0x7f57800a2bd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f578c009c60 tx=0x7f578c009260 comp rx=0 tx=0).stop 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 msgr2=0x7f5798198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f5788009990 tx=0x7f578800f690 comp rx=0 tx=0).stop 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 shutdown_connections 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57800a0710 0x7f57800a2bd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798100de0 0x7f5798198d20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798102970 0x7f57981a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 --2- 172.21.15.142:0/886842010 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798101fd0 0x7f5798199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 >> 172.21.15.142:0/886842010 conn(0x7f57980fc310 msgr2=0x7f57980fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:20.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 shutdown_connections 2023-09-21T12:55:20.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.731+0000 7f57857fa700 1 -- 172.21.15.142:0/886842010 wait complete. 2023-09-21T12:55:20.750 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:55:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:20 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1184867520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:20.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:20 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4269915118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 -- 172.21.15.142:0/3885023856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818100df0 msgr2=0x7f8818101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 --2- 172.21.15.142:0/3885023856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818100df0 0x7f8818101210 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f88080099c0 tx=0x7f8808009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 -- 172.21.15.142:0/3885023856 shutdown_connections 2023-09-21T12:55:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 --2- 172.21.15.142:0/3885023856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818100df0 0x7f8818101210 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 --2- 172.21.15.142:0/3885023856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818102980 0x7f8818109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.949+0000 7f881e7ff700 1 --2- 172.21.15.142:0/3885023856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818101fe0 0x7f8818102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.950+0000 7f881e7ff700 1 -- 172.21.15.142:0/3885023856 >> 172.21.15.142:0/3885023856 conn(0x7f88180fc320 msgr2=0x7f88180fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.950+0000 7f881e7ff700 1 -- 172.21.15.142:0/3885023856 shutdown_connections 2023-09-21T12:55:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.950+0000 7f881e7ff700 1 -- 172.21.15.142:0/3885023856 wait complete. 2023-09-21T12:55:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 Processor -- start 2023-09-21T12:55:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 -- start start 2023-09-21T12:55:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818100df0 0x7f8818198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818102980 0x7f88181a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181a0830 con 0x7f8818101fe0 2023-09-21T12:55:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181a09a0 con 0x7f8818102980 2023-09-21T12:55:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881e7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88181a0b60 con 0x7f8818100df0 2023-09-21T12:55:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f88177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f88177fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38530/0 (socket says 172.21.15.142:38530) 2023-09-21T12:55:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f88177fe700 1 -- 172.21.15.142:0/2440855325 learned_addr learned my addr 172.21.15.142:0/2440855325 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f8817fff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818100df0 0x7f8818198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.951+0000 7f881cd9c700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818102980 0x7f88181a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 -- 172.21.15.142:0/2440855325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818100df0 msgr2=0x7f8818198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818100df0 0x7f8818198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 -- 172.21.15.142:0/2440855325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818102980 msgr2=0x7f88181a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818102980 0x7f88181a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 -- 172.21.15.142:0/2440855325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88080095f0 con 0x7f8818101fe0 2023-09-21T12:55:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88177fe700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f880c00e9a0 tx=0x7f880c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c009790 con 0x7f8818101fe0 2023-09-21T12:55:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f880c010430 con 0x7f8818101fe0 2023-09-21T12:55:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88181a0e40 con 0x7f8818101fe0 2023-09-21T12:55:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c018680 con 0x7f8818101fe0 2023-09-21T12:55:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.952+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88181a1260 con 0x7f8818101fe0 2023-09-21T12:55:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.953+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8818193440 con 0x7f8818101fe0 2023-09-21T12:55:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.955+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f880c0105a0 con 0x7f8818101fe0 2023-09-21T12:55:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.957+0000 7f88157fa700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 0x7f88000a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.957+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f880c014070 con 0x7f8818101fe0 2023-09-21T12:55:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.957+0000 7f8817fff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 0x7f88000a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:20.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.957+0000 7f8817fff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 0x7f88000a2bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f881819a1c0 tx=0x7f8808005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:20.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:20.960+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f880c051e10 con 0x7f8818101fe0 2023-09-21T12:55:21.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:20 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1184867520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:21.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:20 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4269915118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:20 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1184867520' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:21.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:20 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4269915118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.205+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f881810c650 con 0x7f8818101fe0 2023-09-21T12:55:21.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.205+0000 7f88157fa700 1 -- 172.21.15.142:0/2440855325 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f880c095070 con 0x7f8818101fe0 2023-09-21T12:55:21.205 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:21.205 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:55:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 msgr2=0x7f88000a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 0x7f88000a2bd0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f881819a1c0 tx=0x7f8808005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 msgr2=0x7f8818199230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f880c00e9a0 tx=0x7f880c00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 shutdown_connections 2023-09-21T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f88000a0710 0x7f88000a2bd0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8818102980 0x7f88181a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8818100df0 0x7f8818198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 --2- 172.21.15.142:0/2440855325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8818101fe0 0x7f8818199230 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 >> 172.21.15.142:0/2440855325 conn(0x7f88180fc320 msgr2=0x7f88181078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 shutdown_connections 2023-09-21T12:55:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.208+0000 7f881e7ff700 1 -- 172.21.15.142:0/2440855325 wait complete. 2023-09-21T12:55:21.211 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:21.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-21T12:54:11.985089+0000', 'modified': '2023-09-21T12:54:17.432339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24559, 'mds_2': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/2687704828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2687704828}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2687704828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.160:6837/1554558585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 1554558585}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 1554558585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/3800669997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 3800669997}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 3800669997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24535': {'gid': 24535, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6839/39574793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 39574793}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 39574793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24559': {'gid': 24559, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6841/3027031872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6840', 'nonce': 3027031872}, {'type': 'v1', 'addr': '172.21.15.142:6841', 'nonce': 3027031872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6839/1981914736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 1981914736}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 1981914736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-21T12:55:21.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-09-21T12:55:21.227 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-21T12:55:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 -- 172.21.15.142:0/2380798006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8101fe0 msgr2=0x7fede8102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 --2- 172.21.15.142:0/2380798006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8101fe0 0x7fede8102440 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7feddc0099c0 tx=0x7feddc009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 -- 172.21.15.142:0/2380798006 shutdown_connections 2023-09-21T12:55:21.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 --2- 172.21.15.142:0/2380798006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 0x7fede8109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 --2- 172.21.15.142:0/2380798006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8100df0 0x7fede8101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 --2- 172.21.15.142:0/2380798006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8101fe0 0x7fede8102440 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 -- 172.21.15.142:0/2380798006 >> 172.21.15.142:0/2380798006 conn(0x7fede80fc360 msgr2=0x7fede80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 -- 172.21.15.142:0/2380798006 shutdown_connections 2023-09-21T12:55:21.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.426+0000 7fedecfff700 1 -- 172.21.15.142:0/2380798006 wait complete. 2023-09-21T12:55:21.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.427+0000 7fedecfff700 1 Processor -- start 2023-09-21T12:55:21.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.427+0000 7fedecfff700 1 -- start start 2023-09-21T12:55:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 0x7fede8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 0x7fede81a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81a0840 con 0x7fede8100df0 2023-09-21T12:55:21.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81a09b0 con 0x7fede8101fe0 2023-09-21T12:55:21.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fedecfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fede81a0b70 con 0x7fede8102980 2023-09-21T12:55:21.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 0x7fede8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38558/0 (socket says 172.21.15.142:38558) 2023-09-21T12:55:21.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 -- 172.21.15.142:0/200283157 learned_addr learned my addr 172.21.15.142:0/200283157 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede6d9d700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 0x7fede81a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 -- 172.21.15.142:0/200283157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 msgr2=0x7fede81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 0x7fede81a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 -- 172.21.15.142:0/200283157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 msgr2=0x7fede8199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 0x7fede8199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede659c700 1 -- 172.21.15.142:0/200283157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0095f0 con 0x7fede8100df0 2023-09-21T12:55:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.428+0000 7fede5d9b700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 0x7fede8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fede659c700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e970 tx=0x7fedd800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fedd77fe700 1 -- 172.21.15.142:0/200283157 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8009790 con 0x7fede8100df0 2023-09-21T12:55:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fede81a0e50 con 0x7fede8100df0 2023-09-21T12:55:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fedd77fe700 1 -- 172.21.15.142:0/200283157 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fedd800c7e0 con 0x7fede8100df0 2023-09-21T12:55:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fedd77fe700 1 -- 172.21.15.142:0/200283157 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8003c70 con 0x7fede8100df0 2023-09-21T12:55:21.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.429+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede81a1280 con 0x7fede8100df0 2023-09-21T12:55:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.432+0000 7fedd77fe700 1 -- 172.21.15.142:0/200283157 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fedd800cc50 con 0x7fede8100df0 2023-09-21T12:55:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.433+0000 7fee00952b80 1 Processor -- start 2023-09-21T12:55:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.433+0000 7fedd77fe700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 0x7fedd00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 -- start start 2023-09-21T12:55:21.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fedd77fe700 1 -- 172.21.15.142:0/200283157 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fedd8014070 con 0x7fede8100df0 2023-09-21T12:55:21.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede6d9d700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 0x7fedd00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x557827895ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x557827897010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557827809c50 con 0x557827896000 2023-09-21T12:55:21.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578277edc20 con 0x557827896b90 2023-09-21T12:55:21.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fee00952b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578277eb540 con 0x5578278956a0 2023-09-21T12:55:21.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38566/0 (socket says 172.21.15.142:38566) 2023-09-21T12:55:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede5d9b700 1 -- 172.21.15.142:0/1216262886 learned_addr learned my addr 172.21.15.142:0/1216262886 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede659c700 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x557827895ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.434+0000 7fede6d9d700 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x557827897010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 -- 172.21.15.142:0/1216262886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 msgr2=0x557827895ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x557827895ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 -- 172.21.15.142:0/1216262886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 msgr2=0x557827897010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x557827897010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede6d9d700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 0x7fedd00a2b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fede000f590 tx=0x7fede000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 -- 172.21.15.142:0/1216262886 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557827611d90 con 0x557827896000 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feddc009fd0 tx=0x7feddc005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65df9ffb6183604b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fedd4ff9700 1 -- 172.21.15.142:0/1216262886 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00bd40 con 0x557827896000 2023-09-21T12:55:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fedd4ff9700 1 -- 172.21.15.142:0/1216262886 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feddc01e040 con 0x557827896000 2023-09-21T12:55:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.435+0000 7fedd4ff9700 1 -- 172.21.15.142:0/1216262886 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc00f460 con 0x557827896000 2023-09-21T12:55:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- 172.21.15.142:0/1216262886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 msgr2=0x557827896590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7feddc009fd0 tx=0x7feddc005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- 172.21.15.142:0/1216262886 shutdown_connections 2023-09-21T12:55:21.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x557827897010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x557827895ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 --2- 172.21.15.142:0/1216262886 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x557827896590 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- 172.21.15.142:0/1216262886 >> 172.21.15.142:0/1216262886 conn(0x5578277c1fb0 msgr2=0x557827890180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- 172.21.15.142:0/1216262886 shutdown_connections 2023-09-21T12:55:21.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- 172.21.15.142:0/1216262886 wait complete. 2023-09-21T12:55:21.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.436+0000 7fee00952b80 1 -- start start 2023-09-21T12:55:21.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 Processor -- start 2023-09-21T12:55:21.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578277e6e30 con 0x5578278956a0 2023-09-21T12:55:21.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578277836f0 con 0x557827896000 2023-09-21T12:55:21.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557827783390 con 0x557827896b90 2023-09-21T12:55:21.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fee00952b80 10 client.0 _ll_register_callbacks cb 0x5578276cda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.437+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60360/0 (socket says 172.21.15.142:60360) 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 -- 172.21.15.142:0/2253661833 learned_addr learned my addr 172.21.15.142:0/2253661833 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38580/0 (socket says 172.21.15.142:38580) 2023-09-21T12:55:21.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede6d9d700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 -- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 msgr2=0x5578278a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 -- 172.21.15.142:0/2253661833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 msgr2=0x55782789f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 -- 172.21.15.142:0/2253661833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede8109b80 con 0x557827896000 2023-09-21T12:55:21.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede659c700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:21.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fede5d9b700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058e0 tx=0x7feddc00bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c6cb08815c2a8d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fedcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:55:21.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.438+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0039d0 con 0x557827896000 2023-09-21T12:55:21.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557827757b60 con 0x557827896000 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feddc003b30 con 0x557827896000 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7feddc00bde0 con 0x557827896000 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 10 client.24977 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5578275fac10 con 0x557827896000 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557827757b60 con 0x557827896000 2023-09-21T12:55:21.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7feddc021070 con 0x557827896000 2023-09-21T12:55:21.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 10 client.24977 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:21.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 10 client.24977 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-21T12:55:21.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.439+0000 7fee00952b80 20 client.24977 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:21.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5578278aa7e0 0x5578278a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fee00952b80 4 client.24977 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:21.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557827863fd0 con 0x5578278aa7e0 2023-09-21T12:55:21.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fede659c700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5578278aa7e0 0x5578278a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fede659c700 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5578278aa7e0 0x5578278a95d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9dc8416f158af13 server_cookie=59ad6e1e2b7cd2e7 in_seq=0 out_seq=0 2023-09-21T12:55:21.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.440+0000 7fedcdffb700 10 client.24977 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:21.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.441+0000 7fedcdffb700 1 -- 172.21.15.142:0/2253661833 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557827863fd0 con 0x5578278aa7e0 2023-09-21T12:55:21.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.441+0000 7fedcdffb700 10 client.24977 handle_command_reply: tid=0 2023-09-21T12:55:21.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.441+0000 7fee00952b80 1 client.24977 shutdown 2023-09-21T12:55:21.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 msgr2=0x55782789f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7feddc0058e0 tx=0x7feddc00bb40 comp rx=0 tx=0).stop 2023-09-21T12:55:21.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 shutdown_connections 2023-09-21T12:55:21.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5578278aa7e0 0x5578278a95d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x55782789f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fedcdffb700 0 client.24977 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:21.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 --2- 172.21.15.142:0/2253661833 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x55782789f660 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 >> 172.21.15.142:0/2253661833 conn(0x5578277c1fb0 msgr2=0x55782788f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 shutdown_connections 2023-09-21T12:55:21.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 1 -- 172.21.15.142:0/2253661833 wait complete. 2023-09-21T12:55:21.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.442+0000 7fee00952b80 20 client.24977 trim_cache size 0 max 16384 2023-09-21T12:55:21.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 Processor -- start 2023-09-21T12:55:21.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 -- start start 2023-09-21T12:55:21.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x557827896f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x5578278a6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578276678d0 con 0x5578278956a0 2023-09-21T12:55:21.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557827863fd0 con 0x557827896000 2023-09-21T12:55:21.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fee00952b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557827757b60 con 0x557827896b90 2023-09-21T12:55:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.461+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x557827896f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x5578278a6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x557827896f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38596/0 (socket says 172.21.15.142:38596) 2023-09-21T12:55:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede659c700 1 -- 172.21.15.142:0/1357321417 learned_addr learned my addr 172.21.15.142:0/1357321417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede6d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 -- 172.21.15.142:0/1357321417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 msgr2=0x5578278a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 -- 172.21.15.142:0/1357321417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 msgr2=0x557827896f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x557827896f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 -- 172.21.15.142:0/1357321417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557827638200 con 0x557827896000 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fede5d9b700 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x5578278a6660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feddc005850 tx=0x7feddc00b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5c0baf4a9643172 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fedd57fa700 1 -- 172.21.15.142:0/1357321417 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc02daa0 con 0x557827896000 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fedd57fa700 1 -- 172.21.15.142:0/1357321417 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feddc00fe70 con 0x557827896000 2023-09-21T12:55:21.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.462+0000 7fedd57fa700 1 -- 172.21.15.142:0/1357321417 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc02d620 con 0x557827896000 2023-09-21T12:55:21.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 -- 172.21.15.142:0/1357321417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 msgr2=0x5578278a6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x5578278a6660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feddc005850 tx=0x7feddc00b540 comp rx=0 tx=0).stop 2023-09-21T12:55:21.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 -- 172.21.15.142:0/1357321417 shutdown_connections 2023-09-21T12:55:21.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5578278956a0 0x557827896f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557827896b90 0x5578278a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 --2- 172.21.15.142:0/1357321417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896000 0x5578278a6660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 -- 172.21.15.142:0/1357321417 >> 172.21.15.142:0/1357321417 conn(0x5578277c1fb0 msgr2=0x55782789cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 -- 172.21.15.142:0/1357321417 shutdown_connections 2023-09-21T12:55:21.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.463+0000 7fee00952b80 1 -- 172.21.15.142:0/1357321417 wait complete. 2023-09-21T12:55:21.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 -- start start 2023-09-21T12:55:21.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 Processor -- start 2023-09-21T12:55:21.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x5578278a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x5578278a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578278a6060 con 0x557827896000 2023-09-21T12:55:21.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578278a61d0 con 0x557827896b90 2023-09-21T12:55:21.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578278a6390 con 0x5578278956a0 2023-09-21T12:55:21.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.464+0000 7fee00952b80 10 client.0 _ll_register_callbacks cb 0x5578276cda30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:21.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36186/0 (socket says 172.21.15.142:36186) 2023-09-21T12:55:21.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x5578278a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 -- 172.21.15.142:0/221820913 learned_addr learned my addr 172.21.15.142:0/221820913 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede6d9d700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x5578278a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 -- 172.21.15.142:0/221820913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 msgr2=0x5578278a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x5578278a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 -- 172.21.15.142:0/221820913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 msgr2=0x5578278a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x5578278a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 -- 172.21.15.142:0/221820913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578275fac10 con 0x5578278956a0 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fede659c700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fedd8099e30 tx=0x7fedd8003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fd4defe81a6098d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fedcdffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:55:21.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd80acea0 con 0x5578278956a0 2023-09-21T12:55:21.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feddc01e040 con 0x5578278956a0 2023-09-21T12:55:21.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.465+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fedd8095040 con 0x5578278956a0 2023-09-21T12:55:21.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedd809d3b0 con 0x5578278956a0 2023-09-21T12:55:21.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 10 client.24961 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x557827610260 con 0x5578278956a0 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feddc01e040 con 0x5578278956a0 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fedd80c9af0 con 0x5578278956a0 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 10 client.24961 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 10 client.24961 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-21T12:55:21.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 20 client.24961 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x557827902b40 0x5578278ff000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 4 client.24961 mds_command: new command op to 24514 tid=0[{"prefix": "status"}] 2023-09-21T12:55:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5578277dfe10 con 0x557827902b40 2023-09-21T12:55:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.466+0000 7fede5d9b700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x557827902b40 0x5578278ff000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fedcdffb700 10 client.24961 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fede5d9b700 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x557827902b40 0x5578278ff000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3debfaab277cfae4 server_cookie=b6fe712c99794542 in_seq=0 out_seq=0 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fedcdffb700 1 -- 172.21.15.142:0/221820913 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5578277dfe10 con 0x557827902b40 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fedcdffb700 10 client.24961 handle_command_reply: tid=0 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 client.24961 shutdown 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 msgr2=0x5578278a27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fedd8099e30 tx=0x7fedd8003680 comp rx=0 tx=0).stop 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 shutdown_connections 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x557827902b40 0x5578278ff000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557827896b90 0x5578278a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5578278956a0 0x5578278a27f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 --2- 172.21.15.142:0/221820913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557827896000 0x5578278a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fedcdffb700 0 client.24961 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:21.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.467+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 >> 172.21.15.142:0/221820913 conn(0x5578277c1fb0 msgr2=0x5578278a95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 shutdown_connections 2023-09-21T12:55:21.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fee00952b80 1 -- 172.21.15.142:0/221820913 wait complete. 2023-09-21T12:55:21.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fee00952b80 20 client.24961 trim_cache size 0 max 16384 2023-09-21T12:55:21.482 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 2, 2023-09-21T12:55:21.482 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24514, 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 65.039288799999994, 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:21.483 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:21.484 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 88.264374824000001 2023-09-21T12:55:21.484 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:21.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 msgr2=0x7fedd00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 0x7fedd00a2b90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fede000f590 tx=0x7fede000b040 comp rx=0 tx=0).stop 2023-09-21T12:55:21.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 msgr2=0x7fede8198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.468+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e970 tx=0x7fedd800ec80 comp rx=0 tx=0).stop 2023-09-21T12:55:21.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 shutdown_connections 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fedd00a06d0 0x7fedd00a2b90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fede8100df0 0x7fede8198d00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fede8102980 0x7fede81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 --2- 172.21.15.142:0/200283157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fede8101fe0 0x7fede8199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 >> 172.21.15.142:0/200283157 conn(0x7fede80fc360 msgr2=0x7fede80fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 shutdown_connections 2023-09-21T12:55:21.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.469+0000 7fedecfff700 1 -- 172.21.15.142:0/200283157 wait complete. 2023-09-21T12:55:21.488 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-21T12:55:21.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/2753273599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4102960 msgr2=0x7ff6b4109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/2753273599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4102960 0x7ff6b4109210 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b0d0 tx=0x7ff6ac00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/2753273599 shutdown_connections 2023-09-21T12:55:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/2753273599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4102960 0x7ff6b4109210 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/2753273599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4100dd0 0x7ff6b41011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/2753273599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4101fc0 0x7ff6b4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/2753273599 >> 172.21.15.142:0/2753273599 conn(0x7ff6b40fc320 msgr2=0x7ff6b40fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/2753273599 shutdown_connections 2023-09-21T12:55:21.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.687+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/2753273599 wait complete. 2023-09-21T12:55:21.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.688+0000 7ff6bc5ff700 1 Processor -- start 2023-09-21T12:55:21.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.688+0000 7ff6bc5ff700 1 -- start start 2023-09-21T12:55:21.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4100dd0 0x7ff6b4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4102960 0x7ff6b4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4073eb0 con 0x7ff6b4101fc0 2023-09-21T12:55:21.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b4074020 con 0x7ff6b4100dd0 2023-09-21T12:55:21.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bc5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b41a0c50 con 0x7ff6b4102960 2023-09-21T12:55:21.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38614/0 (socket says 172.21.15.142:38614) 2023-09-21T12:55:21.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/3809181933 learned_addr learned my addr 172.21.15.142:0/3809181933 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4102960 0x7ff6b4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4100dd0 0x7ff6b4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/3809181933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4102960 msgr2=0x7ff6b4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4102960 0x7ff6b4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/3809181933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4100dd0 msgr2=0x7ff6b4074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4100dd0 0x7ff6b4074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.689+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/3809181933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac009d00 con 0x7ff6b4101fc0 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e9a0 tx=0x7ff6a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6ab7fe700 1 -- 172.21.15.142:0/3809181933 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4009790 con 0x7ff6b4101fc0 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6ab7fe700 1 -- 172.21.15.142:0/3809181933 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a4010430 con 0x7ff6b4101fc0 2023-09-21T12:55:21.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b41a0f30 con 0x7ff6b4101fc0 2023-09-21T12:55:21.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6ab7fe700 1 -- 172.21.15.142:0/3809181933 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4018680 con 0x7ff6b4101fc0 2023-09-21T12:55:21.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.690+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b41a13b0 con 0x7ff6b4101fc0 2023-09-21T12:55:21.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.694+0000 7ff6ab7fe700 1 -- 172.21.15.142:0/3809181933 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7ff6a40105a0 con 0x7ff6b4101fc0 2023-09-21T12:55:21.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.695+0000 7ff6cfe68b80 1 Processor -- start 2023-09-21T12:55:21.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 -- start start 2023-09-21T12:55:21.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6ab7fe700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 0x7ff6a00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afb1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6ab7fe700 1 -- 172.21.15.142:0/3809181933 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff6a4014070 con 0x7ff6b4101fc0 2023-09-21T12:55:21.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afb2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afb3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60af25c50 con 0x55a60afb16a0 2023-09-21T12:55:21.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60af09c20 con 0x55a60afb2000 2023-09-21T12:55:21.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60af07540 con 0x55a60afb2b90 2023-09-21T12:55:21.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 0x7ff6a00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afb1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afb1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38626/0 (socket says 172.21.15.142:38626) 2023-09-21T12:55:21.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6ba39b700 1 -- 172.21.15.142:0/1997401317 learned_addr learned my addr 172.21.15.142:0/1997401317 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afb2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.696+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afb3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/1997401317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 msgr2=0x55a60afb3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afb3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/1997401317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 msgr2=0x55a60afb1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afb1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/1997401317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a60ad2dd90 con 0x55a60afb2000 2023-09-21T12:55:21.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afb2590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c97d0 tx=0x7ff6a4098e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78549b441427bb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 0x7ff6a00a2b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40751f0 tx=0x7ff6ac008cf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6a8bfe700 1 -- 172.21.15.142:0/1997401317 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a409d120 con 0x55a60afb2000 2023-09-21T12:55:21.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6a8bfe700 1 -- 172.21.15.142:0/1997401317 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a40994b0 con 0x55a60afb2000 2023-09-21T12:55:21.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.697+0000 7ff6a8bfe700 1 -- 172.21.15.142:0/1997401317 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a4010880 con 0x55a60afb2000 2023-09-21T12:55:21.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/1997401317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 msgr2=0x55a60afb2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afb2590 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40c97d0 tx=0x7ff6a4098e10 comp rx=0 tx=0).stop 2023-09-21T12:55:21.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/1997401317 shutdown_connections 2023-09-21T12:55:21.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afb1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afb3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/1997401317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afb2590 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/1997401317 >> 172.21.15.142:0/1997401317 conn(0x55a60aeddfb0 msgr2=0x55a60afac180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/1997401317 shutdown_connections 2023-09-21T12:55:21.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/1997401317 wait complete. 2023-09-21T12:55:21.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.698+0000 7ff6cfe68b80 1 -- start start 2023-09-21T12:55:21.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 Processor -- start 2023-09-21T12:55:21.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afbb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afc2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60af02e30 con 0x55a60afb16a0 2023-09-21T12:55:21.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60ae9f6f0 con 0x55a60afb2000 2023-09-21T12:55:21.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60ae9f390 con 0x55a60afb2b90 2023-09-21T12:55:21.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6cfe68b80 10 client.0 _ll_register_callbacks cb 0x55a60ade9a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:21.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6b9b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afbb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38628/0 (socket says 172.21.15.142:38628) 2023-09-21T12:55:21.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6ba39b700 1 -- 172.21.15.142:0/2582944269 learned_addr learned my addr 172.21.15.142:0/2582944269 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.699+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afc2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 -- 172.21.15.142:0/2582944269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 msgr2=0x55a60afc2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afc2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 -- 172.21.15.142:0/2582944269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 msgr2=0x55a60afbb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afbb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 -- 172.21.15.142:0/2582944269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b41a13b0 con 0x55a60afb16a0 2023-09-21T12:55:21.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afbb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:21.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:21.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00114c0 tx=0x7ff6b00117d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6300e9dc18c2bc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff69dffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:21.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0016070 con 0x55a60afb16a0 2023-09-21T12:55:21.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a60ae73b60 con 0x55a60afb16a0 2023-09-21T12:55:21.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff6b0004260 con 0x55a60afb16a0 2023-09-21T12:55:21.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b0004420 con 0x55a60afb16a0 2023-09-21T12:55:21.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6cfe68b80 10 client.14943 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:21.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.700+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a60ad16c10 con 0x55a60afb16a0 2023-09-21T12:55:21.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a60ae73b60 con 0x55a60afb16a0 2023-09-21T12:55:21.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff6b0024070 con 0x55a60afb16a0 2023-09-21T12:55:21.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 10 client.14943 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:21.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 10 client.14943 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T12:55:21.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 20 client.14943 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:21.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60afc6d00 0x55a60afc57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 4 client.14943 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:21.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a60af7ffd0 con 0x55a60afc6d00 2023-09-21T12:55:21.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.701+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60afc6d00 0x55a60afc57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.702+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60afc6d00 0x55a60afc57c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=297866c1196324a0 server_cookie=20769510108eeb39 in_seq=0 out_seq=0 2023-09-21T12:55:21.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.702+0000 7ff69dffb700 10 client.14943 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:21.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.702+0000 7ff69dffb700 1 -- 172.21.15.142:0/2582944269 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a60af7ffd0 con 0x55a60afc6d00 2023-09-21T12:55:21.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.702+0000 7ff69dffb700 10 client.14943 handle_command_reply: tid=0 2023-09-21T12:55:21.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.702+0000 7ff6cfe68b80 1 client.14943 shutdown 2023-09-21T12:55:21.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 msgr2=0x55a60afbb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00114c0 tx=0x7ff6b00117d0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 shutdown_connections 2023-09-21T12:55:21.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb16a0 0x55a60afbb090 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60afc6d00 0x55a60afc57c0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb2b90 0x55a60afc2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2582944269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afbb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff69dffb700 0 client.14943 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:21.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 >> 172.21.15.142:0/2582944269 conn(0x55a60aeddfb0 msgr2=0x55a60afab830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 shutdown_connections 2023-09-21T12:55:21.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2582944269 wait complete. 2023-09-21T12:55:21.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.703+0000 7ff6cfe68b80 20 client.14943 trim_cache size 0 max 16384 2023-09-21T12:55:21.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 Processor -- start 2023-09-21T12:55:21.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 -- start start 2023-09-21T12:55:21.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afb2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60ad838d0 con 0x55a60afb2b90 2023-09-21T12:55:21.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60ad8fde0 con 0x55a60afb2000 2023-09-21T12:55:21.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.721+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60ae9baa0 con 0x55a60afb16a0 2023-09-21T12:55:21.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38638/0 (socket says 172.21.15.142:38638) 2023-09-21T12:55:21.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 -- 172.21.15.142:0/71954354 learned_addr learned my addr 172.21.15.142:0/71954354 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afb2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 -- 172.21.15.142:0/71954354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 msgr2=0x55a60afb2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afb2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 -- 172.21.15.142:0/71954354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 msgr2=0x55a60afc25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afc25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 -- 172.21.15.142:0/71954354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a60ad54200 con 0x55a60afb2b90 2023-09-21T12:55:21.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.722+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b0d0 tx=0x7ff6ac028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df30dd568589d5d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6a93ff700 1 -- 172.21.15.142:0/71954354 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac00e040 con 0x55a60afb2b90 2023-09-21T12:55:21.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6a93ff700 1 -- 172.21.15.142:0/71954354 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6ac00bca0 con 0x55a60afb2b90 2023-09-21T12:55:21.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6a93ff700 1 -- 172.21.15.142:0/71954354 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ac01e6c0 con 0x55a60afb2b90 2023-09-21T12:55:21.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/71954354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 msgr2=0x55a60afb9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac00b0d0 tx=0x7ff6ac028000 comp rx=0 tx=0).stop 2023-09-21T12:55:21.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/71954354 shutdown_connections 2023-09-21T12:55:21.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2b90 0x55a60afb9010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afb2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/71954354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2000 0x55a60afc25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/71954354 >> 172.21.15.142:0/71954354 conn(0x55a60aeddfb0 msgr2=0x55a60afc2e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/71954354 shutdown_connections 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.723+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/71954354 wait complete. 2023-09-21T12:55:21.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 -- start start 2023-09-21T12:55:21.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 Processor -- start 2023-09-21T12:55:21.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afc1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 0x55a60afc2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 0x55a60afbea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60afbf150 con 0x55a60afb2000 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60afbf2c0 con 0x55a60afb2b90 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a60afbf480 con 0x55a60afb16a0 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.724+0000 7ff6cfe68b80 10 client.0 _ll_register_callbacks cb 0x55a60ade9a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 0x55a60afc2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afc1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6ba39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afc1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36236/0 (socket says 172.21.15.142:36236) 2023-09-21T12:55:21.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6ba39b700 1 -- 172.21.15.142:0/2751897770 learned_addr learned my addr 172.21.15.142:0/2751897770 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 0x55a60afbea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/2751897770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 msgr2=0x55a60afc1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afc1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/2751897770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 msgr2=0x55a60afbea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 0x55a60afbea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 -- 172.21.15.142:0/2751897770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac027050 con 0x55a60afb2000 2023-09-21T12:55:21.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6bab9c700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 0x55a60afbea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:21.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6b9b9a700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 0x55a60afc2510 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a409d4a0 tx=0x7ff6a40c9710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7320a8a4fdf58c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff69dffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:21.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a409d120 con 0x55a60afb2000 2023-09-21T12:55:21.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6a40994b0 con 0x55a60afb2000 2023-09-21T12:55:21.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.725+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff6a409d2e0 con 0x55a60afb2000 2023-09-21T12:55:21.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6a40840b0 con 0x55a60afb2000 2023-09-21T12:55:21.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 10 client.14949 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:21.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a60ad2c260 con 0x55a60afb2000 2023-09-21T12:55:21.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6a40994b0 con 0x55a60afb2000 2023-09-21T12:55:21.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff6a4065130 con 0x55a60afb2000 2023-09-21T12:55:21.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 10 client.14949 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:21.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 10 client.14949 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T12:55:21.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 20 client.14949 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:21.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60b01f270 0x55a60b01b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 4 client.14949 mds_command: new command op to 24559 tid=0[{"prefix": "status"}] 2023-09-21T12:55:21.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a60aefbe10 con 0x55a60b01f270 2023-09-21T12:55:21.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.726+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60b01f270 0x55a60b01b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6ba39b700 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60b01f270 0x55a60b01b710 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d10cb9bef0bdd522 server_cookie=b85a4c8fff4a9bea in_seq=0 out_seq=0 2023-09-21T12:55:21.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff69dffb700 10 client.14949 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:21.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff69dffb700 1 -- 172.21.15.142:0/2751897770 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55a60aefbe10 con 0x55a60b01f270 2023-09-21T12:55:21.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff69dffb700 10 client.14949 handle_command_reply: tid=0 2023-09-21T12:55:21.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 client.14949 shutdown 2023-09-21T12:55:21.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 msgr2=0x55a60afc2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 0x55a60afc2510 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff6a409d4a0 tx=0x7ff6a40c9710 comp rx=0 tx=0).stop 2023-09-21T12:55:21.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 shutdown_connections 2023-09-21T12:55:21.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55a60b01f270 0x55a60b01b710 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a60afb2b90 0x55a60afbea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff69dffb700 0 client.14949 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a60afb16a0 0x55a60afc1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 --2- 172.21.15.142:0/2751897770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a60afb2000 0x55a60afc2510 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 >> 172.21.15.142:0/2751897770 conn(0x55a60aeddfb0 msgr2=0x55a60afb9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 shutdown_connections 2023-09-21T12:55:21.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.727+0000 7ff6cfe68b80 1 -- 172.21.15.142:0/2751897770 wait complete. 2023-09-21T12:55:21.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6cfe68b80 20 client.14949 trim_cache size 0 max 16384 2023-09-21T12:55:21.742 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:21.742 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 1, 2023-09-21T12:55:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24559, 2023-09-21T12:55:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:21.743 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:21.744 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 66.246968619, 2023-09-21T12:55:21.744 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:21.744 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:21.744 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:21.744 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 77.666933580000006 2023-09-21T12:55:21.745 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:21.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 msgr2=0x7ff6a00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 0x7ff6a00a2b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40751f0 tx=0x7ff6ac008cf0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 msgr2=0x7ff6b40731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e9a0 tx=0x7ff6a400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 shutdown_connections 2023-09-21T12:55:21.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6a00a06d0 0x7ff6a00a2b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b4102960 0x7ff6b4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff6b4100dd0 0x7ff6b4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 --2- 172.21.15.142:0/3809181933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff6b4101fc0 0x7ff6b40731d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 >> 172.21.15.142:0/3809181933 conn(0x7ff6b40fc320 msgr2=0x7ff6b40fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 shutdown_connections 2023-09-21T12:55:21.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.728+0000 7ff6bc5ff700 1 -- 172.21.15.142:0/3809181933 wait complete. 2023-09-21T12:55:21.748 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:21 smithi142 ceph-mon[97663]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:21.748 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/886842010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.749 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:21 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2440855325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-21T12:55:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:21 smithi160 ceph-mon[134450]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/886842010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:21 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2440855325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1383911605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 msgr2=0x7fecd4101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1383911605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4101210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fecd00099c0 tx=0x7fecd0009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1383911605 shutdown_connections 2023-09-21T12:55:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1383911605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4101210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1383911605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1383911605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 0x7fecd4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1383911605 >> 172.21.15.142:0/1383911605 conn(0x7fecd40fc360 msgr2=0x7fecd40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1383911605 shutdown_connections 2023-09-21T12:55:21.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.949+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1383911605 wait complete. 2023-09-21T12:55:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.950+0000 7fecdc3ff700 1 Processor -- start 2023-09-21T12:55:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.950+0000 7fecdc3ff700 1 -- start start 2023-09-21T12:55:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.950+0000 7fecdc3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecdc3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 0x7fecd40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecdc3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecdc3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4073eb0 con 0x7fecd4100df0 2023-09-21T12:55:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecdc3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4074020 con 0x7fecd4102980 2023-09-21T12:55:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecdc3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41a0bf0 con 0x7fecd4101fe0 2023-09-21T12:55:21.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38652/0 (socket says 172.21.15.142:38652) 2023-09-21T12:55:21.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 -- 172.21.15.142:0/1351663447 learned_addr learned my addr 172.21.15.142:0/1351663447 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecd999a700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 0x7fecd40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda99c700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 -- 172.21.15.142:0/1351663447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 msgr2=0x7fecd40731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 0x7fecd40731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 -- 172.21.15.142:0/1351663447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 msgr2=0x7fecd4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 -- 172.21.15.142:0/1351663447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00095f0 con 0x7fecd4100df0 2023-09-21T12:55:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda99c700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.951+0000 7fecda19b700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009fd0 tx=0x7fecd000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.952+0000 7feccb7fe700 1 -- 172.21.15.142:0/1351663447 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd001d070 con 0x7fecd4100df0 2023-09-21T12:55:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.952+0000 7feccb7fe700 1 -- 172.21.15.142:0/1351663447 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd0005510 con 0x7fecd4100df0 2023-09-21T12:55:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.952+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd41a0e70 con 0x7fecd4100df0 2023-09-21T12:55:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.952+0000 7feccb7fe700 1 -- 172.21.15.142:0/1351663447 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004b00 con 0x7fecd4100df0 2023-09-21T12:55:21.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.952+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd41a1230 con 0x7fecd4100df0 2023-09-21T12:55:21.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.955+0000 7feccb7fe700 1 -- 172.21.15.142:0/1351663447 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fecd0004ca0 con 0x7fecd4100df0 2023-09-21T12:55:21.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.956+0000 7fecefe0bb80 1 Processor -- start 2023-09-21T12:55:21.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.956+0000 7fecefe0bb80 1 -- start start 2023-09-21T12:55:21.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.956+0000 7feccb7fe700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 0x7fecc00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7feccb7fe700 1 -- 172.21.15.142:0/1351663447 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecd00ccb60 con 0x7fecd4100df0 2023-09-21T12:55:21.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57eb000 0x55ffa57eb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57ebb90 0x55ffa57ec010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa575ec50 con 0x55ffa57ea6a0 2023-09-21T12:55:21.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa5742c20 con 0x55ffa57eb000 2023-09-21T12:55:21.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa5740540 con 0x55ffa57ebb90 2023-09-21T12:55:21.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda99c700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 0x7fecc00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38664/0 (socket says 172.21.15.142:38664) 2023-09-21T12:55:21.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 -- 172.21.15.142:0/833790242 learned_addr learned my addr 172.21.15.142:0/833790242 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecd999a700 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57eb000 0x55ffa57eb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 -- 172.21.15.142:0/833790242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57ebb90 msgr2=0x55ffa57ec010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57ebb90 0x55ffa57ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 -- 172.21.15.142:0/833790242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57eb000 msgr2=0x55ffa57eb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57eb000 0x55ffa57eb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.957+0000 7fecda19b700 1 -- 172.21.15.142:0/833790242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffa5566d90 con 0x55ffa57ea6a0 2023-09-21T12:55:21.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecda19b700 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecd0096730 tx=0x7fecd0099e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0eea9a6c5d1488c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecda99c700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 0x7fecc00a2c10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feccc009fd0 tx=0x7feccc009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecc8bfe700 1 -- 172.21.15.142:0/833790242 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd009a230 con 0x55ffa57ea6a0 2023-09-21T12:55:21.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecc8bfe700 1 -- 172.21.15.142:0/833790242 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd009e060 con 0x55ffa57ea6a0 2023-09-21T12:55:21.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecc8bfe700 1 -- 172.21.15.142:0/833790242 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd009a490 con 0x55ffa57ea6a0 2023-09-21T12:55:21.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecefe0bb80 1 -- 172.21.15.142:0/833790242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 msgr2=0x55ffa57eaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.958+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fecd0096730 tx=0x7fecd0099e80 comp rx=0 tx=0).stop 2023-09-21T12:55:21.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 -- 172.21.15.142:0/833790242 shutdown_connections 2023-09-21T12:55:21.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57eaac0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57ebb90 0x55ffa57ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/833790242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57eb000 0x55ffa57eb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 -- 172.21.15.142:0/833790242 >> 172.21.15.142:0/833790242 conn(0x55ffa5716fb0 msgr2=0x55ffa57e5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 -- 172.21.15.142:0/833790242 shutdown_connections 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 -- 172.21.15.142:0/833790242 wait complete. 2023-09-21T12:55:21.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 -- start start 2023-09-21T12:55:21.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.959+0000 7fecefe0bb80 1 Processor -- start 2023-09-21T12:55:21.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ebb90 0x55ffa57fb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa573be30 con 0x55ffa57ea6a0 2023-09-21T12:55:21.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa56d86f0 con 0x55ffa57ebb90 2023-09-21T12:55:21.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa56d8390 con 0x55ffa57eb000 2023-09-21T12:55:21.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecefe0bb80 10 client.0 _ll_register_callbacks cb 0x55ffa5622a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:21.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38676/0 (socket says 172.21.15.142:38676) 2023-09-21T12:55:21.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 -- 172.21.15.142:0/1761055711 learned_addr learned my addr 172.21.15.142:0/1761055711 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda99c700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ebb90 0x55ffa57fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecd999a700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 -- 172.21.15.142:0/1761055711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 msgr2=0x55ffa57f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 -- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ebb90 msgr2=0x55ffa57fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ebb90 0x55ffa57fb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.960+0000 7fecda19b700 1 -- 172.21.15.142:0/1761055711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd41a1230 con 0x55ffa57ea6a0 2023-09-21T12:55:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecda19b700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fecd0004fd0 tx=0x7fecd00999a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd8fe0956bbde2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00b8070 con 0x55ffa57ea6a0 2023-09-21T12:55:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecd0094e40 con 0x55ffa57ea6a0 2023-09-21T12:55:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ffa56acb60 con 0x55ffa57ea6a0 2023-09-21T12:55:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd00b81d0 con 0x55ffa57ea6a0 2023-09-21T12:55:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecefe0bb80 10 client.14961 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ffa554fc10 con 0x55ffa57ea6a0 2023-09-21T12:55:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ffa56acb60 con 0x55ffa57ea6a0 2023-09-21T12:55:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fecd00b2230 con 0x55ffa57ea6a0 2023-09-21T12:55:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.961+0000 7fecefe0bb80 10 client.14961 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecefe0bb80 10 client.14961 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T12:55:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecefe0bb80 20 client.14961 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa57ff440 0x55ffa57fe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecefe0bb80 4 client.14961 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffa57b8fd0 con 0x55ffa57ff440 2023-09-21T12:55:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecd999a700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa57ff440 0x55ffa57fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecd999a700 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa57ff440 0x55ffa57fe230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a99f33297f3d318 server_cookie=f5291327e2b0cf2c in_seq=0 out_seq=0 2023-09-21T12:55:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.962+0000 7fecbdffb700 10 client.14961 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecbdffb700 1 -- 172.21.15.142:0/1761055711 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ffa57b8fd0 con 0x55ffa57ff440 2023-09-21T12:55:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecbdffb700 10 client.14961 handle_command_reply: tid=0 2023-09-21T12:55:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 client.14961 shutdown 2023-09-21T12:55:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 msgr2=0x55ffa57f3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fecd0004fd0 tx=0x7fecd00999a0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 shutdown_connections 2023-09-21T12:55:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa57ff440 0x55ffa57fe230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f3d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ebb90 0x55ffa57fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1761055711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 >> 172.21.15.142:0/1761055711 conn(0x55ffa5716fb0 msgr2=0x55ffa57e4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:21.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.963+0000 7fecbdffb700 0 client.14961 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:21.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.964+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 shutdown_connections 2023-09-21T12:55:21.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.964+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1761055711 wait complete. 2023-09-21T12:55:21.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.964+0000 7fecefe0bb80 20 client.14961 trim_cache size 0 max 16384 2023-09-21T12:55:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 Processor -- start 2023-09-21T12:55:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 -- start start 2023-09-21T12:55:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57ebf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57e1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa55bc8d0 con 0x55ffa57ebb90 2023-09-21T12:55:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa57e5e50 con 0x55ffa57ea6a0 2023-09-21T12:55:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa58001d0 con 0x55ffa57eb000 2023-09-21T12:55:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecda99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecda99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57e1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38680/0 (socket says 172.21.15.142:38680) 2023-09-21T12:55:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecd999a700 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecda99c700 1 -- 172.21.15.142:0/1893629706 learned_addr learned my addr 172.21.15.142:0/1893629706 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecda19b700 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57ebf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecd999a700 1 -- 172.21.15.142:0/1893629706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 msgr2=0x55ffa57ebf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecd999a700 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57ebf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecd999a700 1 -- 172.21.15.142:0/1893629706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 msgr2=0x55ffa57e1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.982+0000 7fecd999a700 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57e1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.983+0000 7fecd999a700 1 -- 172.21.15.142:0/1893629706 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffa558d200 con 0x55ffa57eb000 2023-09-21T12:55:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.983+0000 7fecd999a700 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55ffa5800170 tx=0x7fecc4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fe8d0759bf968f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.983+0000 7fecc93ff700 1 -- 172.21.15.142:0/1893629706 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4017030 con 0x55ffa57eb000 2023-09-21T12:55:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.983+0000 7fecc93ff700 1 -- 172.21.15.142:0/1893629706 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecc4018040 con 0x55ffa57eb000 2023-09-21T12:55:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.983+0000 7fecc93ff700 1 -- 172.21.15.142:0/1893629706 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4003b40 con 0x55ffa57eb000 2023-09-21T12:55:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1893629706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 msgr2=0x55ffa57fb2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb2c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55ffa5800170 tx=0x7fecc4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1893629706 shutdown_connections 2023-09-21T12:55:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57e1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57ebf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/1893629706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb2c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1893629706 >> 172.21.15.142:0/1893629706 conn(0x55ffa5716fb0 msgr2=0x55ffa5807da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1893629706 shutdown_connections 2023-09-21T12:55:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- 172.21.15.142:0/1893629706 wait complete. 2023-09-21T12:55:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 -- start start 2023-09-21T12:55:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.984+0000 7fecefe0bb80 1 Processor -- start 2023-09-21T12:55:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa57f0f50 con 0x55ffa57ebb90 2023-09-21T12:55:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa57f10c0 con 0x55ffa57ea6a0 2023-09-21T12:55:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffa57f1280 con 0x55ffa57eb000 2023-09-21T12:55:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecefe0bb80 10 client.0 _ll_register_callbacks cb 0x55ffa5622a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecda99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36294/0 (socket says 172.21.15.142:36294) 2023-09-21T12:55:22.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 -- 172.21.15.142:0/3359014085 learned_addr learned my addr 172.21.15.142:0/3359014085 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:22.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecda19b700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:22.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 -- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 msgr2=0x55ffa57f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:22.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 -- 172.21.15.142:0/3359014085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 msgr2=0x55ffa57f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:22.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.985+0000 7fecd999a700 1 -- 172.21.15.142:0/3359014085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc4005ce0 con 0x55ffa57eb000 2023-09-21T12:55:22.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecd999a700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fecc40045c0 tx=0x7fecc40045f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24308cb74e0afa51 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:22.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:55:22.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc402b070 con 0x55ffa57eb000 2023-09-21T12:55:22.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecd009e060 con 0x55ffa57eb000 2023-09-21T12:55:22.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecc401eb90 con 0x55ffa57eb000 2023-09-21T12:55:22.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecc4017040 con 0x55ffa57eb000 2023-09-21T12:55:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecefe0bb80 10 client.24994 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ffa5565260 con 0x55ffa57eb000 2023-09-21T12:55:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.986+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd009e060 con 0x55ffa57eb000 2023-09-21T12:55:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fecc4010690 con 0x55ffa57eb000 2023-09-21T12:55:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 10 client.24994 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 10 client.24994 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T12:55:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 20 client.24994 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa58578c0 0x55ffa5853d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 4 client.24994 mds_command: new command op to 24578 tid=0[{"prefix": "status"}] 2023-09-21T12:55:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ffa5734e10 con 0x55ffa58578c0 2023-09-21T12:55:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecda19b700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa58578c0 0x55ffa5853d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecbdffb700 10 client.24994 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.987+0000 7fecda19b700 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa58578c0 0x55ffa5853d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c03fb0ea2cc3c9 server_cookie=a778edb84a9c9829 in_seq=0 out_seq=0 2023-09-21T12:55:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecbdffb700 1 -- 172.21.15.142:0/3359014085 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55ffa5734e10 con 0x55ffa58578c0 2023-09-21T12:55:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecbdffb700 10 client.24994 handle_command_reply: tid=0 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 client.24994 shutdown 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 msgr2=0x55ffa57fb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fecc40045c0 tx=0x7fecc40045f0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 shutdown_connections 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ffa58578c0 0x55ffa5853d20 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ffa57ebb90 0x55ffa57f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ffa57ea6a0 0x55ffa57f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 --2- 172.21.15.142:0/3359014085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ffa57eb000 0x55ffa57fb290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecbdffb700 0 client.24994 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:22.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 >> 172.21.15.142:0/3359014085 conn(0x55ffa5716fb0 msgr2=0x55ffa57e1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 shutdown_connections 2023-09-21T12:55:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 1 -- 172.21.15.142:0/3359014085 wait complete. 2023-09-21T12:55:22.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.988+0000 7fecefe0bb80 20 client.24994 trim_cache size 0 max 16384 2023-09-21T12:55:22.011 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-21T12:55:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24578, 2023-09-21T12:55:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:22.012 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 69.528229984999996, 2023-09-21T12:55:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:22.013 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:22.014 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 75.576697358999994 2023-09-21T12:55:22.014 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:22.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 msgr2=0x7fecc00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 0x7fecc00a2c10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feccc009fd0 tx=0x7feccc009920 comp rx=0 tx=0).stop 2023-09-21T12:55:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 msgr2=0x7fecd4074b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009fd0 tx=0x7fecd000f690 comp rx=0 tx=0).stop 2023-09-21T12:55:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 shutdown_connections 2023-09-21T12:55:22.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fecc00a0750 0x7fecc00a2c10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fecd4100df0 0x7fecd4074b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fecd4102980 0x7fecd4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 --2- 172.21.15.142:0/1351663447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecd4101fe0 0x7fecd40731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 >> 172.21.15.142:0/1351663447 conn(0x7fecd40fc360 msgr2=0x7fecd41054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:22.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 shutdown_connections 2023-09-21T12:55:22.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:21.989+0000 7fecdc3ff700 1 -- 172.21.15.142:0/1351663447 wait complete. 2023-09-21T12:55:22.018 INFO:tasks.cephadm:Setup complete, yielding 2023-09-21T12:55:22.019 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-21T12:55:22.029 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:55:22.030 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch status' 2023-09-21T12:55:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:21 smithi156 ceph-mon[134078]: pgmap v306: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/886842010' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:21 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2440855325' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:22.747 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:23 smithi160 ceph-mon[134450]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:23 smithi156 ceph-mon[134078]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:24.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:23 smithi142 ceph-mon[97663]: pgmap v307: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:24.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 -- 172.21.15.142:0/401244911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0100e70 msgr2=0x7f05c0101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 --2- 172.21.15.142:0/401244911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0100e70 0x7f05c0101290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f05bc009990 tx=0x7f05bc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 -- 172.21.15.142:0/401244911 shutdown_connections 2023-09-21T12:55:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 --2- 172.21.15.142:0/401244911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 --2- 172.21.15.142:0/401244911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0100e70 0x7f05c0101290 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 --2- 172.21.15.142:0/401244911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0101fd0 0x7f05c0102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 -- 172.21.15.142:0/401244911 >> 172.21.15.142:0/401244911 conn(0x7f05c00fc3d0 msgr2=0x7f05c00fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:24.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 -- 172.21.15.142:0/401244911 shutdown_connections 2023-09-21T12:55:24.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.449+0000 7f05c7488700 1 -- 172.21.15.142:0/401244911 wait complete. 2023-09-21T12:55:24.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.450+0000 7f05c7488700 1 Processor -- start 2023-09-21T12:55:24.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 -- start start 2023-09-21T12:55:24.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:24.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0101fd0 0x7f05c0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:24.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:24.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01a0890 con 0x7f05c0102990 2023-09-21T12:55:24.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01a09d0 con 0x7f05c0100e70 2023-09-21T12:55:24.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c7488700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c01a0b90 con 0x7f05c0101fd0 2023-09-21T12:55:24.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c5224700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:24.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c4a23700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0101fd0 0x7f05c0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:24.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c5224700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56836/0 (socket says 172.21.15.142:56836) 2023-09-21T12:55:24.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.451+0000 7f05c5224700 1 -- 172.21.15.142:0/3697194825 learned_addr learned my addr 172.21.15.142:0/3697194825 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 -- 172.21.15.142:0/3697194825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0101fd0 msgr2=0x7f05c0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0101fd0 0x7f05c0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5a25700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 -- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 msgr2=0x7f05c01a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:24.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 -- 172.21.15.142:0/3697194825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0095f0 con 0x7f05c0100e70 2023-09-21T12:55:24.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5a25700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:55:24.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c5224700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05bc004740 tx=0x7f05bc009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:24.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc01d070 con 0x7f05c0100e70 2023-09-21T12:55:24.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c01a0e10 con 0x7f05c0100e70 2023-09-21T12:55:24.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05bc004830 con 0x7f05c0100e70 2023-09-21T12:55:24.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0053f0 con 0x7f05c0100e70 2023-09-21T12:55:24.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.452+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c01a11c0 con 0x7f05c0100e70 2023-09-21T12:55:24.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.454+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c0193460 con 0x7f05c0100e70 2023-09-21T12:55:24.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.456+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f05bc0055b0 con 0x7f05c0100e70 2023-09-21T12:55:24.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.458+0000 7f05b67fc700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 0x7f05ac0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:24.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.458+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f05bc0cd4b0 con 0x7f05c0100e70 2023-09-21T12:55:24.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.458+0000 7f05c4a23700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 0x7f05ac0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:24.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.458+0000 7f05c4a23700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 0x7f05ac0a2b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009c60 tx=0x7f05b0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:24.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.460+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f05bc096ec0 con 0x7f05c0100e70 2023-09-21T12:55:24.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.677+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05c002d250 con 0x7f05ac0a06d0 2023-09-21T12:55:24.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.679+0000 7f05b67fc700 1 -- 172.21.15.142:0/3697194825 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f05c002d250 con 0x7f05ac0a06d0 2023-09-21T12:55:24.678 INFO:teuthology.orchestra.run.smithi142.stdout:Backend: cephadm 2023-09-21T12:55:24.678 INFO:teuthology.orchestra.run.smithi142.stdout:Available: Yes 2023-09-21T12:55:24.679 INFO:teuthology.orchestra.run.smithi142.stdout:Paused: No 2023-09-21T12:55:24.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 msgr2=0x7f05ac0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:24.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 0x7f05ac0a2b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05b0009c60 tx=0x7f05b0009260 comp rx=0 tx=0).stop 2023-09-21T12:55:24.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 msgr2=0x7f05c0198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:24.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f05bc004740 tx=0x7f05bc009580 comp rx=0 tx=0).stop 2023-09-21T12:55:24.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 shutdown_connections 2023-09-21T12:55:24.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f05ac0a06d0 0x7f05ac0a2b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f05c0102990 0x7f05c01a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f05c0100e70 0x7f05c0198d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 --2- 172.21.15.142:0/3697194825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05c0101fd0 0x7f05c0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:24.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 >> 172.21.15.142:0/3697194825 conn(0x7f05c00fc3d0 msgr2=0x7f05c01079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:24.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.681+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 shutdown_connections 2023-09-21T12:55:24.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:24.682+0000 7f05c7488700 1 -- 172.21.15.142:0/3697194825 wait complete. 2023-09-21T12:55:25.320 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch ps' 2023-09-21T12:55:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:25 smithi160 ceph-mon[134450]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:25 smithi160 ceph-mon[134450]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:26.043 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:25 smithi156 ceph-mon[134078]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:25 smithi156 ceph-mon[134078]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:25 smithi142 ceph-mon[97663]: pgmap v308: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:25 smithi142 ceph-mon[97663]: from='client.25025 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:27.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/3596933620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 msgr2=0x7f5f441092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:27.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/3596933620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441092b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00b0a0 tx=0x7f5f3c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/3596933620 shutdown_connections 2023-09-21T12:55:27.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/3596933620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441092b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/3596933620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 0x7f5f44101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/3596933620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 0x7f5f44102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/3596933620 >> 172.21.15.142:0/3596933620 conn(0x7f5f440fc3d0 msgr2=0x7f5f440fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:27.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/3596933620 shutdown_connections 2023-09-21T12:55:27.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.660+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/3596933620 wait complete. 2023-09-21T12:55:27.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.661+0000 7f5f4aa1a700 1 Processor -- start 2023-09-21T12:55:27.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 -- start start 2023-09-21T12:55:27.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 0x7f5f44198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:27.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 0x7f5f441993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:27.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:27.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441a09f0 con 0x7f5f44102990 2023-09-21T12:55:27.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441a0b30 con 0x7f5f44100e70 2023-09-21T12:55:27.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f4aa1a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f441a0cc0 con 0x7f5f44101fd0 2023-09-21T12:55:27.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f48fb7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:27.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f48fb7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48996/0 (socket says 172.21.15.142:48996) 2023-09-21T12:55:27.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f48fb7700 1 -- 172.21.15.142:0/1786332570 learned_addr learned my addr 172.21.15.142:0/1786332570 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:27.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f43fff700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 0x7f5f44198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:27.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.662+0000 7f5f437fe700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 0x7f5f441993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:27.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 -- 172.21.15.142:0/1786332570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 msgr2=0x7f5f441993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:27.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 0x7f5f441993a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 -- 172.21.15.142:0/1786332570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 msgr2=0x7f5f44198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:27.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 0x7f5f44198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 -- 172.21.15.142:0/1786332570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c009d00 con 0x7f5f44102990 2023-09-21T12:55:27.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f48fb7700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c006070 tx=0x7f5f3c00bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:27.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c00e040 con 0x7f5f44102990 2023-09-21T12:55:27.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f3c00bdf0 con 0x7f5f44102990 2023-09-21T12:55:27.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0052a0 con 0x7f5f44102990 2023-09-21T12:55:27.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f441a0f40 con 0x7f5f44102990 2023-09-21T12:55:27.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.663+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f441a12f0 con 0x7f5f44102990 2023-09-21T12:55:27.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.664+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f441934c0 con 0x7f5f44102990 2023-09-21T12:55:27.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.666+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f5f3c01d480 con 0x7f5f44102990 2023-09-21T12:55:27.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.668+0000 7f5f417fa700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 0x7f5f2c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:27.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.668+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5f3c0ccda0 con 0x7f5f44102990 2023-09-21T12:55:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.668+0000 7f5f43fff700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 0x7f5f2c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.668+0000 7f5f43fff700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 0x7f5f2c0a2c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009c60 tx=0x7f5f34009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:27.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.672+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5f3c0967b0 con 0x7f5f44102990 2023-09-21T12:55:27.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.882+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f4402d230 con 0x7f5f2c0a0750 2023-09-21T12:55:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.895+0000 7f5f417fa700 1 -- 172.21.15.142:0/1786332570 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f5f4402d230 con 0x7f5f2c0a0750 2023-09-21T12:55:27.896 INFO:teuthology.orchestra.run.smithi142.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-09-21T12:55:27.896 INFO:teuthology.orchestra.run.smithi142.stdout:mds.a smithi142 running (84s) - 83s 17.7M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 0078e2cd103f 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.b smithi156 running (81s) - 81s 29.6M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a a93b787f7a51 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.c smithi160 running (95s) - 94s 18.8M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 09d9fa4f796c 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.d smithi142 running (101s) - 101s 13.8M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a a383fa39620e 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.e smithi156 running (99s) - 99s 14.2M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a e3fd99f14a60 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.f smithi160 running (97s) - 96s 17.2M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 2188fefd9a9c 2023-09-21T12:55:27.897 INFO:teuthology.orchestra.run.smithi142.stdout:mds.g smithi142 running (87s) - 86s 13.7M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 590e890b698d 2023-09-21T12:55:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:mds.h smithi156 running (92s) - 92s 17.3M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 4aa378705319 2023-09-21T12:55:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:mds.i smithi160 running (90s) - 90s 21.8M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a ffad7dbb76cf 2023-09-21T12:55:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:mds.j smithi142 running (104s) - 104s 13.8M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a c2a6804cc09e 2023-09-21T12:55:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:mds.k smithi156 running (108s) - 107s 17.2M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a e8d7c2693768 2023-09-21T12:55:27.898 INFO:teuthology.orchestra.run.smithi142.stdout:mds.l smithi160 running (110s) - 109s 16.5M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a c958c6f37ea9 2023-09-21T12:55:27.899 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.x smithi142 *:9283,8765 running (8m) - 8m 525M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 2e3638b93e46 2023-09-21T12:55:27.899 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.y smithi156 *:8443,8765 running (6m) - 6m 449M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a 417de1d70747 2023-09-21T12:55:27.899 INFO:teuthology.orchestra.run.smithi142.stdout:mgr.z smithi160 *:8443,8765 running (6m) - 6m 450M - 18.0.0-6168-g41c9e835 5dcbd8e3a27a cf06004fb713 2023-09-21T12:55:27.899 INFO:teuthology.orchestra.run.smithi142.stdout:mon.a smithi142 running (8m) - 8m 92.0M 2048M 18.0.0-6168-g41c9e835 5dcbd8e3a27a d53e204945eb 2023-09-21T12:55:27.899 INFO:teuthology.orchestra.run.smithi142.stdout:mon.b smithi156 running (6m) - 6m 66.8M 2048M 18.0.0-6168-g41c9e835 5dcbd8e3a27a ade8653e41b3 2023-09-21T12:55:27.900 INFO:teuthology.orchestra.run.smithi142.stdout:mon.c smithi160 running (7m) - 7m 64.4M 2048M 18.0.0-6168-g41c9e835 5dcbd8e3a27a aba71394e8aa 2023-09-21T12:55:27.900 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 smithi142 running (6m) - 6m 68.0M 4316M 18.0.0-6168-g41c9e835 5dcbd8e3a27a f2fa7581c2cc 2023-09-21T12:55:27.900 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 smithi156 running (5m) - 5m 74.3M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 8bb168139e83 2023-09-21T12:55:27.900 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 smithi160 running (5m) - 5m 74.1M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a c0d930911e9a 2023-09-21T12:55:27.900 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 smithi142 running (5m) - 5m 62.8M 4316M 18.0.0-6168-g41c9e835 5dcbd8e3a27a d60ce6fae059 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 smithi156 running (4m) - 4m 63.4M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a b395df4e7408 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 smithi160 running (4m) - 4m 64.9M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 3ef4c7896ffe 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6 smithi142 running (4m) - 4m 58.6M 4316M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 8ca2fb41d2f1 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7 smithi156 running (3m) - 3m 62.6M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a a73ff24c6a72 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.8 smithi160 running (3m) - 3m 60.5M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a a7c64daa55f1 2023-09-21T12:55:27.901 INFO:teuthology.orchestra.run.smithi142.stdout:osd.9 smithi142 running (2m) - 2m 55.8M 4316M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 543f7e27da04 2023-09-21T12:55:27.902 INFO:teuthology.orchestra.run.smithi142.stdout:osd.10 smithi156 running (2m) - 2m 62.7M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 84b3f7d6e5b4 2023-09-21T12:55:27.902 INFO:teuthology.orchestra.run.smithi142.stdout:osd.11 smithi160 running (2m) - 2m 53.5M 4292M 18.0.0-6168-g41c9e835 5dcbd8e3a27a 694099703ffd 2023-09-21T12:55:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 msgr2=0x7f5f2c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 0x7f5f2c0a2c10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009c60 tx=0x7f5f34009260 comp rx=0 tx=0).stop 2023-09-21T12:55:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 msgr2=0x7f5f441a0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c006070 tx=0x7f5f3c00bc80 comp rx=0 tx=0).stop 2023-09-21T12:55:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 shutdown_connections 2023-09-21T12:55:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f2c0a0750 0x7f5f2c0a2c10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f44102990 0x7f5f441a0420 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f44100e70 0x7f5f44198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 --2- 172.21.15.142:0/1786332570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f44101fd0 0x7f5f441993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 >> 172.21.15.142:0/1786332570 conn(0x7f5f440fc3d0 msgr2=0x7f5f44107940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 shutdown_connections 2023-09-21T12:55:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:27.898+0000 7f5f4aa1a700 1 -- 172.21.15.142:0/1786332570 wait complete. 2023-09-21T12:55:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:27 smithi160 ceph-mon[134450]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:28.082 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:27 smithi142 ceph-mon[97663]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:27 smithi156 ceph-mon[134078]: pgmap v309: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:28.420 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch ls' 2023-09-21T12:55:29.146 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:29.807 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:29 smithi142 ceph-mon[97663]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:29.807 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:29 smithi142 ceph-mon[97663]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:29 smithi160 ceph-mon[134450]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:29 smithi160 ceph-mon[134450]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:29 smithi156 ceph-mon[134078]: from='client.14976 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:29 smithi156 ceph-mon[134078]: pgmap v310: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:30.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 -- 172.21.15.142:0/1658215211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c101fd0 msgr2=0x7fc38c102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:30.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 --2- 172.21.15.142:0/1658215211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c101fd0 0x7fc38c102450 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc380009990 tx=0x7fc380009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 -- 172.21.15.142:0/1658215211 shutdown_connections 2023-09-21T12:55:30.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 --2- 172.21.15.142:0/1658215211 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c102990 0x7fc38c1092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 --2- 172.21.15.142:0/1658215211 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 0x7fc38c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 --2- 172.21.15.142:0/1658215211 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c101fd0 0x7fc38c102450 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 -- 172.21.15.142:0/1658215211 >> 172.21.15.142:0/1658215211 conn(0x7fc38c0fc3d0 msgr2=0x7fc38c0fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:30.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.829+0000 7fc39264a700 1 -- 172.21.15.142:0/1658215211 shutdown_connections 2023-09-21T12:55:30.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.830+0000 7fc39264a700 1 -- 172.21.15.142:0/1658215211 wait complete. 2023-09-21T12:55:30.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 Processor -- start 2023-09-21T12:55:30.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 -- start start 2023-09-21T12:55:30.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 0x7fc38c198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:30.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 0x7fc38c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:30.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:30.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c1a08e0 con 0x7fc38c102990 2023-09-21T12:55:30.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c1a0a20 con 0x7fc38c101fd0 2023-09-21T12:55:30.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc39264a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38c1a0be0 con 0x7fc38c100e70 2023-09-21T12:55:30.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc390be7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:30.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc390be7700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49018/0 (socket says 172.21.15.142:49018) 2023-09-21T12:55:30.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc38b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 0x7fc38c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:30.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc390be7700 1 -- 172.21.15.142:0/2668738224 learned_addr learned my addr 172.21.15.142:0/2668738224 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.831+0000 7fc38bfff700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 0x7fc38c198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 -- 172.21.15.142:0/2668738224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 msgr2=0x7fc38c198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 0x7fc38c198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 -- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 msgr2=0x7fc38c1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:30.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 -- 172.21.15.142:0/2668738224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3800095f0 con 0x7fc38c101fd0 2023-09-21T12:55:30.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc390be7700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:30.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc38b7fe700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 0x7fc38c1992d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc380009990 tx=0x7fc380009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:30.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38001d070 con 0x7fc38c101fd0 2023-09-21T12:55:30.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc380003f60 con 0x7fc38c101fd0 2023-09-21T12:55:30.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc380022be0 con 0x7fc38c101fd0 2023-09-21T12:55:30.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.832+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc38c1a0e60 con 0x7fc38c101fd0 2023-09-21T12:55:30.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.833+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38c1a11c0 con 0x7fc38c101fd0 2023-09-21T12:55:30.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.833+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38c10c740 con 0x7fc38c101fd0 2023-09-21T12:55:30.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.836+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7fc3800040d0 con 0x7fc38c101fd0 2023-09-21T12:55:30.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.837+0000 7fc3897fa700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 0x7fc3740a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:30.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.837+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3800cd9a0 con 0x7fc38c101fd0 2023-09-21T12:55:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.837+0000 7fc38bfff700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 0x7fc3740a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.838+0000 7fc38bfff700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 0x7fc3740a2b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc38c19a270 tx=0x7fc37c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:30.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:30.839+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc3800973b0 con 0x7fc38c101fd0 2023-09-21T12:55:31.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.047+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc38c1089c0 con 0x7fc3740a06d0 2023-09-21T12:55:31.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.053+0000 7fc3897fa700 1 -- 172.21.15.142:0/2668738224 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7fc38c1089c0 con 0x7fc3740a06d0 2023-09-21T12:55:31.052 INFO:teuthology.orchestra.run.smithi142.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-09-21T12:55:31.052 INFO:teuthology.orchestra.run.smithi142.stdout:mds.all 12/12 - 115s smithi142=a;smithi142=d;smithi142=g;smithi142=j;smithi156=b;smithi156=e;smithi156=h;smithi156=k;smithi160=c;smithi160=f;smithi160=i;smithi160=l;count:12 2023-09-21T12:55:31.053 INFO:teuthology.orchestra.run.smithi142.stdout:mgr 3/3 - 6m smithi142=x;smithi156=y;smithi160=z;count:3 2023-09-21T12:55:31.053 INFO:teuthology.orchestra.run.smithi142.stdout:mon 3/3 - 7m smithi142:172.21.15.142=a;smithi156:172.21.15.156=b;smithi160:172.21.15.160=c;count:3 2023-09-21T12:55:31.053 INFO:teuthology.orchestra.run.smithi142.stdout:osd 12 - - 2023-09-21T12:55:31.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 msgr2=0x7fc3740a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 0x7fc3740a2b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc38c19a270 tx=0x7fc37c00b410 comp rx=0 tx=0).stop 2023-09-21T12:55:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 msgr2=0x7fc38c1992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 0x7fc38c1992d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc380009990 tx=0x7fc380009580 comp rx=0 tx=0).stop 2023-09-21T12:55:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 shutdown_connections 2023-09-21T12:55:31.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3740a06d0 0x7fc3740a2b90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc38c102990 0x7fc38c1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc38c100e70 0x7fc38c198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 --2- 172.21.15.142:0/2668738224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc38c101fd0 0x7fc38c1992d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 >> 172.21.15.142:0/2668738224 conn(0x7fc38c0fc3d0 msgr2=0x7fc38c0fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:31.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 shutdown_connections 2023-09-21T12:55:31.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:31.055+0000 7fc39264a700 1 -- 172.21.15.142:0/2668738224 wait complete. 2023-09-21T12:55:31.521 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch host ls' 2023-09-21T12:55:31.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:31 smithi142 ceph-mon[97663]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:31 smithi156 ceph-mon[134078]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:32.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:31 smithi160 ceph-mon[134450]: pgmap v311: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:32.250 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:32.898 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:32 smithi142 ceph-mon[97663]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:33.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:32 smithi156 ceph-mon[134078]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:33.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:32 smithi160 ceph-mon[134450]: from='client.25037 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 -- 172.21.15.142:0/4255896005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 msgr2=0x7f7388102450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 --2- 172.21.15.142:0/4255896005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388102450 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7378009990 tx=0x7f7378009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 -- 172.21.15.142:0/4255896005 shutdown_connections 2023-09-21T12:55:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 --2- 172.21.15.142:0/4255896005 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388102990 0x7f73881092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 --2- 172.21.15.142:0/4255896005 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388100e70 0x7f7388101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 --2- 172.21.15.142:0/4255896005 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388102450 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 -- 172.21.15.142:0/4255896005 >> 172.21.15.142:0/4255896005 conn(0x7f73880fc3d0 msgr2=0x7f73880fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:33.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 -- 172.21.15.142:0/4255896005 shutdown_connections 2023-09-21T12:55:33.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.929+0000 7f73904f6700 1 -- 172.21.15.142:0/4255896005 wait complete. 2023-09-21T12:55:33.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.930+0000 7f73904f6700 1 Processor -- start 2023-09-21T12:55:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.930+0000 7f73904f6700 1 -- start start 2023-09-21T12:55:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:33.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388102990 0x7f738819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819e6d0 con 0x7f7388101fd0 2023-09-21T12:55:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819e810 con 0x7f7388102990 2023-09-21T12:55:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f73904f6700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738819e9a0 con 0x7f7388100e70 2023-09-21T12:55:33.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738da91700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56182/0 (socket says 172.21.15.142:56182) 2023-09-21T12:55:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 -- 172.21.15.142:0/1664130611 learned_addr learned my addr 172.21.15.142:0/1664130611 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:33.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738ea93700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388102990 0x7f738819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 -- 172.21.15.142:0/1664130611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388102990 msgr2=0x7f738819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388102990 0x7f738819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 -- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 msgr2=0x7f7388197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:33.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.931+0000 7f738e292700 1 -- 172.21.15.142:0/1664130611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73780095f0 con 0x7f7388100e70 2023-09-21T12:55:33.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f738e292700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f738400e9d0 tx=0x7f738400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:33.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384009790 con 0x7f7388100e70 2023-09-21T12:55:33.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738819ec80 con 0x7f7388100e70 2023-09-21T12:55:33.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f738400ee70 con 0x7f7388100e70 2023-09-21T12:55:33.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384018420 con 0x7f7388100e70 2023-09-21T12:55:33.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.932+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738819f180 con 0x7f7388100e70 2023-09-21T12:55:33.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.933+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7388108460 con 0x7f7388100e70 2023-09-21T12:55:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.935+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f7384010430 con 0x7f7388100e70 2023-09-21T12:55:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.936+0000 7f737f7fe700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 0x7f73740a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.936+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7384014070 con 0x7f7388100e70 2023-09-21T12:55:33.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.936+0000 7f738da91700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 0x7f73740a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:33.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.937+0000 7f738da91700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 0x7f73740a2c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f737800b2e0 tx=0x7f7378005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:33.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:33.941+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7384051e10 con 0x7f7388100e70 2023-09-21T12:55:34.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.144+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f738802d1d0 con 0x7f73740a0750 2023-09-21T12:55:34.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.145+0000 7f737f7fe700 1 -- 172.21.15.142:0/1664130611 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f738802d1d0 con 0x7f73740a0750 2023-09-21T12:55:34.145 INFO:teuthology.orchestra.run.smithi142.stdout:HOST ADDR LABELS STATUS 2023-09-21T12:55:34.145 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 172.21.15.142 2023-09-21T12:55:34.145 INFO:teuthology.orchestra.run.smithi142.stdout:smithi156 172.21.15.156 2023-09-21T12:55:34.146 INFO:teuthology.orchestra.run.smithi142.stdout:smithi160 172.21.15.160 2023-09-21T12:55:34.146 INFO:teuthology.orchestra.run.smithi142.stdout:3 hosts in cluster 2023-09-21T12:55:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 msgr2=0x7f73740a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 0x7f73740a2c10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f737800b2e0 tx=0x7f7378005960 comp rx=0 tx=0).stop 2023-09-21T12:55:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 msgr2=0x7f7388196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f738400e9d0 tx=0x7f738400ece0 comp rx=0 tx=0).stop 2023-09-21T12:55:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 shutdown_connections 2023-09-21T12:55:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f73740a0750 0x7f73740a2c10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7388102990 0x7f738819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7388100e70 0x7f7388196b40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 --2- 172.21.15.142:0/1664130611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7388101fd0 0x7f7388197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 >> 172.21.15.142:0/1664130611 conn(0x7f73880fc3d0 msgr2=0x7f73881055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 shutdown_connections 2023-09-21T12:55:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:34.148+0000 7f73904f6700 1 -- 172.21.15.142:0/1664130611 wait complete. 2023-09-21T12:55:34.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:33 smithi156 ceph-mon[134078]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:34.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:33 smithi142 ceph-mon[97663]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:34.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:33 smithi160 ceph-mon[134450]: pgmap v312: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:34.826 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch device ls' 2023-09-21T12:55:35.550 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:35.954 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:35 smithi142 ceph-mon[97663]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:35.954 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:35 smithi142 ceph-mon[97663]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:36.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:35 smithi156 ceph-mon[134078]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:36.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:35 smithi156 ceph-mon[134078]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:35 smithi160 ceph-mon[134450]: from='client.25018 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:35 smithi160 ceph-mon[134450]: pgmap v313: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:37.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 -- 172.21.15.142:0/1187016952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254100e70 msgr2=0x7f4254101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:37.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 --2- 172.21.15.142:0/1187016952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254100e70 0x7f4254101290 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4250009990 tx=0x7f4250009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 -- 172.21.15.142:0/1187016952 shutdown_connections 2023-09-21T12:55:37.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 --2- 172.21.15.142:0/1187016952 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254100e70 0x7f4254101290 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 --2- 172.21.15.142:0/1187016952 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254102990 0x7f42541092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 --2- 172.21.15.142:0/1187016952 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254101fd0 0x7f4254102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 -- 172.21.15.142:0/1187016952 >> 172.21.15.142:0/1187016952 conn(0x7f42540fc3d0 msgr2=0x7f42540fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:37.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 -- 172.21.15.142:0/1187016952 shutdown_connections 2023-09-21T12:55:37.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.371+0000 7f425c14d700 1 -- 172.21.15.142:0/1187016952 wait complete. 2023-09-21T12:55:37.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 Processor -- start 2023-09-21T12:55:37.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 -- start start 2023-09-21T12:55:37.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254100e70 0x7f4254198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:37.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:37.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254102990 0x7f42541a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:37.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541a08f0 con 0x7f4254101fd0 2023-09-21T12:55:37.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541a0a30 con 0x7f4254102990 2023-09-21T12:55:37.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.372+0000 7f425c14d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541a0bf0 con 0x7f4254100e70 2023-09-21T12:55:37.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:37.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f4259ee9700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254100e70 0x7f4254198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:37.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46110/0 (socket says 172.21.15.142:46110) 2023-09-21T12:55:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 -- 172.21.15.142:0/333434960 learned_addr learned my addr 172.21.15.142:0/333434960 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f425a6ea700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254102990 0x7f42541a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 -- 172.21.15.142:0/333434960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254100e70 msgr2=0x7f4254198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254100e70 0x7f4254198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 -- 172.21.15.142:0/333434960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254102990 msgr2=0x7f42541a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254102990 0x7f42541a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 -- 172.21.15.142:0/333434960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500095f0 con 0x7f4254101fd0 2023-09-21T12:55:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f42596e8700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f424400e9a0 tx=0x7f424400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:37.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.373+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244009790 con 0x7f4254101fd0 2023-09-21T12:55:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.374+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4244010430 con 0x7f4254101fd0 2023-09-21T12:55:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.374+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244018680 con 0x7f4254101fd0 2023-09-21T12:55:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.374+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42541a0ed0 con 0x7f4254101fd0 2023-09-21T12:55:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.374+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42541a12e0 con 0x7f4254101fd0 2023-09-21T12:55:37.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.375+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42541934c0 con 0x7f4254101fd0 2023-09-21T12:55:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.377+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f42440105a0 con 0x7f4254101fd0 2023-09-21T12:55:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.378+0000 7f424affd700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 0x7f42400a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:37.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.378+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4244014070 con 0x7f4254101fd0 2023-09-21T12:55:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.378+0000 7f4259ee9700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 0x7f42400a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.379+0000 7f4259ee9700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 0x7f42400a2b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f425000b2e0 tx=0x7f4250005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:37.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.382+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4244051e10 con 0x7f4254101fd0 2023-09-21T12:55:37.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.591+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f425410c6d0 con 0x7f42400a06d0 2023-09-21T12:55:37.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.593+0000 7f424affd700 1 -- 172.21.15.142:0/333434960 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f425410c6d0 con 0x7f42400a06d0 2023-09-21T12:55:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-09-21T12:55:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:smithi142 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT6303009Y400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-09-21T12:55:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:smithi156 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760040480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-09-21T12:55:37.593 INFO:teuthology.orchestra.run.smithi142.stdout:smithi160 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JY400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-09-21T12:55:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.595+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 msgr2=0x7f42400a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.595+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 0x7f42400a2b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f425000b2e0 tx=0x7f4250005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.595+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 msgr2=0x7f42541992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.595+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f424400e9a0 tx=0x7f424400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 shutdown_connections 2023-09-21T12:55:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f42400a06d0 0x7f42400a2b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4254102990 0x7f42541a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4254100e70 0x7f4254198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 --2- 172.21.15.142:0/333434960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4254101fd0 0x7f42541992e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 >> 172.21.15.142:0/333434960 conn(0x7f42540fc3d0 msgr2=0x7f42541079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 shutdown_connections 2023-09-21T12:55:37.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:37.596+0000 7f425c14d700 1 -- 172.21.15.142:0/333434960 wait complete. 2023-09-21T12:55:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:37 smithi142 ceph-mon[97663]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:38.126 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-21T12:55:38.135 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:55:38.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph fs dump' 2023-09-21T12:55:38.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:37 smithi156 ceph-mon[134078]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:38.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:37 smithi160 ceph-mon[134450]: pgmap v314: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-09-21T12:55:38.862 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:39.153 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:38 smithi142 ceph-mon[97663]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:38 smithi156 ceph-mon[134078]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:38 smithi160 ceph-mon[134450]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:55:39.831 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:39 smithi142 ceph-mon[97663]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:39 smithi156 ceph-mon[134078]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:39 smithi160 ceph-mon[134450]: pgmap v315: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-09-21T12:55:40.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 -- 172.21.15.142:0/4200156270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 msgr2=0x7f5400101290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:40.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 --2- 172.21.15.142:0/4200156270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400101290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009990 tx=0x7f53fc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 -- 172.21.15.142:0/4200156270 shutdown_connections 2023-09-21T12:55:40.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 --2- 172.21.15.142:0/4200156270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 0x7f54001092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 --2- 172.21.15.142:0/4200156270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400101290 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 --2- 172.21.15.142:0/4200156270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400102450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 -- 172.21.15.142:0/4200156270 >> 172.21.15.142:0/4200156270 conn(0x7f54000fc3d0 msgr2=0x7f54000fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 -- 172.21.15.142:0/4200156270 shutdown_connections 2023-09-21T12:55:40.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.498+0000 7f5407a63700 1 -- 172.21.15.142:0/4200156270 wait complete. 2023-09-21T12:55:40.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.499+0000 7f5407a63700 1 Processor -- start 2023-09-21T12:55:40.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.499+0000 7f5407a63700 1 -- start start 2023-09-21T12:55:40.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:40.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:40.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 0x7f540019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:40.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540019e6c0 con 0x7f5400102990 2023-09-21T12:55:40.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540019e800 con 0x7f5400101fd0 2023-09-21T12:55:40.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5407a63700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540019e990 con 0x7f5400100e70 2023-09-21T12:55:40.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:40.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56212/0 (socket says 172.21.15.142:56212) 2023-09-21T12:55:40.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 -- 172.21.15.142:0/850452937 learned_addr learned my addr 172.21.15.142:0/850452937 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:40.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5406000700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 0x7f540019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:40.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5404ffe700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:40.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 -- 172.21.15.142:0/850452937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 msgr2=0x7f5400197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:40.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 -- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 msgr2=0x7f540019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:40.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 0x7f540019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f54057ff700 1 -- 172.21.15.142:0/850452937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc0095f0 con 0x7f5400100e70 2023-09-21T12:55:40.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.500+0000 7f5404ffe700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:40.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f54057ff700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53fc004770 tx=0x7f53fc009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:40.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc01d070 con 0x7f5400100e70 2023-09-21T12:55:40.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53fc0054f0 con 0x7f5400100e70 2023-09-21T12:55:40.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540019ec10 con 0x7f5400100e70 2023-09-21T12:55:40.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc004c70 con 0x7f5400100e70 2023-09-21T12:55:40.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.501+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540019f020 con 0x7f5400100e70 2023-09-21T12:55:40.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.502+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54001084b0 con 0x7f5400100e70 2023-09-21T12:55:40.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.504+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 17) v1 ==== 135311+0+0 (secure 0 0 0) 0x7f53fc00fbc0 con 0x7f5400100e70 2023-09-21T12:55:40.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.506+0000 7f53f67fc700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 0x7f53ec0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:40.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.506+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f53fc0ccf80 con 0x7f5400100e70 2023-09-21T12:55:40.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.506+0000 7f5404ffe700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 0x7f53ec0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:40.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.506+0000 7f5404ffe700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 0x7f53ec0a2b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009cb0 tx=0x7f53f0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:40.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.510+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f53fc05ae10 con 0x7f5400100e70 2023-09-21T12:55:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.726+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f53fc096d60 con 0x7f5400100e70 2023-09-21T12:55:40.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.761+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f540002d2a0 con 0x7f5400100e70 2023-09-21T12:55:40.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.762+0000 7f53f67fc700 1 -- 172.21.15.142:0/850452937 <== mon.1 v2:172.21.15.160:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2951 (secure 0 0 0) 0x7f53fc096990 con 0x7f5400100e70 2023-09-21T12:55:40.762 INFO:teuthology.orchestra.run.smithi142.stdout:e23 2023-09-21T12:55:40.762 INFO:teuthology.orchestra.run.smithi142.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-09-21T12:55:40.762 INFO:teuthology.orchestra.run.smithi142.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-21T12:55:40.762 INFO:teuthology.orchestra.run.smithi142.stdout:legacy client fscid: 1 2023-09-21T12:55:40.763 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:Filesystem 'cephfs' (1) 2023-09-21T12:55:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:fs_name cephfs 2023-09-21T12:55:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 23 2023-09-21T12:55:40.763 INFO:teuthology.orchestra.run.smithi142.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-09-21T12:55:40.764 INFO:teuthology.orchestra.run.smithi142.stdout:created 2023-09-21T12:54:11.985089+0000 2023-09-21T12:55:40.764 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2023-09-21T12:54:17.432339+0000 2023-09-21T12:55:40.764 INFO:teuthology.orchestra.run.smithi142.stdout:tableserver 0 2023-09-21T12:55:40.764 INFO:teuthology.orchestra.run.smithi142.stdout:root 0 2023-09-21T12:55:40.764 INFO:teuthology.orchestra.run.smithi142.stdout:session_timeout 300 2023-09-21T12:55:40.765 INFO:teuthology.orchestra.run.smithi142.stdout:session_autoclose 300 2023-09-21T12:55:40.765 INFO:teuthology.orchestra.run.smithi142.stdout:max_file_size 1099511627776 2023-09-21T12:55:40.765 INFO:teuthology.orchestra.run.smithi142.stdout:max_xattr_size 65536 2023-09-21T12:55:40.765 INFO:teuthology.orchestra.run.smithi142.stdout:required_client_features {} 2023-09-21T12:55:40.765 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure 0 2023-09-21T12:55:40.766 INFO:teuthology.orchestra.run.smithi142.stdout:last_failure_osd_epoch 0 2023-09-21T12:55:40.766 INFO:teuthology.orchestra.run.smithi142.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-21T12:55:40.766 INFO:teuthology.orchestra.run.smithi142.stdout:max_mds 3 2023-09-21T12:55:40.766 INFO:teuthology.orchestra.run.smithi142.stdout:in 0,1,2 2023-09-21T12:55:40.766 INFO:teuthology.orchestra.run.smithi142.stdout:up {0=24578,1=24559,2=24514} 2023-09-21T12:55:40.767 INFO:teuthology.orchestra.run.smithi142.stdout:failed 2023-09-21T12:55:40.767 INFO:teuthology.orchestra.run.smithi142.stdout:damaged 2023-09-21T12:55:40.767 INFO:teuthology.orchestra.run.smithi142.stdout:stopped 2023-09-21T12:55:40.767 INFO:teuthology.orchestra.run.smithi142.stdout:data_pools [3] 2023-09-21T12:55:40.767 INFO:teuthology.orchestra.run.smithi142.stdout:metadata_pool 2 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:inline_data disabled 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:balancer 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:bal_rank_mask -1 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:standby_count_wanted 0 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.b{0:24578} state up:active seq 3 addr [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.768 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.i{0:24535} state up:standby-replay seq 1 addr [v2:172.21.15.160:6838/39574793,v1:172.21.15.160:6839/39574793] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.a{1:24559} state up:active seq 4 addr [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.h{1:24533} state up:standby-replay seq 1 addr [v2:172.21.15.156:6836/3800669997,v1:172.21.15.156:6837/3800669997] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.c{2:24514} state up:active seq 7 addr [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.769 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.f{2:24502} state up:standby-replay seq 1 addr [v2:172.21.15.160:6834/2687704828,v1:172.21.15.160:6835/2687704828] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.769 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:40.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:40.770 INFO:teuthology.orchestra.run.smithi142.stdout:Standby daemons: 2023-09-21T12:55:40.770 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:40.770 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.j{-1:14445} state up:standby seq 1 addr [v2:172.21.15.142:6834/2681250553,v1:172.21.15.142:6835/2681250553] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.770 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.g{-1:14505} state up:standby seq 1 addr [v2:172.21.15.142:6838/445702531,v1:172.21.15.142:6839/445702531] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.771 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.l{-1:24454} state up:standby seq 1 addr [v2:172.21.15.160:6832/3462586639,v1:172.21.15.160:6833/3462586639] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.771 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.k{-1:24467} state up:standby seq 1 addr [v2:172.21.15.156:6832/3649477303,v1:172.21.15.156:6833/3649477303] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.771 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.d{-1:24488} state up:standby seq 1 addr [v2:172.21.15.142:6836/2227040296,v1:172.21.15.142:6837/2227040296] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.771 INFO:teuthology.orchestra.run.smithi142.stdout:[mds.e{-1:24500} state up:standby seq 1 addr [v2:172.21.15.156:6834/3821479486,v1:172.21.15.156:6835/3821479486] compat {c=[1],r=[1],i=[fff]}] 2023-09-21T12:55:40.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 msgr2=0x7f53ec0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:40.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 0x7f53ec0a2b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009cb0 tx=0x7f53f0009260 comp rx=0 tx=0).stop 2023-09-21T12:55:40.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 msgr2=0x7f5400196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f53fc004770 tx=0x7f53fc009580 comp rx=0 tx=0).stop 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 shutdown_connections 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f53ec0a06d0 0x7f53ec0a2b90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5400102990 0x7f540019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5400100e70 0x7f5400196b30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 --2- 172.21.15.142:0/850452937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5400101fd0 0x7f5400197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 >> 172.21.15.142:0/850452937 conn(0x7f54000fc3d0 msgr2=0x7f54001055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 shutdown_connections 2023-09-21T12:55:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:40.765+0000 7f5407a63700 1 -- 172.21.15.142:0/850452937 wait complete. 2023-09-21T12:55:40.774 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:41.335 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph osd dump' 2023-09-21T12:55:42.063 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:41 smithi156 ceph-mon[134078]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:41 smithi156 ceph-mon[134078]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-09-21T12:55:42.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:41 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/850452937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-21T12:55:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:41 smithi142 ceph-mon[97663]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:41 smithi142 ceph-mon[97663]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-09-21T12:55:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:41 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/850452937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-21T12:55:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:41 smithi160 ceph-mon[134450]: pgmap v316: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 6 op/s 2023-09-21T12:55:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:41 smithi160 ceph-mon[134450]: mgrmap e18: x(active, since 8m), standbys: z, y 2023-09-21T12:55:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:41 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/850452937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-21T12:55:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 -- 172.21.15.142:0/2087919617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208073840 msgr2=0x7f2208073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 --2- 172.21.15.142:0/2087919617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208073840 0x7f2208073cc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009990 tx=0x7f21fc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 -- 172.21.15.142:0/2087919617 shutdown_connections 2023-09-21T12:55:43.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 --2- 172.21.15.142:0/2087919617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208108d40 0x7f220810b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 --2- 172.21.15.142:0/2087919617 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208074e10 0x7f2208073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 --2- 172.21.15.142:0/2087919617 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208073840 0x7f2208073cc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 -- 172.21.15.142:0/2087919617 >> 172.21.15.142:0/2087919617 conn(0x7f22080fc3d0 msgr2=0x7f22080fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:43.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 -- 172.21.15.142:0/2087919617 shutdown_connections 2023-09-21T12:55:43.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.794+0000 7f220cba1700 1 -- 172.21.15.142:0/2087919617 wait complete. 2023-09-21T12:55:43.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.795+0000 7f220cba1700 1 Processor -- start 2023-09-21T12:55:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.795+0000 7f220cba1700 1 -- start start 2023-09-21T12:55:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.795+0000 7f220cba1700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208073840 0x7f2208198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220cba1700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 0x7f2208199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220cba1700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:43.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220cba1700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22081a0950 con 0x7f2208108d40 2023-09-21T12:55:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220cba1700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22081a0a90 con 0x7f2208073840 2023-09-21T12:55:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220cba1700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22081a0c20 con 0x7f2208074e10 2023-09-21T12:55:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:46146/0 (socket says 172.21.15.142:46146) 2023-09-21T12:55:43.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 -- 172.21.15.142:0/2978524271 learned_addr learned my addr 172.21.15.142:0/2978524271 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2205d9b700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 0x7f2208199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f220659c700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208073840 0x7f2208198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 -- 172.21.15.142:0/2978524271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 msgr2=0x7f2208199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 0x7f2208199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 -- 172.21.15.142:0/2978524271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208073840 msgr2=0x7f2208198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208073840 0x7f2208198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 -- 172.21.15.142:0/2978524271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc0095f0 con 0x7f2208108d40 2023-09-21T12:55:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2205d9b700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 0x7f2208199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.796+0000 7f2206d9d700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f220000ef60 tx=0x7f220000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:43.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.797+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2200018070 con 0x7f2208108d40 2023-09-21T12:55:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.797+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f220000f040 con 0x7f2208108d40 2023-09-21T12:55:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.797+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22081a0ea0 con 0x7f2208108d40 2023-09-21T12:55:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.797+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220000ccc0 con 0x7f2208108d40 2023-09-21T12:55:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.797+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22081a12c0 con 0x7f2208108d40 2023-09-21T12:55:43.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.798+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22081073f0 con 0x7f2208108d40 2023-09-21T12:55:43.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.800+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f2200003a00 con 0x7f2208108d40 2023-09-21T12:55:43.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.801+0000 7f21f77fe700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 0x7f21f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:43.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.801+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f22000cb620 con 0x7f2208108d40 2023-09-21T12:55:43.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.801+0000 7f220659c700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 0x7f21f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.802+0000 7f220659c700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 0x7f21f00a2b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22080751f0 tx=0x7f21f80073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:43.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:43.805+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2200095190 con 0x7f2208108d40 2023-09-21T12:55:43.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:43 smithi142 ceph-mon[97663]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-09-21T12:55:44.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.005+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f220810e8e0 con 0x7f2208108d40 2023-09-21T12:55:44.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.006+0000 7f21f77fe700 1 -- 172.21.15.142:0/2978524271 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5307 (secure 0 0 0) 0x7f22000987b0 con 0x7f2208108d40 2023-09-21T12:55:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:epoch 86 2023-09-21T12:55:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T12:55:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:created 2023-09-21T12:46:39.123325+0000 2023-09-21T12:55:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:modified 2023-09-21T12:54:41.553827+0000 2023-09-21T12:55:44.006 INFO:teuthology.orchestra.run.smithi142.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-09-21T12:55:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:crush_version 26 2023-09-21T12:55:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:full_ratio 0.95 2023-09-21T12:55:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:backfillfull_ratio 0.9 2023-09-21T12:55:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:nearfull_ratio 0.85 2023-09-21T12:55:44.007 INFO:teuthology.orchestra.run.smithi142.stdout:require_min_compat_client luminous 2023-09-21T12:55:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:min_compat_client luminous 2023-09-21T12:55:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:require_osd_release reef 2023-09-21T12:55:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:stretch_mode_enabled false 2023-09-21T12:55:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-09-21T12:55:44.008 INFO:teuthology.orchestra.run.smithi142.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-09-21T12:55:44.009 INFO:teuthology.orchestra.run.smithi142.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-09-21T12:55:44.009 INFO:teuthology.orchestra.run.smithi142.stdout:max_osd 12 2023-09-21T12:55:44.009 INFO:teuthology.orchestra.run.smithi142.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6802/3599687873,v1:172.21.15.142:6803/3599687873] [v2:172.21.15.142:6804/3599687873,v1:172.21.15.142:6805/3599687873] exists,up 7ea0a160-c930-4a0c-bec7-4613739a09d7 2023-09-21T12:55:44.009 INFO:teuthology.orchestra.run.smithi142.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6800/247411952,v1:172.21.15.156:6801/247411952] [v2:172.21.15.156:6802/247411952,v1:172.21.15.156:6803/247411952] exists,up 6fbd4acd-e759-44ab-8f94-9cc17468eb03 2023-09-21T12:55:44.009 INFO:teuthology.orchestra.run.smithi142.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6800/3134850125,v1:172.21.15.160:6801/3134850125] [v2:172.21.15.160:6802/3134850125,v1:172.21.15.160:6803/3134850125] exists,up 6abafec8-0f0f-46bd-a696-307d17b092ea 2023-09-21T12:55:44.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.3 up in weight 1 up_from 26 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6810/3058352987,v1:172.21.15.142:6811/3058352987] [v2:172.21.15.142:6812/3058352987,v1:172.21.15.142:6813/3058352987] exists,up ff8696c6-6583-4072-a479-2d6d0ce9ca37 2023-09-21T12:55:44.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.4 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6808/3785987022,v1:172.21.15.156:6809/3785987022] [v2:172.21.15.156:6810/3785987022,v1:172.21.15.156:6811/3785987022] exists,up 6992ad1c-863b-4ac1-8916-f4639f26cc5a 2023-09-21T12:55:44.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.5 up in weight 1 up_from 39 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6808/4176368552,v1:172.21.15.160:6809/4176368552] [v2:172.21.15.160:6810/4176368552,v1:172.21.15.160:6811/4176368552] exists,up 8ae7fea9-544d-49a6-9013-60b6856d3a0e 2023-09-21T12:55:44.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.6 up in weight 1 up_from 47 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6818/231467539,v1:172.21.15.142:6819/231467539] [v2:172.21.15.142:6820/231467539,v1:172.21.15.142:6821/231467539] exists,up 6c35da40-e01d-46b9-bd3c-ddd75f470a44 2023-09-21T12:55:44.010 INFO:teuthology.orchestra.run.smithi142.stdout:osd.7 up in weight 1 up_from 52 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6816/129918073,v1:172.21.15.156:6817/129918073] [v2:172.21.15.156:6818/129918073,v1:172.21.15.156:6819/129918073] exists,up 7529cf76-0674-4014-89b5-2468f2dc7dc3 2023-09-21T12:55:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:osd.8 up in weight 1 up_from 59 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6816/2074363946,v1:172.21.15.160:6817/2074363946] [v2:172.21.15.160:6818/2074363946,v1:172.21.15.160:6819/2074363946] exists,up 0f108a2f-c86d-4470-bfa1-1309dc3a7ccf 2023-09-21T12:55:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:osd.9 up in weight 1 up_from 67 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.142:6826/1610185584,v1:172.21.15.142:6827/1610185584] [v2:172.21.15.142:6828/1610185584,v1:172.21.15.142:6829/1610185584] exists,up daf12b88-9896-4d51-9344-19982347fc29 2023-09-21T12:55:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:osd.10 up in weight 1 up_from 72 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.156:6824/2737214225,v1:172.21.15.156:6825/2737214225] [v2:172.21.15.156:6826/2737214225,v1:172.21.15.156:6827/2737214225] exists,up 0f5dfd0a-9c50-4263-a4ac-8e08f16b1017 2023-09-21T12:55:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.160:6824/742511667,v1:172.21.15.160:6825/742511667] [v2:172.21.15.160:6826/742511667,v1:172.21.15.160:6827/742511667] exists,up f2973989-1721-4164-9d5e-a6fd05b73d52 2023-09-21T12:55:44.011 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 2.13 [2,11] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 2.1c [8,11] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.3 [4,9] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.c [3,9] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.11 [4,8] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.1a [5,6] 2023-09-21T12:55:44.012 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.29 [3,9] 2023-09-21T12:55:44.013 INFO:teuthology.orchestra.run.smithi142.stdout:pg_upmap_items 3.3a [4,7] 2023-09-21T12:55:44.013 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/2205822122 expires 2023-09-22T12:47:40.288815+0000 2023-09-21T12:55:44.013 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/2427588007 expires 2023-09-22T12:47:40.288815+0000 2023-09-21T12:55:44.013 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:6801/3720958087 expires 2023-09-22T12:47:40.288815+0000 2023-09-21T12:55:44.013 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:6800/3720958087 expires 2023-09-22T12:47:40.288815+0000 2023-09-21T12:55:44.014 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/2135445545 expires 2023-09-22T12:47:13.540584+0000 2023-09-21T12:55:44.014 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/1696580850 expires 2023-09-22T12:47:13.540584+0000 2023-09-21T12:55:44.014 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/1982354187 expires 2023-09-22T12:47:13.540584+0000 2023-09-21T12:55:44.014 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:6801/3614708159 expires 2023-09-22T12:47:13.540584+0000 2023-09-21T12:55:44.014 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:6800/3614708159 expires 2023-09-22T12:47:13.540584+0000 2023-09-21T12:55:44.015 INFO:teuthology.orchestra.run.smithi142.stdout:blocklist 172.21.15.142:0/3623066670 expires 2023-09-22T12:47:40.288815+0000 2023-09-21T12:55:44.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 msgr2=0x7f21f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 0x7f21f00a2b00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f22080751f0 tx=0x7f21f80073d0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 msgr2=0x7f22081a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f220000ef60 tx=0x7f220000ef90 comp rx=0 tx=0).stop 2023-09-21T12:55:44.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 shutdown_connections 2023-09-21T12:55:44.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f21f00a0640 0x7f21f00a2b00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2208108d40 0x7f22081a0380 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2208073840 0x7f2208198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 --2- 172.21.15.142:0/2978524271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208074e10 0x7f2208199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.008+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 >> 172.21.15.142:0/2978524271 conn(0x7f22080fc3d0 msgr2=0x7f22080fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:44.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.009+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 shutdown_connections 2023-09-21T12:55:44.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.009+0000 7f220cba1700 1 -- 172.21.15.142:0/2978524271 wait complete. 2023-09-21T12:55:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:43 smithi156 ceph-mon[134078]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-09-21T12:55:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:43 smithi160 ceph-mon[134450]: pgmap v317: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 6 op/s 2023-09-21T12:55:44.534 INFO:teuthology.run_tasks:Running task fs.ready... 2023-09-21T12:55:44.548 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 -- 172.21.15.142:0/2721898327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188101fe0 msgr2=0x7f8188102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 --2- 172.21.15.142:0/2721898327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188101fe0 0x7f8188102440 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f81780099c0 tx=0x7f8178009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 -- 172.21.15.142:0/2721898327 shutdown_connections 2023-09-21T12:55:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 --2- 172.21.15.142:0/2721898327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 0x7f8188109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 --2- 172.21.15.142:0/2721898327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188100df0 0x7f8188101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 --2- 172.21.15.142:0/2721898327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188101fe0 0x7f8188102440 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 -- 172.21.15.142:0/2721898327 >> 172.21.15.142:0/2721898327 conn(0x7f81880fc320 msgr2=0x7f81880fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 -- 172.21.15.142:0/2721898327 shutdown_connections 2023-09-21T12:55:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.752+0000 7f818fdff700 1 -- 172.21.15.142:0/2721898327 wait complete. 2023-09-21T12:55:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 Processor -- start 2023-09-21T12:55:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 -- start start 2023-09-21T12:55:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188101fe0 0x7f8188199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 0x7f81881a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.753+0000 7f818fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a0830 con 0x7f8188100df0 2023-09-21T12:55:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a09a0 con 0x7f8188102980 2023-09-21T12:55:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81881a0b60 con 0x7f8188101fe0 2023-09-21T12:55:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56650/0 (socket says 172.21.15.142:56650) 2023-09-21T12:55:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 -- 172.21.15.142:0/3863116253 learned_addr learned my addr 172.21.15.142:0/3863116253 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:44.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818e39c700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 0x7f81881a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:44.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818d39a700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188101fe0 0x7f8188199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:44.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 -- 172.21.15.142:0/3863116253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188101fe0 msgr2=0x7f8188199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188101fe0 0x7f8188199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 -- 172.21.15.142:0/3863116253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 msgr2=0x7f81881a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 0x7f81881a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 -- 172.21.15.142:0/3863116253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780095f0 con 0x7f8188100df0 2023-09-21T12:55:44.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f818db9b700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f818400d980 tx=0x7f818400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:44.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.754+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400f890 con 0x7f8188100df0 2023-09-21T12:55:44.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.755+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8184010460 con 0x7f8188100df0 2023-09-21T12:55:44.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.755+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81881a0e40 con 0x7f8188100df0 2023-09-21T12:55:44.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.755+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400e610 con 0x7f8188100df0 2023-09-21T12:55:44.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.755+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81881a1260 con 0x7f8188100df0 2023-09-21T12:55:44.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.756+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f818810c670 con 0x7f8188100df0 2023-09-21T12:55:44.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.758+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f81840108d0 con 0x7f8188100df0 2023-09-21T12:55:44.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.759+0000 7f817effd700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 0x7f81740a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:44.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.759+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f81840cb580 con 0x7f8188100df0 2023-09-21T12:55:44.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.759+0000 7f818d39a700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 0x7f81740a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:44.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.760+0000 7f818d39a700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 0x7f81740a2bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f817800b580 tx=0x7f8178005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:44.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.763+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8184095060 con 0x7f8188100df0 2023-09-21T12:55:44.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:44 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2978524271' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-21T12:55:44.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.968+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81881a1450 con 0x7f8188100df0 2023-09-21T12:55:44.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.970+0000 7f817effd700 1 -- 172.21.15.142:0/3863116253 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f8184098680 con 0x7f8188100df0 2023-09-21T12:55:44.970 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:44.970 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 msgr2=0x7f81740a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 0x7f81740a2bd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f817800b580 tx=0x7f8178005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 msgr2=0x7f8188198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:44.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f818400d980 tx=0x7f818400dc90 comp rx=0 tx=0).stop 2023-09-21T12:55:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 shutdown_connections 2023-09-21T12:55:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f81740a0710 0x7f81740a2bd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8188100df0 0x7f8188198cc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8188102980 0x7f81881a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 --2- 172.21.15.142:0/3863116253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8188101fe0 0x7f8188199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.972+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 >> 172.21.15.142:0/3863116253 conn(0x7f81880fc320 msgr2=0x7f81880fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.973+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 shutdown_connections 2023-09-21T12:55:44.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:44.973+0000 7f818fdff700 1 -- 172.21.15.142:0/3863116253 wait complete. 2023-09-21T12:55:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:44.991 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:45.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:44 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2978524271' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-21T12:55:45.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:44 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2978524271' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-21T12:55:45.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.193+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/801844698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 msgr2=0x7f2d68101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.193+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/801844698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68101210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009990 tx=0x7f2d58009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/801844698 shutdown_connections 2023-09-21T12:55:45.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/801844698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d68109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/801844698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68101210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/801844698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/801844698 >> 172.21.15.142:0/801844698 conn(0x7f2d680fc360 msgr2=0x7f2d680fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:45.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/801844698 shutdown_connections 2023-09-21T12:55:45.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.194+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/801844698 wait complete. 2023-09-21T12:55:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 Processor -- start 2023-09-21T12:55:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 -- start start 2023-09-21T12:55:45.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d6819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819e6b0 con 0x7f2d68102980 2023-09-21T12:55:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819e7f0 con 0x7f2d68101fe0 2023-09-21T12:55:45.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d6d3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6819e980 con 0x7f2d68100df0 2023-09-21T12:55:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d6819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d667fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d6819e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56670/0 (socket says 172.21.15.142:56670) 2023-09-21T12:55:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d677fe700 1 -- 172.21.15.142:0/1726994777 learned_addr learned my addr 172.21.15.142:0/1726994777 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:45.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.195+0000 7f2d66ffd700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 -- 172.21.15.142:0/1726994777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 msgr2=0x7f2d68196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 -- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 msgr2=0x7f2d6819e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d6819e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 -- 172.21.15.142:0/1726994777 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580095f0 con 0x7f2d68101fe0 2023-09-21T12:55:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d667fc700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68197070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9f0 tx=0x7f2d5c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00c9c0 con 0x7f2d68101fe0 2023-09-21T12:55:45.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6819ec60 con 0x7f2d68101fe0 2023-09-21T12:55:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d5c010430 con 0x7f2d68101fe0 2023-09-21T12:55:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c018680 con 0x7f2d68101fe0 2023-09-21T12:55:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.196+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6819f170 con 0x7f2d68101fe0 2023-09-21T12:55:45.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.197+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d68107d70 con 0x7f2d68101fe0 2023-09-21T12:55:45.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.199+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f2d5c010860 con 0x7f2d68101fe0 2023-09-21T12:55:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.201+0000 7f2d4ffff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 0x7f2d500a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.201+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d5c014070 con 0x7f2d68101fe0 2023-09-21T12:55:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.201+0000 7f2d66ffd700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 0x7f2d500a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.202+0000 7f2d66ffd700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 0x7f2d500a2b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b2e0 tx=0x7f2d58005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:45.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.203+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2d5c0959e0 con 0x7f2d68101fe0 2023-09-21T12:55:45.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.402+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d6810c7e0 con 0x7f2d68101fe0 2023-09-21T12:55:45.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.402+0000 7f2d4ffff700 1 -- 172.21.15.142:0/1726994777 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d5c099000 con 0x7f2d68101fe0 2023-09-21T12:55:45.402 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:45.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 msgr2=0x7f2d500a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 0x7f2d500a2b00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800b2e0 tx=0x7f2d58005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 msgr2=0x7f2d68197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68197070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9f0 tx=0x7f2d5c00ed00 comp rx=0 tx=0).stop 2023-09-21T12:55:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 shutdown_connections 2023-09-21T12:55:45.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f2d500a0640 0x7f2d500a2b00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2d68102980 0x7f2d6819e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d68100df0 0x7f2d68196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 --2- 172.21.15.142:0/1726994777 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2d68101fe0 0x7f2d68197070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 >> 172.21.15.142:0/1726994777 conn(0x7f2d680fc360 msgr2=0x7f2d680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:45.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 shutdown_connections 2023-09-21T12:55:45.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.405+0000 7f2d6d3ff700 1 -- 172.21.15.142:0/1726994777 wait complete. 2023-09-21T12:55:45.423 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:45.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 -- 172.21.15.142:0/2036352629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620101fc0 msgr2=0x7ff620102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 --2- 172.21.15.142:0/2036352629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620101fc0 0x7ff620102420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff6140099c0 tx=0x7ff614009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 -- 172.21.15.142:0/2036352629 shutdown_connections 2023-09-21T12:55:45.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 --2- 172.21.15.142:0/2036352629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620102960 0x7ff620109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 --2- 172.21.15.142:0/2036352629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff6201011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 --2- 172.21.15.142:0/2036352629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620101fc0 0x7ff620102420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 -- 172.21.15.142:0/2036352629 >> 172.21.15.142:0/2036352629 conn(0x7ff6200fc320 msgr2=0x7ff6200fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:45.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 -- 172.21.15.142:0/2036352629 shutdown_connections 2023-09-21T12:55:45.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.626+0000 7ff625bff700 1 -- 172.21.15.142:0/2036352629 wait complete. 2023-09-21T12:55:45.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.627+0000 7ff625bff700 1 Processor -- start 2023-09-21T12:55:45.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.627+0000 7ff625bff700 1 -- start start 2023-09-21T12:55:45.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101fc0 0x7ff620199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 0x7ff6201a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201a08d0 con 0x7ff620102960 2023-09-21T12:55:45.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201a0a10 con 0x7ff620101fc0 2023-09-21T12:55:45.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff625bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6201a0ba0 con 0x7ff620100dd0 2023-09-21T12:55:45.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 0x7ff6201a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56444/0 (socket says 172.21.15.142:56444) 2023-09-21T12:55:45.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 -- 172.21.15.142:0/1679750430 learned_addr learned my addr 172.21.15.142:0/1679750430 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:45.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61effd700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101fc0 0x7ff620199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 -- 172.21.15.142:0/1679750430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101fc0 msgr2=0x7ff620199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101fc0 0x7ff620199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 -- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 msgr2=0x7ff6201a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 0x7ff6201a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61f7fe700 1 -- 172.21.15.142:0/1679750430 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140095f0 con 0x7ff620100dd0 2023-09-21T12:55:45.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.628+0000 7ff61ffff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 0x7ff6201a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:45.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff61f7fe700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e970 tx=0x7ff61000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:45.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610009790 con 0x7ff620100dd0 2023-09-21T12:55:45.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6201a0e80 con 0x7ff620100dd0 2023-09-21T12:55:45.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff61000c7e0 con 0x7ff620100dd0 2023-09-21T12:55:45.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610003c70 con 0x7ff620100dd0 2023-09-21T12:55:45.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.629+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6201a12a0 con 0x7ff620100dd0 2023-09-21T12:55:45.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.630+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff62010c6a0 con 0x7ff620100dd0 2023-09-21T12:55:45.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.632+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7ff61000cc50 con 0x7ff620100dd0 2023-09-21T12:55:45.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.634+0000 7ff61cff9700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 0x7ff6080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:45.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.634+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff610014070 con 0x7ff620100dd0 2023-09-21T12:55:45.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.634+0000 7ff61effd700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 0x7ff6080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:45.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.634+0000 7ff61effd700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 0x7ff6080a2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b580 tx=0x7ff614005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:45.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.636+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff610095990 con 0x7ff620100dd0 2023-09-21T12:55:45.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.840+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff6201a14f0 con 0x7ff620100dd0 2023-09-21T12:55:45.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.841+0000 7ff61cff9700 1 -- 172.21.15.142:0/1679750430 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff610003dd0 con 0x7ff620100dd0 2023-09-21T12:55:45.840 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:55:45.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 msgr2=0x7ff6080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 0x7ff6080a2b00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff61400b580 tx=0x7ff614005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 msgr2=0x7ff620198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:45.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff61000e970 tx=0x7ff61000ec80 comp rx=0 tx=0).stop 2023-09-21T12:55:45.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 shutdown_connections 2023-09-21T12:55:45.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ff6080a0640 0x7ff6080a2b00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff620102960 0x7ff6201a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff620100dd0 0x7ff620198d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 --2- 172.21.15.142:0/1679750430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff620101fc0 0x7ff620199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:45.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 >> 172.21.15.142:0/1679750430 conn(0x7ff6200fc320 msgr2=0x7ff6200fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:45.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 shutdown_connections 2023-09-21T12:55:45.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:45.843+0000 7ff625bff700 1 -- 172.21.15.142:0/1679750430 wait complete. 2023-09-21T12:55:45.862 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:55:46.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3683119928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 msgr2=0x7fa604109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3683119928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604109210 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc00b0d0 tx=0x7fa5fc00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3683119928 shutdown_connections 2023-09-21T12:55:46.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3683119928 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604109210 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3683119928 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 0x7fa6041011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3683119928 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa604102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3683119928 >> 172.21.15.142:0/3683119928 conn(0x7fa6040fc320 msgr2=0x7fa6040fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:46.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3683119928 shutdown_connections 2023-09-21T12:55:46.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.064+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3683119928 wait complete. 2023-09-21T12:55:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 Processor -- start 2023-09-21T12:55:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 -- start start 2023-09-21T12:55:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 0x7fa604074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa6040731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604073eb0 con 0x7fa604102960 2023-09-21T12:55:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa604074020 con 0x7fa604101fc0 2023-09-21T12:55:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.065+0000 7fa60a7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6041a0c50 con 0x7fa604100dd0 2023-09-21T12:55:46.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56700/0 (socket says 172.21.15.142:56700) 2023-09-21T12:55:46.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 -- 172.21.15.142:0/3987804758 learned_addr learned my addr 172.21.15.142:0/3987804758 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:46.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa6037fe700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa6040731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa603fff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 0x7fa604074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 -- 172.21.15.142:0/3987804758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 msgr2=0x7fa604074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 0x7fa604074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 -- 172.21.15.142:0/3987804758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 msgr2=0x7fa6040731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa6040731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 -- 172.21.15.142:0/3987804758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5fc009d00 con 0x7fa604102960 2023-09-21T12:55:46.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa6037fe700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa6040731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:46.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.066+0000 7fa608d9c700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc008eb0 tx=0x7fa5fc008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.067+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc00e040 con 0x7fa604102960 2023-09-21T12:55:46.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.067+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5fc00bdb0 con 0x7fa604102960 2023-09-21T12:55:46.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.067+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6041a0ed0 con 0x7fa604102960 2023-09-21T12:55:46.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.067+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc01d470 con 0x7fa604102960 2023-09-21T12:55:46.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.067+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6041a12a0 con 0x7fa604102960 2023-09-21T12:55:46.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.068+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60410c640 con 0x7fa604102960 2023-09-21T12:55:46.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.070+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa5fc005020 con 0x7fa604102960 2023-09-21T12:55:46.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.072+0000 7fa6017fa700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 0x7fa5ec0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.072+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa5fc0cce10 con 0x7fa604102960 2023-09-21T12:55:46.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.072+0000 7fa603fff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 0x7fa5ec0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.073+0000 7fa603fff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 0x7fa5ec0a2b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa604101e20 tx=0x7fa5f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.076+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa5fc0d0030 con 0x7fa604102960 2023-09-21T12:55:46.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:45 smithi156 ceph-mon[134078]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:45 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3863116253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:46.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:45 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1726994777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:45 smithi142 ceph-mon[97663]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:45 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3863116253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:45 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1726994777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:45 smithi160 ceph-mon[134450]: pgmap v318: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:45 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3863116253' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:45 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1726994777' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.277+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa604107cb0 con 0x7fa604102960 2023-09-21T12:55:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.277+0000 7fa6017fa700 1 -- 172.21.15.142:0/3987804758 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5fc096980 con 0x7fa604102960 2023-09-21T12:55:46.277 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:55:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.279+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 msgr2=0x7fa5ec0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.279+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 0x7fa5ec0a2b00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa604101e20 tx=0x7fa5f4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.279+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 msgr2=0x7fa604073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.279+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc008eb0 tx=0x7fa5fc008ee0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 shutdown_connections 2023-09-21T12:55:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa5ec0a0640 0x7fa5ec0a2b00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa604102960 0x7fa604073710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa604100dd0 0x7fa604074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 --2- 172.21.15.142:0/3987804758 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa604101fc0 0x7fa6040731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 >> 172.21.15.142:0/3987804758 conn(0x7fa6040fc320 msgr2=0x7fa6040fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 shutdown_connections 2023-09-21T12:55:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.280+0000 7fa60a7ff700 1 -- 172.21.15.142:0/3987804758 wait complete. 2023-09-21T12:55:46.298 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:55:46.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 -- 172.21.15.142:0/1914859539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4102980 msgr2=0x7fedf4109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/1914859539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4102980 0x7fedf4109230 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fedec00b0d0 tx=0x7fedec00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 -- 172.21.15.142:0/1914859539 shutdown_connections 2023-09-21T12:55:46.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/1914859539 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4102980 0x7fedf4109230 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/1914859539 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4100df0 0x7fedf4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/1914859539 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4101fe0 0x7fedf4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 -- 172.21.15.142:0/1914859539 >> 172.21.15.142:0/1914859539 conn(0x7fedf40fc320 msgr2=0x7fedf40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:46.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 -- 172.21.15.142:0/1914859539 shutdown_connections 2023-09-21T12:55:46.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.498+0000 7fedfc1ff700 1 -- 172.21.15.142:0/1914859539 wait complete. 2023-09-21T12:55:46.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.499+0000 7fedfc1ff700 1 Processor -- start 2023-09-21T12:55:46.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.499+0000 7fedfc1ff700 1 -- start start 2023-09-21T12:55:46.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 0x7fedf4198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4102980 0x7fedf41a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41a09b0 con 0x7fedf4101fe0 2023-09-21T12:55:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41a0af0 con 0x7fedf4102980 2023-09-21T12:55:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfc1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41a0c80 con 0x7fedf4100df0 2023-09-21T12:55:46.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 0x7fedf4198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56722/0 (socket says 172.21.15.142:56722) 2023-09-21T12:55:46.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 -- 172.21.15.142:0/790863626 learned_addr learned my addr 172.21.15.142:0/790863626 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:46.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedfa79c700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4102980 0x7fedf41a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 -- 172.21.15.142:0/790863626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 msgr2=0x7fedf4198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 0x7fedf4198e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 -- 172.21.15.142:0/790863626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4102980 msgr2=0x7fedf41a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4102980 0x7fedf41a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 -- 172.21.15.142:0/790863626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec009d00 con 0x7fedf4101fe0 2023-09-21T12:55:46.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf9f9b700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 0x7fedf4198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:46.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.500+0000 7fedf979a700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fede400e9a0 tx=0x7fede400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.501+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4009790 con 0x7fedf4101fe0 2023-09-21T12:55:46.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.501+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fede4010430 con 0x7fedf4101fe0 2023-09-21T12:55:46.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.501+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4018680 con 0x7fedf4101fe0 2023-09-21T12:55:46.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.501+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf41a0f60 con 0x7fedf4101fe0 2023-09-21T12:55:46.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.501+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf41a1390 con 0x7fedf4101fe0 2023-09-21T12:55:46.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.502+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf410c660 con 0x7fedf4101fe0 2023-09-21T12:55:46.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.504+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fede40105a0 con 0x7fedf4101fe0 2023-09-21T12:55:46.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.505+0000 7fedeaffd700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 0x7fede00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.505+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fede4014070 con 0x7fedf4101fe0 2023-09-21T12:55:46.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.505+0000 7fedf9f9b700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 0x7fede00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.506+0000 7fedf9f9b700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 0x7fede00a2bd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedf4101e40 tx=0x7fedf0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.509+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fede4051e10 con 0x7fedf4101fe0 2023-09-21T12:55:46.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.755+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedf41a1830 con 0x7fedf4101fe0 2023-09-21T12:55:46.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.756+0000 7fedeaffd700 1 -- 172.21.15.142:0/790863626 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7fede40cde60 con 0x7fedf4101fe0 2023-09-21T12:55:46.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:46.756 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:55:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 msgr2=0x7fede00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 0x7fede00a2bd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fedf4101e40 tx=0x7fedf0009260 comp rx=0 tx=0).stop 2023-09-21T12:55:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 msgr2=0x7fedf4199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fede400e9a0 tx=0x7fede400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 shutdown_connections 2023-09-21T12:55:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fede00a0710 0x7fede00a2bd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fedf4102980 0x7fedf41a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedf4100df0 0x7fedf4198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 --2- 172.21.15.142:0/790863626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fedf4101fe0 0x7fedf4199370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.758+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 >> 172.21.15.142:0/790863626 conn(0x7fedf40fc320 msgr2=0x7fedf4107840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.759+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 shutdown_connections 2023-09-21T12:55:46.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.759+0000 7fedfc1ff700 1 -- 172.21.15.142:0/790863626 wait complete. 2023-09-21T12:55:46.761 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:46.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:46.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 -- 172.21.15.142:0/1179630167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778100df0 msgr2=0x7f7778101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 --2- 172.21.15.142:0/1179630167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778100df0 0x7f7778101210 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f77740099c0 tx=0x7f7774009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 -- 172.21.15.142:0/1179630167 shutdown_connections 2023-09-21T12:55:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 --2- 172.21.15.142:0/1179630167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778100df0 0x7f7778101210 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 --2- 172.21.15.142:0/1179630167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778102980 0x7f7778109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 --2- 172.21.15.142:0/1179630167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778101fe0 0x7f7778102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 -- 172.21.15.142:0/1179630167 >> 172.21.15.142:0/1179630167 conn(0x7f77780fc320 msgr2=0x7f77780fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 -- 172.21.15.142:0/1179630167 shutdown_connections 2023-09-21T12:55:46.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.976+0000 7f777fdff700 1 -- 172.21.15.142:0/1179630167 wait complete. 2023-09-21T12:55:46.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.977+0000 7f777fdff700 1 Processor -- start 2023-09-21T12:55:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.977+0000 7f777fdff700 1 -- start start 2023-09-21T12:55:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778100df0 0x7f7778074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778101fe0 0x7f77780731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778073eb0 con 0x7f7778102980 2023-09-21T12:55:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7778074020 con 0x7f7778101fe0 2023-09-21T12:55:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77781a0b10 con 0x7f7778100df0 2023-09-21T12:55:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777e39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777db9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778100df0 0x7f7778074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777e39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56746/0 (socket says 172.21.15.142:56746) 2023-09-21T12:55:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777e39c700 1 -- 172.21.15.142:0/3526907134 learned_addr learned my addr 172.21.15.142:0/3526907134 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:46.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777d39a700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778101fe0 0x7f77780731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.978+0000 7f777e39c700 1 -- 172.21.15.142:0/3526907134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778100df0 msgr2=0x7f7778074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777e39c700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778100df0 0x7f7778074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777e39c700 1 -- 172.21.15.142:0/3526907134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778101fe0 msgr2=0x7f77780731d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777e39c700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778101fe0 0x7f77780731d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:46.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777e39c700 1 -- 172.21.15.142:0/3526907134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77740095f0 con 0x7f7778102980 2023-09-21T12:55:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777e39c700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7770007ee0 tx=0x7f777000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770017070 con 0x7f7778102980 2023-09-21T12:55:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77781a0df0 con 0x7f7778102980 2023-09-21T12:55:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777000f040 con 0x7f7778102980 2023-09-21T12:55:46.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770005550 con 0x7f7778102980 2023-09-21T12:55:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.979+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77781a1280 con 0x7f7778102980 2023-09-21T12:55:46.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.980+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777810c650 con 0x7f7778102980 2023-09-21T12:55:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.982+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f777000db20 con 0x7f7778102980 2023-09-21T12:55:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.983+0000 7f776effd700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 0x7f77640a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.984+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f77700cb340 con 0x7f7778102980 2023-09-21T12:55:46.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.984+0000 7f777db9b700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 0x7f77640a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.984+0000 7f777db9b700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 0x7f77640a2bd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7774009990 tx=0x7f7774005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:46.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:46.988+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7770094e20 con 0x7f7778102980 2023-09-21T12:55:47.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:46 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1679750430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:46 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3987804758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1679750430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3987804758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:46 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1679750430' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:46 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3987804758' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:47.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.190+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77781a1470 con 0x7f7778102980 2023-09-21T12:55:47.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.191+0000 7f776effd700 1 -- 172.21.15.142:0/3526907134 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f7770098440 con 0x7f7778102980 2023-09-21T12:55:47.191 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:47.192 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:47.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 msgr2=0x7f77640a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 0x7f77640a2bd0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7774009990 tx=0x7f7774005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 msgr2=0x7f7778073710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7770007ee0 tx=0x7f777000d3b0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 shutdown_connections 2023-09-21T12:55:47.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f77640a0710 0x7f77640a2bd0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7778102980 0x7f7778073710 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7778100df0 0x7f7778074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 --2- 172.21.15.142:0/3526907134 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7778101fe0 0x7f77780731d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 >> 172.21.15.142:0/3526907134 conn(0x7f77780fc320 msgr2=0x7f77780fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:47.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 shutdown_connections 2023-09-21T12:55:47.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.194+0000 7f777fdff700 1 -- 172.21.15.142:0/3526907134 wait complete. 2023-09-21T12:55:47.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:47.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.415+0000 7fd9217ff700 1 -- 172.21.15.142:0/296583614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c102980 msgr2=0x7fd91c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.415+0000 7fd9217ff700 1 --2- 172.21.15.142:0/296583614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c102980 0x7fd91c109230 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd91400b0d0 tx=0x7fd91400b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.415+0000 7fd9217ff700 1 -- 172.21.15.142:0/296583614 shutdown_connections 2023-09-21T12:55:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.415+0000 7fd9217ff700 1 --2- 172.21.15.142:0/296583614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c102980 0x7fd91c109230 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.416+0000 7fd9217ff700 1 --2- 172.21.15.142:0/296583614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 0x7fd91c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.416+0000 7fd9217ff700 1 --2- 172.21.15.142:0/296583614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c101fe0 0x7fd91c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.416+0000 7fd9217ff700 1 -- 172.21.15.142:0/296583614 >> 172.21.15.142:0/296583614 conn(0x7fd91c0fc360 msgr2=0x7fd91c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.416+0000 7fd9217ff700 1 -- 172.21.15.142:0/296583614 shutdown_connections 2023-09-21T12:55:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.416+0000 7fd9217ff700 1 -- 172.21.15.142:0/296583614 wait complete. 2023-09-21T12:55:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 Processor -- start 2023-09-21T12:55:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 -- start start 2023-09-21T12:55:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 0x7fd91c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c102980 0x7fd91c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a0940 con 0x7fd91c101fe0 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a0a80 con 0x7fd91c102980 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd9217ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c1a0c10 con 0x7fd91c100df0 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd91a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd91a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56760/0 (socket says 172.21.15.142:56760) 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd91a7fc700 1 -- 172.21.15.142:0/3560923342 learned_addr learned my addr 172.21.15.142:0/3560923342 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd91b7fe700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c102980 0x7fd91c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.417+0000 7fd91affd700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 0x7fd91c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 -- 172.21.15.142:0/3560923342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 msgr2=0x7fd91c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 0x7fd91c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 -- 172.21.15.142:0/3560923342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c102980 msgr2=0x7fd91c1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c102980 0x7fd91c1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 -- 172.21.15.142:0/3560923342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009520 con 0x7fd91c101fe0 2023-09-21T12:55:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd91a7fc700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e9a0 tx=0x7fd91000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910009790 con 0x7fd91c101fe0 2023-09-21T12:55:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd910010430 con 0x7fd91c101fe0 2023-09-21T12:55:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd914009d00 con 0x7fd91c101fe0 2023-09-21T12:55:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910018680 con 0x7fd91c101fe0 2023-09-21T12:55:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.418+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c1a1210 con 0x7fd91c101fe0 2023-09-21T12:55:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.419+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c10c660 con 0x7fd91c101fe0 2023-09-21T12:55:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.421+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fd9100105a0 con 0x7fd91c101fe0 2023-09-21T12:55:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.422+0000 7fd903fff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 0x7fd9040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.423+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd910014070 con 0x7fd91c101fe0 2023-09-21T12:55:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.423+0000 7fd91affd700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 0x7fd9040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.423+0000 7fd91affd700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 0x7fd9040a2b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd91c101e40 tx=0x7fd90c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.426+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd910051e10 con 0x7fd91c101fe0 2023-09-21T12:55:47.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.631+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd91c1a1400 con 0x7fd91c101fe0 2023-09-21T12:55:47.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.631+0000 7fd903fff700 1 -- 172.21.15.142:0/3560923342 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd910095850 con 0x7fd91c101fe0 2023-09-21T12:55:47.631 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.633+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 msgr2=0x7fd9040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.633+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 0x7fd9040a2b00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd91c101e40 tx=0x7fd90c009260 comp rx=0 tx=0).stop 2023-09-21T12:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.633+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 msgr2=0x7fd91c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.633+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd91000e9a0 tx=0x7fd91000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 shutdown_connections 2023-09-21T12:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd9040a0640 0x7fd9040a2b00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd91c102980 0x7fd91c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd91c100df0 0x7fd91c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 --2- 172.21.15.142:0/3560923342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd91c101fe0 0x7fd91c199300 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 >> 172.21.15.142:0/3560923342 conn(0x7fd91c0fc360 msgr2=0x7fd91c107830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 shutdown_connections 2023-09-21T12:55:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.634+0000 7fd9217ff700 1 -- 172.21.15.142:0/3560923342 wait complete. 2023-09-21T12:55:47.652 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:47.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 -- 172.21.15.142:0/4127186229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0101fe0 msgr2=0x7f41e0102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 --2- 172.21.15.142:0/4127186229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0101fe0 0x7f41e0102440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f41d00099c0 tx=0x7f41d0009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 -- 172.21.15.142:0/4127186229 shutdown_connections 2023-09-21T12:55:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 --2- 172.21.15.142:0/4127186229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0102980 0x7f41e0109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 --2- 172.21.15.142:0/4127186229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0100df0 0x7f41e0101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 --2- 172.21.15.142:0/4127186229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0101fe0 0x7f41e0102440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 -- 172.21.15.142:0/4127186229 >> 172.21.15.142:0/4127186229 conn(0x7f41e00fc360 msgr2=0x7f41e00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:47.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 -- 172.21.15.142:0/4127186229 shutdown_connections 2023-09-21T12:55:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.855+0000 7f41e81ff700 1 -- 172.21.15.142:0/4127186229 wait complete. 2023-09-21T12:55:47.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 Processor -- start 2023-09-21T12:55:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 -- start start 2023-09-21T12:55:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0101fe0 0x7f41e0199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0102980 0x7f41e01a02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01a0890 con 0x7f41e0100df0 2023-09-21T12:55:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01a0a00 con 0x7f41e0101fe0 2023-09-21T12:55:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e81ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e01a0bc0 con 0x7f41e0102980 2023-09-21T12:55:47.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.856+0000 7f41e5f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56766/0 (socket says 172.21.15.142:56766) 2023-09-21T12:55:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 -- 172.21.15.142:0/2266955089 learned_addr learned my addr 172.21.15.142:0/2266955089 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e579a700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0101fe0 0x7f41e0199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e679c700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0102980 0x7f41e01a02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 -- 172.21.15.142:0/2266955089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0102980 msgr2=0x7f41e01a02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0102980 0x7f41e01a02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 -- 172.21.15.142:0/2266955089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0101fe0 msgr2=0x7f41e0199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:47.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0101fe0 0x7f41e0199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 -- 172.21.15.142:0/2266955089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d00095f0 con 0x7f41e0100df0 2023-09-21T12:55:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41e5f9b700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e970 tx=0x7f41dc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc009790 con 0x7f41e0100df0 2023-09-21T12:55:47.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f41dc00c7e0 con 0x7f41e0100df0 2023-09-21T12:55:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.857+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc003c70 con 0x7f41e0100df0 2023-09-21T12:55:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.858+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e01a0ea0 con 0x7f41e0100df0 2023-09-21T12:55:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.858+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e01a1270 con 0x7f41e0100df0 2023-09-21T12:55:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.859+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e0193440 con 0x7f41e0100df0 2023-09-21T12:55:47.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.860+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f41dc00cc50 con 0x7f41e0100df0 2023-09-21T12:55:47.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.862+0000 7f41d6ffd700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 0x7f41cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:47.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.862+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f41dc014070 con 0x7f41e0100df0 2023-09-21T12:55:47.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.862+0000 7f41e579a700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 0x7f41cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:47.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.863+0000 7f41e579a700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 0x7f41cc0a2b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b580 tx=0x7f41d0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:47.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:47.866+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f41dc095880 con 0x7f41e0100df0 2023-09-21T12:55:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:47 smithi142 ceph-mon[97663]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-09-21T12:55:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/790863626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3526907134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:47.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3560923342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:48.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.066+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41e002cfa0 con 0x7f41e0100df0 2023-09-21T12:55:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.066+0000 7f41d6ffd700 1 -- 172.21.15.142:0/2266955089 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41dc003dd0 con 0x7f41e0100df0 2023-09-21T12:55:48.066 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:55:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 msgr2=0x7f41cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 0x7f41cc0a2b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f41d000b580 tx=0x7f41d0005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 msgr2=0x7f41e0198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00e970 tx=0x7f41dc00ec80 comp rx=0 tx=0).stop 2023-09-21T12:55:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 shutdown_connections 2023-09-21T12:55:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f41cc0a0640 0x7f41cc0a2b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f41e0100df0 0x7f41e0198d50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41e0102980 0x7f41e01a02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 --2- 172.21.15.142:0/2266955089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f41e0101fe0 0x7f41e0199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 >> 172.21.15.142:0/2266955089 conn(0x7f41e00fc360 msgr2=0x7f41e0107920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 shutdown_connections 2023-09-21T12:55:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.069+0000 7f41e81ff700 1 -- 172.21.15.142:0/2266955089 wait complete. 2023-09-21T12:55:48.088 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:55:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:47 smithi156 ceph-mon[134078]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-09-21T12:55:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/790863626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:48.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3526907134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:48.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3560923342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:47 smithi160 ceph-mon[134450]: pgmap v319: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 5 op/s 2023-09-21T12:55:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/790863626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:48.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3526907134' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:48.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3560923342' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:48.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.289+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/1302848089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08102980 msgr2=0x7f8f08109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.289+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/1302848089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08102980 0x7f8f08109230 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8f0000b0d0 tx=0x7f8f0000b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/1302848089 shutdown_connections 2023-09-21T12:55:48.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/1302848089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08102980 0x7f8f08109230 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/1302848089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08100df0 0x7f8f08101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/1302848089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 0x7f8f08102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/1302848089 >> 172.21.15.142:0/1302848089 conn(0x7f8f080fc360 msgr2=0x7f8f080fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:48.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/1302848089 shutdown_connections 2023-09-21T12:55:48.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.290+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/1302848089 wait complete. 2023-09-21T12:55:48.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 Processor -- start 2023-09-21T12:55:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 -- start start 2023-09-21T12:55:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 0x7f8f08199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08102980 0x7f8f081a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f081a0950 con 0x7f8f08100df0 2023-09-21T12:55:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f081a0a90 con 0x7f8f08102980 2023-09-21T12:55:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f0d1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f081a0c20 con 0x7f8f08101fe0 2023-09-21T12:55:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f06d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56770/0 (socket says 172.21.15.142:56770) 2023-09-21T12:55:48.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.291+0000 7f8f06d9d700 1 -- 172.21.15.142:0/3277911306 learned_addr learned my addr 172.21.15.142:0/3277911306 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:48.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f0759e700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08102980 0x7f8f081a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f0659c700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 0x7f8f08199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 -- 172.21.15.142:0/3277911306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 msgr2=0x7f8f08199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 0x7f8f08199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 -- 172.21.15.142:0/3277911306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08102980 msgr2=0x7f8f081a0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08102980 0x7f8f081a0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 -- 172.21.15.142:0/3277911306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009d00 con 0x7f8f08100df0 2023-09-21T12:55:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f06d9d700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800e970 tx=0x7f8ef800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8009790 con 0x7f8f08100df0 2023-09-21T12:55:48.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f081a0f00 con 0x7f8f08100df0 2023-09-21T12:55:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ef800c7e0 con 0x7f8f08100df0 2023-09-21T12:55:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8003c70 con 0x7f8f08100df0 2023-09-21T12:55:48.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.292+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f081a1330 con 0x7f8f08100df0 2023-09-21T12:55:48.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.293+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0810c610 con 0x7f8f08100df0 2023-09-21T12:55:48.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.295+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f8ef800cc50 con 0x7f8f08100df0 2023-09-21T12:55:48.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.297+0000 7f8eeffff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 0x7f8ef00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.298+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8ef8014070 con 0x7f8f08100df0 2023-09-21T12:55:48.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.298+0000 7f8f0659c700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 0x7f8ef00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.298+0000 7f8f0659c700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 0x7f8ef00a2b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005950 tx=0x7f8efc00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:48.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.301+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8ef8095890 con 0x7f8f08100df0 2023-09-21T12:55:48.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.510+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f081a1580 con 0x7f8f08100df0 2023-09-21T12:55:48.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.510+0000 7f8eeffff700 1 -- 172.21.15.142:0/3277911306 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ef8003dd0 con 0x7f8f08100df0 2023-09-21T12:55:48.510 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:55:48.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 msgr2=0x7f8ef00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 0x7f8ef00a2b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8efc005950 tx=0x7f8efc00b410 comp rx=0 tx=0).stop 2023-09-21T12:55:48.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 msgr2=0x7f8f08198dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800e970 tx=0x7f8ef800ec80 comp rx=0 tx=0).stop 2023-09-21T12:55:48.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 shutdown_connections 2023-09-21T12:55:48.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8ef00a0640 0x7f8ef00a2b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f08100df0 0x7f8f08198dd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f08102980 0x7f8f081a0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 --2- 172.21.15.142:0/3277911306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f08101fe0 0x7f8f08199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 >> 172.21.15.142:0/3277911306 conn(0x7f8f080fc360 msgr2=0x7f8f080fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:48.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 shutdown_connections 2023-09-21T12:55:48.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.513+0000 7f8f0d1ff700 1 -- 172.21.15.142:0/3277911306 wait complete. 2023-09-21T12:55:48.532 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:55:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 -- 172.21.15.142:0/79961171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0074e20 msgr2=0x7f32e0073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 --2- 172.21.15.142:0/79961171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0074e20 0x7f32e0073270 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f32d4009990 tx=0x7f32d4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 -- 172.21.15.142:0/79961171 shutdown_connections 2023-09-21T12:55:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 --2- 172.21.15.142:0/79961171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0074e20 0x7f32e0073270 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 --2- 172.21.15.142:0/79961171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0108ca0 0x7f32e010b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 --2- 172.21.15.142:0/79961171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0073840 0x7f32e0073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 -- 172.21.15.142:0/79961171 >> 172.21.15.142:0/79961171 conn(0x7f32e00fc330 msgr2=0x7f32e00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 -- 172.21.15.142:0/79961171 shutdown_connections 2023-09-21T12:55:48.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.731+0000 7f32e6dff700 1 -- 172.21.15.142:0/79961171 wait complete. 2023-09-21T12:55:48.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.732+0000 7f32e6dff700 1 Processor -- start 2023-09-21T12:55:48.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.732+0000 7f32e6dff700 1 -- start start 2023-09-21T12:55:48.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0073840 0x7f32e0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 0x7f32e01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01a0830 con 0x7f32e0108ca0 2023-09-21T12:55:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01a09a0 con 0x7f32e0073840 2023-09-21T12:55:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e6dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e01a0b60 con 0x7f32e0074e20 2023-09-21T12:55:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 0x7f32e01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56574/0 (socket says 172.21.15.142:56574) 2023-09-21T12:55:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 -- 172.21.15.142:0/3909480940 learned_addr learned my addr 172.21.15.142:0/3909480940 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e4b9b700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0073840 0x7f32e0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 -- 172.21.15.142:0/3909480940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0073840 msgr2=0x7f32e0198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0073840 0x7f32e0198cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 -- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 msgr2=0x7f32e01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 0x7f32e01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32dffff700 1 -- 172.21.15.142:0/3909480940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40095f0 con 0x7f32e0074e20 2023-09-21T12:55:48.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.733+0000 7f32e539c700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 0x7f32e01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:48.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32dffff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00e970 tx=0x7f32cc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:48.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc009790 con 0x7f32e0074e20 2023-09-21T12:55:48.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32cc00c7e0 con 0x7f32e0074e20 2023-09-21T12:55:48.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc003c70 con 0x7f32e0074e20 2023-09-21T12:55:48.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e01a0e40 con 0x7f32e0074e20 2023-09-21T12:55:48.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.734+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e01a1270 con 0x7f32e0074e20 2023-09-21T12:55:48.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.735+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e0107350 con 0x7f32e0074e20 2023-09-21T12:55:48.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.738+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f32cc00cc50 con 0x7f32e0074e20 2023-09-21T12:55:48.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.740+0000 7f32ddffb700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 0x7f32d00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:48.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.740+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f32cc014070 con 0x7f32e0074e20 2023-09-21T12:55:48.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.740+0000 7f32e4b9b700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 0x7f32d00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:48.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.741+0000 7f32e4b9b700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 0x7f32d00a2bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32d400b2e0 tx=0x7f32d4005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:48.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.741+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f32cc095a60 con 0x7f32e0074e20 2023-09-21T12:55:48.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:48 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2266955089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:48.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:48 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3277911306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:48.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.990+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32e002cef0 con 0x7f32e0074e20 2023-09-21T12:55:48.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.991+0000 7f32ddffb700 1 -- 172.21.15.142:0/3909480940 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f32cc003dd0 con 0x7f32e0074e20 2023-09-21T12:55:48.991 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:48.991 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:55:48.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.993+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 msgr2=0x7f32d00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.993+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 0x7f32d00a2bd0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f32d400b2e0 tx=0x7f32d4005fb0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.993+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 msgr2=0x7f32e0199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:48.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.993+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f32cc00e970 tx=0x7f32cc00ec80 comp rx=0 tx=0).stop 2023-09-21T12:55:48.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.993+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 shutdown_connections 2023-09-21T12:55:48.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f32d00a0710 0x7f32d00a2bd0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f32e0108ca0 0x7f32e01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f32e0073840 0x7f32e0198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 --2- 172.21.15.142:0/3909480940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32e0074e20 0x7f32e0199200 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 >> 172.21.15.142:0/3909480940 conn(0x7f32e00fc330 msgr2=0x7f32e00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:48.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 shutdown_connections 2023-09-21T12:55:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:48.994+0000 7f32e6dff700 1 -- 172.21.15.142:0/3909480940 wait complete. 2023-09-21T12:55:48.996 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:55:49.013 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:49.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:48 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2266955089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:49.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:48 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3277911306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:49.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:48 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2266955089' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:49.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:48 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3277911306' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:49.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 -- 172.21.15.142:0/2329084959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588101fe0 msgr2=0x7f7588102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 --2- 172.21.15.142:0/2329084959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588101fe0 0x7f7588102440 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f75740099c0 tx=0x7f7574009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 -- 172.21.15.142:0/2329084959 shutdown_connections 2023-09-21T12:55:49.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 --2- 172.21.15.142:0/2329084959 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588102980 0x7f7588109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 --2- 172.21.15.142:0/2329084959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588100df0 0x7f7588101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 --2- 172.21.15.142:0/2329084959 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588101fe0 0x7f7588102440 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 -- 172.21.15.142:0/2329084959 >> 172.21.15.142:0/2329084959 conn(0x7f75880fc320 msgr2=0x7f75880fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 -- 172.21.15.142:0/2329084959 shutdown_connections 2023-09-21T12:55:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.211+0000 7f758efff700 1 -- 172.21.15.142:0/2329084959 wait complete. 2023-09-21T12:55:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 Processor -- start 2023-09-21T12:55:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 -- start start 2023-09-21T12:55:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 0x7f7588074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 0x7f75880731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588073eb0 con 0x7f7588102980 2023-09-21T12:55:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7588074020 con 0x7f7588100df0 2023-09-21T12:55:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.212+0000 7f758efff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75881a0b90 con 0x7f7588101fe0 2023-09-21T12:55:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758d59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758cd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 0x7f7588074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758d59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56812/0 (socket says 172.21.15.142:56812) 2023-09-21T12:55:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 0x7f75880731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758d59c700 1 -- 172.21.15.142:0/614880939 learned_addr learned my addr 172.21.15.142:0/614880939 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 -- 172.21.15.142:0/614880939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 msgr2=0x7f7588074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 0x7f7588074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 -- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 msgr2=0x7f7588073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 -- 172.21.15.142:0/614880939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740095f0 con 0x7f7588101fe0 2023-09-21T12:55:49.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758cd9b700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 0x7f7588074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f758d59c700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.213+0000 7f7587fff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 0x7f75880731d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7574006010 tx=0x7f757400f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.214+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757401c070 con 0x7f7588101fe0 2023-09-21T12:55:49.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.214+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75881a0e10 con 0x7f7588101fe0 2023-09-21T12:55:49.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.214+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f757400fd60 con 0x7f7588101fe0 2023-09-21T12:55:49.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.214+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574005280 con 0x7f7588101fe0 2023-09-21T12:55:49.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.214+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75881a11d0 con 0x7f7588101fe0 2023-09-21T12:55:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.215+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7588108390 con 0x7f7588101fe0 2023-09-21T12:55:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.217+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f7574020070 con 0x7f7588101fe0 2023-09-21T12:55:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.218+0000 7f7585ffb700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 0x7f75780a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.218+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f75740ccb70 con 0x7f7588101fe0 2023-09-21T12:55:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.218+0000 7f758cd9b700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 0x7f75780a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.218+0000 7f758cd9b700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 0x7f75780a2b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7588101e40 tx=0x7f757c009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.220+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f75740966e0 con 0x7f7588101fe0 2023-09-21T12:55:49.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.422+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f758810c650 con 0x7f7588101fe0 2023-09-21T12:55:49.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.423+0000 7f7585ffb700 1 -- 172.21.15.142:0/614880939 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f7574099d00 con 0x7f7588101fe0 2023-09-21T12:55:49.423 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:49.424 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:49.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 msgr2=0x7f75780a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 0x7f75780a2b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7588101e40 tx=0x7f757c009260 comp rx=0 tx=0).stop 2023-09-21T12:55:49.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 msgr2=0x7f75880731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 0x7f75880731d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7574006010 tx=0x7f757400f670 comp rx=0 tx=0).stop 2023-09-21T12:55:49.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 shutdown_connections 2023-09-21T12:55:49.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f75780a0690 0x7f75780a2b50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7588102980 0x7f7588073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7588100df0 0x7f7588074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 --2- 172.21.15.142:0/614880939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7588101fe0 0x7f75880731d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 >> 172.21.15.142:0/614880939 conn(0x7f75880fc320 msgr2=0x7f75881054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 shutdown_connections 2023-09-21T12:55:49.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.426+0000 7f758efff700 1 -- 172.21.15.142:0/614880939 wait complete. 2023-09-21T12:55:49.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-21T12:54:11.985089+0000', 'modified': '2023-09-21T12:54:17.432339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24578, 'mds_1': 24559, 'mds_2': 24514}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24502': {'gid': 24502, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6835/2687704828', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 2687704828}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 2687704828}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24514': {'gid': 24514, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.160:6837/1554558585', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6836', 'nonce': 1554558585}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 1554558585}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24533': {'gid': 24533, 'name': 'h', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.156:6837/3800669997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6836', 'nonce': 3800669997}, {'type': 'v1', 'addr': '172.21.15.156:6837', 'nonce': 3800669997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24535': {'gid': 24535, 'name': 'i', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.160:6839/39574793', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6838', 'nonce': 39574793}, {'type': 'v1', 'addr': '172.21.15.160:6839', 'nonce': 39574793}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24559': {'gid': 24559, 'name': 'a', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.142:6841/3027031872', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.142:6840', 'nonce': 3027031872}, {'type': 'v1', 'addr': '172.21.15.142:6841', 'nonce': 3027031872}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24578': {'gid': 24578, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.156:6839/1981914736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.156:6838', 'nonce': 1981914736}, {'type': 'v1', 'addr': '172.21.15.156:6839', 'nonce': 1981914736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-21T12:55:49.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-09-21T12:55:49.446 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-21T12:55:49.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 -- 172.21.15.142:0/370486207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394073840 msgr2=0x7f6394073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 --2- 172.21.15.142:0/370486207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394073840 0x7f6394073cc0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f63800098f0 tx=0x7f6380009c00 comp rx=0 tx=0).stop 2023-09-21T12:55:49.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 -- 172.21.15.142:0/370486207 shutdown_connections 2023-09-21T12:55:49.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 --2- 172.21.15.142:0/370486207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394108cb0 0x7f639410b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 --2- 172.21.15.142:0/370486207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394074e20 0x7f6394073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 --2- 172.21.15.142:0/370486207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394073840 0x7f6394073cc0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.646+0000 7f639abff700 1 -- 172.21.15.142:0/370486207 >> 172.21.15.142:0/370486207 conn(0x7f63940fc360 msgr2=0x7f63940fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.647+0000 7f639abff700 1 -- 172.21.15.142:0/370486207 shutdown_connections 2023-09-21T12:55:49.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.647+0000 7f639abff700 1 -- 172.21.15.142:0/370486207 wait complete. 2023-09-21T12:55:49.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.648+0000 7f639abff700 1 Processor -- start 2023-09-21T12:55:49.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.648+0000 7f639abff700 1 -- start start 2023-09-21T12:55:49.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 0x7f6394198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394108cb0 0x7f63941a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63941a08e0 con 0x7f6394074e20 2023-09-21T12:55:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63941a0a20 con 0x7f6394073840 2023-09-21T12:55:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639abff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63941a0bb0 con 0x7f6394108cb0 2023-09-21T12:55:49.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56818/0 (socket says 172.21.15.142:56818) 2023-09-21T12:55:49.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639899b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 0x7f6394198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 -- 172.21.15.142:0/2214107541 learned_addr learned my addr 172.21.15.142:0/2214107541 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639919c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394108cb0 0x7f63941a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 -- 172.21.15.142:0/2214107541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394108cb0 msgr2=0x7f63941a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394108cb0 0x7f63941a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 -- 172.21.15.142:0/2214107541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 msgr2=0x7f6394198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 0x7f6394198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f6393fff700 1 -- 172.21.15.142:0/2214107541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009520 con 0x7f6394074e20 2023-09-21T12:55:49.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.649+0000 7f639899b700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 0x7f6394198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f6393fff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6380009fd0 tx=0x7f638000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f6391ffb700 1 -- 172.21.15.142:0/2214107541 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638001c070 con 0x7f6394074e20 2023-09-21T12:55:49.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f6391ffb700 1 -- 172.21.15.142:0/2214107541 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f638000f7d0 con 0x7f6394074e20 2023-09-21T12:55:49.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63941a0e30 con 0x7f6394074e20 2023-09-21T12:55:49.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f6391ffb700 1 -- 172.21.15.142:0/2214107541 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6380003a20 con 0x7f6394074e20 2023-09-21T12:55:49.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.650+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63941a11a0 con 0x7f6394074e20 2023-09-21T12:55:49.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.653+0000 7f6391ffb700 1 -- 172.21.15.142:0/2214107541 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f6380020030 con 0x7f6394074e20 2023-09-21T12:55:49.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.654+0000 7f6391ffb700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 0x7f63840a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.654+0000 7f63ae473b80 1 Processor -- start 2023-09-21T12:55:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f6391ffb700 1 -- 172.21.15.142:0/2214107541 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63800ccb30 con 0x7f6394074e20 2023-09-21T12:55:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 -- start start 2023-09-21T12:55:49.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f639899b700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 0x7f63840a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 0x55609c718590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718b90 0x55609c719010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c68bc50 con 0x55609c7176a0 2023-09-21T12:55:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c66fc20 con 0x55609c718b90 2023-09-21T12:55:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f63ae473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c66d540 con 0x55609c718000 2023-09-21T12:55:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.655+0000 7f639899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56832/0 (socket says 172.21.15.142:56832) 2023-09-21T12:55:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 -- 172.21.15.142:0/1827331721 learned_addr learned my addr 172.21.15.142:0/1827331721 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639919c700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718b90 0x55609c719010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 0x7f63840a2b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6388005fd0 tx=0x7f6388009310 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f6393fff700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 0x55609c718590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 -- 172.21.15.142:0/1827331721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 msgr2=0x55609c718590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 0x55609c718590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 -- 172.21.15.142:0/1827331721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718b90 msgr2=0x55609c719010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718b90 0x55609c719010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 -- 172.21.15.142:0/1827331721 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55609c493d90 con 0x55609c7176a0 2023-09-21T12:55:49.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f6393fff700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 0x55609c718590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:49.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f639899b700 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6388004380 tx=0x7f6388014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85efb0fa5edb6b31 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f637effd700 1 -- 172.21.15.142:0/1827331721 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6388003c90 con 0x55609c7176a0 2023-09-21T12:55:49.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f637effd700 1 -- 172.21.15.142:0/1827331721 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6388003df0 con 0x55609c7176a0 2023-09-21T12:55:49.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.656+0000 7f637effd700 1 -- 172.21.15.142:0/1827331721 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638800e7d0 con 0x55609c7176a0 2023-09-21T12:55:49.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 -- 172.21.15.142:0/1827331721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 msgr2=0x55609c717ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6388004380 tx=0x7f6388014000 comp rx=0 tx=0).stop 2023-09-21T12:55:49.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 -- 172.21.15.142:0/1827331721 shutdown_connections 2023-09-21T12:55:49.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c717ac0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718b90 0x55609c719010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 --2- 172.21.15.142:0/1827331721 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718000 0x55609c718590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 -- 172.21.15.142:0/1827331721 >> 172.21.15.142:0/1827331721 conn(0x55609c643fb0 msgr2=0x55609c712180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 -- 172.21.15.142:0/1827331721 shutdown_connections 2023-09-21T12:55:49.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.657+0000 7f63ae473b80 1 -- 172.21.15.142:0/1827331721 wait complete. 2023-09-21T12:55:49.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.658+0000 7f63ae473b80 1 -- start start 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.658+0000 7f63ae473b80 1 Processor -- start 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.658+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.658+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7216f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.658+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c728730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f63ae473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c668e30 con 0x55609c7176a0 2023-09-21T12:55:49.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f63ae473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c6056f0 con 0x55609c718000 2023-09-21T12:55:49.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f63ae473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c605390 con 0x55609c718b90 2023-09-21T12:55:49.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f63ae473b80 10 client.0 _ll_register_callbacks cb 0x55609c54fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:49.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56844/0 (socket says 172.21.15.142:56844) 2023-09-21T12:55:49.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 -- 172.21.15.142:0/503570013 learned_addr learned my addr 172.21.15.142:0/503570013 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639919c700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c728730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f6393fff700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7216f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 -- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 msgr2=0x55609c728730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c728730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 -- 172.21.15.142:0/503570013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 msgr2=0x55609c7216f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7216f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 -- 172.21.15.142:0/503570013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6388017070 con 0x55609c7176a0 2023-09-21T12:55:49.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f639899b700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6388003960 tx=0x7f63880053b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3ebfe9d05a005b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.659+0000 7f6373fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638802c070 con 0x55609c7176a0 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55609c5d9b60 con 0x55609c7176a0 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6388005660 con 0x55609c7176a0 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6388004960 con 0x55609c7176a0 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 10 client.15084 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:49.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55609c47cc10 con 0x55609c7176a0 2023-09-21T12:55:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55609c5d9b60 con 0x55609c7176a0 2023-09-21T12:55:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f638803a070 con 0x55609c7176a0 2023-09-21T12:55:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 10 client.15084 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-21T12:55:49.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 20 client.15084 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:49.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c72cb80 0x55609c72b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 4 client.15084 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:49.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.660+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55609c6e5fd0 con 0x55609c72cb80 2023-09-21T12:55:49.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.661+0000 7f6393fff700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c72cb80 0x55609c72b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.661+0000 7f6373fff700 10 client.15084 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:49.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.661+0000 7f6393fff700 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c72cb80 0x55609c72b6f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91d6eb682298a533 server_cookie=21abc83c231f3b2e in_seq=0 out_seq=0 2023-09-21T12:55:49.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f6373fff700 1 -- 172.21.15.142:0/503570013 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55609c6e5fd0 con 0x55609c72cb80 2023-09-21T12:55:49.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f6373fff700 10 client.15084 handle_command_reply: tid=0 2023-09-21T12:55:49.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 client.15084 shutdown 2023-09-21T12:55:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 msgr2=0x55609c7211b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6388003960 tx=0x7f63880053b0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 shutdown_connections 2023-09-21T12:55:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c72cb80 0x55609c72b6f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c7176a0 0x55609c7211b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c728730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 --2- 172.21.15.142:0/503570013 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7216f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f6373fff700 0 client.15084 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:49.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 >> 172.21.15.142:0/503570013 conn(0x55609c643fb0 msgr2=0x55609c711830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 shutdown_connections 2023-09-21T12:55:49.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 1 -- 172.21.15.142:0/503570013 wait complete. 2023-09-21T12:55:49.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.662+0000 7f63ae473b80 20 client.15084 trim_cache size 0 max 16384 2023-09-21T12:55:49.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.680+0000 7f63ae473b80 1 Processor -- start 2023-09-21T12:55:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.680+0000 7f63ae473b80 1 -- start start 2023-09-21T12:55:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 0x55609c718f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c4e98d0 con 0x55609c718b90 2023-09-21T12:55:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c60f470 con 0x55609c718000 2023-09-21T12:55:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f63ae473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c4f5de0 con 0x55609c7176a0 2023-09-21T12:55:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56856/0 (socket says 172.21.15.142:56856) 2023-09-21T12:55:49.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 -- 172.21.15.142:0/734327246 learned_addr learned my addr 172.21.15.142:0/734327246 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639899b700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 0x55609c718f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f6393fff700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 -- 172.21.15.142:0/734327246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 msgr2=0x55609c718f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 0x55609c718f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 -- 172.21.15.142:0/734327246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 msgr2=0x55609c7286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7286f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639919c700 1 -- 172.21.15.142:0/734327246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55609c4ba200 con 0x55609c718b90 2023-09-21T12:55:49.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.681+0000 7f639899b700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 0x55609c718f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f6393fff700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7286f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f639919c700 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f638c011870 tx=0x7f638c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d092ba5d5fe587c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f637f7fe700 1 -- 172.21.15.142:0/734327246 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00e040 con 0x55609c718b90 2023-09-21T12:55:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f637f7fe700 1 -- 172.21.15.142:0/734327246 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f638c00f040 con 0x55609c718b90 2023-09-21T12:55:49.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f637f7fe700 1 -- 172.21.15.142:0/734327246 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c017530 con 0x55609c718b90 2023-09-21T12:55:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f63ae473b80 1 -- 172.21.15.142:0/734327246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 msgr2=0x55609c71bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.682+0000 7f63ae473b80 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f638c011870 tx=0x7f638c009920 comp rx=0 tx=0).stop 2023-09-21T12:55:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 -- 172.21.15.142:0/734327246 shutdown_connections 2023-09-21T12:55:49.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718b90 0x55609c71bb40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c7176a0 0x55609c718f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 --2- 172.21.15.142:0/734327246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c718000 0x55609c7286f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 -- 172.21.15.142:0/734327246 >> 172.21.15.142:0/734327246 conn(0x55609c643fb0 msgr2=0x55609c71eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 -- 172.21.15.142:0/734327246 shutdown_connections 2023-09-21T12:55:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 -- 172.21.15.142:0/734327246 wait complete. 2023-09-21T12:55:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 -- start start 2023-09-21T12:55:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.683+0000 7f63ae473b80 1 Processor -- start 2023-09-21T12:55:49.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c7176a0 0x55609c728420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c725400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c725940 con 0x55609c718000 2023-09-21T12:55:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c725ab0 con 0x55609c7176a0 2023-09-21T12:55:49.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55609c780570 con 0x55609c718b90 2023-09-21T12:55:49.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f63ae473b80 10 client.0 _ll_register_callbacks cb 0x55609c54fa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:49.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56870/0 (socket says 172.21.15.142:56870) 2023-09-21T12:55:49.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 -- 172.21.15.142:0/3242643455 learned_addr learned my addr 172.21.15.142:0/3242643455 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f639899b700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c7176a0 0x55609c728420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f639919c700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c725400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 -- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 msgr2=0x55609c725400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c725400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 -- 172.21.15.142:0/3242643455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c7176a0 msgr2=0x55609c728420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c7176a0 0x55609c728420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 -- 172.21.15.142:0/3242643455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55609c47cc10 con 0x55609c718000 2023-09-21T12:55:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6393fff700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f638002b000 tx=0x7f63800ca4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579453a8b7b10a49 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.684+0000 7f6373fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638009aa60 con 0x55609c718000 2023-09-21T12:55:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6388003df0 con 0x55609c718000 2023-09-21T12:55:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f63800b2070 con 0x55609c718000 2023-09-21T12:55:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f638009a360 con 0x55609c718000 2023-09-21T12:55:49.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 10 client.15090 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f63941a11a0 con 0x55609c718000 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6388003df0 con 0x55609c718000 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6380096a70 con 0x55609c718000 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 10 client.15090 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 10 client.15090 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-21T12:55:49.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 20 client.15090 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c7854f0 0x55609c781930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 4 client.15090 mds_command: new command op to 24514 tid=0[{"prefix": "status"}] 2023-09-21T12:55:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.685+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55609c661e10 con 0x55609c7854f0 2023-09-21T12:55:49.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f639899b700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c7854f0 0x55609c781930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f6373fff700 10 client.15090 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f639899b700 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c7854f0 0x55609c781930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c23a42b1f4fb7386 server_cookie=5231def04780ddee in_seq=0 out_seq=0 2023-09-21T12:55:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f6373fff700 1 -- 172.21.15.142:0/3242643455 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55609c661e10 con 0x55609c7854f0 2023-09-21T12:55:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f6373fff700 10 client.15090 handle_command_reply: tid=0 2023-09-21T12:55:49.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.686+0000 7f63ae473b80 1 client.15090 shutdown 2023-09-21T12:55:49.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 msgr2=0x55609c724ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f638002b000 tx=0x7f63800ca4b0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 shutdown_connections 2023-09-21T12:55:49.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55609c7854f0 0x55609c781930 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55609c718b90 0x55609c725400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55609c7176a0 0x55609c728420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 --2- 172.21.15.142:0/3242643455 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55609c718000 0x55609c724ec0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f6373fff700 0 client.15090 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:55:49.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 >> 172.21.15.142:0/3242643455 conn(0x55609c643fb0 msgr2=0x55609c71bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 shutdown_connections 2023-09-21T12:55:49.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 1 -- 172.21.15.142:0/3242643455 wait complete. 2023-09-21T12:55:49.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f63ae473b80 20 client.15090 trim_cache size 0 max 16384 2023-09-21T12:55:49.706 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:49.706 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:49.706 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 2, 2023-09-21T12:55:49.707 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24514, 2023-09-21T12:55:49.707 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:49.708 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:49.708 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:49.708 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 93.258474617000005, 2023-09-21T12:55:49.709 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:49.709 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:49.709 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:49.709 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 116.483561024 2023-09-21T12:55:49.709 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:49.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 msgr2=0x7f63840a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 0x7f63840a2b00 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6388005fd0 tx=0x7f6388009310 comp rx=0 tx=0).stop 2023-09-21T12:55:49.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 msgr2=0x7f63941992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.687+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6380009fd0 tx=0x7f638000b790 comp rx=0 tx=0).stop 2023-09-21T12:55:49.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 shutdown_connections 2023-09-21T12:55:49.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f63840a0640 0x7f63840a2b00 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6394108cb0 0x7f63941a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6394073840 0x7f6394198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 --2- 172.21.15.142:0/2214107541 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6394074e20 0x7f63941992a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 >> 172.21.15.142:0/2214107541 conn(0x7f63940fc360 msgr2=0x7f63940fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 shutdown_connections 2023-09-21T12:55:49.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.688+0000 7f639abff700 1 -- 172.21.15.142:0/2214107541 wait complete. 2023-09-21T12:55:49.713 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-21T12:55:49.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 -- 172.21.15.142:0/243800933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20102960 msgr2=0x7f1a20109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 --2- 172.21.15.142:0/243800933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20102960 0x7f1a20109210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800b0d0 tx=0x7f1a1800b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 -- 172.21.15.142:0/243800933 shutdown_connections 2023-09-21T12:55:49.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 --2- 172.21.15.142:0/243800933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20102960 0x7f1a20109210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 --2- 172.21.15.142:0/243800933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20100dd0 0x7f1a201011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 --2- 172.21.15.142:0/243800933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20101fc0 0x7f1a20102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 -- 172.21.15.142:0/243800933 >> 172.21.15.142:0/243800933 conn(0x7f1a200fc320 msgr2=0x7f1a200fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 -- 172.21.15.142:0/243800933 shutdown_connections 2023-09-21T12:55:49.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.912+0000 7f1a287ff700 1 -- 172.21.15.142:0/243800933 wait complete. 2023-09-21T12:55:49.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 Processor -- start 2023-09-21T12:55:49.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 -- start start 2023-09-21T12:55:49.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20100dd0 0x7f1a20198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20102960 0x7f1a201a03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a0990 con 0x7f1a20101fc0 2023-09-21T12:55:49.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a0ad0 con 0x7f1a20102960 2023-09-21T12:55:49.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.913+0000 7f1a287ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201a0c60 con 0x7f1a20100dd0 2023-09-21T12:55:49.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20100dd0 0x7f1a20198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56886/0 (socket says 172.21.15.142:56886) 2023-09-21T12:55:49.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 -- 172.21.15.142:0/2912666301 learned_addr learned my addr 172.21.15.142:0/2912666301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20102960 0x7f1a201a03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 -- 172.21.15.142:0/2912666301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20100dd0 msgr2=0x7f1a20198e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20100dd0 0x7f1a20198e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 -- 172.21.15.142:0/2912666301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20102960 msgr2=0x7f1a201a03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20102960 0x7f1a201a03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 -- 172.21.15.142:0/2912666301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c009520 con 0x7f1a20101fc0 2023-09-21T12:55:49.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9a0 tx=0x7f1a1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a177fe700 1 -- 172.21.15.142:0/2912666301 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10009790 con 0x7f1a20101fc0 2023-09-21T12:55:49.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a177fe700 1 -- 172.21.15.142:0/2912666301 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1000cbd0 con 0x7f1a20101fc0 2023-09-21T12:55:49.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a18009d00 con 0x7f1a20101fc0 2023-09-21T12:55:49.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.914+0000 7f1a177fe700 1 -- 172.21.15.142:0/2912666301 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10018680 con 0x7f1a20101fc0 2023-09-21T12:55:49.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.915+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201a1280 con 0x7f1a20101fc0 2023-09-21T12:55:49.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.918+0000 7f1a177fe700 1 -- 172.21.15.142:0/2912666301 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1a1000cd40 con 0x7f1a20101fc0 2023-09-21T12:55:49.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 Processor -- start 2023-09-21T12:55:49.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 -- start start 2023-09-21T12:55:49.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a177fe700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 0x7f1a0c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37e4010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da3756c50 con 0x563da37e3b90 2023-09-21T12:55:49.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da373ac20 con 0x563da37e3000 2023-09-21T12:55:49.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.919+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da3738540 con 0x563da37e26a0 2023-09-21T12:55:49.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a177fe700 1 -- 172.21.15.142:0/2912666301 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a10014070 con 0x7f1a20101fc0 2023-09-21T12:55:49.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 0x7f1a0c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47812/0 (socket says 172.21.15.142:47812) 2023-09-21T12:55:49.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 -- 172.21.15.142:0/995642775 learned_addr learned my addr 172.21.15.142:0/995642775 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a2659b700 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a26d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37e4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 -- 172.21.15.142:0/995642775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 msgr2=0x563da37e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37e2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 -- 172.21.15.142:0/995642775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 msgr2=0x563da37e4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37e4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 -- 172.21.15.142:0/995642775 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da355ed90 con 0x563da37e3000 2023-09-21T12:55:49.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a100a10a0 tx=0x7f1a10099120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b24cccecdad908 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.920+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 0x7f1a0c0a2b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009850 tx=0x7f1a180092e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.921+0000 7f1a14ff9700 1 -- 172.21.15.142:0/995642775 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10099c60 con 0x563da37e3000 2023-09-21T12:55:49.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.921+0000 7f1a14ff9700 1 -- 172.21.15.142:0/995642775 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a100a2490 con 0x563da37e3000 2023-09-21T12:55:49.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.921+0000 7f1a14ff9700 1 -- 172.21.15.142:0/995642775 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1009d390 con 0x563da37e3000 2023-09-21T12:55:49.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.921+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/995642775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 msgr2=0x563da37e3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.921+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a100a10a0 tx=0x7f1a10099120 comp rx=0 tx=0).stop 2023-09-21T12:55:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/995642775 shutdown_connections 2023-09-21T12:55:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37e4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/995642775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37e3590 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/995642775 >> 172.21.15.142:0/995642775 conn(0x563da370efb0 msgr2=0x563da37dd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/995642775 shutdown_connections 2023-09-21T12:55:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/995642775 wait complete. 2023-09-21T12:55:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 -- start start 2023-09-21T12:55:49.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.922+0000 7f1a3c1ecb80 1 Processor -- start 2023-09-21T12:55:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37ec680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da3733e30 con 0x563da37e3b90 2023-09-21T12:55:49.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da36d06f0 con 0x563da37e3000 2023-09-21T12:55:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da36d0390 con 0x563da37e26a0 2023-09-21T12:55:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a3c1ecb80 10 client.0 _ll_register_callbacks cb 0x563da361aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a26d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56684/0 (socket says 172.21.15.142:56684) 2023-09-21T12:55:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 -- 172.21.15.142:0/3779918901 learned_addr learned my addr 172.21.15.142:0/3779918901 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 -- 172.21.15.142:0/3779918901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 msgr2=0x563da37ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 -- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 msgr2=0x563da37f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.923+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a2659b700 1 -- 172.21.15.142:0/3779918901 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201a1280 con 0x563da37e26a0 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0128d0 tx=0x7f1a1c012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c197e6c7b104233c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:55:49.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c017070 con 0x563da37e26a0 2023-09-21T12:55:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563da36a4b60 con 0x563da37e26a0 2023-09-21T12:55:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a1c00f560 con 0x563da37e26a0 2023-09-21T12:55:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a1c0122e0 con 0x563da37e26a0 2023-09-21T12:55:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a3c1ecb80 10 client.25132 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:49.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.924+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563da3547c10 con 0x563da37e26a0 2023-09-21T12:55:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563da36a4b60 con 0x563da37e26a0 2023-09-21T12:55:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a1c010950 con 0x563da37e26a0 2023-09-21T12:55:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 10 client.25132 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 10 client.25132 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T12:55:49.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 20 client.25132 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da37f7da0 0x563da37f6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 4 client.25132 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563da37b0fd0 con 0x563da37f7da0 2023-09-21T12:55:49.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da37f7da0 0x563da37f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da37f7da0 0x563da37f6820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3584b7f7e281cfe2 server_cookie=ef936d45b18e7f0 in_seq=0 out_seq=0 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.925+0000 7f1a09ffb700 10 client.25132 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3779918901 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563da37b0fd0 con 0x563da37f7da0 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a09ffb700 10 client.25132 handle_command_reply: tid=0 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 client.25132 shutdown 2023-09-21T12:55:49.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 msgr2=0x563da37ec140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0128d0 tx=0x7f1a1c012be0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 shutdown_connections 2023-09-21T12:55:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e3b90 0x563da37f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da37f7da0 0x563da37f6820 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e26a0 0x563da37ec140 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3779918901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a09ffb700 0 client.25132 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.926+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 >> 172.21.15.142:0/3779918901 conn(0x563da370efb0 msgr2=0x563da37dc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.927+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 shutdown_connections 2023-09-21T12:55:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.927+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3779918901 wait complete. 2023-09-21T12:55:49.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.927+0000 7f1a3c1ecb80 20 client.25132 trim_cache size 0 max 16384 2023-09-21T12:55:49.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 Processor -- start 2023-09-21T12:55:49.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 -- start start 2023-09-21T12:55:49.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3b90 0x563da37ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da35b48d0 con 0x563da37e26a0 2023-09-21T12:55:49.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da35c0de0 con 0x563da37e3000 2023-09-21T12:55:49.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da36ee820 con 0x563da37e3b90 2023-09-21T12:55:49.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56918/0 (socket says 172.21.15.142:56918) 2023-09-21T12:55:49.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 -- 172.21.15.142:0/1561480619 learned_addr learned my addr 172.21.15.142:0/1561480619 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3b90 0x563da37ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 -- 172.21.15.142:0/1561480619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3b90 msgr2=0x563da37ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3b90 0x563da37ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 -- 172.21.15.142:0/1561480619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 msgr2=0x563da37f35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37f35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.945+0000 7f1a2659b700 1 -- 172.21.15.142:0/1561480619 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da3585200 con 0x563da37e26a0 2023-09-21T12:55:49.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a2659b700 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010cb0 tx=0x7f1a1c014fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c0e7336813f485 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a157fa700 1 -- 172.21.15.142:0/1561480619 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c017040 con 0x563da37e26a0 2023-09-21T12:55:49.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a157fa700 1 -- 172.21.15.142:0/1561480619 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1c010af0 con 0x563da37e26a0 2023-09-21T12:55:49.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a157fa700 1 -- 172.21.15.142:0/1561480619 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c003680 con 0x563da37e26a0 2023-09-21T12:55:49.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/1561480619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 msgr2=0x563da37e3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.946+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c010cb0 tx=0x7f1a1c014fd0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/1561480619 shutdown_connections 2023-09-21T12:55:49.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37e3f70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3b90 0x563da37ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/1561480619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3000 0x563da37f35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/1561480619 >> 172.21.15.142:0/1561480619 conn(0x563da370efb0 msgr2=0x563da37eae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/1561480619 shutdown_connections 2023-09-21T12:55:49.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/1561480619 wait complete. 2023-09-21T12:55:49.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 -- start start 2023-09-21T12:55:49.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.947+0000 7f1a3c1ecb80 1 Processor -- start 2023-09-21T12:55:49.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 0x563da37f34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3b90 0x563da37efa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da37effd0 con 0x563da37e26a0 2023-09-21T12:55:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da37f0140 con 0x563da37e3b90 2023-09-21T12:55:49.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da37f0300 con 0x563da37e3000 2023-09-21T12:55:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a3c1ecb80 10 client.0 _ll_register_callbacks cb 0x563da361aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a2659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56922/0 (socket says 172.21.15.142:56922) 2023-09-21T12:55:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a2659b700 1 -- 172.21.15.142:0/3575005582 learned_addr learned my addr 172.21.15.142:0/3575005582 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 0x563da37f34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a26d9c700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3b90 0x563da37efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 -- 172.21.15.142:0/3575005582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3b90 msgr2=0x563da37efa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3b90 0x563da37efa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 -- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 msgr2=0x563da37f2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 -- 172.21.15.142:0/3575005582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563da3547c10 con 0x563da37e3000 2023-09-21T12:55:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a25d9a700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 0x563da37f34f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x563da37e2440 tx=0x7f1a10084040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b38b67a43c7879d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:49.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.948+0000 7f1a09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:55:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100a15d0 con 0x563da37e3000 2023-09-21T12:55:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a100a2490 con 0x563da37e3000 2023-09-21T12:55:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a1009d390 con 0x563da37e3000 2023-09-21T12:55:49.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a100b7020 con 0x563da37e3000 2023-09-21T12:55:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 10 client.25135 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563da355d260 con 0x563da37e3000 2023-09-21T12:55:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a100a2490 con 0x563da37e3000 2023-09-21T12:55:49.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1a100998e0 con 0x563da37e3000 2023-09-21T12:55:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 10 client.25135 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 10 client.25135 resolve_mds: resolved name 'a' to daemon mds.a 2023-09-21T12:55:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 20 client.25135 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da3850220 0x563da384c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:49.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 4 client.25135 mds_command: new command op to 24559 tid=0[{"prefix": "status"}] 2023-09-21T12:55:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.949+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563da372ce10 con 0x563da3850220 2023-09-21T12:55:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da3850220 0x563da384c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a09ffb700 10 client.25135 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a2659b700 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da3850220 0x563da384c6a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=518555e6cb8163fe server_cookie=db7f51229955cec2 in_seq=0 out_seq=0 2023-09-21T12:55:49.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a09ffb700 1 -- 172.21.15.142:0/3575005582 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563da372ce10 con 0x563da3850220 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a09ffb700 10 client.25135 handle_command_reply: tid=0 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 client.25135 shutdown 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 msgr2=0x563da37f34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 0x563da37f34f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x563da37e2440 tx=0x7f1a10084040 comp rx=0 tx=0).stop 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 shutdown_connections 2023-09-21T12:55:49.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563da37e26a0 0x563da37f2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x563da3850220 0x563da384c6a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563da37e3b90 0x563da37efa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a09ffb700 0 client.25135 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:55:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 --2- 172.21.15.142:0/3575005582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563da37e3000 0x563da37f34f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.950+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 >> 172.21.15.142:0/3575005582 conn(0x563da370efb0 msgr2=0x563da37ea000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 shutdown_connections 2023-09-21T12:55:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a3c1ecb80 1 -- 172.21.15.142:0/3575005582 wait complete. 2023-09-21T12:55:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a3c1ecb80 20 client.25135 trim_cache size 0 max 16384 2023-09-21T12:55:49.972 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 1, 2023-09-21T12:55:49.972 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24559, 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 94.470110129999995, 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:49.973 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:49.974 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 105.890078436 2023-09-21T12:55:49.974 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 msgr2=0x7f1a0c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 0x7f1a0c0a2b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a18009850 tx=0x7f1a180092e0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 msgr2=0x7f1a20199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a1000e9a0 tx=0x7f1a1000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 shutdown_connections 2023-09-21T12:55:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a0c0a06c0 0x7f1a0c0a2b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a20102960 0x7f1a201a03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a20100dd0 0x7f1a20198e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 --2- 172.21.15.142:0/2912666301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a20101fc0 0x7f1a20199350 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.951+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 >> 172.21.15.142:0/2912666301 conn(0x7f1a200fc320 msgr2=0x7f1a200fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.952+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 shutdown_connections 2023-09-21T12:55:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:49.952+0000 7f1a287ff700 1 -- 172.21.15.142:0/2912666301 wait complete. 2023-09-21T12:55:49.977 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:49 smithi142 ceph-mon[97663]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:49.978 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:49 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3909480940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:49.978 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:49 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/614880939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:49.979 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-21T12:55:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:49 smithi156 ceph-mon[134078]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:49 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3909480940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:50.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:49 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/614880939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:50.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 -- 172.21.15.142:0/1389381225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8074e20 msgr2=0x7f55e8073270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 --2- 172.21.15.142:0/1389381225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8074e20 0x7f55e8073270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55dc009990 tx=0x7f55dc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 -- 172.21.15.142:0/1389381225 shutdown_connections 2023-09-21T12:55:50.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 --2- 172.21.15.142:0/1389381225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8108cb0 0x7f55e810b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 --2- 172.21.15.142:0/1389381225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8074e20 0x7f55e8073270 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 --2- 172.21.15.142:0/1389381225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8073840 0x7f55e8073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 -- 172.21.15.142:0/1389381225 >> 172.21.15.142:0/1389381225 conn(0x7f55e80fc360 msgr2=0x7f55e80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 -- 172.21.15.142:0/1389381225 shutdown_connections 2023-09-21T12:55:50.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.177+0000 7f55eefff700 1 -- 172.21.15.142:0/1389381225 wait complete. 2023-09-21T12:55:50.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.178+0000 7f55eefff700 1 Processor -- start 2023-09-21T12:55:50.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.178+0000 7f55eefff700 1 -- start start 2023-09-21T12:55:50.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8074e20 0x7f55e8199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8108cb0 0x7f55e81a0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e81a08d0 con 0x7f55e8073840 2023-09-21T12:55:50.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e81a0a10 con 0x7f55e8108cb0 2023-09-21T12:55:50.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55eefff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e81a0ba0 con 0x7f55e8074e20 2023-09-21T12:55:50.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56932/0 (socket says 172.21.15.142:56932) 2023-09-21T12:55:50.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 -- 172.21.15.142:0/3509467216 learned_addr learned my addr 172.21.15.142:0/3509467216 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8108cb0 0x7f55e81a0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8074e20 0x7f55e8199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 -- 172.21.15.142:0/3509467216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8074e20 msgr2=0x7f55e8199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8074e20 0x7f55e8199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 -- 172.21.15.142:0/3509467216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8108cb0 msgr2=0x7f55e81a0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8108cb0 0x7f55e81a0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.179+0000 7f55ecd9b700 1 -- 172.21.15.142:0/3509467216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc0095f0 con 0x7f55e8073840 2023-09-21T12:55:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55dc004740 tx=0x7f55dc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55e5ffb700 1 -- 172.21.15.142:0/3509467216 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc01d070 con 0x7f55e8073840 2023-09-21T12:55:50.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e81a0e20 con 0x7f55e8073840 2023-09-21T12:55:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55e5ffb700 1 -- 172.21.15.142:0/3509467216 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55dc004830 con 0x7f55e8073840 2023-09-21T12:55:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55e5ffb700 1 -- 172.21.15.142:0/3509467216 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55dc0053c0 con 0x7f55e8073840 2023-09-21T12:55:50.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.180+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e81a1190 con 0x7f55e8073840 2023-09-21T12:55:50.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.183+0000 7f55e5ffb700 1 -- 172.21.15.142:0/3509467216 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f55dc005580 con 0x7f55e8073840 2023-09-21T12:55:50.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.184+0000 7f55e5ffb700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 0x7f55d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.184+0000 7f560296eb80 1 Processor -- start 2023-09-21T12:55:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55e5ffb700 1 -- 172.21.15.142:0/3509467216 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55dc0ccd80 con 0x7f55e8073840 2023-09-21T12:55:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 -- start start 2023-09-21T12:55:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 0x7f55d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de556a0 0x55f04de55ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de56000 0x55f04de56590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04ddc9c50 con 0x55f04de56b90 2023-09-21T12:55:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04ddadc20 con 0x55f04de56000 2023-09-21T12:55:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f560296eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04ddab540 con 0x55f04de556a0 2023-09-21T12:55:50.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 0x7f55d80a2b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f55e8074b40 tx=0x7f55d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55ed59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55ed59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56934/0 (socket says 172.21.15.142:56934) 2023-09-21T12:55:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.185+0000 7f55ed59c700 1 -- 172.21.15.142:0/3572123569 learned_addr learned my addr 172.21.15.142:0/3572123569 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:50.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de56000 0x55f04de56590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de556a0 0x55f04de55ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 -- 172.21.15.142:0/3572123569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de556a0 msgr2=0x55f04de55ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de556a0 0x55f04de55ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 -- 172.21.15.142:0/3572123569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de56000 msgr2=0x55f04de56590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de56000 0x55f04de56590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 -- 172.21.15.142:0/3572123569 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f04dbd1d90 con 0x55f04de56b90 2023-09-21T12:55:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f55e0011680 tx=0x7f55e0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a392357f19bf4a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55d2ffd700 1 -- 172.21.15.142:0/3572123569 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000e040 con 0x55f04de56b90 2023-09-21T12:55:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55d2ffd700 1 -- 172.21.15.142:0/3572123569 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55e000f040 con 0x55f04de56b90 2023-09-21T12:55:50.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.186+0000 7f55d2ffd700 1 -- 172.21.15.142:0/3572123569 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e00048a0 con 0x55f04de56b90 2023-09-21T12:55:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 -- 172.21.15.142:0/3572123569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 msgr2=0x55f04de57010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f55e0011680 tx=0x7f55e0009920 comp rx=0 tx=0).stop 2023-09-21T12:55:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 -- 172.21.15.142:0/3572123569 shutdown_connections 2023-09-21T12:55:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56b90 0x55f04de57010 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de556a0 0x55f04de55ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 --2- 172.21.15.142:0/3572123569 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de56000 0x55f04de56590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 -- 172.21.15.142:0/3572123569 >> 172.21.15.142:0/3572123569 conn(0x55f04dd81fb0 msgr2=0x55f04de50180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 -- 172.21.15.142:0/3572123569 shutdown_connections 2023-09-21T12:55:50.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.187+0000 7f560296eb80 1 -- 172.21.15.142:0/3572123569 wait complete. 2023-09-21T12:55:50.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 -- start start 2023-09-21T12:55:50.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 Processor -- start 2023-09-21T12:55:50.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de556a0 0x55f04de5f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56b90 0x55f04de66690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dda6e30 con 0x55f04de56000 2023-09-21T12:55:50.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dd436f0 con 0x55f04de556a0 2023-09-21T12:55:50.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dd43390 con 0x55f04de56b90 2023-09-21T12:55:50.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f560296eb80 10 client.0 _ll_register_callbacks cb 0x55f04dc8da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:50.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.188+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56944/0 (socket says 172.21.15.142:56944) 2023-09-21T12:55:50.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 -- 172.21.15.142:0/445502225 learned_addr learned my addr 172.21.15.142:0/445502225 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:50.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55ed59c700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56b90 0x55f04de66690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de556a0 0x55f04de5f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 -- 172.21.15.142:0/445502225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56b90 msgr2=0x55f04de66690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56b90 0x55f04de66690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 -- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de556a0 msgr2=0x55f04de5f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de556a0 0x55f04de5f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 -- 172.21.15.142:0/445502225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0011330 con 0x55f04de56000 2023-09-21T12:55:50.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55e7fff700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f55d401d840 tx=0x7f55d40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed96f178eb5815d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:50.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4022070 con 0x55f04de56000 2023-09-21T12:55:50.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f04dd17b60 con 0x55f04de56000 2023-09-21T12:55:50.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.189+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55d4004020 con 0x55f04de56000 2023-09-21T12:55:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55d402d030 con 0x55f04de56000 2023-09-21T12:55:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 10 client.15120 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f04dbbac10 con 0x55f04de56000 2023-09-21T12:55:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f04dd17b60 con 0x55f04de56000 2023-09-21T12:55:50.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f55d4003680 con 0x55f04de56000 2023-09-21T12:55:50.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 10 client.15120 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:50.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T12:55:50.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 20 client.15120 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:50.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de6ad60 0x55f04de697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 4 client.15120 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:55:50.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.190+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f04de23fd0 con 0x55f04de6ad60 2023-09-21T12:55:50.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.191+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de6ad60 0x55f04de697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.191+0000 7f55c7fff700 10 client.15120 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:50.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.191+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de6ad60 0x55f04de697f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aadba23bc78a7d6 server_cookie=6d94583a9609290e in_seq=0 out_seq=0 2023-09-21T12:55:50.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:49 smithi160 ceph-mon[134450]: pgmap v320: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:50.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:49 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3909480940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:55:50.206 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:49 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/614880939' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:50.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f55c7fff700 1 -- 172.21.15.142:0/445502225 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f04de23fd0 con 0x55f04de6ad60 2023-09-21T12:55:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f55c7fff700 10 client.15120 handle_command_reply: tid=0 2023-09-21T12:55:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 client.15120 shutdown 2023-09-21T12:55:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 msgr2=0x55f04de5f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f55d401d840 tx=0x7f55d40047c0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 shutdown_connections 2023-09-21T12:55:50.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de6ad60 0x55f04de697f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56b90 0x55f04de66690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04de556a0 0x55f04de5f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f55c7fff700 0 client.15120 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:50.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 --2- 172.21.15.142:0/445502225 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de56000 0x55f04de5f650 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 >> 172.21.15.142:0/445502225 conn(0x55f04dd81fb0 msgr2=0x55f04de4f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 shutdown_connections 2023-09-21T12:55:50.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 1 -- 172.21.15.142:0/445502225 wait complete. 2023-09-21T12:55:50.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.192+0000 7f560296eb80 20 client.15120 trim_cache size 0 max 16384 2023-09-21T12:55:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.210+0000 7f560296eb80 1 Processor -- start 2023-09-21T12:55:50.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 -- start start 2023-09-21T12:55:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de5d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04de59b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dc278d0 con 0x55f04de556a0 2023-09-21T12:55:50.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dd4d470 con 0x55f04dd81fb0 2023-09-21T12:55:50.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f560296eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04dc33de0 con 0x55f04de56000 2023-09-21T12:55:50.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56950/0 (socket says 172.21.15.142:56950) 2023-09-21T12:55:50.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 -- 172.21.15.142:0/3230081409 learned_addr learned my addr 172.21.15.142:0/3230081409 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:50.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04de59b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de5d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 -- 172.21.15.142:0/3230081409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 msgr2=0x55f04de59b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04de59b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 -- 172.21.15.142:0/3230081409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 msgr2=0x55f04de5d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.211+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de5d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55e7fff700 1 -- 172.21.15.142:0/3230081409 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f04dbf8200 con 0x55f04de556a0 2023-09-21T12:55:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55ed59c700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04de59b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55e7fff700 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55d40039e0 tx=0x7f55d4009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7582fb367e6b4209 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55d37fe700 1 -- 172.21.15.142:0/3230081409 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d402d070 con 0x55f04de556a0 2023-09-21T12:55:50.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55d37fe700 1 -- 172.21.15.142:0/3230081409 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55d4003740 con 0x55f04de556a0 2023-09-21T12:55:50.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.212+0000 7f55d37fe700 1 -- 172.21.15.142:0/3230081409 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d4022040 con 0x55f04de556a0 2023-09-21T12:55:50.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- 172.21.15.142:0/3230081409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 msgr2=0x55f04de66620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f55d40039e0 tx=0x7f55d4009770 comp rx=0 tx=0).stop 2023-09-21T12:55:50.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- 172.21.15.142:0/3230081409 shutdown_connections 2023-09-21T12:55:50.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04de59b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de5d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 --2- 172.21.15.142:0/3230081409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de66620 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- 172.21.15.142:0/3230081409 >> 172.21.15.142:0/3230081409 conn(0x55f04de504b0 msgr2=0x55f04de4f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- 172.21.15.142:0/3230081409 shutdown_connections 2023-09-21T12:55:50.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- 172.21.15.142:0/3230081409 wait complete. 2023-09-21T12:55:50.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 -- start start 2023-09-21T12:55:50.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.213+0000 7f560296eb80 1 Processor -- start 2023-09-21T12:55:50.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de63830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04debe750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04de64500 con 0x55f04de556a0 2023-09-21T12:55:50.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04debec90 con 0x55f04dd81fb0 2023-09-21T12:55:50.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04debee00 con 0x55f04de56000 2023-09-21T12:55:50.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f560296eb80 10 client.0 _ll_register_callbacks cb 0x55f04dc8da30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:55:50.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56960/0 (socket says 172.21.15.142:56960) 2023-09-21T12:55:50.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 -- 172.21.15.142:0/1929813165 learned_addr learned my addr 172.21.15.142:0/1929813165 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:50.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de63830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55ed59c700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04debe750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 -- 172.21.15.142:0/1929813165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 msgr2=0x55f04debe750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04debe750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 -- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 msgr2=0x55f04de63830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:55:50.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de63830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.214+0000 7f55e7fff700 1 -- 172.21.15.142:0/1929813165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f04dbd1d90 con 0x55f04de556a0 2023-09-21T12:55:50.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55e7fff700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55d4004630 tx=0x7f55d4004660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1153c07a5db4a656 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:50.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:55:50.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d402d040 con 0x55f04de556a0 2023-09-21T12:55:50.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f55e000f040 con 0x55f04de556a0 2023-09-21T12:55:50.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f55d402e070 con 0x55f04de556a0 2023-09-21T12:55:50.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55d4022040 con 0x55f04de556a0 2023-09-21T12:55:50.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f560296eb80 10 client.15126 fetch_fsmap learned FSMap version 23 2023-09-21T12:55:50.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f04dbbac10 con 0x55f04de556a0 2023-09-21T12:55:50.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.215+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55e000f040 con 0x55f04de556a0 2023-09-21T12:55:50.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f55d4041070 con 0x55f04de556a0 2023-09-21T12:55:50.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 10 client.15126 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:55:50.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 10 client.15126 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-21T12:55:50.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 20 client.15126 populate_metadata read hostname 'smithi142' 2023-09-21T12:55:50.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de56b90 0x55f04dec01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:50.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 4 client.15126 mds_command: new command op to 24578 tid=0[{"prefix": "status"}] 2023-09-21T12:55:50.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f04dd9fe10 con 0x55f04de56b90 2023-09-21T12:55:50.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de56b90 0x55f04dec01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:50.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f55ecd9b700 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de56b90 0x55f04dec01d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6aa5887988e49f0 server_cookie=946f47edd9fbf899 in_seq=0 out_seq=0 2023-09-21T12:55:50.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.216+0000 7f55c7fff700 10 client.15126 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:50.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f55c7fff700 1 -- 172.21.15.142:0/1929813165 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f04dd9fe10 con 0x55f04de56b90 2023-09-21T12:55:50.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f55c7fff700 10 client.15126 handle_command_reply: tid=0 2023-09-21T12:55:50.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 client.15126 shutdown 2023-09-21T12:55:50.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 msgr2=0x55f04de63d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f55d4004630 tx=0x7f55d4004660 comp rx=0 tx=0).stop 2023-09-21T12:55:50.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 shutdown_connections 2023-09-21T12:55:50.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f04de56b90 0x55f04dec01d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f04de56000 0x55f04debe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f04dd81fb0 0x55f04de63830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f55c7fff700 0 client.15126 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:55:50.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 --2- 172.21.15.142:0/1929813165 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f04de556a0 0x55f04de63d70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 >> 172.21.15.142:0/1929813165 conn(0x55f04de504b0 msgr2=0x55f04de5d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 shutdown_connections 2023-09-21T12:55:50.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 1 -- 172.21.15.142:0/1929813165 wait complete. 2023-09-21T12:55:50.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.217+0000 7f560296eb80 20 client.15126 trim_cache size 0 max 16384 2023-09-21T12:55:50.235 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:55:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "cluster_fsid": "ca3f7e80-587c-11ee-9ab8-7b867c8bd7da", 2023-09-21T12:55:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "whoami": 0, 2023-09-21T12:55:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "id": 24578, 2023-09-21T12:55:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "want_state": "up:active", 2023-09-21T12:55:50.236 INFO:teuthology.orchestra.run.smithi142.stdout: "state": "up:active", 2023-09-21T12:55:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "fs_name": "cephfs", 2023-09-21T12:55:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "rank_uptime": 97.757104952000006, 2023-09-21T12:55:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "mdsmap_epoch": 23, 2023-09-21T12:55:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch": 86, 2023-09-21T12:55:50.237 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_epoch_barrier": 84, 2023-09-21T12:55:50.238 INFO:teuthology.orchestra.run.smithi142.stdout: "uptime": 103.80557155699999 2023-09-21T12:55:50.238 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:55:50.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 msgr2=0x7f55d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 0x7f55d80a2b00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f55e8074b40 tx=0x7f55d4009260 comp rx=0 tx=0).stop 2023-09-21T12:55:50.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 msgr2=0x7f55e8198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:50.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55dc004740 tx=0x7f55dc009580 comp rx=0 tx=0).stop 2023-09-21T12:55:50.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 shutdown_connections 2023-09-21T12:55:50.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f55d80a0640 0x7f55d80a2b00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55e8073840 0x7f55e8198d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55e8108cb0 0x7f55e81a0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 --2- 172.21.15.142:0/3509467216 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55e8074e20 0x7f55e8199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:50.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 >> 172.21.15.142:0/3509467216 conn(0x7f55e80fc360 msgr2=0x7f55e80fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:50.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 shutdown_connections 2023-09-21T12:55:50.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:50.218+0000 7f55eefff700 1 -- 172.21.15.142:0/3509467216 wait complete. 2023-09-21T12:55:50.242 INFO:teuthology.run_tasks:Running task kclient... 2023-09-21T12:55:50.266 INFO:tasks.kclient:Mounting kernel clients... 2023-09-21T12:55:50.267 INFO:tasks.kclient:config is {'client.0': {}} 2023-09-21T12:55:50.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:50.268 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-21T12:55:50.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:50.313 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-21T12:55:50.426 INFO:teuthology.orchestra.run.smithi142.stderr:Cannot find device "ceph-brx" 2023-09-21T12:55:50.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T12:55:50.430 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2023-09-21T12:55:50.431 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-21T12:55:50.431 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-21T12:55:50.432 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph fs ls 2023-09-21T12:55:51.159 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T12:55:51.836 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:51 smithi142 ceph-mon[97663]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:51 smithi156 ceph-mon[134078]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:51 smithi160 ceph-mon[134450]: pgmap v321: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 597 B/s wr, 7 op/s 2023-09-21T12:55:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 -- 172.21.15.142:0/1657151839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0101060 msgr2=0x7fe6c0101440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:52.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1657151839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0101060 0x7fe6c0101440 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc009990 tx=0x7fe6bc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 -- 172.21.15.142:0/1657151839 shutdown_connections 2023-09-21T12:55:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1657151839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0101060 0x7fe6c0101440 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1657151839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0106140 0x7fe6c010dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1657151839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101a10 0x7fe6c0105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 -- 172.21.15.142:0/1657151839 >> 172.21.15.142:0/1657151839 conn(0x7fe6c00fc8d0 msgr2=0x7fe6c00fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 -- 172.21.15.142:0/1657151839 shutdown_connections 2023-09-21T12:55:52.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.738+0000 7fe6c819a700 1 -- 172.21.15.142:0/1657151839 wait complete. 2023-09-21T12:55:52.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.739+0000 7fe6c819a700 1 Processor -- start 2023-09-21T12:55:52.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.739+0000 7fe6c819a700 1 -- start start 2023-09-21T12:55:52.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 0x7fe6c00730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 0x7fe6c0073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c01a5370 con 0x7fe6c0106140 2023-09-21T12:55:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c01a54e0 con 0x7fe6c0101a10 2023-09-21T12:55:52.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c819a700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c01a56a0 con 0x7fe6c0101060 2023-09-21T12:55:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c6737700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c5735700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 0x7fe6c0073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c6737700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56982/0 (socket says 172.21.15.142:56982) 2023-09-21T12:55:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c6737700 1 -- 172.21.15.142:0/1931891319 learned_addr learned my addr 172.21.15.142:0/1931891319 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:52.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.740+0000 7fe6c5f36700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 0x7fe6c00730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 -- 172.21.15.142:0/1931891319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 msgr2=0x7fe6c00730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 0x7fe6c00730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 -- 172.21.15.142:0/1931891319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 msgr2=0x7fe6c0073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 0x7fe6c0073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 -- 172.21.15.142:0/1931891319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8009c40 con 0x7fe6c0106140 2023-09-21T12:55:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c5735700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 0x7fe6c0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c5f36700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 0x7fe6c00730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c6737700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c370 tx=0x7fe6b800c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8017070 con 0x7fe6c0106140 2023-09-21T12:55:52.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6bc0095f0 con 0x7fe6c0106140 2023-09-21T12:55:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6b800f040 con 0x7fe6c0106140 2023-09-21T12:55:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800e050 con 0x7fe6c0106140 2023-09-21T12:55:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.741+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c01a5c90 con 0x7fe6c0106140 2023-09-21T12:55:52.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.742+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c004eae0 con 0x7fe6c0106140 2023-09-21T12:55:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.744+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fe6b800cb60 con 0x7fe6c0106140 2023-09-21T12:55:52.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.745+0000 7fe6b6ffd700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 0x7fe6ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:52.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.746+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe6b80cb4f0 con 0x7fe6c0106140 2023-09-21T12:55:52.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.746+0000 7fe6c5f36700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 0x7fe6ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:52.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.746+0000 7fe6c5f36700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 0x7fe6ac0a2b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00b2e0 tx=0x7fe6bc005960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:52.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.750+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe6b8094fd0 con 0x7fe6c0106140 2023-09-21T12:55:52.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.994+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe6c0110fb0 con 0x7fe6c0106140 2023-09-21T12:55:52.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.995+0000 7fe6b6ffd700 1 -- 172.21.15.142:0/1931891319 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe6b80985f0 con 0x7fe6c0106140 2023-09-21T12:55:52.995 INFO:teuthology.orchestra.run.smithi142.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-21T12:55:52.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 msgr2=0x7fe6ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:52.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 0x7fe6ac0a2b00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00b2e0 tx=0x7fe6bc005960 comp rx=0 tx=0).stop 2023-09-21T12:55:52.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 msgr2=0x7fe6c0073ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:52.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800c370 tx=0x7fe6b800c680 comp rx=0 tx=0).stop 2023-09-21T12:55:52.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 shutdown_connections 2023-09-21T12:55:52.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe6ac0a0640 0x7fe6ac0a2b00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6c0106140 0x7fe6c0073ba0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6c0101060 0x7fe6c00730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 --2- 172.21.15.142:0/1931891319 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6c0101a10 0x7fe6c0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:52.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 >> 172.21.15.142:0/1931891319 conn(0x7fe6c00fc8d0 msgr2=0x7fe6c0104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:52.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 shutdown_connections 2023-09-21T12:55:53.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:52.997+0000 7fe6c819a700 1 -- 172.21.15.142:0/1931891319 wait complete. 2023-09-21T12:55:53.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-21T12:55:53.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-21T12:55:53.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi142.front.sepia.ceph.com 2023-09-21T12:55:53.534 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-21T12:55:53.534 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-21T12:55:53.534 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-21T12:55:53.534 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-21T12:55:53.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-21T12:55:53.535 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-21T12:55:53.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:53.536 DEBUG:teuthology.orchestra.run.smithi142:> ip addr 2023-09-21T12:55:53.581 INFO:teuthology.orchestra.run.smithi142.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-21T12:55:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-21T12:55:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: inet 127.0.0.1/8 scope host lo 2023-09-21T12:55:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-21T12:55:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 ::1/128 scope host 2023-09-21T12:55:53.582 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-21T12:55:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T12:55:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3c brd ff:ff:ff:ff:ff:ff 2023-09-21T12:55:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f0 2023-09-21T12:55:53.583 INFO:teuthology.orchestra.run.smithi142.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T12:55:53.583 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:d9:36:3d brd ff:ff:ff:ff:ff:ff 2023-09-21T12:55:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: altname enp7s0f1 2023-09-21T12:55:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-21T12:55:53.584 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0c brd ff:ff:ff:ff:ff:ff 2023-09-21T12:55:53.584 INFO:teuthology.orchestra.run.smithi142.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-21T12:55:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: link/ether 0c:c4:7a:88:6e:0d brd ff:ff:ff:ff:ff:ff 2023-09-21T12:55:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: inet 172.21.15.142/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-09-21T12:55:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft 41670sec preferred_lft 41670sec 2023-09-21T12:55:53.585 INFO:teuthology.orchestra.run.smithi142.stdout: inet6 fe80::7a4f:a396:a154:4bd/64 scope link noprefixroute 2023-09-21T12:55:53.586 INFO:teuthology.orchestra.run.smithi142.stdout: valid_lft forever preferred_lft forever 2023-09-21T12:55:53.586 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-21T12:55:53.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:53.587 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-21T12:55:53.588 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-21T12:55:53.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add name ceph-brx type bridge 2023-09-21T12:55:53.588 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr flush dev ceph-brx 2023-09-21T12:55:53.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set ceph-brx up 2023-09-21T12:55:53.589 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-21T12:55:53.589 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-21T12:55:53.982 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:53 smithi142 ceph-mon[97663]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:53.983 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:53 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1931891319' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-21T12:55:54.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.051 DEBUG:teuthology.orchestra.run.smithi142:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-21T12:55:54.122 INFO:teuthology.orchestra.run.smithi142.stdout:1 2023-09-21T12:55:54.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.125 DEBUG:teuthology.orchestra.run.smithi142:> route 2023-09-21T12:55:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:53 smithi156 ceph-mon[134078]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:54.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:53 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1931891319' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-21T12:55:54.186 INFO:teuthology.orchestra.run.smithi142.stdout:Kernel IP routing table 2023-09-21T12:55:54.186 INFO:teuthology.orchestra.run.smithi142.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-21T12:55:54.187 INFO:teuthology.orchestra.run.smithi142.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-09-21T12:55:54.187 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-09-21T12:55:54.187 INFO:teuthology.orchestra.run.smithi142.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-21T12:55:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:53 smithi160 ceph-mon[134450]: pgmap v322: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:55:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:53 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1931891319' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-21T12:55:54.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.190 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-21T12:55:54.190 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-21T12:55:54.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-09-21T12:55:54.190 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-09-21T12:55:54.191 DEBUG:teuthology.orchestra.run.smithi142:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-09-21T12:55:54.191 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-21T12:55:54.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.871 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-21T12:55:54.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.916 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list-id 2023-09-21T12:55:54.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:54.999 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-21T12:55:55.000 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-21T12:55:55.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-21T12:55:55.000 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-21T12:55:55.001 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-21T12:55:55.183 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-21T12:55:55.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:55.184 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-21T12:55:55.185 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-21T12:55:55.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-21T12:55:55.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-21T12:55:55.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-21T12:55:55.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-21T12:55:55.186 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-21T12:55:55.187 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-21T12:55:55.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:55.469 DEBUG:teuthology.orchestra.run.smithi142:> (cd / && exec bash -c ' 2023-09-21T12:55:55.469 DEBUG:teuthology.orchestra.run.smithi142:> set -e 2023-09-21T12:55:55.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set brx.0 up 2023-09-21T12:55:55.469 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link set dev brx.0 master ceph-brx 2023-09-21T12:55:55.470 DEBUG:teuthology.orchestra.run.smithi142:> ') 2023-09-21T12:55:55.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T12:55:55.644 DEBUG:teuthology.orchestra.run.smithi142:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-21T12:55:55.688 INFO:teuthology.orchestra.run.smithi142.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-21T12:55:55.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-21T12:55:55.689 DEBUG:teuthology.orchestra.run.smithi142:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-21T12:55:55.774 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-09-21T12:55:55.774 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-09-21T12:55:55.775 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/_nogroup/sv_1/4f22885d-ff40-4d39-87c7-0279654a3fb4 2023-09-21T12:55:55.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:55.775 DEBUG:teuthology.orchestra.run.smithi142:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/_nogroup/sv_1/4f22885d-ff40-4d39-87c7-0279654a3fb4 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2023-09-21T12:55:55.926 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2023-09-21T12:55:55.926 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2023-09-21T12:55:56.025 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:55 smithi142 ceph-mon[97663]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:55:56.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:55 smithi156 ceph-mon[134078]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:55:56.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:55 smithi160 ceph-mon[134450]: pgmap v323: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi142.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2023-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2023-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: resolved to: "172.21.15.142:3300,172.21.15.156:3300,172.21.15.160:3300" 2023-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: trying mount with new device syntax: 0@ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.cephfs=/volumes/_nogroup/sv_1/4f22885d-ff40-4d39-87c7-0279654a3fb4 2023-09-21T12:55:56.370 INFO:teuthology.orchestra.run.smithi142.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.142:3300/172.21.15.156:3300/172.21.15.160:3300" will pass to kernel 2023-09-21T12:55:56.376 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-21T12:55:56.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:56.376 DEBUG:teuthology.orchestra.run.smithi142:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-21T12:55:56.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:56.453 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T12:55:56.572 INFO:teuthology.orchestra.run.smithi142.stdout:client15135 2023-09-21T12:55:56.572 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:55:56.573 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T12:55:56.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:56.618 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T12:55:56.743 INFO:teuthology.orchestra.run.smithi142.stdout:client15135 2023-09-21T12:55:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:56.744 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-21T12:55:56.830 INFO:teuthology.orchestra.run.smithi142.stdout:client15135 2023-09-21T12:55:56.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T12:55:56.831 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da.client15135/status') 2023-09-21T12:55:56.940 INFO:teuthology.orchestra.run.smithi142.stdout:instance: client.15135 (3)192.168.0.1:0/2961012941 2023-09-21T12:55:56.940 INFO:teuthology.orchestra.run.smithi142.stdout:blocklisted: false 2023-09-21T12:55:56.940 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records in 2023-09-21T12:55:56.941 INFO:teuthology.orchestra.run.smithi142.stderr:0+1 records out 2023-09-21T12:55:56.941 INFO:teuthology.orchestra.run.smithi142.stderr:70 bytes copied, 5.1955e-05 s, 1.3 MB/s 2023-09-21T12:55:56.943 INFO:teuthology.run_tasks:Running task check-counter... 2023-09-21T12:55:56.956 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-09-21T12:55:56.968 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:57.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 -- 172.21.15.142:0/148075575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c102980 msgr2=0x7fe36c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 --2- 172.21.15.142:0/148075575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c102980 0x7fe36c109230 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe36400b0d0 tx=0x7fe36400b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 -- 172.21.15.142:0/148075575 shutdown_connections 2023-09-21T12:55:57.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 --2- 172.21.15.142:0/148075575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c102980 0x7fe36c109230 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 --2- 172.21.15.142:0/148075575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c100df0 0x7fe36c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 --2- 172.21.15.142:0/148075575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c101fe0 0x7fe36c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 -- 172.21.15.142:0/148075575 >> 172.21.15.142:0/148075575 conn(0x7fe36c0fc320 msgr2=0x7fe36c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:57.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 -- 172.21.15.142:0/148075575 shutdown_connections 2023-09-21T12:55:57.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.167+0000 7fe3721ff700 1 -- 172.21.15.142:0/148075575 wait complete. 2023-09-21T12:55:57.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.168+0000 7fe3721ff700 1 Processor -- start 2023-09-21T12:55:57.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.168+0000 7fe3721ff700 1 -- start start 2023-09-21T12:55:57.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c100df0 0x7fe36c198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c102980 0x7fe36c1a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a0970 con 0x7fe36c101fe0 2023-09-21T12:55:57.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a0ab0 con 0x7fe36c102980 2023-09-21T12:55:57.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe3721ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe36c1a0c40 con 0x7fe36c100df0 2023-09-21T12:55:57.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47250/0 (socket says 172.21.15.142:47250) 2023-09-21T12:55:57.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 -- 172.21.15.142:0/4249044000 learned_addr learned my addr 172.21.15.142:0/4249044000 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:57.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36b7fe700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c100df0 0x7fe36c198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36bfff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c102980 0x7fe36c1a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 -- 172.21.15.142:0/4249044000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c100df0 msgr2=0x7fe36c198df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c100df0 0x7fe36c198df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 -- 172.21.15.142:0/4249044000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c102980 msgr2=0x7fe36c1a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c102980 0x7fe36c1a03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.169+0000 7fe36affd700 1 -- 172.21.15.142:0/4249044000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009d00 con 0x7fe36c101fe0 2023-09-21T12:55:57.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe36affd700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e9a0 tx=0x7fe36000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:57.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360009790 con 0x7fe36c101fe0 2023-09-21T12:55:57.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe360010430 con 0x7fe36c101fe0 2023-09-21T12:55:57.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe36c1a0f20 con 0x7fe36c101fe0 2023-09-21T12:55:57.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360018680 con 0x7fe36c101fe0 2023-09-21T12:55:57.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.170+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36c1a13f0 con 0x7fe36c101fe0 2023-09-21T12:55:57.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.171+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe36c10c660 con 0x7fe36c101fe0 2023-09-21T12:55:57.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.173+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fe3600105a0 con 0x7fe36c101fe0 2023-09-21T12:55:57.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.175+0000 7fe368ff9700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 0x7fe3540a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.175+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe360014070 con 0x7fe36c101fe0 2023-09-21T12:55:57.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.175+0000 7fe36b7fe700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 0x7fe3540a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.175+0000 7fe36b7fe700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 0x7fe3540a2bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe36c101e40 tx=0x7fe35c007400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:57.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.177+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe3600959e0 con 0x7fe36c101fe0 2023-09-21T12:55:57.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.378+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe36c10c880 con 0x7fe36c101fe0 2023-09-21T12:55:57.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.380+0000 7fe368ff9700 1 -- 172.21.15.142:0/4249044000 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7fe360026020 con 0x7fe36c101fe0 2023-09-21T12:55:57.380 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:57.380 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:57.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 msgr2=0x7fe3540a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 0x7fe3540a2bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe36c101e40 tx=0x7fe35c007400 comp rx=0 tx=0).stop 2023-09-21T12:55:57.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 msgr2=0x7fe36c199330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe36000e9a0 tx=0x7fe36000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 shutdown_connections 2023-09-21T12:55:57.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe3540a0710 0x7fe3540a2bd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe36c102980 0x7fe36c1a03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe36c100df0 0x7fe36c198df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 --2- 172.21.15.142:0/4249044000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe36c101fe0 0x7fe36c199330 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 >> 172.21.15.142:0/4249044000 conn(0x7fe36c0fc320 msgr2=0x7fe36c107800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:57.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 shutdown_connections 2023-09-21T12:55:57.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.382+0000 7fe3721ff700 1 -- 172.21.15.142:0/4249044000 wait complete. 2023-09-21T12:55:57.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:57.401 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:57.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 -- 172.21.15.142:0/3853389491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 msgr2=0x7fc4001011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 --2- 172.21.15.142:0/3853389491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc4001011f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0099c0 tx=0x7fc3fc009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 -- 172.21.15.142:0/3853389491 shutdown_connections 2023-09-21T12:55:57.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 --2- 172.21.15.142:0/3853389491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 0x7fc400109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 --2- 172.21.15.142:0/3853389491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc4001011f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 --2- 172.21.15.142:0/3853389491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 0x7fc400102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 -- 172.21.15.142:0/3853389491 >> 172.21.15.142:0/3853389491 conn(0x7fc4000fc320 msgr2=0x7fc4000fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:57.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 -- 172.21.15.142:0/3853389491 shutdown_connections 2023-09-21T12:55:57.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.604+0000 7fc4085ff700 1 -- 172.21.15.142:0/3853389491 wait complete. 2023-09-21T12:55:57.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 Processor -- start 2023-09-21T12:55:57.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 -- start start 2023-09-21T12:55:57.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 0x7fc400197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 0x7fc40019e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40019e680 con 0x7fc400102960 2023-09-21T12:55:57.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40019e7c0 con 0x7fc400100dd0 2023-09-21T12:55:57.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.606+0000 7fc4085ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40019e950 con 0x7fc400101fc0 2023-09-21T12:55:57.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc406b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 0x7fc40019e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34466/0 (socket says 172.21.15.142:34466) 2023-09-21T12:55:57.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 -- 172.21.15.142:0/1718684713 learned_addr learned my addr 172.21.15.142:0/1718684713 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:57.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc405b9a700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 0x7fc400197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 -- 172.21.15.142:0/1718684713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 msgr2=0x7fc400197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 0x7fc400197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 -- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 msgr2=0x7fc40019e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 0x7fc40019e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 -- 172.21.15.142:0/1718684713 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f0009520 con 0x7fc400100dd0 2023-09-21T12:55:57.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc40639b700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0058e0 tx=0x7fc3fc00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:57.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.607+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc01d070 con 0x7fc400100dd0 2023-09-21T12:55:57.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.608+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3fc005510 con 0x7fc400100dd0 2023-09-21T12:55:57.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.608+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f8009c40 con 0x7fc400100dd0 2023-09-21T12:55:57.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.608+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3fc004a90 con 0x7fc400100dd0 2023-09-21T12:55:57.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.608+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3fc0095f0 con 0x7fc400100dd0 2023-09-21T12:55:57.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.609+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc40010c5e0 con 0x7fc400100dd0 2023-09-21T12:55:57.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.611+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fc3fc004bf0 con 0x7fc400100dd0 2023-09-21T12:55:57.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.612+0000 7fc3f77fe700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 0x7fc3ec0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:57.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.612+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3fc0ccdc0 con 0x7fc400100dd0 2023-09-21T12:55:57.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.612+0000 7fc405b9a700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 0x7fc3ec0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:57.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.613+0000 7fc405b9a700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 0x7fc3ec0a2b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009df0 tx=0x7fc3f0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:57.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.614+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc3fc096a50 con 0x7fc400100dd0 2023-09-21T12:55:57.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.816+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc400107d90 con 0x7fc400100dd0 2023-09-21T12:55:57.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.817+0000 7fc3f77fe700 1 -- 172.21.15.142:0/1718684713 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3fc0260a0 con 0x7fc400100dd0 2023-09-21T12:55:57.816 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:57.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 msgr2=0x7fc3ec0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 0x7fc3ec0a2b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0009df0 tx=0x7fc3f0009260 comp rx=0 tx=0).stop 2023-09-21T12:55:57.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 msgr2=0x7fc400196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:57.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc3fc0058e0 tx=0x7fc3fc00f690 comp rx=0 tx=0).stop 2023-09-21T12:55:57.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 shutdown_connections 2023-09-21T12:55:57.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc3ec0a0640 0x7fc3ec0a2b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc400102960 0x7fc40019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc400100dd0 0x7fc400196b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 --2- 172.21.15.142:0/1718684713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc400101fc0 0x7fc400197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:57.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 >> 172.21.15.142:0/1718684713 conn(0x7fc4000fc320 msgr2=0x7fc4000fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:57.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 shutdown_connections 2023-09-21T12:55:57.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:57.819+0000 7fc4085ff700 1 -- 172.21.15.142:0/1718684713 wait complete. 2023-09-21T12:55:57.838 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:58.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 -- 172.21.15.142:0/1260860029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 msgr2=0x7f991410b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 --2- 172.21.15.142:0/1260860029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f991410b120 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f990c009f90 tx=0x7f990c00b330 comp rx=0 tx=0).stop 2023-09-21T12:55:58.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 -- 172.21.15.142:0/1260860029 shutdown_connections 2023-09-21T12:55:58.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 --2- 172.21.15.142:0/1260860029 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f991410b120 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 --2- 172.21.15.142:0/1260860029 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914074e20 0x7f9914073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 --2- 172.21.15.142:0/1260860029 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914073840 0x7f9914073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 -- 172.21.15.142:0/1260860029 >> 172.21.15.142:0/1260860029 conn(0x7f99140fc320 msgr2=0x7f99140fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:58.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 -- 172.21.15.142:0/1260860029 shutdown_connections 2023-09-21T12:55:58.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.040+0000 7f99199ff700 1 -- 172.21.15.142:0/1260860029 wait complete. 2023-09-21T12:55:58.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.041+0000 7f99199ff700 1 Processor -- start 2023-09-21T12:55:58.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 -- start start 2023-09-21T12:55:58.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914073840 0x7f9914198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914074e20 0x7f9914199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141a09a0 con 0x7f9914108c90 2023-09-21T12:55:58.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141a0ae0 con 0x7f9914074e20 2023-09-21T12:55:58.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99199ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99141a0c70 con 0x7f9914073840 2023-09-21T12:55:58.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99137fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47296/0 (socket says 172.21.15.142:47296) 2023-09-21T12:55:58.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99137fe700 1 -- 172.21.15.142:0/3602097435 learned_addr learned my addr 172.21.15.142:0/3602097435 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:58.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f9912ffd700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914073840 0x7f9914198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.042+0000 7f99127fc700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914074e20 0x7f9914199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 -- 172.21.15.142:0/3602097435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914073840 msgr2=0x7f9914198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914073840 0x7f9914198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 -- 172.21.15.142:0/3602097435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914074e20 msgr2=0x7f9914199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914074e20 0x7f9914199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 -- 172.21.15.142:0/3602097435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009c40 con 0x7f9914108c90 2023-09-21T12:55:58.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99137fe700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f990c009f60 tx=0x7f990c004c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c00e040 con 0x7f9914108c90 2023-09-21T12:55:58.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f990c00bbf0 con 0x7f9914108c90 2023-09-21T12:55:58.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99141a0ef0 con 0x7f9914108c90 2023-09-21T12:55:58.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f990c0052a0 con 0x7f9914108c90 2023-09-21T12:55:58.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.043+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99141a12c0 con 0x7f9914108c90 2023-09-21T12:55:58.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.044+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9914107340 con 0x7f9914108c90 2023-09-21T12:55:58.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.046+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f990c01d470 con 0x7f9914108c90 2023-09-21T12:55:58.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.047+0000 7f99189fd700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 0x7f98fc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.048+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f990c0cd1c0 con 0x7f9914108c90 2023-09-21T12:55:58.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.048+0000 7f9912ffd700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 0x7f98fc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.048+0000 7f9912ffd700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 0x7f98fc0a2b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9904009c60 tx=0x7f9904009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.051+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f990c096d30 con 0x7f9914108c90 2023-09-21T12:55:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:57 smithi156 ceph-mon[134078]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-09-21T12:55:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:57 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4249044000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:57 smithi142 ceph-mon[97663]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-09-21T12:55:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:57 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4249044000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:58.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:57 smithi160 ceph-mon[134450]: pgmap v324: 97 pgs: 97 active+clean; 637 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 0 B/s wr, 5 op/s 2023-09-21T12:55:58.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:57 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4249044000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:58.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.253+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99140008d0 con 0x7f9914108c90 2023-09-21T12:55:58.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.253+0000 7f99189fd700 1 -- 172.21.15.142:0/3602097435 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f990c09a350 con 0x7f9914108c90 2023-09-21T12:55:58.253 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:55:58.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 msgr2=0x7f98fc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 0x7f98fc0a2b00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9904009c60 tx=0x7f9904009260 comp rx=0 tx=0).stop 2023-09-21T12:55:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 msgr2=0x7f99141a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f990c009f60 tx=0x7f990c004c60 comp rx=0 tx=0).stop 2023-09-21T12:55:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 shutdown_connections 2023-09-21T12:55:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f98fc0a0640 0x7f98fc0a2b00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9914108c90 0x7f99141a03d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9914073840 0x7f9914198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 --2- 172.21.15.142:0/3602097435 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9914074e20 0x7f9914199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 >> 172.21.15.142:0/3602097435 conn(0x7f99140fc320 msgr2=0x7f99140fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:58.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 shutdown_connections 2023-09-21T12:55:58.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.256+0000 7f99199ff700 1 -- 172.21.15.142:0/3602097435 wait complete. 2023-09-21T12:55:58.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:55:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 -- 172.21.15.142:0/3178278830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 msgr2=0x7f1a2c102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 --2- 172.21.15.142:0/3178278830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c102440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0099c0 tx=0x7f1a1c009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 -- 172.21.15.142:0/3178278830 shutdown_connections 2023-09-21T12:55:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 --2- 172.21.15.142:0/3178278830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c102980 0x7f1a2c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 --2- 172.21.15.142:0/3178278830 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c100df0 0x7f1a2c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 --2- 172.21.15.142:0/3178278830 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c102440 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.477+0000 7f1a335ff700 1 -- 172.21.15.142:0/3178278830 >> 172.21.15.142:0/3178278830 conn(0x7f1a2c0fc360 msgr2=0x7f1a2c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.478+0000 7f1a335ff700 1 -- 172.21.15.142:0/3178278830 shutdown_connections 2023-09-21T12:55:58.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.478+0000 7f1a335ff700 1 -- 172.21.15.142:0/3178278830 wait complete. 2023-09-21T12:55:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.478+0000 7f1a335ff700 1 Processor -- start 2023-09-21T12:55:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 -- start start 2023-09-21T12:55:58.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c100df0 0x7f1a2c074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c102980 0x7f1a2c073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c073eb0 con 0x7f1a2c101fe0 2023-09-21T12:55:58.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c074020 con 0x7f1a2c102980 2023-09-21T12:55:58.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a335ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c1a0b40 con 0x7f1a2c100df0 2023-09-21T12:55:58.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a30b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a30b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47306/0 (socket says 172.21.15.142:47306) 2023-09-21T12:55:58.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a30b9a700 1 -- 172.21.15.142:0/597254047 learned_addr learned my addr 172.21.15.142:0/597254047 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:58.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a3139b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c100df0 0x7f1a2c074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.479+0000 7f1a31b9c700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c102980 0x7f1a2c073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 -- 172.21.15.142:0/597254047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c100df0 msgr2=0x7f1a2c074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c100df0 0x7f1a2c074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 -- 172.21.15.142:0/597254047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c102980 msgr2=0x7f1a2c073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c102980 0x7f1a2c073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 -- 172.21.15.142:0/597254047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a1c0095f0 con 0x7f1a2c101fe0 2023-09-21T12:55:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a30b9a700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009990 tx=0x7f1a1c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c01d070 con 0x7f1a2c101fe0 2023-09-21T12:55:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a1c005030 con 0x7f1a2c101fe0 2023-09-21T12:55:58.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c1a0dc0 con 0x7f1a2c101fe0 2023-09-21T12:55:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c004a70 con 0x7f1a2c101fe0 2023-09-21T12:55:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.480+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c1a1190 con 0x7f1a2c101fe0 2023-09-21T12:55:58.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.481+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c107d70 con 0x7f1a2c101fe0 2023-09-21T12:55:58.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.483+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f1a1c005410 con 0x7f1a2c101fe0 2023-09-21T12:55:58.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.485+0000 7f1a227fc700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 0x7f1a180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.485+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1a1c0ccd50 con 0x7f1a2c101fe0 2023-09-21T12:55:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.485+0000 7f1a3139b700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 0x7f1a180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.485+0000 7f1a3139b700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 0x7f1a180a2b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c101e40 tx=0x7f1a28009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.486+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1a1c096920 con 0x7f1a2c101fe0 2023-09-21T12:55:58.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.693+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a2c10c650 con 0x7f1a2c101fe0 2023-09-21T12:55:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.693+0000 7f1a227fc700 1 -- 172.21.15.142:0/597254047 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a1c099f40 con 0x7f1a2c101fe0 2023-09-21T12:55:58.693 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:55:58.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 msgr2=0x7f1a180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 0x7f1a180a2b00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c101e40 tx=0x7f1a28009260 comp rx=0 tx=0).stop 2023-09-21T12:55:58.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 msgr2=0x7f1a2c0731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c009990 tx=0x7f1a1c00f690 comp rx=0 tx=0).stop 2023-09-21T12:55:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 shutdown_connections 2023-09-21T12:55:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f1a180a0640 0x7f1a180a2b00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a2c102980 0x7f1a2c073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a2c100df0 0x7f1a2c074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 --2- 172.21.15.142:0/597254047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a2c101fe0 0x7f1a2c0731d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 >> 172.21.15.142:0/597254047 conn(0x7f1a2c0fc360 msgr2=0x7f1a2c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 shutdown_connections 2023-09-21T12:55:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.696+0000 7f1a335ff700 1 -- 172.21.15.142:0/597254047 wait complete. 2023-09-21T12:55:58.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:55:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 -- 172.21.15.142:0/51761259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0100df0 msgr2=0x7feab0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 --2- 172.21.15.142:0/51761259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0100df0 0x7feab0101210 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7feaac0099c0 tx=0x7feaac009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 -- 172.21.15.142:0/51761259 shutdown_connections 2023-09-21T12:55:58.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 --2- 172.21.15.142:0/51761259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0100df0 0x7feab0101210 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 --2- 172.21.15.142:0/51761259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0102980 0x7feab0109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 --2- 172.21.15.142:0/51761259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0101fe0 0x7feab0102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 -- 172.21.15.142:0/51761259 >> 172.21.15.142:0/51761259 conn(0x7feab00fc320 msgr2=0x7feab00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 -- 172.21.15.142:0/51761259 shutdown_connections 2023-09-21T12:55:58.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.916+0000 7feab7bff700 1 -- 172.21.15.142:0/51761259 wait complete. 2023-09-21T12:55:58.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.917+0000 7feab7bff700 1 Processor -- start 2023-09-21T12:55:58.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.917+0000 7feab7bff700 1 -- start start 2023-09-21T12:55:58.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0100df0 0x7feab0198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0101fe0 0x7feab0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01a0830 con 0x7feab0102980 2023-09-21T12:55:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01a09a0 con 0x7feab0100df0 2023-09-21T12:55:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab7bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01a0b60 con 0x7feab0101fe0 2023-09-21T12:55:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab519a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0101fe0 0x7feab0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47328/0 (socket says 172.21.15.142:47328) 2023-09-21T12:55:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 -- 172.21.15.142:0/441181303 learned_addr learned my addr 172.21.15.142:0/441181303 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab599b700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0100df0 0x7feab0198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 -- 172.21.15.142:0/441181303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0101fe0 msgr2=0x7feab0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0101fe0 0x7feab0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 -- 172.21.15.142:0/441181303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0100df0 msgr2=0x7feab0198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0100df0 0x7feab0198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.918+0000 7feab619c700 1 -- 172.21.15.142:0/441181303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0095f0 con 0x7feab0102980 2023-09-21T12:55:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feab619c700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ef30 tx=0x7feaa800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8018070 con 0x7feab0102980 2023-09-21T12:55:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab01a0de0 con 0x7feab0102980 2023-09-21T12:55:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feaa800f040 con 0x7feab0102980 2023-09-21T12:55:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa800cd00 con 0x7feab0102980 2023-09-21T12:55:58.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.919+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab01a1200 con 0x7feab0102980 2023-09-21T12:55:58.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.920+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab010c650 con 0x7feab0102980 2023-09-21T12:55:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.922+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7feaa8003a00 con 0x7feab0102980 2023-09-21T12:55:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.923+0000 7feaa6ffd700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 0x7fea9c0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.923+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7feaa80cb6e0 con 0x7feab0102980 2023-09-21T12:55:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.923+0000 7feab599b700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 0x7fea9c0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:58.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.924+0000 7feab599b700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 0x7fea9c0a2b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feaac009990 tx=0x7feaac01a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:58.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:58.927+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7feaa8095250 con 0x7feab0102980 2023-09-21T12:55:59.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.129+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feab01a13f0 con 0x7feab0102980 2023-09-21T12:55:59.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.131+0000 7feaa6ffd700 1 -- 172.21.15.142:0/441181303 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7feaa8098870 con 0x7feab0102980 2023-09-21T12:55:59.131 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:55:59.131 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:55:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 msgr2=0x7fea9c0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 0x7fea9c0a2b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feaac009990 tx=0x7feaac01a040 comp rx=0 tx=0).stop 2023-09-21T12:55:59.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 msgr2=0x7feab01a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feaa800ef30 tx=0x7feaa800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 shutdown_connections 2023-09-21T12:55:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fea9c0a0690 0x7fea9c0a2b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feab0102980 0x7feab01a0260 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feab0100df0 0x7feab0198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 --2- 172.21.15.142:0/441181303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feab0101fe0 0x7feab0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 >> 172.21.15.142:0/441181303 conn(0x7feab00fc320 msgr2=0x7feab00fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:59.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 shutdown_connections 2023-09-21T12:55:59.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.134+0000 7feab7bff700 1 -- 172.21.15.142:0/441181303 wait complete. 2023-09-21T12:55:59.150 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:58 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1718684713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.150 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:58 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3602097435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.150 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:58 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/597254047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.152 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:55:59.153 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:55:59.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:58 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1718684713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:58 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3602097435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:58 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/597254047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:58 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1718684713' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:58 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3602097435' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:58 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/597254047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:55:59.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3500146600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0100df0 msgr2=0x7fd5a0101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3500146600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0100df0 0x7fd5a0101210 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd5900099c0 tx=0x7fd590009cd0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3500146600 shutdown_connections 2023-09-21T12:55:59.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3500146600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0100df0 0x7fd5a0101210 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3500146600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0102980 0x7fd5a0109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3500146600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3500146600 >> 172.21.15.142:0/3500146600 conn(0x7fd5a00fc360 msgr2=0x7fd5a00fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:59.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3500146600 shutdown_connections 2023-09-21T12:55:59.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.354+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3500146600 wait complete. 2023-09-21T12:55:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.355+0000 7fd5a55ff700 1 Processor -- start 2023-09-21T12:55:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.355+0000 7fd5a55ff700 1 -- start start 2023-09-21T12:55:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 0x7fd5a0198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0102980 0x7fd5a01a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01a0880 con 0x7fd5a0101fe0 2023-09-21T12:55:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01a09f0 con 0x7fd5a0100df0 2023-09-21T12:55:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd5a55ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a01a0bb0 con 0x7fd5a0102980 2023-09-21T12:55:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 0x7fd5a0198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47344/0 (socket says 172.21.15.142:47344) 2023-09-21T12:55:59.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59e7fc700 1 -- 172.21.15.142:0/3007397949 learned_addr learned my addr 172.21.15.142:0/3007397949 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:59.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59f7fe700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0102980 0x7fd5a01a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 -- 172.21.15.142:0/3007397949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0102980 msgr2=0x7fd5a01a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0102980 0x7fd5a01a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 -- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 msgr2=0x7fd5a0199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59effd700 1 -- 172.21.15.142:0/3007397949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900095f0 con 0x7fd5a0100df0 2023-09-21T12:55:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.356+0000 7fd59e7fc700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:55:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd59effd700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 0x7fd5a0198d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098e0 tx=0x7fd59000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59001d070 con 0x7fd5a0100df0 2023-09-21T12:55:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a01a0e30 con 0x7fd5a0100df0 2023-09-21T12:55:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd590005510 con 0x7fd5a0100df0 2023-09-21T12:55:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd590004b30 con 0x7fd5a0100df0 2023-09-21T12:55:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.357+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a01a11f0 con 0x7fd5a0100df0 2023-09-21T12:55:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.358+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a010c650 con 0x7fd5a0100df0 2023-09-21T12:55:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.360+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fd590004c90 con 0x7fd5a0100df0 2023-09-21T12:55:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.361+0000 7fd587fff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 0x7fd5880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.361+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd5900ccb50 con 0x7fd5a0100df0 2023-09-21T12:55:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.362+0000 7fd59e7fc700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 0x7fd5880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.362+0000 7fd59e7fc700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 0x7fd5880a2b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd594011550 tx=0x7fd594009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.364+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd5900966c0 con 0x7fd5a0100df0 2023-09-21T12:55:59.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.568+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5a01a1740 con 0x7fd5a0100df0 2023-09-21T12:55:59.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.568+0000 7fd587fff700 1 -- 172.21.15.142:0/3007397949 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd590099ce0 con 0x7fd5a0100df0 2023-09-21T12:55:59.568 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:55:59.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 msgr2=0x7fd5880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 0x7fd5880a2b00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd594011550 tx=0x7fd594009260 comp rx=0 tx=0).stop 2023-09-21T12:55:59.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 msgr2=0x7fd5a0198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 0x7fd5a0198d40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd5900098e0 tx=0x7fd59000f690 comp rx=0 tx=0).stop 2023-09-21T12:55:59.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 shutdown_connections 2023-09-21T12:55:59.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fd5880a0640 0x7fd5880a2b00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5a0102980 0x7fd5a01a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd5a0100df0 0x7fd5a0198d40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 --2- 172.21.15.142:0/3007397949 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd5a0101fe0 0x7fd5a0199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 >> 172.21.15.142:0/3007397949 conn(0x7fd5a00fc360 msgr2=0x7fd5a00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:59.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 shutdown_connections 2023-09-21T12:55:59.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.571+0000 7fd5a55ff700 1 -- 172.21.15.142:0/3007397949 wait complete. 2023-09-21T12:55:59.590 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:55:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 -- 172.21.15.142:0/985525181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c102980 msgr2=0x7fb92c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 --2- 172.21.15.142:0/985525181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c102980 0x7fb92c109230 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb92400b0d0 tx=0x7fb92400b3e0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 -- 172.21.15.142:0/985525181 shutdown_connections 2023-09-21T12:55:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 --2- 172.21.15.142:0/985525181 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c102980 0x7fb92c109230 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 --2- 172.21.15.142:0/985525181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c100df0 0x7fb92c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 --2- 172.21.15.142:0/985525181 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c101fe0 0x7fb92c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 -- 172.21.15.142:0/985525181 >> 172.21.15.142:0/985525181 conn(0x7fb92c0fc360 msgr2=0x7fb92c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:55:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 -- 172.21.15.142:0/985525181 shutdown_connections 2023-09-21T12:55:59.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.795+0000 7fb9329ff700 1 -- 172.21.15.142:0/985525181 wait complete. 2023-09-21T12:55:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.796+0000 7fb9329ff700 1 Processor -- start 2023-09-21T12:55:59.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.796+0000 7fb9329ff700 1 -- start start 2023-09-21T12:55:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c101fe0 0x7fb92c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 0x7fb92c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19e760 con 0x7fb92c100df0 2023-09-21T12:55:59.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19e8a0 con 0x7fb92c102980 2023-09-21T12:55:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb9329ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c19ea30 con 0x7fb92c101fe0 2023-09-21T12:55:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47362/0 (socket says 172.21.15.142:47362) 2023-09-21T12:55:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 -- 172.21.15.142:0/2357838811 learned_addr learned my addr 172.21.15.142:0/2357838811 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:55:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92b7fe700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c101fe0 0x7fb92c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb930f9c700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 0x7fb92c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 -- 172.21.15.142:0/2357838811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c101fe0 msgr2=0x7fb92c197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c101fe0 0x7fb92c197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 -- 172.21.15.142:0/2357838811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 msgr2=0x7fb92c19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:55:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 0x7fb92c19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:55:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb92bfff700 1 -- 172.21.15.142:0/2357838811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924009d00 con 0x7fb92c100df0 2023-09-21T12:55:59.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.797+0000 7fb930f9c700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 0x7fb92c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:55:59.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb92bfff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00e970 tx=0x7fb91c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:59.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009790 con 0x7fb92c100df0 2023-09-21T12:55:59.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91c00eec0 con 0x7fb92c100df0 2023-09-21T12:55:59.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c19ed10 con 0x7fb92c100df0 2023-09-21T12:55:59.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003cf0 con 0x7fb92c100df0 2023-09-21T12:55:59.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.798+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c19f1d0 con 0x7fb92c100df0 2023-09-21T12:55:59.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.799+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c1082e0 con 0x7fb92c100df0 2023-09-21T12:55:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.801+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fb91c00ccd0 con 0x7fb92c100df0 2023-09-21T12:55:59.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.802+0000 7fb9297fa700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 0x7fb9140a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:55:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.802+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb91c014070 con 0x7fb92c100df0 2023-09-21T12:55:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.803+0000 7fb92b7fe700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 0x7fb9140a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:55:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.803+0000 7fb92b7fe700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 0x7fb9140a2b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb920007be0 tx=0x7fb9200073d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:55:59.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:55:59.806+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb91c095940 con 0x7fb92c100df0 2023-09-21T12:55:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:59 smithi142 ceph-mon[97663]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:55:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:59 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/441181303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:55:59.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:55:59 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3007397949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:00.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.010+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb92c10c660 con 0x7fb92c100df0 2023-09-21T12:56:00.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.010+0000 7fb9297fa700 1 -- 172.21.15.142:0/2357838811 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb91c098f60 con 0x7fb92c100df0 2023-09-21T12:56:00.010 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:56:00.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 msgr2=0x7fb9140a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 0x7fb9140a2b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb920007be0 tx=0x7fb9200073d0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 msgr2=0x7fb92c196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00e970 tx=0x7fb91c00ec80 comp rx=0 tx=0).stop 2023-09-21T12:56:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 shutdown_connections 2023-09-21T12:56:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb9140a0640 0x7fb9140a2b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb92c100df0 0x7fb92c196be0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb92c102980 0x7fb92c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 --2- 172.21.15.142:0/2357838811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92c101fe0 0x7fb92c197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 >> 172.21.15.142:0/2357838811 conn(0x7fb92c0fc360 msgr2=0x7fb92c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 shutdown_connections 2023-09-21T12:56:00.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.013+0000 7fb9329ff700 1 -- 172.21.15.142:0/2357838811 wait complete. 2023-09-21T12:56:00.031 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:56:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:59 smithi156 ceph-mon[134078]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:56:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:59 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/441181303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:00.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:55:59 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3007397949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:59 smithi160 ceph-mon[134450]: pgmap v325: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:56:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:59 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/441181303' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:55:59 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3007397949' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:00.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 -- 172.21.15.142:0/2937538849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 msgr2=0x7fdc94109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2937538849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc94109230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00b0d0 tx=0x7fdc8c00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 -- 172.21.15.142:0/2937538849 shutdown_connections 2023-09-21T12:56:00.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2937538849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc94109230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2937538849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2937538849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 0x7fdc94102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 -- 172.21.15.142:0/2937538849 >> 172.21.15.142:0/2937538849 conn(0x7fdc940fc360 msgr2=0x7fdc940fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:00.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 -- 172.21.15.142:0/2937538849 shutdown_connections 2023-09-21T12:56:00.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.232+0000 7fdc99fff700 1 -- 172.21.15.142:0/2937538849 wait complete. 2023-09-21T12:56:00.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.233+0000 7fdc99fff700 1 Processor -- start 2023-09-21T12:56:00.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.233+0000 7fdc99fff700 1 -- start start 2023-09-21T12:56:00.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 0x7fdc94197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc9419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419e770 con 0x7fdc94102980 2023-09-21T12:56:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419e8e0 con 0x7fdc94100df0 2023-09-21T12:56:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc99fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9419eaa0 con 0x7fdc94101fe0 2023-09-21T12:56:00.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc9419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc937fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34562/0 (socket says 172.21.15.142:34562) 2023-09-21T12:56:00.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc92ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 0x7fdc94197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc937fe700 1 -- 172.21.15.142:0/2035516892 learned_addr learned my addr 172.21.15.142:0/2035516892 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:00.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 -- 172.21.15.142:0/2035516892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 msgr2=0x7fdc94197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 0x7fdc94197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 -- 172.21.15.142:0/2035516892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 msgr2=0x7fdc94196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc93fff700 1 -- 172.21.15.142:0/2035516892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc8c009d00 con 0x7fdc94102980 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.234+0000 7fdc937fe700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc93fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc9419e1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c007a30 tx=0x7fdc8c008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00e040 con 0x7fdc94102980 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8c00bd30 con 0x7fdc94102980 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9419ed20 con 0x7fdc94102980 2023-09-21T12:56:00.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c01d470 con 0x7fdc94102980 2023-09-21T12:56:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.235+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc9419f150 con 0x7fdc94102980 2023-09-21T12:56:00.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.236+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc94108330 con 0x7fdc94102980 2023-09-21T12:56:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.238+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fdc8c005020 con 0x7fdc94102980 2023-09-21T12:56:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.239+0000 7fdc90ff9700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 0x7fdc7c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.239+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdc8c0cce00 con 0x7fdc94102980 2023-09-21T12:56:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.240+0000 7fdc937fe700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 0x7fdc7c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.240+0000 7fdc937fe700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 0x7fdc7c0a2b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc94198100 tx=0x7fdc84009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:00.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.243+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fdc8c096970 con 0x7fdc94102980 2023-09-21T12:56:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.446+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc9402d100 con 0x7fdc94102980 2023-09-21T12:56:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.447+0000 7fdc90ff9700 1 -- 172.21.15.142:0/2035516892 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc8c099f90 con 0x7fdc94102980 2023-09-21T12:56:00.447 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:56:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 msgr2=0x7fdc7c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 0x7fdc7c0a2b00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdc94198100 tx=0x7fdc84009260 comp rx=0 tx=0).stop 2023-09-21T12:56:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 msgr2=0x7fdc9419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc9419e1a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c007a30 tx=0x7fdc8c008eb0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 shutdown_connections 2023-09-21T12:56:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fdc7c0a0640 0x7fdc7c0a2b00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc94102980 0x7fdc9419e1a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc94100df0 0x7fdc94196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 --2- 172.21.15.142:0/2035516892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc94101fe0 0x7fdc94197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.449+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 >> 172.21.15.142:0/2035516892 conn(0x7fdc940fc360 msgr2=0x7fdc94105470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.450+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 shutdown_connections 2023-09-21T12:56:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.450+0000 7fdc99fff700 1 -- 172.21.15.142:0/2035516892 wait complete. 2023-09-21T12:56:00.467 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-09-21T12:56:00.468 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:56:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 -- 172.21.15.142:0/87329270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8073840 msgr2=0x7f57f8073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 --2- 172.21.15.142:0/87329270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8073840 0x7f57f8073cc0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f57e8009990 tx=0x7f57e8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 -- 172.21.15.142:0/87329270 shutdown_connections 2023-09-21T12:56:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 --2- 172.21.15.142:0/87329270 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f810d3c0 0x7f57f810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 --2- 172.21.15.142:0/87329270 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f8074e20 0x7f57f8073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 --2- 172.21.15.142:0/87329270 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8073840 0x7f57f8073cc0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 -- 172.21.15.142:0/87329270 >> 172.21.15.142:0/87329270 conn(0x7f57f80fc320 msgr2=0x7f57f80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 -- 172.21.15.142:0/87329270 shutdown_connections 2023-09-21T12:56:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.668+0000 7f58003ff700 1 -- 172.21.15.142:0/87329270 wait complete. 2023-09-21T12:56:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 Processor -- start 2023-09-21T12:56:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 -- start start 2023-09-21T12:56:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8073840 0x7f57f819d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810d3c0 0x7f57f81a4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81a4c20 con 0x7f57f8074e20 2023-09-21T12:56:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81a4d60 con 0x7f57f8073840 2023-09-21T12:56:00.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f58003ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f81a4ef0 con 0x7f57f810d3c0 2023-09-21T12:56:00.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.669+0000 7f57fd99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fe19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8073840 0x7f57f819d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47394/0 (socket says 172.21.15.142:47394) 2023-09-21T12:56:00.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 -- 172.21.15.142:0/800018973 learned_addr learned my addr 172.21.15.142:0/800018973 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fe99c700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810d3c0 0x7f57f81a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 -- 172.21.15.142:0/800018973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810d3c0 msgr2=0x7f57f81a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810d3c0 0x7f57f81a4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 -- 172.21.15.142:0/800018973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8073840 msgr2=0x7f57f819d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8073840 0x7f57f819d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 -- 172.21.15.142:0/800018973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e80095f0 con 0x7f57f8074e20 2023-09-21T12:56:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57fd99a700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57e8005720 tx=0x7f57e8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e801d070 con 0x7f57f8074e20 2023-09-21T12:56:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57e8021410 con 0x7f57f8074e20 2023-09-21T12:56:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57f81a5170 con 0x7f57f8074e20 2023-09-21T12:56:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.670+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e8017650 con 0x7f57f8074e20 2023-09-21T12:56:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.671+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f81a5590 con 0x7f57f8074e20 2023-09-21T12:56:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.672+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57f8102f10 con 0x7f57f8074e20 2023-09-21T12:56:00.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.674+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f57e8021580 con 0x7f57f8074e20 2023-09-21T12:56:00.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.675+0000 7f57ef7fe700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 0x7f57e40a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:00.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.675+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f57e80cd1f0 con 0x7f57f8074e20 2023-09-21T12:56:00.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.675+0000 7f57fe19b700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 0x7f57e40a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:00.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.676+0000 7f57fe19b700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 0x7f57e40a2b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009c60 tx=0x7f57f4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:00.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.677+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f57e8096d60 con 0x7f57f8074e20 2023-09-21T12:56:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.923+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57f8112c30 con 0x7f57f8074e20 2023-09-21T12:56:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.924+0000 7f57ef7fe700 1 -- 172.21.15.142:0/800018973 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f57e809a380 con 0x7f57f8074e20 2023-09-21T12:56:00.924 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:00.924 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:56:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 msgr2=0x7f57e40a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 0x7f57e40a2b50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f57f4009c60 tx=0x7f57f4009260 comp rx=0 tx=0).stop 2023-09-21T12:56:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 msgr2=0x7f57f819d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f57e8005720 tx=0x7f57e8009580 comp rx=0 tx=0).stop 2023-09-21T12:56:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 shutdown_connections 2023-09-21T12:56:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f57e40a0690 0x7f57e40a2b50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57f810d3c0 0x7f57f81a4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57f8073840 0x7f57f819d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 --2- 172.21.15.142:0/800018973 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57f8074e20 0x7f57f819d5e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.926+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 >> 172.21.15.142:0/800018973 conn(0x7f57f80fc320 msgr2=0x7f57f80fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.927+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 shutdown_connections 2023-09-21T12:56:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:00.927+0000 7f58003ff700 1 -- 172.21.15.142:0/800018973 wait complete. 2023-09-21T12:56:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:56:00.946 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-09-21T12:56:00.946 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-09-21T12:56:00.947 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T12:56:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/3337595545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4102970 msgr2=0x7fe0e4109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/3337595545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4102970 0x7fe0e4109220 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00b0d0 tx=0x7fe0dc00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/3337595545 shutdown_connections 2023-09-21T12:56:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/3337595545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4102970 0x7fe0e4109220 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/3337595545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4100de0 0x7fe0e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/3337595545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 0x7fe0e4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/3337595545 >> 172.21.15.142:0/3337595545 conn(0x7fe0e40fc310 msgr2=0x7fe0e40fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/3337595545 shutdown_connections 2023-09-21T12:56:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.146+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/3337595545 wait complete. 2023-09-21T12:56:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.147+0000 7fe0eb7ff700 1 Processor -- start 2023-09-21T12:56:01.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.147+0000 7fe0eb7ff700 1 -- start start 2023-09-21T12:56:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 0x7fe0e41992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 0x7fe0e41a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41a08f0 con 0x7fe0e4100de0 2023-09-21T12:56:01.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41a0a60 con 0x7fe0e4101fd0 2023-09-21T12:56:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0eb7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e41a0c20 con 0x7fe0e4102970 2023-09-21T12:56:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47422/0 (socket says 172.21.15.142:47422) 2023-09-21T12:56:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 -- 172.21.15.142:0/1096315334 learned_addr learned my addr 172.21.15.142:0/1096315334 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:01.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e8d9a700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 0x7fe0e41992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e9d9c700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 0x7fe0e41a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 -- 172.21.15.142:0/1096315334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 msgr2=0x7fe0e41a0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 0x7fe0e41a0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 -- 172.21.15.142:0/1096315334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 msgr2=0x7fe0e41992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 0x7fe0e41992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e959b700 1 -- 172.21.15.142:0/1096315334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0009520 con 0x7fe0e4100de0 2023-09-21T12:56:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.148+0000 7fe0e9d9c700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 0x7fe0e41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0e959b700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000ea50 tx=0x7fe0e000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:01.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000cbd0 con 0x7fe0e4100de0 2023-09-21T12:56:01.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0e000cd30 con 0x7fe0e4100de0 2023-09-21T12:56:01.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00186c0 con 0x7fe0e4100de0 2023-09-21T12:56:01.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0dc009d00 con 0x7fe0e4100de0 2023-09-21T12:56:01.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.149+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e41a11d0 con 0x7fe0e4100de0 2023-09-21T12:56:01.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:00 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2357838811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:00 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2035516892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.150+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e410c650 con 0x7fe0e4100de0 2023-09-21T12:56:01.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.152+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fe0e0018820 con 0x7fe0e4100de0 2023-09-21T12:56:01.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.153+0000 7fe0da7fc700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 0x7fe0d00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.153+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe0e0014070 con 0x7fe0e4100de0 2023-09-21T12:56:01.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.154+0000 7fe0e8d9a700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 0x7fe0d00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.154+0000 7fe0e8d9a700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 0x7fe0d00a2bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009c60 tx=0x7fe0d4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:01.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.157+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe0e0095b90 con 0x7fe0e4100de0 2023-09-21T12:56:01.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:00 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2357838811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:00 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2035516892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:00 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2357838811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:00 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2035516892' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:01.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.355+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe0e4108f30 con 0x7fe0d00a0710 2023-09-21T12:56:01.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.366+0000 7fe0da7fc700 1 -- 172.21.15.142:0/1096315334 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344990 (secure 0 0 0) 0x7fe0e4108f30 con 0x7fe0d00a0710 2023-09-21T12:56:01.371 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:01.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 msgr2=0x7fe0d00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 0x7fe0d00a2bd0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009c60 tx=0x7fe0d4009260 comp rx=0 tx=0).stop 2023-09-21T12:56:01.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 msgr2=0x7fe0e4198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000ea50 tx=0x7fe0e000ed60 comp rx=0 tx=0).stop 2023-09-21T12:56:01.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 shutdown_connections 2023-09-21T12:56:01.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fe0d00a0710 0x7fe0d00a2bd0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0e4100de0 0x7fe0e4198db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0e4102970 0x7fe0e41a0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 --2- 172.21.15.142:0/1096315334 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0e4101fd0 0x7fe0e41992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.371+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 >> 172.21.15.142:0/1096315334 conn(0x7fe0e40fc310 msgr2=0x7fe0e4107810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:01.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.372+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 shutdown_connections 2023-09-21T12:56:01.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.372+0000 7fe0eb7ff700 1 -- 172.21.15.142:0/1096315334 wait complete. 2023-09-21T12:56:01.377 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:56:01.390 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-09-21T12:56:00.395767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653161,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":510,"num_write":345,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180893,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335536,"kb_used_data":11344,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606288,"statfs":{"total":1151940427776,"available":1151596838912,"internally_reserved":0,"allocated":11616256,"data_stored":7312122,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419262+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:55:40.419262+0000","last_peered":"2023-09-21T12:55:40.419262+0000","last_clean":"2023-09-21T12:55:40.419262+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:55:40.419262+0000","last_undegraded":"2023-09-21T12:55:40.419262+0000","last_fullsized":"2023-09-21T12:55:40.419262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418770+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:55:40.418770+0000","last_peered":"2023-09-21T12:55:40.418770+0000","last_clean":"2023-09-21T12:55:40.418770+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:55:40.418770+0000","last_undegraded":"2023-09-21T12:55:40.418770+0000","last_fullsized":"2023-09-21T12:55:40.418770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422258+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:55:40.422258+0000","last_peered":"2023-09-21T12:55:40.422258+0000","last_clean":"2023-09-21T12:55:40.422258+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:55:40.422258+0000","last_undegraded":"2023-09-21T12:55:40.422258+0000","last_fullsized":"2023-09-21T12:55:40.422258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417527+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:55:40.417527+0000","last_peered":"2023-09-21T12:55:40.417527+0000","last_clean":"2023-09-21T12:55:40.417527+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:55:40.417527+0000","last_undegraded":"2023-09-21T12:55:40.417527+0000","last_fullsized":"2023-09-21T12:55:40.417527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406678+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:55:40.406678+0000","last_peered":"2023-09-21T12:55:40.406678+0000","last_clean":"2023-09-21T12:55:40.406678+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:55:40.406678+0000","last_undegraded":"2023-09-21T12:55:40.406678+0000","last_fullsized":"2023-09-21T12:55:40.406678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418106+0000","last_change":"2023-09-21T12:54:41.568064+0000","last_active":"2023-09-21T12:55:40.418106+0000","last_peered":"2023-09-21T12:55:40.418106+0000","last_clean":"2023-09-21T12:55:40.418106+0000","last_became_active":"2023-09-21T12:54:41.567634+0000","last_became_peered":"2023-09-21T12:54:41.567634+0000","last_unstale":"2023-09-21T12:55:40.418106+0000","last_undegraded":"2023-09-21T12:55:40.418106+0000","last_fullsized":"2023-09-21T12:55:40.418106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:25:07.646626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409521+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:55:40.409521+0000","last_peered":"2023-09-21T12:55:40.409521+0000","last_clean":"2023-09-21T12:55:40.409521+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:55:40.409521+0000","last_undegraded":"2023-09-21T12:55:40.409521+0000","last_fullsized":"2023-09-21T12:55:40.409521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415704+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:55:40.415704+0000","last_peered":"2023-09-21T12:55:40.415704+0000","last_clean":"2023-09-21T12:55:40.415704+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:55:40.415704+0000","last_undegraded":"2023-09-21T12:55:40.415704+0000","last_fullsized":"2023-09-21T12:55:40.415704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.405631+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:55:40.405631+0000","last_peered":"2023-09-21T12:55:40.405631+0000","last_clean":"2023-09-21T12:55:40.405631+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:55:40.405631+0000","last_undegraded":"2023-09-21T12:55:40.405631+0000","last_fullsized":"2023-09-21T12:55:40.405631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416687+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:55:40.416687+0000","last_peered":"2023-09-21T12:55:40.416687+0000","last_clean":"2023-09-21T12:55:40.416687+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:55:40.416687+0000","last_undegraded":"2023-09-21T12:55:40.416687+0000","last_fullsized":"2023-09-21T12:55:40.416687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419501+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:55:40.419501+0000","last_peered":"2023-09-21T12:55:40.419501+0000","last_clean":"2023-09-21T12:55:40.419501+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:55:40.419501+0000","last_undegraded":"2023-09-21T12:55:40.419501+0000","last_fullsized":"2023-09-21T12:55:40.419501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417386+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:55:40.417386+0000","last_peered":"2023-09-21T12:55:40.417386+0000","last_clean":"2023-09-21T12:55:40.417386+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:55:40.417386+0000","last_undegraded":"2023-09-21T12:55:40.417386+0000","last_fullsized":"2023-09-21T12:55:40.417386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399424+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:55:40.399424+0000","last_peered":"2023-09-21T12:55:40.399424+0000","last_clean":"2023-09-21T12:55:40.399424+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:55:40.399424+0000","last_undegraded":"2023-09-21T12:55:40.399424+0000","last_fullsized":"2023-09-21T12:55:40.399424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422157+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:55:40.422157+0000","last_peered":"2023-09-21T12:55:40.422157+0000","last_clean":"2023-09-21T12:55:40.422157+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:55:40.422157+0000","last_undegraded":"2023-09-21T12:55:40.422157+0000","last_fullsized":"2023-09-21T12:55:40.422157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420514+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:55:40.420514+0000","last_peered":"2023-09-21T12:55:40.420514+0000","last_clean":"2023-09-21T12:55:40.420514+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:55:40.420514+0000","last_undegraded":"2023-09-21T12:55:40.420514+0000","last_fullsized":"2023-09-21T12:55:40.420514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422688+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:55:40.422688+0000","last_peered":"2023-09-21T12:55:40.422688+0000","last_clean":"2023-09-21T12:55:40.422688+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:55:40.422688+0000","last_undegraded":"2023-09-21T12:55:40.422688+0000","last_fullsized":"2023-09-21T12:55:40.422688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419339+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:55:40.419339+0000","last_peered":"2023-09-21T12:55:40.419339+0000","last_clean":"2023-09-21T12:55:40.419339+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:55:40.419339+0000","last_undegraded":"2023-09-21T12:55:40.419339+0000","last_fullsized":"2023-09-21T12:55:40.419339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404163+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:55:40.404163+0000","last_peered":"2023-09-21T12:55:40.404163+0000","last_clean":"2023-09-21T12:55:40.404163+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:55:40.404163+0000","last_undegraded":"2023-09-21T12:55:40.404163+0000","last_fullsized":"2023-09-21T12:55:40.404163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412551+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:55:40.412551+0000","last_peered":"2023-09-21T12:55:40.412551+0000","last_clean":"2023-09-21T12:55:40.412551+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:55:40.412551+0000","last_undegraded":"2023-09-21T12:55:40.412551+0000","last_fullsized":"2023-09-21T12:55:40.412551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555018+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:40.555018+0000","last_peered":"2023-09-21T12:54:40.555018+0000","last_clean":"2023-09-21T12:54:40.555018+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:40.555018+0000","last_undegraded":"2023-09-21T12:54:40.555018+0000","last_fullsized":"2023-09-21T12:54:40.555018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412189+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:55:40.412189+0000","last_peered":"2023-09-21T12:55:40.412189+0000","last_clean":"2023-09-21T12:55:40.412189+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:55:40.412189+0000","last_undegraded":"2023-09-21T12:55:40.412189+0000","last_fullsized":"2023-09-21T12:55:40.412189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563487+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:40.563487+0000","last_peered":"2023-09-21T12:54:40.563487+0000","last_clean":"2023-09-21T12:54:40.563487+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:40.563487+0000","last_undegraded":"2023-09-21T12:54:40.563487+0000","last_fullsized":"2023-09-21T12:54:40.563487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422849+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:55:40.422849+0000","last_peered":"2023-09-21T12:55:40.422849+0000","last_clean":"2023-09-21T12:55:40.422849+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:55:40.422849+0000","last_undegraded":"2023-09-21T12:55:40.422849+0000","last_fullsized":"2023-09-21T12:55:40.422849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559289+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:40.559289+0000","last_peered":"2023-09-21T12:54:40.559289+0000","last_clean":"2023-09-21T12:54:40.559289+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:40.559289+0000","last_undegraded":"2023-09-21T12:54:40.559289+0000","last_fullsized":"2023-09-21T12:54:40.559289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403027+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:55:40.403027+0000","last_peered":"2023-09-21T12:55:40.403027+0000","last_clean":"2023-09-21T12:55:40.403027+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:55:40.403027+0000","last_undegraded":"2023-09-21T12:55:40.403027+0000","last_fullsized":"2023-09-21T12:55:40.403027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574116+0000","last_change":"2023-09-21T12:54:41.573641+0000","last_active":"2023-09-21T12:54:41.574116+0000","last_peered":"2023-09-21T12:54:41.574116+0000","last_clean":"2023-09-21T12:54:41.574116+0000","last_became_active":"2023-09-21T12:54:41.570382+0000","last_became_peered":"2023-09-21T12:54:41.570382+0000","last_unstale":"2023-09-21T12:54:41.574116+0000","last_undegraded":"2023-09-21T12:54:41.574116+0000","last_fullsized":"2023-09-21T12:54:41.574116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:47:35.642160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407249+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:55:40.407249+0000","last_peered":"2023-09-21T12:55:40.407249+0000","last_clean":"2023-09-21T12:55:40.407249+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:55:40.407249+0000","last_undegraded":"2023-09-21T12:55:40.407249+0000","last_fullsized":"2023-09-21T12:55:40.407249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:55.589472+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:55:55.589472+0000","last_peered":"2023-09-21T12:55:55.589472+0000","last_clean":"2023-09-21T12:55:55.589472+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:55:55.589472+0000","last_undegraded":"2023-09-21T12:55:55.589472+0000","last_fullsized":"2023-09-21T12:55:55.589472+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400941+0000","last_change":"2023-09-21T12:54:41.717011+0000","last_active":"2023-09-21T12:55:40.400941+0000","last_peered":"2023-09-21T12:55:40.400941+0000","last_clean":"2023-09-21T12:55:40.400941+0000","last_became_active":"2023-09-21T12:54:41.716663+0000","last_became_peered":"2023-09-21T12:54:41.716663+0000","last_unstale":"2023-09-21T12:55:40.400941+0000","last_undegraded":"2023-09-21T12:55:40.400941+0000","last_fullsized":"2023-09-21T12:55:40.400941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:24:43.714781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557437+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:40.557437+0000","last_peered":"2023-09-21T12:54:40.557437+0000","last_clean":"2023-09-21T12:54:40.557437+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:40.557437+0000","last_undegraded":"2023-09-21T12:54:40.557437+0000","last_fullsized":"2023-09-21T12:54:40.557437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406135+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:55:40.406135+0000","last_peered":"2023-09-21T12:55:40.406135+0000","last_clean":"2023-09-21T12:55:40.406135+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:55:40.406135+0000","last_undegraded":"2023-09-21T12:55:40.406135+0000","last_fullsized":"2023-09-21T12:55:40.406135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561561+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:40.561561+0000","last_peered":"2023-09-21T12:54:40.561561+0000","last_clean":"2023-09-21T12:54:40.561561+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:40.561561+0000","last_undegraded":"2023-09-21T12:54:40.561561+0000","last_fullsized":"2023-09-21T12:54:40.561561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411654+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:55:40.411654+0000","last_peered":"2023-09-21T12:55:40.411654+0000","last_clean":"2023-09-21T12:55:40.411654+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:55:40.411654+0000","last_undegraded":"2023-09-21T12:55:40.411654+0000","last_fullsized":"2023-09-21T12:55:40.411654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555803+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:40.555803+0000","last_peered":"2023-09-21T12:54:40.555803+0000","last_clean":"2023-09-21T12:54:40.555803+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:40.555803+0000","last_undegraded":"2023-09-21T12:54:40.555803+0000","last_fullsized":"2023-09-21T12:54:40.555803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417347+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:55:40.417347+0000","last_peered":"2023-09-21T12:55:40.417347+0000","last_clean":"2023-09-21T12:55:40.417347+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:55:40.417347+0000","last_undegraded":"2023-09-21T12:55:40.417347+0000","last_fullsized":"2023-09-21T12:55:40.417347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":122,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.592231+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:55:57.592231+0000","last_peered":"2023-09-21T12:55:57.592231+0000","last_clean":"2023-09-21T12:55:57.592231+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:55:57.592231+0000","last_undegraded":"2023-09-21T12:55:57.592231+0000","last_fullsized":"2023-09-21T12:55:57.592231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403182+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:55:40.403182+0000","last_peered":"2023-09-21T12:55:40.403182+0000","last_clean":"2023-09-21T12:55:40.403182+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:55:40.403182+0000","last_undegraded":"2023-09-21T12:55:40.403182+0000","last_fullsized":"2023-09-21T12:55:40.403182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561279+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:40.561279+0000","last_peered":"2023-09-21T12:54:40.561279+0000","last_clean":"2023-09-21T12:54:40.561279+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:40.561279+0000","last_undegraded":"2023-09-21T12:54:40.561279+0000","last_fullsized":"2023-09-21T12:54:40.561279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423718+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:55:40.423718+0000","last_peered":"2023-09-21T12:55:40.423718+0000","last_clean":"2023-09-21T12:55:40.423718+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:55:40.423718+0000","last_undegraded":"2023-09-21T12:55:40.423718+0000","last_fullsized":"2023-09-21T12:55:40.423718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557100+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:40.557100+0000","last_peered":"2023-09-21T12:54:40.557100+0000","last_clean":"2023-09-21T12:54:40.557100+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:40.557100+0000","last_undegraded":"2023-09-21T12:54:40.557100+0000","last_fullsized":"2023-09-21T12:54:40.557100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418004+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:55:40.418004+0000","last_peered":"2023-09-21T12:55:40.418004+0000","last_clean":"2023-09-21T12:55:40.418004+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:55:40.418004+0000","last_undegraded":"2023-09-21T12:55:40.418004+0000","last_fullsized":"2023-09-21T12:55:40.418004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":261,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:58.601142+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:55:58.601142+0000","last_peered":"2023-09-21T12:55:58.601142+0000","last_clean":"2023-09-21T12:55:58.601142+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:55:58.601142+0000","last_undegraded":"2023-09-21T12:55:58.601142+0000","last_fullsized":"2023-09-21T12:55:58.601142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57559,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":163,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421550+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:55:40.421550+0000","last_peered":"2023-09-21T12:55:40.421550+0000","last_clean":"2023-09-21T12:55:40.421550+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:55:40.421550+0000","last_undegraded":"2023-09-21T12:55:40.421550+0000","last_fullsized":"2023-09-21T12:55:40.421550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.581333+0000","last_change":"2023-09-21T12:54:41.580944+0000","last_active":"2023-09-21T12:54:41.581333+0000","last_peered":"2023-09-21T12:54:41.581333+0000","last_clean":"2023-09-21T12:54:41.581333+0000","last_became_active":"2023-09-21T12:54:41.571007+0000","last_became_peered":"2023-09-21T12:54:41.571007+0000","last_unstale":"2023-09-21T12:54:41.581333+0000","last_undegraded":"2023-09-21T12:54:41.581333+0000","last_fullsized":"2023-09-21T12:54:41.581333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:54:34.209661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422245+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:55:40.422245+0000","last_peered":"2023-09-21T12:55:40.422245+0000","last_clean":"2023-09-21T12:55:40.422245+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:55:40.422245+0000","last_undegraded":"2023-09-21T12:55:40.422245+0000","last_fullsized":"2023-09-21T12:55:40.422245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556559+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:40.556559+0000","last_peered":"2023-09-21T12:54:40.556559+0000","last_clean":"2023-09-21T12:54:40.556559+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:40.556559+0000","last_undegraded":"2023-09-21T12:54:40.556559+0000","last_fullsized":"2023-09-21T12:54:40.556559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421237+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:55:40.421237+0000","last_peered":"2023-09-21T12:55:40.421237+0000","last_clean":"2023-09-21T12:55:40.421237+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:55:40.421237+0000","last_undegraded":"2023-09-21T12:55:40.421237+0000","last_fullsized":"2023-09-21T12:55:40.421237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:56.621617+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:55:56.621617+0000","last_peered":"2023-09-21T12:55:56.621617+0000","last_clean":"2023-09-21T12:55:56.621617+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:55:56.621617+0000","last_undegraded":"2023-09-21T12:55:56.621617+0000","last_fullsized":"2023-09-21T12:55:56.621617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407709+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:55:40.407709+0000","last_peered":"2023-09-21T12:55:40.407709+0000","last_clean":"2023-09-21T12:55:40.407709+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:55:40.407709+0000","last_undegraded":"2023-09-21T12:55:40.407709+0000","last_fullsized":"2023-09-21T12:55:40.407709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557457+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:40.557457+0000","last_peered":"2023-09-21T12:54:40.557457+0000","last_clean":"2023-09-21T12:54:40.557457+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:40.557457+0000","last_undegraded":"2023-09-21T12:54:40.557457+0000","last_fullsized":"2023-09-21T12:54:40.557457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404266+0000","last_change":"2023-09-21T12:54:41.570475+0000","last_active":"2023-09-21T12:55:40.404266+0000","last_peered":"2023-09-21T12:55:40.404266+0000","last_clean":"2023-09-21T12:55:40.404266+0000","last_became_active":"2023-09-21T12:54:41.570069+0000","last_became_peered":"2023-09-21T12:54:41.570069+0000","last_unstale":"2023-09-21T12:55:40.404266+0000","last_undegraded":"2023-09-21T12:55:40.404266+0000","last_fullsized":"2023-09-21T12:55:40.404266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:07:47.022244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559676+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:40.559676+0000","last_peered":"2023-09-21T12:54:40.559676+0000","last_clean":"2023-09-21T12:54:40.559676+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:40.559676+0000","last_undegraded":"2023-09-21T12:54:40.559676+0000","last_fullsized":"2023-09-21T12:54:40.559676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412436+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:55:40.412436+0000","last_peered":"2023-09-21T12:55:40.412436+0000","last_clean":"2023-09-21T12:55:40.412436+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:55:40.412436+0000","last_undegraded":"2023-09-21T12:55:40.412436+0000","last_fullsized":"2023-09-21T12:55:40.412436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555077+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:40.555077+0000","last_peered":"2023-09-21T12:54:40.555077+0000","last_clean":"2023-09-21T12:54:40.555077+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:40.555077+0000","last_undegraded":"2023-09-21T12:54:40.555077+0000","last_fullsized":"2023-09-21T12:54:40.555077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412701+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:55:40.412701+0000","last_peered":"2023-09-21T12:55:40.412701+0000","last_clean":"2023-09-21T12:55:40.412701+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:55:40.412701+0000","last_undegraded":"2023-09-21T12:55:40.412701+0000","last_fullsized":"2023-09-21T12:55:40.412701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561037+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:40.561037+0000","last_peered":"2023-09-21T12:54:40.561037+0000","last_clean":"2023-09-21T12:54:40.561037+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:40.561037+0000","last_undegraded":"2023-09-21T12:54:40.561037+0000","last_fullsized":"2023-09-21T12:54:40.561037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418895+0000","last_change":"2023-09-21T12:54:41.862117+0000","last_active":"2023-09-21T12:55:40.418895+0000","last_peered":"2023-09-21T12:55:40.418895+0000","last_clean":"2023-09-21T12:55:40.418895+0000","last_became_active":"2023-09-21T12:54:41.861717+0000","last_became_peered":"2023-09-21T12:54:41.861717+0000","last_unstale":"2023-09-21T12:55:40.418895+0000","last_undegraded":"2023-09-21T12:55:40.418895+0000","last_fullsized":"2023-09-21T12:55:40.418895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:25:46.138394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416091+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:55:40.416091+0000","last_peered":"2023-09-21T12:55:40.416091+0000","last_clean":"2023-09-21T12:55:40.416091+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:55:40.416091+0000","last_undegraded":"2023-09-21T12:55:40.416091+0000","last_fullsized":"2023-09-21T12:55:40.416091+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":123,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.623131+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:55:57.623131+0000","last_peered":"2023-09-21T12:55:57.623131+0000","last_clean":"2023-09-21T12:55:57.623131+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:55:57.623131+0000","last_undegraded":"2023-09-21T12:55:57.623131+0000","last_fullsized":"2023-09-21T12:55:57.623131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417050+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:55:40.417050+0000","last_peered":"2023-09-21T12:55:40.417050+0000","last_clean":"2023-09-21T12:55:40.417050+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:55:40.417050+0000","last_undegraded":"2023-09-21T12:55:40.417050+0000","last_fullsized":"2023-09-21T12:55:40.417050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560769+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:40.560769+0000","last_peered":"2023-09-21T12:54:40.560769+0000","last_clean":"2023-09-21T12:54:40.560769+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:40.560769+0000","last_undegraded":"2023-09-21T12:54:40.560769+0000","last_fullsized":"2023-09-21T12:54:40.560769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.566573+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:41.566573+0000","last_peered":"2023-09-21T12:54:41.566573+0000","last_clean":"2023-09-21T12:54:41.566573+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:41.566573+0000","last_undegraded":"2023-09-21T12:54:41.566573+0000","last_fullsized":"2023-09-21T12:54:41.566573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415172+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:55:40.415172+0000","last_peered":"2023-09-21T12:55:40.415172+0000","last_clean":"2023-09-21T12:55:40.415172+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:55:40.415172+0000","last_undegraded":"2023-09-21T12:55:40.415172+0000","last_fullsized":"2023-09-21T12:55:40.415172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560099+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:40.560099+0000","last_peered":"2023-09-21T12:54:40.560099+0000","last_clean":"2023-09-21T12:54:40.560099+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:40.560099+0000","last_undegraded":"2023-09-21T12:54:40.560099+0000","last_fullsized":"2023-09-21T12:54:40.560099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559181+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:40.559181+0000","last_peered":"2023-09-21T12:54:40.559181+0000","last_clean":"2023-09-21T12:54:40.559181+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:40.559181+0000","last_undegraded":"2023-09-21T12:54:40.559181+0000","last_fullsized":"2023-09-21T12:54:40.559181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400883+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:55:40.400883+0000","last_peered":"2023-09-21T12:55:40.400883+0000","last_clean":"2023-09-21T12:55:40.400883+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:55:40.400883+0000","last_undegraded":"2023-09-21T12:55:40.400883+0000","last_fullsized":"2023-09-21T12:55:40.400883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.563193+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:41.563193+0000","last_peered":"2023-09-21T12:54:41.563193+0000","last_clean":"2023-09-21T12:54:41.563193+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:41.563193+0000","last_undegraded":"2023-09-21T12:54:41.563193+0000","last_fullsized":"2023-09-21T12:54:41.563193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406894+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:55:40.406894+0000","last_peered":"2023-09-21T12:55:40.406894+0000","last_clean":"2023-09-21T12:55:40.406894+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:55:40.406894+0000","last_undegraded":"2023-09-21T12:55:40.406894+0000","last_fullsized":"2023-09-21T12:55:40.406894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561295+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:40.561295+0000","last_peered":"2023-09-21T12:54:40.561295+0000","last_clean":"2023-09-21T12:54:40.561295+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:40.561295+0000","last_undegraded":"2023-09-21T12:54:40.561295+0000","last_fullsized":"2023-09-21T12:54:40.561295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420058+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:55:40.420058+0000","last_peered":"2023-09-21T12:55:40.420058+0000","last_clean":"2023-09-21T12:55:40.420058+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:55:40.420058+0000","last_undegraded":"2023-09-21T12:55:40.420058+0000","last_fullsized":"2023-09-21T12:55:40.420058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555440+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:40.555440+0000","last_peered":"2023-09-21T12:54:40.555440+0000","last_clean":"2023-09-21T12:54:40.555440+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:40.555440+0000","last_undegraded":"2023-09-21T12:54:40.555440+0000","last_fullsized":"2023-09-21T12:54:40.555440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399956+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:55:40.399956+0000","last_peered":"2023-09-21T12:55:40.399956+0000","last_clean":"2023-09-21T12:55:40.399956+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:55:40.399956+0000","last_undegraded":"2023-09-21T12:55:40.399956+0000","last_fullsized":"2023-09-21T12:55:40.399956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563079+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:40.563079+0000","last_peered":"2023-09-21T12:54:40.563079+0000","last_clean":"2023-09-21T12:54:40.563079+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:40.563079+0000","last_undegraded":"2023-09-21T12:54:40.563079+0000","last_fullsized":"2023-09-21T12:54:40.563079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409568+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:55:40.409568+0000","last_peered":"2023-09-21T12:55:40.409568+0000","last_clean":"2023-09-21T12:55:40.409568+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:55:40.409568+0000","last_undegraded":"2023-09-21T12:55:40.409568+0000","last_fullsized":"2023-09-21T12:55:40.409568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561350+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:40.561350+0000","last_peered":"2023-09-21T12:54:40.561350+0000","last_clean":"2023-09-21T12:54:40.561350+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:40.561350+0000","last_undegraded":"2023-09-21T12:54:40.561350+0000","last_fullsized":"2023-09-21T12:54:40.561350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423399+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:55:40.423399+0000","last_peered":"2023-09-21T12:55:40.423399+0000","last_clean":"2023-09-21T12:55:40.423399+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:55:40.423399+0000","last_undegraded":"2023-09-21T12:55:40.423399+0000","last_fullsized":"2023-09-21T12:55:40.423399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557905+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:40.557905+0000","last_peered":"2023-09-21T12:54:40.557905+0000","last_clean":"2023-09-21T12:54:40.557905+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:40.557905+0000","last_undegraded":"2023-09-21T12:54:40.557905+0000","last_fullsized":"2023-09-21T12:54:40.557905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419512+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:55:40.419512+0000","last_peered":"2023-09-21T12:55:40.419512+0000","last_clean":"2023-09-21T12:55:40.419512+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:55:40.419512+0000","last_undegraded":"2023-09-21T12:55:40.419512+0000","last_fullsized":"2023-09-21T12:55:40.419512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561605+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:40.561605+0000","last_peered":"2023-09-21T12:54:40.561605+0000","last_clean":"2023-09-21T12:54:40.561605+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:40.561605+0000","last_undegraded":"2023-09-21T12:54:40.561605+0000","last_fullsized":"2023-09-21T12:54:40.561605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419739+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:55:40.419739+0000","last_peered":"2023-09-21T12:55:40.419739+0000","last_clean":"2023-09-21T12:55:40.419739+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:55:40.419739+0000","last_undegraded":"2023-09-21T12:55:40.419739+0000","last_fullsized":"2023-09-21T12:55:40.419739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556244+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:40.556244+0000","last_peered":"2023-09-21T12:54:40.556244+0000","last_clean":"2023-09-21T12:54:40.556244+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:40.556244+0000","last_undegraded":"2023-09-21T12:54:40.556244+0000","last_fullsized":"2023-09-21T12:54:40.556244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411659+0000","last_change":"2023-09-21T12:54:41.574550+0000","last_active":"2023-09-21T12:55:40.411659+0000","last_peered":"2023-09-21T12:55:40.411659+0000","last_clean":"2023-09-21T12:55:40.411659+0000","last_became_active":"2023-09-21T12:54:41.568847+0000","last_became_peered":"2023-09-21T12:54:41.568847+0000","last_unstale":"2023-09-21T12:55:40.411659+0000","last_undegraded":"2023-09-21T12:55:40.411659+0000","last_fullsized":"2023-09-21T12:55:40.411659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:40:47.869112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561711+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:40.561711+0000","last_peered":"2023-09-21T12:54:40.561711+0000","last_clean":"2023-09-21T12:54:40.561711+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:40.561711+0000","last_undegraded":"2023-09-21T12:54:40.561711+0000","last_fullsized":"2023-09-21T12:54:40.561711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.413851+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:55:40.413851+0000","last_peered":"2023-09-21T12:55:40.413851+0000","last_clean":"2023-09-21T12:55:40.413851+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:55:40.413851+0000","last_undegraded":"2023-09-21T12:55:40.413851+0000","last_fullsized":"2023-09-21T12:55:40.413851+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.402235+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:55:40.402235+0000","last_peered":"2023-09-21T12:55:40.402235+0000","last_clean":"2023-09-21T12:55:40.402235+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:55:40.402235+0000","last_undegraded":"2023-09-21T12:55:40.402235+0000","last_fullsized":"2023-09-21T12:55:40.402235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409013+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:55:40.409013+0000","last_peered":"2023-09-21T12:55:40.409013+0000","last_clean":"2023-09-21T12:55:40.409013+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:55:40.409013+0000","last_undegraded":"2023-09-21T12:55:40.409013+0000","last_fullsized":"2023-09-21T12:55:40.409013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.389897+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:55:40.389897+0000","last_peered":"2023-09-21T12:55:40.389897+0000","last_clean":"2023-09-21T12:55:40.389897+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:55:40.389897+0000","last_undegraded":"2023-09-21T12:55:40.389897+0000","last_fullsized":"2023-09-21T12:55:40.389897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421416+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:55:40.421416+0000","last_peered":"2023-09-21T12:55:40.421416+0000","last_clean":"2023-09-21T12:55:40.421416+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:55:40.421416+0000","last_undegraded":"2023-09-21T12:55:40.421416+0000","last_fullsized":"2023-09-21T12:55:40.421416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421161+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:55:40.421161+0000","last_peered":"2023-09-21T12:55:40.421161+0000","last_clean":"2023-09-21T12:55:40.421161+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:55:40.421161+0000","last_undegraded":"2023-09-21T12:55:40.421161+0000","last_fullsized":"2023-09-21T12:55:40.421161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403172+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:55:40.403172+0000","last_peered":"2023-09-21T12:55:40.403172+0000","last_clean":"2023-09-21T12:55:40.403172+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:55:40.403172+0000","last_undegraded":"2023-09-21T12:55:40.403172+0000","last_fullsized":"2023-09-21T12:55:40.403172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404940+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:55:40.404940+0000","last_peered":"2023-09-21T12:55:40.404940+0000","last_clean":"2023-09-21T12:55:40.404940+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:55:40.404940+0000","last_undegraded":"2023-09-21T12:55:40.404940+0000","last_fullsized":"2023-09-21T12:55:40.404940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416070+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:55:40.416070+0000","last_peered":"2023-09-21T12:55:40.416070+0000","last_clean":"2023-09-21T12:55:40.416070+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:55:40.416070+0000","last_undegraded":"2023-09-21T12:55:40.416070+0000","last_fullsized":"2023-09-21T12:55:40.416070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404388+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:55:40.404388+0000","last_peered":"2023-09-21T12:55:40.404388+0000","last_clean":"2023-09-21T12:55:40.404388+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:55:40.404388+0000","last_undegraded":"2023-09-21T12:55:40.404388+0000","last_fullsized":"2023-09-21T12:55:40.404388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404271+0000","last_change":"2023-09-21T12:54:41.568252+0000","last_active":"2023-09-21T12:55:40.404271+0000","last_peered":"2023-09-21T12:55:40.404271+0000","last_clean":"2023-09-21T12:55:40.404271+0000","last_became_active":"2023-09-21T12:54:41.567653+0000","last_became_peered":"2023-09-21T12:54:41.567653+0000","last_unstale":"2023-09-21T12:55:40.404271+0000","last_undegraded":"2023-09-21T12:55:40.404271+0000","last_fullsized":"2023-09-21T12:55:40.404271+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:09:31.075023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423029+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:55:40.423029+0000","last_peered":"2023-09-21T12:55:40.423029+0000","last_clean":"2023-09-21T12:55:40.423029+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:55:40.423029+0000","last_undegraded":"2023-09-21T12:55:40.423029+0000","last_fullsized":"2023-09-21T12:55:40.423029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422807+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:55:40.422807+0000","last_peered":"2023-09-21T12:55:40.422807+0000","last_clean":"2023-09-21T12:55:40.422807+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:55:40.422807+0000","last_undegraded":"2023-09-21T12:55:40.422807+0000","last_fullsized":"2023-09-21T12:55:40.422807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415950+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:55:40.415950+0000","last_peered":"2023-09-21T12:55:40.415950+0000","last_clean":"2023-09-21T12:55:40.415950+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:55:40.415950+0000","last_undegraded":"2023-09-21T12:55:40.415950+0000","last_fullsized":"2023-09-21T12:55:40.415950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62547,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":391,"num_write":162,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416419,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92600000000000005,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.437},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70199999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.876,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.107,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.44500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0049999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.54500000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.054,"5min":1.48,"15min":1.48},"last":0.77100000000000002}]},{"osd":8,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.048,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0349999999999999,"5min":1.228,"15min":1.228},"last":0.79900000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.77900000000000003,"15min":0.76300000000000001},"min":{"1min":0.58599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.133,"5min":1.55,"15min":1.55},"last":0.87},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0780000000000001,"5min":1.522,"15min":1.522},"last":0.78700000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":1096347,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.621,"15min":0.62},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":1.345,"15min":1.345},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84199999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86799999999999999}]},{"osd":8,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78700000000000003,"15min":0.78200000000000003},"min":{"1min":0.63600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96899999999999997,"5min":1.214,"15min":1.214},"last":0.749},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.76100000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.03,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91500000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78300000000000003,"5min":6.335,"15min":6.335},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55800000000000005,"15min":0.58399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.76900000000000002,"15min":0.81799999999999995},"min":{"1min":0.48799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.046,"5min":1.149,"15min":1.149},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82599999999999996,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.72499999999999998,"15min":0.753},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4199999999999999,"5min":4.633,"15min":4.633},"last":0.621},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.25,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.82099999999999995,"15min":0.88300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.046,"5min":1.492,"15min":1.492},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.85399999999999998},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1919999999999999,"5min":1.456,"15min":1.456},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.099,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83999999999999997,"15min":0.89600000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92400000000000004,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.88600000000000001,"15min":0.96499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.98699999999999999,"15min":1.0129999999999999},"min":{"1min":0.53700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1619999999999999,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.89100000000000001,"15min":0.94499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.516,"15min":2.516},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.91300000000000003,"15min":0.98299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0680000000000001,"5min":1.548,"15min":1.548},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1120000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.131,"5min":1.506,"15min":1.506},"last":0.95499999999999996}]},{"osd":11,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.92500000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.879,"5min":1.024,"15min":1.024},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78400000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.499},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.502,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.436}]},{"osd":6,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.008,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.505,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.59699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70699999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.754,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.85299999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.73799999999999999,"15min":0.71899999999999997},"min":{"1min":0.56299999999999994,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79900000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1039864,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51200000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65600000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77700000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69899999999999995,"5min":0.88,"15min":0.88},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81499999999999995,"5min":1.095,"15min":1.095},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.111,"15min":1.111},"last":0.78900000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":1.446,"15min":1.446},"last":1.0169999999999999}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.135,"15min":1.135},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92500000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.004}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":1.052,"15min":1.052},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.93799999999999994}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":1.034},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.98999999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.46300000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496}]},{"osd":1,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.034,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.69399999999999995,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.3410000000000002,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.89900000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.244},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.119},"last":0.622},{"interface":"front","average":{"1min":1.097,"5min":0.84299999999999997,"15min":0.79800000000000004},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.3570000000000002,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.56499999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88,"5min":1.016,"15min":1.016},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78600000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:55:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.46400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0509999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.79000000000000004,"15min":0.82699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96299999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.77600000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.86699999999999999,"15min":0.82299999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":7.4009999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.133,"5min":0.93500000000000005,"15min":0.90200000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":7.3890000000000002,"5min":7.3890000000000002,"15min":7.3890000000000002},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":503489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59299999999999997,"15min":0.50800000000000001},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.505},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.30499999999999999},"max":{"1min":0.79900000000000004,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84999999999999998,"5min":0.878,"15min":0.878},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.57899999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.745}]},{"osd":3,"last update":"Thu Sep 21 12:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.55200000000000005},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.871,"15min":0.871},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.42999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78700000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Sep 21 12:55:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83099999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.57899999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97099999999999997,"5min":1.028,"15min":1.028},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90600000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97699999999999998,"5min":2.177,"15min":2.177},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.55700000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97599999999999998,"5min":0.995,"15min":0.995},"last":0.876}]},{"osd":11,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.417,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5049999999999999,"5min":2.657,"15min":2.657},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95799999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.65800000000000003,"15min":0.59399999999999997},"min":{"1min":0.48299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.372}]},{"osd":4,"last update":"Thu Sep 21 12:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69299999999999995,"15min":0.625},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.542,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.71599999999999997,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.8039999999999998,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.117,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.755},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.421,"15min":1.421},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.83899999999999997,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.871,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.86199999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.222,"15min":1.222},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.8730000000000002,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":0.65900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":505609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59599999999999997,"15min":0.53400000000000003},"min":{"1min":0.48699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.53600000000000003},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.876,"15min":0.876},"last":0.498}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.58399999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.629}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84599999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.026},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78800000000000003,"15min":0.76200000000000001},"min":{"1min":0.65900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.01,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.877}]},{"osd":11,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.82999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.46600000000000003},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.202,"5min":14.457000000000001,"15min":14.457000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.625,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.2809999999999999,"5min":14.156000000000001,"15min":14.156000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64600000000000002,"15min":0.60499999999999998},"min":{"1min":0.46200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.97799999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.64300000000000002},"min":{"1min":0.438,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.51,"5min":6.9119999999999999,"15min":6.9119999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.79100000000000004,"15min":0.65900000000000003},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.214,"5min":13.997,"15min":13.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.45100000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98099999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.89300000000000002,"15min":0.70099999999999996},"min":{"1min":0.49099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":6.4610000000000003,"5min":14.121,"15min":14.121},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.7729999999999997,"5min":5.7729999999999997,"15min":5.7729999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.74299999999999999,"15min":0.67100000000000004},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.79,"5min":6.79,"15min":6.79},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.962,"5min":0.92200000000000004,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":13.933999999999999,"5min":13.933999999999999,"15min":13.933999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63300000000000001,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.627,"5min":1.994,"15min":1.994},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.79100000000000004,"15min":0.66200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.9909999999999997,"5min":6.7329999999999997,"15min":6.7329999999999997},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":0.83699999999999997,"15min":0.76300000000000001},"min":{"1min":0.623,"5min":0.499,"15min":0.499},"max":{"1min":6.8399999999999999,"5min":6.8399999999999999,"15min":6.8399999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.92800000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.012,"15min":0.90900000000000003},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.661,"5min":14.189,"15min":14.189},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":0.91900000000000004,"15min":0.85999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.343,"5min":8.343,"15min":8.343},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":0.93999999999999995,"15min":0.89100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.8789999999999996,"5min":6.8789999999999996,"15min":6.8789999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1040000000000001,"15min":0.95799999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":14.083,"5min":14.083,"15min":14.083},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.96099999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.38100000000000001},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53800000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.38500000000000001},"min":{"1min":0.35099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90100000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.85299999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.57099999999999995},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":3.851,"15min":3.851},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61299999999999999,"15min":0.56799999999999995},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":1,"15min":1},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.65600000000000003,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":0.63},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.874}]},{"osd":9,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.01,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.92100000000000004}]},{"osd":11,"last update":"Thu Sep 21 12:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.94999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":1038370,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.501},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.218,"15min":1.218},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.53200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80400000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.71099999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":1.768,"15min":1.768},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.435,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.52600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83099999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66200000000000003,"15min":0.64600000000000002},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96699999999999997,"5min":1.409,"15min":1.409},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99099999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.54700000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.95399999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57499999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.53300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.077,"5min":0.79700000000000004,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:56:01.402 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T12:56:01.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 -- 172.21.15.142:0/3855990068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 msgr2=0x7f47e0102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 --2- 172.21.15.142:0/3855990068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0102430 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f47d40099c0 tx=0x7f47d4009cd0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 -- 172.21.15.142:0/3855990068 shutdown_connections 2023-09-21T12:56:01.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 --2- 172.21.15.142:0/3855990068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0102970 0x7f47e0109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 --2- 172.21.15.142:0/3855990068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0100de0 0x7f47e0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 --2- 172.21.15.142:0/3855990068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0102430 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 -- 172.21.15.142:0/3855990068 >> 172.21.15.142:0/3855990068 conn(0x7f47e00fc310 msgr2=0x7f47e00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:01.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.631+0000 7f47e61ff700 1 -- 172.21.15.142:0/3855990068 shutdown_connections 2023-09-21T12:56:01.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.632+0000 7f47e61ff700 1 -- 172.21.15.142:0/3855990068 wait complete. 2023-09-21T12:56:01.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.632+0000 7f47e61ff700 1 Processor -- start 2023-09-21T12:56:01.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 -- start start 2023-09-21T12:56:01.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0100de0 0x7f47e0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 0x7f47e019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019e6a0 con 0x7f47e0101fd0 2023-09-21T12:56:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019e7e0 con 0x7f47e0102970 2023-09-21T12:56:01.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47e61ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019e970 con 0x7f47e0100de0 2023-09-21T12:56:01.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47deffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47deffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47434/0 (socket says 172.21.15.142:47434) 2023-09-21T12:56:01.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47deffd700 1 -- 172.21.15.142:0/286718218 learned_addr learned my addr 172.21.15.142:0/286718218 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:01.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47dffff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 0x7f47e019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.633+0000 7f47df7fe700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0100de0 0x7f47e0196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 -- 172.21.15.142:0/286718218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0100de0 msgr2=0x7f47e0196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0100de0 0x7f47e0196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 -- 172.21.15.142:0/286718218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 msgr2=0x7f47e019e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 0x7f47e019e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 -- 172.21.15.142:0/286718218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0009520 con 0x7f47e0101fd0 2023-09-21T12:56:01.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47dffff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 0x7f47e019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:01.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47deffd700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009fd0 tx=0x7f47d400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:01.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d401d070 con 0x7f47e0101fd0 2023-09-21T12:56:01.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47d4005050 con 0x7f47e0101fd0 2023-09-21T12:56:01.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d40095f0 con 0x7f47e0101fd0 2023-09-21T12:56:01.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004b30 con 0x7f47e0101fd0 2023-09-21T12:56:01.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.634+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e019ee80 con 0x7f47e0101fd0 2023-09-21T12:56:01.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.635+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e0108380 con 0x7f47e0101fd0 2023-09-21T12:56:01.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.637+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f47d4004c90 con 0x7f47e0101fd0 2023-09-21T12:56:01.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.639+0000 7f47dcff9700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 0x7f47c80a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:01.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.640+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f47d40cc9e0 con 0x7f47e0101fd0 2023-09-21T12:56:01.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.640+0000 7f47df7fe700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 0x7f47c80a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:01.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.640+0000 7f47df7fe700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 0x7f47c80a2b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e0101e30 tx=0x7f47d0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:01.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.644+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f47d4096550 con 0x7f47e0101fd0 2023-09-21T12:56:01.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.842+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47e002d0e0 con 0x7f47c80a0690 2023-09-21T12:56:01.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.853+0000 7f47dcff9700 1 -- 172.21.15.142:0/286718218 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344990 (secure 0 0 0) 0x7f47e002d0e0 con 0x7f47c80a0690 2023-09-21T12:56:01.857 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 msgr2=0x7f47c80a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 0x7f47c80a2b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f47e0101e30 tx=0x7f47d0009260 comp rx=0 tx=0).stop 2023-09-21T12:56:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 msgr2=0x7f47e0197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:01.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009fd0 tx=0x7f47d400f690 comp rx=0 tx=0).stop 2023-09-21T12:56:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 shutdown_connections 2023-09-21T12:56:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f47c80a0690 0x7f47c80a2b50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f47e0102970 0x7f47e019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f47e0100de0 0x7f47e0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 --2- 172.21.15.142:0/286718218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f47e0101fd0 0x7f47e0197060 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 >> 172.21.15.142:0/286718218 conn(0x7f47e00fc310 msgr2=0x7f47e01054c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 shutdown_connections 2023-09-21T12:56:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:01.858+0000 7f47e61ff700 1 -- 172.21.15.142:0/286718218 wait complete. 2023-09-21T12:56:01.862 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:56:01.876 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-09-21T12:56:00.395767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653161,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":510,"num_write":345,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180893,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335536,"kb_used_data":11344,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606288,"statfs":{"total":1151940427776,"available":1151596838912,"internally_reserved":0,"allocated":11616256,"data_stored":7312122,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419262+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:55:40.419262+0000","last_peered":"2023-09-21T12:55:40.419262+0000","last_clean":"2023-09-21T12:55:40.419262+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:55:40.419262+0000","last_undegraded":"2023-09-21T12:55:40.419262+0000","last_fullsized":"2023-09-21T12:55:40.419262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418770+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:55:40.418770+0000","last_peered":"2023-09-21T12:55:40.418770+0000","last_clean":"2023-09-21T12:55:40.418770+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:55:40.418770+0000","last_undegraded":"2023-09-21T12:55:40.418770+0000","last_fullsized":"2023-09-21T12:55:40.418770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422258+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:55:40.422258+0000","last_peered":"2023-09-21T12:55:40.422258+0000","last_clean":"2023-09-21T12:55:40.422258+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:55:40.422258+0000","last_undegraded":"2023-09-21T12:55:40.422258+0000","last_fullsized":"2023-09-21T12:55:40.422258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417527+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:55:40.417527+0000","last_peered":"2023-09-21T12:55:40.417527+0000","last_clean":"2023-09-21T12:55:40.417527+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:55:40.417527+0000","last_undegraded":"2023-09-21T12:55:40.417527+0000","last_fullsized":"2023-09-21T12:55:40.417527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406678+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:55:40.406678+0000","last_peered":"2023-09-21T12:55:40.406678+0000","last_clean":"2023-09-21T12:55:40.406678+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:55:40.406678+0000","last_undegraded":"2023-09-21T12:55:40.406678+0000","last_fullsized":"2023-09-21T12:55:40.406678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418106+0000","last_change":"2023-09-21T12:54:41.568064+0000","last_active":"2023-09-21T12:55:40.418106+0000","last_peered":"2023-09-21T12:55:40.418106+0000","last_clean":"2023-09-21T12:55:40.418106+0000","last_became_active":"2023-09-21T12:54:41.567634+0000","last_became_peered":"2023-09-21T12:54:41.567634+0000","last_unstale":"2023-09-21T12:55:40.418106+0000","last_undegraded":"2023-09-21T12:55:40.418106+0000","last_fullsized":"2023-09-21T12:55:40.418106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:25:07.646626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409521+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:55:40.409521+0000","last_peered":"2023-09-21T12:55:40.409521+0000","last_clean":"2023-09-21T12:55:40.409521+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:55:40.409521+0000","last_undegraded":"2023-09-21T12:55:40.409521+0000","last_fullsized":"2023-09-21T12:55:40.409521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415704+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:55:40.415704+0000","last_peered":"2023-09-21T12:55:40.415704+0000","last_clean":"2023-09-21T12:55:40.415704+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:55:40.415704+0000","last_undegraded":"2023-09-21T12:55:40.415704+0000","last_fullsized":"2023-09-21T12:55:40.415704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.405631+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:55:40.405631+0000","last_peered":"2023-09-21T12:55:40.405631+0000","last_clean":"2023-09-21T12:55:40.405631+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:55:40.405631+0000","last_undegraded":"2023-09-21T12:55:40.405631+0000","last_fullsized":"2023-09-21T12:55:40.405631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416687+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:55:40.416687+0000","last_peered":"2023-09-21T12:55:40.416687+0000","last_clean":"2023-09-21T12:55:40.416687+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:55:40.416687+0000","last_undegraded":"2023-09-21T12:55:40.416687+0000","last_fullsized":"2023-09-21T12:55:40.416687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419501+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:55:40.419501+0000","last_peered":"2023-09-21T12:55:40.419501+0000","last_clean":"2023-09-21T12:55:40.419501+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:55:40.419501+0000","last_undegraded":"2023-09-21T12:55:40.419501+0000","last_fullsized":"2023-09-21T12:55:40.419501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417386+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:55:40.417386+0000","last_peered":"2023-09-21T12:55:40.417386+0000","last_clean":"2023-09-21T12:55:40.417386+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:55:40.417386+0000","last_undegraded":"2023-09-21T12:55:40.417386+0000","last_fullsized":"2023-09-21T12:55:40.417386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399424+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:55:40.399424+0000","last_peered":"2023-09-21T12:55:40.399424+0000","last_clean":"2023-09-21T12:55:40.399424+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:55:40.399424+0000","last_undegraded":"2023-09-21T12:55:40.399424+0000","last_fullsized":"2023-09-21T12:55:40.399424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422157+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:55:40.422157+0000","last_peered":"2023-09-21T12:55:40.422157+0000","last_clean":"2023-09-21T12:55:40.422157+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:55:40.422157+0000","last_undegraded":"2023-09-21T12:55:40.422157+0000","last_fullsized":"2023-09-21T12:55:40.422157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420514+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:55:40.420514+0000","last_peered":"2023-09-21T12:55:40.420514+0000","last_clean":"2023-09-21T12:55:40.420514+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:55:40.420514+0000","last_undegraded":"2023-09-21T12:55:40.420514+0000","last_fullsized":"2023-09-21T12:55:40.420514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422688+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:55:40.422688+0000","last_peered":"2023-09-21T12:55:40.422688+0000","last_clean":"2023-09-21T12:55:40.422688+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:55:40.422688+0000","last_undegraded":"2023-09-21T12:55:40.422688+0000","last_fullsized":"2023-09-21T12:55:40.422688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419339+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:55:40.419339+0000","last_peered":"2023-09-21T12:55:40.419339+0000","last_clean":"2023-09-21T12:55:40.419339+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:55:40.419339+0000","last_undegraded":"2023-09-21T12:55:40.419339+0000","last_fullsized":"2023-09-21T12:55:40.419339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404163+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:55:40.404163+0000","last_peered":"2023-09-21T12:55:40.404163+0000","last_clean":"2023-09-21T12:55:40.404163+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:55:40.404163+0000","last_undegraded":"2023-09-21T12:55:40.404163+0000","last_fullsized":"2023-09-21T12:55:40.404163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412551+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:55:40.412551+0000","last_peered":"2023-09-21T12:55:40.412551+0000","last_clean":"2023-09-21T12:55:40.412551+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:55:40.412551+0000","last_undegraded":"2023-09-21T12:55:40.412551+0000","last_fullsized":"2023-09-21T12:55:40.412551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555018+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:40.555018+0000","last_peered":"2023-09-21T12:54:40.555018+0000","last_clean":"2023-09-21T12:54:40.555018+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:40.555018+0000","last_undegraded":"2023-09-21T12:54:40.555018+0000","last_fullsized":"2023-09-21T12:54:40.555018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412189+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:55:40.412189+0000","last_peered":"2023-09-21T12:55:40.412189+0000","last_clean":"2023-09-21T12:55:40.412189+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:55:40.412189+0000","last_undegraded":"2023-09-21T12:55:40.412189+0000","last_fullsized":"2023-09-21T12:55:40.412189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563487+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:40.563487+0000","last_peered":"2023-09-21T12:54:40.563487+0000","last_clean":"2023-09-21T12:54:40.563487+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:40.563487+0000","last_undegraded":"2023-09-21T12:54:40.563487+0000","last_fullsized":"2023-09-21T12:54:40.563487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422849+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:55:40.422849+0000","last_peered":"2023-09-21T12:55:40.422849+0000","last_clean":"2023-09-21T12:55:40.422849+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:55:40.422849+0000","last_undegraded":"2023-09-21T12:55:40.422849+0000","last_fullsized":"2023-09-21T12:55:40.422849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559289+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:40.559289+0000","last_peered":"2023-09-21T12:54:40.559289+0000","last_clean":"2023-09-21T12:54:40.559289+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:40.559289+0000","last_undegraded":"2023-09-21T12:54:40.559289+0000","last_fullsized":"2023-09-21T12:54:40.559289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403027+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:55:40.403027+0000","last_peered":"2023-09-21T12:55:40.403027+0000","last_clean":"2023-09-21T12:55:40.403027+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:55:40.403027+0000","last_undegraded":"2023-09-21T12:55:40.403027+0000","last_fullsized":"2023-09-21T12:55:40.403027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574116+0000","last_change":"2023-09-21T12:54:41.573641+0000","last_active":"2023-09-21T12:54:41.574116+0000","last_peered":"2023-09-21T12:54:41.574116+0000","last_clean":"2023-09-21T12:54:41.574116+0000","last_became_active":"2023-09-21T12:54:41.570382+0000","last_became_peered":"2023-09-21T12:54:41.570382+0000","last_unstale":"2023-09-21T12:54:41.574116+0000","last_undegraded":"2023-09-21T12:54:41.574116+0000","last_fullsized":"2023-09-21T12:54:41.574116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:47:35.642160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407249+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:55:40.407249+0000","last_peered":"2023-09-21T12:55:40.407249+0000","last_clean":"2023-09-21T12:55:40.407249+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:55:40.407249+0000","last_undegraded":"2023-09-21T12:55:40.407249+0000","last_fullsized":"2023-09-21T12:55:40.407249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:55.589472+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:55:55.589472+0000","last_peered":"2023-09-21T12:55:55.589472+0000","last_clean":"2023-09-21T12:55:55.589472+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:55:55.589472+0000","last_undegraded":"2023-09-21T12:55:55.589472+0000","last_fullsized":"2023-09-21T12:55:55.589472+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400941+0000","last_change":"2023-09-21T12:54:41.717011+0000","last_active":"2023-09-21T12:55:40.400941+0000","last_peered":"2023-09-21T12:55:40.400941+0000","last_clean":"2023-09-21T12:55:40.400941+0000","last_became_active":"2023-09-21T12:54:41.716663+0000","last_became_peered":"2023-09-21T12:54:41.716663+0000","last_unstale":"2023-09-21T12:55:40.400941+0000","last_undegraded":"2023-09-21T12:55:40.400941+0000","last_fullsized":"2023-09-21T12:55:40.400941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:24:43.714781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557437+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:40.557437+0000","last_peered":"2023-09-21T12:54:40.557437+0000","last_clean":"2023-09-21T12:54:40.557437+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:40.557437+0000","last_undegraded":"2023-09-21T12:54:40.557437+0000","last_fullsized":"2023-09-21T12:54:40.557437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406135+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:55:40.406135+0000","last_peered":"2023-09-21T12:55:40.406135+0000","last_clean":"2023-09-21T12:55:40.406135+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:55:40.406135+0000","last_undegraded":"2023-09-21T12:55:40.406135+0000","last_fullsized":"2023-09-21T12:55:40.406135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561561+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:40.561561+0000","last_peered":"2023-09-21T12:54:40.561561+0000","last_clean":"2023-09-21T12:54:40.561561+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:40.561561+0000","last_undegraded":"2023-09-21T12:54:40.561561+0000","last_fullsized":"2023-09-21T12:54:40.561561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411654+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:55:40.411654+0000","last_peered":"2023-09-21T12:55:40.411654+0000","last_clean":"2023-09-21T12:55:40.411654+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:55:40.411654+0000","last_undegraded":"2023-09-21T12:55:40.411654+0000","last_fullsized":"2023-09-21T12:55:40.411654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555803+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:40.555803+0000","last_peered":"2023-09-21T12:54:40.555803+0000","last_clean":"2023-09-21T12:54:40.555803+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:40.555803+0000","last_undegraded":"2023-09-21T12:54:40.555803+0000","last_fullsized":"2023-09-21T12:54:40.555803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417347+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:55:40.417347+0000","last_peered":"2023-09-21T12:55:40.417347+0000","last_clean":"2023-09-21T12:55:40.417347+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:55:40.417347+0000","last_undegraded":"2023-09-21T12:55:40.417347+0000","last_fullsized":"2023-09-21T12:55:40.417347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":122,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.592231+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:55:57.592231+0000","last_peered":"2023-09-21T12:55:57.592231+0000","last_clean":"2023-09-21T12:55:57.592231+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:55:57.592231+0000","last_undegraded":"2023-09-21T12:55:57.592231+0000","last_fullsized":"2023-09-21T12:55:57.592231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403182+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:55:40.403182+0000","last_peered":"2023-09-21T12:55:40.403182+0000","last_clean":"2023-09-21T12:55:40.403182+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:55:40.403182+0000","last_undegraded":"2023-09-21T12:55:40.403182+0000","last_fullsized":"2023-09-21T12:55:40.403182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561279+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:40.561279+0000","last_peered":"2023-09-21T12:54:40.561279+0000","last_clean":"2023-09-21T12:54:40.561279+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:40.561279+0000","last_undegraded":"2023-09-21T12:54:40.561279+0000","last_fullsized":"2023-09-21T12:54:40.561279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423718+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:55:40.423718+0000","last_peered":"2023-09-21T12:55:40.423718+0000","last_clean":"2023-09-21T12:55:40.423718+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:55:40.423718+0000","last_undegraded":"2023-09-21T12:55:40.423718+0000","last_fullsized":"2023-09-21T12:55:40.423718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557100+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:40.557100+0000","last_peered":"2023-09-21T12:54:40.557100+0000","last_clean":"2023-09-21T12:54:40.557100+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:40.557100+0000","last_undegraded":"2023-09-21T12:54:40.557100+0000","last_fullsized":"2023-09-21T12:54:40.557100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418004+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:55:40.418004+0000","last_peered":"2023-09-21T12:55:40.418004+0000","last_clean":"2023-09-21T12:55:40.418004+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:55:40.418004+0000","last_undegraded":"2023-09-21T12:55:40.418004+0000","last_fullsized":"2023-09-21T12:55:40.418004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":261,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:58.601142+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:55:58.601142+0000","last_peered":"2023-09-21T12:55:58.601142+0000","last_clean":"2023-09-21T12:55:58.601142+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:55:58.601142+0000","last_undegraded":"2023-09-21T12:55:58.601142+0000","last_fullsized":"2023-09-21T12:55:58.601142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57559,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":163,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421550+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:55:40.421550+0000","last_peered":"2023-09-21T12:55:40.421550+0000","last_clean":"2023-09-21T12:55:40.421550+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:55:40.421550+0000","last_undegraded":"2023-09-21T12:55:40.421550+0000","last_fullsized":"2023-09-21T12:55:40.421550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.581333+0000","last_change":"2023-09-21T12:54:41.580944+0000","last_active":"2023-09-21T12:54:41.581333+0000","last_peered":"2023-09-21T12:54:41.581333+0000","last_clean":"2023-09-21T12:54:41.581333+0000","last_became_active":"2023-09-21T12:54:41.571007+0000","last_became_peered":"2023-09-21T12:54:41.571007+0000","last_unstale":"2023-09-21T12:54:41.581333+0000","last_undegraded":"2023-09-21T12:54:41.581333+0000","last_fullsized":"2023-09-21T12:54:41.581333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:54:34.209661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422245+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:55:40.422245+0000","last_peered":"2023-09-21T12:55:40.422245+0000","last_clean":"2023-09-21T12:55:40.422245+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:55:40.422245+0000","last_undegraded":"2023-09-21T12:55:40.422245+0000","last_fullsized":"2023-09-21T12:55:40.422245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556559+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:40.556559+0000","last_peered":"2023-09-21T12:54:40.556559+0000","last_clean":"2023-09-21T12:54:40.556559+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:40.556559+0000","last_undegraded":"2023-09-21T12:54:40.556559+0000","last_fullsized":"2023-09-21T12:54:40.556559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421237+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:55:40.421237+0000","last_peered":"2023-09-21T12:55:40.421237+0000","last_clean":"2023-09-21T12:55:40.421237+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:55:40.421237+0000","last_undegraded":"2023-09-21T12:55:40.421237+0000","last_fullsized":"2023-09-21T12:55:40.421237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:56.621617+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:55:56.621617+0000","last_peered":"2023-09-21T12:55:56.621617+0000","last_clean":"2023-09-21T12:55:56.621617+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:55:56.621617+0000","last_undegraded":"2023-09-21T12:55:56.621617+0000","last_fullsized":"2023-09-21T12:55:56.621617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407709+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:55:40.407709+0000","last_peered":"2023-09-21T12:55:40.407709+0000","last_clean":"2023-09-21T12:55:40.407709+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:55:40.407709+0000","last_undegraded":"2023-09-21T12:55:40.407709+0000","last_fullsized":"2023-09-21T12:55:40.407709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557457+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:40.557457+0000","last_peered":"2023-09-21T12:54:40.557457+0000","last_clean":"2023-09-21T12:54:40.557457+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:40.557457+0000","last_undegraded":"2023-09-21T12:54:40.557457+0000","last_fullsized":"2023-09-21T12:54:40.557457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404266+0000","last_change":"2023-09-21T12:54:41.570475+0000","last_active":"2023-09-21T12:55:40.404266+0000","last_peered":"2023-09-21T12:55:40.404266+0000","last_clean":"2023-09-21T12:55:40.404266+0000","last_became_active":"2023-09-21T12:54:41.570069+0000","last_became_peered":"2023-09-21T12:54:41.570069+0000","last_unstale":"2023-09-21T12:55:40.404266+0000","last_undegraded":"2023-09-21T12:55:40.404266+0000","last_fullsized":"2023-09-21T12:55:40.404266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:07:47.022244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559676+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:40.559676+0000","last_peered":"2023-09-21T12:54:40.559676+0000","last_clean":"2023-09-21T12:54:40.559676+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:40.559676+0000","last_undegraded":"2023-09-21T12:54:40.559676+0000","last_fullsized":"2023-09-21T12:54:40.559676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412436+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:55:40.412436+0000","last_peered":"2023-09-21T12:55:40.412436+0000","last_clean":"2023-09-21T12:55:40.412436+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:55:40.412436+0000","last_undegraded":"2023-09-21T12:55:40.412436+0000","last_fullsized":"2023-09-21T12:55:40.412436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555077+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:40.555077+0000","last_peered":"2023-09-21T12:54:40.555077+0000","last_clean":"2023-09-21T12:54:40.555077+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:40.555077+0000","last_undegraded":"2023-09-21T12:54:40.555077+0000","last_fullsized":"2023-09-21T12:54:40.555077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412701+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:55:40.412701+0000","last_peered":"2023-09-21T12:55:40.412701+0000","last_clean":"2023-09-21T12:55:40.412701+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:55:40.412701+0000","last_undegraded":"2023-09-21T12:55:40.412701+0000","last_fullsized":"2023-09-21T12:55:40.412701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561037+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:40.561037+0000","last_peered":"2023-09-21T12:54:40.561037+0000","last_clean":"2023-09-21T12:54:40.561037+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:40.561037+0000","last_undegraded":"2023-09-21T12:54:40.561037+0000","last_fullsized":"2023-09-21T12:54:40.561037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418895+0000","last_change":"2023-09-21T12:54:41.862117+0000","last_active":"2023-09-21T12:55:40.418895+0000","last_peered":"2023-09-21T12:55:40.418895+0000","last_clean":"2023-09-21T12:55:40.418895+0000","last_became_active":"2023-09-21T12:54:41.861717+0000","last_became_peered":"2023-09-21T12:54:41.861717+0000","last_unstale":"2023-09-21T12:55:40.418895+0000","last_undegraded":"2023-09-21T12:55:40.418895+0000","last_fullsized":"2023-09-21T12:55:40.418895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:25:46.138394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416091+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:55:40.416091+0000","last_peered":"2023-09-21T12:55:40.416091+0000","last_clean":"2023-09-21T12:55:40.416091+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:55:40.416091+0000","last_undegraded":"2023-09-21T12:55:40.416091+0000","last_fullsized":"2023-09-21T12:55:40.416091+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":123,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.623131+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:55:57.623131+0000","last_peered":"2023-09-21T12:55:57.623131+0000","last_clean":"2023-09-21T12:55:57.623131+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:55:57.623131+0000","last_undegraded":"2023-09-21T12:55:57.623131+0000","last_fullsized":"2023-09-21T12:55:57.623131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417050+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:55:40.417050+0000","last_peered":"2023-09-21T12:55:40.417050+0000","last_clean":"2023-09-21T12:55:40.417050+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:55:40.417050+0000","last_undegraded":"2023-09-21T12:55:40.417050+0000","last_fullsized":"2023-09-21T12:55:40.417050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560769+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:40.560769+0000","last_peered":"2023-09-21T12:54:40.560769+0000","last_clean":"2023-09-21T12:54:40.560769+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:40.560769+0000","last_undegraded":"2023-09-21T12:54:40.560769+0000","last_fullsized":"2023-09-21T12:54:40.560769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.566573+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:41.566573+0000","last_peered":"2023-09-21T12:54:41.566573+0000","last_clean":"2023-09-21T12:54:41.566573+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:41.566573+0000","last_undegraded":"2023-09-21T12:54:41.566573+0000","last_fullsized":"2023-09-21T12:54:41.566573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415172+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:55:40.415172+0000","last_peered":"2023-09-21T12:55:40.415172+0000","last_clean":"2023-09-21T12:55:40.415172+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:55:40.415172+0000","last_undegraded":"2023-09-21T12:55:40.415172+0000","last_fullsized":"2023-09-21T12:55:40.415172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560099+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:40.560099+0000","last_peered":"2023-09-21T12:54:40.560099+0000","last_clean":"2023-09-21T12:54:40.560099+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:40.560099+0000","last_undegraded":"2023-09-21T12:54:40.560099+0000","last_fullsized":"2023-09-21T12:54:40.560099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559181+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:40.559181+0000","last_peered":"2023-09-21T12:54:40.559181+0000","last_clean":"2023-09-21T12:54:40.559181+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:40.559181+0000","last_undegraded":"2023-09-21T12:54:40.559181+0000","last_fullsized":"2023-09-21T12:54:40.559181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400883+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:55:40.400883+0000","last_peered":"2023-09-21T12:55:40.400883+0000","last_clean":"2023-09-21T12:55:40.400883+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:55:40.400883+0000","last_undegraded":"2023-09-21T12:55:40.400883+0000","last_fullsized":"2023-09-21T12:55:40.400883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.563193+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:41.563193+0000","last_peered":"2023-09-21T12:54:41.563193+0000","last_clean":"2023-09-21T12:54:41.563193+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:41.563193+0000","last_undegraded":"2023-09-21T12:54:41.563193+0000","last_fullsized":"2023-09-21T12:54:41.563193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406894+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:55:40.406894+0000","last_peered":"2023-09-21T12:55:40.406894+0000","last_clean":"2023-09-21T12:55:40.406894+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:55:40.406894+0000","last_undegraded":"2023-09-21T12:55:40.406894+0000","last_fullsized":"2023-09-21T12:55:40.406894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561295+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:40.561295+0000","last_peered":"2023-09-21T12:54:40.561295+0000","last_clean":"2023-09-21T12:54:40.561295+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:40.561295+0000","last_undegraded":"2023-09-21T12:54:40.561295+0000","last_fullsized":"2023-09-21T12:54:40.561295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420058+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:55:40.420058+0000","last_peered":"2023-09-21T12:55:40.420058+0000","last_clean":"2023-09-21T12:55:40.420058+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:55:40.420058+0000","last_undegraded":"2023-09-21T12:55:40.420058+0000","last_fullsized":"2023-09-21T12:55:40.420058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555440+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:40.555440+0000","last_peered":"2023-09-21T12:54:40.555440+0000","last_clean":"2023-09-21T12:54:40.555440+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:40.555440+0000","last_undegraded":"2023-09-21T12:54:40.555440+0000","last_fullsized":"2023-09-21T12:54:40.555440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399956+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:55:40.399956+0000","last_peered":"2023-09-21T12:55:40.399956+0000","last_clean":"2023-09-21T12:55:40.399956+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:55:40.399956+0000","last_undegraded":"2023-09-21T12:55:40.399956+0000","last_fullsized":"2023-09-21T12:55:40.399956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563079+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:40.563079+0000","last_peered":"2023-09-21T12:54:40.563079+0000","last_clean":"2023-09-21T12:54:40.563079+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:40.563079+0000","last_undegraded":"2023-09-21T12:54:40.563079+0000","last_fullsized":"2023-09-21T12:54:40.563079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409568+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:55:40.409568+0000","last_peered":"2023-09-21T12:55:40.409568+0000","last_clean":"2023-09-21T12:55:40.409568+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:55:40.409568+0000","last_undegraded":"2023-09-21T12:55:40.409568+0000","last_fullsized":"2023-09-21T12:55:40.409568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561350+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:40.561350+0000","last_peered":"2023-09-21T12:54:40.561350+0000","last_clean":"2023-09-21T12:54:40.561350+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:40.561350+0000","last_undegraded":"2023-09-21T12:54:40.561350+0000","last_fullsized":"2023-09-21T12:54:40.561350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423399+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:55:40.423399+0000","last_peered":"2023-09-21T12:55:40.423399+0000","last_clean":"2023-09-21T12:55:40.423399+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:55:40.423399+0000","last_undegraded":"2023-09-21T12:55:40.423399+0000","last_fullsized":"2023-09-21T12:55:40.423399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557905+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:40.557905+0000","last_peered":"2023-09-21T12:54:40.557905+0000","last_clean":"2023-09-21T12:54:40.557905+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:40.557905+0000","last_undegraded":"2023-09-21T12:54:40.557905+0000","last_fullsized":"2023-09-21T12:54:40.557905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419512+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:55:40.419512+0000","last_peered":"2023-09-21T12:55:40.419512+0000","last_clean":"2023-09-21T12:55:40.419512+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:55:40.419512+0000","last_undegraded":"2023-09-21T12:55:40.419512+0000","last_fullsized":"2023-09-21T12:55:40.419512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561605+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:40.561605+0000","last_peered":"2023-09-21T12:54:40.561605+0000","last_clean":"2023-09-21T12:54:40.561605+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:40.561605+0000","last_undegraded":"2023-09-21T12:54:40.561605+0000","last_fullsized":"2023-09-21T12:54:40.561605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419739+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:55:40.419739+0000","last_peered":"2023-09-21T12:55:40.419739+0000","last_clean":"2023-09-21T12:55:40.419739+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:55:40.419739+0000","last_undegraded":"2023-09-21T12:55:40.419739+0000","last_fullsized":"2023-09-21T12:55:40.419739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556244+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:40.556244+0000","last_peered":"2023-09-21T12:54:40.556244+0000","last_clean":"2023-09-21T12:54:40.556244+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:40.556244+0000","last_undegraded":"2023-09-21T12:54:40.556244+0000","last_fullsized":"2023-09-21T12:54:40.556244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411659+0000","last_change":"2023-09-21T12:54:41.574550+0000","last_active":"2023-09-21T12:55:40.411659+0000","last_peered":"2023-09-21T12:55:40.411659+0000","last_clean":"2023-09-21T12:55:40.411659+0000","last_became_active":"2023-09-21T12:54:41.568847+0000","last_became_peered":"2023-09-21T12:54:41.568847+0000","last_unstale":"2023-09-21T12:55:40.411659+0000","last_undegraded":"2023-09-21T12:55:40.411659+0000","last_fullsized":"2023-09-21T12:55:40.411659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:40:47.869112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561711+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:40.561711+0000","last_peered":"2023-09-21T12:54:40.561711+0000","last_clean":"2023-09-21T12:54:40.561711+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:40.561711+0000","last_undegraded":"2023-09-21T12:54:40.561711+0000","last_fullsized":"2023-09-21T12:54:40.561711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.413851+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:55:40.413851+0000","last_peered":"2023-09-21T12:55:40.413851+0000","last_clean":"2023-09-21T12:55:40.413851+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:55:40.413851+0000","last_undegraded":"2023-09-21T12:55:40.413851+0000","last_fullsized":"2023-09-21T12:55:40.413851+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.402235+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:55:40.402235+0000","last_peered":"2023-09-21T12:55:40.402235+0000","last_clean":"2023-09-21T12:55:40.402235+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:55:40.402235+0000","last_undegraded":"2023-09-21T12:55:40.402235+0000","last_fullsized":"2023-09-21T12:55:40.402235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409013+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:55:40.409013+0000","last_peered":"2023-09-21T12:55:40.409013+0000","last_clean":"2023-09-21T12:55:40.409013+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:55:40.409013+0000","last_undegraded":"2023-09-21T12:55:40.409013+0000","last_fullsized":"2023-09-21T12:55:40.409013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.389897+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:55:40.389897+0000","last_peered":"2023-09-21T12:55:40.389897+0000","last_clean":"2023-09-21T12:55:40.389897+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:55:40.389897+0000","last_undegraded":"2023-09-21T12:55:40.389897+0000","last_fullsized":"2023-09-21T12:55:40.389897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421416+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:55:40.421416+0000","last_peered":"2023-09-21T12:55:40.421416+0000","last_clean":"2023-09-21T12:55:40.421416+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:55:40.421416+0000","last_undegraded":"2023-09-21T12:55:40.421416+0000","last_fullsized":"2023-09-21T12:55:40.421416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421161+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:55:40.421161+0000","last_peered":"2023-09-21T12:55:40.421161+0000","last_clean":"2023-09-21T12:55:40.421161+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:55:40.421161+0000","last_undegraded":"2023-09-21T12:55:40.421161+0000","last_fullsized":"2023-09-21T12:55:40.421161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403172+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:55:40.403172+0000","last_peered":"2023-09-21T12:55:40.403172+0000","last_clean":"2023-09-21T12:55:40.403172+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:55:40.403172+0000","last_undegraded":"2023-09-21T12:55:40.403172+0000","last_fullsized":"2023-09-21T12:55:40.403172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404940+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:55:40.404940+0000","last_peered":"2023-09-21T12:55:40.404940+0000","last_clean":"2023-09-21T12:55:40.404940+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:55:40.404940+0000","last_undegraded":"2023-09-21T12:55:40.404940+0000","last_fullsized":"2023-09-21T12:55:40.404940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416070+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:55:40.416070+0000","last_peered":"2023-09-21T12:55:40.416070+0000","last_clean":"2023-09-21T12:55:40.416070+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:55:40.416070+0000","last_undegraded":"2023-09-21T12:55:40.416070+0000","last_fullsized":"2023-09-21T12:55:40.416070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404388+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:55:40.404388+0000","last_peered":"2023-09-21T12:55:40.404388+0000","last_clean":"2023-09-21T12:55:40.404388+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:55:40.404388+0000","last_undegraded":"2023-09-21T12:55:40.404388+0000","last_fullsized":"2023-09-21T12:55:40.404388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404271+0000","last_change":"2023-09-21T12:54:41.568252+0000","last_active":"2023-09-21T12:55:40.404271+0000","last_peered":"2023-09-21T12:55:40.404271+0000","last_clean":"2023-09-21T12:55:40.404271+0000","last_became_active":"2023-09-21T12:54:41.567653+0000","last_became_peered":"2023-09-21T12:54:41.567653+0000","last_unstale":"2023-09-21T12:55:40.404271+0000","last_undegraded":"2023-09-21T12:55:40.404271+0000","last_fullsized":"2023-09-21T12:55:40.404271+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:09:31.075023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423029+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:55:40.423029+0000","last_peered":"2023-09-21T12:55:40.423029+0000","last_clean":"2023-09-21T12:55:40.423029+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:55:40.423029+0000","last_undegraded":"2023-09-21T12:55:40.423029+0000","last_fullsized":"2023-09-21T12:55:40.423029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422807+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:55:40.422807+0000","last_peered":"2023-09-21T12:55:40.422807+0000","last_clean":"2023-09-21T12:55:40.422807+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:55:40.422807+0000","last_undegraded":"2023-09-21T12:55:40.422807+0000","last_fullsized":"2023-09-21T12:55:40.422807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415950+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:55:40.415950+0000","last_peered":"2023-09-21T12:55:40.415950+0000","last_clean":"2023-09-21T12:55:40.415950+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:55:40.415950+0000","last_undegraded":"2023-09-21T12:55:40.415950+0000","last_fullsized":"2023-09-21T12:55:40.415950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62547,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":391,"num_write":162,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416419,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92600000000000005,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.437},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70199999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.876,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.107,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.44500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0049999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.54500000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.054,"5min":1.48,"15min":1.48},"last":0.77100000000000002}]},{"osd":8,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.048,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0349999999999999,"5min":1.228,"15min":1.228},"last":0.79900000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.77900000000000003,"15min":0.76300000000000001},"min":{"1min":0.58599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.133,"5min":1.55,"15min":1.55},"last":0.87},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0780000000000001,"5min":1.522,"15min":1.522},"last":0.78700000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":1096347,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.621,"15min":0.62},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":1.345,"15min":1.345},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84199999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86799999999999999}]},{"osd":8,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78700000000000003,"15min":0.78200000000000003},"min":{"1min":0.63600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96899999999999997,"5min":1.214,"15min":1.214},"last":0.749},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.76100000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.03,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91500000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78300000000000003,"5min":6.335,"15min":6.335},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55800000000000005,"15min":0.58399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.76900000000000002,"15min":0.81799999999999995},"min":{"1min":0.48799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.046,"5min":1.149,"15min":1.149},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82599999999999996,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.72499999999999998,"15min":0.753},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4199999999999999,"5min":4.633,"15min":4.633},"last":0.621},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.25,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.82099999999999995,"15min":0.88300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.046,"5min":1.492,"15min":1.492},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.85399999999999998},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1919999999999999,"5min":1.456,"15min":1.456},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.099,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83999999999999997,"15min":0.89600000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92400000000000004,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.88600000000000001,"15min":0.96499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.98699999999999999,"15min":1.0129999999999999},"min":{"1min":0.53700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1619999999999999,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.89100000000000001,"15min":0.94499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.516,"15min":2.516},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.91300000000000003,"15min":0.98299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0680000000000001,"5min":1.548,"15min":1.548},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1120000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.131,"5min":1.506,"15min":1.506},"last":0.95499999999999996}]},{"osd":11,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.92500000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.879,"5min":1.024,"15min":1.024},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78400000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.499},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.502,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.436}]},{"osd":6,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.008,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.505,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.59699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70699999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.754,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.85299999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.73799999999999999,"15min":0.71899999999999997},"min":{"1min":0.56299999999999994,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79900000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1039864,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51200000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65600000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77700000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69899999999999995,"5min":0.88,"15min":0.88},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81499999999999995,"5min":1.095,"15min":1.095},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.111,"15min":1.111},"last":0.78900000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":1.446,"15min":1.446},"last":1.0169999999999999}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.135,"15min":1.135},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92500000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.004}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":1.052,"15min":1.052},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.93799999999999994}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":1.034},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.98999999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.46300000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496}]},{"osd":1,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.034,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.69399999999999995,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.3410000000000002,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.89900000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.244},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.119},"last":0.622},{"interface":"front","average":{"1min":1.097,"5min":0.84299999999999997,"15min":0.79800000000000004},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.3570000000000002,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.56499999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88,"5min":1.016,"15min":1.016},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78600000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:55:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.46400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0509999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.79000000000000004,"15min":0.82699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96299999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.77600000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.86699999999999999,"15min":0.82299999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":7.4009999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.133,"5min":0.93500000000000005,"15min":0.90200000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":7.3890000000000002,"5min":7.3890000000000002,"15min":7.3890000000000002},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":503489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59299999999999997,"15min":0.50800000000000001},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.505},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.30499999999999999},"max":{"1min":0.79900000000000004,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84999999999999998,"5min":0.878,"15min":0.878},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.57899999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.745}]},{"osd":3,"last update":"Thu Sep 21 12:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.55200000000000005},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.871,"15min":0.871},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.42999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78700000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Sep 21 12:55:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83099999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.57899999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97099999999999997,"5min":1.028,"15min":1.028},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90600000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97699999999999998,"5min":2.177,"15min":2.177},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.55700000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97599999999999998,"5min":0.995,"15min":0.995},"last":0.876}]},{"osd":11,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.417,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5049999999999999,"5min":2.657,"15min":2.657},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95799999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.65800000000000003,"15min":0.59399999999999997},"min":{"1min":0.48299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.372}]},{"osd":4,"last update":"Thu Sep 21 12:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69299999999999995,"15min":0.625},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.542,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.71599999999999997,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.8039999999999998,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.117,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.755},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.421,"15min":1.421},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.83899999999999997,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.871,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.86199999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.222,"15min":1.222},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.8730000000000002,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":0.65900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":505609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59599999999999997,"15min":0.53400000000000003},"min":{"1min":0.48699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.53600000000000003},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.876,"15min":0.876},"last":0.498}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.58399999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.629}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84599999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.026},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78800000000000003,"15min":0.76200000000000001},"min":{"1min":0.65900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.01,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.877}]},{"osd":11,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.82999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.46600000000000003},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.202,"5min":14.457000000000001,"15min":14.457000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.625,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.2809999999999999,"5min":14.156000000000001,"15min":14.156000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64600000000000002,"15min":0.60499999999999998},"min":{"1min":0.46200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.97799999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.64300000000000002},"min":{"1min":0.438,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.51,"5min":6.9119999999999999,"15min":6.9119999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.79100000000000004,"15min":0.65900000000000003},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.214,"5min":13.997,"15min":13.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.45100000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98099999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.89300000000000002,"15min":0.70099999999999996},"min":{"1min":0.49099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":6.4610000000000003,"5min":14.121,"15min":14.121},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.7729999999999997,"5min":5.7729999999999997,"15min":5.7729999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.74299999999999999,"15min":0.67100000000000004},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.79,"5min":6.79,"15min":6.79},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.962,"5min":0.92200000000000004,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":13.933999999999999,"5min":13.933999999999999,"15min":13.933999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63300000000000001,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.627,"5min":1.994,"15min":1.994},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.79100000000000004,"15min":0.66200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.9909999999999997,"5min":6.7329999999999997,"15min":6.7329999999999997},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":0.83699999999999997,"15min":0.76300000000000001},"min":{"1min":0.623,"5min":0.499,"15min":0.499},"max":{"1min":6.8399999999999999,"5min":6.8399999999999999,"15min":6.8399999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.92800000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.012,"15min":0.90900000000000003},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.661,"5min":14.189,"15min":14.189},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":0.91900000000000004,"15min":0.85999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.343,"5min":8.343,"15min":8.343},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":0.93999999999999995,"15min":0.89100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.8789999999999996,"5min":6.8789999999999996,"15min":6.8789999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1040000000000001,"15min":0.95799999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":14.083,"5min":14.083,"15min":14.083},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.96099999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.38100000000000001},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53800000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.38500000000000001},"min":{"1min":0.35099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90100000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.85299999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.57099999999999995},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":3.851,"15min":3.851},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61299999999999999,"15min":0.56799999999999995},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":1,"15min":1},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.65600000000000003,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":0.63},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.874}]},{"osd":9,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.01,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.92100000000000004}]},{"osd":11,"last update":"Thu Sep 21 12:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.94999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":1038370,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.501},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.218,"15min":1.218},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.53200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80400000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.71099999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":1.768,"15min":1.768},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.435,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.52600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83099999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66200000000000003,"15min":0.64600000000000002},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96699999999999997,"5min":1.409,"15min":1.409},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99099999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.54700000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.95399999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57499999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.53300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.077,"5min":0.79700000000000004,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:56:01.888 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-09-21T12:56:01.889 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-21T12:56:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 -- 172.21.15.142:0/375588120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 msgr2=0x7fa748102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/375588120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa748102430 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009990 tx=0x7fa73c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 -- 172.21.15.142:0/375588120 shutdown_connections 2023-09-21T12:56:02.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/375588120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748109220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/375588120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 0x7fa748101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/375588120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa748102430 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 -- 172.21.15.142:0/375588120 >> 172.21.15.142:0/375588120 conn(0x7fa7480fc310 msgr2=0x7fa7480fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 -- 172.21.15.142:0/375588120 shutdown_connections 2023-09-21T12:56:02.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.116+0000 7fa74e5ff700 1 -- 172.21.15.142:0/375588120 wait complete. 2023-09-21T12:56:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.117+0000 7fa74e5ff700 1 Processor -- start 2023-09-21T12:56:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.117+0000 7fa74e5ff700 1 -- start start 2023-09-21T12:56:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 0x7fa748074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748073eb0 con 0x7fa748102970 2023-09-21T12:56:02.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748074020 con 0x7fa748100de0 2023-09-21T12:56:02.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74e5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481a0b00 con 0x7fa748101fd0 2023-09-21T12:56:02.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74cb9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa747fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 0x7fa748074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53914/0 (socket says 172.21.15.142:53914) 2023-09-21T12:56:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 -- 172.21.15.142:0/1438001190 learned_addr learned my addr 172.21.15.142:0/1438001190 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:02.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 -- 172.21.15.142:0/1438001190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 msgr2=0x7fa748074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 0x7fa748074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 -- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 msgr2=0x7fa748073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa7477fe700 1 -- 172.21.15.142:0/1438001190 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c0095f0 con 0x7fa748101fd0 2023-09-21T12:56:02.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.118+0000 7fa74cb9c700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:02.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa7477fe700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00b680 tx=0x7fa73c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:02.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c01d070 con 0x7fa748101fd0 2023-09-21T12:56:02.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7481a0d80 con 0x7fa748101fd0 2023-09-21T12:56:02.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa73c022470 con 0x7fa748101fd0 2023-09-21T12:56:02.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c017650 con 0x7fa748101fd0 2023-09-21T12:56:02.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.119+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7481a11b0 con 0x7fa748101fd0 2023-09-21T12:56:02.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.120+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa748108370 con 0x7fa748101fd0 2023-09-21T12:56:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.122+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fa73c0225e0 con 0x7fa748101fd0 2023-09-21T12:56:02.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.124+0000 7fa7457fa700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 0x7fa7300a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.124+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa73c0cd770 con 0x7fa748101fd0 2023-09-21T12:56:02.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.124+0000 7fa747fff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 0x7fa7300a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.124+0000 7fa747fff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 0x7fa7300a2b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa748101e30 tx=0x7fa738009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:02.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.126+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa73c0972e0 con 0x7fa748101fd0 2023-09-21T12:56:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:01 smithi156 ceph-mon[134078]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2023-09-21T12:56:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:01 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/800018973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:01 smithi142 ceph-mon[97663]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2023-09-21T12:56:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:01 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/800018973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:01 smithi160 ceph-mon[134450]: pgmap v326: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 341 B/s wr, 7 op/s 2023-09-21T12:56:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:01 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/800018973' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:02.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.323+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa74802d0c0 con 0x7fa7300a0690 2023-09-21T12:56:02.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.333+0000 7fa7457fa700 1 -- 172.21.15.142:0/1438001190 <== mgr.14150 v2:172.21.15.142:6800/3499877374 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+344990 (secure 0 0 0) 0x7fa74802d0c0 con 0x7fa7300a0690 2023-09-21T12:56:02.337 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:02.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 msgr2=0x7fa7300a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 0x7fa7300a2b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa748101e30 tx=0x7fa738009260 comp rx=0 tx=0).stop 2023-09-21T12:56:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 msgr2=0x7fa7480731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00b680 tx=0x7fa73c005740 comp rx=0 tx=0).stop 2023-09-21T12:56:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 shutdown_connections 2023-09-21T12:56:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fa7300a0690 0x7fa7300a2b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa748102970 0x7fa748073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa748100de0 0x7fa748074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 --2- 172.21.15.142:0/1438001190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa748101fd0 0x7fa7480731d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.338+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 >> 172.21.15.142:0/1438001190 conn(0x7fa7480fc310 msgr2=0x7fa7481054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.339+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 shutdown_connections 2023-09-21T12:56:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.339+0000 7fa74e5ff700 1 -- 172.21.15.142:0/1438001190 wait complete. 2023-09-21T12:56:02.347 INFO:teuthology.orchestra.run.smithi142.stderr:dumped all 2023-09-21T12:56:02.357 INFO:teuthology.orchestra.run.smithi142.stdout:{"pg_ready":true,"pg_map":{"version":326,"stamp":"2023-09-21T12:56:00.395767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653161,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":510,"num_write":345,"num_write_kb":3053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180893,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335536,"kb_used_data":11344,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606288,"statfs":{"total":1151940427776,"available":1151596838912,"internally_reserved":0,"allocated":11616256,"data_stored":7312122,"data_compressed":108684,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19127,"internal_metadata":331855177},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":47,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002888"},"pg_stats":[{"pgid":"3.3f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419262+0000","last_change":"2023-09-21T12:54:12.450214+0000","last_active":"2023-09-21T12:55:40.419262+0000","last_peered":"2023-09-21T12:55:40.419262+0000","last_clean":"2023-09-21T12:55:40.419262+0000","last_became_active":"2023-09-21T12:54:12.449489+0000","last_became_peered":"2023-09-21T12:54:12.449489+0000","last_unstale":"2023-09-21T12:55:40.419262+0000","last_undegraded":"2023-09-21T12:55:40.419262+0000","last_fullsized":"2023-09-21T12:55:40.419262+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:20.420895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418770+0000","last_change":"2023-09-21T12:54:12.446965+0000","last_active":"2023-09-21T12:55:40.418770+0000","last_peered":"2023-09-21T12:55:40.418770+0000","last_clean":"2023-09-21T12:55:40.418770+0000","last_became_active":"2023-09-21T12:54:12.446626+0000","last_became_peered":"2023-09-21T12:54:12.446626+0000","last_unstale":"2023-09-21T12:55:40.418770+0000","last_undegraded":"2023-09-21T12:55:40.418770+0000","last_fullsized":"2023-09-21T12:55:40.418770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:46:24.757007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422258+0000","last_change":"2023-09-21T12:54:12.449719+0000","last_active":"2023-09-21T12:55:40.422258+0000","last_peered":"2023-09-21T12:55:40.422258+0000","last_clean":"2023-09-21T12:55:40.422258+0000","last_became_active":"2023-09-21T12:54:12.449445+0000","last_became_peered":"2023-09-21T12:54:12.449445+0000","last_unstale":"2023-09-21T12:55:40.422258+0000","last_undegraded":"2023-09-21T12:55:40.422258+0000","last_fullsized":"2023-09-21T12:55:40.422258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:54:02.857904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417527+0000","last_change":"2023-09-21T12:54:12.438768+0000","last_active":"2023-09-21T12:55:40.417527+0000","last_peered":"2023-09-21T12:55:40.417527+0000","last_clean":"2023-09-21T12:55:40.417527+0000","last_became_active":"2023-09-21T12:54:12.438454+0000","last_became_peered":"2023-09-21T12:54:12.438454+0000","last_unstale":"2023-09-21T12:55:40.417527+0000","last_undegraded":"2023-09-21T12:55:40.417527+0000","last_fullsized":"2023-09-21T12:55:40.417527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:20:04.245122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406678+0000","last_change":"2023-09-21T12:54:12.449381+0000","last_active":"2023-09-21T12:55:40.406678+0000","last_peered":"2023-09-21T12:55:40.406678+0000","last_clean":"2023-09-21T12:55:40.406678+0000","last_became_active":"2023-09-21T12:54:12.449021+0000","last_became_peered":"2023-09-21T12:54:12.449021+0000","last_unstale":"2023-09-21T12:55:40.406678+0000","last_undegraded":"2023-09-21T12:55:40.406678+0000","last_fullsized":"2023-09-21T12:55:40.406678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:40:03.142759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418106+0000","last_change":"2023-09-21T12:54:41.568064+0000","last_active":"2023-09-21T12:55:40.418106+0000","last_peered":"2023-09-21T12:55:40.418106+0000","last_clean":"2023-09-21T12:55:40.418106+0000","last_became_active":"2023-09-21T12:54:41.567634+0000","last_became_peered":"2023-09-21T12:54:41.567634+0000","last_unstale":"2023-09-21T12:55:40.418106+0000","last_undegraded":"2023-09-21T12:55:40.418106+0000","last_fullsized":"2023-09-21T12:55:40.418106+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:25:07.646626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409521+0000","last_change":"2023-09-21T12:54:12.455606+0000","last_active":"2023-09-21T12:55:40.409521+0000","last_peered":"2023-09-21T12:55:40.409521+0000","last_clean":"2023-09-21T12:55:40.409521+0000","last_became_active":"2023-09-21T12:54:12.455304+0000","last_became_peered":"2023-09-21T12:54:12.455304+0000","last_unstale":"2023-09-21T12:55:40.409521+0000","last_undegraded":"2023-09-21T12:55:40.409521+0000","last_fullsized":"2023-09-21T12:55:40.409521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:50:34.218649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415704+0000","last_change":"2023-09-21T12:54:12.443491+0000","last_active":"2023-09-21T12:55:40.415704+0000","last_peered":"2023-09-21T12:55:40.415704+0000","last_clean":"2023-09-21T12:55:40.415704+0000","last_became_active":"2023-09-21T12:54:12.438600+0000","last_became_peered":"2023-09-21T12:54:12.438600+0000","last_unstale":"2023-09-21T12:55:40.415704+0000","last_undegraded":"2023-09-21T12:55:40.415704+0000","last_fullsized":"2023-09-21T12:55:40.415704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:17:02.274725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.405631+0000","last_change":"2023-09-21T12:54:12.437043+0000","last_active":"2023-09-21T12:55:40.405631+0000","last_peered":"2023-09-21T12:55:40.405631+0000","last_clean":"2023-09-21T12:55:40.405631+0000","last_became_active":"2023-09-21T12:54:12.436759+0000","last_became_peered":"2023-09-21T12:54:12.436759+0000","last_unstale":"2023-09-21T12:55:40.405631+0000","last_undegraded":"2023-09-21T12:55:40.405631+0000","last_fullsized":"2023-09-21T12:55:40.405631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:12:27.304954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"86'16","reported_seq":30,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416687+0000","last_change":"2023-09-21T12:54:12.443626+0000","last_active":"2023-09-21T12:55:40.416687+0000","last_peered":"2023-09-21T12:55:40.416687+0000","last_clean":"2023-09-21T12:55:40.416687+0000","last_became_active":"2023-09-21T12:54:12.443455+0000","last_became_peered":"2023-09-21T12:54:12.443455+0000","last_unstale":"2023-09-21T12:55:40.416687+0000","last_undegraded":"2023-09-21T12:55:40.416687+0000","last_fullsized":"2023-09-21T12:55:40.416687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:08:02.621471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419501+0000","last_change":"2023-09-21T12:54:12.438860+0000","last_active":"2023-09-21T12:55:40.419501+0000","last_peered":"2023-09-21T12:55:40.419501+0000","last_clean":"2023-09-21T12:55:40.419501+0000","last_became_active":"2023-09-21T12:54:12.438455+0000","last_became_peered":"2023-09-21T12:54:12.438455+0000","last_unstale":"2023-09-21T12:55:40.419501+0000","last_undegraded":"2023-09-21T12:55:40.419501+0000","last_fullsized":"2023-09-21T12:55:40.419501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:52.609562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417386+0000","last_change":"2023-09-21T12:54:12.443540+0000","last_active":"2023-09-21T12:55:40.417386+0000","last_peered":"2023-09-21T12:55:40.417386+0000","last_clean":"2023-09-21T12:55:40.417386+0000","last_became_active":"2023-09-21T12:54:12.443168+0000","last_became_peered":"2023-09-21T12:54:12.443168+0000","last_unstale":"2023-09-21T12:55:40.417386+0000","last_undegraded":"2023-09-21T12:55:40.417386+0000","last_fullsized":"2023-09-21T12:55:40.417386+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:06:02.606798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399424+0000","last_change":"2023-09-21T12:54:12.442582+0000","last_active":"2023-09-21T12:55:40.399424+0000","last_peered":"2023-09-21T12:55:40.399424+0000","last_clean":"2023-09-21T12:55:40.399424+0000","last_became_active":"2023-09-21T12:54:12.442257+0000","last_became_peered":"2023-09-21T12:54:12.442257+0000","last_unstale":"2023-09-21T12:55:40.399424+0000","last_undegraded":"2023-09-21T12:55:40.399424+0000","last_fullsized":"2023-09-21T12:55:40.399424+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:39:00.507371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422157+0000","last_change":"2023-09-21T12:54:12.447079+0000","last_active":"2023-09-21T12:55:40.422157+0000","last_peered":"2023-09-21T12:55:40.422157+0000","last_clean":"2023-09-21T12:55:40.422157+0000","last_became_active":"2023-09-21T12:54:12.446717+0000","last_became_peered":"2023-09-21T12:54:12.446717+0000","last_unstale":"2023-09-21T12:55:40.422157+0000","last_undegraded":"2023-09-21T12:55:40.422157+0000","last_fullsized":"2023-09-21T12:55:40.422157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:59:43.131283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420514+0000","last_change":"2023-09-21T12:54:12.449515+0000","last_active":"2023-09-21T12:55:40.420514+0000","last_peered":"2023-09-21T12:55:40.420514+0000","last_clean":"2023-09-21T12:55:40.420514+0000","last_became_active":"2023-09-21T12:54:12.449157+0000","last_became_peered":"2023-09-21T12:54:12.449157+0000","last_unstale":"2023-09-21T12:55:40.420514+0000","last_undegraded":"2023-09-21T12:55:40.420514+0000","last_fullsized":"2023-09-21T12:55:40.420514+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:39:33.661996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422688+0000","last_change":"2023-09-21T12:54:12.449549+0000","last_active":"2023-09-21T12:55:40.422688+0000","last_peered":"2023-09-21T12:55:40.422688+0000","last_clean":"2023-09-21T12:55:40.422688+0000","last_became_active":"2023-09-21T12:54:12.449227+0000","last_became_peered":"2023-09-21T12:54:12.449227+0000","last_unstale":"2023-09-21T12:55:40.422688+0000","last_undegraded":"2023-09-21T12:55:40.422688+0000","last_fullsized":"2023-09-21T12:55:40.422688+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:05:15.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419339+0000","last_change":"2023-09-21T12:54:12.450330+0000","last_active":"2023-09-21T12:55:40.419339+0000","last_peered":"2023-09-21T12:55:40.419339+0000","last_clean":"2023-09-21T12:55:40.419339+0000","last_became_active":"2023-09-21T12:54:12.449900+0000","last_became_peered":"2023-09-21T12:54:12.449900+0000","last_unstale":"2023-09-21T12:55:40.419339+0000","last_undegraded":"2023-09-21T12:55:40.419339+0000","last_fullsized":"2023-09-21T12:55:40.419339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:16:43.450938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404163+0000","last_change":"2023-09-21T12:54:12.454408+0000","last_active":"2023-09-21T12:55:40.404163+0000","last_peered":"2023-09-21T12:55:40.404163+0000","last_clean":"2023-09-21T12:55:40.404163+0000","last_became_active":"2023-09-21T12:54:12.454008+0000","last_became_peered":"2023-09-21T12:54:12.454008+0000","last_unstale":"2023-09-21T12:55:40.404163+0000","last_undegraded":"2023-09-21T12:55:40.404163+0000","last_fullsized":"2023-09-21T12:55:40.404163+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:48:43.095486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412551+0000","last_change":"2023-09-21T12:54:12.439238+0000","last_active":"2023-09-21T12:55:40.412551+0000","last_peered":"2023-09-21T12:55:40.412551+0000","last_clean":"2023-09-21T12:55:40.412551+0000","last_became_active":"2023-09-21T12:54:12.438898+0000","last_became_peered":"2023-09-21T12:54:12.438898+0000","last_unstale":"2023-09-21T12:55:40.412551+0000","last_undegraded":"2023-09-21T12:55:40.412551+0000","last_fullsized":"2023-09-21T12:55:40.412551+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:56:18.745509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'9","reported_seq":25,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555018+0000","last_change":"2023-09-21T12:54:11.463853+0000","last_active":"2023-09-21T12:54:40.555018+0000","last_peered":"2023-09-21T12:54:40.555018+0000","last_clean":"2023-09-21T12:54:40.555018+0000","last_became_active":"2023-09-21T12:54:11.463480+0000","last_became_peered":"2023-09-21T12:54:11.463480+0000","last_unstale":"2023-09-21T12:54:40.555018+0000","last_undegraded":"2023-09-21T12:54:40.555018+0000","last_fullsized":"2023-09-21T12:54:40.555018+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:40:15.497362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412189+0000","last_change":"2023-09-21T12:54:12.438329+0000","last_active":"2023-09-21T12:55:40.412189+0000","last_peered":"2023-09-21T12:55:40.412189+0000","last_clean":"2023-09-21T12:55:40.412189+0000","last_became_active":"2023-09-21T12:54:12.437983+0000","last_became_peered":"2023-09-21T12:54:12.437983+0000","last_unstale":"2023-09-21T12:55:40.412189+0000","last_undegraded":"2023-09-21T12:55:40.412189+0000","last_fullsized":"2023-09-21T12:55:40.412189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:05:54.674830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563487+0000","last_change":"2023-09-21T12:54:11.462363+0000","last_active":"2023-09-21T12:54:40.563487+0000","last_peered":"2023-09-21T12:54:40.563487+0000","last_clean":"2023-09-21T12:54:40.563487+0000","last_became_active":"2023-09-21T12:54:11.462000+0000","last_became_peered":"2023-09-21T12:54:11.462000+0000","last_unstale":"2023-09-21T12:54:40.563487+0000","last_undegraded":"2023-09-21T12:54:40.563487+0000","last_fullsized":"2023-09-21T12:54:40.563487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:49:45.733631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422849+0000","last_change":"2023-09-21T12:54:12.456539+0000","last_active":"2023-09-21T12:55:40.422849+0000","last_peered":"2023-09-21T12:55:40.422849+0000","last_clean":"2023-09-21T12:55:40.422849+0000","last_became_active":"2023-09-21T12:54:12.456229+0000","last_became_peered":"2023-09-21T12:54:12.456229+0000","last_unstale":"2023-09-21T12:55:40.422849+0000","last_undegraded":"2023-09-21T12:55:40.422849+0000","last_fullsized":"2023-09-21T12:55:40.422849+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:11:01.139726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559289+0000","last_change":"2023-09-21T12:54:11.462796+0000","last_active":"2023-09-21T12:54:40.559289+0000","last_peered":"2023-09-21T12:54:40.559289+0000","last_clean":"2023-09-21T12:54:40.559289+0000","last_became_active":"2023-09-21T12:54:11.460669+0000","last_became_peered":"2023-09-21T12:54:11.460669+0000","last_unstale":"2023-09-21T12:54:40.559289+0000","last_undegraded":"2023-09-21T12:54:40.559289+0000","last_fullsized":"2023-09-21T12:54:40.559289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:54:22.571025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403027+0000","last_change":"2023-09-21T12:54:12.436133+0000","last_active":"2023-09-21T12:55:40.403027+0000","last_peered":"2023-09-21T12:55:40.403027+0000","last_clean":"2023-09-21T12:55:40.403027+0000","last_became_active":"2023-09-21T12:54:12.435802+0000","last_became_peered":"2023-09-21T12:54:12.435802+0000","last_unstale":"2023-09-21T12:55:40.403027+0000","last_undegraded":"2023-09-21T12:55:40.403027+0000","last_fullsized":"2023-09-21T12:55:40.403027+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:10.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.574116+0000","last_change":"2023-09-21T12:54:41.573641+0000","last_active":"2023-09-21T12:54:41.574116+0000","last_peered":"2023-09-21T12:54:41.574116+0000","last_clean":"2023-09-21T12:54:41.574116+0000","last_became_active":"2023-09-21T12:54:41.570382+0000","last_became_peered":"2023-09-21T12:54:41.570382+0000","last_unstale":"2023-09-21T12:54:41.574116+0000","last_undegraded":"2023-09-21T12:54:41.574116+0000","last_fullsized":"2023-09-21T12:54:41.574116+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:47:35.642160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,5],"acting":[11,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1d","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407249+0000","last_change":"2023-09-21T12:54:12.439868+0000","last_active":"2023-09-21T12:55:40.407249+0000","last_peered":"2023-09-21T12:55:40.407249+0000","last_clean":"2023-09-21T12:55:40.407249+0000","last_became_active":"2023-09-21T12:54:12.437313+0000","last_became_peered":"2023-09-21T12:54:12.437313+0000","last_unstale":"2023-09-21T12:55:40.407249+0000","last_undegraded":"2023-09-21T12:55:40.407249+0000","last_fullsized":"2023-09-21T12:55:40.407249+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:27:16.653563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"86'7","reported_seq":127,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:55.589472+0000","last_change":"2023-09-21T12:54:11.459329+0000","last_active":"2023-09-21T12:55:55.589472+0000","last_peered":"2023-09-21T12:55:55.589472+0000","last_clean":"2023-09-21T12:55:55.589472+0000","last_became_active":"2023-09-21T12:54:11.459013+0000","last_became_peered":"2023-09-21T12:54:11.459013+0000","last_unstale":"2023-09-21T12:55:55.589472+0000","last_undegraded":"2023-09-21T12:55:55.589472+0000","last_fullsized":"2023-09-21T12:55:55.589472+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:18.453540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1153,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400941+0000","last_change":"2023-09-21T12:54:41.717011+0000","last_active":"2023-09-21T12:55:40.400941+0000","last_peered":"2023-09-21T12:55:40.400941+0000","last_clean":"2023-09-21T12:55:40.400941+0000","last_became_active":"2023-09-21T12:54:41.716663+0000","last_became_peered":"2023-09-21T12:54:41.716663+0000","last_unstale":"2023-09-21T12:55:40.400941+0000","last_undegraded":"2023-09-21T12:55:40.400941+0000","last_fullsized":"2023-09-21T12:55:40.400941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:24:43.714781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6],"acting":[8,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557437+0000","last_change":"2023-09-21T12:54:11.461084+0000","last_active":"2023-09-21T12:54:40.557437+0000","last_peered":"2023-09-21T12:54:40.557437+0000","last_clean":"2023-09-21T12:54:40.557437+0000","last_became_active":"2023-09-21T12:54:11.460751+0000","last_became_peered":"2023-09-21T12:54:11.460751+0000","last_unstale":"2023-09-21T12:54:40.557437+0000","last_undegraded":"2023-09-21T12:54:40.557437+0000","last_fullsized":"2023-09-21T12:54:40.557437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:24:30.383686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406135+0000","last_change":"2023-09-21T12:54:12.451311+0000","last_active":"2023-09-21T12:55:40.406135+0000","last_peered":"2023-09-21T12:55:40.406135+0000","last_clean":"2023-09-21T12:55:40.406135+0000","last_became_active":"2023-09-21T12:54:12.451018+0000","last_became_peered":"2023-09-21T12:54:12.451018+0000","last_unstale":"2023-09-21T12:55:40.406135+0000","last_undegraded":"2023-09-21T12:55:40.406135+0000","last_fullsized":"2023-09-21T12:55:40.406135+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:20.829551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561561+0000","last_change":"2023-09-21T12:54:11.470426+0000","last_active":"2023-09-21T12:54:40.561561+0000","last_peered":"2023-09-21T12:54:40.561561+0000","last_clean":"2023-09-21T12:54:40.561561+0000","last_became_active":"2023-09-21T12:54:11.470095+0000","last_became_peered":"2023-09-21T12:54:11.470095+0000","last_unstale":"2023-09-21T12:54:40.561561+0000","last_undegraded":"2023-09-21T12:54:40.561561+0000","last_fullsized":"2023-09-21T12:54:40.561561+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:14:53.411322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411654+0000","last_change":"2023-09-21T12:54:12.438920+0000","last_active":"2023-09-21T12:55:40.411654+0000","last_peered":"2023-09-21T12:55:40.411654+0000","last_clean":"2023-09-21T12:55:40.411654+0000","last_became_active":"2023-09-21T12:54:12.438126+0000","last_became_peered":"2023-09-21T12:54:12.438126+0000","last_unstale":"2023-09-21T12:55:40.411654+0000","last_undegraded":"2023-09-21T12:55:40.411654+0000","last_fullsized":"2023-09-21T12:55:40.411654+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:21:29.601259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555803+0000","last_change":"2023-09-21T12:54:11.461365+0000","last_active":"2023-09-21T12:54:40.555803+0000","last_peered":"2023-09-21T12:54:40.555803+0000","last_clean":"2023-09-21T12:54:40.555803+0000","last_became_active":"2023-09-21T12:54:11.461081+0000","last_became_peered":"2023-09-21T12:54:11.461081+0000","last_unstale":"2023-09-21T12:54:40.555803+0000","last_undegraded":"2023-09-21T12:54:40.555803+0000","last_fullsized":"2023-09-21T12:54:40.555803+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:44:25.941027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417347+0000","last_change":"2023-09-21T12:54:12.453754+0000","last_active":"2023-09-21T12:55:40.417347+0000","last_peered":"2023-09-21T12:55:40.417347+0000","last_clean":"2023-09-21T12:55:40.417347+0000","last_became_active":"2023-09-21T12:54:12.453333+0000","last_became_peered":"2023-09-21T12:54:12.453333+0000","last_unstale":"2023-09-21T12:55:40.417347+0000","last_undegraded":"2023-09-21T12:55:40.417347+0000","last_fullsized":"2023-09-21T12:55:40.417347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:33:29.380113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"86'4","reported_seq":122,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.592231+0000","last_change":"2023-09-21T12:54:11.455549+0000","last_active":"2023-09-21T12:55:57.592231+0000","last_peered":"2023-09-21T12:55:57.592231+0000","last_clean":"2023-09-21T12:55:57.592231+0000","last_became_active":"2023-09-21T12:54:11.455228+0000","last_became_peered":"2023-09-21T12:54:11.455228+0000","last_unstale":"2023-09-21T12:55:57.592231+0000","last_undegraded":"2023-09-21T12:55:57.592231+0000","last_fullsized":"2023-09-21T12:55:57.592231+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:05.041783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403182+0000","last_change":"2023-09-21T12:54:12.454621+0000","last_active":"2023-09-21T12:55:40.403182+0000","last_peered":"2023-09-21T12:55:40.403182+0000","last_clean":"2023-09-21T12:55:40.403182+0000","last_became_active":"2023-09-21T12:54:12.454387+0000","last_became_peered":"2023-09-21T12:54:12.454387+0000","last_unstale":"2023-09-21T12:55:40.403182+0000","last_undegraded":"2023-09-21T12:55:40.403182+0000","last_fullsized":"2023-09-21T12:55:40.403182+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:22.433578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561279+0000","last_change":"2023-09-21T12:54:11.458959+0000","last_active":"2023-09-21T12:54:40.561279+0000","last_peered":"2023-09-21T12:54:40.561279+0000","last_clean":"2023-09-21T12:54:40.561279+0000","last_became_active":"2023-09-21T12:54:11.458646+0000","last_became_peered":"2023-09-21T12:54:11.458646+0000","last_unstale":"2023-09-21T12:54:40.561279+0000","last_undegraded":"2023-09-21T12:54:40.561279+0000","last_fullsized":"2023-09-21T12:54:40.561279+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:26:40.047372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423718+0000","last_change":"2023-09-21T12:54:12.448180+0000","last_active":"2023-09-21T12:55:40.423718+0000","last_peered":"2023-09-21T12:55:40.423718+0000","last_clean":"2023-09-21T12:55:40.423718+0000","last_became_active":"2023-09-21T12:54:12.447855+0000","last_became_peered":"2023-09-21T12:54:12.447855+0000","last_unstale":"2023-09-21T12:55:40.423718+0000","last_undegraded":"2023-09-21T12:55:40.423718+0000","last_fullsized":"2023-09-21T12:55:40.423718+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:15:36.175529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557100+0000","last_change":"2023-09-21T12:54:11.462888+0000","last_active":"2023-09-21T12:54:40.557100+0000","last_peered":"2023-09-21T12:54:40.557100+0000","last_clean":"2023-09-21T12:54:40.557100+0000","last_became_active":"2023-09-21T12:54:11.462562+0000","last_became_peered":"2023-09-21T12:54:11.462562+0000","last_unstale":"2023-09-21T12:54:40.557100+0000","last_undegraded":"2023-09-21T12:54:40.557100+0000","last_fullsized":"2023-09-21T12:54:40.557100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:57:06.881572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418004+0000","last_change":"2023-09-21T12:54:12.434551+0000","last_active":"2023-09-21T12:55:40.418004+0000","last_peered":"2023-09-21T12:55:40.418004+0000","last_clean":"2023-09-21T12:55:40.418004+0000","last_became_active":"2023-09-21T12:54:12.434201+0000","last_became_peered":"2023-09-21T12:54:12.434201+0000","last_unstale":"2023-09-21T12:55:40.418004+0000","last_undegraded":"2023-09-21T12:55:40.418004+0000","last_fullsized":"2023-09-21T12:55:40.418004+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:11:50.660764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":261,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:58.601142+0000","last_change":"2023-09-21T12:54:11.458797+0000","last_active":"2023-09-21T12:55:58.601142+0000","last_peered":"2023-09-21T12:55:58.601142+0000","last_clean":"2023-09-21T12:55:58.601142+0000","last_became_active":"2023-09-21T12:54:11.458381+0000","last_became_peered":"2023-09-21T12:54:11.458381+0000","last_unstale":"2023-09-21T12:55:58.601142+0000","last_undegraded":"2023-09-21T12:55:58.601142+0000","last_fullsized":"2023-09-21T12:55:58.601142+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:42:09.591764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57559,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":215,"num_read_kb":163,"num_write":32,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421550+0000","last_change":"2023-09-21T12:54:12.444583+0000","last_active":"2023-09-21T12:55:40.421550+0000","last_peered":"2023-09-21T12:55:40.421550+0000","last_clean":"2023-09-21T12:55:40.421550+0000","last_became_active":"2023-09-21T12:54:12.444153+0000","last_became_peered":"2023-09-21T12:54:12.444153+0000","last_unstale":"2023-09-21T12:55:40.421550+0000","last_undegraded":"2023-09-21T12:55:40.421550+0000","last_fullsized":"2023-09-21T12:55:40.421550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:19:47.365271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.581333+0000","last_change":"2023-09-21T12:54:41.580944+0000","last_active":"2023-09-21T12:54:41.581333+0000","last_peered":"2023-09-21T12:54:41.581333+0000","last_clean":"2023-09-21T12:54:41.581333+0000","last_became_active":"2023-09-21T12:54:41.571007+0000","last_became_peered":"2023-09-21T12:54:41.571007+0000","last_unstale":"2023-09-21T12:54:41.581333+0000","last_undegraded":"2023-09-21T12:54:41.581333+0000","last_fullsized":"2023-09-21T12:54:41.581333+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:54:34.209661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422245+0000","last_change":"2023-09-21T12:54:12.455159+0000","last_active":"2023-09-21T12:55:40.422245+0000","last_peered":"2023-09-21T12:55:40.422245+0000","last_clean":"2023-09-21T12:55:40.422245+0000","last_became_active":"2023-09-21T12:54:12.454748+0000","last_became_peered":"2023-09-21T12:54:12.454748+0000","last_unstale":"2023-09-21T12:55:40.422245+0000","last_undegraded":"2023-09-21T12:55:40.422245+0000","last_fullsized":"2023-09-21T12:55:40.422245+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:24:24.838285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556559+0000","last_change":"2023-09-21T12:54:11.459964+0000","last_active":"2023-09-21T12:54:40.556559+0000","last_peered":"2023-09-21T12:54:40.556559+0000","last_clean":"2023-09-21T12:54:40.556559+0000","last_became_active":"2023-09-21T12:54:11.459638+0000","last_became_peered":"2023-09-21T12:54:11.459638+0000","last_unstale":"2023-09-21T12:54:40.556559+0000","last_undegraded":"2023-09-21T12:54:40.556559+0000","last_fullsized":"2023-09-21T12:54:40.556559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:19:50.150129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421237+0000","last_change":"2023-09-21T12:54:12.440550+0000","last_active":"2023-09-21T12:55:40.421237+0000","last_peered":"2023-09-21T12:55:40.421237+0000","last_clean":"2023-09-21T12:55:40.421237+0000","last_became_active":"2023-09-21T12:54:12.440260+0000","last_became_peered":"2023-09-21T12:54:12.440260+0000","last_unstale":"2023-09-21T12:55:40.421237+0000","last_undegraded":"2023-09-21T12:55:40.421237+0000","last_fullsized":"2023-09-21T12:55:40.421237+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:49:11.498270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"86'6","reported_seq":126,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:56.621617+0000","last_change":"2023-09-21T12:54:11.455908+0000","last_active":"2023-09-21T12:55:56.621617+0000","last_peered":"2023-09-21T12:55:56.621617+0000","last_clean":"2023-09-21T12:55:56.621617+0000","last_became_active":"2023-09-21T12:54:11.455605+0000","last_became_peered":"2023-09-21T12:54:11.455605+0000","last_unstale":"2023-09-21T12:55:56.621617+0000","last_undegraded":"2023-09-21T12:55:56.621617+0000","last_fullsized":"2023-09-21T12:55:56.621617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:04:58.725389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1435,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.407709+0000","last_change":"2023-09-21T12:54:12.442731+0000","last_active":"2023-09-21T12:55:40.407709+0000","last_peered":"2023-09-21T12:55:40.407709+0000","last_clean":"2023-09-21T12:55:40.407709+0000","last_became_active":"2023-09-21T12:54:12.442407+0000","last_became_peered":"2023-09-21T12:54:12.442407+0000","last_unstale":"2023-09-21T12:55:40.407709+0000","last_undegraded":"2023-09-21T12:55:40.407709+0000","last_fullsized":"2023-09-21T12:55:40.407709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:00:39.599660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'15","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557457+0000","last_change":"2023-09-21T12:54:11.461228+0000","last_active":"2023-09-21T12:54:40.557457+0000","last_peered":"2023-09-21T12:54:40.557457+0000","last_clean":"2023-09-21T12:54:40.557457+0000","last_became_active":"2023-09-21T12:54:11.460039+0000","last_became_peered":"2023-09-21T12:54:11.460039+0000","last_unstale":"2023-09-21T12:54:40.557457+0000","last_undegraded":"2023-09-21T12:54:40.557457+0000","last_fullsized":"2023-09-21T12:54:40.557457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:03:00.069566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"86'6","reported_seq":28,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404266+0000","last_change":"2023-09-21T12:54:41.570475+0000","last_active":"2023-09-21T12:55:40.404266+0000","last_peered":"2023-09-21T12:55:40.404266+0000","last_clean":"2023-09-21T12:55:40.404266+0000","last_became_active":"2023-09-21T12:54:41.570069+0000","last_became_peered":"2023-09-21T12:54:41.570069+0000","last_unstale":"2023-09-21T12:55:40.404266+0000","last_undegraded":"2023-09-21T12:55:40.404266+0000","last_fullsized":"2023-09-21T12:55:40.404266+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:07:47.022244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559676+0000","last_change":"2023-09-21T12:54:11.456074+0000","last_active":"2023-09-21T12:54:40.559676+0000","last_peered":"2023-09-21T12:54:40.559676+0000","last_clean":"2023-09-21T12:54:40.559676+0000","last_became_active":"2023-09-21T12:54:11.455581+0000","last_became_peered":"2023-09-21T12:54:11.455581+0000","last_unstale":"2023-09-21T12:54:40.559676+0000","last_undegraded":"2023-09-21T12:54:40.559676+0000","last_fullsized":"2023-09-21T12:54:40.559676+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:22:50.967680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412436+0000","last_change":"2023-09-21T12:54:12.441612+0000","last_active":"2023-09-21T12:55:40.412436+0000","last_peered":"2023-09-21T12:55:40.412436+0000","last_clean":"2023-09-21T12:55:40.412436+0000","last_became_active":"2023-09-21T12:54:12.441109+0000","last_became_peered":"2023-09-21T12:54:12.441109+0000","last_unstale":"2023-09-21T12:55:40.412436+0000","last_undegraded":"2023-09-21T12:55:40.412436+0000","last_fullsized":"2023-09-21T12:55:40.412436+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:49:26.079863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555077+0000","last_change":"2023-09-21T12:54:11.461431+0000","last_active":"2023-09-21T12:54:40.555077+0000","last_peered":"2023-09-21T12:54:40.555077+0000","last_clean":"2023-09-21T12:54:40.555077+0000","last_became_active":"2023-09-21T12:54:11.461047+0000","last_became_peered":"2023-09-21T12:54:11.461047+0000","last_unstale":"2023-09-21T12:54:40.555077+0000","last_undegraded":"2023-09-21T12:54:40.555077+0000","last_fullsized":"2023-09-21T12:54:40.555077+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:20:27.439523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.412701+0000","last_change":"2023-09-21T12:54:12.442588+0000","last_active":"2023-09-21T12:55:40.412701+0000","last_peered":"2023-09-21T12:55:40.412701+0000","last_clean":"2023-09-21T12:55:40.412701+0000","last_became_active":"2023-09-21T12:54:12.442204+0000","last_became_peered":"2023-09-21T12:54:12.442204+0000","last_unstale":"2023-09-21T12:55:40.412701+0000","last_undegraded":"2023-09-21T12:55:40.412701+0000","last_fullsized":"2023-09-21T12:55:40.412701+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:40:31.095215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561037+0000","last_change":"2023-09-21T12:54:11.461230+0000","last_active":"2023-09-21T12:54:40.561037+0000","last_peered":"2023-09-21T12:54:40.561037+0000","last_clean":"2023-09-21T12:54:40.561037+0000","last_became_active":"2023-09-21T12:54:11.460929+0000","last_became_peered":"2023-09-21T12:54:11.460929+0000","last_unstale":"2023-09-21T12:54:40.561037+0000","last_undegraded":"2023-09-21T12:54:40.561037+0000","last_fullsized":"2023-09-21T12:54:40.561037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:59:55.648281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"86'7","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.418895+0000","last_change":"2023-09-21T12:54:41.862117+0000","last_active":"2023-09-21T12:55:40.418895+0000","last_peered":"2023-09-21T12:55:40.418895+0000","last_clean":"2023-09-21T12:55:40.418895+0000","last_became_active":"2023-09-21T12:54:41.861717+0000","last_became_peered":"2023-09-21T12:54:41.861717+0000","last_unstale":"2023-09-21T12:55:40.418895+0000","last_undegraded":"2023-09-21T12:55:40.418895+0000","last_fullsized":"2023-09-21T12:55:40.418895+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:25:46.138394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416091+0000","last_change":"2023-09-21T12:54:12.434113+0000","last_active":"2023-09-21T12:55:40.416091+0000","last_peered":"2023-09-21T12:55:40.416091+0000","last_clean":"2023-09-21T12:55:40.416091+0000","last_became_active":"2023-09-21T12:54:12.433741+0000","last_became_peered":"2023-09-21T12:54:12.433741+0000","last_unstale":"2023-09-21T12:55:40.416091+0000","last_undegraded":"2023-09-21T12:55:40.416091+0000","last_fullsized":"2023-09-21T12:55:40.416091+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:34:24.583133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"86'6","reported_seq":123,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:57.623131+0000","last_change":"2023-09-21T12:54:11.469546+0000","last_active":"2023-09-21T12:55:57.623131+0000","last_peered":"2023-09-21T12:55:57.623131+0000","last_clean":"2023-09-21T12:55:57.623131+0000","last_became_active":"2023-09-21T12:54:11.469224+0000","last_became_peered":"2023-09-21T12:54:11.469224+0000","last_unstale":"2023-09-21T12:55:57.623131+0000","last_undegraded":"2023-09-21T12:55:57.623131+0000","last_fullsized":"2023-09-21T12:55:57.623131+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:36:09.896399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.417050+0000","last_change":"2023-09-21T12:54:12.447937+0000","last_active":"2023-09-21T12:55:40.417050+0000","last_peered":"2023-09-21T12:55:40.417050+0000","last_clean":"2023-09-21T12:55:40.417050+0000","last_became_active":"2023-09-21T12:54:12.445621+0000","last_became_peered":"2023-09-21T12:54:12.445621+0000","last_unstale":"2023-09-21T12:55:40.417050+0000","last_undegraded":"2023-09-21T12:55:40.417050+0000","last_fullsized":"2023-09-21T12:55:40.417050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:08:28.967559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'3","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560769+0000","last_change":"2023-09-21T12:54:11.452828+0000","last_active":"2023-09-21T12:54:40.560769+0000","last_peered":"2023-09-21T12:54:40.560769+0000","last_clean":"2023-09-21T12:54:40.560769+0000","last_became_active":"2023-09-21T12:54:11.452483+0000","last_became_peered":"2023-09-21T12:54:11.452483+0000","last_unstale":"2023-09-21T12:54:40.560769+0000","last_undegraded":"2023-09-21T12:54:40.560769+0000","last_fullsized":"2023-09-21T12:54:40.560769+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:07:39.710254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"23'137","reported_seq":321,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.566573+0000","last_change":"2023-09-21T12:53:06.639112+0000","last_active":"2023-09-21T12:54:41.566573+0000","last_peered":"2023-09-21T12:54:41.566573+0000","last_clean":"2023-09-21T12:54:41.566573+0000","last_became_active":"2023-09-21T12:53:06.638655+0000","last_became_peered":"2023-09-21T12:53:06.638655+0000","last_unstale":"2023-09-21T12:54:41.566573+0000","last_undegraded":"2023-09-21T12:54:41.566573+0000","last_fullsized":"2023-09-21T12:54:41.566573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:50:01.115536+0000","last_clean_scrub_stamp":"2023-09-21T12:50:01.115536+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-23T00:11:57.315852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415172+0000","last_change":"2023-09-21T12:54:12.443714+0000","last_active":"2023-09-21T12:55:40.415172+0000","last_peered":"2023-09-21T12:55:40.415172+0000","last_clean":"2023-09-21T12:55:40.415172+0000","last_became_active":"2023-09-21T12:54:12.443354+0000","last_became_peered":"2023-09-21T12:54:12.443354+0000","last_unstale":"2023-09-21T12:55:40.415172+0000","last_undegraded":"2023-09-21T12:55:40.415172+0000","last_fullsized":"2023-09-21T12:55:40.415172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:51:05.405029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.560099+0000","last_change":"2023-09-21T12:54:11.459912+0000","last_active":"2023-09-21T12:54:40.560099+0000","last_peered":"2023-09-21T12:54:40.560099+0000","last_clean":"2023-09-21T12:54:40.560099+0000","last_became_active":"2023-09-21T12:54:11.459650+0000","last_became_peered":"2023-09-21T12:54:11.459650+0000","last_unstale":"2023-09-21T12:54:40.560099+0000","last_undegraded":"2023-09-21T12:54:40.560099+0000","last_fullsized":"2023-09-21T12:54:40.560099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:10:26.029457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.559181+0000","last_change":"2023-09-21T12:54:11.469797+0000","last_active":"2023-09-21T12:54:40.559181+0000","last_peered":"2023-09-21T12:54:40.559181+0000","last_clean":"2023-09-21T12:54:40.559181+0000","last_became_active":"2023-09-21T12:54:11.469537+0000","last_became_peered":"2023-09-21T12:54:11.469537+0000","last_unstale":"2023-09-21T12:54:40.559181+0000","last_undegraded":"2023-09-21T12:54:40.559181+0000","last_fullsized":"2023-09-21T12:54:40.559181+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:20:28.150739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.400883+0000","last_change":"2023-09-21T12:54:12.455285+0000","last_active":"2023-09-21T12:55:40.400883+0000","last_peered":"2023-09-21T12:55:40.400883+0000","last_clean":"2023-09-21T12:55:40.400883+0000","last_became_active":"2023-09-21T12:54:12.454961+0000","last_became_peered":"2023-09-21T12:54:12.454961+0000","last_unstale":"2023-09-21T12:55:40.400883+0000","last_undegraded":"2023-09-21T12:55:40.400883+0000","last_fullsized":"2023-09-21T12:55:40.400883+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:16:47.425342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"86'6","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:54:41.563193+0000","last_change":"2023-09-21T12:54:11.462516+0000","last_active":"2023-09-21T12:54:41.563193+0000","last_peered":"2023-09-21T12:54:41.563193+0000","last_clean":"2023-09-21T12:54:41.563193+0000","last_became_active":"2023-09-21T12:54:11.462201+0000","last_became_peered":"2023-09-21T12:54:11.462201+0000","last_unstale":"2023-09-21T12:54:41.563193+0000","last_undegraded":"2023-09-21T12:54:41.563193+0000","last_fullsized":"2023-09-21T12:54:41.563193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:21:57.080849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.406894+0000","last_change":"2023-09-21T12:54:12.444092+0000","last_active":"2023-09-21T12:55:40.406894+0000","last_peered":"2023-09-21T12:55:40.406894+0000","last_clean":"2023-09-21T12:55:40.406894+0000","last_became_active":"2023-09-21T12:54:12.443769+0000","last_became_peered":"2023-09-21T12:54:12.443769+0000","last_unstale":"2023-09-21T12:55:40.406894+0000","last_undegraded":"2023-09-21T12:55:40.406894+0000","last_fullsized":"2023-09-21T12:55:40.406894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:09:27.045280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561295+0000","last_change":"2023-09-21T12:54:11.460574+0000","last_active":"2023-09-21T12:54:40.561295+0000","last_peered":"2023-09-21T12:54:40.561295+0000","last_clean":"2023-09-21T12:54:40.561295+0000","last_became_active":"2023-09-21T12:54:11.460244+0000","last_became_peered":"2023-09-21T12:54:11.460244+0000","last_unstale":"2023-09-21T12:54:40.561295+0000","last_undegraded":"2023-09-21T12:54:40.561295+0000","last_fullsized":"2023-09-21T12:54:40.561295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:25:36.382028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.420058+0000","last_change":"2023-09-21T12:54:12.459637+0000","last_active":"2023-09-21T12:55:40.420058+0000","last_peered":"2023-09-21T12:55:40.420058+0000","last_clean":"2023-09-21T12:55:40.420058+0000","last_became_active":"2023-09-21T12:54:12.459317+0000","last_became_peered":"2023-09-21T12:54:12.459317+0000","last_unstale":"2023-09-21T12:55:40.420058+0000","last_undegraded":"2023-09-21T12:55:40.420058+0000","last_fullsized":"2023-09-21T12:55:40.420058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:51:42.891602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.555440+0000","last_change":"2023-09-21T12:54:11.461566+0000","last_active":"2023-09-21T12:54:40.555440+0000","last_peered":"2023-09-21T12:54:40.555440+0000","last_clean":"2023-09-21T12:54:40.555440+0000","last_became_active":"2023-09-21T12:54:11.461245+0000","last_became_peered":"2023-09-21T12:54:11.461245+0000","last_unstale":"2023-09-21T12:54:40.555440+0000","last_undegraded":"2023-09-21T12:54:40.555440+0000","last_fullsized":"2023-09-21T12:54:40.555440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:33:31.305390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.399956+0000","last_change":"2023-09-21T12:54:12.443824+0000","last_active":"2023-09-21T12:55:40.399956+0000","last_peered":"2023-09-21T12:55:40.399956+0000","last_clean":"2023-09-21T12:55:40.399956+0000","last_became_active":"2023-09-21T12:54:12.443500+0000","last_became_peered":"2023-09-21T12:54:12.443500+0000","last_unstale":"2023-09-21T12:55:40.399956+0000","last_undegraded":"2023-09-21T12:55:40.399956+0000","last_fullsized":"2023-09-21T12:55:40.399956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:19:52.775233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.563079+0000","last_change":"2023-09-21T12:54:11.457788+0000","last_active":"2023-09-21T12:54:40.563079+0000","last_peered":"2023-09-21T12:54:40.563079+0000","last_clean":"2023-09-21T12:54:40.563079+0000","last_became_active":"2023-09-21T12:54:11.457468+0000","last_became_peered":"2023-09-21T12:54:11.457468+0000","last_unstale":"2023-09-21T12:54:40.563079+0000","last_undegraded":"2023-09-21T12:54:40.563079+0000","last_fullsized":"2023-09-21T12:54:40.563079+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:05:55.311018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409568+0000","last_change":"2023-09-21T12:54:12.450531+0000","last_active":"2023-09-21T12:55:40.409568+0000","last_peered":"2023-09-21T12:55:40.409568+0000","last_clean":"2023-09-21T12:55:40.409568+0000","last_became_active":"2023-09-21T12:54:12.450209+0000","last_became_peered":"2023-09-21T12:54:12.450209+0000","last_unstale":"2023-09-21T12:55:40.409568+0000","last_undegraded":"2023-09-21T12:55:40.409568+0000","last_fullsized":"2023-09-21T12:55:40.409568+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:38:56.093320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561350+0000","last_change":"2023-09-21T12:54:11.460226+0000","last_active":"2023-09-21T12:54:40.561350+0000","last_peered":"2023-09-21T12:54:40.561350+0000","last_clean":"2023-09-21T12:54:40.561350+0000","last_became_active":"2023-09-21T12:54:11.459899+0000","last_became_peered":"2023-09-21T12:54:11.459899+0000","last_unstale":"2023-09-21T12:54:40.561350+0000","last_undegraded":"2023-09-21T12:54:40.561350+0000","last_fullsized":"2023-09-21T12:54:40.561350+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:58:09.445951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423399+0000","last_change":"2023-09-21T12:54:12.458914+0000","last_active":"2023-09-21T12:55:40.423399+0000","last_peered":"2023-09-21T12:55:40.423399+0000","last_clean":"2023-09-21T12:55:40.423399+0000","last_became_active":"2023-09-21T12:54:12.458531+0000","last_became_peered":"2023-09-21T12:54:12.458531+0000","last_unstale":"2023-09-21T12:55:40.423399+0000","last_undegraded":"2023-09-21T12:55:40.423399+0000","last_fullsized":"2023-09-21T12:55:40.423399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:36:13.479594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.557905+0000","last_change":"2023-09-21T12:54:11.460380+0000","last_active":"2023-09-21T12:54:40.557905+0000","last_peered":"2023-09-21T12:54:40.557905+0000","last_clean":"2023-09-21T12:54:40.557905+0000","last_became_active":"2023-09-21T12:54:11.460080+0000","last_became_peered":"2023-09-21T12:54:11.460080+0000","last_unstale":"2023-09-21T12:54:40.557905+0000","last_undegraded":"2023-09-21T12:54:40.557905+0000","last_fullsized":"2023-09-21T12:54:40.557905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:59:01.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"86'5","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419512+0000","last_change":"2023-09-21T12:54:12.439626+0000","last_active":"2023-09-21T12:55:40.419512+0000","last_peered":"2023-09-21T12:55:40.419512+0000","last_clean":"2023-09-21T12:55:40.419512+0000","last_became_active":"2023-09-21T12:54:12.439296+0000","last_became_peered":"2023-09-21T12:54:12.439296+0000","last_unstale":"2023-09-21T12:55:40.419512+0000","last_undegraded":"2023-09-21T12:55:40.419512+0000","last_fullsized":"2023-09-21T12:55:40.419512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:21:30.704123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561605+0000","last_change":"2023-09-21T12:54:11.459500+0000","last_active":"2023-09-21T12:54:40.561605+0000","last_peered":"2023-09-21T12:54:40.561605+0000","last_clean":"2023-09-21T12:54:40.561605+0000","last_became_active":"2023-09-21T12:54:11.458995+0000","last_became_peered":"2023-09-21T12:54:11.458995+0000","last_unstale":"2023-09-21T12:54:40.561605+0000","last_undegraded":"2023-09-21T12:54:40.561605+0000","last_fullsized":"2023-09-21T12:54:40.561605+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T15:49:51.933183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.419739+0000","last_change":"2023-09-21T12:54:12.439458+0000","last_active":"2023-09-21T12:55:40.419739+0000","last_peered":"2023-09-21T12:55:40.419739+0000","last_clean":"2023-09-21T12:55:40.419739+0000","last_became_active":"2023-09-21T12:54:12.439128+0000","last_became_peered":"2023-09-21T12:54:12.439128+0000","last_unstale":"2023-09-21T12:55:40.419739+0000","last_undegraded":"2023-09-21T12:55:40.419739+0000","last_fullsized":"2023-09-21T12:55:40.419739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:03:40.199701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.556244+0000","last_change":"2023-09-21T12:54:11.458049+0000","last_active":"2023-09-21T12:54:40.556244+0000","last_peered":"2023-09-21T12:54:40.556244+0000","last_clean":"2023-09-21T12:54:40.556244+0000","last_became_active":"2023-09-21T12:54:11.457746+0000","last_became_peered":"2023-09-21T12:54:11.457746+0000","last_unstale":"2023-09-21T12:54:40.556244+0000","last_undegraded":"2023-09-21T12:54:40.556244+0000","last_fullsized":"2023-09-21T12:54:40.556244+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:28:17.723197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"86'7","reported_seq":36,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.411659+0000","last_change":"2023-09-21T12:54:41.574550+0000","last_active":"2023-09-21T12:55:40.411659+0000","last_peered":"2023-09-21T12:55:40.411659+0000","last_clean":"2023-09-21T12:55:40.411659+0000","last_became_active":"2023-09-21T12:54:41.568847+0000","last_became_peered":"2023-09-21T12:54:41.568847+0000","last_unstale":"2023-09-21T12:55:40.411659+0000","last_undegraded":"2023-09-21T12:55:40.411659+0000","last_fullsized":"2023-09-21T12:55:40.411659+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:40:47.869112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-21T12:54:40.561711+0000","last_change":"2023-09-21T12:54:11.467306+0000","last_active":"2023-09-21T12:54:40.561711+0000","last_peered":"2023-09-21T12:54:40.561711+0000","last_clean":"2023-09-21T12:54:40.561711+0000","last_became_active":"2023-09-21T12:54:11.466872+0000","last_became_peered":"2023-09-21T12:54:11.466872+0000","last_unstale":"2023-09-21T12:54:40.561711+0000","last_undegraded":"2023-09-21T12:54:40.561711+0000","last_fullsized":"2023-09-21T12:54:40.561711+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:10.438556+0000","last_clean_scrub_stamp":"2023-09-21T12:54:10.438556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:39:00.119361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.413851+0000","last_change":"2023-09-21T12:54:12.441762+0000","last_active":"2023-09-21T12:55:40.413851+0000","last_peered":"2023-09-21T12:55:40.413851+0000","last_clean":"2023-09-21T12:55:40.413851+0000","last_became_active":"2023-09-21T12:54:12.441494+0000","last_became_peered":"2023-09-21T12:54:12.441494+0000","last_unstale":"2023-09-21T12:55:40.413851+0000","last_undegraded":"2023-09-21T12:55:40.413851+0000","last_fullsized":"2023-09-21T12:55:40.413851+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:49:44.211982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"86'9","reported_seq":23,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.402235+0000","last_change":"2023-09-21T12:54:12.441677+0000","last_active":"2023-09-21T12:55:40.402235+0000","last_peered":"2023-09-21T12:55:40.402235+0000","last_clean":"2023-09-21T12:55:40.402235+0000","last_became_active":"2023-09-21T12:54:12.441318+0000","last_became_peered":"2023-09-21T12:54:12.441318+0000","last_unstale":"2023-09-21T12:55:40.402235+0000","last_undegraded":"2023-09-21T12:55:40.402235+0000","last_fullsized":"2023-09-21T12:55:40.402235+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T18:30:57.958203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"86'12","reported_seq":26,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.409013+0000","last_change":"2023-09-21T12:54:12.435483+0000","last_active":"2023-09-21T12:55:40.409013+0000","last_peered":"2023-09-21T12:55:40.409013+0000","last_clean":"2023-09-21T12:55:40.409013+0000","last_became_active":"2023-09-21T12:54:12.435179+0000","last_became_peered":"2023-09-21T12:54:12.435179+0000","last_unstale":"2023-09-21T12:55:40.409013+0000","last_undegraded":"2023-09-21T12:55:40.409013+0000","last_fullsized":"2023-09-21T12:55:40.409013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T14:57:50.822445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.389897+0000","last_change":"2023-09-21T12:54:12.449728+0000","last_active":"2023-09-21T12:55:40.389897+0000","last_peered":"2023-09-21T12:55:40.389897+0000","last_clean":"2023-09-21T12:55:40.389897+0000","last_became_active":"2023-09-21T12:54:12.449289+0000","last_became_peered":"2023-09-21T12:54:12.449289+0000","last_unstale":"2023-09-21T12:55:40.389897+0000","last_undegraded":"2023-09-21T12:55:40.389897+0000","last_fullsized":"2023-09-21T12:55:40.389897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:09:58.807725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"86'7","reported_seq":21,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421416+0000","last_change":"2023-09-21T12:54:12.457604+0000","last_active":"2023-09-21T12:55:40.421416+0000","last_peered":"2023-09-21T12:55:40.421416+0000","last_clean":"2023-09-21T12:55:40.421416+0000","last_became_active":"2023-09-21T12:54:12.457349+0000","last_became_peered":"2023-09-21T12:54:12.457349+0000","last_unstale":"2023-09-21T12:55:40.421416+0000","last_undegraded":"2023-09-21T12:55:40.421416+0000","last_fullsized":"2023-09-21T12:55:40.421416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:58:25.603523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"86'4","reported_seq":18,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.421161+0000","last_change":"2023-09-21T12:54:12.454088+0000","last_active":"2023-09-21T12:55:40.421161+0000","last_peered":"2023-09-21T12:55:40.421161+0000","last_clean":"2023-09-21T12:55:40.421161+0000","last_became_active":"2023-09-21T12:54:12.453739+0000","last_became_peered":"2023-09-21T12:54:12.453739+0000","last_unstale":"2023-09-21T12:55:40.421161+0000","last_undegraded":"2023-09-21T12:55:40.421161+0000","last_fullsized":"2023-09-21T12:55:40.421161+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T17:18:37.325559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.403172+0000","last_change":"2023-09-21T12:54:12.441508+0000","last_active":"2023-09-21T12:55:40.403172+0000","last_peered":"2023-09-21T12:55:40.403172+0000","last_clean":"2023-09-21T12:55:40.403172+0000","last_became_active":"2023-09-21T12:54:12.441164+0000","last_became_peered":"2023-09-21T12:54:12.441164+0000","last_unstale":"2023-09-21T12:55:40.403172+0000","last_undegraded":"2023-09-21T12:55:40.403172+0000","last_fullsized":"2023-09-21T12:55:40.403172+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T23:55:05.794448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"86'15","reported_seq":29,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404940+0000","last_change":"2023-09-21T12:54:12.437630+0000","last_active":"2023-09-21T12:55:40.404940+0000","last_peered":"2023-09-21T12:55:40.404940+0000","last_clean":"2023-09-21T12:55:40.404940+0000","last_became_active":"2023-09-21T12:54:12.437308+0000","last_became_peered":"2023-09-21T12:54:12.437308+0000","last_unstale":"2023-09-21T12:55:40.404940+0000","last_undegraded":"2023-09-21T12:55:40.404940+0000","last_fullsized":"2023-09-21T12:55:40.404940+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T22:16:41.165358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"86'2","reported_seq":16,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.416070+0000","last_change":"2023-09-21T12:54:12.443916+0000","last_active":"2023-09-21T12:55:40.416070+0000","last_peered":"2023-09-21T12:55:40.416070+0000","last_clean":"2023-09-21T12:55:40.416070+0000","last_became_active":"2023-09-21T12:54:12.443623+0000","last_became_peered":"2023-09-21T12:54:12.443623+0000","last_unstale":"2023-09-21T12:55:40.416070+0000","last_undegraded":"2023-09-21T12:55:40.416070+0000","last_fullsized":"2023-09-21T12:55:40.416070+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T13:47:13.525230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"86'6","reported_seq":20,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404388+0000","last_change":"2023-09-21T12:54:12.454732+0000","last_active":"2023-09-21T12:55:40.404388+0000","last_peered":"2023-09-21T12:55:40.404388+0000","last_clean":"2023-09-21T12:55:40.404388+0000","last_became_active":"2023-09-21T12:54:12.454374+0000","last_became_peered":"2023-09-21T12:54:12.454374+0000","last_unstale":"2023-09-21T12:55:40.404388+0000","last_undegraded":"2023-09-21T12:55:40.404388+0000","last_fullsized":"2023-09-21T12:55:40.404388+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:08:59.386098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"86'8","reported_seq":19,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.404271+0000","last_change":"2023-09-21T12:54:41.568252+0000","last_active":"2023-09-21T12:55:40.404271+0000","last_peered":"2023-09-21T12:55:40.404271+0000","last_clean":"2023-09-21T12:55:40.404271+0000","last_became_active":"2023-09-21T12:54:41.567653+0000","last_became_peered":"2023-09-21T12:54:41.567653+0000","last_unstale":"2023-09-21T12:55:40.404271+0000","last_undegraded":"2023-09-21T12:55:40.404271+0000","last_fullsized":"2023-09-21T12:55:40.404271+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T16:09:31.075023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,11],"acting":[9,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2a","version":"86'10","reported_seq":24,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.423029+0000","last_change":"2023-09-21T12:54:12.440896+0000","last_active":"2023-09-21T12:55:40.423029+0000","last_peered":"2023-09-21T12:55:40.423029+0000","last_clean":"2023-09-21T12:55:40.423029+0000","last_became_active":"2023-09-21T12:54:12.440600+0000","last_became_peered":"2023-09-21T12:54:12.440600+0000","last_unstale":"2023-09-21T12:55:40.423029+0000","last_undegraded":"2023-09-21T12:55:40.423029+0000","last_fullsized":"2023-09-21T12:55:40.423029+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T19:51:18.845072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"86'11","reported_seq":25,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.422807+0000","last_change":"2023-09-21T12:54:12.453376+0000","last_active":"2023-09-21T12:55:40.422807+0000","last_peered":"2023-09-21T12:55:40.422807+0000","last_clean":"2023-09-21T12:55:40.422807+0000","last_became_active":"2023-09-21T12:54:12.452816+0000","last_became_peered":"2023-09-21T12:54:12.452816+0000","last_unstale":"2023-09-21T12:55:40.422807+0000","last_undegraded":"2023-09-21T12:55:40.422807+0000","last_fullsized":"2023-09-21T12:55:40.422807+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T20:22:03.906882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"86'8","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-21T12:55:40.415950+0000","last_change":"2023-09-21T12:54:12.445654+0000","last_active":"2023-09-21T12:55:40.415950+0000","last_peered":"2023-09-21T12:55:40.415950+0000","last_clean":"2023-09-21T12:55:40.415950+0000","last_became_active":"2023-09-21T12:54:12.445279+0000","last_became_peered":"2023-09-21T12:54:12.445279+0000","last_unstale":"2023-09-21T12:55:40.415950+0000","last_undegraded":"2023-09-21T12:55:40.415950+0000","last_fullsized":"2023-09-21T12:55:40.415950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-21T12:54:11.440698+0000","last_clean_scrub_stamp":"2023-09-21T12:54:11.440698+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-22T21:42:43.971096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":250312,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62547,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":644,"num_read_kb":391,"num_write":162,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":187641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416419,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.39000000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78800000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.498},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84699999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.61899999999999999,"15min":0.60699999999999998},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.92600000000000005,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.49299999999999999,"15min":0.48199999999999998},"min":{"1min":0.314,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.437},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.47099999999999997,"15min":0.45600000000000002},"min":{"1min":0.34699999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70199999999999996,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.41999999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.61399999999999999,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.876,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.107,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56200000000000006,"15min":0.54600000000000004},"min":{"1min":0.373,"5min":0.314,"15min":0.314},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.57799999999999996,"15min":0.56399999999999995},"min":{"1min":0.44500000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:54:25 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70099999999999996,"15min":0.69099999999999995},"min":{"1min":0.498,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.0049999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.753},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.54500000000000004,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.054,"5min":1.48,"15min":1.48},"last":0.77100000000000002}]},{"osd":8,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.81899999999999995}]},{"osd":9,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77100000000000002,"15min":0.76600000000000001},"min":{"1min":0.52200000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.048,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.752,"15min":0.74199999999999999},"min":{"1min":0.53100000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0349999999999999,"5min":1.228,"15min":1.228},"last":0.79900000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:28 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.77900000000000003,"15min":0.76300000000000001},"min":{"1min":0.58599999999999997,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.133,"5min":1.55,"15min":1.55},"last":0.87},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0780000000000001,"5min":1.522,"15min":1.522},"last":0.78700000000000003}]}]},{"osd":10,"up_from":72,"seq":309237645349,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1069056,"data_stored":1096347,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.48399999999999999,"15min":0.48999999999999999},"min":{"1min":0.28899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66000000000000003,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47499999999999998,"15min":0.47699999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.61499999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.621,"15min":0.62},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.67600000000000005}]},{"osd":3,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.65000000000000002,"15min":0.66500000000000004},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79400000000000004,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.65600000000000003,"15min":0.66600000000000004},"min":{"1min":0.433,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.79500000000000004,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53900000000000003,"15min":0.53400000000000003},"min":{"1min":0.375,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.78900000000000003,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71499999999999997,"15min":0.71699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81999999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75700000000000001,"15min":0.76500000000000001},"min":{"1min":0.47399999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.94699999999999995,"5min":1.345,"15min":1.345},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.73399999999999999,"15min":0.74199999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84199999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Sep 21 12:55:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.86799999999999999}]},{"osd":8,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.745,"15min":0.74399999999999999},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.52300000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98499999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.95199999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79900000000000004,"15min":0.80000000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.84199999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.88}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.78700000000000003,"15min":0.78200000000000003},"min":{"1min":0.63600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96899999999999997,"5min":1.214,"15min":1.214},"last":0.749},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81699999999999995,"15min":0.80600000000000005},"min":{"1min":0.76100000000000001,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.03,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.91500000000000004}]}]},{"osd":9,"up_from":67,"seq":287762808874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.622,"15min":0.621},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78300000000000003,"5min":6.335,"15min":6.335},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.55800000000000005,"15min":0.58399999999999996},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0109999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.72299999999999998,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.76900000000000002,"15min":0.81799999999999995},"min":{"1min":0.48799999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89000000000000001,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.73099999999999998,"15min":0.76400000000000001},"min":{"1min":0.53000000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.046,"5min":1.149,"15min":1.149},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.77300000000000002,"15min":0.81100000000000005},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.82599999999999996,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.72499999999999998,"15min":0.753},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.4199999999999999,"5min":4.633,"15min":4.633},"last":0.621},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.72999999999999998,"15min":0.76400000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.25,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Sep 21 12:53:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.82099999999999995,"15min":0.88300000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.046,"5min":1.492,"15min":1.492},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81499999999999995,"15min":0.85399999999999998},"min":{"1min":0.57899999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1919999999999999,"5min":1.456,"15min":1.456},"last":0.84899999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.83299999999999996,"15min":0.90800000000000003},"min":{"1min":0.438,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.099,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83999999999999997,"15min":0.89600000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92400000000000004,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.88600000000000001,"15min":0.96499999999999997},"min":{"1min":0.51300000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.087,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.98699999999999999,"15min":1.0129999999999999},"min":{"1min":0.53700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1619999999999999,"5min":6.9420000000000002,"15min":6.9420000000000002},"last":0.88900000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.89100000000000001,"15min":0.94499999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90000000000000002,"5min":2.516,"15min":2.516},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.91300000000000003,"15min":0.98299999999999998},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0680000000000001,"5min":1.548,"15min":1.548},"last":0.80000000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.90900000000000003,"15min":0.92800000000000005},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1120000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.89300000000000002,"15min":0.90300000000000002},"min":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.131,"5min":1.506,"15min":1.506},"last":0.95499999999999996}]},{"osd":11,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.92500000000000004}]}]},{"osd":8,"up_from":59,"seq":253403070511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.879,"5min":1.024,"15min":1.024},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.78400000000000003,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.499},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.64100000000000001,"15min":0.63900000000000001},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58799999999999997}]},{"osd":2,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.45300000000000001,"15min":0.44900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.47899999999999998,"15min":0.47499999999999998},"min":{"1min":0.32800000000000001,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.58199999999999996},"min":{"1min":0.38800000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.502,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995}]},{"osd":4,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.65300000000000002,"15min":0.64200000000000002},"min":{"1min":0.45500000000000002,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.66900000000000004,"15min":0.66100000000000003},"min":{"1min":0.499,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.56000000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.55600000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.436}]},{"osd":6,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.72499999999999998,"15min":0.72099999999999997},"min":{"1min":0.49399999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.008,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.70199999999999996,"15min":0.69799999999999995},"min":{"1min":0.505,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96599999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Thu Sep 21 12:55:18 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.70499999999999996,"15min":0.69299999999999995},"min":{"1min":0.54800000000000004,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.59699999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70699999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.71999999999999997,"15min":0.69999999999999996},"min":{"1min":0.56200000000000006,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.754,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.85299999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.75700000000000001,"15min":0.74099999999999999},"min":{"1min":0.61499999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.73799999999999999,"15min":0.71899999999999997},"min":{"1min":0.56299999999999994,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.72999999999999998}]},{"osd":11,"last update":"Thu Sep 21 12:55:15 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.79900000000000004}]}]},{"osd":7,"up_from":52,"seq":223338299445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":991232,"data_stored":1039864,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56899999999999995,"15min":0.56599999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58999999999999997,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.42899999999999999,"15min":0.433},"min":{"1min":0.32100000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.51200000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.621},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.42299999999999999,"15min":0.41299999999999998},"min":{"1min":0.30599999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65600000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.441,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77700000000000002,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57899999999999996,"15min":0.56799999999999995},"min":{"1min":0.42699999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73499999999999999}]},{"osd":3,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.61799999999999999,"15min":0.625},"min":{"1min":0.40300000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.69899999999999995,"5min":0.88,"15min":0.88},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.373,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78600000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.84999999999999998,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65200000000000002,"15min":0.64600000000000002},"min":{"1min":0.46800000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83899999999999997,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.623},"min":{"1min":0.51600000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.83699999999999997,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68899999999999995,"15min":0.69099999999999995},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81499999999999995,"5min":1.095,"15min":1.095},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.70999999999999996,"15min":0.71999999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82699999999999996,"5min":1.111,"15min":1.111},"last":0.78900000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.68400000000000005,"15min":0.67600000000000005},"min":{"1min":0.47799999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83999999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.70599999999999996},"min":{"1min":0.48599999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":1.446,"15min":1.446},"last":1.0169999999999999}]},{"osd":9,"last update":"Thu Sep 21 12:55:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74099999999999999,"15min":0.76000000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.135,"15min":1.135},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73899999999999999,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92500000000000004,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.004}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71699999999999997,"15min":0.72299999999999998},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.79100000000000004,"5min":1.052,"15min":1.052},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69699999999999995,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.83999999999999997,"5min":1.04,"15min":1.04},"last":0.93799999999999994}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":1.034},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.98999999999999999}]}]},{"osd":6,"up_from":47,"seq":201863462969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":446416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.45200000000000001},"min":{"1min":0.33900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.46300000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.496}]},{"osd":1,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63400000000000001,"15min":0.63},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.034,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.69399999999999995,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.3410000000000002,"5min":7.3410000000000002,"15min":7.3410000000000002},"last":0.67800000000000005}]},{"osd":2,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64700000000000002,"15min":0.627},"min":{"1min":0.42599999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93200000000000005,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.623,"15min":0.61499999999999999},"min":{"1min":0.41299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.89900000000000002,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":0.58799999999999997},"min":{"1min":0.39400000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60199999999999998,"15min":0.59599999999999997},"min":{"1min":0.438,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.58599999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69099999999999995,"15min":0.68000000000000005},"min":{"1min":0.504,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.244},"last":0.60399999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.68899999999999995,"15min":0.68700000000000006},"min":{"1min":0.53800000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.032,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.745,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.119},"last":0.622},{"interface":"front","average":{"1min":1.097,"5min":0.84299999999999997,"15min":0.79800000000000004},"min":{"1min":0.63300000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":7.3570000000000002,"5min":7.3570000000000002,"15min":7.3570000000000002},"last":0.56499999999999995}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.74399999999999999,"15min":0.75700000000000001},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.88,"5min":1.016,"15min":1.016},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.79600000000000004,"15min":0.81899999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.78600000000000003}]},{"osd":9,"last update":"Thu Sep 21 12:55:50 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.83399999999999996,"15min":0.86599999999999999},"min":{"1min":0.46400000000000002,"5min":0.438,"15min":0.438},"max":{"1min":1.0509999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.79000000000000004,"15min":0.82699999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.96299999999999997,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.77600000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":0.86699999999999999,"15min":0.82299999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":7.4009999999999998,"5min":7.4009999999999998,"15min":7.4009999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.133,"5min":0.93500000000000005,"15min":0.90200000000000002},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":7.3890000000000002,"5min":7.3890000000000002,"15min":7.3890000000000002},"last":0.80700000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":503489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.59299999999999997,"15min":0.50800000000000001},"min":{"1min":0.45700000000000002,"5min":0.38500000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":5.7750000000000004,"15min":5.7750000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.505},"min":{"1min":0.436,"5min":0.38300000000000001,"15min":0.30499999999999999},"max":{"1min":0.79900000000000004,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58399999999999996,"15min":0.53500000000000003},"min":{"1min":0.47599999999999998,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84999999999999998,"5min":0.878,"15min":0.878},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.58599999999999997,"15min":0.54000000000000004},"min":{"1min":0.57899999999999996,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.745}]},{"osd":3,"last update":"Thu Sep 21 12:55:35 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58599999999999997,"15min":0.55200000000000005},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58399999999999996,"15min":0.55000000000000004},"min":{"1min":0.39600000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.76600000000000001,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Sep 21 12:55:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.47999999999999998,"15min":0.443},"min":{"1min":0.26800000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.79300000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.52600000000000002,"15min":0.50600000000000001},"min":{"1min":0.33200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.71299999999999997,"5min":0.871,"15min":0.871},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.59099999999999997},"min":{"1min":0.42999999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83799999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.65200000000000002,"15min":0.623},"min":{"1min":0.51500000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89200000000000002,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.67300000000000004,"15min":0.66500000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.78700000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Sep 21 12:55:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.39300000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.83699999999999997,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.45100000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95699999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.83099999999999996}]},{"osd":8,"last update":"Thu Sep 21 12:55:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.70499999999999996,"15min":0.68300000000000005},"min":{"1min":0.57899999999999996,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.97099999999999997,"5min":1.028,"15min":1.028},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.70799999999999996,"15min":0.69399999999999995},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90600000000000003,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.67000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79400000000000004,"15min":0.77400000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.97699999999999998,"5min":2.177,"15min":2.177},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.80300000000000005,"15min":0.78300000000000003},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.96699999999999997,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":0.91400000000000003}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.71999999999999997},"min":{"1min":0.48899999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.55700000000000005,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.97599999999999998,"5min":0.995,"15min":0.995},"last":0.876}]},{"osd":11,"last update":"Thu Sep 21 12:55:14 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90400000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":447408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.622,"15min":0.52100000000000002},"min":{"1min":0.38600000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.417,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66600000000000004,"15min":0.55800000000000005},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.5049999999999999,"5min":2.657,"15min":2.657},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.621,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.95799999999999996,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.623},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.65800000000000003,"15min":0.59399999999999997},"min":{"1min":0.48299999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.8340000000000001,"5min":2.8340000000000001,"15min":2.8340000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.907,"5min":2.907,"15min":2.907},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.372}]},{"osd":4,"last update":"Thu Sep 21 12:55:56 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69299999999999995,"15min":0.625},"min":{"1min":0.46800000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.542,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.71599999999999997,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":2.8039999999999998,"5min":2.8039999999999998,"15min":2.8039999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66400000000000003,"15min":0.65400000000000003},"min":{"1min":0.42699999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.117,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.755},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.375,"5min":0.307,"15min":0.307},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Sep 21 12:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72999999999999998,"15min":0.72399999999999998},"min":{"1min":0.59999999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.018,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.52200000000000002,"5min":0.5,"15min":0.5},"max":{"1min":0.96899999999999997,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.66400000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80600000000000005,"15min":0.82699999999999996},"min":{"1min":0.55400000000000005,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95999999999999996,"5min":1.421,"15min":1.421},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.7719999999999998,"5min":2.7719999999999998,"15min":2.7719999999999998},"last":0.80000000000000004}]},{"osd":9,"last update":"Thu Sep 21 12:55:49 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0860000000000001,"5min":1.8169999999999999,"15min":1.8169999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.83899999999999997,"15min":0.85199999999999998},"min":{"1min":0.54900000000000004,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.871,"5min":2.3109999999999999,"15min":2.3109999999999999},"last":0.65100000000000002}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.871,"15min":0.86199999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":2.7389999999999999,"5min":2.7389999999999999,"15min":2.7389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84599999999999997,"15min":0.84799999999999998},"min":{"1min":0.61799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.125,"5min":1.222,"15min":1.222},"last":0.72099999999999997}]},{"osd":11,"last update":"Thu Sep 21 12:55:29 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.86399999999999999,"15min":0.84799999999999998},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.8730000000000002,"5min":2.8730000000000002,"15min":2.8730000000000002},"last":0.65900000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411404,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":1007616,"data_stored":505609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56200000000000006,"15min":0.54300000000000004},"min":{"1min":0.42599999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.81100000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.39700000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77900000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.59599999999999997,"15min":0.53400000000000003},"min":{"1min":0.48699999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.56999999999999995,"15min":0.53600000000000003},"min":{"1min":0.46700000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.86599999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Sep 21 12:55:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.39900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.61199999999999999,"15min":0.57999999999999996},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":2.7370000000000001,"5min":2.7370000000000001,"15min":2.7370000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Sep 21 12:55:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71399999999999997,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.51300000000000001,"15min":0.50700000000000001},"min":{"1min":0.36699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.70399999999999996,"5min":0.876,"15min":0.876},"last":0.498}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.69999999999999996},"min":{"1min":0.58399999999999996,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.85799999999999998,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.66300000000000003,"15min":0.66500000000000004},"min":{"1min":0.42199999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.81200000000000006,"5min":3.5449999999999999,"15min":3.5449999999999999},"last":0.629}]},{"osd":7,"last update":"Thu Sep 21 12:53:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.879,"5min":1.252,"15min":1.252},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.63400000000000001,"15min":0.63800000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.56000000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57999999999999996,"15min":0.56799999999999995},"min":{"1min":0.35299999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.84599999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.63500000000000001,"15min":0.625},"min":{"1min":0.41299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86099999999999999,"5min":1.026,"15min":1.026},"last":0.85399999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:44 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.78800000000000003,"15min":0.76200000000000001},"min":{"1min":0.65900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.01,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.57399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":2.9870000000000001,"15min":2.9870000000000001},"last":0.79200000000000004}]},{"osd":10,"last update":"Thu Sep 21 12:55:06 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.877}]},{"osd":11,"last update":"Thu Sep 21 12:55:12 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.82999999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149766,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":446610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61599999999999999,"15min":0.46600000000000003},"min":{"1min":0.30499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":2.202,"5min":14.457000000000001,"15min":14.457000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.625,"15min":0.48499999999999999},"min":{"1min":0.35699999999999998,"5min":0.31,"15min":0.31},"max":{"1min":1.2809999999999999,"5min":14.156000000000001,"15min":14.156000000000001},"last":0.54600000000000004}]},{"osd":1,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64600000000000002,"15min":0.60499999999999998},"min":{"1min":0.46200000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.97799999999999998,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.70999999999999996,"15min":0.64300000000000002},"min":{"1min":0.438,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.51,"5min":6.9119999999999999,"15min":6.9119999999999999},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Sep 21 12:55:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.79100000000000004,"15min":0.65900000000000003},"min":{"1min":0.53300000000000003,"5min":0.437,"15min":0.437},"max":{"1min":1.214,"5min":13.997,"15min":13.997},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.45100000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.98099999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.86699999999999999}]},{"osd":4,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.89300000000000002,"15min":0.70099999999999996},"min":{"1min":0.49099999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":6.4610000000000003,"5min":14.121,"15min":14.121},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.71699999999999997,"15min":0.64700000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":5.7729999999999997,"5min":5.7729999999999997,"15min":5.7729999999999997},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":0.74299999999999999,"15min":0.67100000000000004},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.79,"5min":6.79,"15min":6.79},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.962,"5min":0.92200000000000004,"15min":0.73299999999999998},"min":{"1min":0.52700000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":13.933999999999999,"5min":13.933999999999999,"15min":13.933999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Thu Sep 21 12:55:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63300000000000001,"15min":0.58099999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.627,"5min":1.994,"15min":1.994},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.79100000000000004,"15min":0.66200000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":5.9909999999999997,"5min":6.7329999999999997,"15min":6.7329999999999997},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:55:03 2023","interfaces":[{"interface":"back","average":{"1min":1.206,"5min":0.83699999999999997,"15min":0.76300000000000001},"min":{"1min":0.623,"5min":0.499,"15min":0.499},"max":{"1min":6.8399999999999999,"5min":6.8399999999999999,"15min":6.8399999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.63200000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.92800000000000005}]},{"osd":8,"last update":"Thu Sep 21 12:53:15 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.85599999999999998}]},{"osd":9,"last update":"Thu Sep 21 12:55:46 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":1.012,"15min":0.90900000000000003},"min":{"1min":0.48999999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":3.661,"5min":14.189,"15min":14.189},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.1120000000000001,"5min":0.91900000000000004,"15min":0.85999999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.343,"5min":8.343,"15min":8.343},"last":0.83599999999999997}]},{"osd":10,"last update":"Thu Sep 21 12:55:05 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":0.93999999999999995,"15min":0.89100000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":6.8789999999999996,"5min":6.8789999999999996,"15min":6.8789999999999996},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.1040000000000001,"15min":0.95799999999999996},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":14.083,"5min":14.083,"15min":14.083},"last":0.69499999999999995}]},{"osd":11,"last update":"Thu Sep 21 12:55:11 2023","interfaces":[{"interface":"back","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":14.042999999999999,"5min":14.042999999999999,"15min":14.042999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.96099999999999997}]}]},{"osd":4,"up_from":34,"seq":146028888129,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":447105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78100000000000003,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.57299999999999995,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73799999999999999}]},{"osd":1,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41299999999999998,"15min":0.38100000000000001},"min":{"1min":0.32000000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.53800000000000003,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.42099999999999999,"15min":0.38500000000000001},"min":{"1min":0.35099999999999998,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42599999999999999}]},{"osd":2,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.53700000000000003},"min":{"1min":0.376,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.90100000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.85299999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.64900000000000002,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.90800000000000003,"5min":3.7229999999999999,"15min":3.7229999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61699999999999999,"15min":0.57099999999999995},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.878,"5min":3.851,"15min":3.851},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60399999999999998,"15min":0.57299999999999995},"min":{"1min":0.40899999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80600000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.61299999999999999,"15min":0.56799999999999995},"min":{"1min":0.42399999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.94199999999999995,"5min":1,"15min":1},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.65600000000000003,"15min":0.61599999999999999},"min":{"1min":0.44800000000000001,"5min":0.433,"15min":0.433},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":0.63},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63800000000000001,"15min":0.624},"min":{"1min":0.46300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.877,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Sep 21 12:54:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.58699999999999997,"15min":0.55900000000000005},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.88700000000000001,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.88100000000000001,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66300000000000003}]},{"osd":8,"last update":"Thu Sep 21 12:55:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.51400000000000001,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.70499999999999996,"15min":0.68899999999999995},"min":{"1min":0.503,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":0.874}]},{"osd":9,"last update":"Thu Sep 21 12:55:45 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.60899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.01,"5min":3.1139999999999999,"15min":3.1139999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.76300000000000001,"15min":0.75800000000000001},"min":{"1min":0.59799999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.95599999999999996,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.81699999999999995}]},{"osd":10,"last update":"Thu Sep 21 12:55:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.76400000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.871,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.745,"15min":0.75800000000000001},"min":{"1min":0.45600000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.92100000000000004}]},{"osd":11,"last update":"Thu Sep 21 12:55:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.94999999999999996}]}]},{"osd":5,"up_from":39,"seq":167503724605,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":999424,"data_stored":1038370,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52800000000000002,"15min":0.501},"min":{"1min":0.40699999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.50800000000000001},"min":{"1min":0.36499999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.218,"15min":1.218},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.53200000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80400000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59899999999999998,"15min":0.57599999999999996},"min":{"1min":0.44,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67100000000000004}]},{"osd":2,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"min":{"1min":0.34200000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.44},"min":{"1min":0.307,"5min":0.246,"15min":0.246},"max":{"1min":0.71099999999999997,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.38,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71299999999999997,"5min":1.768,"15min":1.768},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57399999999999995,"15min":0.57099999999999995},"min":{"1min":0.435,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Thu Sep 21 12:55:16 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.629,"15min":0.60499999999999998},"min":{"1min":0.52600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.63,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.46200000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.83099999999999996,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.46200000000000002}]},{"osd":6,"last update":"Thu Sep 21 12:55:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66200000000000003,"15min":0.64600000000000002},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.96699999999999997,"5min":1.409,"15min":1.409},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.99099999999999999,"5min":1.5720000000000001,"15min":1.5720000000000001},"last":0.43099999999999999}]},{"osd":7,"last update":"Thu Sep 21 12:54:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.64900000000000002},"min":{"1min":0.54700000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.95399999999999996,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.63400000000000001,"15min":0.63500000000000001},"min":{"1min":0.46899999999999997,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.879,"15min":0.879},"last":0.63200000000000001}]},{"osd":8,"last update":"Thu Sep 21 12:55:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63500000000000001,"15min":0.63100000000000001},"min":{"1min":0.318,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.44800000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.57499999999999996}]},{"osd":9,"last update":"Thu Sep 21 12:55:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.53300000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.90900000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.077,"5min":0.79700000000000004,"15min":0.745},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":7.3819999999999997,"5min":7.3819999999999997,"15min":7.3819999999999997},"last":0.85399999999999998}]},{"osd":10,"last update":"Thu Sep 21 12:55:08 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.748,"15min":0.73799999999999999},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.68300000000000005,"15min":0.67100000000000004},"min":{"1min":0.48699999999999999,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91800000000000004,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.88800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34586,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36228,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":57559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":59406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":59984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-21T12:56:02.366 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:56:02.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 -- 172.21.15.142:0/3859708687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 msgr2=0x7fc920102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 --2- 172.21.15.142:0/3859708687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920102440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc90c0099c0 tx=0x7fc90c009cd0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 -- 172.21.15.142:0/3859708687 shutdown_connections 2023-09-21T12:56:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 --2- 172.21.15.142:0/3859708687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920102980 0x7fc920109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 --2- 172.21.15.142:0/3859708687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920100df0 0x7fc920101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 --2- 172.21.15.142:0/3859708687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920102440 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 -- 172.21.15.142:0/3859708687 >> 172.21.15.142:0/3859708687 conn(0x7fc9200fc320 msgr2=0x7fc9200fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 -- 172.21.15.142:0/3859708687 shutdown_connections 2023-09-21T12:56:02.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.597+0000 7fc926fff700 1 -- 172.21.15.142:0/3859708687 wait complete. 2023-09-21T12:56:02.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 Processor -- start 2023-09-21T12:56:02.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 -- start start 2023-09-21T12:56:02.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920100df0 0x7fc920196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920102980 0x7fc92019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92019e5d0 con 0x7fc920101fe0 2023-09-21T12:56:02.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92019e710 con 0x7fc920100df0 2023-09-21T12:56:02.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc926fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92019e8a0 con 0x7fc920102980 2023-09-21T12:56:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.598+0000 7fc91ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc924d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920100df0 0x7fc920196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47466/0 (socket says 172.21.15.142:47466) 2023-09-21T12:56:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 -- 172.21.15.142:0/1568449911 learned_addr learned my addr 172.21.15.142:0/1568449911 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:02.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc92559c700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920102980 0x7fc92019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 -- 172.21.15.142:0/1568449911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920102980 msgr2=0x7fc92019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920102980 0x7fc92019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 -- 172.21.15.142:0/1568449911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920100df0 msgr2=0x7fc920196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920100df0 0x7fc920196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 -- 172.21.15.142:0/1568449911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914009520 con 0x7fc920101fe0 2023-09-21T12:56:02.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91ffff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c010 tx=0x7fc90c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:02.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c01d070 con 0x7fc920101fe0 2023-09-21T12:56:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc90c005050 con 0x7fc920101fe0 2023-09-21T12:56:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c004ad0 con 0x7fc920101fe0 2023-09-21T12:56:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.599+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90c0095f0 con 0x7fc920101fe0 2023-09-21T12:56:02.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.600+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc92019ed60 con 0x7fc920101fe0 2023-09-21T12:56:02.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.601+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc92010c600 con 0x7fc920101fe0 2023-09-21T12:56:02.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.603+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fc90c0051c0 con 0x7fc920101fe0 2023-09-21T12:56:02.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.604+0000 7fc91dffb700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 0x7fc9100a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:02.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.604+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc90c0ccde0 con 0x7fc920101fe0 2023-09-21T12:56:02.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.604+0000 7fc924d9b700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 0x7fc9100a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:02.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.605+0000 7fc924d9b700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 0x7fc9100a2bd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc920101e40 tx=0x7fc914009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:02.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.606+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc90c0969b0 con 0x7fc920101fe0 2023-09-21T12:56:02.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.812+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc92010c840 con 0x7fc920101fe0 2023-09-21T12:56:02.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.813+0000 7fc91dffb700 1 -- 172.21.15.142:0/1568449911 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7fc90c099fd0 con 0x7fc920101fe0 2023-09-21T12:56:02.813 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:02.813 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:56:02.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 msgr2=0x7fc9100a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 0x7fc9100a2bd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc920101e40 tx=0x7fc914009260 comp rx=0 tx=0).stop 2023-09-21T12:56:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 msgr2=0x7fc920196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c010 tx=0x7fc90c00f690 comp rx=0 tx=0).stop 2023-09-21T12:56:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 shutdown_connections 2023-09-21T12:56:02.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc9100a0710 0x7fc9100a2bd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc920102980 0x7fc92019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc920100df0 0x7fc920196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 --2- 172.21.15.142:0/1568449911 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc920101fe0 0x7fc920196f90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:02.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 >> 172.21.15.142:0/1568449911 conn(0x7fc9200fc320 msgr2=0x7fc9200fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:02.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 shutdown_connections 2023-09-21T12:56:02.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:02.816+0000 7fc926fff700 1 -- 172.21.15.142:0/1568449911 wait complete. 2023-09-21T12:56:02.835 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T12:56:02.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T12:56:03.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 -- 172.21.15.142:0/2154747303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c108cb0 msgr2=0x7f178c10b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 --2- 172.21.15.142:0/2154747303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c108cb0 0x7f178c10b140 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f178400b0a0 tx=0x7f178400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 -- 172.21.15.142:0/2154747303 shutdown_connections 2023-09-21T12:56:03.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 --2- 172.21.15.142:0/2154747303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c108cb0 0x7f178c10b140 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 --2- 172.21.15.142:0/2154747303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 --2- 172.21.15.142:0/2154747303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c073840 0x7f178c073cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 -- 172.21.15.142:0/2154747303 >> 172.21.15.142:0/2154747303 conn(0x7f178c0fc360 msgr2=0x7f178c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:03.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 -- 172.21.15.142:0/2154747303 shutdown_connections 2023-09-21T12:56:03.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.037+0000 7f17909ff700 1 -- 172.21.15.142:0/2154747303 wait complete. 2023-09-21T12:56:03.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.038+0000 7f17909ff700 1 Processor -- start 2023-09-21T12:56:03.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.038+0000 7f17909ff700 1 -- start start 2023-09-21T12:56:03.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c108cb0 0x7f178c1a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1a09b0 con 0x7f178c073840 2023-09-21T12:56:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1a0af0 con 0x7f178c074e20 2023-09-21T12:56:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f17909ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c1a0c80 con 0x7f178c108cb0 2023-09-21T12:56:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47484/0 (socket says 172.21.15.142:47484) 2023-09-21T12:56:03.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 -- 172.21.15.142:0/3432885664 learned_addr learned my addr 172.21.15.142:0/3432885664 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:03.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178ad9d700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c108cb0 0x7f178c1a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f1789d9b700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 -- 172.21.15.142:0/3432885664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c108cb0 msgr2=0x7f178c1a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c108cb0 0x7f178c1a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 -- 172.21.15.142:0/3432885664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 msgr2=0x7f178c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 -- 172.21.15.142:0/3432885664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784009d00 con 0x7f178c073840 2023-09-21T12:56:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f1789d9b700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.039+0000 7f178a59c700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e9a0 tx=0x7f177c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.040+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c009790 con 0x7f178c073840 2023-09-21T12:56:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.040+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f177c00cbd0 con 0x7f178c073840 2023-09-21T12:56:03.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.040+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c1a0f60 con 0x7f178c073840 2023-09-21T12:56:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.040+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c018680 con 0x7f178c073840 2023-09-21T12:56:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.040+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c1a1380 con 0x7f178c073840 2023-09-21T12:56:03.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.041+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c107360 con 0x7f178c073840 2023-09-21T12:56:03.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.043+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f177c00cd40 con 0x7f178c073840 2023-09-21T12:56:03.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.045+0000 7f177b7fe700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 0x7f17740a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.045+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f177c014070 con 0x7f178c073840 2023-09-21T12:56:03.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.045+0000 7f1789d9b700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 0x7f17740a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.046+0000 7f1789d9b700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 0x7f17740a2b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f178c074b40 tx=0x7f1780009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.049+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f177c051e10 con 0x7f178c073840 2023-09-21T12:56:03.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:02 smithi156 ceph-mon[134078]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:03.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:02 smithi142 ceph-mon[97663]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:03.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:02 smithi160 ceph-mon[134450]: from='client.15195 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.247+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f178c02cfa0 con 0x7f178c073840 2023-09-21T12:56:03.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.248+0000 7f177b7fe700 1 -- 172.21.15.142:0/3432885664 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f177c095920 con 0x7f178c073840 2023-09-21T12:56:03.248 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T12:56:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.250+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 msgr2=0x7f17740a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.250+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 0x7f17740a2b00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f178c074b40 tx=0x7f1780009260 comp rx=0 tx=0).stop 2023-09-21T12:56:03.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.250+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 msgr2=0x7f178c198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.250+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e9a0 tx=0x7f177c00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 shutdown_connections 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f17740a0640 0x7f17740a2b00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f178c073840 0x7f178c198e30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f178c108cb0 0x7f178c1a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 --2- 172.21.15.142:0/3432885664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f178c074e20 0x7f178c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 >> 172.21.15.142:0/3432885664 conn(0x7f178c0fc360 msgr2=0x7f178c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 shutdown_connections 2023-09-21T12:56:03.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.251+0000 7f17909ff700 1 -- 172.21.15.142:0/3432885664 wait complete. 2023-09-21T12:56:03.269 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T12:56:03.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 -- 172.21.15.142:0/1579854861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c073840 msgr2=0x7f5f8c073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 --2- 172.21.15.142:0/1579854861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c073840 0x7f5f8c073cc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5f80009990 tx=0x7f5f80009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 -- 172.21.15.142:0/1579854861 shutdown_connections 2023-09-21T12:56:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 --2- 172.21.15.142:0/1579854861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c10b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 --2- 172.21.15.142:0/1579854861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c074e20 0x7f5f8c073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 --2- 172.21.15.142:0/1579854861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c073840 0x7f5f8c073cc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 -- 172.21.15.142:0/1579854861 >> 172.21.15.142:0/1579854861 conn(0x7f5f8c0fc360 msgr2=0x7f5f8c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.473+0000 7f5f90bff700 1 -- 172.21.15.142:0/1579854861 shutdown_connections 2023-09-21T12:56:03.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.474+0000 7f5f90bff700 1 -- 172.21.15.142:0/1579854861 wait complete. 2023-09-21T12:56:03.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.474+0000 7f5f90bff700 1 Processor -- start 2023-09-21T12:56:03.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 -- start start 2023-09-21T12:56:03.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c074e20 0x7f5f8c199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c1a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1a0880 con 0x7f5f8c108cb0 2023-09-21T12:56:03.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1a09f0 con 0x7f5f8c074e20 2023-09-21T12:56:03.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f90bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1a0bb0 con 0x7f5f8c073840 2023-09-21T12:56:03.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f8ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c1a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f8a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53962/0 (socket says 172.21.15.142:53962) 2023-09-21T12:56:03.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f8a59c700 1 -- 172.21.15.142:0/3626713171 learned_addr learned my addr 172.21.15.142:0/3626713171 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:03.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.475+0000 7f5f89d9b700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c074e20 0x7f5f8c199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 -- 172.21.15.142:0/3626713171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c074e20 msgr2=0x7f5f8c199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c074e20 0x7f5f8c199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 -- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 msgr2=0x7f5f8c1a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c1a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 -- 172.21.15.142:0/3626713171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f800095f0 con 0x7f5f8c073840 2023-09-21T12:56:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8ad9d700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f8a59c700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e9a0 tx=0x7f5f7c00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c009790 con 0x7f5f8c073840 2023-09-21T12:56:03.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f7c010430 con 0x7f5f8c073840 2023-09-21T12:56:03.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c1a0e90 con 0x7f5f8c073840 2023-09-21T12:56:03.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c018680 con 0x7f5f8c073840 2023-09-21T12:56:03.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.476+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c1a12b0 con 0x7f5f8c073840 2023-09-21T12:56:03.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.477+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c107360 con 0x7f5f8c073840 2023-09-21T12:56:03.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.480+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f5f7c0105a0 con 0x7f5f8c073840 2023-09-21T12:56:03.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.481+0000 7f5f7b7fe700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 0x7f5f740a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.481+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5f7c014070 con 0x7f5f8c073840 2023-09-21T12:56:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.481+0000 7f5f89d9b700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 0x7f5f740a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.482+0000 7f5f89d9b700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 0x7f5f740a2b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b2e0 tx=0x7f5f80005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.483+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5f7c095a30 con 0x7f5f8c073840 2023-09-21T12:56:03.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.684+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f8c10eac0 con 0x7f5f8c073840 2023-09-21T12:56:03.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.685+0000 7f5f7b7fe700 1 -- 172.21.15.142:0/3626713171 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f7c026020 con 0x7f5f8c073840 2023-09-21T12:56:03.684 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T12:56:03.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 msgr2=0x7f5f740a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 0x7f5f740a2b00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b2e0 tx=0x7f5f80005fb0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 msgr2=0x7f5f8c198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00e9a0 tx=0x7f5f7c00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 shutdown_connections 2023-09-21T12:56:03.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f5f740a0640 0x7f5f740a2b00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5f8c108cb0 0x7f5f8c1a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f8c073840 0x7f5f8c198d40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 --2- 172.21.15.142:0/3626713171 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5f8c074e20 0x7f5f8c199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 >> 172.21.15.142:0/3626713171 conn(0x7f5f8c0fc360 msgr2=0x7f5f8c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:03.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 shutdown_connections 2023-09-21T12:56:03.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.687+0000 7f5f90bff700 1 -- 172.21.15.142:0/3626713171 wait complete. 2023-09-21T12:56:03.705 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T12:56:03.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1343566356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 msgr2=0x7f60b4109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1343566356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b4109230 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f60ac009fc0 tx=0x7f60ac00b330 comp rx=0 tx=0).stop 2023-09-21T12:56:03.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1343566356 shutdown_connections 2023-09-21T12:56:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1343566356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b4109230 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1343566356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1343566356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1343566356 >> 172.21.15.142:0/1343566356 conn(0x7f60b40fc360 msgr2=0x7f60b40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:03.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1343566356 shutdown_connections 2023-09-21T12:56:03.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.908+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1343566356 wait complete. 2023-09-21T12:56:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.909+0000 7f60ba5ff700 1 Processor -- start 2023-09-21T12:56:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.909+0000 7f60ba5ff700 1 -- start start 2023-09-21T12:56:03.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b419e770 con 0x7f60b4102980 2023-09-21T12:56:03.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b419e8e0 con 0x7f60b4100df0 2023-09-21T12:56:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60ba5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b419eaa0 con 0x7f60b4101fe0 2023-09-21T12:56:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4197170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53464/0 (socket says 172.21.15.142:53464) 2023-09-21T12:56:03.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b37fe700 1 -- 172.21.15.142:0/1222888102 learned_addr learned my addr 172.21.15.142:0/1222888102 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b3fff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 -- 172.21.15.142:0/1222888102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 msgr2=0x7f60b4197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 -- 172.21.15.142:0/1222888102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 msgr2=0x7f60b4196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:03.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 -- 172.21.15.142:0/1222888102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4009520 con 0x7f60b4102980 2023-09-21T12:56:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b3fff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.910+0000 7f60b8b9c700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b419e1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b6c0 tx=0x7f60ac0077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.911+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00e040 con 0x7f60b4102980 2023-09-21T12:56:03.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.911+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60ac004e90 con 0x7f60b4102980 2023-09-21T12:56:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.911+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a80095f0 con 0x7f60b4102980 2023-09-21T12:56:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.911+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac0052a0 con 0x7f60b4102980 2023-09-21T12:56:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.911+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac009c40 con 0x7f60b4102980 2023-09-21T12:56:03.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.912+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b4108330 con 0x7f60b4102980 2023-09-21T12:56:03.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.914+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f60ac01d470 con 0x7f60b4102980 2023-09-21T12:56:03.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.916+0000 7f60b17fa700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 0x7f609c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.916+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60ac0cd180 con 0x7f60b4102980 2023-09-21T12:56:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.916+0000 7f60b3fff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 0x7f609c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:03.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.917+0000 7f60b3fff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 0x7f609c0a2b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60b4198100 tx=0x7f60a4009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:03.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:03.920+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f60ac096cf0 con 0x7f60b4102980 2023-09-21T12:56:04.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.120+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60b402d070 con 0x7f60b4102980 2023-09-21T12:56:04.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.121+0000 7f60b17fa700 1 -- 172.21.15.142:0/1222888102 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60ac09a310 con 0x7f60b4102980 2023-09-21T12:56:04.121 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T12:56:04.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 msgr2=0x7f609c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 0x7f609c0a2b00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f60b4198100 tx=0x7f60a4009260 comp rx=0 tx=0).stop 2023-09-21T12:56:04.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 msgr2=0x7f60b419e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b419e1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f60ac00b6c0 tx=0x7f60ac0077a0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 shutdown_connections 2023-09-21T12:56:04.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.123+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f609c0a0640 0x7f609c0a2b00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f60b4102980 0x7f60b419e1a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f60b4100df0 0x7f60b4196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 --2- 172.21.15.142:0/1222888102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60b4101fe0 0x7f60b4197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 >> 172.21.15.142:0/1222888102 conn(0x7f60b40fc360 msgr2=0x7f60b4105470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:04.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 shutdown_connections 2023-09-21T12:56:04.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.124+0000 7f60ba5ff700 1 -- 172.21.15.142:0/1222888102 wait complete. 2023-09-21T12:56:04.134 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.134 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: from='client.25228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.134 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:04.135 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1568449911' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:04.135 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3432885664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.135 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3626713171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.144 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:56:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: from='client.25228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1568449911' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3432885664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3626713171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: from='client.25228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-21T12:56:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: pgmap v327: 97 pgs: 97 active+clean; 638 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1568449911' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3432885664' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3626713171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/1360197827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4102980 msgr2=0x7f8dd4109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/1360197827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4102980 0x7f8dd4109230 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00b0d0 tx=0x7f8dcc00b3e0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/1360197827 shutdown_connections 2023-09-21T12:56:04.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/1360197827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4102980 0x7f8dd4109230 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/1360197827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/1360197827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4101fe0 0x7f8dd4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/1360197827 >> 172.21.15.142:0/1360197827 conn(0x7f8dd40fc320 msgr2=0x7f8dd40fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:04.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/1360197827 shutdown_connections 2023-09-21T12:56:04.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.362+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/1360197827 wait complete. 2023-09-21T12:56:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.363+0000 7f8ddc7ff700 1 Processor -- start 2023-09-21T12:56:04.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.363+0000 7f8ddc7ff700 1 -- start start 2023-09-21T12:56:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4102980 0x7f8dd4073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4073eb0 con 0x7f8dd4101fe0 2023-09-21T12:56:04.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4074020 con 0x7f8dd4102980 2023-09-21T12:56:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddc7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41a0c00 con 0x7f8dd4100df0 2023-09-21T12:56:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48120/0 (socket says 172.21.15.142:48120) 2023-09-21T12:56:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 -- 172.21.15.142:0/3738435218 learned_addr learned my addr 172.21.15.142:0/3738435218 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:04.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dda59b700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8ddad9c700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4102980 0x7f8dd4073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 -- 172.21.15.142:0/3738435218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 msgr2=0x7f8dd4074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 -- 172.21.15.142:0/3738435218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4102980 msgr2=0x7f8dd4073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4102980 0x7f8dd4073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dd9d9a700 1 -- 172.21.15.142:0/3738435218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc009d00 con 0x7f8dd4101fe0 2023-09-21T12:56:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.364+0000 7f8dda59b700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:04.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8dd9d9a700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400e9a0 tx=0x7f8dc400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4009790 con 0x7f8dd4101fe0 2023-09-21T12:56:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dc4010430 con 0x7f8dd4101fe0 2023-09-21T12:56:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd41a0ee0 con 0x7f8dd4101fe0 2023-09-21T12:56:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4018680 con 0x7f8dd4101fe0 2023-09-21T12:56:04.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.365+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd41a13b0 con 0x7f8dd4101fe0 2023-09-21T12:56:04.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.366+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd410c660 con 0x7f8dd4101fe0 2023-09-21T12:56:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.368+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f8dc40105a0 con 0x7f8dd4101fe0 2023-09-21T12:56:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.369+0000 7f8dcb7fe700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 0x7f8dc00a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.369+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8dc4014070 con 0x7f8dd4101fe0 2023-09-21T12:56:04.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.369+0000 7f8dda59b700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 0x7f8dc00a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.370+0000 7f8dda59b700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 0x7f8dc00a2bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4101e40 tx=0x7f8dd0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:04.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.373+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8dc4051e10 con 0x7f8dd4101fe0 2023-09-21T12:56:04.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.625+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dd410c880 con 0x7f8dd4101fe0 2023-09-21T12:56:04.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.625+0000 7f8dcb7fe700 1 -- 172.21.15.142:0/3738435218 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f8dc4095810 con 0x7f8dd4101fe0 2023-09-21T12:56:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:04.625 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:56:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 msgr2=0x7f8dc00a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 0x7f8dc00a2bd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4101e40 tx=0x7f8dd0009260 comp rx=0 tx=0).stop 2023-09-21T12:56:04.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 msgr2=0x7f8dd40731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f8dc400e9a0 tx=0x7f8dc400ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 shutdown_connections 2023-09-21T12:56:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f8dc00a0710 0x7f8dc00a2bd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dd4102980 0x7f8dd4073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dd4100df0 0x7f8dd4074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 --2- 172.21.15.142:0/3738435218 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dd4101fe0 0x7f8dd40731d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 >> 172.21.15.142:0/3738435218 conn(0x7f8dd40fc320 msgr2=0x7f8dd40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 shutdown_connections 2023-09-21T12:56:04.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.628+0000 7f8ddc7ff700 1 -- 172.21.15.142:0/3738435218 wait complete. 2023-09-21T12:56:04.630 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:56:04.646 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T12:56:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 -- 172.21.15.142:0/417026805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0073840 msgr2=0x7f10c0073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 --2- 172.21.15.142:0/417026805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0073840 0x7f10c0073cc0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f10ac009990 tx=0x7f10ac009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 -- 172.21.15.142:0/417026805 shutdown_connections 2023-09-21T12:56:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 --2- 172.21.15.142:0/417026805 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0108ca0 0x7f10c010b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 --2- 172.21.15.142:0/417026805 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0074e20 0x7f10c0073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 --2- 172.21.15.142:0/417026805 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0073840 0x7f10c0073cc0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 -- 172.21.15.142:0/417026805 >> 172.21.15.142:0/417026805 conn(0x7f10c00fc310 msgr2=0x7f10c00fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 -- 172.21.15.142:0/417026805 shutdown_connections 2023-09-21T12:56:04.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.846+0000 7f10c6bff700 1 -- 172.21.15.142:0/417026805 wait complete. 2023-09-21T12:56:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.847+0000 7f10c6bff700 1 Processor -- start 2023-09-21T12:56:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 -- start start 2023-09-21T12:56:04.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0073840 0x7f10c0198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 0x7f10c01991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01a07e0 con 0x7f10c0108ca0 2023-09-21T12:56:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01a0950 con 0x7f10c0074e20 2023-09-21T12:56:04.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c6bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c01a0b10 con 0x7f10c0073840 2023-09-21T12:56:04.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c519c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10bffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 0x7f10c01991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c519c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48140/0 (socket says 172.21.15.142:48140) 2023-09-21T12:56:04.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c519c700 1 -- 172.21.15.142:0/1717851787 learned_addr learned my addr 172.21.15.142:0/1717851787 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:04.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.848+0000 7f10c499b700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0073840 0x7f10c0198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 -- 172.21.15.142:0/1717851787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0073840 msgr2=0x7f10c0198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0073840 0x7f10c0198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 -- 172.21.15.142:0/1717851787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 msgr2=0x7f10c01991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:04.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 0x7f10c01991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:04.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 -- 172.21.15.142:0/1717851787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0095f0 con 0x7f10c0108ca0 2023-09-21T12:56:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10bffff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 0x7f10c01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c519c700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007ee0 tx=0x7f10b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8017070 con 0x7f10c0108ca0 2023-09-21T12:56:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10b800f040 con 0x7f10c0108ca0 2023-09-21T12:56:04.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c01a0df0 con 0x7f10c0108ca0 2023-09-21T12:56:04.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8005580 con 0x7f10c0108ca0 2023-09-21T12:56:04.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.849+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c01a12d0 con 0x7f10c0108ca0 2023-09-21T12:56:04.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.850+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10c0107350 con 0x7f10c0108ca0 2023-09-21T12:56:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.852+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f10b800db20 con 0x7f10c0108ca0 2023-09-21T12:56:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.853+0000 7f10bdffb700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 0x7f10b00a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:04.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.854+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f10b80cb9d0 con 0x7f10c0108ca0 2023-09-21T12:56:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.854+0000 7f10c499b700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 0x7f10b00a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.854+0000 7f10c499b700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 0x7f10b00a2c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f10c0199b40 tx=0x7f10b400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:04.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:04.856+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f10b80954b0 con 0x7f10c0108ca0 2023-09-21T12:56:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1222888102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:04.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3738435218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:05.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.057+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10c010e9e0 con 0x7f10c0108ca0 2023-09-21T12:56:05.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.059+0000 7f10bdffb700 1 -- 172.21.15.142:0/1717851787 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22601 (secure 0 0 0) 0x7f10b8098ad0 con 0x7f10c0108ca0 2023-09-21T12:56:05.059 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:05.059 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":86,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T12:54:41.553827+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T12:56:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 msgr2=0x7f10b00a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 0x7f10b00a2c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f10c0199b40 tx=0x7f10b400b410 comp rx=0 tx=0).stop 2023-09-21T12:56:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 msgr2=0x7f10c01a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f10b8007ee0 tx=0x7f10b800d3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 shutdown_connections 2023-09-21T12:56:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f10b00a0790 0x7f10b00a2c50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f10c0108ca0 0x7f10c01a0210 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f10c0073840 0x7f10c0198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 --2- 172.21.15.142:0/1717851787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f10c0074e20 0x7f10c01991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.061+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 >> 172.21.15.142:0/1717851787 conn(0x7f10c00fc310 msgr2=0x7f10c00fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.062+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 shutdown_connections 2023-09-21T12:56:05.063 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.062+0000 7f10c6bff700 1 -- 172.21.15.142:0/1717851787 wait complete. 2023-09-21T12:56:05.080 DEBUG:tasks.fwd_scrub:Yielding 2023-09-21T12:56:05.081 INFO:teuthology.run_tasks:Running task exec... 2023-09-21T12:56:05.111 INFO:teuthology.task.exec:Executing custom commands... 2023-09-21T12:56:05.112 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:56:05.112 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-09-21T12:56:05.113 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-09-21T12:56:05.113 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:56:05.114 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:56:05.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:04 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1222888102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:05.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:04 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3738435218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:05.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:04 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1222888102' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T12:56:05.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:04 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3738435218' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:05.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 -- 172.21.15.142:0/1968343392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600101f90 msgr2=0x7f2600102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 --2- 172.21.15.142:0/1968343392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600101f90 0x7f2600102410 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f25f0009990 tx=0x7f25f0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 -- 172.21.15.142:0/1968343392 shutdown_connections 2023-09-21T12:56:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 --2- 172.21.15.142:0/1968343392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600102950 0x7f2600109270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 --2- 172.21.15.142:0/1968343392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600100e40 0x7f2600101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 --2- 172.21.15.142:0/1968343392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600101f90 0x7f2600102410 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 -- 172.21.15.142:0/1968343392 >> 172.21.15.142:0/1968343392 conn(0x7f26000fc390 msgr2=0x7f26000fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 -- 172.21.15.142:0/1968343392 shutdown_connections 2023-09-21T12:56:05.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.312+0000 7f26073ff700 1 -- 172.21.15.142:0/1968343392 wait complete. 2023-09-21T12:56:05.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.313+0000 7f26073ff700 1 Processor -- start 2023-09-21T12:56:05.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 -- start start 2023-09-21T12:56:05.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600101f90 0x7f2600073710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 0x7f2600073c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001a0ba0 con 0x7f2600100e40 2023-09-21T12:56:05.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001a0ce0 con 0x7f2600101f90 2023-09-21T12:56:05.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f26073ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26001a0e20 con 0x7f2600102950 2023-09-21T12:56:05.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f260519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f260519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48154/0 (socket says 172.21.15.142:48154) 2023-09-21T12:56:05.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f260519b700 1 -- 172.21.15.142:0/521473262 learned_addr learned my addr 172.21.15.142:0/521473262 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f260499a700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600101f90 0x7f2600073710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.314+0000 7f260599c700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 0x7f2600073c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 -- 172.21.15.142:0/521473262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 msgr2=0x7f2600073c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 0x7f2600073c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 -- 172.21.15.142:0/521473262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600101f90 msgr2=0x7f2600073710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600101f90 0x7f2600073710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 -- 172.21.15.142:0/521473262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f00095f0 con 0x7f2600100e40 2023-09-21T12:56:05.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260599c700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 0x7f2600073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:56:05.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f260519b700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e9a0 tx=0x7f25fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc009790 con 0x7f2600100e40 2023-09-21T12:56:05.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25fc00cbd0 con 0x7f2600100e40 2023-09-21T12:56:05.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26001a10b0 con 0x7f2600100e40 2023-09-21T12:56:05.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc018680 con 0x7f2600100e40 2023-09-21T12:56:05.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.315+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26001a15c0 con 0x7f2600100e40 2023-09-21T12:56:05.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.316+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260004ebc0 con 0x7f2600100e40 2023-09-21T12:56:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.318+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f25fc00cd40 con 0x7f2600100e40 2023-09-21T12:56:05.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.320+0000 7f25f67fc700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 0x7f25ec0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.320+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25fc014070 con 0x7f2600100e40 2023-09-21T12:56:05.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.320+0000 7f260499a700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 0x7f25ec0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.321+0000 7f260499a700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 0x7f25ec0a2b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f25f000b620 tx=0x7f25f0005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f25fc051e10 con 0x7f2600100e40 2023-09-21T12:56:05.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 -- 172.21.15.142:0/4064398981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c70100c60 msgr2=0x7f6c70101080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/4064398981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c70100c60 0x7f6c70101080 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6c600099c0 tx=0x7f6c60009cd0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 -- 172.21.15.142:0/4064398981 shutdown_connections 2023-09-21T12:56:05.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/4064398981 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c70100c60 0x7f6c70101080 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/4064398981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c701027f0 0x7f6c701090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/4064398981 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c701022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.324+0000 7f6c6ffff700 1 -- 172.21.15.142:0/4064398981 >> 172.21.15.142:0/4064398981 conn(0x7f6c700fc1f0 msgr2=0x7f6c700fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.325+0000 7f6c6ffff700 1 -- 172.21.15.142:0/4064398981 shutdown_connections 2023-09-21T12:56:05.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.325+0000 7f6c6ffff700 1 -- 172.21.15.142:0/4064398981 wait complete. 2023-09-21T12:56:05.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.325+0000 7f6c6ffff700 1 Processor -- start 2023-09-21T12:56:05.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 -- start start 2023-09-21T12:56:05.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 0x7f6c70196870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019e3f0 con 0x7f6c701027f0 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019e530 con 0x7f6c70101e50 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6ffff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019e6c0 con 0x7f6c70100c60 2023-09-21T12:56:05.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38572/0 (socket says 172.21.15.142:38572) 2023-09-21T12:56:05.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48178/0 (socket says 172.21.15.142:48178) 2023-09-21T12:56:05.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/646078544 learned_addr learned my addr 172.21.15.142:0/646078544 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.326+0000 7f6c6effd700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 0x7f6c70196870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/646078544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 msgr2=0x7f6c70196870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 0x7f6c70196870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 msgr2=0x7f6c7019de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/646078544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009520 con 0x7f6c70101e50 2023-09-21T12:56:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6effd700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 0x7f6c70196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6f7fe700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:05.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400eb30 tx=0x7f6c6400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c749fd700 1 -- 172.21.15.142:0/646078544 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64009880 con 0x7f6c70101e50 2023-09-21T12:56:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c600095f0 con 0x7f6c70101e50 2023-09-21T12:56:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c749fd700 1 -- 172.21.15.142:0/646078544 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c640044e0 con 0x7f6c70101e50 2023-09-21T12:56:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c749fd700 1 -- 172.21.15.142:0/646078544 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64003e90 con 0x7f6c70101e50 2023-09-21T12:56:05.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.327+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7019ed70 con 0x7f6c70101e50 2023-09-21T12:56:05.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.332+0000 7f6c749fd700 1 -- 172.21.15.142:0/646078544 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7f6c64004000 con 0x7f6c70101e50 2023-09-21T12:56:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 Processor -- start 2023-09-21T12:56:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 -- start start 2023-09-21T12:56:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd12d80 0x5563abd131a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd13c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abc82d20 con 0x5563abd12d80 2023-09-21T12:56:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abc66cf0 con 0x5563abd136e0 2023-09-21T12:56:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.333+0000 7f6c89369b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abc64610 con 0x5563abd141f0 2023-09-21T12:56:05.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c749fd700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 0x7f6c580a2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53560/0 (socket says 172.21.15.142:53560) 2023-09-21T12:56:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3924099519 learned_addr learned my addr 172.21.15.142:0/3924099519 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6f7fe700 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd12d80 0x5563abd131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd13c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6f7fe700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 0x7f6c580a2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c749fd700 1 -- 172.21.15.142:0/646078544 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c64014070 con 0x7f6c70101e50 2023-09-21T12:56:05.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3924099519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 msgr2=0x5563abd13c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd13c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3924099519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd12d80 msgr2=0x5563abd131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd12d80 0x5563abd131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3924099519 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563aba8ae60 con 0x5563abd141f0 2023-09-21T12:56:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.334+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c64095cd0 tx=0x7f6c64003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9c44f2f8747f427 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c55ffb700 1 -- 172.21.15.142:0/3924099519 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64099ed0 con 0x5563abd141f0 2023-09-21T12:56:05.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c6f7fe700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 0x7f6c580a2ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5563abd12b20 tx=0x7f6c68009130 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c55ffb700 1 -- 172.21.15.142:0/3924099519 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c64016330 con 0x5563abd141f0 2023-09-21T12:56:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c55ffb700 1 -- 172.21.15.142:0/3924099519 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a1840 con 0x5563abd141f0 2023-09-21T12:56:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c89369b80 1 -- 172.21.15.142:0/3924099519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 msgr2=0x5563abd146a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.335+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6c64095cd0 tx=0x7f6c64003680 comp rx=0 tx=0).stop 2023-09-21T12:56:05.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 -- 172.21.15.142:0/3924099519 shutdown_connections 2023-09-21T12:56:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd12d80 0x5563abd131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd141f0 0x5563abd146a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3924099519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd13c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 -- 172.21.15.142:0/3924099519 >> 172.21.15.142:0/3924099519 conn(0x5563abc3b080 msgr2=0x5563abd09360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 -- 172.21.15.142:0/3924099519 shutdown_connections 2023-09-21T12:56:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 -- 172.21.15.142:0/3924099519 wait complete. 2023-09-21T12:56:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 -- start start 2023-09-21T12:56:05.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.336+0000 7f6c89369b80 1 Processor -- start 2023-09-21T12:56:05.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd0f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd0bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abc5ff00 con 0x5563abd141f0 2023-09-21T12:56:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abbfc7c0 con 0x5563abd136e0 2023-09-21T12:56:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abbfc460 con 0x5563abd12d80 2023-09-21T12:56:05.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c89369b80 10 client.0 _ll_register_callbacks cb 0x5563abb46b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:05.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd0bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38588/0 (socket says 172.21.15.142:38588) 2023-09-21T12:56:05.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3867393430 learned_addr learned my addr 172.21.15.142:0/3867393430 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd0f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3867393430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 msgr2=0x5563abd0f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.337+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd0f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3867393430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 msgr2=0x5563abd0bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd0bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c6e7fc700 1 -- 172.21.15.142:0/3867393430 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7019ed70 con 0x5563abd136e0 2023-09-21T12:56:05.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd0f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:05.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c64099760 tx=0x7f6c6400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=273e797e503b43f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c4effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:56:05.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400cc90 con 0x5563abd136e0 2023-09-21T12:56:05.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5563abbd0c30 con 0x5563abd136e0 2023-09-21T12:56:05.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c640a1840 con 0x5563abd136e0 2023-09-21T12:56:05.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c640042b0 con 0x5563abd136e0 2023-09-21T12:56:05.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c89369b80 10 client.25313 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:05.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5563aba73ce0 con 0x5563abd136e0 2023-09-21T12:56:05.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.338+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c6407c080 con 0x5563abd136e0 2023-09-21T12:56:05.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c6409d160 con 0x5563abd136e0 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 10 client.25313 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 10 client.25313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 20 client.25313 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd2c540 0x5563abd2e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 4 client.25313 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:05.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563abcdd0a0 con 0x5563abd2c540 2023-09-21T12:56:05.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.339+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd2c540 0x5563abd2e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.340+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd2c540 0x5563abd2e930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb9637f2184d5b3 server_cookie=65e338b7b9b5fc4c in_seq=0 out_seq=0 2023-09-21T12:56:05.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.340+0000 7f6c4effd700 10 client.25313 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.340+0000 7f6c4effd700 1 -- 172.21.15.142:0/3867393430 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5563abcdd0a0 con 0x5563abd2c540 2023-09-21T12:56:05.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.340+0000 7f6c4effd700 10 client.25313 handle_command_reply: tid=0 2023-09-21T12:56:05.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.340+0000 7f6c89369b80 1 client.25313 shutdown 2023-09-21T12:56:05.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 msgr2=0x5563abd0f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6c64099760 tx=0x7f6c6400c6e0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 shutdown_connections 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd2c540 0x5563abd2e930 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd0bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd0f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3867393430 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd0f540 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c4effd700 0 client.25313 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 >> 172.21.15.142:0/3867393430 conn(0x5563abc3b080 msgr2=0x5563abd08b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 shutdown_connections 2023-09-21T12:56:05.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 1 -- 172.21.15.142:0/3867393430 wait complete. 2023-09-21T12:56:05.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.341+0000 7f6c89369b80 20 client.25313 trim_cache size 0 max 16384 2023-09-21T12:56:05.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 Processor -- start 2023-09-21T12:56:05.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 -- start start 2023-09-21T12:56:05.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd055b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd1b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abae09a0 con 0x5563abd141f0 2023-09-21T12:56:05.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abd1bc60 con 0x5563abd136e0 2023-09-21T12:56:05.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c89369b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abd0ade0 con 0x5563abd12d80 2023-09-21T12:56:05.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48190/0 (socket says 172.21.15.142:48190) 2023-09-21T12:56:05.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c6f7fe700 1 -- 172.21.15.142:0/3619072813 learned_addr learned my addr 172.21.15.142:0/3619072813 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c6e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd1b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.359+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd055b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 -- 172.21.15.142:0/3619072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 msgr2=0x5563abd1b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd1b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 -- 172.21.15.142:0/3619072813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 msgr2=0x5563abd1a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 -- 172.21.15.142:0/3619072813 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563abab12d0 con 0x5563abd12d80 2023-09-21T12:56:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6f7fe700 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c6effd700 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd055b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098e0 tx=0x7f6c60009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fd10a9e2adc8f9b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c567fc700 1 -- 172.21.15.142:0/3619072813 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60029070 con 0x5563abd12d80 2023-09-21T12:56:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c567fc700 1 -- 172.21.15.142:0/3619072813 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c60003c90 con 0x5563abd12d80 2023-09-21T12:56:05.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.360+0000 7f6c567fc700 1 -- 172.21.15.142:0/3619072813 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6001d040 con 0x5563abd12d80 2023-09-21T12:56:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 -- 172.21.15.142:0/3619072813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 msgr2=0x5563abd055b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd055b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c600098e0 tx=0x7f6c60009290 comp rx=0 tx=0).stop 2023-09-21T12:56:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 -- 172.21.15.142:0/3619072813 shutdown_connections 2023-09-21T12:56:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd1a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd055b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 --2- 172.21.15.142:0/3619072813 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd1b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 -- 172.21.15.142:0/3619072813 >> 172.21.15.142:0/3619072813 conn(0x5563abc3b080 msgr2=0x5563abd332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 -- 172.21.15.142:0/3619072813 shutdown_connections 2023-09-21T12:56:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.361+0000 7f6c89369b80 1 -- 172.21.15.142:0/3619072813 wait complete. 2023-09-21T12:56:05.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 -- start start 2023-09-21T12:56:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 Processor -- start 2023-09-21T12:56:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd78ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd79020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd80060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abd805a0 con 0x5563abd141f0 2023-09-21T12:56:05.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abd806e0 con 0x5563abd136e0 2023-09-21T12:56:05.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563abd80870 con 0x5563abd12d80 2023-09-21T12:56:05.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.362+0000 7f6c89369b80 10 client.0 _ll_register_callbacks cb 0x5563abb46b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:05.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd80060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd78ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd80060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48194/0 (socket says 172.21.15.142:48194) 2023-09-21T12:56:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6f7fe700 1 -- 172.21.15.142:0/1914973339 learned_addr learned my addr 172.21.15.142:0/1914973339 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd79020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 -- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 msgr2=0x5563abd79020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd79020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 -- 172.21.15.142:0/1914973339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 msgr2=0x5563abd80060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd80060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 -- 172.21.15.142:0/1914973339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c68011040 con 0x5563abd12d80 2023-09-21T12:56:05.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c6effd700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd78ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5563abd03d40 tx=0x7f6c60003e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90d20b2d58a29d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c4effd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:05.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60029040 con 0x5563abd12d80 2023-09-21T12:56:05.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.363+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c64016330 con 0x5563abd12d80 2023-09-21T12:56:05.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6c600055d0 con 0x5563abd12d80 2023-09-21T12:56:05.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c6001d040 con 0x5563abd12d80 2023-09-21T12:56:05.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 10 client.25285 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:05.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f6c701099f0 con 0x5563abd12d80 2023-09-21T12:56:05.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c64016330 con 0x5563abd12d80 2023-09-21T12:56:05.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c60035020 con 0x5563abd12d80 2023-09-21T12:56:05.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 10 client.25285 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:05.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 10 client.25285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:05.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 20 client.25285 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:05.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd81da0 0x5563abd84190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 4 client.25285 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:56:05.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.364+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5563abc58ee0 con 0x5563abd81da0 2023-09-21T12:56:05.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.365+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd81da0 0x5563abd84190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.365+0000 7f6c6e7fc700 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd81da0 0x5563abd84190 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55dda5f3bdff3335 server_cookie=24d20da421b38679 in_seq=0 out_seq=0 2023-09-21T12:56:05.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.365+0000 7f6c4effd700 10 client.25285 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.366+0000 7f6c4effd700 1 -- 172.21.15.142:0/1914973339 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5563abc58ee0 con 0x5563abd81da0 2023-09-21T12:56:05.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.366+0000 7f6c4effd700 10 client.25285 handle_command_reply: tid=0 2023-09-21T12:56:05.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.366+0000 7f6c89369b80 1 client.25285 shutdown 2023-09-21T12:56:05.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.366+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 msgr2=0x5563abd78ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.366+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd78ae0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x5563abd03d40 tx=0x7f6c60003e80 comp rx=0 tx=0).stop 2023-09-21T12:56:05.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 shutdown_connections 2023-09-21T12:56:05.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5563abd81da0 0x5563abd84190 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5563abd141f0 0x5563abd80060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5563abd12d80 0x5563abd78ae0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 --2- 172.21.15.142:0/1914973339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5563abd136e0 0x5563abd79020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c4effd700 0 client.25285 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 >> 172.21.15.142:0/1914973339 conn(0x5563abc3b080 msgr2=0x5563abd1b410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 shutdown_connections 2023-09-21T12:56:05.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 1 -- 172.21.15.142:0/1914973339 wait complete. 2023-09-21T12:56:05.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c89369b80 20 client.25285 trim_cache size 0 max 16384 2023-09-21T12:56:05.380 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:56:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:56:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "dba22527-994c-4e6e-b469-b7f76a3b6c0e", 2023-09-21T12:56:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:56:05.381 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:56:05.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 msgr2=0x7f6c580a2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 0x7f6c580a2ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x5563abd12b20 tx=0x7f6c68009130 comp rx=0 tx=0).stop 2023-09-21T12:56:05.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 msgr2=0x7f6c70196db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.367+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400eb30 tx=0x7f6c6400ee40 comp rx=0 tx=0).stop 2023-09-21T12:56:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 shutdown_connections 2023-09-21T12:56:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f6c580a06e0 0x7f6c580a2ba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6c701027f0 0x7f6c7019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c70100c60 0x7f6c70196870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 --2- 172.21.15.142:0/646078544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6c70101e50 0x7f6c70196db0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 >> 172.21.15.142:0/646078544 conn(0x7f6c700fc1f0 msgr2=0x7f6c701052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 shutdown_connections 2023-09-21T12:56:05.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.368+0000 7f6c6ffff700 1 -- 172.21.15.142:0/646078544 wait complete. 2023-09-21T12:56:05.385 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:56:05.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 -- 172.21.15.142:0/795322829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 msgr2=0x7fc050073210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 --2- 172.21.15.142:0/795322829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050073210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc040009990 tx=0x7fc040009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 -- 172.21.15.142:0/795322829 shutdown_connections 2023-09-21T12:56:05.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 --2- 172.21.15.142:0/795322829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc05010b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 --2- 172.21.15.142:0/795322829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050073210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 --2- 172.21.15.142:0/795322829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.588+0000 7fc054dff700 1 -- 172.21.15.142:0/795322829 >> 172.21.15.142:0/795322829 conn(0x7fc0500fc360 msgr2=0x7fc0500fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.589+0000 7fc054dff700 1 -- 172.21.15.142:0/795322829 shutdown_connections 2023-09-21T12:56:05.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.589+0000 7fc054dff700 1 -- 172.21.15.142:0/795322829 wait complete. 2023-09-21T12:56:05.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.589+0000 7fc054dff700 1 Processor -- start 2023-09-21T12:56:05.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 -- start start 2023-09-21T12:56:05.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0501a0860 con 0x7fc050108ce0 2023-09-21T12:56:05.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0501a09d0 con 0x7fc050074dc0 2023-09-21T12:56:05.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc054dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0501a0b90 con 0x7fc0500737e0 2023-09-21T12:56:05.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48214/0 (socket says 172.21.15.142:48214) 2023-09-21T12:56:05.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.590+0000 7fc04ed9d700 1 -- 172.21.15.142:0/2144090066 learned_addr learned my addr 172.21.15.142:0/2144090066 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 -- 172.21.15.142:0/2144090066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 msgr2=0x7fc050198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 -- 172.21.15.142:0/2144090066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 msgr2=0x7fc050199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 -- 172.21.15.142:0/2144090066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0400095f0 con 0x7fc050108ce0 2023-09-21T12:56:05.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:05.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:05.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc04800ef30 tx=0x7fc04800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc03f7fe700 1 -- 172.21.15.142:0/2144090066 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048018070 con 0x7fc050108ce0 2023-09-21T12:56:05.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc03f7fe700 1 -- 172.21.15.142:0/2144090066 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc04800f040 con 0x7fc050108ce0 2023-09-21T12:56:05.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc03f7fe700 1 -- 172.21.15.142:0/2144090066 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800cd00 con 0x7fc050108ce0 2023-09-21T12:56:05.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0501a0e10 con 0x7fc050108ce0 2023-09-21T12:56:05.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.591+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501a11e0 con 0x7fc050108ce0 2023-09-21T12:56:05.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.594+0000 7fc03f7fe700 1 -- 172.21.15.142:0/2144090066 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 18) v1 ==== 135260+0+0 (secure 0 0 0) 0x7fc048003a00 con 0x7fc050108ce0 2023-09-21T12:56:05.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 Processor -- start 2023-09-21T12:56:05.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc03f7fe700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 0x7fc0380a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc03f7fe700 1 -- 172.21.15.142:0/2144090066 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc0480cb690 con 0x7fc050108ce0 2023-09-21T12:56:05.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 -- start start 2023-09-21T12:56:05.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 0x7fc0380a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 0x55df91d34b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d355e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91ca8ca0 con 0x55df91d35be0 2023-09-21T12:56:05.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91c8cc70 con 0x55df91d35050 2023-09-21T12:56:05.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.596+0000 7fc068728b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91c8a590 con 0x55df91d346f0 2023-09-21T12:56:05.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 0x55df91d34b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48224/0 (socket says 172.21.15.142:48224) 2023-09-21T12:56:05.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 -- 172.21.15.142:0/3924190978 learned_addr learned my addr 172.21.15.142:0/3924190978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04e59c700 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 0x55df91d34b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53622/0 (socket says 172.21.15.142:53622) 2023-09-21T12:56:05.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d355e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 0x7fc0380a2b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b2e0 tx=0x7fc040005fb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 -- 172.21.15.142:0/3924190978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 msgr2=0x55df91d34b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 0x55df91d34b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 -- 172.21.15.142:0/3924190978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 msgr2=0x55df91d355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d355e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 -- 172.21.15.142:0/3924190978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df91ab0de0 con 0x55df91d35be0 2023-09-21T12:56:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c10 tx=0x7fc048095160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3545af0e0ef1656 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc03cff9700 1 -- 172.21.15.142:0/3924190978 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048098a00 con 0x55df91d35be0 2023-09-21T12:56:05.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.597+0000 7fc03cff9700 1 -- 172.21.15.142:0/3924190978 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc048098820 con 0x55df91d35be0 2023-09-21T12:56:05.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc03cff9700 1 -- 172.21.15.142:0/3924190978 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048098ec0 con 0x55df91d35be0 2023-09-21T12:56:05.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 -- 172.21.15.142:0/3924190978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 msgr2=0x55df91d36060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c10 tx=0x7fc048095160 comp rx=0 tx=0).stop 2023-09-21T12:56:05.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 -- 172.21.15.142:0/3924190978 shutdown_connections 2023-09-21T12:56:05.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d36060 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d346f0 0x55df91d34b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 --2- 172.21.15.142:0/3924190978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d355e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 -- 172.21.15.142:0/3924190978 >> 172.21.15.142:0/3924190978 conn(0x55df91c61000 msgr2=0x55df91d2f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 -- 172.21.15.142:0/3924190978 shutdown_connections 2023-09-21T12:56:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.598+0000 7fc068728b80 1 -- 172.21.15.142:0/3924190978 wait complete. 2023-09-21T12:56:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.599+0000 7fc068728b80 1 -- start start 2023-09-21T12:56:05.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.599+0000 7fc068728b80 1 Processor -- start 2023-09-21T12:56:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d3e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 0x55df91d45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91c85e80 con 0x55df91d346f0 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91c22740 con 0x55df91d35050 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91c223e0 con 0x55df91d35be0 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc068728b80 10 client.0 _ll_register_callbacks cb 0x55df91b6ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:05.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48226/0 (socket says 172.21.15.142:48226) 2023-09-21T12:56:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 -- 172.21.15.142:0/2714658261 learned_addr learned my addr 172.21.15.142:0/2714658261 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 0x55df91d45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d3e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 -- 172.21.15.142:0/2714658261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 msgr2=0x55df91d45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 0x55df91d45760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 -- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 msgr2=0x55df91d3e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d3e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04e59c700 1 -- 172.21.15.142:0/2714658261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0501a11e0 con 0x55df91d346f0 2023-09-21T12:56:05.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.600+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 0x55df91d45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc04e59c700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc040009990 tx=0x7fc040009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a457b427e28cffae server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc035ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040024a00 con 0x55df91d346f0 2023-09-21T12:56:05.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df91bf6bb0 con 0x55df91d346f0 2023-09-21T12:56:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc040024b60 con 0x55df91d346f0 2023-09-21T12:56:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc040024d60 con 0x55df91d346f0 2023-09-21T12:56:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc068728b80 10 client.15279 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55df91a99c60 con 0x55df91d346f0 2023-09-21T12:56:05.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.601+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55df91bf6bb0 con 0x55df91d346f0 2023-09-21T12:56:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc0400173f0 con 0x55df91d346f0 2023-09-21T12:56:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 10 client.15279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 20 client.15279 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:05.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d49f80 0x55df91d4c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 4 client.15279 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:05.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df91d03020 con 0x55df91d49f80 2023-09-21T12:56:05.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.602+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d49f80 0x55df91d4c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.603+0000 7fc035ffb700 10 client.15279 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.603+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d49f80 0x55df91d4c3a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d8279f8ac5e3fe server_cookie=38c17b25e9f2c880 in_seq=0 out_seq=0 2023-09-21T12:56:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.603+0000 7fc035ffb700 1 -- 172.21.15.142:0/2714658261 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55df91d03020 con 0x55df91d49f80 2023-09-21T12:56:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.603+0000 7fc035ffb700 10 client.15279 handle_command_reply: tid=0 2023-09-21T12:56:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 client.15279 shutdown 2023-09-21T12:56:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 msgr2=0x55df91d3e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc040009990 tx=0x7fc040009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 shutdown_connections 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d49f80 0x55df91d4c3a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d3e1e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35be0 0x55df91d45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc035ffb700 0 client.15279 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 --2- 172.21.15.142:0/2714658261 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35050 0x55df91d3e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 >> 172.21.15.142:0/2714658261 conn(0x55df91c61000 msgr2=0x55df91d2e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 shutdown_connections 2023-09-21T12:56:05.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 1 -- 172.21.15.142:0/2714658261 wait complete. 2023-09-21T12:56:05.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.604+0000 7fc068728b80 20 client.15279 trim_cache size 0 max 16384 2023-09-21T12:56:05.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.611+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f2600107d30 con 0x7f2600100e40 2023-09-21T12:56:05.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.621+0000 7fc068728b80 1 Processor -- start 2023-09-21T12:56:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.621+0000 7fc068728b80 1 -- start start 2023-09-21T12:56:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d45720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35be0 0x55df91d3ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91b06920 con 0x55df91d346f0 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91d35430 con 0x55df91d35be0 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc068728b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91d2fe50 con 0x55df91d35050 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48234/0 (socket says 172.21.15.142:48234) 2023-09-21T12:56:05.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 -- 172.21.15.142:0/1423945629 learned_addr learned my addr 172.21.15.142:0/1423945629 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04ed9d700 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35be0 0x55df91d3ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d45720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 -- 172.21.15.142:0/1423945629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 msgr2=0x55df91d45720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d45720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 -- 172.21.15.142:0/1423945629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35be0 msgr2=0x55df91d3ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35be0 0x55df91d3ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.622+0000 7fc04e59c700 1 -- 172.21.15.142:0/1423945629 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df91ad7250 con 0x55df91d346f0 2023-09-21T12:56:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.623+0000 7fc04e59c700 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b680 tx=0x7fc040009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd4c96eee987279 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.623+0000 7fc03d7fa700 1 -- 172.21.15.142:0/1423945629 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0400173f0 con 0x55df91d346f0 2023-09-21T12:56:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.623+0000 7fc03d7fa700 1 -- 172.21.15.142:0/1423945629 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc04001e040 con 0x55df91d346f0 2023-09-21T12:56:05.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.623+0000 7fc03d7fa700 1 -- 172.21.15.142:0/1423945629 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04003c740 con 0x55df91d346f0 2023-09-21T12:56:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- 172.21.15.142:0/1423945629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 msgr2=0x55df91d2efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b680 tx=0x7fc040009310 comp rx=0 tx=0).stop 2023-09-21T12:56:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- 172.21.15.142:0/1423945629 shutdown_connections 2023-09-21T12:56:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d346f0 0x55df91d2efb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d35be0 0x55df91d3ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 --2- 172.21.15.142:0/1423945629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d45720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- 172.21.15.142:0/1423945629 >> 172.21.15.142:0/1423945629 conn(0x55df91c61000 msgr2=0x55df91d46050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- 172.21.15.142:0/1423945629 shutdown_connections 2023-09-21T12:56:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- 172.21.15.142:0/1423945629 wait complete. 2023-09-21T12:56:05.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 -- start start 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.624+0000 7fc068728b80 1 Processor -- start 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d43b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d44ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91d450e0 con 0x55df91d35be0 2023-09-21T12:56:05.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91d45250 con 0x55df91d346f0 2023-09-21T12:56:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df91d45410 con 0x55df91d35050 2023-09-21T12:56:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc068728b80 10 client.0 _ll_register_callbacks cb 0x55df91b6ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d44ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04dd9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d43b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38648/0 (socket says 172.21.15.142:38648) 2023-09-21T12:56:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 -- 172.21.15.142:0/3123889532 learned_addr learned my addr 172.21.15.142:0/3123889532 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 -- 172.21.15.142:0/3123889532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 msgr2=0x55df91d43b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d43b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 -- 172.21.15.142:0/3123889532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 msgr2=0x55df91d44ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d44ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.625+0000 7fc04e59c700 1 -- 172.21.15.142:0/3123889532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df91a99c60 con 0x55df91d346f0 2023-09-21T12:56:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc04e59c700 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098e0 tx=0x7fc040017ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1296c6d807565728 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc035ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:56:05.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040024a00 con 0x55df91d346f0 2023-09-21T12:56:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc048098820 con 0x55df91d346f0 2023-09-21T12:56:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc040024b60 con 0x55df91d346f0 2023-09-21T12:56:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc040024d20 con 0x55df91d346f0 2023-09-21T12:56:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc068728b80 10 client.25337 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:05.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55df91aaf2b0 con 0x55df91d346f0 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.626+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc048098820 con 0x55df91d346f0 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc040042020 con 0x55df91d346f0 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 10 client.25337 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 10 client.25337 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 20 client.25337 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:05.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d9ea80 0x55df91da0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 4 client.25337 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:56:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df91c7ee60 con 0x55df91d9ea80 2023-09-21T12:56:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d9ea80 0x55df91da0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc035ffb700 10 client.25337 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.627+0000 7fc04dd9b700 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d9ea80 0x55df91da0ea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6afc1707eca9764c server_cookie=ee8325a78e315fb5 in_seq=0 out_seq=0 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc035ffb700 1 -- 172.21.15.142:0/3123889532 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55df91c7ee60 con 0x55df91d9ea80 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc035ffb700 10 client.25337 handle_command_reply: tid=0 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 client.25337 shutdown 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 msgr2=0x55df91d43650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc0400098e0 tx=0x7fc040017ba0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 shutdown_connections 2023-09-21T12:56:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df91d9ea80 0x55df91da0ea0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df91d35be0 0x55df91d44ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc035ffb700 0 client.25337 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df91d346f0 0x55df91d43650 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 --2- 172.21.15.142:0/3123889532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df91d35050 0x55df91d43b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 >> 172.21.15.142:0/3123889532 conn(0x55df91c61000 msgr2=0x55df91d2ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 shutdown_connections 2023-09-21T12:56:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 1 -- 172.21.15.142:0/3123889532 wait complete. 2023-09-21T12:56:05.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc068728b80 20 client.25337 trim_cache size 0 max 16384 2023-09-21T12:56:05.662 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:56:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:56:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:56:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "dba22527-994c-4e6e-b469-b7f76a3b6c0e": { 2023-09-21T12:56:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:56:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "dba22527-994c-4e6e-b469-b7f76a3b6c0e", 2023-09-21T12:56:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:56:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:56:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:56:05.663 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:56:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 msgr2=0x7fc0380a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.628+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 0x7fc0380a2b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc04000b2e0 tx=0x7fc040005fb0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 msgr2=0x7fc0501a0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc04800ef30 tx=0x7fc04800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 shutdown_connections 2023-09-21T12:56:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fc0380a06c0 0x7fc0380a2b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc050108ce0 0x7fc0501a0290 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0500737e0 0x7fc050198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 --2- 172.21.15.142:0/2144090066 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc050074dc0 0x7fc050199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 >> 172.21.15.142:0/2144090066 conn(0x7fc0500fc360 msgr2=0x7fc0500fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 shutdown_connections 2023-09-21T12:56:05.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.629+0000 7fc054dff700 1 -- 172.21.15.142:0/2144090066 wait complete. 2023-09-21T12:56:05.667 INFO:tasks.cephfs.filesystem:scrub status for tag:dba22527-994c-4e6e-b469-b7f76a3b6c0e - {'path': '/', 'tag': 'dba22527-994c-4e6e-b469-b7f76a3b6c0e', 'options': 'recursive,force'} 2023-09-21T12:56:05.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.806+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mgrmap(e 19) v1 ==== 135277+0+0 (secure 0 0 0) 0x7f25fc095d60 con 0x7f2600100e40 2023-09-21T12:56:05.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.807+0000 7f25f67fc700 1 -- 172.21.15.142:0/521473262 <== mon.0 v2:172.21.15.142:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f25fc065670 con 0x7f2600100e40 2023-09-21T12:56:05.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 msgr2=0x7f25ec0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 0x7f25ec0a2b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f25f000b620 tx=0x7f25f0005fb0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 msgr2=0x7f26000731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:05.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e9a0 tx=0x7f25fc00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 shutdown_connections 2023-09-21T12:56:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f25ec0a0640 0x7f25ec0a2b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2600100e40 0x7f26000731d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2600102950 0x7f2600073c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 --2- 172.21.15.142:0/521473262 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2600101f90 0x7f2600073710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:05.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.810+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 >> 172.21.15.142:0/521473262 conn(0x7f26000fc390 msgr2=0x7f26000fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.811+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 shutdown_connections 2023-09-21T12:56:05.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:05.811+0000 7f26073ff700 1 -- 172.21.15.142:0/521473262 wait complete. 2023-09-21T12:56:05.830 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-09-21T12:56:05.900 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2023-09-21T12:56:05.900 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1717851787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:05.900 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:56:05.901 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:05.901 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:56:05.901 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:05.901 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-21T12:56:06.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 -- 172.21.15.142:0/1748418925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa60073840 msgr2=0x7ffa60073cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 --2- 172.21.15.142:0/1748418925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa60073840 0x7ffa60073cc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa500098f0 tx=0x7ffa50009c00 comp rx=0 tx=0).stop 2023-09-21T12:56:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 -- 172.21.15.142:0/1748418925 shutdown_connections 2023-09-21T12:56:06.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 --2- 172.21.15.142:0/1748418925 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa6010d3c0 0x7ffa6010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 --2- 172.21.15.142:0/1748418925 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60074e20 0x7ffa60073270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 --2- 172.21.15.142:0/1748418925 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa60073840 0x7ffa60073cc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 -- 172.21.15.142:0/1748418925 >> 172.21.15.142:0/1748418925 conn(0x7ffa600fc320 msgr2=0x7ffa600fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 -- 172.21.15.142:0/1748418925 shutdown_connections 2023-09-21T12:56:06.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.038+0000 7ffa675ff700 1 -- 172.21.15.142:0/1748418925 wait complete. 2023-09-21T12:56:06.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.039+0000 7ffa675ff700 1 Processor -- start 2023-09-21T12:56:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 -- start start 2023-09-21T12:56:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa60074e20 0x7ffa6019d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa6010d3c0 0x7ffa6019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6019ece0 con 0x7ffa60074e20 2023-09-21T12:56:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6019ee50 con 0x7ffa60073840 2023-09-21T12:56:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa675ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6019f010 con 0x7ffa6010d3c0 2023-09-21T12:56:06.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa6539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa6539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38682/0 (socket says 172.21.15.142:38682) 2023-09-21T12:56:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa6539b700 1 -- 172.21.15.142:0/4009956244 learned_addr learned my addr 172.21.15.142:0/4009956244 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa64b9a700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa60074e20 0x7ffa6019d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.040+0000 7ffa65b9c700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa6010d3c0 0x7ffa6019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa6010d3c0 msgr2=0x7ffa6019e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa6010d3c0 0x7ffa6019e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa60074e20 msgr2=0x7ffa6019d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa60074e20 0x7ffa6019d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 -- 172.21.15.142:0/4009956244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0095f0 con 0x7ffa60073840 2023-09-21T12:56:06.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa6539b700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00ec10 tx=0x7ffa5c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c00cc90 con 0x7ffa60073840 2023-09-21T12:56:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa50009520 con 0x7ffa60073840 2023-09-21T12:56:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa5c0044e0 con 0x7ffa60073840 2023-09-21T12:56:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c010430 con 0x7ffa60073840 2023-09-21T12:56:06.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.041+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa6019f4e0 con 0x7ffa60073840 2023-09-21T12:56:06.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.043+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa60102f10 con 0x7ffa60073840 2023-09-21T12:56:06.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.044+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 135277+0+0 (secure 0 0 0) 0x7ffa5c003fb0 con 0x7ffa60073840 2023-09-21T12:56:06.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.045+0000 7ffa567fc700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 0x7ffa4c0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.046+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ffa5c014070 con 0x7ffa60073840 2023-09-21T12:56:06.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.046+0000 7ffa64b9a700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 msgr2=0x7ffa4c0a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:06.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.046+0000 7ffa64b9a700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 0x7ffa4c0a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:56:06.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.049+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ffa5c095ca0 con 0x7ffa60073840 2023-09-21T12:56:06.060 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: ignoring --setuser ceph since I am not root 2023-09-21T12:56:06.061 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: ignoring --setgroup ceph since I am not root 2023-09-21T12:56:06.061 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mgr[135578]: -- 172.21.15.156:0/3299514813 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f7db9131e0 con 0x55f7db8e8c00 2023-09-21T12:56:06.061 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:05.980+0000 7f31f0689200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:56:06.061 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2023-09-21T12:56:06.062 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1717851787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:06.062 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:56:06.062 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:06.062 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:56:06.062 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:06.063 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:05 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-21T12:56:06.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 853 B/s wr, 7 op/s 2023-09-21T12:56:06.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1717851787' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T12:56:06.149 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:56:06.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:06.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:56:06.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:06.150 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-09-21T12:56:06.151 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: ignoring --setuser ceph since I am not root 2023-09-21T12:56:06.151 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: ignoring --setgroup ceph since I am not root 2023-09-21T12:56:06.151 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-mgr[136590]: -- 172.21.15.160:0/3437340612 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5558b66071e0 con 0x5558b65dd000 2023-09-21T12:56:06.152 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:05.977+0000 7f6bcedfb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:56:06.152 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.057+0000 7f6bcedfb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:06.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setuser ceph since I am not root 2023-09-21T12:56:06.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: ignoring --setgroup ceph since I am not root 2023-09-21T12:56:06.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:06.077+0000 7ff170c8e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-21T12:56:06.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.247+0000 7ffa64b9a700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 msgr2=0x7ffa4c0a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:06.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.247+0000 7ffa64b9a700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 0x7ffa4c0a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:56:06.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.253+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ffa60112e60 con 0x7ffa60073840 2023-09-21T12:56:06.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.261+0000 7ffa567fc700 1 -- 172.21.15.142:0/4009956244 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7ffa5c0992c0 con 0x7ffa60073840 2023-09-21T12:56:06.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 msgr2=0x7ffa4c0a2b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:56:06.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 0x7ffa4c0a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 msgr2=0x7ffa6019d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c00ec10 tx=0x7ffa5c00ef20 comp rx=0 tx=0).stop 2023-09-21T12:56:06.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 shutdown_connections 2023-09-21T12:56:06.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7ffa4c0a0690 0x7ffa4c0a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa6010d3c0 0x7ffa6019e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa60073840 0x7ffa6019d2c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 --2- 172.21.15.142:0/4009956244 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa60074e20 0x7ffa6019d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 >> 172.21.15.142:0/4009956244 conn(0x7ffa600fc320 msgr2=0x7ffa600fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:06.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 shutdown_connections 2023-09-21T12:56:06.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.263+0000 7ffa675ff700 1 -- 172.21.15.142:0/4009956244 wait complete. 2023-09-21T12:56:06.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-09-21T12:56:06.405 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.061+0000 7f31f0689200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:06.406 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.152+0000 7f31f0689200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:56:06.406 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.244+0000 7f31f0689200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:56:06.413 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.150+0000 7f6bcedfb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:56:06.413 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.243+0000 7f6bcedfb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:56:06.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/1711015057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8104240 msgr2=0x7fb8a8106630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/1711015057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8104240 0x7fb8a8106630 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb89c009990 tx=0x7fb89c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/1711015057 shutdown_connections 2023-09-21T12:56:06.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/1711015057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8106b70 0x7fb8a8108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/1711015057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8101910 0x7fb8a8103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/1711015057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8104240 0x7fb8a8106630 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/1711015057 >> 172.21.15.142:0/1711015057 conn(0x7fb8a80fb280 msgr2=0x7fb8a80fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:06.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/1711015057 shutdown_connections 2023-09-21T12:56:06.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.484+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/1711015057 wait complete. 2023-09-21T12:56:06.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.485+0000 7fb8ae9ff700 1 Processor -- start 2023-09-21T12:56:06.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.485+0000 7fb8ae9ff700 1 -- start start 2023-09-21T12:56:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8104240 0x7fb8a81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8106b70 0x7fb8a8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8198580 con 0x7fb8a8104240 2023-09-21T12:56:06.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81986f0 con 0x7fb8a8106b70 2023-09-21T12:56:06.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8ae9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81988b0 con 0x7fb8a8101910 2023-09-21T12:56:06.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8a7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53696/0 (socket says 172.21.15.142:53696) 2023-09-21T12:56:06.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8a77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8104240 0x7fb8a81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8a7fff700 1 -- 172.21.15.142:0/195331491 learned_addr learned my addr 172.21.15.142:0/195331491 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:06.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.486+0000 7fb8acf9c700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8106b70 0x7fb8a8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8106b70 msgr2=0x7fb8a8197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8106b70 0x7fb8a8197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8104240 msgr2=0x7fb8a81970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8104240 0x7fb8a81970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 -- 172.21.15.142:0/195331491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c0095f0 con 0x7fb8a8101910 2023-09-21T12:56:06.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a7fff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb89800e9a0 tx=0x7fb89800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:06.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898009790 con 0x7fb8a8101910 2023-09-21T12:56:06.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb898010430 con 0x7fb8a8101910 2023-09-21T12:56:06.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a8198b90 con 0x7fb8a8101910 2023-09-21T12:56:06.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb898018680 con 0x7fb8a8101910 2023-09-21T12:56:06.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.487+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a819f350 con 0x7fb8a8101910 2023-09-21T12:56:06.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.488+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a80fce00 con 0x7fb8a8101910 2023-09-21T12:56:06.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.490+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 19) v1 ==== 135277+0+0 (secure 0 0 0) 0x7fb8980105a0 con 0x7fb8a8101910 2023-09-21T12:56:06.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.491+0000 7fb8a57fa700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 0x7fb8900a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.492+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb898014070 con 0x7fb8a8101910 2023-09-21T12:56:06.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.492+0000 7fb8a77fe700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 msgr2=0x7fb8900a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:06.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.492+0000 7fb8a77fe700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 0x7fb8900a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:56:06.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.495+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb898051e10 con 0x7fb8a8101910 2023-09-21T12:56:06.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:06.185+0000 7ff170c8e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:06.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:06.307+0000 7ff170c8e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-21T12:56:06.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:06.434+0000 7ff170c8e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-21T12:56:06.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.414+0000 7f6bcedfb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:56:06.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.693+0000 7fb8a77fe700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 msgr2=0x7fb8900a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:06.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.693+0000 7fb8a77fe700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 0x7fb8900a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:56:06.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.701+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fb8a810c880 con 0x7fb8a8101910 2023-09-21T12:56:06.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.709+0000 7fb8a57fa700 1 -- 172.21.15.142:0/195331491 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb8980958d0 con 0x7fb8a8101910 2023-09-21T12:56:06.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 msgr2=0x7fb8900a2b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:56:06.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 0x7fb8900a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 msgr2=0x7fb8a8196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb89800e9a0 tx=0x7fb89800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 shutdown_connections 2023-09-21T12:56:06.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7fb8900a0690 0x7fb8900a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8a8106b70 0x7fb8a8197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a8101910 0x7fb8a8196b60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 --2- 172.21.15.142:0/195331491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8a8104240 0x7fb8a81970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 >> 172.21.15.142:0/195331491 conn(0x7fb8a80fb280 msgr2=0x7fb8a8102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:06.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 shutdown_connections 2023-09-21T12:56:06.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.711+0000 7fb8ae9ff700 1 -- 172.21.15.142:0/195331491 wait complete. 2023-09-21T12:56:06.729 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2023-09-21T12:56:06.782 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.417+0000 7f31f0689200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:56:06.782 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.782+0000 7f31f0689200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:56:06.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:06.666+0000 7ff170c8e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-21T12:56:06.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-21T12:56:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-mon[97663]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-09-21T12:56:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' 2023-09-21T12:56:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:56:06.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:06 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' 2023-09-21T12:56:06.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 -- 172.21.15.142:0/3159979861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698101fe0 msgr2=0x7f4698102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 --2- 172.21.15.142:0/3159979861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698101fe0 0x7f4698102440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f4688009920 tx=0x7f4688009c30 comp rx=0 tx=0).stop 2023-09-21T12:56:06.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 -- 172.21.15.142:0/3159979861 shutdown_connections 2023-09-21T12:56:06.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 --2- 172.21.15.142:0/3159979861 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698102980 0x7f4698109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 --2- 172.21.15.142:0/3159979861 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4698100df0 0x7f4698101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 --2- 172.21.15.142:0/3159979861 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698101fe0 0x7f4698102440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.933+0000 7f469fbff700 1 -- 172.21.15.142:0/3159979861 >> 172.21.15.142:0/3159979861 conn(0x7f46980fc320 msgr2=0x7f46980fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:06.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.934+0000 7f469fbff700 1 -- 172.21.15.142:0/3159979861 shutdown_connections 2023-09-21T12:56:06.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.934+0000 7f469fbff700 1 -- 172.21.15.142:0/3159979861 wait complete. 2023-09-21T12:56:06.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.935+0000 7f469fbff700 1 Processor -- start 2023-09-21T12:56:06.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.935+0000 7f469fbff700 1 -- start start 2023-09-21T12:56:06.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698100df0 0x7f4698196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 0x7f46981972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4698102980 0x7f4698197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46981986e0 con 0x7f4698100df0 2023-09-21T12:56:06.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698198850 con 0x7f4698101fe0 2023-09-21T12:56:06.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469fbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698198a10 con 0x7f4698102980 2023-09-21T12:56:06.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698100df0 0x7f4698196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 0x7f46981972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 0x7f46981972a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38708/0 (socket says 172.21.15.142:38708) 2023-09-21T12:56:06.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d99b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698100df0 0x7f4698196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48322/0 (socket says 172.21.15.142:48322) 2023-09-21T12:56:06.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 -- 172.21.15.142:0/1576049735 learned_addr learned my addr 172.21.15.142:0/1576049735 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:06.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469e19c700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4698102980 0x7f4698197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:06.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4698102980 msgr2=0x7f4698197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4698102980 0x7f4698197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698100df0 msgr2=0x7f4698196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:06.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4698100df0 0x7f4698196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:06.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.936+0000 7f469d19a700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940095f0 con 0x7f4698101fe0 2023-09-21T12:56:06.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f469d19a700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 0x7f46981972a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4688009230 tx=0x7f468800bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:06.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468801c070 con 0x7f4698101fe0 2023-09-21T12:56:06.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f468800bba0 con 0x7f4698101fe0 2023-09-21T12:56:06.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4688009520 con 0x7f4698101fe0 2023-09-21T12:56:06.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688003a80 con 0x7f4698101fe0 2023-09-21T12:56:06.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.937+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469819f230 con 0x7f4698101fe0 2023-09-21T12:56:06.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.938+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46981084b0 con 0x7f4698101fe0 2023-09-21T12:56:06.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.940+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 19) v1 ==== 135277+0+0 (secure 0 0 0) 0x7f4688020030 con 0x7f4698101fe0 2023-09-21T12:56:06.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.942+0000 7f468effd700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:06.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.942+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:06.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.942+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f46880cd150 con 0x7f4698101fe0 2023-09-21T12:56:06.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.942+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-21T12:56:06.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:06.944+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4688096cc0 con 0x7f4698101fe0 2023-09-21T12:56:07.095 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-21T12:56:07.095 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-mon[134450]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-09-21T12:56:07.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' 2023-09-21T12:56:07.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:56:07.096 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' 2023-09-21T12:56:07.096 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.782+0000 7f6bcedfb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:56:07.097 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:06.913+0000 7f6bcedfb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:56:07.097 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:07.001+0000 7f6bcedfb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:56:07.101 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:06.914+0000 7f31f0689200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:56:07.101 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:07.005+0000 7f31f0689200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:56:07.101 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/521473262' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-09-21T12:56:07.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-mon[134078]: mgrmap e19: x(active, since 8m), standbys: z, y 2023-09-21T12:56:07.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' 2023-09-21T12:56:07.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:56:07.102 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:06 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' 2023-09-21T12:56:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:07.143+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:07.143+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-21T12:56:07.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:07.176+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f469802cf60 con 0x7f46840a0690 2023-09-21T12:56:07.405 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:07.101+0000 7f31f0689200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:56:07.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:07.142+0000 7ff170c8e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-21T12:56:07.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:07.305+0000 7ff170c8e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-21T12:56:07.437 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:07.096+0000 7f6bcedfb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:56:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:07.544+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:07.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:07.544+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-21T12:56:07.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:07.530+0000 7f31f0689200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:56:07.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:07.421+0000 7ff170c8e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-21T12:56:07.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:07.544+0000 7ff170c8e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-21T12:56:07.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:07.521+0000 7f6bcedfb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:56:08.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:08.345+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:08.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:08.345+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-21T12:56:08.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:08.076+0000 7ff170c8e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-21T12:56:08.438 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:08.180+0000 7f6bcedfb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:56:08.438 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:08.263+0000 7f6bcedfb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:56:08.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:08.189+0000 7f31f0689200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:56:08.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:08.272+0000 7f31f0689200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:56:09.300 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.038+0000 7f6bcedfb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:09.301 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.128+0000 7f6bcedfb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:56:09.313 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.050+0000 7f31f0689200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:09.313 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.141+0000 7f31f0689200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:56:09.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:08.934+0000 7ff170c8e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-21T12:56:09.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:09.041+0000 7ff170c8e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-21T12:56:09.581 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.301+0000 7f6bcedfb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:09.592 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.313+0000 7f31f0689200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:09.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.592+0000 7f31f0689200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:56:09.924 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.822+0000 7f31f0689200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:56:09.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.581+0000 7f6bcedfb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:56:09.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.810+0000 7f6bcedfb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:56:09.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:09.947+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:09.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:09.947+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-21T12:56:10.221 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:09.959+0000 7f6bcedfb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:56:10.231 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:09.971+0000 7f31f0689200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:56:10.337 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:09.996+0000 7ff170c8e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:10.337 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:10.114+0000 7ff170c8e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-21T12:56:10.655 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:10.232+0000 7f31f0689200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:56:10.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:10.337+0000 7ff170c8e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-21T12:56:10.688 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:10.222+0000 7f6bcedfb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:56:10.982 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:10.703+0000 7ff170c8e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-21T12:56:11.188 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:10.930+0000 7f6bcedfb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:56:11.188 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:11.061+0000 7f6bcedfb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:56:11.259 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:10.937+0000 7f31f0689200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:56:11.260 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:11.067+0000 7f31f0689200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:56:11.260 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:11.260+0000 7f31f0689200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:56:11.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:10.982+0000 7ff170c8e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-21T12:56:11.416 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:11.174+0000 7ff170c8e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-21T12:56:11.589 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:11.254+0000 7f6bcedfb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:56:11.589 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:11.367+0000 7f6bcedfb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:11.592 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:11.373+0000 7f31f0689200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:11.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:11.593+0000 7f31f0689200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:56:11.916 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:11.523+0000 7ff170c8e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-21T12:56:11.937 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:11.589+0000 7f6bcedfb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:56:12.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:12.538+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 20) v1 ==== 135277+0+0 (secure 0 0 0) 0x7f4688097090 con 0x7f4698101fe0 2023-09-21T12:56:12.891 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:12.458+0000 7ff170c8e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-21T12:56:12.891 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:12.639+0000 7ff170c8e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-21T12:56:12.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: Standby manager daemon z restarted 2023-09-21T12:56:12.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: Standby manager daemon z started 2023-09-21T12:56:12.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:56:12.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.892 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: Standby manager daemon y restarted 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: Standby manager daemon y started 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.893 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:56:12.894 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-mon[97663]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:12.905 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y[135554]: 2023-09-21T12:56:12.467+0000 7f31f0689200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:56:12.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: Standby manager daemon z restarted 2023-09-21T12:56:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: Standby manager daemon z started 2023-09-21T12:56:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:56:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:56:12.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: Standby manager daemon y restarted 2023-09-21T12:56:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: Standby manager daemon y started 2023-09-21T12:56:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:56:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:56:12.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:12 smithi156 ceph-mon[134078]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:12.938 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z[136504]: 2023-09-21T12:56:12.461+0000 7f6bcedfb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:56:12.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: Standby manager daemon z restarted 2023-09-21T12:56:12.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: Standby manager daemon z started 2023-09-21T12:56:12.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-21T12:56:12.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-21T12:56:12.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.160:0/767761337' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:12.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: Standby manager daemon y restarted 2023-09-21T12:56:12.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: Standby manager daemon y started 2023-09-21T12:56:12.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-21T12:56:12.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-21T12:56:12.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-21T12:56:12.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:12 smithi160 ceph-mon[134450]: from='mgr.? 172.21.15.156:0/3882857859' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-21T12:56:13.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:13.150+0000 7f469d99b700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.142:6800/3499877374 2023-09-21T12:56:13.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:13.150+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-09-21T12:56:13.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:12.891+0000 7ff170c8e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-21T12:56:13.166 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:13 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:13.043+0000 7ff170c8e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-21T12:56:13.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:13 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:13.324+0000 7ff170c8e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-21T12:56:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:13 smithi142 ceph-mon[97663]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-09-21T12:56:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:13 smithi156 ceph-mon[134078]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-09-21T12:56:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:13 smithi160 ceph-mon[134450]: mgrmap e20: x(active, since 8m), standbys: z, y 2023-09-21T12:56:14.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:14.412+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 8 ==== mgrmap(e 21) v1 ==== 134944+0+0 (secure 0 0 0) 0x7f46880cac80 con 0x7f4698101fe0 2023-09-21T12:56:14.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:14.413+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 msgr2=0x7f46840a2b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T12:56:14.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:14.413+0000 7f468effd700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/3499877374,v1:172.21.15.142:6801/3499877374] conn(0x7f46840a0690 0x7f46840a2b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:14.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.395+0000 7ff170c8e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-21T12:56:14.666 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.610+0000 7ff0d359e700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.610+0000 7ff0d359e700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.610+0000 7ff0d359e700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.610+0000 7ff0d359e700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.667 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.610+0000 7ff0d359e700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.611+0000 7ff0d0598700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.611+0000 7ff0d0598700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.611+0000 7ff0d0598700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.611+0000 7ff0d0598700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.668 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:56:14.611+0000 7ff0d0598700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:56:14.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: Active manager daemon x restarted 2023-09-21T12:56:14.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: Activating manager daemon x 2023-09-21T12:56:14.669 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: osdmap e87: 12 total, 12 up, 12 in 2023-09-21T12:56:14.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: mgrmap e21: x(active, starting, since 0.0140233s), standbys: z, y 2023-09-21T12:56:14.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:56:14.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:56:14.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:56:14.670 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:56:14.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:56:14.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:56:14.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:56:14.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:56:14.671 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:56:14.672 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:56:14.672 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:56:14.672 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:56:14.672 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:56:14.673 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:56:14.673 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:56:14.673 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:56:14.673 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:56:14.673 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:56:14.674 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:56:14.674 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:56:14.674 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:56:14.674 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:56:14.674 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:56:14.675 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:56:14.675 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:56:14.675 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:56:14.675 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:56:14.675 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:56:14.676 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:56:14.676 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:56:14.676 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:56:14.676 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:56:14.676 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:56:14.677 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: Manager daemon x is now available 2023-09-21T12:56:14.677 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.677 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.677 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.677 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.678 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:14.678 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:14 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:14.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: Active manager daemon x restarted 2023-09-21T12:56:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: Activating manager daemon x 2023-09-21T12:56:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: osdmap e87: 12 total, 12 up, 12 in 2023-09-21T12:56:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: mgrmap e21: x(active, starting, since 0.0140233s), standbys: z, y 2023-09-21T12:56:14.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:56:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:56:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:56:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:56:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:56:14.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:56:14.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:56:14.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:56:14.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:56:14.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:56:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:56:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:56:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:56:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:56:14.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:56:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:56:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:56:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:56:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:56:14.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:56:14.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:56:14.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:56:14.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:56:14.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:56:14.911 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:56:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:56:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:56:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:56:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:56:14.912 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:56:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:56:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:56:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:56:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: Manager daemon x is now available 2023-09-21T12:56:14.913 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:14.914 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:14 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:14.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: Active manager daemon x restarted 2023-09-21T12:56:14.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: Activating manager daemon x 2023-09-21T12:56:14.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: osdmap e87: 12 total, 12 up, 12 in 2023-09-21T12:56:14.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: mgrmap e21: x(active, starting, since 0.0140233s), standbys: z, y 2023-09-21T12:56:14.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-21T12:56:14.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-21T12:56:14.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-21T12:56:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-21T12:56:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-21T12:56:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-21T12:56:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-21T12:56:14.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T12:56:14.942 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T12:56:14.943 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T12:56:14.943 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-21T12:56:14.943 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-21T12:56:14.943 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-21T12:56:14.943 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-21T12:56:14.944 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-21T12:56:14.944 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-21T12:56:14.944 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-21T12:56:14.944 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-21T12:56:14.944 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-21T12:56:14.945 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-21T12:56:14.945 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-21T12:56:14.945 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-21T12:56:14.945 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-21T12:56:14.945 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-21T12:56:14.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-21T12:56:14.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-21T12:56:14.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-21T12:56:14.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-21T12:56:14.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: Manager daemon x is now available 2023-09-21T12:56:14.947 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.947 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:14.947 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.947 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-21T12:56:14.947 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:14.948 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:14 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-21T12:56:15.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.417+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mon.2 v2:172.21.15.156:3300/0 9 ==== mgrmap(e 22) v1 ==== 135071+0+0 (secure 0 0 0) 0x7f46880052b0 con 0x7f4698101fe0 2023-09-21T12:56:15.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.417+0000 7f468effd700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f468401b730 0x7f468401bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:15.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.417+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) v1 -- 0x7f469802cf60 con 0x7f468401b730 2023-09-21T12:56:15.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.420+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f468401b730 0x7f468401bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:15.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.425+0000 7f469d99b700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f468401b730 0x7f468401bb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4698101e40 tx=0x7f4694009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.495+0000 7f468effd700 1 -- 172.21.15.142:0/1576049735 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f469802cf60 con 0x7f468401b730 2023-09-21T12:56:15.495 INFO:teuthology.orchestra.run.smithi142.stdout:Schedule set for path / 2023-09-21T12:56:15.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f468401b730 msgr2=0x7f468401bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:15.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f468401b730 0x7f468401bb10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4698101e40 tx=0x7f4694009310 comp rx=0 tx=0).stop 2023-09-21T12:56:15.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 msgr2=0x7f46981972a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:15.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 --2- 172.21.15.142:0/1576049735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4698101fe0 0x7f46981972a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4688009230 tx=0x7f468800bf80 comp rx=0 tx=0).stop 2023-09-21T12:56:15.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469e19c700 1 -- 172.21.15.142:0/1576049735 reap_dead start 2023-09-21T12:56:15.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 shutdown_connections 2023-09-21T12:56:15.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 >> 172.21.15.142:0/1576049735 conn(0x7f46980fc320 msgr2=0x7f46981055f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:15.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 shutdown_connections 2023-09-21T12:56:15.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.498+0000 7f469fbff700 1 -- 172.21.15.142:0/1576049735 wait complete. 2023-09-21T12:56:15.517 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2023-09-21T12:56:15.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.727+0000 7fce7219d700 1 -- 172.21.15.142:0/1585195263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c0ffb30 msgr2=0x7fce6c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:15.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.727+0000 7fce7219d700 1 --2- 172.21.15.142:0/1585195263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c0ffb30 0x7fce6c0fff50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce680098f0 tx=0x7fce68009c00 comp rx=0 tx=0).stop 2023-09-21T12:56:15.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 -- 172.21.15.142:0/1585195263 shutdown_connections 2023-09-21T12:56:15.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 --2- 172.21.15.142:0/1585195263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c1016c0 0x7fce6c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:15.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 --2- 172.21.15.142:0/1585195263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c0ffb30 0x7fce6c0fff50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:15.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 --2- 172.21.15.142:0/1585195263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c100d20 0x7fce6c101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:15.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 -- 172.21.15.142:0/1585195263 >> 172.21.15.142:0/1585195263 conn(0x7fce6c0fb0a0 msgr2=0x7fce6c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:15.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 -- 172.21.15.142:0/1585195263 shutdown_connections 2023-09-21T12:56:15.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.728+0000 7fce7219d700 1 -- 172.21.15.142:0/1585195263 wait complete. 2023-09-21T12:56:15.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.729+0000 7fce7219d700 1 Processor -- start 2023-09-21T12:56:15.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.729+0000 7fce7219d700 1 -- start start 2023-09-21T12:56:15.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:15.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c100d20 0x7fce6c102100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:15.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c1016c0 0x7fce6c102640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:15.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c102de0 con 0x7fce6c100d20 2023-09-21T12:56:15.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c102f50 con 0x7fce6c0ffb30 2023-09-21T12:56:15.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7219d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c1a0a90 con 0x7fce6c1016c0 2023-09-21T12:56:15.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:15.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59016/0 (socket says 172.21.15.142:59016) 2023-09-21T12:56:15.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 -- 172.21.15.142:0/2065519680 learned_addr learned my addr 172.21.15.142:0/2065519680 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:15.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7099a700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c100d20 0x7fce6c102100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:15.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 -- 172.21.15.142:0/2065519680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c1016c0 msgr2=0x7fce6c102640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:15.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c1016c0 0x7fce6c102640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:15.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 -- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c100d20 msgr2=0x7fce6c102100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:15.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.730+0000 7fce7119b700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c100d20 0x7fce6c102100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:15.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce7119b700 1 -- 172.21.15.142:0/2065519680 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009520 con 0x7fce6c0ffb30 2023-09-21T12:56:15.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce7119b700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce68005e90 tx=0x7fce6800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:15.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6801c070 con 0x7fce6c0ffb30 2023-09-21T12:56:15.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce6800f860 con 0x7fce6c0ffb30 2023-09-21T12:56:15.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68003ad0 con 0x7fce6c0ffb30 2023-09-21T12:56:15.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c1a0d10 con 0x7fce6c0ffb30 2023-09-21T12:56:15.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.731+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c1a10e0 con 0x7fce6c0ffb30 2023-09-21T12:56:15.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.732+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c10b480 con 0x7fce6c0ffb30 2023-09-21T12:56:15.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.734+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 22) v1 ==== 135071+0+0 (secure 0 0 0) 0x7fce68020030 con 0x7fce6c0ffb30 2023-09-21T12:56:15.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.735+0000 7fce627fc700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 0x7fce580a2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:15.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.736+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fce680ccbc0 con 0x7fce6c0ffb30 2023-09-21T12:56:15.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.736+0000 7fce7099a700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 0x7fce580a2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:15.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.736+0000 7fce7099a700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 0x7fce580a2900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009a10 tx=0x7fce5c009190 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:15.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.737+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fce68096940 con 0x7fce6c0ffb30 2023-09-21T12:56:15.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:15.980+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fce6c069270 con 0x7fce580a0440 2023-09-21T12:56:16.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.035+0000 7fce627fc700 1 -- 172.21.15.142:0/2065519680 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fce6c069270 con 0x7fce580a0440 2023-09-21T12:56:16.035 INFO:teuthology.orchestra.run.smithi142.stdout:Retention added to path / 2023-09-21T12:56:16.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 msgr2=0x7fce580a2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 0x7fce580a2900 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fce5c009a10 tx=0x7fce5c009190 comp rx=0 tx=0).stop 2023-09-21T12:56:16.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 msgr2=0x7fce6c103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce68005e90 tx=0x7fce6800b790 comp rx=0 tx=0).stop 2023-09-21T12:56:16.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 shutdown_connections 2023-09-21T12:56:16.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce580a0440 0x7fce580a2900 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce6c1016c0 0x7fce6c102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce6c0ffb30 0x7fce6c103ac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 --2- 172.21.15.142:0/2065519680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce6c100d20 0x7fce6c102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 >> 172.21.15.142:0/2065519680 conn(0x7fce6c0fb0a0 msgr2=0x7fce6c068ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:16.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 shutdown_connections 2023-09-21T12:56:16.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.038+0000 7fce7219d700 1 -- 172.21.15.142:0/2065519680 wait complete. 2023-09-21T12:56:16.056 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-09-21T12:56:16.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 -- 172.21.15.142:0/1795486137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0106910 msgr2=0x7f42e0108d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 --2- 172.21.15.142:0/1795486137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0106910 0x7f42e0108d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f42d8009f90 tx=0x7f42d800b330 comp rx=0 tx=0).stop 2023-09-21T12:56:16.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 -- 172.21.15.142:0/1795486137 shutdown_connections 2023-09-21T12:56:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 --2- 172.21.15.142:0/1795486137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 0x7f42e0103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 --2- 172.21.15.142:0/1795486137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0106910 0x7f42e0108d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 --2- 172.21.15.142:0/1795486137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0103fe0 0x7f42e01063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 -- 172.21.15.142:0/1795486137 >> 172.21.15.142:0/1795486137 conn(0x7f42e00fb0a0 msgr2=0x7f42e00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:16.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 -- 172.21.15.142:0/1795486137 shutdown_connections 2023-09-21T12:56:16.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.270+0000 7f42dffff700 1 -- 172.21.15.142:0/1795486137 wait complete. 2023-09-21T12:56:16.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.272+0000 7f42dffff700 1 Processor -- start 2023-09-21T12:56:16.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.272+0000 7f42dffff700 1 -- start start 2023-09-21T12:56:16.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.272+0000 7f42dffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 0x7f42e0196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42dffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42dffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 0x7f42e019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42dffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019e580 con 0x7f42e01016b0 2023-09-21T12:56:16.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42dffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019e6c0 con 0x7f42e0103fe0 2023-09-21T12:56:16.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42dffff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e019e850 con 0x7f42e0106910 2023-09-21T12:56:16.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59034/0 (socket says 172.21.15.142:59034) 2023-09-21T12:56:16.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 -- 172.21.15.142:0/1145446144 learned_addr learned my addr 172.21.15.142:0/1145446144 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:16.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42deffd700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 0x7f42e0196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42df7fe700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 0x7f42e019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 -- 172.21.15.142:0/1145446144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 msgr2=0x7f42e019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 0x7f42e019dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 -- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 msgr2=0x7f42e0196a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 0x7f42e0196a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42de7fc700 1 -- 172.21.15.142:0/1145446144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d8009c40 con 0x7f42e0103fe0 2023-09-21T12:56:16.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.273+0000 7f42df7fe700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 0x7f42e019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:16.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42de7fc700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9a0 tx=0x7f42d400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:16.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d4009790 con 0x7f42e0103fe0 2023-09-21T12:56:16.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42d400cbd0 con 0x7f42e0103fe0 2023-09-21T12:56:16.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42d400eee0 con 0x7f42e0103fe0 2023-09-21T12:56:16.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e019eb30 con 0x7f42e0103fe0 2023-09-21T12:56:16.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.274+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e019f040 con 0x7f42e0103fe0 2023-09-21T12:56:16.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.275+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e00fcc20 con 0x7f42e0103fe0 2023-09-21T12:56:16.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.277+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 22) v1 ==== 135071+0+0 (secure 0 0 0) 0x7f42d400cd40 con 0x7f42e0103fe0 2023-09-21T12:56:16.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.278+0000 7f42c7fff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 0x7f42c80a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.279+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42d4014070 con 0x7f42e0103fe0 2023-09-21T12:56:16.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.279+0000 7f42deffd700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 0x7f42c80a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.279+0000 7f42deffd700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 0x7f42c80a2980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005fd0 tx=0x7f42d0009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:16.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.280+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f42d4095ba0 con 0x7f42e0103fe0 2023-09-21T12:56:16.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.422+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mgrmap(e 23) v1 ==== 135380+0+0 (secure 0 0 0) 0x7f42d4095f70 con 0x7f42e0103fe0 2023-09-21T12:56:16.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.541+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f42e002d230 con 0x7f42c80a04c0 2023-09-21T12:56:16.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.549+0000 7f42c7fff700 1 -- 172.21.15.142:0/1145446144 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7f42e002d230 con 0x7f42c80a04c0 2023-09-21T12:56:16.549 INFO:teuthology.orchestra.run.smithi142.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-09-21T00:00:00", "created": "2023-09-21T12:56:15", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-09-21T12:56:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 msgr2=0x7f42c80a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 0x7f42c80a2980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42d0005fd0 tx=0x7f42d0009310 comp rx=0 tx=0).stop 2023-09-21T12:56:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 msgr2=0x7f42e0196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e9a0 tx=0x7f42d400ed60 comp rx=0 tx=0).stop 2023-09-21T12:56:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 shutdown_connections 2023-09-21T12:56:16.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42c80a04c0 0x7f42c80a2980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42e01016b0 0x7f42e0196a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42e0106910 0x7f42e019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 --2- 172.21.15.142:0/1145446144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42e0103fe0 0x7f42e0196f40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 >> 172.21.15.142:0/1145446144 conn(0x7f42e00fb0a0 msgr2=0x7f42e0102320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:16.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 shutdown_connections 2023-09-21T12:56:16.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.552+0000 7f42dffff700 1 -- 172.21.15.142:0/1145446144 wait complete. 2023-09-21T12:56:16.571 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-09-21T12:56:16.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:56:15] ENGINE Bus STARTING 2023-09-21T12:56:16.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: mgrmap e22: x(active, since 1.01805s), standbys: z, y 2023-09-21T12:56:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:56:15] ENGINE Serving on http://172.21.15.142:8765 2023-09-21T12:56:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: from='client.25367 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:56:15] ENGINE Serving on https://172.21.15.142:7150 2023-09-21T12:56:16.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:16 smithi142 ceph-mon[97663]: [21/Sep/2023:12:56:15] ENGINE Bus STARTED 2023-09-21T12:56:16.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: [21/Sep/2023:12:56:15] ENGINE Bus STARTING 2023-09-21T12:56:16.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: mgrmap e22: x(active, since 1.01805s), standbys: z, y 2023-09-21T12:56:16.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: [21/Sep/2023:12:56:15] ENGINE Serving on http://172.21.15.142:8765 2023-09-21T12:56:16.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: from='client.25367 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:16.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:16.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: [21/Sep/2023:12:56:15] ENGINE Serving on https://172.21.15.142:7150 2023-09-21T12:56:16.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:16 smithi160 ceph-mon[134450]: [21/Sep/2023:12:56:15] ENGINE Bus STARTED 2023-09-21T12:56:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 -- 172.21.15.142:0/1435983221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c101fe0 msgr2=0x7fa45c102440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 --2- 172.21.15.142:0/1435983221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c101fe0 0x7fa45c102440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa4480099c0 tx=0x7fa448009cd0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 -- 172.21.15.142:0/1435983221 shutdown_connections 2023-09-21T12:56:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 --2- 172.21.15.142:0/1435983221 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c102980 0x7fa45c109230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 --2- 172.21.15.142:0/1435983221 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c100df0 0x7fa45c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 --2- 172.21.15.142:0/1435983221 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c101fe0 0x7fa45c102440 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 -- 172.21.15.142:0/1435983221 >> 172.21.15.142:0/1435983221 conn(0x7fa45c0fc320 msgr2=0x7fa45c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:16.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 -- 172.21.15.142:0/1435983221 shutdown_connections 2023-09-21T12:56:16.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.775+0000 7fa462fff700 1 -- 172.21.15.142:0/1435983221 wait complete. 2023-09-21T12:56:16.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 Processor -- start 2023-09-21T12:56:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 -- start start 2023-09-21T12:56:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c101fe0 0x7fa45c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c102980 0x7fa45c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c1985d0 con 0x7fa45c102980 2023-09-21T12:56:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c198740 con 0x7fa45c100df0 2023-09-21T12:56:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa462fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45c198900 con 0x7fa45c101fe0 2023-09-21T12:56:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa46159c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c102980 0x7fa45c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa460d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.777+0000 7fa460d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59056/0 (socket says 172.21.15.142:59056) 2023-09-21T12:56:16.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 -- 172.21.15.142:0/3061871534 learned_addr learned my addr 172.21.15.142:0/3061871534 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:16.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa45bfff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c101fe0 0x7fa45c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 -- 172.21.15.142:0/3061871534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c101fe0 msgr2=0x7fa45c1970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c101fe0 0x7fa45c1970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 -- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c102980 msgr2=0x7fa45c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:16.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c102980 0x7fa45c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:16.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 -- 172.21.15.142:0/3061871534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4480095f0 con 0x7fa45c100df0 2023-09-21T12:56:16.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa460d9b700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e970 tx=0x7fa45000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:16.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450009790 con 0x7fa45c100df0 2023-09-21T12:56:16.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45c198be0 con 0x7fa45c100df0 2023-09-21T12:56:16.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa45000c7e0 con 0x7fa45c100df0 2023-09-21T12:56:16.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.778+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450003c70 con 0x7fa45c100df0 2023-09-21T12:56:16.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.779+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa45c19f3a0 con 0x7fa45c100df0 2023-09-21T12:56:16.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.780+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45c1083e0 con 0x7fa45c100df0 2023-09-21T12:56:16.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.782+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 23) v1 ==== 135380+0+0 (secure 0 0 0) 0x7fa45000cc50 con 0x7fa45c100df0 2023-09-21T12:56:16.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.783+0000 7fa459ffb700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 0x7fa44c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:16.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.783+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa450014070 con 0x7fa45c100df0 2023-09-21T12:56:16.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.783+0000 7fa45bfff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 0x7fa44c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:16.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.784+0000 7fa45bfff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 0x7fa44c0a2c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b580 tx=0x7fa448005fb0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:16.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:16.786+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa450095cc0 con 0x7fa45c100df0 2023-09-21T12:56:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: [21/Sep/2023:12:56:15] ENGINE Bus STARTING 2023-09-21T12:56:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: mgrmap e22: x(active, since 1.01805s), standbys: z, y 2023-09-21T12:56:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: [21/Sep/2023:12:56:15] ENGINE Serving on http://172.21.15.142:8765 2023-09-21T12:56:16.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: from='client.25367 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: [21/Sep/2023:12:56:15] ENGINE Serving on https://172.21.15.142:7150 2023-09-21T12:56:16.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:16 smithi156 ceph-mon[134078]: [21/Sep/2023:12:56:15] ENGINE Bus STARTED 2023-09-21T12:56:17.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.036+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa45c02cf60 con 0x7fa44c0a07b0 2023-09-21T12:56:17.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.043+0000 7fa459ffb700 1 -- 172.21.15.142:0/3061871534 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7fa45c02cf60 con 0x7fa44c0a07b0 2023-09-21T12:56:17.042 INFO:teuthology.orchestra.run.smithi142.stdout:/ 1m 6m3h 2023-09-21T12:56:17.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.045+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 msgr2=0x7fa44c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:17.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.045+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 0x7fa44c0a2c70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa44800b580 tx=0x7fa448005fb0 comp rx=0 tx=0).stop 2023-09-21T12:56:17.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.045+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 msgr2=0x7fa45c196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:17.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.045+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa45000e970 tx=0x7fa45000ec80 comp rx=0 tx=0).stop 2023-09-21T12:56:17.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 shutdown_connections 2023-09-21T12:56:17.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa44c0a07b0 0x7fa44c0a2c70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:17.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa45c102980 0x7fa45c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:17.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa45c100df0 0x7fa45c196bb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:17.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 --2- 172.21.15.142:0/3061871534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa45c101fe0 0x7fa45c1970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:17.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 >> 172.21.15.142:0/3061871534 conn(0x7fa45c0fc320 msgr2=0x7fa45c105520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:17.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 shutdown_connections 2023-09-21T12:56:17.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:17.046+0000 7fa462fff700 1 -- 172.21.15.142:0/3061871534 wait complete. 2023-09-21T12:56:17.064 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-09-21T12:56:17.159 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-09-21T12:56:17.172 INFO:teuthology.run_tasks:Running task background_exec... 2023-09-21T12:56:17.205 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T12:56:17.206 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-09-21T12:56:17.210 INFO:teuthology.run_tasks:Running task workunit... 2023-09-21T12:56:17.224 INFO:tasks.workunit:Pulling workunits from ref 41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:56:17.224 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-21T12:56:17.225 INFO:tasks.workunit:timeout=3h 2023-09-21T12:56:17.225 INFO:tasks.workunit:cleanup=True 2023-09-21T12:56:17.225 DEBUG:teuthology.orchestra.run.smithi142:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-21T12:56:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-09-21T12:56:17.274 INFO:teuthology.orchestra.run.smithi142.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-09-21T12:56:17.274 INFO:teuthology.orchestra.run.smithi142.stdout:Device: 79h/121d Inode: 1099511628283 Links: 2 2023-09-21T12:56:17.275 INFO:teuthology.orchestra.run.smithi142.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-21T12:56:17.275 INFO:teuthology.orchestra.run.smithi142.stdout:Context: system_u:object_r:cephfs_t:s0 2023-09-21T12:56:17.275 INFO:teuthology.orchestra.run.smithi142.stdout:Access: 2023-09-21 12:54:18.895759401 +0000 2023-09-21T12:56:17.275 INFO:teuthology.orchestra.run.smithi142.stdout:Modify: 2023-09-21 12:54:18.895759401 +0000 2023-09-21T12:56:17.275 INFO:teuthology.orchestra.run.smithi142.stdout:Change: 2023-09-21 12:55:56.445471299 +0000 2023-09-21T12:56:17.276 INFO:teuthology.orchestra.run.smithi142.stdout: Birth: 2023-09-21 12:54:18.895759401 +0000 2023-09-21T12:56:17.276 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-09-21T12:56:17.276 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-09-21T12:56:17.362 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 41c9e835c3f621102ade35dd597317a42116a491 2023-09-21T12:56:17.411 INFO:tasks.workunit.client.0.smithi142.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-21T12:56:17.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:17 smithi142 ceph-mon[97663]: from='client.25406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:17.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:17 smithi142 ceph-mon[97663]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:17.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:17 smithi142 ceph-mon[97663]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-09-21T12:56:17.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:17 smithi142 ceph-mon[97663]: from='client.25412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:17.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:17 smithi160 ceph-mon[134450]: from='client.25406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:17.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:17 smithi160 ceph-mon[134450]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:17.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:17 smithi160 ceph-mon[134450]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-09-21T12:56:17.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:17 smithi160 ceph-mon[134450]: from='client.25412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:17 smithi156 ceph-mon[134078]: from='client.25406 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:17 smithi156 ceph-mon[134078]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:17 smithi156 ceph-mon[134078]: mgrmap e23: x(active, since 2s), standbys: z, y 2023-09-21T12:56:17.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:17 smithi156 ceph-mon[134078]: from='client.25412 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:18.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='client.25424 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:18.688 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.689 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.690 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.691 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.692 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.693 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:18 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='client.25424 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:18.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.909 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.910 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:18 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='client.25424 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T12:56:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:18.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.919 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.920 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:18.921 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:18 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T12:56:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T12:56:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:19 smithi156 ceph-mon[134078]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-09-21T12:56:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T12:56:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T12:56:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:19 smithi142 ceph-mon[97663]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-09-21T12:56:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T12:56:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T12:56:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T12:56:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:19.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:19 smithi160 ceph-mon[134450]: mgrmap e24: x(active, since 4s), standbys: z, y 2023-09-21T12:56:21.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T12:56:21.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T12:56:21.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:21.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:21.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: Updating smithi142:/etc/ceph/ceph.conf 2023-09-21T12:56:21.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:56:21.159 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:20 smithi156 ceph-mon[134078]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:56:21.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T12:56:21.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T12:56:21.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:21.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:21.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: Updating smithi142:/etc/ceph/ceph.conf 2023-09-21T12:56:21.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:56:21.170 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:20 smithi142 ceph-mon[97663]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:56:21.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:21.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T12:56:21.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T12:56:21.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T12:56:21.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:21.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:21.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: Updating smithi142:/etc/ceph/ceph.conf 2023-09-21T12:56:21.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: Updating smithi156:/etc/ceph/ceph.conf 2023-09-21T12:56:21.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:20 smithi160 ceph-mon[134450]: Updating smithi160:/etc/ceph/ceph.conf 2023-09-21T12:56:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:21 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:21 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T12:56:22.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi156:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi160:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:22.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-21T12:56:22.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: Updating smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:22.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:22.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:21 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:23.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:23.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:23.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:23.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:23.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:22 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:23.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:23.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:23.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:23.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:23.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:22 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: Updating smithi142:/etc/ceph/ceph.client.admin.keyring 2023-09-21T12:56:23.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: Updating smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-21T12:56:23.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:56:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:56:23.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:56:23.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:22 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:56:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:23 smithi156 ceph-mon[134078]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 132 KiB/s wr, 68 op/s 2023-09-21T12:56:24.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:23 smithi142 ceph-mon[97663]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 132 KiB/s wr, 68 op/s 2023-09-21T12:56:24.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:23 smithi160 ceph-mon[134450]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 132 KiB/s wr, 68 op/s 2023-09-21T12:56:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:25 smithi156 ceph-mon[134078]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 103 KiB/s wr, 53 op/s 2023-09-21T12:56:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:25 smithi142 ceph-mon[97663]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 103 KiB/s wr, 53 op/s 2023-09-21T12:56:26.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:25 smithi160 ceph-mon[134450]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 103 KiB/s wr, 53 op/s 2023-09-21T12:56:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:27 smithi142 ceph-mon[97663]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 46 op/s 2023-09-21T12:56:28.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:27 smithi160 ceph-mon[134450]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 46 op/s 2023-09-21T12:56:28.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:27 smithi156 ceph-mon[134078]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 84 KiB/s wr, 46 op/s 2023-09-21T12:56:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:29 smithi142 ceph-mon[97663]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2023-09-21T12:56:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:29 smithi160 ceph-mon[134450]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2023-09-21T12:56:30.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:29 smithi156 ceph-mon[134078]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 42 op/s 2023-09-21T12:56:30.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 -- 172.21.15.142:0/1001030442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 msgr2=0x7f74b81013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 --2- 172.21.15.142:0/1001030442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b81013c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f74a80098f0 tx=0x7f74a8009c00 comp rx=0 tx=0).stop 2023-09-21T12:56:30.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 -- 172.21.15.142:0/1001030442 shutdown_connections 2023-09-21T12:56:30.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 --2- 172.21.15.142:0/1001030442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b8106100 0x7f74b810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 --2- 172.21.15.142:0/1001030442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b81013c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 --2- 172.21.15.142:0/1001030442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8101990 0x7f74b81059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.473+0000 7f74be9ff700 1 -- 172.21.15.142:0/1001030442 >> 172.21.15.142:0/1001030442 conn(0x7f74b80fc840 msgr2=0x7f74b80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.474+0000 7f74be9ff700 1 -- 172.21.15.142:0/1001030442 shutdown_connections 2023-09-21T12:56:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.474+0000 7f74be9ff700 1 -- 172.21.15.142:0/1001030442 wait complete. 2023-09-21T12:56:30.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.474+0000 7f74be9ff700 1 Processor -- start 2023-09-21T12:56:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 -- start start 2023-09-21T12:56:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b8196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8106100 0x7f74b8197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b819c530 con 0x7f74b819bab0 2023-09-21T12:56:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b819c6a0 con 0x7f74b8100fe0 2023-09-21T12:56:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74be9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b819c860 con 0x7f74b8106100 2023-09-21T12:56:30.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b8196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50348/0 (socket says 172.21.15.142:50348) 2023-09-21T12:56:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74bcf9c700 1 -- 172.21.15.142:0/259447367 learned_addr learned my addr 172.21.15.142:0/259447367 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.475+0000 7f74b77fe700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8106100 0x7f74b8197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 -- 172.21.15.142:0/259447367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8106100 msgr2=0x7f74b8197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8106100 0x7f74b8197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 -- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 msgr2=0x7f74b819bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 -- 172.21.15.142:0/259447367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009d00 con 0x7f74b8100fe0 2023-09-21T12:56:30.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b7fff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b8196f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009810 tx=0x7f74a800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b57fa700 1 -- 172.21.15.142:0/259447367 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a801c070 con 0x7f74b8100fe0 2023-09-21T12:56:30.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a8009520 con 0x7f74b8100fe0 2023-09-21T12:56:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b57fa700 1 -- 172.21.15.142:0/259447367 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74a800bba0 con 0x7f74b8100fe0 2023-09-21T12:56:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74b57fa700 1 -- 172.21.15.142:0/259447367 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8003970 con 0x7f74b8100fe0 2023-09-21T12:56:30.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.476+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81a40a0 con 0x7f74b8100fe0 2023-09-21T12:56:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.480+0000 7f74b57fa700 1 -- 172.21.15.142:0/259447367 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f74a8020030 con 0x7f74b8100fe0 2023-09-21T12:56:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.481+0000 7f74d2382b80 1 Processor -- start 2023-09-21T12:56:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.481+0000 7f74b57fa700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 0x7f74a00a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.481+0000 7f74b57fa700 1 -- 172.21.15.142:0/259447367 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f74a80ccef0 con 0x7f74b8100fe0 2023-09-21T12:56:30.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.481+0000 7f74d2382b80 1 -- start start 2023-09-21T12:56:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.481+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 0x7f74a00a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8246910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b82472b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b81b6c40 con 0x5637b82420a0 2023-09-21T12:56:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b819ac10 con 0x5637b82429c0 2023-09-21T12:56:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74d2382b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b8198530 con 0x5637b8246e50 2023-09-21T12:56:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50362/0 (socket says 172.21.15.142:50362) 2023-09-21T12:56:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 -- 172.21.15.142:0/1561333162 learned_addr learned my addr 172.21.15.142:0/1561333162 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 0x7f74a00a2d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009fd0 tx=0x7f74b000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b82472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8246910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 -- 172.21.15.142:0/1561333162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 msgr2=0x5637b82472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b82472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 -- 172.21.15.142:0/1561333162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 msgr2=0x5637b8246910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8246910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 -- 172.21.15.142:0/1561333162 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637b7fbed80 con 0x5637b82420a0 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.482+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74a80a1d40 tx=0x7f74a8005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7fcb51b7fedb49 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f749e7fc700 1 -- 172.21.15.142:0/1561333162 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a809a990 con 0x5637b82420a0 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f749e7fc700 1 -- 172.21.15.142:0/1561333162 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74a809a290 con 0x5637b82420a0 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f749e7fc700 1 -- 172.21.15.142:0/1561333162 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80a00c0 con 0x5637b82420a0 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 -- 172.21.15.142:0/1561333162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 msgr2=0x5637b8242480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f74a80a1d40 tx=0x7f74a8005600 comp rx=0 tx=0).stop 2023-09-21T12:56:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 -- 172.21.15.142:0/1561333162 shutdown_connections 2023-09-21T12:56:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b8242480 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b82472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1561333162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8246910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.483+0000 7f74d2382b80 1 -- 172.21.15.142:0/1561333162 >> 172.21.15.142:0/1561333162 conn(0x5637b816efa0 msgr2=0x5637b823d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.484+0000 7f74d2382b80 1 -- 172.21.15.142:0/1561333162 shutdown_connections 2023-09-21T12:56:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.484+0000 7f74d2382b80 1 -- 172.21.15.142:0/1561333162 wait complete. 2023-09-21T12:56:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.484+0000 7f74d2382b80 1 -- start start 2023-09-21T12:56:30.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.484+0000 7f74d2382b80 1 Processor -- start 2023-09-21T12:56:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82420a0 0x5637b824e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b824bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b8193e20 con 0x5637b82429c0 2023-09-21T12:56:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b81306e0 con 0x5637b82420a0 2023-09-21T12:56:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b8130380 con 0x5637b8246e50 2023-09-21T12:56:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.485+0000 7f74d2382b80 10 client.0 _ll_register_callbacks cb 0x5637b807aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50378/0 (socket says 172.21.15.142:50378) 2023-09-21T12:56:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 -- 172.21.15.142:0/1321006246 learned_addr learned my addr 172.21.15.142:0/1321006246 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b824bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82420a0 0x5637b824e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 -- 172.21.15.142:0/1321006246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 msgr2=0x5637b824bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b824bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 -- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82420a0 msgr2=0x5637b824e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82420a0 0x5637b824e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 -- 172.21.15.142:0/1321006246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b81a40a0 con 0x5637b82429c0 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f74ac012700 tx=0x7f74ac012a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4209ac160c8d9a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74977fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac017070 con 0x5637b82429c0 2023-09-21T12:56:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f74ac004050 con 0x5637b82429c0 2023-09-21T12:56:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.486+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637b8104b50 con 0x5637b82429c0 2023-09-21T12:56:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74ac004210 con 0x5637b82429c0 2023-09-21T12:56:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 10 client.15393 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5637b7fa7c00 con 0x5637b82429c0 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5637b8104b50 con 0x5637b82429c0 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74ac010430 con 0x5637b82429c0 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 10 client.15393 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 10 client.15393 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 20 client.15393 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b825bc40 0x5637b825e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 4 client.15393 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.487+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637b8210fc0 con 0x5637b825bc40 2023-09-21T12:56:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.488+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b825bc40 0x5637b825e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.488+0000 7f74977fe700 10 client.15393 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.488+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b825bc40 0x5637b825e060 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35945edee97043b8 server_cookie=a52ad7af2ac39c32 in_seq=0 out_seq=0 2023-09-21T12:56:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74977fe700 1 -- 172.21.15.142:0/1321006246 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5637b8210fc0 con 0x5637b825bc40 2023-09-21T12:56:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74977fe700 10 client.15393 handle_command_reply: tid=0 2023-09-21T12:56:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 client.15393 shutdown 2023-09-21T12:56:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 msgr2=0x5637b824b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f74ac012700 tx=0x7f74ac012a10 comp rx=0 tx=0).stop 2023-09-21T12:56:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 shutdown_connections 2023-09-21T12:56:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b825bc40 0x5637b825e060 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b824bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82420a0 0x5637b824e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74977fe700 0 client.15393 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1321006246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82429c0 0x5637b824b780 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 >> 172.21.15.142:0/1321006246 conn(0x5637b816efa0 msgr2=0x5637b823cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 shutdown_connections 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.489+0000 7f74d2382b80 1 -- 172.21.15.142:0/1321006246 wait complete. 2023-09-21T12:56:30.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.490+0000 7f74d2382b80 20 client.15393 trim_cache size 0 max 16384 2023-09-21T12:56:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 Processor -- start 2023-09-21T12:56:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 -- start start 2023-09-21T12:56:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8252c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b8245de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b80148c0 con 0x5637b82420a0 2023-09-21T12:56:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b8243160 con 0x5637b82429c0 2023-09-21T12:56:30.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74d2382b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b824b560 con 0x5637b8246e50 2023-09-21T12:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50388/0 (socket says 172.21.15.142:50388) 2023-09-21T12:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.505+0000 7f74b7fff700 1 -- 172.21.15.142:0/708741390 learned_addr learned my addr 172.21.15.142:0/708741390 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b77fe700 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8252c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b8245de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 -- 172.21.15.142:0/708741390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 msgr2=0x5637b8245de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b8245de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 -- 172.21.15.142:0/708741390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 msgr2=0x5637b8252c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8252c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 -- 172.21.15.142:0/708741390 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637b7fe51f0 con 0x5637b82420a0 2023-09-21T12:56:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f74b7fff700 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74a8021530 tx=0x7f74a802afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b0324856aa60ee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f749effd700 1 -- 172.21.15.142:0/708741390 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8094ea0 con 0x5637b82420a0 2023-09-21T12:56:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f749effd700 1 -- 172.21.15.142:0/708741390 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74a809e140 con 0x5637b82420a0 2023-09-21T12:56:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.506+0000 7f749effd700 1 -- 172.21.15.142:0/708741390 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a80b80b0 con 0x5637b82420a0 2023-09-21T12:56:30.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- 172.21.15.142:0/708741390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 msgr2=0x5637b824b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f74a8021530 tx=0x7f74a802afc0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- 172.21.15.142:0/708741390 shutdown_connections 2023-09-21T12:56:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b82420a0 0x5637b824b020 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b8246e50 0x5637b8245de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 --2- 172.21.15.142:0/708741390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8252c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- 172.21.15.142:0/708741390 >> 172.21.15.142:0/708741390 conn(0x5637b816efa0 msgr2=0x5637b8262980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- 172.21.15.142:0/708741390 shutdown_connections 2023-09-21T12:56:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- 172.21.15.142:0/708741390 wait complete. 2023-09-21T12:56:30.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.507+0000 7f74d2382b80 1 -- start start 2023-09-21T12:56:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 Processor -- start 2023-09-21T12:56:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b82420a0 0x5637b8250e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8251380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b82a8f70 con 0x5637b8246e50 2023-09-21T12:56:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b82a90e0 con 0x5637b82429c0 2023-09-21T12:56:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637b82a92a0 con 0x5637b82420a0 2023-09-21T12:56:30.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74d2382b80 10 client.0 _ll_register_callbacks cb 0x5637b807aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74bcf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50400/0 (socket says 172.21.15.142:50400) 2023-09-21T12:56:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74bcf9c700 1 -- 172.21.15.142:0/1691900317 learned_addr learned my addr 172.21.15.142:0/1691900317 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8251380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.508+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b82420a0 0x5637b8250e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 -- 172.21.15.142:0/1691900317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b82420a0 msgr2=0x5637b8250e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b82420a0 0x5637b8250e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 -- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 msgr2=0x5637b8251380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8251380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 -- 172.21.15.142:0/1691900317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a807e730 con 0x5637b8246e50 2023-09-21T12:56:30.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74b77fe700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8251380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:30.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74bcf9c700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f74b0011cc0 tx=0x7f74b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b938a6fe07d70a9a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:30.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74977fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:30.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b001c040 con 0x5637b8246e50 2023-09-21T12:56:30.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74a809a290 con 0x5637b8246e50 2023-09-21T12:56:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f74b0004bb0 con 0x5637b8246e50 2023-09-21T12:56:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74b000e040 con 0x5637b8246e50 2023-09-21T12:56:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74d2382b80 10 client.15399 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:30.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.509+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5637b7fbd250 con 0x5637b8246e50 2023-09-21T12:56:30.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74a809a290 con 0x5637b8246e50 2023-09-21T12:56:30.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f74b0005020 con 0x5637b8246e50 2023-09-21T12:56:30.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 10 client.15399 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:30.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 10 client.15399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:30.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 20 client.15399 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:30.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b82b0bd0 0x5637b82b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:30.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 4 client.15399 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:56:30.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637b818ce00 con 0x5637b82b0bd0 2023-09-21T12:56:30.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.510+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b82b0bd0 0x5637b82b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:30.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.511+0000 7f74b7fff700 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b82b0bd0 0x5637b82b2ff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20d48247bc18e424 server_cookie=17ff3ecb8ceaa397 in_seq=0 out_seq=0 2023-09-21T12:56:30.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.511+0000 7f74977fe700 10 client.15399 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:30.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74977fe700 1 -- 172.21.15.142:0/1691900317 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637b818ce00 con 0x5637b82b0bd0 2023-09-21T12:56:30.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74977fe700 10 client.15399 handle_command_reply: tid=0 2023-09-21T12:56:30.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 client.15399 shutdown 2023-09-21T12:56:30.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 msgr2=0x5637b82a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f74b0011cc0 tx=0x7f74b0004ad0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 shutdown_connections 2023-09-21T12:56:30.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5637b82b0bd0 0x5637b82b2ff0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5637b8246e50 0x5637b82a8a00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5637b82420a0 0x5637b8250e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74977fe700 0 client.15399 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:30.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 --2- 172.21.15.142:0/1691900317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5637b82429c0 0x5637b8251380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 >> 172.21.15.142:0/1691900317 conn(0x5637b816efa0 msgr2=0x5637b8240ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 shutdown_connections 2023-09-21T12:56:30.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 1 -- 172.21.15.142:0/1691900317 wait complete. 2023-09-21T12:56:30.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.523+0000 7f74d2382b80 20 client.15399 trim_cache size 0 max 16384 2023-09-21T12:56:30.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:56:30.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:56:30.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:56:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:56:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 msgr2=0x7f74a00a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 0x7f74a00a2d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74b0009fd0 tx=0x7f74b000b040 comp rx=0 tx=0).stop 2023-09-21T12:56:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 msgr2=0x7f74b8196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b8196f00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009810 tx=0x7f74a800fa00 comp rx=0 tx=0).stop 2023-09-21T12:56:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 shutdown_connections 2023-09-21T12:56:30.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f74a00a08c0 0x7f74a00a2d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f74b819bab0 0x7f74b819bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f74b8100fe0 0x7f74b8196f00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 --2- 172.21.15.142:0/259447367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f74b8106100 0x7f74b8197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 >> 172.21.15.142:0/259447367 conn(0x7f74b80fc840 msgr2=0x7f74b80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 shutdown_connections 2023-09-21T12:56:30.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:30.524+0000 7f74be9ff700 1 -- 172.21.15.142:0/259447367 wait complete. 2023-09-21T12:56:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:31 smithi142 ceph-mon[97663]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2023-09-21T12:56:32.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:31 smithi160 ceph-mon[134450]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2023-09-21T12:56:32.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:31 smithi156 ceph-mon[134078]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 77 KiB/s wr, 43 op/s 2023-09-21T12:56:34.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:33 smithi160 ceph-mon[134450]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2023-09-21T12:56:34.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:33 smithi156 ceph-mon[134078]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2023-09-21T12:56:34.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:33 smithi142 ceph-mon[97663]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 77 KiB/s wr, 45 op/s 2023-09-21T12:56:35.669 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:56:35.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.882+0000 7f14ff7ff700 1 -- 172.21.15.142:0/1859146395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 msgr2=0x7f14f8101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.882+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/1859146395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f8101380 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009990 tx=0x7f14f4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 -- 172.21.15.142:0/1859146395 shutdown_connections 2023-09-21T12:56:35.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/1859146395 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f8101380 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/1859146395 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f81060c0 0x7f14f810dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/1859146395 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f8101950 0x7f14f8105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 -- 172.21.15.142:0/1859146395 >> 172.21.15.142:0/1859146395 conn(0x7f14f80fc860 msgr2=0x7f14f80fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 -- 172.21.15.142:0/1859146395 shutdown_connections 2023-09-21T12:56:35.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.883+0000 7f14ff7ff700 1 -- 172.21.15.142:0/1859146395 wait complete. 2023-09-21T12:56:35.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 Processor -- start 2023-09-21T12:56:35.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 -- start start 2023-09-21T12:56:35.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f81060c0 0x7f14f8073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f8073b60 0x7f14f81a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81a5760 con 0x7f14f8100fa0 2023-09-21T12:56:35.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81a58d0 con 0x7f14f81060c0 2023-09-21T12:56:35.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14ff7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f81a5a90 con 0x7f14f8073b60 2023-09-21T12:56:35.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41566/0 (socket says 172.21.15.142:41566) 2023-09-21T12:56:35.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14fd59b700 1 -- 172.21.15.142:0/3902911894 learned_addr learned my addr 172.21.15.142:0/3902911894 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:35.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.884+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f81060c0 0x7f14f8073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f8073b60 0x7f14f81a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 -- 172.21.15.142:0/3902911894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f8073b60 msgr2=0x7f14f81a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f8073b60 0x7f14f81a50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 -- 172.21.15.142:0/3902911894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f81060c0 msgr2=0x7f14f8073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f81060c0 0x7f14f8073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 -- 172.21.15.142:0/3902911894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40095f0 con 0x7f14f8100fa0 2023-09-21T12:56:35.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005910 tx=0x7f14f4005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14ee7fc700 1 -- 172.21.15.142:0/3902911894 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f401d070 con 0x7f14f8100fa0 2023-09-21T12:56:35.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14ee7fc700 1 -- 172.21.15.142:0/3902911894 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f4022470 con 0x7f14f8100fa0 2023-09-21T12:56:35.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f81a5d10 con 0x7f14f8100fa0 2023-09-21T12:56:35.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14ee7fc700 1 -- 172.21.15.142:0/3902911894 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f4017650 con 0x7f14f8100fa0 2023-09-21T12:56:35.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.885+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81a6190 con 0x7f14f8100fa0 2023-09-21T12:56:35.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.888+0000 7f14ee7fc700 1 -- 172.21.15.142:0/3902911894 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f14f40225e0 con 0x7f14f8100fa0 2023-09-21T12:56:35.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 Processor -- start 2023-09-21T12:56:35.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f14ee7fc700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 0x7f14e40a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 -- start start 2023-09-21T12:56:35.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f14ee7fc700 1 -- 172.21.15.142:0/3902911894 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14f40cd630 con 0x7f14f8100fa0 2023-09-21T12:56:35.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 0x7f14e40a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ed5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ed67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77e45ca0 con 0x55cf77ed6360 2023-09-21T12:56:35.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77e29c70 con 0x55cf77ed1f30 2023-09-21T12:56:35.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f15130fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77e27590 con 0x55cf77ed1610 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.890+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46158/0 (socket says 172.21.15.142:46158) 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 -- 172.21.15.142:0/428827494 learned_addr learned my addr 172.21.15.142:0/428827494 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ed5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ed67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 -- 172.21.15.142:0/428827494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 msgr2=0x55cf77ed5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ed5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 -- 172.21.15.142:0/428827494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 msgr2=0x55cf77ed67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ed67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 -- 172.21.15.142:0/428827494 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf77c4dde0 con 0x55cf77ed1610 2023-09-21T12:56:35.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 0x7f14e40a2d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14f00075c0 tx=0x7f14f0007980 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14fd59b700 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14f4029000 tx=0x7f14f4096f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e38f67c829af08 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14e37fe700 1 -- 172.21.15.142:0/428827494 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f409aaf0 con 0x55cf77ed1610 2023-09-21T12:56:35.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14e37fe700 1 -- 172.21.15.142:0/428827494 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f409e920 con 0x55cf77ed1610 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.891+0000 7f14e37fe700 1 -- 172.21.15.142:0/428827494 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f409af50 con 0x55cf77ed1610 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 -- 172.21.15.142:0/428827494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 msgr2=0x55cf77ed19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f14f4029000 tx=0x7f14f4096f60 comp rx=0 tx=0).stop 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 -- 172.21.15.142:0/428827494 shutdown_connections 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ed67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ed19f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 --2- 172.21.15.142:0/428827494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ed5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 -- 172.21.15.142:0/428827494 >> 172.21.15.142:0/428827494 conn(0x55cf77dfe000 msgr2=0x55cf77ecc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 -- 172.21.15.142:0/428827494 shutdown_connections 2023-09-21T12:56:35.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.892+0000 7f15130fab80 1 -- 172.21.15.142:0/428827494 wait complete. 2023-09-21T12:56:35.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.893+0000 7f15130fab80 1 -- start start 2023-09-21T12:56:35.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.893+0000 7f15130fab80 1 Processor -- start 2023-09-21T12:56:35.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77edaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 0x55cf77edb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77e22e80 con 0x55cf77ed1610 2023-09-21T12:56:35.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77dbf740 con 0x55cf77ed6360 2023-09-21T12:56:35.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77dbf3e0 con 0x55cf77ed1f30 2023-09-21T12:56:35.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f15130fab80 10 client.0 _ll_register_callbacks cb 0x55cf77d09a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:35.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41590/0 (socket says 172.21.15.142:41590) 2023-09-21T12:56:35.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 -- 172.21.15.142:0/2178307258 learned_addr learned my addr 172.21.15.142:0/2178307258 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:35.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77edaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 0x55cf77edb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 -- 172.21.15.142:0/2178307258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 msgr2=0x55cf77edaca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77edaca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 -- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 msgr2=0x55cf77edb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 0x55cf77edb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fd59b700 1 -- 172.21.15.142:0/2178307258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81a6190 con 0x55cf77ed1610 2023-09-21T12:56:35.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77edaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:35.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.894+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 0x55cf77edb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:35.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14fd59b700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f14f4097560 tx=0x7f14f4009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d100db55ddffd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:35.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40a2ad0 con 0x55cf77ed1610 2023-09-21T12:56:35.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14f409aaf0 con 0x55cf77ed1610 2023-09-21T12:56:35.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf77d93bb0 con 0x55cf77ed1610 2023-09-21T12:56:35.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f4098e90 con 0x55cf77ed1610 2023-09-21T12:56:35.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 10 client.15411 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:35.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cf77c36c60 con 0x55cf77ed1610 2023-09-21T12:56:35.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f40a6020 con 0x55cf77ed1610 2023-09-21T12:56:35.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f14f40a2d20 con 0x55cf77ed1610 2023-09-21T12:56:35.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 10 client.15411 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:35.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 10 client.15411 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 20 client.15411 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77eeabe0 0x55cf77eed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 4 client.15411 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.895+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf77ea0020 con 0x55cf77eeabe0 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.896+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77eeabe0 0x55cf77eed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.896+0000 7f14e0ff9700 10 client.15411 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:35.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.896+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77eeabe0 0x55cf77eed000 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d320ba9e46f8765f server_cookie=cb832951f21248f2 in_seq=0 out_seq=0 2023-09-21T12:56:35.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f14e0ff9700 1 -- 172.21.15.142:0/2178307258 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf77ea0020 con 0x55cf77eeabe0 2023-09-21T12:56:35.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f14e0ff9700 10 client.15411 handle_command_reply: tid=0 2023-09-21T12:56:35.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 client.15411 shutdown 2023-09-21T12:56:35.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 msgr2=0x55cf77edda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f14f4097560 tx=0x7f14f4009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 shutdown_connections 2023-09-21T12:56:35.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77eeabe0 0x55cf77eed000 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed1610 0x55cf77edda90 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed6360 0x55cf77edb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f14e0ff9700 0 client.15411 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:35.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 --2- 172.21.15.142:0/2178307258 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77edaca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 >> 172.21.15.142:0/2178307258 conn(0x55cf77dfe000 msgr2=0x55cf77ecc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 shutdown_connections 2023-09-21T12:56:35.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.897+0000 7f15130fab80 1 -- 172.21.15.142:0/2178307258 wait complete. 2023-09-21T12:56:35.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.898+0000 7f15130fab80 20 client.15411 trim_cache size 0 max 16384 2023-09-21T12:56:35.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 Processor -- start 2023-09-21T12:56:35.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 -- start start 2023-09-21T12:56:35.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 0x55cf77edac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77ee2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77ca3920 con 0x55cf77ed6360 2023-09-21T12:56:35.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77eccc30 con 0x55cf77ed1610 2023-09-21T12:56:35.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f15130fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77ed2670 con 0x55cf77ed1f30 2023-09-21T12:56:35.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f14fdd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f14fdd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41592/0 (socket says 172.21.15.142:41592) 2023-09-21T12:56:35.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f14fdd9c700 1 -- 172.21.15.142:0/4171261200 learned_addr learned my addr 172.21.15.142:0/4171261200 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:35.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f14fd59b700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 0x55cf77edac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.915+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77ee2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 -- 172.21.15.142:0/4171261200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 msgr2=0x55cf77ee2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77ee2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 -- 172.21.15.142:0/4171261200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 msgr2=0x55cf77edac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 0x55cf77edac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 -- 172.21.15.142:0/4171261200 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf77ef1bf0 con 0x55cf77ed6360 2023-09-21T12:56:35.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fd59b700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 0x55cf77edac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:35.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14fdd9c700 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14f00199d0 tx=0x7f14f0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21dfd80d5643c0cd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14e3fff700 1 -- 172.21.15.142:0/4171261200 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0018750 con 0x55cf77ed6360 2023-09-21T12:56:35.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14e3fff700 1 -- 172.21.15.142:0/4171261200 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f000f070 con 0x55cf77ed6360 2023-09-21T12:56:35.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.916+0000 7f14e3fff700 1 -- 172.21.15.142:0/4171261200 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0025c10 con 0x55cf77ed6360 2023-09-21T12:56:35.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- 172.21.15.142:0/4171261200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 msgr2=0x55cf77edd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f14f00199d0 tx=0x7f14f0007f90 comp rx=0 tx=0).stop 2023-09-21T12:56:35.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- 172.21.15.142:0/4171261200 shutdown_connections 2023-09-21T12:56:35.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77edd5c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1610 0x55cf77edac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 --2- 172.21.15.142:0/4171261200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1f30 0x55cf77ee2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- 172.21.15.142:0/4171261200 >> 172.21.15.142:0/4171261200 conn(0x55cf77dfe000 msgr2=0x55cf77eda540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- 172.21.15.142:0/4171261200 shutdown_connections 2023-09-21T12:56:35.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- 172.21.15.142:0/4171261200 wait complete. 2023-09-21T12:56:35.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.917+0000 7f15130fab80 1 -- start start 2023-09-21T12:56:35.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 Processor -- start 2023-09-21T12:56:35.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ee06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ee0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77ee1350 con 0x55cf77ed6360 2023-09-21T12:56:35.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77ee14c0 con 0x55cf77ed1f30 2023-09-21T12:56:35.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf77f3e9e0 con 0x55cf77ed1610 2023-09-21T12:56:35.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f15130fab80 10 client.0 _ll_register_callbacks cb 0x55cf77d09a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:35.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f14fdd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ee0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f14fd59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46186/0 (socket says 172.21.15.142:46186) 2023-09-21T12:56:35.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f14fd59b700 1 -- 172.21.15.142:0/3691148515 learned_addr learned my addr 172.21.15.142:0/3691148515 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:35.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.918+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ee06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 -- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 msgr2=0x55cf77ee06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ee06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 -- 172.21.15.142:0/3691148515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 msgr2=0x55cf77ee0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:35.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ee0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 -- 172.21.15.142:0/3691148515 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf77c36c60 con 0x55cf77ed1610 2023-09-21T12:56:35.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14fd59b700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14f409aa80 tx=0x7f14f40093a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b2cecd2582e9710 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:35.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:35.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40cabd0 con 0x55cf77ed1610 2023-09-21T12:56:35.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14f409e920 con 0x55cf77ed1610 2023-09-21T12:56:35.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14f40a7080 con 0x55cf77ed1610 2023-09-21T12:56:35.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14f409a630 con 0x55cf77ed1610 2023-09-21T12:56:35.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f15130fab80 10 client.25420 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:35.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.919+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f14f0019710 con 0x55cf77ed1610 2023-09-21T12:56:35.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14f409e920 con 0x55cf77ed1610 2023-09-21T12:56:35.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f14f40a2d20 con 0x55cf77ed1610 2023-09-21T12:56:35.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 10 client.25420 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:35.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 10 client.25420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:35.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 20 client.25420 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:35.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77f3fcb0 0x55cf77f420d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:35.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 4 client.25420 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:56:35.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cf77e1be60 con 0x55cf77f3fcb0 2023-09-21T12:56:35.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.920+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77f3fcb0 0x55cf77f420d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:35.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f14fcd9a700 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77f3fcb0 0x55cf77f420d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=519e34268c6c20f2 server_cookie=e8ebe6108aeeb353 in_seq=0 out_seq=0 2023-09-21T12:56:35.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f14e0ff9700 10 client.25420 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:35.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f14e0ff9700 1 -- 172.21.15.142:0/3691148515 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cf77e1be60 con 0x55cf77f3fcb0 2023-09-21T12:56:35.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f14e0ff9700 10 client.25420 handle_command_reply: tid=0 2023-09-21T12:56:35.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 client.25420 shutdown 2023-09-21T12:56:35.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 msgr2=0x55cf77ee2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f14f409aa80 tx=0x7f14f40093a0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 shutdown_connections 2023-09-21T12:56:35.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf77f3fcb0 0x55cf77f420d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf77ed6360 0x55cf77ee0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f14e0ff9700 0 client.25420 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf77ed1610 0x55cf77ee2180 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 --2- 172.21.15.142:0/3691148515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf77ed1f30 0x55cf77ee06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 >> 172.21.15.142:0/3691148515 conn(0x55cf77dfe000 msgr2=0x55cf77ecb880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 shutdown_connections 2023-09-21T12:56:35.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.921+0000 7f15130fab80 1 -- 172.21.15.142:0/3691148515 wait complete. 2023-09-21T12:56:35.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f15130fab80 20 client.25420 trim_cache size 0 max 16384 2023-09-21T12:56:35.942 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:56:35.943 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:56:35.943 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:56:35.943 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:56:35.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 msgr2=0x7f14e40a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 0x7f14e40a2d80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f14f00075c0 tx=0x7f14f0007980 comp rx=0 tx=0).stop 2023-09-21T12:56:35.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 msgr2=0x7f14f80730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:35.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f14f4005910 tx=0x7f14f4005740 comp rx=0 tx=0).stop 2023-09-21T12:56:35.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 shutdown_connections 2023-09-21T12:56:35.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14e40a08c0 0x7f14e40a2d80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f8100fa0 0x7f14f80730e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f8073b60 0x7f14f81a50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 --2- 172.21.15.142:0/3902911894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f81060c0 0x7f14f8073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:35.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 >> 172.21.15.142:0/3902911894 conn(0x7f14f80fc860 msgr2=0x7f14f80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:35.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 shutdown_connections 2023-09-21T12:56:35.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:35.922+0000 7f14ff7ff700 1 -- 172.21.15.142:0/3902911894 wait complete. 2023-09-21T12:56:35.948 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:56:35.948 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:56:36.009 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:35 smithi142 ceph-mon[97663]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:56:36.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.147+0000 7fb041fff700 1 -- 172.21.15.142:0/1911455761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c1060f0 msgr2=0x7fb03c10dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.147+0000 7fb041fff700 1 --2- 172.21.15.142:0/1911455761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c1060f0 0x7fb03c10dc70 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb03400b0a0 tx=0x7fb03400b3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 -- 172.21.15.142:0/1911455761 shutdown_connections 2023-09-21T12:56:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 --2- 172.21.15.142:0/1911455761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c1060f0 0x7fb03c10dc70 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 --2- 172.21.15.142:0/1911455761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c100fd0 0x7fb03c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 --2- 172.21.15.142:0/1911455761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c101980 0x7fb03c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 -- 172.21.15.142:0/1911455761 >> 172.21.15.142:0/1911455761 conn(0x7fb03c0fc890 msgr2=0x7fb03c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 -- 172.21.15.142:0/1911455761 shutdown_connections 2023-09-21T12:56:36.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.148+0000 7fb041fff700 1 -- 172.21.15.142:0/1911455761 wait complete. 2023-09-21T12:56:36.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 Processor -- start 2023-09-21T12:56:36.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 -- start start 2023-09-21T12:56:36.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c1060f0 0x7fb03c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c19db40 0x7fb03c19dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c19e5c0 con 0x7fb03c100fd0 2023-09-21T12:56:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c19e730 con 0x7fb03c19db40 2023-09-21T12:56:36.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb041fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c19e8f0 con 0x7fb03c1060f0 2023-09-21T12:56:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.149+0000 7fb03b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41630/0 (socket says 172.21.15.142:41630) 2023-09-21T12:56:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 -- 172.21.15.142:0/1900826827 learned_addr learned my addr 172.21.15.142:0/1900826827 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03affd700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c1060f0 0x7fb03c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03bfff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c19db40 0x7fb03c19dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 -- 172.21.15.142:0/1900826827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c1060f0 msgr2=0x7fb03c1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c1060f0 0x7fb03c1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 -- 172.21.15.142:0/1900826827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c19db40 msgr2=0x7fb03c19dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c19db40 0x7fb03c19dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 -- 172.21.15.142:0/1900826827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c009520 con 0x7fb03c100fd0 2023-09-21T12:56:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb03b7fe700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00eb30 tx=0x7fb02c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c009880 con 0x7fb03c100fd0 2023-09-21T12:56:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb02c0044e0 con 0x7fb03c100fd0 2023-09-21T12:56:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb034009d00 con 0x7fb03c100fd0 2023-09-21T12:56:36.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.150+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c003d80 con 0x7fb03c100fd0 2023-09-21T12:56:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.151+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c1a61a0 con 0x7fb03c100fd0 2023-09-21T12:56:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.152+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c067bd0 con 0x7fb03c100fd0 2023-09-21T12:56:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.154+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7fb02c003f20 con 0x7fb03c100fd0 2023-09-21T12:56:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.155+0000 7fb038ff9700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 0x7fb0240a2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.155+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb02c014070 con 0x7fb03c100fd0 2023-09-21T12:56:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.155+0000 7fb03affd700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 0x7fb0240a2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.156+0000 7fb03affd700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 0x7fb0240a2d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb03c19a7b0 tx=0x7fb030009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.159+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb02c095d00 con 0x7fb03c100fd0 2023-09-21T12:56:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:35 smithi160 ceph-mon[134450]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:56:36.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:35 smithi156 ceph-mon[134078]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2023-09-21T12:56:36.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.407+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb03c101bd0 con 0x7fb03c100fd0 2023-09-21T12:56:36.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.407+0000 7fb038ff9700 1 -- 172.21.15.142:0/1900826827 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7fb03c101bd0 con 0x7fb03c100fd0 2023-09-21T12:56:36.407 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:56:36.407 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:56:36.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 msgr2=0x7fb0240a2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 0x7fb0240a2d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb03c19a7b0 tx=0x7fb030009260 comp rx=0 tx=0).stop 2023-09-21T12:56:36.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 msgr2=0x7fb03c1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb02c00eb30 tx=0x7fb02c00ee40 comp rx=0 tx=0).stop 2023-09-21T12:56:36.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 shutdown_connections 2023-09-21T12:56:36.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb0240a0880 0x7fb0240a2d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb03c100fd0 0x7fb03c1991a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb03c19db40 0x7fb03c19dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 --2- 172.21.15.142:0/1900826827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c1060f0 0x7fb03c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 >> 172.21.15.142:0/1900826827 conn(0x7fb03c0fc890 msgr2=0x7fb03c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 shutdown_connections 2023-09-21T12:56:36.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.410+0000 7fb041fff700 1 -- 172.21.15.142:0/1900826827 wait complete. 2023-09-21T12:56:36.412 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:56:36.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:56:36.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 -- 172.21.15.142:0/3469868322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 msgr2=0x7f71a410dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/3469868322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a410dc40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f719c00b0a0 tx=0x7f719c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 -- 172.21.15.142:0/3469868322 shutdown_connections 2023-09-21T12:56:36.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/3469868322 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a410dc40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/3469868322 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/3469868322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a4101950 0x7f71a4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 -- 172.21.15.142:0/3469868322 >> 172.21.15.142:0/3469868322 conn(0x7f71a40fc860 msgr2=0x7f71a40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 -- 172.21.15.142:0/3469868322 shutdown_connections 2023-09-21T12:56:36.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.636+0000 7f71ab5ff700 1 -- 172.21.15.142:0/3469868322 wait complete. 2023-09-21T12:56:36.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.638+0000 7f71ab5ff700 1 Processor -- start 2023-09-21T12:56:36.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.638+0000 7f71ab5ff700 1 -- start start 2023-09-21T12:56:36.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a419b990 0x7f71a419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a419c410 con 0x7f71a41060c0 2023-09-21T12:56:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a419c580 con 0x7f71a4100fa0 2023-09-21T12:56:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71ab5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a419c740 con 0x7f71a419b990 2023-09-21T12:56:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41648/0 (socket says 172.21.15.142:41648) 2023-09-21T12:56:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 -- 172.21.15.142:0/2426467642 learned_addr learned my addr 172.21.15.142:0/2426467642 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a939b700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a419b990 0x7f71a419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 -- 172.21.15.142:0/2426467642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a419b990 msgr2=0x7f71a419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a419b990 0x7f71a419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 -- 172.21.15.142:0/2426467642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 msgr2=0x7f71a4196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a8b9a700 1 -- 172.21.15.142:0/2426467642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c009d00 con 0x7f71a41060c0 2023-09-21T12:56:36.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.639+0000 7f71a939b700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:36.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f719400e970 tx=0x7f719400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f719a7fc700 1 -- 172.21.15.142:0/2426467642 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194009790 con 0x7f71a41060c0 2023-09-21T12:56:36.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f719a7fc700 1 -- 172.21.15.142:0/2426467642 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f719400c7e0 con 0x7f71a41060c0 2023-09-21T12:56:36.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a41a3ca0 con 0x7f71a41060c0 2023-09-21T12:56:36.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f719a7fc700 1 -- 172.21.15.142:0/2426467642 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940054e0 con 0x7f71a41060c0 2023-09-21T12:56:36.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.640+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a41a4180 con 0x7f71a41060c0 2023-09-21T12:56:36.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.643+0000 7f719a7fc700 1 -- 172.21.15.142:0/2426467642 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f719400c950 con 0x7f71a41060c0 2023-09-21T12:56:36.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.644+0000 7f71bef6db80 1 Processor -- start 2023-09-21T12:56:36.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.644+0000 7f719a7fc700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 0x7f71900a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 -- start start 2023-09-21T12:56:36.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f719a7fc700 1 -- 172.21.15.142:0/2426467642 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7194014070 con 0x7f71a41060c0 2023-09-21T12:56:36.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406f9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f9770 0x55d8406f9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 0x7f71900a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d840664ca0 con 0x55d8406f9770 2023-09-21T12:56:36.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d840648c70 con 0x55d8406f4a20 2023-09-21T12:56:36.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71bef6db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d840646590 con 0x55d8406f5340 2023-09-21T12:56:36.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a939b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a939b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46962/0 (socket says 172.21.15.142:46962) 2023-09-21T12:56:36.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a939b700 1 -- 172.21.15.142:0/2033681877 learned_addr learned my addr 172.21.15.142:0/2033681877 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f9770 0x55d8406f9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.645+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 -- 172.21.15.142:0/2033681877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 msgr2=0x55d8406f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 -- 172.21.15.142:0/2033681877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f9770 msgr2=0x55d8406f9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f9770 0x55d8406f9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 -- 172.21.15.142:0/2033681877 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d84046cde0 con 0x55d8406f4a20 2023-09-21T12:56:36.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 0x7f71900a2d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f719c0062a0 tx=0x7f719c0094a0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f71a939b700 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71a00115f0 tx=0x7f71a0011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6e7cf1b5e002c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f718f7fe700 1 -- 172.21.15.142:0/2033681877 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0019630 con 0x55d8406f4a20 2023-09-21T12:56:36.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f718f7fe700 1 -- 172.21.15.142:0/2033681877 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71a0019c50 con 0x55d8406f4a20 2023-09-21T12:56:36.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.646+0000 7f718f7fe700 1 -- 172.21.15.142:0/2033681877 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a000eb00 con 0x55d8406f4a20 2023-09-21T12:56:36.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 -- 172.21.15.142:0/2033681877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 msgr2=0x55d8406f4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f71a00115f0 tx=0x7f71a0011900 comp rx=0 tx=0).stop 2023-09-21T12:56:36.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 -- 172.21.15.142:0/2033681877 shutdown_connections 2023-09-21T12:56:36.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f9770 0x55d8406f9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f4a20 0x55d8406f4e00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 --2- 172.21.15.142:0/2033681877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 -- 172.21.15.142:0/2033681877 >> 172.21.15.142:0/2033681877 conn(0x55d84061d000 msgr2=0x55d8406eb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 -- 172.21.15.142:0/2033681877 shutdown_connections 2023-09-21T12:56:36.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.647+0000 7f71bef6db80 1 -- 172.21.15.142:0/2033681877 wait complete. 2023-09-21T12:56:36.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 -- start start 2023-09-21T12:56:36.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 Processor -- start 2023-09-21T12:56:36.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d8406fe890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d840641e80 con 0x55d8406f4a20 2023-09-21T12:56:36.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8405de740 con 0x55d8406f9770 2023-09-21T12:56:36.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8405de3e0 con 0x55d8406f5340 2023-09-21T12:56:36.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.648+0000 7f71bef6db80 10 client.0 _ll_register_callbacks cb 0x55d840528a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:36.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41666/0 (socket says 172.21.15.142:41666) 2023-09-21T12:56:36.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 -- 172.21.15.142:0/3390243402 learned_addr learned my addr 172.21.15.142:0/3390243402 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d8406fe890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 -- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 msgr2=0x55d8406fe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 -- 172.21.15.142:0/3390243402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 msgr2=0x55d8406fe890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d8406fe890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 -- 172.21.15.142:0/3390243402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a0009dd0 con 0x55d8406f4a20 2023-09-21T12:56:36.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f71a939b700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71a0000c00 tx=0x7f71a000e540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ca23d11ac63fa server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f718cff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:36.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.649+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0019840 con 0x55d8406f4a20 2023-09-21T12:56:36.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8405b2bb0 con 0x55d8406f4a20 2023-09-21T12:56:36.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71a0005ce0 con 0x55d8406f4a20 2023-09-21T12:56:36.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71a00199a0 con 0x55d8406f4a20 2023-09-21T12:56:36.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 10 client.15435 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:36.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d840455c60 con 0x55d8406f4a20 2023-09-21T12:56:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d8405b2bb0 con 0x55d8406f4a20 2023-09-21T12:56:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f71a00038c0 con 0x55d8406f4a20 2023-09-21T12:56:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 10 client.15435 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 10 client.15435 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:56:36.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 20 client.15435 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:36.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d84070e740 0x55d840710b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 4 client.15435 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:36.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.650+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8406bf020 con 0x55d84070e740 2023-09-21T12:56:36.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.651+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d84070e740 0x55d840710b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.651+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d84070e740 0x55d840710b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7cb97a64774096bb server_cookie=6c0ad086c3d6d172 in_seq=0 out_seq=0 2023-09-21T12:56:36.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.651+0000 7f718cff9700 10 client.15435 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:56:36.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.652+0000 7f718cff9700 1 -- 172.21.15.142:0/3390243402 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8406bf020 con 0x55d84070e740 2023-09-21T12:56:36.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.652+0000 7f718cff9700 10 client.15435 handle_command_reply: tid=0 2023-09-21T12:56:36.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.652+0000 7f71bef6db80 1 client.15435 shutdown 2023-09-21T12:56:36.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.652+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 msgr2=0x55d840700f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.652+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f71a0000c00 tx=0x7f71a000e540 comp rx=0 tx=0).stop 2023-09-21T12:56:36.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 shutdown_connections 2023-09-21T12:56:36.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d84070e740 0x55d840710b30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840700f40 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d8406fe890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3390243402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f718cff9700 0 client.15435 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:56:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 >> 172.21.15.142:0/3390243402 conn(0x55d84061d000 msgr2=0x55d8406eb230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 shutdown_connections 2023-09-21T12:56:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 1 -- 172.21.15.142:0/3390243402 wait complete. 2023-09-21T12:56:36.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.653+0000 7f71bef6db80 20 client.15435 trim_cache size 0 max 16384 2023-09-21T12:56:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.666+0000 7f71bef6db80 1 Processor -- start 2023-09-21T12:56:36.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.666+0000 7f71bef6db80 1 -- start start 2023-09-21T12:56:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d8406fe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d840700a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8404c2920 con 0x55d8406f4a20 2023-09-21T12:56:36.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8406e5990 con 0x55d8406f9770 2023-09-21T12:56:36.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71bef6db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8406ec410 con 0x55d8406f5340 2023-09-21T12:56:36.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d8406fe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46266/0 (socket says 172.21.15.142:46266) 2023-09-21T12:56:36.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3766075852 learned_addr learned my addr 172.21.15.142:0/3766075852 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d840700a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3766075852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 msgr2=0x55d840700a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d840700a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3766075852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 msgr2=0x55d8406fe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d8406fe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3766075852 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8406ea0b0 con 0x55d8406f5340 2023-09-21T12:56:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.667+0000 7f71a939b700 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d8406fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7194095b20 tx=0x7f7194084040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f223dcf9d87598c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f718ffff700 1 -- 172.21.15.142:0/3766075852 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194099d80 con 0x55d8406f5340 2023-09-21T12:56:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f718ffff700 1 -- 172.21.15.142:0/3766075852 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7194099620 con 0x55d8406f5340 2023-09-21T12:56:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f718ffff700 1 -- 172.21.15.142:0/3766075852 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940840b0 con 0x55d8406f5340 2023-09-21T12:56:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 -- 172.21.15.142:0/3766075852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 msgr2=0x55d8406fab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7194095b20 tx=0x7f7194084040 comp rx=0 tx=0).stop 2023-09-21T12:56:36.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 -- 172.21.15.142:0/3766075852 shutdown_connections 2023-09-21T12:56:36.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d8406fe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d840700a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.668+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3766075852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d8406fab60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.669+0000 7f71bef6db80 1 -- 172.21.15.142:0/3766075852 >> 172.21.15.142:0/3766075852 conn(0x55d84061d000 msgr2=0x55d8406fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.669+0000 7f71bef6db80 1 -- 172.21.15.142:0/3766075852 shutdown_connections 2023-09-21T12:56:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.669+0000 7f71bef6db80 1 -- 172.21.15.142:0/3766075852 wait complete. 2023-09-21T12:56:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.669+0000 7f71bef6db80 1 -- start start 2023-09-21T12:56:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.669+0000 7f71bef6db80 1 Processor -- start 2023-09-21T12:56:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d84075b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84075bb00 con 0x55d8406f4a20 2023-09-21T12:56:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84075bc70 con 0x55d8406f9770 2023-09-21T12:56:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d84075be30 con 0x55d8406f5340 2023-09-21T12:56:36.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71bef6db80 10 client.0 _ll_register_callbacks cb 0x55d840528a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46280/0 (socket says 172.21.15.142:46280) 2023-09-21T12:56:36.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a939b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41692/0 (socket says 172.21.15.142:41692) 2023-09-21T12:56:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3160471266 learned_addr learned my addr 172.21.15.142:0/3160471266 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d84075b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3160471266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 msgr2=0x55d84075b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d84075b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3160471266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 msgr2=0x55d840703ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a8b9a700 1 -- 172.21.15.142:0/3160471266 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d840455c60 con 0x55d8406f5340 2023-09-21T12:56:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a9b9c700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d84075b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.670+0000 7f71a939b700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:36.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71a8b9a700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7194004800 tx=0x7f7194005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b380a816b939b18 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719409d160 con 0x55d8406f5340 2023-09-21T12:56:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71a0019c50 con 0x55d8406f5340 2023-09-21T12:56:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f71940840b0 con 0x55d8406f5340 2023-09-21T12:56:36.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7194084270 con 0x55d8406f5340 2023-09-21T12:56:36.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 10 client.25444 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:36.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f71a41a4180 con 0x55d8406f5340 2023-09-21T12:56:36.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f71a0019c50 con 0x55d8406f5340 2023-09-21T12:56:36.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7194099880 con 0x55d8406f5340 2023-09-21T12:56:36.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 10 client.25444 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:36.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 10 client.25444 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:56:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 20 client.25444 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.671+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d840763270 0x55d840765690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f71bef6db80 4 client.25444 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:56:36.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d84063ae60 con 0x55d840763270 2023-09-21T12:56:36.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f71a939b700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d840763270 0x55d840765690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f71a939b700 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d840763270 0x55d840765690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32bd48a106e218e2 server_cookie=9cd8f5df5c8add89 in_seq=0 out_seq=0 2023-09-21T12:56:36.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f718cff9700 10 client.25444 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:56:36.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f718cff9700 1 -- 172.21.15.142:0/3160471266 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d84063ae60 con 0x55d840763270 2023-09-21T12:56:36.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f718cff9700 10 client.25444 handle_command_reply: tid=0 2023-09-21T12:56:36.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.672+0000 7f71bef6db80 1 client.25444 shutdown 2023-09-21T12:56:36.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 msgr2=0x55d840704010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7194004800 tx=0x7f7194005d50 comp rx=0 tx=0).stop 2023-09-21T12:56:36.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 shutdown_connections 2023-09-21T12:56:36.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d840763270 0x55d840765690 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8406f4a20 0x55d840703ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8406f9770 0x55d84075b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f718cff9700 0 client.25444 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:56:36.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 --2- 172.21.15.142:0/3160471266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8406f5340 0x55d840704010 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 >> 172.21.15.142:0/3160471266 conn(0x55d84061d000 msgr2=0x55d8406f8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 shutdown_connections 2023-09-21T12:56:36.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 1 -- 172.21.15.142:0/3160471266 wait complete. 2023-09-21T12:56:36.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71bef6db80 20 client.25444 trim_cache size 0 max 16384 2023-09-21T12:56:36.697 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:56:36.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 msgr2=0x7f71900a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 0x7f71900a2d00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f719c0062a0 tx=0x7f719c0094a0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 msgr2=0x7f71a4197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f719400e970 tx=0x7f719400ec80 comp rx=0 tx=0).stop 2023-09-21T12:56:36.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 shutdown_connections 2023-09-21T12:56:36.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71900a0840 0x7f71900a2d00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71a419b990 0x7f71a419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f71a4100fa0 0x7f71a4196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.673+0000 7f71ab5ff700 1 --2- 172.21.15.142:0/2426467642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f71a41060c0 0x7f71a4197530 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.674+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 >> 172.21.15.142:0/2426467642 conn(0x7f71a40fc860 msgr2=0x7f71a40fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.674+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 shutdown_connections 2023-09-21T12:56:36.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.674+0000 7f71ab5ff700 1 -- 172.21.15.142:0/2426467642 wait complete. 2023-09-21T12:56:36.702 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:56:36.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 -- 172.21.15.142:0/2968240620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c101970 msgr2=0x7f827c1059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 --2- 172.21.15.142:0/2968240620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c101970 0x7f827c1059b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f826c009990 tx=0x7f826c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 -- 172.21.15.142:0/2968240620 shutdown_connections 2023-09-21T12:56:36.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 --2- 172.21.15.142:0/2968240620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c1060e0 0x7f827c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 --2- 172.21.15.142:0/2968240620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c100fc0 0x7f827c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 --2- 172.21.15.142:0/2968240620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c101970 0x7f827c1059b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 -- 172.21.15.142:0/2968240620 >> 172.21.15.142:0/2968240620 conn(0x7f827c0fc840 msgr2=0x7f827c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 -- 172.21.15.142:0/2968240620 shutdown_connections 2023-09-21T12:56:36.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.904+0000 7f82843ff700 1 -- 172.21.15.142:0/2968240620 wait complete. 2023-09-21T12:56:36.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.905+0000 7f82843ff700 1 Processor -- start 2023-09-21T12:56:36.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.905+0000 7f82843ff700 1 -- start start 2023-09-21T12:56:36.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.905+0000 7f82843ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.905+0000 7f82843ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c1060e0 0x7f827c1995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f82843ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c19da50 0x7f827c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f82843ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c19e4d0 con 0x7f827c100fc0 2023-09-21T12:56:36.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f82843ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c19e640 con 0x7f827c1060e0 2023-09-21T12:56:36.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f82843ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c19e800 con 0x7f827c19da50 2023-09-21T12:56:36.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41724/0 (socket says 172.21.15.142:41724) 2023-09-21T12:56:36.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 -- 172.21.15.142:0/1012392441 learned_addr learned my addr 172.21.15.142:0/1012392441 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828299c700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c19da50 0x7f827c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828199a700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c1060e0 0x7f827c1995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 -- 172.21.15.142:0/1012392441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c19da50 msgr2=0x7f827c19ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c19da50 0x7f827c19ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 -- 172.21.15.142:0/1012392441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c1060e0 msgr2=0x7f827c1995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c1060e0 0x7f827c1995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 -- 172.21.15.142:0/1012392441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8278009520 con 0x7f827c100fc0 2023-09-21T12:56:36.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.906+0000 7f828219b700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f827800eb30 tx=0x7f827800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.907+0000 7f82737fe700 1 -- 172.21.15.142:0/1012392441 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278009880 con 0x7f827c100fc0 2023-09-21T12:56:36.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.907+0000 7f82737fe700 1 -- 172.21.15.142:0/1012392441 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82780044e0 con 0x7f827c100fc0 2023-09-21T12:56:36.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.907+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f826c0095f0 con 0x7f827c100fc0 2023-09-21T12:56:36.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.907+0000 7f82737fe700 1 -- 172.21.15.142:0/1012392441 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278003d80 con 0x7f827c100fc0 2023-09-21T12:56:36.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.907+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c1a6100 con 0x7f827c100fc0 2023-09-21T12:56:36.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.910+0000 7f82737fe700 1 -- 172.21.15.142:0/1012392441 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f8278003f20 con 0x7f827c100fc0 2023-09-21T12:56:36.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f8297d3fb80 1 Processor -- start 2023-09-21T12:56:36.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f8297d3fb80 1 -- start start 2023-09-21T12:56:36.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f82737fe700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 0x7f82680a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f82737fe700 1 -- 172.21.15.142:0/1012392441 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8278014070 con 0x7f827c100fc0 2023-09-21T12:56:36.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.911+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefabf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefa2eca0 con 0x55faefabf360 2023-09-21T12:56:36.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefa12c70 con 0x55faefabaf30 2023-09-21T12:56:36.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefa10590 con 0x55faefaba610 2023-09-21T12:56:36.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828299c700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 0x7f82680a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46308/0 (socket says 172.21.15.142:46308) 2023-09-21T12:56:36.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 -- 172.21.15.142:0/4267467346 learned_addr learned my addr 172.21.15.142:0/4267467346 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828299c700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefabf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828199a700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 -- 172.21.15.142:0/4267467346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 msgr2=0x55faefabee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 -- 172.21.15.142:0/4267467346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 msgr2=0x55faefabf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefabf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 -- 172.21.15.142:0/4267467346 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faef836de0 con 0x55faefaba610 2023-09-21T12:56:36.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828299c700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefabf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:36.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.912+0000 7f828219b700 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82780a14a0 tx=0x7f8278099590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19115a22202410d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f828299c700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 0x7f82680a2d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8274009ec0 tx=0x7f8274009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f8270bfe700 1 -- 172.21.15.142:0/4267467346 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b9070 con 0x55faefaba610 2023-09-21T12:56:36.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f8270bfe700 1 -- 172.21.15.142:0/4267467346 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8278099960 con 0x55faefaba610 2023-09-21T12:56:36.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f8270bfe700 1 -- 172.21.15.142:0/4267467346 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780ca1c0 con 0x55faefaba610 2023-09-21T12:56:36.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f8297d3fb80 1 -- 172.21.15.142:0/4267467346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 msgr2=0x55faefaba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.913+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f82780a14a0 tx=0x7f8278099590 comp rx=0 tx=0).stop 2023-09-21T12:56:36.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 -- 172.21.15.142:0/4267467346 shutdown_connections 2023-09-21T12:56:36.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefabf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefaba610 0x55faefaba9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/4267467346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 -- 172.21.15.142:0/4267467346 >> 172.21.15.142:0/4267467346 conn(0x55faef9e7000 msgr2=0x55faefab56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 -- 172.21.15.142:0/4267467346 shutdown_connections 2023-09-21T12:56:36.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 -- 172.21.15.142:0/4267467346 wait complete. 2023-09-21T12:56:36.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 -- start start 2023-09-21T12:56:36.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.914+0000 7f8297d3fb80 1 Processor -- start 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefac43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefa0be80 con 0x55faefabf360 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faef9a8740 con 0x55faefaba610 2023-09-21T12:56:36.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faef9a83e0 con 0x55faefabaf30 2023-09-21T12:56:36.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f8297d3fb80 10 client.0 _ll_register_callbacks cb 0x55faef8f2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:36.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefac43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47038/0 (socket says 172.21.15.142:47038) 2023-09-21T12:56:36.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 -- 172.21.15.142:0/1903251985 learned_addr learned my addr 172.21.15.142:0/1903251985 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828199a700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 -- 172.21.15.142:0/1903251985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 msgr2=0x55faefac3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 -- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 msgr2=0x55faefac43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefac43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828219b700 1 -- 172.21.15.142:0/1903251985 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8278084040 con 0x55faefaba610 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.915+0000 7f828299c700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefac43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f828219b700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82780998f0 tx=0x7f827800ce40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afb62d4483d5e4ba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b7070 con 0x55faefaba610 2023-09-21T12:56:36.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f82780a19d0 con 0x55faefaba610 2023-09-21T12:56:36.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55faef97cbb0 con 0x55faefaba610 2023-09-21T12:56:36.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8278099bc0 con 0x55faefaba610 2023-09-21T12:56:36.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8297d3fb80 10 client.25496 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:36.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55faef81fc60 con 0x55faefaba610 2023-09-21T12:56:36.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55faef97cbb0 con 0x55faefaba610 2023-09-21T12:56:36.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.916+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f82780a1540 con 0x55faefaba610 2023-09-21T12:56:36.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 10 client.25496 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:36.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 10 client.25496 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:56:36.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 20 client.25496 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:36.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefad3ec0 0x55faefad62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 4 client.25496 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:36.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55faefa89020 con 0x55faefad3ec0 2023-09-21T12:56:36.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f828199a700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefad3ec0 0x55faefad62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f828199a700 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefad3ec0 0x55faefad62b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=afa2fa9cab5d4816 server_cookie=5d931221cecc0a69 in_seq=0 out_seq=0 2023-09-21T12:56:36.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.917+0000 7f8265ffb700 10 client.25496 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:56:36.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8265ffb700 1 -- 172.21.15.142:0/1903251985 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55faefa89020 con 0x55faefad3ec0 2023-09-21T12:56:36.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8265ffb700 10 client.25496 handle_command_reply: tid=0 2023-09-21T12:56:36.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 client.25496 shutdown 2023-09-21T12:56:36.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 msgr2=0x55faefac6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f82780998f0 tx=0x7f827800ce40 comp rx=0 tx=0).stop 2023-09-21T12:56:36.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 shutdown_connections 2023-09-21T12:56:36.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefabf360 0x55faefac43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefad3ec0 0x55faefad62b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefaba610 0x55faefac6aa0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1903251985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8265ffb700 0 client.25496 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:56:36.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.918+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 >> 172.21.15.142:0/1903251985 conn(0x55faef9e7000 msgr2=0x55faefab5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.919+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 shutdown_connections 2023-09-21T12:56:36.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.919+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1903251985 wait complete. 2023-09-21T12:56:36.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.919+0000 7f8297d3fb80 20 client.25496 trim_cache size 0 max 16384 2023-09-21T12:56:36.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 Processor -- start 2023-09-21T12:56:36.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 -- start start 2023-09-21T12:56:36.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabf360 0x55faefac0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faef88c920 con 0x55faefaba610 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefaaf990 con 0x55faefabaf30 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefad0d40 con 0x55faefabf360 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.936+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41750/0 (socket says 172.21.15.142:41750) 2023-09-21T12:56:36.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 -- 172.21.15.142:0/2169348726 learned_addr learned my addr 172.21.15.142:0/2169348726 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828299c700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabf360 0x55faefac0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828199a700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 -- 172.21.15.142:0/2169348726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabf360 msgr2=0x55faefac0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabf360 0x55faefac0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 -- 172.21.15.142:0/2169348726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 msgr2=0x55faefabea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 -- 172.21.15.142:0/2169348726 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faefab40b0 con 0x55faefaba610 2023-09-21T12:56:36.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828199a700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:36.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f828219b700 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82780ca370 tx=0x7f8278097f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27bca7ab0689f4d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f82713ff700 1 -- 172.21.15.142:0/2169348726 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82780b7040 con 0x55faefaba610 2023-09-21T12:56:36.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.937+0000 7f82713ff700 1 -- 172.21.15.142:0/2169348726 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82780c9bf0 con 0x55faefaba610 2023-09-21T12:56:36.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f82713ff700 1 -- 172.21.15.142:0/2169348726 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278099070 con 0x55faefaba610 2023-09-21T12:56:36.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 -- 172.21.15.142:0/2169348726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 msgr2=0x55faefacb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f82780ca370 tx=0x7f8278097f10 comp rx=0 tx=0).stop 2023-09-21T12:56:36.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 -- 172.21.15.142:0/2169348726 shutdown_connections 2023-09-21T12:56:36.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefacb480 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabf360 0x55faefac0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/2169348726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabaf30 0x55faefabea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 -- 172.21.15.142:0/2169348726 >> 172.21.15.142:0/2169348726 conn(0x55faef9e7000 msgr2=0x55faefabe370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 -- 172.21.15.142:0/2169348726 shutdown_connections 2023-09-21T12:56:36.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.938+0000 7f8297d3fb80 1 -- 172.21.15.142:0/2169348726 wait complete. 2023-09-21T12:56:36.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 -- start start 2023-09-21T12:56:36.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 Processor -- start 2023-09-21T12:56:36.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabf360 0x55faefb20c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefb21190 con 0x55faefaba610 2023-09-21T12:56:36.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefb21300 con 0x55faefabf360 2023-09-21T12:56:36.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faefb214c0 con 0x55faefabaf30 2023-09-21T12:56:36.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.939+0000 7f8297d3fb80 10 client.0 _ll_register_callbacks cb 0x55faef8f2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:36.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41760/0 (socket says 172.21.15.142:41760) 2023-09-21T12:56:36.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828219b700 1 -- 172.21.15.142:0/1564517048 learned_addr learned my addr 172.21.15.142:0/1564517048 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:36.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828299c700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabf360 0x55faefb20c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 -- 172.21.15.142:0/1564517048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabf360 msgr2=0x55faefb20c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabf360 0x55faefb20c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 -- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 msgr2=0x55faefac9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:36.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 -- 172.21.15.142:0/1564517048 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55faef81fc60 con 0x55faefabaf30 2023-09-21T12:56:36.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828219b700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:36.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f828199a700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac9ba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f826c0059d0 tx=0x7f826c029cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4f889083dfa60e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:36.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.940+0000 7f8265ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:36.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c01d040 con 0x55faefabaf30 2023-09-21T12:56:36.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55faefa04e60 con 0x55faefabaf30 2023-09-21T12:56:36.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f826c029070 con 0x55faefabaf30 2023-09-21T12:56:36.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f826c029230 con 0x55faefabaf30 2023-09-21T12:56:36.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8297d3fb80 10 client.25462 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:36.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55faef85d250 con 0x55faefabaf30 2023-09-21T12:56:36.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55faefa04e60 con 0x55faefabaf30 2023-09-21T12:56:36.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.941+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f826c00f4f0 con 0x55faefabaf30 2023-09-21T12:56:36.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 10 client.25462 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:36.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 10 client.25462 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:56:36.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 20 client.25462 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:36.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefb28be0 0x55faefb2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:36.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 4 client.25462 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:56:36.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55faefa04b80 con 0x55faefb28be0 2023-09-21T12:56:36.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f828219b700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefb28be0 0x55faefb2b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:36.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8265ffb700 10 client.25462 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:56:36.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f828219b700 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefb28be0 0x55faefb2b000 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fa3a2072136b89c2 server_cookie=a04b24bac986bf05 in_seq=0 out_seq=0 2023-09-21T12:56:36.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8265ffb700 1 -- 172.21.15.142:0/1564517048 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55faefa04b80 con 0x55faefb28be0 2023-09-21T12:56:36.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8265ffb700 10 client.25462 handle_command_reply: tid=0 2023-09-21T12:56:36.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.942+0000 7f8297d3fb80 1 client.25462 shutdown 2023-09-21T12:56:36.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 msgr2=0x55faefac9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac9ba0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f826c0059d0 tx=0x7f826c029cb0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 shutdown_connections 2023-09-21T12:56:36.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55faefaba610 0x55faefac9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55faefb28be0 0x55faefb2b000 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55faefabf360 0x55faefb20c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8265ffb700 0 client.25462 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:56:36.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 --2- 172.21.15.142:0/1564517048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55faefabaf30 0x55faefac9ba0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 >> 172.21.15.142:0/1564517048 conn(0x55faef9e7000 msgr2=0x55faefabec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 shutdown_connections 2023-09-21T12:56:36.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 1 -- 172.21.15.142:0/1564517048 wait complete. 2023-09-21T12:56:36.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.943+0000 7f8297d3fb80 20 client.25462 trim_cache size 0 max 16384 2023-09-21T12:56:36.958 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:56:36.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 msgr2=0x7f82680a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 0x7f82680a2d80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8274009ec0 tx=0x7f8274009920 comp rx=0 tx=0).stop 2023-09-21T12:56:36.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 msgr2=0x7f827c1990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:36.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f827800eb30 tx=0x7f827800ee40 comp rx=0 tx=0).stop 2023-09-21T12:56:36.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 shutdown_connections 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f82680a08c0 0x7f82680a2d80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f827c100fc0 0x7f827c1990b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f827c19da50 0x7f827c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 --2- 172.21.15.142:0/1012392441 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f827c1060e0 0x7f827c1995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 >> 172.21.15.142:0/1012392441 conn(0x7f827c0fc840 msgr2=0x7f827c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:36.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 shutdown_connections 2023-09-21T12:56:36.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:36.944+0000 7f82843ff700 1 -- 172.21.15.142:0/1012392441 wait complete. 2023-09-21T12:56:36.961 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:36 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1900826827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:36.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:56:37.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 -- 172.21.15.142:0/357037586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b4101970 msgr2=0x7ff1b41059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/357037586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b4101970 0x7ff1b41059b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009990 tx=0x7ff19c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 -- 172.21.15.142:0/357037586 shutdown_connections 2023-09-21T12:56:37.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/357037586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/357037586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 0x7ff1b41013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/357037586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b4101970 0x7ff1b41059b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 -- 172.21.15.142:0/357037586 >> 172.21.15.142:0/357037586 conn(0x7ff1b40fc840 msgr2=0x7ff1b40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 -- 172.21.15.142:0/357037586 shutdown_connections 2023-09-21T12:56:37.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.163+0000 7ff1b8bff700 1 -- 172.21.15.142:0/357037586 wait complete. 2023-09-21T12:56:37.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.164+0000 7ff1b8bff700 1 Processor -- start 2023-09-21T12:56:37.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.164+0000 7ff1b8bff700 1 -- start start 2023-09-21T12:56:37.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 0x7ff1b4196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b4197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419c2f0 con 0x7ff1b419b870 2023-09-21T12:56:37.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419c460 con 0x7ff1b41060e0 2023-09-21T12:56:37.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b8bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b419c620 con 0x7ff1b4100fc0 2023-09-21T12:56:37.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41778/0 (socket says 172.21.15.142:41778) 2023-09-21T12:56:37.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 -- 172.21.15.142:0/917491506 learned_addr learned my addr 172.21.15.142:0/917491506 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:37.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1abfff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b4197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b259c700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 0x7ff1b4196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 -- 172.21.15.142:0/917491506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 msgr2=0x7ff1b4196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 0x7ff1b4196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 -- 172.21.15.142:0/917491506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 msgr2=0x7ff1b4197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b4197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1b2d9d700 1 -- 172.21.15.142:0/917491506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0095f0 con 0x7ff1b419b870 2023-09-21T12:56:37.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.165+0000 7ff1abfff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b4197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:37.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00ef30 tx=0x7ff1ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1ab7fe700 1 -- 172.21.15.142:0/917491506 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac018070 con 0x7ff1b419b870 2023-09-21T12:56:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1ab7fe700 1 -- 172.21.15.142:0/917491506 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1ac00f040 con 0x7ff1b419b870 2023-09-21T12:56:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b41a3b20 con 0x7ff1b419b870 2023-09-21T12:56:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1ab7fe700 1 -- 172.21.15.142:0/917491506 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac00cd00 con 0x7ff1b419b870 2023-09-21T12:56:37.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.166+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b41a4050 con 0x7ff1b419b870 2023-09-21T12:56:37.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.169+0000 7ff1ab7fe700 1 -- 172.21.15.142:0/917491506 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7ff1ac003a00 con 0x7ff1b419b870 2023-09-21T12:56:37.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.170+0000 7ff1ab7fe700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 0x7ff1a00a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 Processor -- start 2023-09-21T12:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 -- start start 2023-09-21T12:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1ab7fe700 1 -- 172.21.15.142:0/917491506 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff1ac0cbb60 con 0x7ff1b419b870 2023-09-21T12:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1b259c700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 0x7ff1a00a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f76811e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768127c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76781ca0 con 0x563f7680d610 2023-09-21T12:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76765c70 con 0x563f76812360 2023-09-21T12:56:37.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76763590 con 0x563f7680df30 2023-09-21T12:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41790/0 (socket says 172.21.15.142:41790) 2023-09-21T12:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.171+0000 7ff1b259c700 1 -- 172.21.15.142:0/2861667432 learned_addr learned my addr 172.21.15.142:0/2861667432 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1abfff700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f76811e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 -- 172.21.15.142:0/2861667432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 msgr2=0x563f76811e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f76811e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 -- 172.21.15.142:0/2861667432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 msgr2=0x563f768127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 -- 172.21.15.142:0/2861667432 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f76589de0 con 0x563f7680d610 2023-09-21T12:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 0x7ff1a00a2d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013650 tx=0x7ff1a4013a10 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a91d7674f683ba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1a8ff9700 1 -- 172.21.15.142:0/2861667432 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4012110 con 0x563f7680d610 2023-09-21T12:56:37.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1a8ff9700 1 -- 172.21.15.142:0/2861667432 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1a4012270 con 0x563f7680d610 2023-09-21T12:56:37.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.172+0000 7ff1a8ff9700 1 -- 172.21.15.142:0/2861667432 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a40056c0 con 0x563f7680d610 2023-09-21T12:56:37.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2861667432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 msgr2=0x563f7680d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4020000 comp rx=0 tx=0).stop 2023-09-21T12:56:37.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2861667432 shutdown_connections 2023-09-21T12:56:37.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680d610 0x563f7680d9f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2861667432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f76811e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2861667432 >> 172.21.15.142:0/2861667432 conn(0x563f7673a000 msgr2=0x563f768086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2861667432 shutdown_connections 2023-09-21T12:56:37.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.173+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2861667432 wait complete. 2023-09-21T12:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.174+0000 7ff1cc56fb80 1 -- start start 2023-09-21T12:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.174+0000 7ff1cc56fb80 1 Processor -- start 2023-09-21T12:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.174+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.174+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7675ee80 con 0x563f7680df30 2023-09-21T12:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f766fb740 con 0x563f76812360 2023-09-21T12:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f766fb3e0 con 0x563f7680d610 2023-09-21T12:56:37.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1cc56fb80 10 client.0 _ll_register_callbacks cb 0x563f76645a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41792/0 (socket says 172.21.15.142:41792) 2023-09-21T12:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46360/0 (socket says 172.21.15.142:46360) 2023-09-21T12:56:37.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1abfff700 1 -- 172.21.15.142:0/2991270411 learned_addr learned my addr 172.21.15.142:0/2991270411 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 -- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 msgr2=0x563f768174f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768174f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 -- 172.21.15.142:0/2991270411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 msgr2=0x563f76816db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1b259c700 1 -- 172.21.15.142:0/2991270411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a4020430 con 0x563f7680d610 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.175+0000 7ff1abfff700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff1b259c700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4009ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb2f56ad3520941 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4012110 con 0x563f7680d610 2023-09-21T12:56:37.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f766cfbb0 con 0x563f7680d610 2023-09-21T12:56:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff1a40048d0 con 0x563f7680d610 2023-09-21T12:56:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a4009de0 con 0x563f7680d610 2023-09-21T12:56:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff1cc56fb80 10 client.25474 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563f76572c60 con 0x563f7680d610 2023-09-21T12:56:37.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563f766cfbb0 con 0x563f7680d610 2023-09-21T12:56:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.176+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1a4010bf0 con 0x563f7680d610 2023-09-21T12:56:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 10 client.25474 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 10 client.25474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 20 client.25474 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:37.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f7682b750 0x563f7682db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 4 client.25474 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:37.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f767dc020 con 0x563f7682b750 2023-09-21T12:56:37.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1abfff700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f7682b750 0x563f7682db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.192 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:36 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1900826827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:37.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff199ffb700 10 client.25474 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:37.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.177+0000 7ff1abfff700 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f7682b750 0x563f7682db70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4bc25f9e5d56361 server_cookie=5845f8ffd2a65b25 in_seq=0 out_seq=0 2023-09-21T12:56:37.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.178+0000 7ff199ffb700 1 -- 172.21.15.142:0/2991270411 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563f767dc020 con 0x563f7682b750 2023-09-21T12:56:37.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.178+0000 7ff199ffb700 10 client.25474 handle_command_reply: tid=0 2023-09-21T12:56:37.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.178+0000 7ff1cc56fb80 1 client.25474 shutdown 2023-09-21T12:56:37.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 msgr2=0x563f76819ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4009ab0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 shutdown_connections 2023-09-21T12:56:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f7682b750 0x563f7682db70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f768174f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f76819ba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/2991270411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff199ffb700 0 client.25474 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 >> 172.21.15.142:0/2991270411 conn(0x563f7673a000 msgr2=0x563f76807920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 shutdown_connections 2023-09-21T12:56:37.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/2991270411 wait complete. 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.179+0000 7ff1cc56fb80 20 client.25474 trim_cache size 0 max 16384 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 Processor -- start 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 -- start start 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f768147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 0x563f76816650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f765df920 con 0x563f76812360 2023-09-21T12:56:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f768029f0 con 0x563f7680d610 2023-09-21T12:56:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.192+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76822ed0 con 0x563f7680df30 2023-09-21T12:56:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 0x563f76816650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f768147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 0x563f76816650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41806/0 (socket says 172.21.15.142:41806) 2023-09-21T12:56:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47124/0 (socket says 172.21.15.142:47124) 2023-09-21T12:56:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b2d9d700 1 -- 172.21.15.142:0/1056268491 learned_addr learned my addr 172.21.15.142:0/1056268491 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:37.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 -- 172.21.15.142:0/1056268491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 msgr2=0x563f76822910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 -- 172.21.15.142:0/1056268491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 msgr2=0x563f76816650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 0x563f76816650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 -- 172.21.15.142:0/1056268491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f768327a0 con 0x563f7680df30 2023-09-21T12:56:37.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1b259c700 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.193+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f768147c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x563f76818460 tx=0x7ff19c005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5683d4aa7818de4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1a97fa700 1 -- 172.21.15.142:0/1056268491 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c01d040 con 0x563f7680df30 2023-09-21T12:56:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1a97fa700 1 -- 172.21.15.142:0/1056268491 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff19c01e040 con 0x563f7680df30 2023-09-21T12:56:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1a97fa700 1 -- 172.21.15.142:0/1056268491 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c004500 con 0x563f7680df30 2023-09-21T12:56:37.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1056268491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 msgr2=0x563f768147c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f768147c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x563f76818460 tx=0x7ff19c005fb0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1056268491 shutdown_connections 2023-09-21T12:56:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f76812360 0x563f76816650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7680d610 0x563f76822910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1056268491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680df30 0x563f768147c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1056268491 >> 172.21.15.142:0/1056268491 conn(0x563f7673a000 msgr2=0x563f76810430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1056268491 shutdown_connections 2023-09-21T12:56:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.194+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1056268491 wait complete. 2023-09-21T12:56:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 -- start start 2023-09-21T12:56:37.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 Processor -- start 2023-09-21T12:56:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f76816c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76822c40 con 0x563f7680df30 2023-09-21T12:56:37.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f76815310 con 0x563f76812360 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f768154d0 con 0x563f7680d610 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.195+0000 7ff1cc56fb80 10 client.0 _ll_register_callbacks cb 0x563f76645a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46374/0 (socket says 172.21.15.142:46374) 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 -- 172.21.15.142:0/1907055776 learned_addr learned my addr 172.21.15.142:0/1907055776 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:37.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b2d9d700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f76816c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 -- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 msgr2=0x563f76816c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f76816c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 -- 172.21.15.142:0/1907055776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 msgr2=0x563f76816730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:37.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 -- 172.21.15.142:0/1907055776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f76572c60 con 0x563f7680d610 2023-09-21T12:56:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff1b259c700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4028830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e86d73bb3200770 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff199ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.196+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4028b90 con 0x563f7680d610 2023-09-21T12:56:37.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1a4012270 con 0x563f7680d610 2023-09-21T12:56:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff1a4028cf0 con 0x563f7680d610 2023-09-21T12:56:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1a40106c0 con 0x563f7680d610 2023-09-21T12:56:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 10 client.25480 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7ff1b410e4d0 con 0x563f7680d610 2023-09-21T12:56:37.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff1a4012270 con 0x563f7680d610 2023-09-21T12:56:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff1a4004b40 con 0x563f7680d610 2023-09-21T12:56:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 10 client.25480 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 10 client.25480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:37.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 20 client.25480 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f76884260 0x563f76886680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 4 client.25480 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:56:37.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.197+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563f76757e60 con 0x563f76884260 2023-09-21T12:56:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f76884260 0x563f76886680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:37.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff199ffb700 10 client.25480 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff1abfff700 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f76884260 0x563f76886680 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ea5bde6ec17e3ed server_cookie=19be90b0f520c239 in_seq=0 out_seq=0 2023-09-21T12:56:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff199ffb700 1 -- 172.21.15.142:0/1907055776 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563f76757e60 con 0x563f76884260 2023-09-21T12:56:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff199ffb700 10 client.25480 handle_command_reply: tid=0 2023-09-21T12:56:37.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.198+0000 7ff1cc56fb80 1 client.25480 shutdown 2023-09-21T12:56:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 msgr2=0x563f768224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013e10 tx=0x7ff1a4028830 comp rx=0 tx=0).stop 2023-09-21T12:56:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 shutdown_connections 2023-09-21T12:56:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563f76884260 0x563f76886680 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f76812360 0x563f76816c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff199ffb700 0 client.25480 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7680d610 0x563f768224c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 --2- 172.21.15.142:0/1907055776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7680df30 0x563f76816730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 >> 172.21.15.142:0/1907055776 conn(0x563f7673a000 msgr2=0x563f768113d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 shutdown_connections 2023-09-21T12:56:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 1 -- 172.21.15.142:0/1907055776 wait complete. 2023-09-21T12:56:37.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1cc56fb80 20 client.25480 trim_cache size 0 max 16384 2023-09-21T12:56:37.218 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:56:37.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 msgr2=0x7ff1a00a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 0x7ff1a00a2d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4013650 tx=0x7ff1a4013a10 comp rx=0 tx=0).stop 2023-09-21T12:56:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 msgr2=0x7ff1b419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.199+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac00ef30 tx=0x7ff1ac00c3a0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 shutdown_connections 2023-09-21T12:56:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff1a00a08c0 0x7ff1a00a2d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff1b419b870 0x7ff1b419bcf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1b4100fc0 0x7ff1b4196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 --2- 172.21.15.142:0/917491506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff1b41060e0 0x7ff1b4197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:37.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 >> 172.21.15.142:0/917491506 conn(0x7ff1b40fc840 msgr2=0x7ff1b40fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 shutdown_connections 2023-09-21T12:56:37.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:37.200+0000 7ff1b8bff700 1 -- 172.21.15.142:0/917491506 wait complete. 2023-09-21T12:56:37.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:36 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1900826827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:56:38.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:37 smithi160 ceph-mon[134450]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-21T12:56:38.223 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:56:38.223 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:56:38.286 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:37 smithi142 ceph-mon[97663]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-21T12:56:38.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:37 smithi156 ceph-mon[134078]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2023-09-21T12:56:38.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.440+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/3437639691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c04073210 msgr2=0x7f4c040735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.440+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/3437639691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c04073210 0x7f4c040735f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009990 tx=0x7f4c00009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/3437639691 shutdown_connections 2023-09-21T12:56:38.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/3437639691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c04073210 0x7f4c040735f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/3437639691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c0410d590 0x7f4c0410fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/3437639691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 0x7f4c0410d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/3437639691 >> 172.21.15.142:0/3437639691 conn(0x7f4c040fc840 msgr2=0x7f4c040fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/3437639691 shutdown_connections 2023-09-21T12:56:38.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.441+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/3437639691 wait complete. 2023-09-21T12:56:38.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 Processor -- start 2023-09-21T12:56:38.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 -- start start 2023-09-21T12:56:38.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c04073210 0x7f4c041990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 0x7f4c04199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419e0b0 con 0x7f4c0410d590 2023-09-21T12:56:38.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419e220 con 0x7f4c04073210 2023-09-21T12:56:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.442+0000 7f4c0b3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0419e3e0 con 0x7f4c04073b30 2023-09-21T12:56:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 0x7f4c04199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41826/0 (socket says 172.21.15.142:41826) 2023-09-21T12:56:38.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 -- 172.21.15.142:0/1663993881 learned_addr learned my addr 172.21.15.142:0/1663993881 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c04073210 0x7f4c041990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 -- 172.21.15.142:0/1663993881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 msgr2=0x7f4c04199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 0x7f4c04199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 -- 172.21.15.142:0/1663993881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c04073210 msgr2=0x7f4c041990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c04073210 0x7f4c041990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.443+0000 7f4c0999c700 1 -- 172.21.15.142:0/1663993881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000095f0 con 0x7f4c0410d590 2023-09-21T12:56:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4c0999c700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc007ee0 tx=0x7f4bfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4bfa7fc700 1 -- 172.21.15.142:0/1663993881 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc017070 con 0x7f4c0410d590 2023-09-21T12:56:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c0419e6c0 con 0x7f4c0410d590 2023-09-21T12:56:38.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4bfa7fc700 1 -- 172.21.15.142:0/1663993881 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bfc00f040 con 0x7f4c0410d590 2023-09-21T12:56:38.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4bfa7fc700 1 -- 172.21.15.142:0/1663993881 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc005550 con 0x7f4c0410d590 2023-09-21T12:56:38.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.444+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c041a5f00 con 0x7f4c0410d590 2023-09-21T12:56:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.448+0000 7f4bfa7fc700 1 -- 172.21.15.142:0/1663993881 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f4bfc00db20 con 0x7f4c0410d590 2023-09-21T12:56:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 Processor -- start 2023-09-21T12:56:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 -- start start 2023-09-21T12:56:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 0x559432084a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594320893e0 0x559432089840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431ff8d20 con 0x559432084690 2023-09-21T12:56:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431fdccf0 con 0x5594320893e0 2023-09-21T12:56:38.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431fda610 con 0x559432084fb0 2023-09-21T12:56:38.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4bfa7fc700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 0x7f4bf00a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.449+0000 7f4bfa7fc700 1 -- 172.21.15.142:0/1663993881 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4bfc0cb7b0 con 0x7f4c0410d590 2023-09-21T12:56:38.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46404/0 (socket says 172.21.15.142:46404) 2023-09-21T12:56:38.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 -- 172.21.15.142:0/494487972 learned_addr learned my addr 172.21.15.142:0/494487972 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0899a700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 0x559432084a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0999c700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 0x7f4bf00a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0899a700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594320893e0 0x559432089840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 -- 172.21.15.142:0/494487972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594320893e0 msgr2=0x559432089840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594320893e0 0x559432089840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 -- 172.21.15.142:0/494487972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 msgr2=0x559432084a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 0x559432084a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 -- 172.21.15.142:0/494487972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559431e00e60 con 0x559432084fb0 2023-09-21T12:56:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0899a700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 0x559432084a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:38.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0999c700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 0x7f4bf00a2d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0c8ed0 tx=0x7f4bfc007f10 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.450+0000 7f4c0919b700 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005e80 tx=0x7f4c00009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262177daa6021f12 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.451+0000 7f4bef7fe700 1 -- 172.21.15.142:0/494487972 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0001d050 con 0x559432084fb0 2023-09-21T12:56:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.451+0000 7f4bef7fe700 1 -- 172.21.15.142:0/494487972 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c0001e040 con 0x559432084fb0 2023-09-21T12:56:38.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.451+0000 7f4bef7fe700 1 -- 172.21.15.142:0/494487972 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000053f0 con 0x559432084fb0 2023-09-21T12:56:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/494487972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 msgr2=0x559432088ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4c00005e80 tx=0x7f4c00009ee0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/494487972 shutdown_connections 2023-09-21T12:56:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559432084690 0x559432084a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5594320893e0 0x559432089840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/494487972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432088ea0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/494487972 >> 172.21.15.142:0/494487972 conn(0x559431fb1080 msgr2=0x55943207f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/494487972 shutdown_connections 2023-09-21T12:56:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/494487972 wait complete. 2023-09-21T12:56:38.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.452+0000 7f4c1ecf1b80 1 -- start start 2023-09-21T12:56:38.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 Processor -- start 2023-09-21T12:56:38.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x559432090c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x55943208de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431fd5f00 con 0x5594320893e0 2023-09-21T12:56:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431f727c0 con 0x559432084690 2023-09-21T12:56:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431f72460 con 0x559432084fb0 2023-09-21T12:56:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.453+0000 7f4c1ecf1b80 10 client.0 _ll_register_callbacks cb 0x559431ebcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:38.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41856/0 (socket says 172.21.15.142:41856) 2023-09-21T12:56:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x55943208de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0899a700 1 -- 172.21.15.142:0/1870451042 learned_addr learned my addr 172.21.15.142:0/1870451042 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0899a700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x559432090c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 -- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 msgr2=0x559432090c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x559432090c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 -- 172.21.15.142:0/1870451042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 msgr2=0x55943208e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 -- 172.21.15.142:0/1870451042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c041106c0 con 0x559432084fb0 2023-09-21T12:56:38.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x55943208de80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c000098e0 tx=0x7f4c0000bba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3b4eb6d66c7899e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.454+0000 7f4becff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000054d0 con 0x559432084fb0 2023-09-21T12:56:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559431f46c30 con 0x559432084fb0 2023-09-21T12:56:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4c00003d40 con 0x559432084fb0 2023-09-21T12:56:38.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c00005630 con 0x559432084fb0 2023-09-21T12:56:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4c1ecf1b80 10 client.25492 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x559431de9ce0 con 0x559432084fb0 2023-09-21T12:56:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.455+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559431f46c30 con 0x559432084fb0 2023-09-21T12:56:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c00023460 con 0x559432084fb0 2023-09-21T12:56:38.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:38.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:38.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 20 client.25492 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:38.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55943209dfc0 0x5594320a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 4 client.25492 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:38.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594320530a0 con 0x55943209dfc0 2023-09-21T12:56:38.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c0899a700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55943209dfc0 0x5594320a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4becff9700 10 client.25492 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.456+0000 7f4c0899a700 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55943209dfc0 0x5594320a03e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=490b3911db73c514 server_cookie=8469e76f780d4819 in_seq=0 out_seq=0 2023-09-21T12:56:38.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.457+0000 7f4becff9700 1 -- 172.21.15.142:0/1870451042 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594320530a0 con 0x55943209dfc0 2023-09-21T12:56:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.457+0000 7f4becff9700 10 client.25492 handle_command_reply: tid=0 2023-09-21T12:56:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.457+0000 7f4c1ecf1b80 1 client.25492 shutdown 2023-09-21T12:56:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.457+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 msgr2=0x55943208de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.457+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x55943208de80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4c000098e0 tx=0x7f4c0000bba0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 shutdown_connections 2023-09-21T12:56:38.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55943209dfc0 0x5594320a03e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x559432090c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1870451042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x55943208de80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4becff9700 0 client.25492 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 >> 172.21.15.142:0/1870451042 conn(0x559431fb1080 msgr2=0x55943207f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 shutdown_connections 2023-09-21T12:56:38.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1870451042 wait complete. 2023-09-21T12:56:38.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.458+0000 7f4c1ecf1b80 20 client.25492 trim_cache size 0 max 16384 2023-09-21T12:56:38.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 Processor -- start 2023-09-21T12:56:38.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 -- start start 2023-09-21T12:56:38.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 0x559432086cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559431e569a0 con 0x5594320893e0 2023-09-21T12:56:38.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943208ebb0 con 0x559432084fb0 2023-09-21T12:56:38.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.477+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943208f310 con 0x559432084690 2023-09-21T12:56:38.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 0x559432086cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47168/0 (socket says 172.21.15.142:47168) 2023-09-21T12:56:38.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 0x559432086cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46418/0 (socket says 172.21.15.142:46418) 2023-09-21T12:56:38.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 -- 172.21.15.142:0/1469721508 learned_addr learned my addr 172.21.15.142:0/1469721508 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0899a700 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 -- 172.21.15.142:0/1469721508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 msgr2=0x559432086cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 0x559432086cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 -- 172.21.15.142:0/1469721508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 msgr2=0x55943208a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 -- 172.21.15.142:0/1469721508 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55943207b630 con 0x559432084fb0 2023-09-21T12:56:38.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0899a700 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:38.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.478+0000 7f4c0919b700 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000c00 tx=0x7f4c00009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba54820e1afdd003 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4beffff700 1 -- 172.21.15.142:0/1469721508 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0001d040 con 0x559432084fb0 2023-09-21T12:56:38.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4beffff700 1 -- 172.21.15.142:0/1469721508 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c00023b60 con 0x559432084fb0 2023-09-21T12:56:38.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4beffff700 1 -- 172.21.15.142:0/1469721508 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0000f6c0 con 0x559432084fb0 2023-09-21T12:56:38.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1469721508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 msgr2=0x559432095500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4c00000c00 tx=0x7f4c00009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1469721508 shutdown_connections 2023-09-21T12:56:38.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x55943208a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.479+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084690 0x559432086cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/1469721508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084fb0 0x559432095500 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1469721508 >> 172.21.15.142:0/1469721508 conn(0x559431fb1080 msgr2=0x559432087510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1469721508 shutdown_connections 2023-09-21T12:56:38.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/1469721508 wait complete. 2023-09-21T12:56:38.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 -- start start 2023-09-21T12:56:38.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.480+0000 7f4c1ecf1b80 1 Processor -- start 2023-09-21T12:56:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x5594320956f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x559432092240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559432092950 con 0x5594320893e0 2023-09-21T12:56:38.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594320f1df0 con 0x559432084690 2023-09-21T12:56:38.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594320f1f60 con 0x559432084fb0 2023-09-21T12:56:38.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c1ecf1b80 10 client.0 _ll_register_callbacks cb 0x559431ebcb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:38.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x5594320956f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0919b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46426/0 (socket says 172.21.15.142:46426) 2023-09-21T12:56:38.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0919b700 1 -- 172.21.15.142:0/2218902269 learned_addr learned my addr 172.21.15.142:0/2218902269 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0899a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x5594320956f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47178/0 (socket says 172.21.15.142:47178) 2023-09-21T12:56:38.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0899a700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x559432092240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.481+0000 7f4c0919b700 1 -- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 msgr2=0x5594320956f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c0919b700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x5594320956f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c0919b700 1 -- 172.21.15.142:0/2218902269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 msgr2=0x559432092240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c0919b700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x559432092240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c0919b700 1 -- 172.21.15.142:0/2218902269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559431de9ce0 con 0x559432084fb0 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c0919b700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009350 tx=0x7f4c0000beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=687665f9c869da04 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4becff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:38.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0001d040 con 0x559432084fb0 2023-09-21T12:56:38.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c0001e040 con 0x559432084fb0 2023-09-21T12:56:38.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f4c00000e40 con 0x559432084fb0 2023-09-21T12:56:38.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.482+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c000054d0 con 0x559432084fb0 2023-09-21T12:56:38.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 10 client.25498 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:38.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55943208d9f0 con 0x559432084fb0 2023-09-21T12:56:38.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c0001e040 con 0x559432084fb0 2023-09-21T12:56:38.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c00044020 con 0x559432084fb0 2023-09-21T12:56:38.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 10 client.25498 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:38.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 10 client.25498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:38.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 20 client.25498 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:38.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5594320f3220 0x5594320f5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 4 client.25498 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:56:38.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.483+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559431fceee0 con 0x5594320f3220 2023-09-21T12:56:38.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.484+0000 7f4c0899a700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5594320f3220 0x5594320f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.484+0000 7f4becff9700 10 client.25498 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.484+0000 7f4c0899a700 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5594320f3220 0x5594320f5610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d98b5533aee3acab server_cookie=9c88e444cc63b70e in_seq=0 out_seq=0 2023-09-21T12:56:38.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.485+0000 7f4becff9700 1 -- 172.21.15.142:0/2218902269 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559431fceee0 con 0x5594320f3220 2023-09-21T12:56:38.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.485+0000 7f4becff9700 10 client.25498 handle_command_reply: tid=0 2023-09-21T12:56:38.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.485+0000 7f4c1ecf1b80 1 client.25498 shutdown 2023-09-21T12:56:38.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.485+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 msgr2=0x559432091b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.485+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009350 tx=0x7f4c0000beb0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 shutdown_connections 2023-09-21T12:56:38.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5594320f3220 0x5594320f5610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5594320893e0 0x559432092240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559432084690 0x5594320956f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 --2- 172.21.15.142:0/2218902269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559432084fb0 0x559432091b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 >> 172.21.15.142:0/2218902269 conn(0x559431fb1080 msgr2=0x55943208b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4becff9700 0 client.25498 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 shutdown_connections 2023-09-21T12:56:38.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 1 -- 172.21.15.142:0/2218902269 wait complete. 2023-09-21T12:56:38.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.486+0000 7f4c1ecf1b80 20 client.25498 trim_cache size 0 max 16384 2023-09-21T12:56:38.500 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:56:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:56:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "6e777fe5-8c39-46cd-9964-264c6b6f9d51", 2023-09-21T12:56:38.500 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:56:38.501 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:56:38.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 msgr2=0x7f4bf00a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 0x7f4bf00a2d00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0c8ed0 tx=0x7f4bfc007f10 comp rx=0 tx=0).stop 2023-09-21T12:56:38.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 msgr2=0x7f4c0419da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc007ee0 tx=0x7f4bfc00d3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 shutdown_connections 2023-09-21T12:56:38.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4bf00a0840 0x7f4bf00a2d00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4c0410d590 0x7f4c0419da70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4c04073210 0x7f4c041990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 --2- 172.21.15.142:0/1663993881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c04073b30 0x7f4c04199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 >> 172.21.15.142:0/1663993881 conn(0x7f4c040fc840 msgr2=0x7f4c0410f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 shutdown_connections 2023-09-21T12:56:38.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.487+0000 7f4c0b3ff700 1 -- 172.21.15.142:0/1663993881 wait complete. 2023-09-21T12:56:38.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:56:38.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 -- 172.21.15.142:0/854643144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 msgr2=0x7ff8f80735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 --2- 172.21.15.142:0/854643144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f80735f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009990 tx=0x7ff8ec009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 -- 172.21.15.142:0/854643144 shutdown_connections 2023-09-21T12:56:38.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 --2- 172.21.15.142:0/854643144 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f80735f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 --2- 172.21.15.142:0/854643144 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f810d590 0x7ff8f810fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.714+0000 7ff8fedff700 1 --2- 172.21.15.142:0/854643144 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f8073b30 0x7ff8f810d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.715+0000 7ff8fedff700 1 -- 172.21.15.142:0/854643144 >> 172.21.15.142:0/854643144 conn(0x7ff8f80fc840 msgr2=0x7ff8f80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.715+0000 7ff8fedff700 1 -- 172.21.15.142:0/854643144 shutdown_connections 2023-09-21T12:56:38.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.715+0000 7ff8fedff700 1 -- 172.21.15.142:0/854643144 wait complete. 2023-09-21T12:56:38.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.716+0000 7ff8fedff700 1 Processor -- start 2023-09-21T12:56:38.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.716+0000 7ff8fedff700 1 -- start start 2023-09-21T12:56:38.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f8073b30 0x7ff8f8199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f810d590 0x7ff8f819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f819e0b0 con 0x7ff8f8073210 2023-09-21T12:56:38.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f819e220 con 0x7ff8f8073b30 2023-09-21T12:56:38.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fedff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f819e3e0 con 0x7ff8f810d590 2023-09-21T12:56:38.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41890/0 (socket says 172.21.15.142:41890) 2023-09-21T12:56:38.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1969414765 learned_addr learned my addr 172.21.15.142:0/1969414765 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.717+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f8073b30 0x7ff8f8199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f810d590 0x7ff8f819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1969414765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f810d590 msgr2=0x7ff8f819da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f810d590 0x7ff8f819da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1969414765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f8073b30 msgr2=0x7ff8f8199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f8073b30 0x7ff8f8199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1969414765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e4009520 con 0x7ff8f8073210 2023-09-21T12:56:38.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec005910 tx=0x7ff8ec005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8f5ffb700 1 -- 172.21.15.142:0/1969414765 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec01d070 con 0x7ff8f8073210 2023-09-21T12:56:38.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8f5ffb700 1 -- 172.21.15.142:0/1969414765 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec022470 con 0x7ff8f8073210 2023-09-21T12:56:38.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec0095f0 con 0x7ff8f8073210 2023-09-21T12:56:38.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8f5ffb700 1 -- 172.21.15.142:0/1969414765 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017650 con 0x7ff8f8073210 2023-09-21T12:56:38.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.718+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81a5d20 con 0x7ff8f8073210 2023-09-21T12:56:38.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.722+0000 7ff8f5ffb700 1 -- 172.21.15.142:0/1969414765 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7ff8ec0225e0 con 0x7ff8f8073210 2023-09-21T12:56:38.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.723+0000 7ff8f5ffb700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 0x7ff8e80a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.723+0000 7ff9127bab80 1 Processor -- start 2023-09-21T12:56:38.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.723+0000 7ff8f5ffb700 1 -- 172.21.15.142:0/1969414765 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff8ec0cd550 con 0x7ff8f8073210 2023-09-21T12:56:38.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.723+0000 7ff9127bab80 1 -- start start 2023-09-21T12:56:38.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 0x7ff8e80a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a5f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a63e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec999d3ca0 con 0x55ec99a5ff30 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec999b7c70 con 0x55ec99a5f610 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff9127bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec999b5590 con 0x55ec99a64360 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a63e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a63e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41900/0 (socket says 172.21.15.142:41900) 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8f7fff700 1 -- 172.21.15.142:0/1972482313 learned_addr learned my addr 172.21.15.142:0/1972482313 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a5f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1972482313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 msgr2=0x55ec99a647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.724+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1972482313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 msgr2=0x55ec99a63e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a63e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/1972482313 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec997dbde0 con 0x55ec99a5f610 2023-09-21T12:56:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 0x7ff8e80a2d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4013710 tx=0x7ff8e4013ad0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a5f9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0cac10 tx=0x7ff8ec009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3d6cf0ec8100188 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8e2ffd700 1 -- 172.21.15.142:0/1972482313 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09a5b0 con 0x55ec99a5f610 2023-09-21T12:56:38.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8e2ffd700 1 -- 172.21.15.142:0/1972482313 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec09a3d0 con 0x55ec99a5f610 2023-09-21T12:56:38.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.725+0000 7ff8e2ffd700 1 -- 172.21.15.142:0/1972482313 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09acd0 con 0x55ec99a5f610 2023-09-21T12:56:38.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 -- 172.21.15.142:0/1972482313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 msgr2=0x55ec99a5f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a5f9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0cac10 tx=0x7ff8ec009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 -- 172.21.15.142:0/1972482313 shutdown_connections 2023-09-21T12:56:38.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a5f9f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 --2- 172.21.15.142:0/1972482313 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a63e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 -- 172.21.15.142:0/1972482313 >> 172.21.15.142:0/1972482313 conn(0x55ec9998c000 msgr2=0x55ec99a5a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 -- 172.21.15.142:0/1972482313 shutdown_connections 2023-09-21T12:56:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.726+0000 7ff9127bab80 1 -- 172.21.15.142:0/1972482313 wait complete. 2023-09-21T12:56:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 -- start start 2023-09-21T12:56:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 Processor -- start 2023-09-21T12:56:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5ff30 0x55ec99a68d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 0x55ec99a69320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec999b0e80 con 0x55ec99a5f610 2023-09-21T12:56:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec9994d740 con 0x55ec99a64360 2023-09-21T12:56:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec9994d3e0 con 0x55ec99a5ff30 2023-09-21T12:56:38.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.727+0000 7ff9127bab80 10 client.0 _ll_register_callbacks cb 0x55ec99897a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41912/0 (socket says 172.21.15.142:41912) 2023-09-21T12:56:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/224921953 learned_addr learned my addr 172.21.15.142:0/224921953 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 0x55ec99a69320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5ff30 0x55ec99a68d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/224921953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5ff30 msgr2=0x55ec99a68d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5ff30 0x55ec99a68d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 msgr2=0x55ec99a69320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 0x55ec99a69320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/224921953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f81a5d20 con 0x55ec99a5f610 2023-09-21T12:56:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 0x55ec99a69320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0cb2d0 tx=0x7ff8ec022af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8840065425f8cd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.728+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09aa70 con 0x55ec99a5f610 2023-09-21T12:56:38.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec99921bb0 con 0x55ec99a5f610 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff8ec09e8a0 con 0x55ec99a5f610 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8ec0a2a50 con 0x55ec99a5f610 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 10 client.15507 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ec997c4c60 con 0x55ec99a5f610 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ec99921bb0 con 0x55ec99a5f610 2023-09-21T12:56:38.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8ec0a25c0 con 0x55ec99a5f610 2023-09-21T12:56:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 10 client.15507 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 20 client.15507 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99a78c30 0x55ec99a7b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 4 client.15507 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.729+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec99a2e020 con 0x55ec99a78c30 2023-09-21T12:56:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.730+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99a78c30 0x55ec99a7b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.731+0000 7ff8d7fff700 10 client.15507 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.731+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99a78c30 0x55ec99a7b050 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0438c8a84744187 server_cookie=7f8501bfec598c8c in_seq=0 out_seq=0 2023-09-21T12:56:38.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff8d7fff700 1 -- 172.21.15.142:0/224921953 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec99a2e020 con 0x55ec99a78c30 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff8d7fff700 10 client.15507 handle_command_reply: tid=0 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 client.15507 shutdown 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 msgr2=0x55ec99a6ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0cb2d0 tx=0x7ff8ec022af0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 shutdown_connections 2023-09-21T12:56:38.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99a78c30 0x55ec99a7b050 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5f610 0x55ec99a6ba90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a64360 0x55ec99a69320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 --2- 172.21.15.142:0/224921953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5ff30 0x55ec99a68d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff8d7fff700 0 client.15507 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 >> 172.21.15.142:0/224921953 conn(0x55ec9998c000 msgr2=0x55ec99a5a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 shutdown_connections 2023-09-21T12:56:38.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 1 -- 172.21.15.142:0/224921953 wait complete. 2023-09-21T12:56:38.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.732+0000 7ff9127bab80 20 client.15507 trim_cache size 0 max 16384 2023-09-21T12:56:38.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.749+0000 7ff9127bab80 1 Processor -- start 2023-09-21T12:56:38.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 -- start start 2023-09-21T12:56:38.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a6b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a66750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99a75af0 con 0x55ec99a5ff30 2023-09-21T12:56:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99831920 con 0x55ec99a5f610 2023-09-21T12:56:38.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff9127bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99a54c50 con 0x55ec99a64360 2023-09-21T12:56:38.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a6b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47210/0 (socket says 172.21.15.142:47210) 2023-09-21T12:56:38.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/2120155867 learned_addr learned my addr 172.21.15.142:0/2120155867 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.750+0000 7ff8f7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a6b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41914/0 (socket says 172.21.15.142:41914) 2023-09-21T12:56:38.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a66750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/2120155867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 msgr2=0x55ec99a66750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a66750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/2120155867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 msgr2=0x55ec99a6b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a6b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/2120155867 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec99a7fc80 con 0x55ec99a5f610 2023-09-21T12:56:38.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00f740 tx=0x7ff8ec00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae357e6bbb30b6b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8e37fe700 1 -- 172.21.15.142:0/2120155867 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0cab50 con 0x55ec99a5f610 2023-09-21T12:56:38.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8e37fe700 1 -- 172.21.15.142:0/2120155867 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec09a5b0 con 0x55ec99a5f610 2023-09-21T12:56:38.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.751+0000 7ff8e37fe700 1 -- 172.21.15.142:0/2120155867 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec09aee0 con 0x55ec99a5f610 2023-09-21T12:56:38.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- 172.21.15.142:0/2120155867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 msgr2=0x55ec99a70270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00f740 tx=0x7ff8ec00b610 comp rx=0 tx=0).stop 2023-09-21T12:56:38.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- 172.21.15.142:0/2120155867 shutdown_connections 2023-09-21T12:56:38.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a64360 0x55ec99a66750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5f610 0x55ec99a70270 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 --2- 172.21.15.142:0/2120155867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a5ff30 0x55ec99a6b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- 172.21.15.142:0/2120155867 >> 172.21.15.142:0/2120155867 conn(0x55ec9998c000 msgr2=0x55ec99a623f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- 172.21.15.142:0/2120155867 shutdown_connections 2023-09-21T12:56:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- 172.21.15.142:0/2120155867 wait complete. 2023-09-21T12:56:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.752+0000 7ff9127bab80 1 -- start start 2023-09-21T12:56:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 Processor -- start 2023-09-21T12:56:38.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 0x55ec99a6ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 0x55ec99a6f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99accac0 con 0x55ec99a64360 2023-09-21T12:56:38.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99accc00 con 0x55ec99a5ff30 2023-09-21T12:56:38.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec99accdc0 con 0x55ec99a5f610 2023-09-21T12:56:38.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff9127bab80 10 client.0 _ll_register_callbacks cb 0x55ec99897a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:38.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff8fd39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 0x55ec99a6f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff8fcb9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46492/0 (socket says 172.21.15.142:46492) 2023-09-21T12:56:38.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.753+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/3696697788 learned_addr learned my addr 172.21.15.142:0/3696697788 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 0x55ec99a6ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 msgr2=0x55ec99a6ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 0x55ec99a6ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/3696697788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 msgr2=0x55ec99a6f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 0x55ec99a6f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 -- 172.21.15.142:0/3696697788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec997c4c60 con 0x55ec99a5f610 2023-09-21T12:56:38.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 0x55ec99a6ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:38.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fd39c700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 0x55ec99a6f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:38.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8fcb9b700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0974e0 tx=0x7ff8ec005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfdb584e539b17e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:38.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:38.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec096db0 con 0x55ec99a5f610 2023-09-21T12:56:38.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8ec09a3d0 con 0x55ec99a5f610 2023-09-21T12:56:38.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff8ec09e8a0 con 0x55ec99a5f610 2023-09-21T12:56:38.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.754+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8ec09aa70 con 0x55ec99a5f610 2023-09-21T12:56:38.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 10 client.25516 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:38.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ec99802250 con 0x55ec99a5f610 2023-09-21T12:56:38.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8ec09a3d0 con 0x55ec99a5f610 2023-09-21T12:56:38.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff8ec096860 con 0x55ec99a5f610 2023-09-21T12:56:38.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 10 client.25516 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:38.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 10 client.25516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 20 client.25516 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99acdf70 0x55ec99ad0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 4 client.25516 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec999a9e60 con 0x55ec99acdf70 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.755+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99acdf70 0x55ec99ad0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:38.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff8f7fff700 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99acdf70 0x55ec99ad0360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5517c0ecc0986964 server_cookie=87516988468b6fa8 in_seq=0 out_seq=0 2023-09-21T12:56:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff8d7fff700 10 client.25516 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff8d7fff700 1 -- 172.21.15.142:0/3696697788 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ec999a9e60 con 0x55ec99acdf70 2023-09-21T12:56:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff8d7fff700 10 client.25516 handle_command_reply: tid=0 2023-09-21T12:56:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 client.25516 shutdown 2023-09-21T12:56:38.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 msgr2=0x55ec99a6e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0974e0 tx=0x7ff8ec005fd0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 shutdown_connections 2023-09-21T12:56:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec99acdf70 0x55ec99ad0360 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec99a64360 0x55ec99a6f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff8d7fff700 0 client.25516 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec99a5f610 0x55ec99a6e950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 --2- 172.21.15.142:0/3696697788 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec99a5ff30 0x55ec99a6ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.756+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 >> 172.21.15.142:0/3696697788 conn(0x55ec9998c000 msgr2=0x55ec99a66750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 shutdown_connections 2023-09-21T12:56:38.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff9127bab80 1 -- 172.21.15.142:0/3696697788 wait complete. 2023-09-21T12:56:38.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff9127bab80 20 client.25516 trim_cache size 0 max 16384 2023-09-21T12:56:38.771 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:56:38.771 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:56:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:56:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "6e777fe5-8c39-46cd-9964-264c6b6f9d51": { 2023-09-21T12:56:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:56:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "6e777fe5-8c39-46cd-9964-264c6b6f9d51", 2023-09-21T12:56:38.772 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:56:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:56:38.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:56:38.773 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:56:38.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 msgr2=0x7ff8e80a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 0x7ff8e80a2d80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4013710 tx=0x7ff8e4013ad0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 msgr2=0x7ff8f81990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:38.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec005910 tx=0x7ff8ec005720 comp rx=0 tx=0).stop 2023-09-21T12:56:38.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 shutdown_connections 2023-09-21T12:56:38.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff8e80a08c0 0x7ff8e80a2d80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff8f8073210 0x7ff8f81990d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8f810d590 0x7ff8f819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 --2- 172.21.15.142:0/1969414765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff8f8073b30 0x7ff8f8199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:38.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.757+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 >> 172.21.15.142:0/1969414765 conn(0x7ff8f80fc840 msgr2=0x7ff8f810f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:38.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.758+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 shutdown_connections 2023-09-21T12:56:38.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:56:38.758+0000 7ff8fedff700 1 -- 172.21.15.142:0/1969414765 wait complete. 2023-09-21T12:56:38.777 INFO:tasks.cephfs.filesystem:scrub status for tag:6e777fe5-8c39-46cd-9964-264c6b6f9d51 - {'path': '/', 'tag': '6e777fe5-8c39-46cd-9964-264c6b6f9d51', 'options': 'recursive,force'} 2023-09-21T12:56:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:38 smithi160 ceph-mon[134450]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-21T12:56:39.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:38 smithi156 ceph-mon[134078]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-21T12:56:39.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:38 smithi142 ceph-mon[97663]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-21T12:56:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:39 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:56:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:39 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:40.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:39 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:56:40.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:39 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:40.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:39 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:56:40.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:39 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:39 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:56:40.406 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:39 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:40.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:39 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:56:40.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:39 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:40.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:39 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:56:40.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:39 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:56:41.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:40 smithi156 ceph-mon[134078]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:41.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:40 smithi142 ceph-mon[97663]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:41.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:40 smithi160 ceph-mon[134450]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:42.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:41 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:56:42.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:41 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:56:42.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:41 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:56:43.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:42 smithi156 ceph-mon[134078]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:43.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:42 smithi142 ceph-mon[97663]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:43.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:42 smithi160 ceph-mon[134450]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-09-21T12:56:43.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.682+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/153355364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e81039d0 msgr2=0x7fd6e8107a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.682+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/153355364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e81039d0 0x7fd6e8107a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009990 tx=0x7fd6dc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/153355364 shutdown_connections 2023-09-21T12:56:43.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/153355364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e8103020 0x7fd6e8103400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/153355364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8108140 0x7fd6e810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/153355364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e81039d0 0x7fd6e8107a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/153355364 >> 172.21.15.142:0/153355364 conn(0x7fd6e80fe8c0 msgr2=0x7fd6e8100ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/153355364 shutdown_connections 2023-09-21T12:56:43.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.683+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/153355364 wait complete. 2023-09-21T12:56:43.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 Processor -- start 2023-09-21T12:56:43.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 -- start start 2023-09-21T12:56:43.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e8108140 0x7fd6e81993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819e2b0 con 0x7fd6e819d830 2023-09-21T12:56:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819e420 con 0x7fd6e8103020 2023-09-21T12:56:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.684+0000 7fd6ec9fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e819e5e0 con 0x7fd6e8108140 2023-09-21T12:56:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e8108140 0x7fd6e81993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e759e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41942/0 (socket says 172.21.15.142:41942) 2023-09-21T12:56:43.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e759e700 1 -- 172.21.15.142:0/3060397631 learned_addr learned my addr 172.21.15.142:0/3060397631 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:43.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47242/0 (socket says 172.21.15.142:47242) 2023-09-21T12:56:43.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/3060397631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e8108140 msgr2=0x7fd6e81993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e8108140 0x7fd6e81993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 msgr2=0x7fd6e819dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/3060397631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0095f0 con 0x7fd6e8103020 2023-09-21T12:56:43.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e759e700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.685+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e9f0 tx=0x7fd6d800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.686+0000 7fd6cffff700 1 -- 172.21.15.142:0/3060397631 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d800c9c0 con 0x7fd6e8103020 2023-09-21T12:56:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.686+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e81a5b40 con 0x7fd6e8103020 2023-09-21T12:56:43.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.686+0000 7fd6cffff700 1 -- 172.21.15.142:0/3060397631 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6d8010430 con 0x7fd6e8103020 2023-09-21T12:56:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.686+0000 7fd6cffff700 1 -- 172.21.15.142:0/3060397631 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d8018680 con 0x7fd6e8103020 2023-09-21T12:56:43.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.686+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e81a6070 con 0x7fd6e8103020 2023-09-21T12:56:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.689+0000 7fd6cffff700 1 -- 172.21.15.142:0/3060397631 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7fd6d8010860 con 0x7fd6e8103020 2023-09-21T12:56:43.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.690+0000 7fd700bacb80 1 Processor -- start 2023-09-21T12:56:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 -- start start 2023-09-21T12:56:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6cffff700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 0x7fd6d00a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf2e60 0x5571aecf3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aeced260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6cffff700 1 -- 172.21.15.142:0/3060397631 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd6d8014070 con 0x7fd6e8103020 2023-09-21T12:56:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aec61c40 con 0x5571aecf3780 2023-09-21T12:56:43.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aec45c10 con 0x5571aeced7a0 2023-09-21T12:56:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd700bacb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aec43530 con 0x5571aecf2e60 2023-09-21T12:56:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6e759e700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 0x7fd6d00a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6e759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6e759e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47254/0 (socket says 172.21.15.142:47254) 2023-09-21T12:56:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.691+0000 7fd6e759e700 1 -- 172.21.15.142:0/2234911589 learned_addr learned my addr 172.21.15.142:0/2234911589 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e659c700 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aeced260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf2e60 0x5571aecf3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 -- 172.21.15.142:0/2234911589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf2e60 msgr2=0x5571aecf3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf2e60 0x5571aecf3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 -- 172.21.15.142:0/2234911589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 msgr2=0x5571aeced260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aeced260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 -- 172.21.15.142:0/2234911589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571aea69d80 con 0x5571aeced7a0 2023-09-21T12:56:43.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 0x7fd6d00a2d00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0008dc0 tx=0x7fd6e00094b0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6e759e700 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000ef30 tx=0x7fd6e001d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4ab86097f2f685a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.692+0000 7fd6cd7fa700 1 -- 172.21.15.142:0/2234911589 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0009040 con 0x5571aeced7a0 2023-09-21T12:56:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd6cd7fa700 1 -- 172.21.15.142:0/2234911589 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6e000f040 con 0x5571aeced7a0 2023-09-21T12:56:43.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd6cd7fa700 1 -- 172.21.15.142:0/2234911589 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0025d50 con 0x5571aeced7a0 2023-09-21T12:56:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 -- 172.21.15.142:0/2234911589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 msgr2=0x5571aecedbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd6e000ef30 tx=0x7fd6e001d000 comp rx=0 tx=0).stop 2023-09-21T12:56:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 -- 172.21.15.142:0/2234911589 shutdown_connections 2023-09-21T12:56:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecedbe0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf2e60 0x5571aecf3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 --2- 172.21.15.142:0/2234911589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aeced260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 -- 172.21.15.142:0/2234911589 >> 172.21.15.142:0/2234911589 conn(0x5571aec19fa0 msgr2=0x5571aece8180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.693+0000 7fd700bacb80 1 -- 172.21.15.142:0/2234911589 shutdown_connections 2023-09-21T12:56:43.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.694+0000 7fd700bacb80 1 -- 172.21.15.142:0/2234911589 wait complete. 2023-09-21T12:56:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.694+0000 7fd700bacb80 1 -- start start 2023-09-21T12:56:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.694+0000 7fd700bacb80 1 Processor -- start 2023-09-21T12:56:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecf6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aecf7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aec3ee20 con 0x5571aecf2e60 2023-09-21T12:56:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aebdb6e0 con 0x5571aeced7a0 2023-09-21T12:56:43.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aebdb380 con 0x5571aecf3780 2023-09-21T12:56:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd700bacb80 10 client.0 _ll_register_callbacks cb 0x5571aeb25a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecf6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aecf7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47258/0 (socket says 172.21.15.142:47258) 2023-09-21T12:56:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/1562735580 learned_addr learned my addr 172.21.15.142:0/1562735580 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 -- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 msgr2=0x5571aecf9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 -- 172.21.15.142:0/1562735580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 msgr2=0x5571aecf6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecf6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.695+0000 7fd6e759e700 1 -- 172.21.15.142:0/1562735580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e000ecf0 con 0x5571aecf3780 2023-09-21T12:56:43.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6e759e700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aecf7000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0028040 tx=0x7fd6e001be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34162146e16dac40 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6caff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:56:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0004ea0 con 0x5571aecf3780 2023-09-21T12:56:43.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571aebafb50 con 0x5571aecf3780 2023-09-21T12:56:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd6e0021070 con 0x5571aecf3780 2023-09-21T12:56:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e0030480 con 0x5571aecf3780 2023-09-21T12:56:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd700bacb80 10 client.25528 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:43.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.696+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5571aea52c00 con 0x5571aecf3780 2023-09-21T12:56:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6e003e020 con 0x5571aecf3780 2023-09-21T12:56:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6e002c030 con 0x5571aecf3780 2023-09-21T12:56:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 10 client.25528 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:43.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 10 client.25528 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 20 client.25528 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed07030 0x5571aed09420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 4 client.25528 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:43.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.697+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571aecbbfc0 con 0x5571aed07030 2023-09-21T12:56:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.698+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed07030 0x5571aed09420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.698+0000 7fd6caff5700 10 client.25528 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.698+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed07030 0x5571aed09420 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eda512e82a79a6c server_cookie=8fe3ed843a6f934b in_seq=0 out_seq=0 2023-09-21T12:56:43.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd6caff5700 1 -- 172.21.15.142:0/1562735580 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5571aecbbfc0 con 0x5571aed07030 2023-09-21T12:56:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd6caff5700 10 client.25528 handle_command_reply: tid=0 2023-09-21T12:56:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 client.25528 shutdown 2023-09-21T12:56:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 msgr2=0x5571aecf7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aecf7000 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0028040 tx=0x7fd6e001be50 comp rx=0 tx=0).stop 2023-09-21T12:56:43.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 shutdown_connections 2023-09-21T12:56:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed07030 0x5571aed09420 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aecf7000 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecf9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd6caff5700 0 client.25528 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 --2- 172.21.15.142:0/1562735580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecf6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 >> 172.21.15.142:0/1562735580 conn(0x5571aec19fa0 msgr2=0x5571aece7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 shutdown_connections 2023-09-21T12:56:43.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.699+0000 7fd700bacb80 1 -- 172.21.15.142:0/1562735580 wait complete. 2023-09-21T12:56:43.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.700+0000 7fd700bacb80 20 client.25528 trim_cache size 0 max 16384 2023-09-21T12:56:43.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.715+0000 7fd700bacb80 1 Processor -- start 2023-09-21T12:56:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.715+0000 7fd700bacb80 1 -- start start 2023-09-21T12:56:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 0x5571aeced260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aecf6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aeabf8c0 con 0x5571aecf3780 2023-09-21T12:56:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aece9be0 con 0x5571aecf2e60 2023-09-21T12:56:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd700bacb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aecf7f60 con 0x5571aeced7a0 2023-09-21T12:56:43.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 0x5571aeced260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47266/0 (socket says 172.21.15.142:47266) 2023-09-21T12:56:43.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 -- 172.21.15.142:0/3979432410 learned_addr learned my addr 172.21.15.142:0/3979432410 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e759e700 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aecf6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 -- 172.21.15.142:0/3979432410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 msgr2=0x5571aeced260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 0x5571aeced260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 -- 172.21.15.142:0/3979432410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 msgr2=0x5571aecf6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aecf6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e659c700 1 -- 172.21.15.142:0/3979432410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571aea901f0 con 0x5571aecf2e60 2023-09-21T12:56:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.716+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 0x5571aeced260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.717+0000 7fd6e659c700 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009990 tx=0x7fd6dc005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2dbda4e346fd79 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.717+0000 7fd6cdffb700 1 -- 172.21.15.142:0/3979432410 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc01d030 con 0x5571aecf2e60 2023-09-21T12:56:43.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.717+0000 7fd6cdffb700 1 -- 172.21.15.142:0/3979432410 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6dc01e040 con 0x5571aecf2e60 2023-09-21T12:56:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.717+0000 7fd6cdffb700 1 -- 172.21.15.142:0/3979432410 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc003c30 con 0x5571aecf2e60 2023-09-21T12:56:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- 172.21.15.142:0/3979432410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 msgr2=0x5571aecfe170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc009990 tx=0x7fd6dc005960 comp rx=0 tx=0).stop 2023-09-21T12:56:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- 172.21.15.142:0/3979432410 shutdown_connections 2023-09-21T12:56:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf3780 0x5571aecf6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aeced7a0 0x5571aeced260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 --2- 172.21.15.142:0/3979432410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aecf2e60 0x5571aecfe170 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- 172.21.15.142:0/3979432410 >> 172.21.15.142:0/3979432410 conn(0x5571aec19fa0 msgr2=0x5571aecf0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- 172.21.15.142:0/3979432410 shutdown_connections 2023-09-21T12:56:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- 172.21.15.142:0/3979432410 wait complete. 2023-09-21T12:56:43.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 -- start start 2023-09-21T12:56:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.718+0000 7fd700bacb80 1 Processor -- start 2023-09-21T12:56:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecefb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aed5adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aed5b300 con 0x5571aecf2e60 2023-09-21T12:56:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aed5b440 con 0x5571aeced7a0 2023-09-21T12:56:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571aed5b5b0 con 0x5571aecf3780 2023-09-21T12:56:43.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd700bacb80 10 client.0 _ll_register_callbacks cb 0x5571aeb25a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd6e6d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47268/0 (socket says 172.21.15.142:47268) 2023-09-21T12:56:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/4246278977 learned_addr learned my addr 172.21.15.142:0/4246278977 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd6e659c700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecefb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.719+0000 7fd6e759e700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aed5adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/4246278977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 msgr2=0x5571aed5adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aed5adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/4246278977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 msgr2=0x5571aecefb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:43.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecefb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 -- 172.21.15.142:0/4246278977 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e81a6070 con 0x5571aeced7a0 2023-09-21T12:56:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e759e700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aed5adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6e6d9d700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8095aa0 tx=0x7fd6d8084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a52551cbd5c99a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:43.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6caff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:56:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d809d3d0 con 0x5571aeced7a0 2023-09-21T12:56:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd6d80a1610 con 0x5571aeced7a0 2023-09-21T12:56:43.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6e000f040 con 0x5571aeced7a0 2023-09-21T12:56:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6d80105a0 con 0x5571aeced7a0 2023-09-21T12:56:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd700bacb80 10 client.25571 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.720+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fd6e8110530 con 0x5571aeced7a0 2023-09-21T12:56:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6e000f040 con 0x5571aeced7a0 2023-09-21T12:56:43.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6d8098b90 con 0x5571aeced7a0 2023-09-21T12:56:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 10 client.25571 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 10 client.25571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 20 client.25571 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:43.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed5cc20 0x5571aed5f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 4 client.25571 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:56:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5571aec37e00 con 0x5571aed5cc20 2023-09-21T12:56:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.721+0000 7fd6e659c700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed5cc20 0x5571aed5f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:43.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.722+0000 7fd6caff5700 10 client.25571 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.722+0000 7fd6e659c700 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed5cc20 0x5571aed5f040 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=156f274e133e9e2f server_cookie=c222f504017f36c8 in_seq=0 out_seq=0 2023-09-21T12:56:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.728+0000 7fd6caff5700 1 -- 172.21.15.142:0/4246278977 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5571aec37e00 con 0x5571aed5cc20 2023-09-21T12:56:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.728+0000 7fd6caff5700 10 client.25571 handle_command_reply: tid=0 2023-09-21T12:56:43.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.728+0000 7fd700bacb80 1 client.25571 shutdown 2023-09-21T12:56:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.728+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 msgr2=0x5571aecef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.728+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd6d8095aa0 tx=0x7fd6d8084040 comp rx=0 tx=0).stop 2023-09-21T12:56:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 shutdown_connections 2023-09-21T12:56:43.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5571aed5cc20 0x5571aed5f040 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5571aecf3780 0x5571aed5adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5571aeced7a0 0x5571aecef630 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 --2- 172.21.15.142:0/4246278977 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5571aecf2e60 0x5571aecefb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd6caff5700 0 client.25571 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 >> 172.21.15.142:0/4246278977 conn(0x5571aec19fa0 msgr2=0x5571aecf3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 shutdown_connections 2023-09-21T12:56:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 1 -- 172.21.15.142:0/4246278977 wait complete. 2023-09-21T12:56:43.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.729+0000 7fd700bacb80 20 client.25571 trim_cache size 0 max 16384 2023-09-21T12:56:43.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:56:43.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:56:43.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:56:43.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:56:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 msgr2=0x7fd6d00a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 0x7fd6d00a2d00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0008dc0 tx=0x7fd6e00094b0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 msgr2=0x7fd6e8198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:43.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd6d800e9f0 tx=0x7fd6d800ed00 comp rx=0 tx=0).stop 2023-09-21T12:56:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 shutdown_connections 2023-09-21T12:56:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6d00a0840 0x7fd6d00a2d00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6e819d830 0x7fd6e819dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6e8103020 0x7fd6e8198e90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 --2- 172.21.15.142:0/3060397631 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6e8108140 0x7fd6e81993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 >> 172.21.15.142:0/3060397631 conn(0x7fd6e80fe8c0 msgr2=0x7fd6e80ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 shutdown_connections 2023-09-21T12:56:43.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:43.730+0000 7fd6ec9fe700 1 -- 172.21.15.142:0/3060397631 wait complete. 2023-09-21T12:56:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:45 smithi156 ceph-mon[134078]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-09-21T12:56:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:45 smithi142 ceph-mon[97663]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-09-21T12:56:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:45 smithi160 ceph-mon[134450]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2023-09-21T12:56:47.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:47 smithi156 ceph-mon[134078]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-21T12:56:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:47 smithi142 ceph-mon[97663]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-21T12:56:47.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:47 smithi160 ceph-mon[134450]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-21T12:56:49.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:49 smithi156 ceph-mon[134078]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:49 smithi142 ceph-mon[97663]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:49 smithi160 ceph-mon[134450]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-09-21T12:56:51.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:51 smithi156 ceph-mon[134078]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-09-21T12:56:51.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:51 smithi142 ceph-mon[97663]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-09-21T12:56:51.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:51 smithi160 ceph-mon[134450]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 8 op/s 2023-09-21T12:56:53.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:53 smithi156 ceph-mon[134078]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:56:53.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:53 smithi142 ceph-mon[97663]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:56:53.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:53 smithi160 ceph-mon[134450]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 7 op/s 2023-09-21T12:56:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:55 smithi156 ceph-mon[134078]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2023-09-21T12:56:55.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:55 smithi142 ceph-mon[97663]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2023-09-21T12:56:55.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:55 smithi160 ceph-mon[134450]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 5 op/s 2023-09-21T12:56:56.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.964+0000 7f3289d9d700 1 -- 172.21.15.142:0/1787134775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 msgr2=0x7f328410dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.964+0000 7f3289d9d700 1 --2- 172.21.15.142:0/1787134775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328410dba0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f327c00b0a0 tx=0x7f327c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 -- 172.21.15.142:0/1787134775 shutdown_connections 2023-09-21T12:56:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 --2- 172.21.15.142:0/1787134775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328410dba0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 --2- 172.21.15.142:0/1787134775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f3284101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 --2- 172.21.15.142:0/1787134775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f3284102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 -- 172.21.15.142:0/1787134775 >> 172.21.15.142:0/1787134775 conn(0x7f32840fc6a0 msgr2=0x7f32840feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 -- 172.21.15.142:0/1787134775 shutdown_connections 2023-09-21T12:56:56.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.965+0000 7f3289d9d700 1 -- 172.21.15.142:0/1787134775 wait complete. 2023-09-21T12:56:56.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.966+0000 7f3289d9d700 1 Processor -- start 2023-09-21T12:56:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.966+0000 7f3289d9d700 1 -- start start 2023-09-21T12:56:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f32841995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328419da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328419e080 con 0x7f3284102800 2023-09-21T12:56:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328419e1f0 con 0x7f3284100f20 2023-09-21T12:56:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3289d9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328419e3b0 con 0x7f32841031c0 2023-09-21T12:56:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.967+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44138/0 (socket says 172.21.15.142:44138) 2023-09-21T12:56:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 -- 172.21.15.142:0/2353526622 learned_addr learned my addr 172.21.15.142:0/2353526622 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f328959c700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328419da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3283fff700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f32841995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 -- 172.21.15.142:0/2353526622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 msgr2=0x7f328419da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:56.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328419da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 -- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 msgr2=0x7f32841995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f32841995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 -- 172.21.15.142:0/2353526622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009d00 con 0x7f3284100f20 2023-09-21T12:56:56.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3283fff700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f32841995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.968+0000 7f3288d9b700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f327800e9a0 tx=0x7f327800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:56.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.969+0000 7f3281ffb700 1 -- 172.21.15.142:0/2353526622 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278009790 con 0x7f3284100f20 2023-09-21T12:56:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.969+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328419e690 con 0x7f3284100f20 2023-09-21T12:56:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.969+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841a5ed0 con 0x7f3284100f20 2023-09-21T12:56:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.969+0000 7f3281ffb700 1 -- 172.21.15.142:0/2353526622 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f327800cbd0 con 0x7f3284100f20 2023-09-21T12:56:56.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.969+0000 7f3281ffb700 1 -- 172.21.15.142:0/2353526622 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278018680 con 0x7f3284100f20 2023-09-21T12:56:56.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.974+0000 7f3281ffb700 1 -- 172.21.15.142:0/2353526622 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 24) v1 ==== 135436+0+0 (secure 0 0 0) 0x7f327800cd40 con 0x7f3284100f20 2023-09-21T12:56:56.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.975+0000 7f329e8c7b80 1 Processor -- start 2023-09-21T12:56:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 -- start start 2023-09-21T12:56:56.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d5e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0cccc40 con 0x562dc0d587a0 2023-09-21T12:56:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0cb0c10 con 0x562dc0d5e780 2023-09-21T12:56:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.976+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0cae530 con 0x562dc0d5de60 2023-09-21T12:56:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f328959c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d5e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44150/0 (socket says 172.21.15.142:44150) 2023-09-21T12:56:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 -- 172.21.15.142:0/3962013545 learned_addr learned my addr 172.21.15.142:0/3962013545 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:56.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3281ffb700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 0x7f32740a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3281ffb700 1 -- 172.21.15.142:0/2353526622 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3278014070 con 0x7f3284100f20 2023-09-21T12:56:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 -- 172.21.15.142:0/3962013545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 msgr2=0x562dc0d5e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:56.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d5e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 -- 172.21.15.142:0/3962013545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 msgr2=0x562dc0d58be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.977+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f3288d9b700 1 -- 172.21.15.142:0/3962013545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc0ad4d80 con 0x562dc0d5e780 2023-09-21T12:56:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32780992c0 tx=0x7f3278099410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6f55a40501d8ef2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:56.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f328959c700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 0x7f32740a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f326effd700 1 -- 172.21.15.142:0/3962013545 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278098f20 con 0x562dc0d5e780 2023-09-21T12:56:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f326effd700 1 -- 172.21.15.142:0/3962013545 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3278099cc0 con 0x562dc0d5e780 2023-09-21T12:56:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.978+0000 7f326effd700 1 -- 172.21.15.142:0/3962013545 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780ce0d0 con 0x562dc0d5e780 2023-09-21T12:56:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3962013545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 msgr2=0x562dc0d58260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:56.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f328959c700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 0x7f32740a2d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f327c00b780 tx=0x7f327c00b3b0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f32780992c0 tx=0x7f3278099410 comp rx=0 tx=0).stop 2023-09-21T12:56:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3962013545 shutdown_connections 2023-09-21T12:56:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d5e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3962013545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d58260 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.979+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3962013545 >> 172.21.15.142:0/3962013545 conn(0x562dc0c84fa0 msgr2=0x562dc0d53180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.980+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3962013545 shutdown_connections 2023-09-21T12:56:56.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.980+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3962013545 wait complete. 2023-09-21T12:56:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.980+0000 7f329e8c7b80 1 -- start start 2023-09-21T12:56:56.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 Processor -- start 2023-09-21T12:56:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 0x562dc0d64730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0ca9e20 con 0x562dc0d5de60 2023-09-21T12:56:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0c466e0 con 0x562dc0d5e780 2023-09-21T12:56:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.981+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0c46380 con 0x562dc0d587a0 2023-09-21T12:56:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f329e8c7b80 10 client.0 _ll_register_callbacks cb 0x562dc0b90a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36194/0 (socket says 172.21.15.142:36194) 2023-09-21T12:56:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 -- 172.21.15.142:0/4030249021 learned_addr learned my addr 172.21.15.142:0/4030249021 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f328959c700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3288d9b700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 0x562dc0d64730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 -- 172.21.15.142:0/4030249021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 msgr2=0x562dc0d64730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:56.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 0x562dc0d64730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 -- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 msgr2=0x562dc0d620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3283fff700 1 -- 172.21.15.142:0/4030249021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841a5ed0 con 0x562dc0d5de60 2023-09-21T12:56:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.982+0000 7f3288d9b700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 0x562dc0d64730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:56.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.983+0000 7f3283fff700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3270011660 tx=0x7f3270011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7b7ddaa319d026 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.983+0000 7f3263fff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:56:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.983+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270012860 con 0x562dc0d5de60 2023-09-21T12:56:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.983+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f32700129c0 con 0x562dc0d5de60 2023-09-21T12:56:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.983+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562dc0c1ab50 con 0x562dc0d5de60 2023-09-21T12:56:56.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.984+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3270012b80 con 0x562dc0d5de60 2023-09-21T12:56:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.984+0000 7f329e8c7b80 10 client.15540 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.984+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562dc0abdc00 con 0x562dc0d5de60 2023-09-21T12:56:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.984+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3270027020 con 0x562dc0d5de60 2023-09-21T12:56:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f327000f440 con 0x562dc0d5de60 2023-09-21T12:56:56.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 10 client.15540 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:56.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 20 client.15540 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0d7aaa0 0x562dc0d7cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 4 client.15540 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:56:56.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562dc0d26fc0 con 0x562dc0d7aaa0 2023-09-21T12:56:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.985+0000 7f3288d9b700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0d7aaa0 0x562dc0d7cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.986+0000 7f3288d9b700 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0d7aaa0 0x562dc0d7cec0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6362cb90c8bb7775 server_cookie=e8638c841db1eaaa in_seq=0 out_seq=0 2023-09-21T12:56:56.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.986+0000 7f3263fff700 10 client.15540 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f3263fff700 1 -- 172.21.15.142:0/4030249021 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562dc0d26fc0 con 0x562dc0d7aaa0 2023-09-21T12:56:56.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f3263fff700 10 client.15540 handle_command_reply: tid=0 2023-09-21T12:56:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 client.15540 shutdown 2023-09-21T12:56:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 msgr2=0x562dc0d61a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3270011660 tx=0x7f3270011a20 comp rx=0 tx=0).stop 2023-09-21T12:56:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 shutdown_connections 2023-09-21T12:56:56.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0d7aaa0 0x562dc0d7cec0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5e780 0x562dc0d620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d587a0 0x562dc0d64730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/4030249021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5de60 0x562dc0d61a20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 >> 172.21.15.142:0/4030249021 conn(0x562dc0c84fa0 msgr2=0x562dc0d52f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:56.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f3263fff700 0 client.15540 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.987+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 shutdown_connections 2023-09-21T12:56:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.988+0000 7f329e8c7b80 1 -- 172.21.15.142:0/4030249021 wait complete. 2023-09-21T12:56:56.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:56.988+0000 7f329e8c7b80 20 client.15540 trim_cache size 0 max 16384 2023-09-21T12:56:57.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.016+0000 7f329e8c7b80 1 Processor -- start 2023-09-21T12:56:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 -- start start 2023-09-21T12:56:57.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5de60 0x562dc0d5bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0b2a8c0 con 0x562dc0d587a0 2023-09-21T12:56:57.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0d78030 con 0x562dc0d5de60 2023-09-21T12:56:57.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.017+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0d536d0 con 0x562dc0d5e780 2023-09-21T12:56:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41054/0 (socket says 172.21.15.142:41054) 2023-09-21T12:56:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 -- 172.21.15.142:0/1609936241 learned_addr learned my addr 172.21.15.142:0/1609936241 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:57.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f3288d9b700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f3283fff700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5de60 0x562dc0d5bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 -- 172.21.15.142:0/1609936241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5de60 msgr2=0x562dc0d5bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:57.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5de60 0x562dc0d5bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 -- 172.21.15.142:0/1609936241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 msgr2=0x562dc0d58260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f328959c700 1 -- 172.21.15.142:0/1609936241 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562dc0afb1f0 con 0x562dc0d5e780 2023-09-21T12:56:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.018+0000 7f3288d9b700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:56:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.019+0000 7f328959c700 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327c015000 tx=0x7f327c009360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8394ecadbe2b852a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.019+0000 7f326f7fe700 1 -- 172.21.15.142:0/1609936241 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c00e040 con 0x562dc0d5e780 2023-09-21T12:56:57.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.019+0000 7f326f7fe700 1 -- 172.21.15.142:0/1609936241 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f327c027040 con 0x562dc0d5e780 2023-09-21T12:56:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.019+0000 7f326f7fe700 1 -- 172.21.15.142:0/1609936241 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c005040 con 0x562dc0d5e780 2023-09-21T12:56:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 -- 172.21.15.142:0/1609936241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 msgr2=0x562dc0d5c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:57.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f327c015000 tx=0x7f327c009360 comp rx=0 tx=0).stop 2023-09-21T12:56:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 -- 172.21.15.142:0/1609936241 shutdown_connections 2023-09-21T12:56:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d587a0 0x562dc0d58260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5e780 0x562dc0d5c150 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/1609936241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d5de60 0x562dc0d5bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.020+0000 7f329e8c7b80 1 -- 172.21.15.142:0/1609936241 >> 172.21.15.142:0/1609936241 conn(0x562dc0c84fa0 msgr2=0x562dc0d6d900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.021+0000 7f329e8c7b80 1 -- 172.21.15.142:0/1609936241 shutdown_connections 2023-09-21T12:56:57.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.021+0000 7f329e8c7b80 1 -- 172.21.15.142:0/1609936241 wait complete. 2023-09-21T12:56:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.021+0000 7f329e8c7b80 1 -- start start 2023-09-21T12:56:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.021+0000 7f329e8c7b80 1 Processor -- start 2023-09-21T12:56:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d68c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5e780 0x562dc0dcd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0dcde10 con 0x562dc0d5e780 2023-09-21T12:56:57.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0dcdf50 con 0x562dc0d587a0 2023-09-21T12:56:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562dc0dce090 con 0x562dc0d5de60 2023-09-21T12:56:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f329e8c7b80 10 client.0 _ll_register_callbacks cb 0x562dc0b90a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:56:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.022+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44174/0 (socket says 172.21.15.142:44174) 2023-09-21T12:56:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 -- 172.21.15.142:0/3876268990 learned_addr learned my addr 172.21.15.142:0/3876268990 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:56:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3283fff700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d68c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 -- 172.21.15.142:0/3876268990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 msgr2=0x562dc0d68c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d68c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 -- 172.21.15.142:0/3876268990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5e780 msgr2=0x562dc0dcd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:56:57.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5e780 0x562dc0dcd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3288d9b700 1 -- 172.21.15.142:0/3876268990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328410e4a0 con 0x562dc0d587a0 2023-09-21T12:56:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.023+0000 7f3283fff700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d68c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:56:57.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f3288d9b700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f32780992c0 tx=0x7f3278099e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75bf27dddaa9e132 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:56:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f3263fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:56:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278098f20 con 0x562dc0d587a0 2023-09-21T12:56:57.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f32780a1630 con 0x562dc0d587a0 2023-09-21T12:56:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3278099cc0 con 0x562dc0d587a0 2023-09-21T12:56:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f327809d3f0 con 0x562dc0d587a0 2023-09-21T12:56:57.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f329e8c7b80 10 client.25589 fetch_fsmap learned FSMap version 23 2023-09-21T12:56:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.024+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562dc0ad3250 con 0x562dc0d587a0 2023-09-21T12:56:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.025+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3278099cc0 con 0x562dc0d587a0 2023-09-21T12:56:57.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.025+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f32780840b0 con 0x562dc0d587a0 2023-09-21T12:56:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 10 client.25589 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:56:57.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 10 client.25589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:56:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 20 client.25589 populate_metadata read hostname 'smithi142' 2023-09-21T12:56:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0dcf550 0x562dc0dd1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:56:57.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 4 client.25589 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:56:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562dc0ca2e00 con 0x562dc0dcf550 2023-09-21T12:56:57.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f3283fff700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0dcf550 0x562dc0dd1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:56:57.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f3263fff700 10 client.25589 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:57.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.026+0000 7f3283fff700 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0dcf550 0x562dc0dd1940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcd0bac023e9f023 server_cookie=14b1241820ad0dd0 in_seq=0 out_seq=0 2023-09-21T12:56:57.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f3263fff700 1 -- 172.21.15.142:0/3876268990 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562dc0ca2e00 con 0x562dc0dcf550 2023-09-21T12:56:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f3263fff700 10 client.25589 handle_command_reply: tid=0 2023-09-21T12:56:57.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 client.25589 shutdown 2023-09-21T12:56:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 msgr2=0x562dc0d68750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f32780992c0 tx=0x7f3278099e30 comp rx=0 tx=0).stop 2023-09-21T12:56:57.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 shutdown_connections 2023-09-21T12:56:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562dc0dcf550 0x562dc0dd1940 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562dc0d5e780 0x562dc0dcd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.036+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562dc0d587a0 0x562dc0d68750 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f329e8c7b80 1 --2- 172.21.15.142:0/3876268990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562dc0d5de60 0x562dc0d68c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 >> 172.21.15.142:0/3876268990 conn(0x562dc0c84fa0 msgr2=0x562dc0d5bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f3263fff700 0 client.25589 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:56:57.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 shutdown_connections 2023-09-21T12:56:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f329e8c7b80 1 -- 172.21.15.142:0/3876268990 wait complete. 2023-09-21T12:56:57.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.037+0000 7f329e8c7b80 20 client.25589 trim_cache size 0 max 16384 2023-09-21T12:56:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:56:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:56:57.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:56:57.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:56:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 msgr2=0x7f32740a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:57.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 0x7f32740a2d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f327c00b780 tx=0x7f327c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 msgr2=0x7f32841990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:56:57.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f327800e9a0 tx=0x7f327800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 shutdown_connections 2023-09-21T12:56:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f32740a08c0 0x7f32740a2d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32841031c0 0x7f328419da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3284100f20 0x7f32841990a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 --2- 172.21.15.142:0/2353526622 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3284102800 0x7f32841995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:56:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 >> 172.21.15.142:0/2353526622 conn(0x7f32840fc6a0 msgr2=0x7f328410c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:56:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 shutdown_connections 2023-09-21T12:56:57.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:56:57.038+0000 7f3289d9d700 1 -- 172.21.15.142:0/2353526622 wait complete. 2023-09-21T12:56:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:57 smithi156 ceph-mon[134078]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-21T12:56:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:57 smithi142 ceph-mon[97663]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-21T12:56:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:57 smithi160 ceph-mon[134450]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-09-21T12:56:59.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:56:59 smithi156 ceph-mon[134078]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-09-21T12:56:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:56:59 smithi142 ceph-mon[97663]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-09-21T12:56:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:56:59 smithi160 ceph-mon[134450]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 5 op/s 2023-09-21T12:57:00.417 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:57:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:57:00.050+0000 7ff0b199b700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:57:00.417 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:57:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:57:00.050+0000 7ff0b199b700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:57:00.418 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:57:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:57:00.050+0000 7ff0b199b700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:57:00.418 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:57:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:57:00.050+0000 7ff0b199b700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:57:00.419 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 12:57:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T12:57:00.050+0000 7ff0b199b700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-21T12:57:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:01 smithi156 ceph-mon[134078]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-09-21T12:57:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:01 smithi156 ceph-mon[134078]: mgrmap e25: x(active, since 46s), standbys: z, y 2023-09-21T12:57:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:01 smithi142 ceph-mon[97663]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-09-21T12:57:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:01 smithi142 ceph-mon[97663]: mgrmap e25: x(active, since 46s), standbys: z, y 2023-09-21T12:57:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:01 smithi160 ceph-mon[134450]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 13 KiB/s wr, 9 op/s 2023-09-21T12:57:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:01 smithi160 ceph-mon[134450]: mgrmap e25: x(active, since 46s), standbys: z, y 2023-09-21T12:57:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:03 smithi156 ceph-mon[134078]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-09-21T12:57:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:03 smithi142 ceph-mon[97663]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-09-21T12:57:03.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:03 smithi160 ceph-mon[134450]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 20 op/s 2023-09-21T12:57:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:05 smithi156 ceph-mon[134078]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-09-21T12:57:05.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:05 smithi142 ceph-mon[97663]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-09-21T12:57:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:05 smithi160 ceph-mon[134450]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 19 op/s 2023-09-21T12:57:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:07 smithi156 ceph-mon[134078]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:07 smithi142 ceph-mon[97663]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:07 smithi160 ceph-mon[134450]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:08.778 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:57:09.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 -- 172.21.15.142:0/3734390713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d44101970 msgr2=0x7f9d441059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 --2- 172.21.15.142:0/3734390713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d44101970 0x7f9d441059b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9d38009990 tx=0x7f9d38009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 -- 172.21.15.142:0/3734390713 shutdown_connections 2023-09-21T12:57:09.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 --2- 172.21.15.142:0/3734390713 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d44100fc0 0x7f9d441013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 --2- 172.21.15.142:0/3734390713 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d441060e0 0x7f9d4410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 --2- 172.21.15.142:0/3734390713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d44101970 0x7f9d441059b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 -- 172.21.15.142:0/3734390713 >> 172.21.15.142:0/3734390713 conn(0x7f9d440fc840 msgr2=0x7f9d440fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 -- 172.21.15.142:0/3734390713 shutdown_connections 2023-09-21T12:57:09.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.121+0000 7f9d491ff700 1 -- 172.21.15.142:0/3734390713 wait complete. 2023-09-21T12:57:09.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.123+0000 7f9d491ff700 1 Processor -- start 2023-09-21T12:57:09.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.123+0000 7f9d491ff700 1 -- start start 2023-09-21T12:57:09.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.123+0000 7f9d491ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.123+0000 7f9d491ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 0x7f9d44199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d491ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d491ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4419e570 con 0x7f9d4419daf0 2023-09-21T12:57:09.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d491ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4419e6e0 con 0x7f9d44100fc0 2023-09-21T12:57:09.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d491ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4419e8a0 con 0x7f9d441060e0 2023-09-21T12:57:09.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d4359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33272/0 (socket says 172.21.15.142:33272) 2023-09-21T12:57:09.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1785076443 learned_addr learned my addr 172.21.15.142:0/1785076443 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59724/0 (socket says 172.21.15.142:59724) 2023-09-21T12:57:09.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.124+0000 7f9d4259c700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 0x7f9d44199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1785076443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 msgr2=0x7f9d44199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 0x7f9d44199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 msgr2=0x7f9d4419df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1785076443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d380095f0 con 0x7f9d44100fc0 2023-09-21T12:57:09.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d4259c700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 0x7f9d44199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:09.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400d950 tx=0x7f9d3400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.125+0000 7f9d2bfff700 1 -- 172.21.15.142:0/1785076443 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400f890 con 0x7f9d44100fc0 2023-09-21T12:57:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.126+0000 7f9d2bfff700 1 -- 172.21.15.142:0/1785076443 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d34010460 con 0x7f9d44100fc0 2023-09-21T12:57:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.126+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d44107c70 con 0x7f9d44100fc0 2023-09-21T12:57:09.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.126+0000 7f9d2bfff700 1 -- 172.21.15.142:0/1785076443 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3400e610 con 0x7f9d44100fc0 2023-09-21T12:57:09.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.126+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d441081d0 con 0x7f9d44100fc0 2023-09-21T12:57:09.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.132+0000 7f9d2bfff700 1 -- 172.21.15.142:0/1785076443 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f9d340108d0 con 0x7f9d44100fc0 2023-09-21T12:57:09.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.132+0000 7f9d5cbf3b80 1 Processor -- start 2023-09-21T12:57:09.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 -- start start 2023-09-21T12:57:09.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56113730eca0 con 0x56113739f360 2023-09-21T12:57:09.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611372f2c70 con 0x56113739a610 2023-09-21T12:57:09.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.133+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611372f0590 con 0x56113739af30 2023-09-21T12:57:09.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d4259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49962/0 (socket says 172.21.15.142:49962) 2023-09-21T12:57:09.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2860738908 learned_addr learned my addr 172.21.15.142:0/2860738908 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d4259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59730/0 (socket says 172.21.15.142:59730) 2023-09-21T12:57:09.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d4359e700 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2860738908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 msgr2=0x56113739a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2860738908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 msgr2=0x56113739f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.134+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2860738908 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561137116de0 con 0x56113739af30 2023-09-21T12:57:09.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d2bfff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 0x7f9d2c0a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d340c9500 tx=0x7f9d340d43c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df339cccee2bafb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d2bfff700 1 -- 172.21.15.142:0/1785076443 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d340cbfc0 con 0x7f9d44100fc0 2023-09-21T12:57:09.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d297fa700 1 -- 172.21.15.142:0/2860738908 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34095530 con 0x56113739af30 2023-09-21T12:57:09.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d297fa700 1 -- 172.21.15.142:0/2860738908 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d34098fc0 con 0x56113739af30 2023-09-21T12:57:09.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.135+0000 7f9d297fa700 1 -- 172.21.15.142:0/2860738908 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34099280 con 0x56113739af30 2023-09-21T12:57:09.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.136+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 0x7f9d2c0a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.136+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2860738908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 msgr2=0x56113739ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.136+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d340c9500 tx=0x7f9d340d43c0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2860738908 shutdown_connections 2023-09-21T12:57:09.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2860738908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x56113739ee20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2860738908 >> 172.21.15.142:0/2860738908 conn(0x5611372c7000 msgr2=0x5611373956a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 0x7f9d2c0a2e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c004090 tx=0x7f9d3c00b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2860738908 shutdown_connections 2023-09-21T12:57:09.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.137+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2860738908 wait complete. 2023-09-21T12:57:09.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.138+0000 7f9d5cbf3b80 1 -- start start 2023-09-21T12:57:09.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.138+0000 7f9d5cbf3b80 1 Processor -- start 2023-09-21T12:57:09.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x5611373a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 0x5611373a45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611372ebe80 con 0x56113739af30 2023-09-21T12:57:09.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561137288740 con 0x56113739a610 2023-09-21T12:57:09.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611372883e0 con 0x56113739f360 2023-09-21T12:57:09.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d5cbf3b80 10 client.0 _ll_register_callbacks cb 0x5611371d2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:09.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x5611373a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d4359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 0x5611373a45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d4359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 0x5611373a45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49966/0 (socket says 172.21.15.142:49966) 2023-09-21T12:57:09.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.139+0000 7f9d4359e700 1 -- 172.21.15.142:0/2160304702 learned_addr learned my addr 172.21.15.142:0/2160304702 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2160304702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 msgr2=0x5611373a45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 0x5611373a45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2160304702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 msgr2=0x5611373a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2160304702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d441081d0 con 0x56113739a610 2023-09-21T12:57:09.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:09.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x5611373a6b90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d340c9500 tx=0x7f9d3400dfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29a896494fa37a21 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.140+0000 7f9d26ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:09.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340cf540 con 0x56113739a610 2023-09-21T12:57:09.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d340998f0 con 0x56113739a610 2023-09-21T12:57:09.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56113725cbb0 con 0x56113739a610 2023-09-21T12:57:09.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d34095530 con 0x56113739a610 2023-09-21T12:57:09.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d5cbf3b80 10 client.25604 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:09.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.141+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5611370ffc60 con 0x56113739a610 2023-09-21T12:57:09.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.142+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56113725cbb0 con 0x56113739a610 2023-09-21T12:57:09.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9d340105d0 con 0x56113739a610 2023-09-21T12:57:09.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 10 client.25604 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:09.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 10 client.25604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:09.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 20 client.25604 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:09.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5611373b3f80 0x5611373b6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 4 client.25604 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:09.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561137369020 con 0x5611373b3f80 2023-09-21T12:57:09.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.143+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5611373b3f80 0x5611373b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.144+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5611373b3f80 0x5611373b6370 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b03b93b8edd32070 server_cookie=6d237378b05a531 in_seq=0 out_seq=0 2023-09-21T12:57:09.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.144+0000 7f9d26ff5700 10 client.25604 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:09.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2160304702 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561137369020 con 0x5611373b3f80 2023-09-21T12:57:09.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d26ff5700 10 client.25604 handle_command_reply: tid=0 2023-09-21T12:57:09.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 client.25604 shutdown 2023-09-21T12:57:09.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 msgr2=0x5611373a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x5611373a6b90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d340c9500 tx=0x7f9d3400dfb0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 shutdown_connections 2023-09-21T12:57:09.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5611373b3f80 0x5611373b6370 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739f360 0x5611373a45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x5611373a6b90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2160304702 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 >> 172.21.15.142:0/2160304702 conn(0x5611372c7000 msgr2=0x561137395290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d26ff5700 0 client.25604 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.145+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 shutdown_connections 2023-09-21T12:57:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.146+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2160304702 wait complete. 2023-09-21T12:57:09.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.146+0000 7f9d5cbf3b80 20 client.25604 trim_cache size 0 max 16384 2023-09-21T12:57:09.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 Processor -- start 2023-09-21T12:57:09.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 -- start start 2023-09-21T12:57:09.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x5611373ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56113716c920 con 0x56113739f360 2023-09-21T12:57:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561137396f00 con 0x56113739a610 2023-09-21T12:57:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.179+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611373aba50 con 0x56113739af30 2023-09-21T12:57:09.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33316/0 (socket says 172.21.15.142:33316) 2023-09-21T12:57:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1946201254 learned_addr learned my addr 172.21.15.142:0/1946201254 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d4259c700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x5611373ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1946201254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 msgr2=0x5611373ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x5611373ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1946201254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 msgr2=0x56113739eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d42d9d700 1 -- 172.21.15.142:0/1946201254 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56113713d250 con 0x56113739a610 2023-09-21T12:57:09.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d4259c700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x5611373ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.180+0000 7f9d4359e700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.181+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d34010c80 tx=0x7f9d340c96a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c28b89c523d8f9fd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.181+0000 7f9d29ffb700 1 -- 172.21.15.142:0/1946201254 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d34095530 con 0x56113739a610 2023-09-21T12:57:09.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.181+0000 7f9d29ffb700 1 -- 172.21.15.142:0/1946201254 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d34098b50 con 0x56113739a610 2023-09-21T12:57:09.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.181+0000 7f9d29ffb700 1 -- 172.21.15.142:0/1946201254 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340cf440 con 0x56113739a610 2023-09-21T12:57:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/1946201254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 msgr2=0x56113739cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d34010c80 tx=0x7f9d340c96a0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/1946201254 shutdown_connections 2023-09-21T12:57:09.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739f360 0x56113739eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739a610 0x56113739cc50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/1946201254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739af30 0x5611373ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/1946201254 >> 172.21.15.142:0/1946201254 conn(0x5611372c7000 msgr2=0x56113739e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/1946201254 shutdown_connections 2023-09-21T12:57:09.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.182+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/1946201254 wait complete. 2023-09-21T12:57:09.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.183+0000 7f9d5cbf3b80 1 -- start start 2023-09-21T12:57:09.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.183+0000 7f9d5cbf3b80 1 Processor -- start 2023-09-21T12:57:09.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 0x5611373a75b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611373a7cc0 con 0x56113739af30 2023-09-21T12:57:09.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611373a7e30 con 0x56113739f360 2023-09-21T12:57:09.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611373a7ff0 con 0x56113739a610 2023-09-21T12:57:09.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d5cbf3b80 10 client.0 _ll_register_callbacks cb 0x5611371d2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:09.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d4359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 0x5611373a75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d42d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49980/0 (socket says 172.21.15.142:49980) 2023-09-21T12:57:09.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2325591924 learned_addr learned my addr 172.21.15.142:0/2325591924 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.184+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 msgr2=0x5611373a75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 0x5611373a75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2325591924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 msgr2=0x5611373ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:09.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 -- 172.21.15.142:0/2325591924 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4410e4d0 con 0x56113739a610 2023-09-21T12:57:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d4359e700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 0x5611373a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:09.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d42d9d700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d340981f0 tx=0x7f9d340c94a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=100eadd4a7324f0c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d26ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:09.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d340b7240 con 0x56113739a610 2023-09-21T12:57:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d3409d020 con 0x56113739a610 2023-09-21T12:57:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.185+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5611373b0eb0 con 0x56113739a610 2023-09-21T12:57:09.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d34095530 con 0x56113739a610 2023-09-21T12:57:09.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 10 client.25576 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:09.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5611370ffc60 con 0x56113739a610 2023-09-21T12:57:09.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5611373b0eb0 con 0x56113739a610 2023-09-21T12:57:09.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9d340a0dd0 con 0x56113739a610 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 10 client.25576 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 10 client.25576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 20 client.25576 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561137408a90 0x56113740ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 4 client.25576 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:57:09.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.186+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f9d34098fc0 con 0x561137408a90 2023-09-21T12:57:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.187+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561137408a90 0x56113740ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.187+0000 7f9d4259c700 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561137408a90 0x56113740ae80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f35ed5f5e0ea86e2 server_cookie=69cda942d32fed in_seq=0 out_seq=0 2023-09-21T12:57:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.187+0000 7f9d26ff5700 10 client.25576 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:09.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.187+0000 7f9d26ff5700 1 -- 172.21.15.142:0/2325591924 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f9d34098fc0 con 0x561137408a90 2023-09-21T12:57:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.187+0000 7f9d26ff5700 10 client.25576 handle_command_reply: tid=0 2023-09-21T12:57:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 client.25576 shutdown 2023-09-21T12:57:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 msgr2=0x5611373aaf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9d340981f0 tx=0x7f9d340c94a0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 shutdown_connections 2023-09-21T12:57:09.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561137408a90 0x56113740ae80 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56113739f360 0x5611373a75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56113739a610 0x5611373aaf30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d26ff5700 0 client.25576 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:09.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 --2- 172.21.15.142:0/2325591924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56113739af30 0x5611373ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 >> 172.21.15.142:0/2325591924 conn(0x5611372c7000 msgr2=0x5611373a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 shutdown_connections 2023-09-21T12:57:09.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 1 -- 172.21.15.142:0/2325591924 wait complete. 2023-09-21T12:57:09.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.188+0000 7f9d5cbf3b80 20 client.25576 trim_cache size 0 max 16384 2023-09-21T12:57:09.208 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:09.208 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:57:09.208 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:57:09.208 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:09.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 msgr2=0x7f9d2c0a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 0x7f9d2c0a2e10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c004090 tx=0x7f9d3c00b040 comp rx=0 tx=0).stop 2023-09-21T12:57:09.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 msgr2=0x7f9d44199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d3400d950 tx=0x7f9d3400dc60 comp rx=0 tx=0).stop 2023-09-21T12:57:09.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 shutdown_connections 2023-09-21T12:57:09.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d2c0a0950 0x7f9d2c0a2e10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d4419daf0 0x7f9d4419df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d44100fc0 0x7f9d44199150 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 --2- 172.21.15.142:0/1785076443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d441060e0 0x7f9d44199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.189+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 >> 172.21.15.142:0/1785076443 conn(0x7f9d440fc840 msgr2=0x7f9d440fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.190+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 shutdown_connections 2023-09-21T12:57:09.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.190+0000 7f9d491ff700 1 -- 172.21.15.142:0/1785076443 wait complete. 2023-09-21T12:57:09.220 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:57:09.220 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:57:09.531 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:09 smithi142 ceph-mon[97663]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-09-21T12:57:09.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.557+0000 7f690ebff700 1 -- 172.21.15.142:0/2537406562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6908101970 msgr2=0x7f69081059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.557+0000 7f690ebff700 1 --2- 172.21.15.142:0/2537406562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6908101970 0x7f69081059b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f68f40098f0 tx=0x7f68f4009c00 comp rx=0 tx=0).stop 2023-09-21T12:57:09.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 -- 172.21.15.142:0/2537406562 shutdown_connections 2023-09-21T12:57:09.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 --2- 172.21.15.142:0/2537406562 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f69081060e0 0x7f690810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 --2- 172.21.15.142:0/2537406562 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f69081013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 --2- 172.21.15.142:0/2537406562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6908101970 0x7f69081059b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 -- 172.21.15.142:0/2537406562 >> 172.21.15.142:0/2537406562 conn(0x7f69080fc800 msgr2=0x7f69080fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:09.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 -- 172.21.15.142:0/2537406562 shutdown_connections 2023-09-21T12:57:09.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.558+0000 7f690ebff700 1 -- 172.21.15.142:0/2537406562 wait complete. 2023-09-21T12:57:09.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.559+0000 7f690ebff700 1 Processor -- start 2023-09-21T12:57:09.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 -- start start 2023-09-21T12:57:09.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 0x7f6908197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f690819b890 0x7f690819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690819c310 con 0x7f690819b890 2023-09-21T12:57:09.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690819c480 con 0x7f6908100fc0 2023-09-21T12:57:09.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.560+0000 7f690ebff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690819c640 con 0x7f69081060e0 2023-09-21T12:57:09.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33330/0 (socket says 172.21.15.142:33330) 2023-09-21T12:57:09.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 -- 172.21.15.142:0/789866978 learned_addr learned my addr 172.21.15.142:0/789866978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690d19c700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f690819b890 0x7f690819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f6907fff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 0x7f6908197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 -- 172.21.15.142:0/789866978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 msgr2=0x7f6908197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 0x7f6908197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 -- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f690819b890 msgr2=0x7f690819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:09.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f690819b890 0x7f690819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:09.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f690c99b700 1 -- 172.21.15.142:0/789866978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc0095f0 con 0x7f6908100fc0 2023-09-21T12:57:09.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.561+0000 7f6907fff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 0x7f6908197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f690c99b700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00ec10 tx=0x7f68fc00c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc00cde0 con 0x7f6908100fc0 2023-09-21T12:57:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc0108f0 con 0x7f6908100fc0 2023-09-21T12:57:09.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc018900 con 0x7f6908100fc0 2023-09-21T12:57:09.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f4009520 con 0x7f6908100fc0 2023-09-21T12:57:09.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.562+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6908073370 con 0x7f6908100fc0 2023-09-21T12:57:09.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.564+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6908067bd0 con 0x7f6908100fc0 2023-09-21T12:57:09.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.567+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f68fc010430 con 0x7f6908100fc0 2023-09-21T12:57:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.570+0000 7f6905ffb700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 0x7f68f80a2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.570+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f68fc014070 con 0x7f6908100fc0 2023-09-21T12:57:09.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.571+0000 7f6907fff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 0x7f68f80a2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:09.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.572+0000 7f6907fff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 0x7f68f80a2e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68f40098c0 tx=0x7f68f401d040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:09.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:09.573+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f68fc095ca0 con 0x7f6908100fc0 2023-09-21T12:57:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:09 smithi156 ceph-mon[134078]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-09-21T12:57:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:09 smithi160 ceph-mon[134450]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 23 KiB/s wr, 19 op/s 2023-09-21T12:57:10.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.066+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6908198240 con 0x7f6908100fc0 2023-09-21T12:57:10.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.067+0000 7f6905ffb700 1 -- 172.21.15.142:0/789866978 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f6908198240 con 0x7f6908100fc0 2023-09-21T12:57:10.068 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:57:10.068 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:57:10.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.070+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 msgr2=0x7f68f80a2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.070+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 0x7f68f80a2e60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f68f40098c0 tx=0x7f68f401d040 comp rx=0 tx=0).stop 2023-09-21T12:57:10.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.070+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 msgr2=0x7f6908196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.070+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00ec10 tx=0x7f68fc00c2d0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 shutdown_connections 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f68f80a09a0 0x7f68f80a2e60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f690819b890 0x7f690819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6908100fc0 0x7f6908196ef0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 --2- 172.21.15.142:0/789866978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69081060e0 0x7f6908197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 >> 172.21.15.142:0/789866978 conn(0x7f69080fc800 msgr2=0x7f69080fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 shutdown_connections 2023-09-21T12:57:10.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.071+0000 7f690ebff700 1 -- 172.21.15.142:0/789866978 wait complete. 2023-09-21T12:57:10.073 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:57:10.100 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:57:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 -- 172.21.15.142:0/3841693737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c1019b0 msgr2=0x7f837c1059f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 --2- 172.21.15.142:0/3841693737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c1019b0 0x7f837c1059f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8370009990 tx=0x7f8370009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 -- 172.21.15.142:0/3841693737 shutdown_connections 2023-09-21T12:57:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 --2- 172.21.15.142:0/3841693737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 --2- 172.21.15.142:0/3841693737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 --2- 172.21.15.142:0/3841693737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c1019b0 0x7f837c1059f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.280+0000 7f83813ff700 1 -- 172.21.15.142:0/3841693737 >> 172.21.15.142:0/3841693737 conn(0x7f837c0fc8a0 msgr2=0x7f837c0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.281+0000 7f83813ff700 1 -- 172.21.15.142:0/3841693737 shutdown_connections 2023-09-21T12:57:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.281+0000 7f83813ff700 1 -- 172.21.15.142:0/3841693737 wait complete. 2023-09-21T12:57:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.282+0000 7f83813ff700 1 Processor -- start 2023-09-21T12:57:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 -- start start 2023-09-21T12:57:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c1973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c19ba20 0x7f837c19bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19c4a0 con 0x7f837c101000 2023-09-21T12:57:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19c610 con 0x7f837c19ba20 2023-09-21T12:57:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.283+0000 7f83813ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c19c7d0 con 0x7f837c106120 2023-09-21T12:57:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59794/0 (socket says 172.21.15.142:59794) 2023-09-21T12:57:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837affd700 1 -- 172.21.15.142:0/4076149362 learned_addr learned my addr 172.21.15.142:0/4076149362 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837b7fe700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c19ba20 0x7f837c19bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837a7fc700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c1973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837affd700 1 -- 172.21.15.142:0/4076149362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 msgr2=0x7f837c1973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.284+0000 7f837affd700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c1973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f837affd700 1 -- 172.21.15.142:0/4076149362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c19ba20 msgr2=0x7f837c19bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f837affd700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c19ba20 0x7f837c19bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f837affd700 1 -- 172.21.15.142:0/4076149362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83700095f0 con 0x7f837c101000 2023-09-21T12:57:10.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f837a7fc700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:10.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f837affd700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d950 tx=0x7f836c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f8363fff700 1 -- 172.21.15.142:0/4076149362 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c009b40 con 0x7f837c101000 2023-09-21T12:57:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f8363fff700 1 -- 172.21.15.142:0/4076149362 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f836c009ca0 con 0x7f837c101000 2023-09-21T12:57:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f8363fff700 1 -- 172.21.15.142:0/4076149362 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00f620 con 0x7f837c101000 2023-09-21T12:57:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.285+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c073070 con 0x7f837c101000 2023-09-21T12:57:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.286+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c073530 con 0x7f837c101000 2023-09-21T12:57:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.292+0000 7f8394c4bb80 1 Processor -- start 2023-09-21T12:57:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.292+0000 7f8363fff700 1 -- 172.21.15.142:0/4076149362 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f836c010460 con 0x7f837c101000 2023-09-21T12:57:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.294+0000 7f8363fff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 0x7f83640a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.295+0000 7f8363fff700 1 -- 172.21.15.142:0/4076149362 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f836c0cc5f0 con 0x7f837c101000 2023-09-21T12:57:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 -- start start 2023-09-21T12:57:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f837b7fe700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 0x7f83640a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb9150c40 con 0x558cb91dc0a0 2023-09-21T12:57:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb9134c10 con 0x558cb91dc9c0 2023-09-21T12:57:10.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.296+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb9132530 con 0x558cb91e0e50 2023-09-21T12:57:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50040/0 (socket says 172.21.15.142:50040) 2023-09-21T12:57:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 -- 172.21.15.142:0/828505966 learned_addr learned my addr 172.21.15.142:0/828505966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837affd700 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 -- 172.21.15.142:0/828505966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 msgr2=0x558cb91e0910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e0910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 -- 172.21.15.142:0/828505966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 msgr2=0x558cb91dc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91dc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.297+0000 7f837b7fe700 1 -- 172.21.15.142:0/828505966 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cb8f58d80 con 0x558cb91e0e50 2023-09-21T12:57:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.298+0000 7f837b7fe700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 0x7f83640a2e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8374007c20 tx=0x7f8374007710 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.298+0000 7f837b7fe700 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8374019700 tx=0x7f837401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a25b3b909ddcdcff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.298+0000 7f83617fa700 1 -- 172.21.15.142:0/828505966 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400e050 con 0x558cb91e0e50 2023-09-21T12:57:10.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.298+0000 7f83617fa700 1 -- 172.21.15.142:0/828505966 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837400f040 con 0x558cb91e0e50 2023-09-21T12:57:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.298+0000 7f83617fa700 1 -- 172.21.15.142:0/828505966 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374025900 con 0x558cb91e0e50 2023-09-21T12:57:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.299+0000 7f8394c4bb80 1 -- 172.21.15.142:0/828505966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 msgr2=0x558cb91e12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.299+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8374019700 tx=0x7f837401c000 comp rx=0 tx=0).stop 2023-09-21T12:57:10.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 -- 172.21.15.142:0/828505966 shutdown_connections 2023-09-21T12:57:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91dc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e12b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/828505966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 -- 172.21.15.142:0/828505966 >> 172.21.15.142:0/828505966 conn(0x558cb9108fa0 msgr2=0x558cb91d70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 -- 172.21.15.142:0/828505966 shutdown_connections 2023-09-21T12:57:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.300+0000 7f8394c4bb80 1 -- 172.21.15.142:0/828505966 wait complete. 2023-09-21T12:57:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.301+0000 7f8394c4bb80 1 -- start start 2023-09-21T12:57:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.301+0000 7f8394c4bb80 1 Processor -- start 2023-09-21T12:57:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb912de20 con 0x558cb91dc0a0 2023-09-21T12:57:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb90ca6e0 con 0x558cb91dc9c0 2023-09-21T12:57:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb90ca380 con 0x558cb91e0e50 2023-09-21T12:57:10.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f8394c4bb80 10 client.0 _ll_register_callbacks cb 0x558cb9014a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f837affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f837affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59802/0 (socket says 172.21.15.142:59802) 2023-09-21T12:57:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.302+0000 7f837affd700 1 -- 172.21.15.142:0/1340742607 learned_addr learned my addr 172.21.15.142:0/1340742607 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837a7fc700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837affd700 1 -- 172.21.15.142:0/1340742607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 msgr2=0x558cb91e6370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:10.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837affd700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e6370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837affd700 1 -- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 msgr2=0x558cb91e5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837affd700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.303+0000 7f837affd700 1 -- 172.21.15.142:0/1340742607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83740198f0 con 0x558cb91dc0a0 2023-09-21T12:57:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.304+0000 7f837affd700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b2f0 tx=0x7f836c099f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206984a65d61ee87 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.304+0000 7f835eff5700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.304+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c099c80 con 0x558cb91dc0a0 2023-09-21T12:57:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.304+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f836c0a1890 con 0x558cb91dc0a0 2023-09-21T12:57:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.304+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558cb909eb50 con 0x558cb91dc0a0 2023-09-21T12:57:10.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.305+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f836c010920 con 0x558cb91dc0a0 2023-09-21T12:57:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.305+0000 7f8394c4bb80 10 client.15582 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.305+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558cb8f41c00 con 0x558cb91dc0a0 2023-09-21T12:57:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.305+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558cb909eb50 con 0x558cb91dc0a0 2023-09-21T12:57:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f836c0a1540 con 0x558cb91dc0a0 2023-09-21T12:57:10.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 10 client.15582 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 20 client.15582 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb91fe670 0x558cb9200a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 4 client.15582 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:10.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.306+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558cb91aafc0 con 0x558cb91fe670 2023-09-21T12:57:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.307+0000 7f837a7fc700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb91fe670 0x558cb9200a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.307+0000 7f837a7fc700 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb91fe670 0x558cb9200a60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944139543b33338b server_cookie=8457a8bb1cb0ca59 in_seq=0 out_seq=0 2023-09-21T12:57:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.307+0000 7f835eff5700 10 client.15582 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:10.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.308+0000 7f835eff5700 1 -- 172.21.15.142:0/1340742607 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558cb91aafc0 con 0x558cb91fe670 2023-09-21T12:57:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.308+0000 7f835eff5700 10 client.15582 handle_command_reply: tid=0 2023-09-21T12:57:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.308+0000 7f8394c4bb80 1 client.15582 shutdown 2023-09-21T12:57:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 msgr2=0x558cb91e58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f836c00b2f0 tx=0x7f836c099f20 comp rx=0 tx=0).stop 2023-09-21T12:57:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 shutdown_connections 2023-09-21T12:57:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb91fe670 0x558cb9200a60 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91e58f0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/1340742607 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f835eff5700 0 client.15582 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 >> 172.21.15.142:0/1340742607 conn(0x558cb9108fa0 msgr2=0x558cb91d6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 shutdown_connections 2023-09-21T12:57:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 1 -- 172.21.15.142:0/1340742607 wait complete. 2023-09-21T12:57:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.309+0000 7f8394c4bb80 20 client.15582 trim_cache size 0 max 16384 2023-09-21T12:57:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.338+0000 7f8394c4bb80 1 Processor -- start 2023-09-21T12:57:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.338+0000 7f8394c4bb80 1 -- start start 2023-09-21T12:57:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91de740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb8fae8c0 con 0x558cb91dc0a0 2023-09-21T12:57:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb91e8ab0 con 0x558cb91dc9c0 2023-09-21T12:57:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb91ed4b0 con 0x558cb91e0e50 2023-09-21T12:57:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f837a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50050/0 (socket says 172.21.15.142:50050) 2023-09-21T12:57:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.339+0000 7f837b7fe700 1 -- 172.21.15.142:0/2070967318 learned_addr learned my addr 172.21.15.142:0/2070967318 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 -- 172.21.15.142:0/2070967318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 msgr2=0x558cb91e05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 -- 172.21.15.142:0/2070967318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 msgr2=0x558cb91de740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91de740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 -- 172.21.15.142:0/2070967318 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558cb8f7f1f0 con 0x558cb91dc9c0 2023-09-21T12:57:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f837a7fc700 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91ecf70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c00 tx=0x7f8370009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=764ff1bd9bd19ae1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.340+0000 7f8361ffb700 1 -- 172.21.15.142:0/2070967318 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370005a00 con 0x558cb91dc9c0 2023-09-21T12:57:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.341+0000 7f8361ffb700 1 -- 172.21.15.142:0/2070967318 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837001e030 con 0x558cb91dc9c0 2023-09-21T12:57:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.341+0000 7f8361ffb700 1 -- 172.21.15.142:0/2070967318 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370005680 con 0x558cb91dc9c0 2023-09-21T12:57:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.341+0000 7f8394c4bb80 1 -- 172.21.15.142:0/2070967318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 msgr2=0x558cb91ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.341+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91ecf70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8370000c00 tx=0x7f8370009510 comp rx=0 tx=0).stop 2023-09-21T12:57:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 -- 172.21.15.142:0/2070967318 shutdown_connections 2023-09-21T12:57:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc0a0 0x558cb91de740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91e0e50 0x558cb91e05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/2070967318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91dc9c0 0x558cb91ecf70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 -- 172.21.15.142:0/2070967318 >> 172.21.15.142:0/2070967318 conn(0x558cb9108fa0 msgr2=0x558cb91dfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 -- 172.21.15.142:0/2070967318 shutdown_connections 2023-09-21T12:57:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.342+0000 7f8394c4bb80 1 -- 172.21.15.142:0/2070967318 wait complete. 2023-09-21T12:57:10.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.343+0000 7f8394c4bb80 1 -- start start 2023-09-21T12:57:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.343+0000 7f8394c4bb80 1 Processor -- start 2023-09-21T12:57:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91dc0a0 0x558cb91ecb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91e0e50 0x558cb91e9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb91e99d0 con 0x558cb91dc9c0 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb91e9b10 con 0x558cb91e0e50 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558cb91e9cd0 con 0x558cb91dc0a0 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f8394c4bb80 10 client.0 _ll_register_callbacks cb 0x558cb9014a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f837a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f837a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59830/0 (socket says 172.21.15.142:59830) 2023-09-21T12:57:10.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.344+0000 7f837a7fc700 1 -- 172.21.15.142:0/3844512832 learned_addr learned my addr 172.21.15.142:0/3844512832 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 -- 172.21.15.142:0/3844512832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91dc0a0 msgr2=0x558cb91ecb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:10.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91dc0a0 0x558cb91ecb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 -- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91e0e50 msgr2=0x558cb91e9490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91e0e50 0x558cb91e9490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 -- 172.21.15.142:0/3844512832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c10e510 con 0x558cb91dc9c0 2023-09-21T12:57:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f837a7fc700 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f83700098e0 tx=0x7f837000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e3072a4c4de98f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.345+0000 7f835eff5700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370005500 con 0x558cb91dc9c0 2023-09-21T12:57:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8370005660 con 0x558cb91dc9c0 2023-09-21T12:57:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f837400f040 con 0x558cb91dc9c0 2023-09-21T12:57:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8370025990 con 0x558cb91dc9c0 2023-09-21T12:57:10.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f8394c4bb80 10 client.15585 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.346+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558cb8f57250 con 0x558cb91dc9c0 2023-09-21T12:57:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f837400f040 con 0x558cb91dc9c0 2023-09-21T12:57:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8370023040 con 0x558cb91dc9c0 2023-09-21T12:57:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 10 client.15585 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 10 client.15585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 20 client.15585 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb9253490 0x558cb92558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 4 client.15585 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:57:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.347+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558cb9126e00 con 0x558cb9253490 2023-09-21T12:57:10.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.348+0000 7f837affd700 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb9253490 0x558cb92558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.348+0000 7f835eff5700 10 client.15585 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:10.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.348+0000 7f837affd700 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb9253490 0x558cb92558b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a704babbb2f50e7 server_cookie=b1c572cb6cd4569 in_seq=0 out_seq=0 2023-09-21T12:57:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f835eff5700 1 -- 172.21.15.142:0/3844512832 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558cb9126e00 con 0x558cb9253490 2023-09-21T12:57:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f835eff5700 10 client.15585 handle_command_reply: tid=0 2023-09-21T12:57:10.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 client.15585 shutdown 2023-09-21T12:57:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 msgr2=0x558cb91e8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f83700098e0 tx=0x7f837000be30 comp rx=0 tx=0).stop 2023-09-21T12:57:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 shutdown_connections 2023-09-21T12:57:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558cb9253490 0x558cb92558b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558cb91e0e50 0x558cb91e9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558cb91dc0a0 0x558cb91ecb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 --2- 172.21.15.142:0/3844512832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558cb91dc9c0 0x558cb91e8f50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 >> 172.21.15.142:0/3844512832 conn(0x558cb9108fa0 msgr2=0x558cb91e60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f835eff5700 0 client.15585 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:10.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.356+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 shutdown_connections 2023-09-21T12:57:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.357+0000 7f8394c4bb80 1 -- 172.21.15.142:0/3844512832 wait complete. 2023-09-21T12:57:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.357+0000 7f8394c4bb80 20 client.15585 trim_cache size 0 max 16384 2023-09-21T12:57:10.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:57:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:57:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:57:10.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:57:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 msgr2=0x7f83640a2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 0x7f83640a2e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8374007c20 tx=0x7f8374007710 comp rx=0 tx=0).stop 2023-09-21T12:57:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 msgr2=0x7f837c196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d950 tx=0x7f836c00dd10 comp rx=0 tx=0).stop 2023-09-21T12:57:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 shutdown_connections 2023-09-21T12:57:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f83640a09d0 0x7f83640a2e90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f837c101000 0x7f837c196e70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f837c19ba20 0x7f837c19bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 --2- 172.21.15.142:0/4076149362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f837c106120 0x7f837c1973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 >> 172.21.15.142:0/4076149362 conn(0x7f837c0fc8a0 msgr2=0x7f837c0fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 shutdown_connections 2023-09-21T12:57:10.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:10.358+0000 7f83813ff700 1 -- 172.21.15.142:0/4076149362 wait complete. 2023-09-21T12:57:10.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 -- 172.21.15.142:0/663723121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4101920 msgr2=0x7f13b4105960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 --2- 172.21.15.142:0/663723121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4101920 0x7f13b4105960 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f13a80098f0 tx=0x7f13a8009c00 comp rx=0 tx=0).stop 2023-09-21T12:57:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 -- 172.21.15.142:0/663723121 shutdown_connections 2023-09-21T12:57:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 --2- 172.21.15.142:0/663723121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4106090 0x7f13b410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 --2- 172.21.15.142:0/663723121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b4100f70 0x7f13b4101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 --2- 172.21.15.142:0/663723121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4101920 0x7f13b4105960 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 -- 172.21.15.142:0/663723121 >> 172.21.15.142:0/663723121 conn(0x7f13b40fc7f0 msgr2=0x7f13b40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 -- 172.21.15.142:0/663723121 shutdown_connections 2023-09-21T12:57:10.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.445+0000 7f13b89ff700 1 -- 172.21.15.142:0/663723121 wait complete. 2023-09-21T12:57:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.447+0000 7f13b89ff700 1 Processor -- start 2023-09-21T12:57:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.447+0000 7f13b89ff700 1 -- start start 2023-09-21T12:57:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4106090 0x7f13b410cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 0x7f13b41b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41b2450 con 0x7f13b4100f70 2023-09-21T12:57:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41b25c0 con 0x7f13b41afb20 2023-09-21T12:57:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b89ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41b2780 con 0x7f13b4106090 2023-09-21T12:57:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59854/0 (socket says 172.21.15.142:59854) 2023-09-21T12:57:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b259c700 1 -- 172.21.15.142:0/2615330661 learned_addr learned my addr 172.21.15.142:0/2615330661 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 0x7f13b41b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.448+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4106090 0x7f13b410cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 -- 172.21.15.142:0/2615330661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4106090 msgr2=0x7f13b410cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4106090 0x7f13b410cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 -- 172.21.15.142:0/2615330661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 msgr2=0x7f13b41b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 0x7f13b41b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 -- 172.21.15.142:0/2615330661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009d00 con 0x7f13b4100f70 2023-09-21T12:57:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 0x7f13b41b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:10.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.449+0000 7f13b259c700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f13a400e3c0 tx=0x7f13a400e6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.450+0000 7f13a37fe700 1 -- 172.21.15.142:0/2615330661 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4018070 con 0x7f13b4100f70 2023-09-21T12:57:10.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.450+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a8009520 con 0x7f13b4100f70 2023-09-21T12:57:10.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.450+0000 7f13a37fe700 1 -- 172.21.15.142:0/2615330661 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a400f040 con 0x7f13b4100f70 2023-09-21T12:57:10.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.450+0000 7f13a37fe700 1 -- 172.21.15.142:0/2615330661 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40042f0 con 0x7f13b4100f70 2023-09-21T12:57:10.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.450+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b41b2da0 con 0x7f13b4100f70 2023-09-21T12:57:10.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.455+0000 7f13a37fe700 1 -- 172.21.15.142:0/2615330661 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f13a40090d0 con 0x7f13b4100f70 2023-09-21T12:57:10.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.457+0000 7f13cc254b80 1 Processor -- start 2023-09-21T12:57:10.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.457+0000 7f13cc254b80 1 -- start start 2023-09-21T12:57:10.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.457+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 0x558a21871e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 0x558a218727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13cc254b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a217e1ca0 con 0x558a2186df30 2023-09-21T12:57:10.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13cc254b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a217c5c70 con 0x558a2186d610 2023-09-21T12:57:10.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13cc254b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a217c3590 con 0x558a21872360 2023-09-21T12:57:10.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13a37fe700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 0x7f139c0a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13b2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13a37fe700 1 -- 172.21.15.142:0/2615330661 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f13a40cf170 con 0x7f13b4100f70 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 0x558a21871e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 0x558a21871e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59868/0 (socket says 172.21.15.142:59868) 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.458+0000 7f13b259c700 1 -- 172.21.15.142:0/3003684217 learned_addr learned my addr 172.21.15.142:0/3003684217 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 0x558a218727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 0x7f139c0a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 -- 172.21.15.142:0/3003684217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 msgr2=0x558a2186d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 -- 172.21.15.142:0/3003684217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 msgr2=0x558a21871e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 0x558a21871e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.459+0000 7f13b1d9b700 1 -- 172.21.15.142:0/3003684217 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a215e9de0 con 0x558a21872360 2023-09-21T12:57:10.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.460+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 0x558a218727c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009230 tx=0x7f13a8005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92df210522677ca4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.460+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 0x7f139c0a2e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fd0 tx=0x7f13ac0047c0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.460+0000 7f13a0ff9700 1 -- 172.21.15.142:0/3003684217 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a800fe70 con 0x558a21872360 2023-09-21T12:57:10.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.460+0000 7f13a0ff9700 1 -- 172.21.15.142:0/3003684217 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a801d040 con 0x558a21872360 2023-09-21T12:57:10.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.460+0000 7f13a0ff9700 1 -- 172.21.15.142:0/3003684217 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8005040 con 0x558a21872360 2023-09-21T12:57:10.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 -- 172.21.15.142:0/3003684217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 msgr2=0x558a218727c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 0x558a218727c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009230 tx=0x7f13a8005dc0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 -- 172.21.15.142:0/3003684217 shutdown_connections 2023-09-21T12:57:10.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a21872360 0x558a218727c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 --2- 172.21.15.142:0/3003684217 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186df30 0x558a21871e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 -- 172.21.15.142:0/3003684217 >> 172.21.15.142:0/3003684217 conn(0x558a2179a000 msgr2=0x558a218686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 -- 172.21.15.142:0/3003684217 shutdown_connections 2023-09-21T12:57:10.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.461+0000 7f13cc254b80 1 -- 172.21.15.142:0/3003684217 wait complete. 2023-09-21T12:57:10.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.462+0000 7f13cc254b80 1 -- start start 2023-09-21T12:57:10.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 Processor -- start 2023-09-21T12:57:10.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a218772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a21877830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a217bee80 con 0x558a2186d610 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2175b740 con 0x558a21872360 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2175b3e0 con 0x558a2186df30 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.463+0000 7f13cc254b80 10 client.0 _ll_register_callbacks cb 0x558a216a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59882/0 (socket says 172.21.15.142:59882) 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 -- 172.21.15.142:0/2725551555 learned_addr learned my addr 172.21.15.142:0/2725551555 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a21877830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 -- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 msgr2=0x558a218772f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a218772f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 -- 172.21.15.142:0/2725551555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 msgr2=0x558a21877830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a21877830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.464+0000 7f13b259c700 1 -- 172.21.15.142:0/2725551555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b410e480 con 0x558a2186d610 2023-09-21T12:57:10.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f13b259c700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009fd0 tx=0x7f13a401b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414a3a945b6ff459 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f1399ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:10.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a4099190 con 0x558a2186d610 2023-09-21T12:57:10.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f13a4098a90 con 0x558a2186d610 2023-09-21T12:57:10.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a2172fbb0 con 0x558a2186d610 2023-09-21T12:57:10.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13a409c8c0 con 0x558a2186d610 2023-09-21T12:57:10.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.465+0000 7f13cc254b80 10 client.15597 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.466+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558a215d2c60 con 0x558a2186d610 2023-09-21T12:57:10.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.466+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558a2172fbb0 con 0x558a2186d610 2023-09-21T12:57:10.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13a40a0670 con 0x558a2186d610 2023-09-21T12:57:10.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 10 client.15597 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 10 client.15597 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:10.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 20 client.15597 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a21887380 0x558a218897a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 4 client.15597 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.467+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a2183c020 con 0x558a21887380 2023-09-21T12:57:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.468+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a21887380 0x558a218897a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.468+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a21887380 0x558a218897a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=256250509d85126a server_cookie=ca0be8257f3fab14 in_seq=0 out_seq=0 2023-09-21T12:57:10.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.468+0000 7f1399ffb700 10 client.15597 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:10.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.469+0000 7f1399ffb700 1 -- 172.21.15.142:0/2725551555 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a2183c020 con 0x558a21887380 2023-09-21T12:57:10.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.469+0000 7f1399ffb700 10 client.15597 handle_command_reply: tid=0 2023-09-21T12:57:10.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.469+0000 7f13cc254b80 1 client.15597 shutdown 2023-09-21T12:57:10.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.469+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 msgr2=0x558a21876db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.469+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f13a4009fd0 tx=0x7f13a401b600 comp rx=0 tx=0).stop 2023-09-21T12:57:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 shutdown_connections 2023-09-21T12:57:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a21887380 0x558a218897a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a21876db0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a21877830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 --2- 172.21.15.142:0/2725551555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a218772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 >> 172.21.15.142:0/2725551555 conn(0x558a2179a000 msgr2=0x558a21868290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f1399ffb700 0 client.15597 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 shutdown_connections 2023-09-21T12:57:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 1 -- 172.21.15.142:0/2725551555 wait complete. 2023-09-21T12:57:10.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.470+0000 7f13cc254b80 20 client.15597 trim_cache size 0 max 16384 2023-09-21T12:57:10.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 Processor -- start 2023-09-21T12:57:10.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 -- start start 2023-09-21T12:57:10.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a21872360 0x558a21877660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2163f920 con 0x558a21872360 2023-09-21T12:57:10.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2186e3f0 con 0x558a2186d610 2023-09-21T12:57:10.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.496+0000 7f13cc254b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2187e9c0 con 0x558a2186df30 2023-09-21T12:57:10.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33428/0 (socket says 172.21.15.142:33428) 2023-09-21T12:57:10.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b259c700 1 -- 172.21.15.142:0/1305955372 learned_addr learned my addr 172.21.15.142:0/1305955372 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a21872360 0x558a21877660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b259c700 1 -- 172.21.15.142:0/1305955372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 msgr2=0x558a2187e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.497+0000 7f13b259c700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13b259c700 1 -- 172.21.15.142:0/1305955372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a21872360 msgr2=0x558a21877660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13b259c700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a21872360 0x558a21877660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13b259c700 1 -- 172.21.15.142:0/1305955372 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a21889b50 con 0x558a2186d610 2023-09-21T12:57:10.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13b259c700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f13a4098380 tx=0x7f13a40c8f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb13d0da77cf1e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:10.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13a17fa700 1 -- 172.21.15.142:0/1305955372 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40c90e0 con 0x558a2186d610 2023-09-21T12:57:10.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13a17fa700 1 -- 172.21.15.142:0/1305955372 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a4099190 con 0x558a2186d610 2023-09-21T12:57:10.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.498+0000 7f13a17fa700 1 -- 172.21.15.142:0/1305955372 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40a0b90 con 0x558a2186d610 2023-09-21T12:57:10.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 -- 172.21.15.142:0/1305955372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 msgr2=0x558a2186fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f13a4098380 tx=0x7f13a40c8f50 comp rx=0 tx=0).stop 2023-09-21T12:57:10.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 -- 172.21.15.142:0/1305955372 shutdown_connections 2023-09-21T12:57:10.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a21872360 0x558a21877660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a2186d610 0x558a2186fc50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 --2- 172.21.15.142:0/1305955372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 -- 172.21.15.142:0/1305955372 >> 172.21.15.142:0/1305955372 conn(0x558a2179a000 msgr2=0x558a21870490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.499+0000 7f13cc254b80 1 -- 172.21.15.142:0/1305955372 shutdown_connections 2023-09-21T12:57:10.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.500+0000 7f13cc254b80 1 -- 172.21.15.142:0/1305955372 wait complete. 2023-09-21T12:57:10.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.500+0000 7f13cc254b80 1 -- start start 2023-09-21T12:57:10.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.500+0000 7f13cc254b80 1 Processor -- start 2023-09-21T12:57:10.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a2187c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a2187d2c0 con 0x558a2186d610 2023-09-21T12:57:10.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a218da730 con 0x558a21872360 2023-09-21T12:57:10.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a218da870 con 0x558a2186df30 2023-09-21T12:57:10.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.501+0000 7f13cc254b80 10 client.0 _ll_register_callbacks cb 0x558a216a5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33436/0 (socket says 172.21.15.142:33436) 2023-09-21T12:57:10.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 -- 172.21.15.142:0/260240305 learned_addr learned my addr 172.21.15.142:0/260240305 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b259c700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a2187c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b1d9b700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 -- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 msgr2=0x558a2187c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.502+0000 7f13b2d9d700 1 -- 172.21.15.142:0/260240305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 msgr2=0x558a2187c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a2187c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f13b2d9d700 1 -- 172.21.15.142:0/260240305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a215e9de0 con 0x558a21872360 2023-09-21T12:57:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f13b2d9d700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00ece0 tx=0x7f13ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63d9b92f46e9dbd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f1399ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac028070 con 0x558a21872360 2023-09-21T12:57:10.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.503+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13a801d040 con 0x558a21872360 2023-09-21T12:57:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f13ac010b80 con 0x558a21872360 2023-09-21T12:57:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13ac010d40 con 0x558a21872360 2023-09-21T12:57:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f13cc254b80 10 client.25646 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558a215d2c60 con 0x558a21872360 2023-09-21T12:57:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13a801d040 con 0x558a21872360 2023-09-21T12:57:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.504+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13ac005400 con 0x558a21872360 2023-09-21T12:57:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 10 client.25646 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 10 client.25646 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 20 client.25646 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a218dc090 0x558a218de4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 4 client.25646 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:10.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558a217b7e60 con 0x558a218dc090 2023-09-21T12:57:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13b259c700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a218dc090 0x558a218de4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f1399ffb700 10 client.25646 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.505+0000 7f13b259c700 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a218dc090 0x558a218de4b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a3eac9a0870e1f39 server_cookie=42c994a2f555ab39 in_seq=0 out_seq=0 2023-09-21T12:57:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f1399ffb700 1 -- 172.21.15.142:0/260240305 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558a217b7e60 con 0x558a218dc090 2023-09-21T12:57:10.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f1399ffb700 10 client.25646 handle_command_reply: tid=0 2023-09-21T12:57:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 client.25646 shutdown 2023-09-21T12:57:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 msgr2=0x558a218da1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13ac00ece0 tx=0x7f13ac004750 comp rx=0 tx=0).stop 2023-09-21T12:57:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 shutdown_connections 2023-09-21T12:57:10.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558a218dc090 0x558a218de4b0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558a2186d610 0x558a2187c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558a21872360 0x558a218da1f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f1399ffb700 0 client.25646 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 --2- 172.21.15.142:0/260240305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558a2186df30 0x558a2187c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 >> 172.21.15.142:0/260240305 conn(0x558a2179a000 msgr2=0x558a21871410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 shutdown_connections 2023-09-21T12:57:10.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.506+0000 7f13cc254b80 1 -- 172.21.15.142:0/260240305 wait complete. 2023-09-21T12:57:10.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.507+0000 7f13cc254b80 20 client.25646 trim_cache size 0 max 16384 2023-09-21T12:57:10.519 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:10.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.507+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 msgr2=0x7f139c0a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.507+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 0x7f139c0a2e10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009fd0 tx=0x7f13ac0047c0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.507+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 msgr2=0x7f13b410ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.507+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f13a400e3c0 tx=0x7f13a400e6d0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 shutdown_connections 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f139c0a0950 0x7f139c0a2e10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f13b4100f70 0x7f13b410ca60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f13b41afb20 0x7f13b41b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 --2- 172.21.15.142:0/2615330661 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f13b4106090 0x7f13b410cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.508+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 >> 172.21.15.142:0/2615330661 conn(0x7f13b40fc7f0 msgr2=0x7f13b40fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.510+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 shutdown_connections 2023-09-21T12:57:10.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.510+0000 7f13b89ff700 1 -- 172.21.15.142:0/2615330661 wait complete. 2023-09-21T12:57:10.538 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:57:10.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 -- 172.21.15.142:0/420615869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1498100fa0 msgr2=0x7f1498101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 --2- 172.21.15.142:0/420615869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1498100fa0 0x7f1498101380 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1494009990 tx=0x7f1494009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 -- 172.21.15.142:0/420615869 shutdown_connections 2023-09-21T12:57:10.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 --2- 172.21.15.142:0/420615869 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f149810dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 --2- 172.21.15.142:0/420615869 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1498100fa0 0x7f1498101380 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 --2- 172.21.15.142:0/420615869 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498101950 0x7f1498105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 -- 172.21.15.142:0/420615869 >> 172.21.15.142:0/420615869 conn(0x7f14980fc860 msgr2=0x7f14980fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 -- 172.21.15.142:0/420615869 shutdown_connections 2023-09-21T12:57:10.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.877+0000 7f149f3ff700 1 -- 172.21.15.142:0/420615869 wait complete. 2023-09-21T12:57:10.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 Processor -- start 2023-09-21T12:57:10.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 -- start start 2023-09-21T12:57:10.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498100fa0 0x7f1498199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149819da30 0x7f149819deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819e4b0 con 0x7f1498100fa0 2023-09-21T12:57:10.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819e5f0 con 0x7f149819da30 2023-09-21T12:57:10.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.879+0000 7f149f3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149819e760 con 0x7f14981060c0 2023-09-21T12:57:10.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50124/0 (socket says 172.21.15.142:50124) 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 -- 172.21.15.142:0/3136364582 learned_addr learned my addr 172.21.15.142:0/3136364582 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149d99c700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149819da30 0x7f149819deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149d19b700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498100fa0 0x7f1498199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 -- 172.21.15.142:0/3136364582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149819da30 msgr2=0x7f149819deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149819da30 0x7f149819deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 -- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498100fa0 msgr2=0x7f1498199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498100fa0 0x7f1498199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.880+0000 7f149c99a700 1 -- 172.21.15.142:0/3136364582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14940095f0 con 0x7f14981060c0 2023-09-21T12:57:10.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f149c99a700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f148800e970 tx=0x7f148800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f148e7fc700 1 -- 172.21.15.142:0/3136364582 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488009790 con 0x7f14981060c0 2023-09-21T12:57:10.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149806a800 con 0x7f14981060c0 2023-09-21T12:57:10.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f148e7fc700 1 -- 172.21.15.142:0/3136364582 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f148800eec0 con 0x7f14981060c0 2023-09-21T12:57:10.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f148e7fc700 1 -- 172.21.15.142:0/3136364582 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488005590 con 0x7f14981060c0 2023-09-21T12:57:10.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.881+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149806ad60 con 0x7f14981060c0 2023-09-21T12:57:10.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.886+0000 7f148e7fc700 1 -- 172.21.15.142:0/3136364582 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f148800cbd0 con 0x7f14981060c0 2023-09-21T12:57:10.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.888+0000 7f14b2d53b80 1 Processor -- start 2023-09-21T12:57:10.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.888+0000 7f14b2d53b80 1 -- start start 2023-09-21T12:57:10.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e6e20 0x5616905e7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690552ca0 con 0x5616905e6e20 2023-09-21T12:57:10.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690536c70 con 0x5616905e7740 2023-09-21T12:57:10.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690534590 con 0x5616905ebb70 2023-09-21T12:57:10.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f149d99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e6e20 0x5616905e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33466/0 (socket says 172.21.15.142:33466) 2023-09-21T12:57:10.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.889+0000 7f149d19b700 1 -- 172.21.15.142:0/3222002726 learned_addr learned my addr 172.21.15.142:0/3222002726 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149c99a700 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149d19b700 1 -- 172.21.15.142:0/3222002726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 msgr2=0x5616905ebfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149d19b700 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905ebfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149d19b700 1 -- 172.21.15.142:0/3222002726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e6e20 msgr2=0x5616905e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149d19b700 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e6e20 0x5616905e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149d19b700 1 -- 172.21.15.142:0/3222002726 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56169035ade0 con 0x5616905e7740 2023-09-21T12:57:10.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f149c99a700 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:10.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f148e7fc700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 0x7f14840a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.890+0000 7f148e7fc700 1 -- 172.21.15.142:0/3136364582 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1488014070 con 0x7f14981060c0 2023-09-21T12:57:10.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.891+0000 7f149d19b700 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1494005e80 tx=0x7f1494005eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6913da4f889f8be server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.891+0000 7f14837fe700 1 -- 172.21.15.142:0/3222002726 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400bee0 con 0x5616905e7740 2023-09-21T12:57:10.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.891+0000 7f14837fe700 1 -- 172.21.15.142:0/3222002726 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f149401e040 con 0x5616905e7740 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.891+0000 7f14837fe700 1 -- 172.21.15.142:0/3222002726 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1494004ba0 con 0x5616905e7740 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3222002726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 msgr2=0x5616905eb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1494005e80 tx=0x7f1494005eb0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3222002726 shutdown_connections 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e6e20 0x5616905e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3222002726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905eb630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3222002726 >> 172.21.15.142:0/3222002726 conn(0x56169050b000 msgr2=0x5616905d96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3222002726 shutdown_connections 2023-09-21T12:57:10.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f149d99c700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 0x7f14840a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.892+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3222002726 wait complete. 2023-09-21T12:57:10.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.893+0000 7f14b2d53b80 1 -- start start 2023-09-21T12:57:10.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 Processor -- start 2023-09-21T12:57:10.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f149d99c700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 0x7f14840a2e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1490009500 tx=0x7f149000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56169052fe80 con 0x5616905e7740 2023-09-21T12:57:10.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616904cc740 con 0x5616905e6e20 2023-09-21T12:57:10.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.894+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616904cc3e0 con 0x5616905ebb70 2023-09-21T12:57:10.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f14b2d53b80 10 client.0 _ll_register_callbacks cb 0x561690416a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f33a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33474/0 (socket says 172.21.15.142:33474) 2023-09-21T12:57:10.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d19b700 1 -- 172.21.15.142:0/1343657749 learned_addr learned my addr 172.21.15.142:0/1343657749 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d99c700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d99c700 1 -- 172.21.15.142:0/1343657749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 msgr2=0x5616905f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d99c700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.895+0000 7f149d99c700 1 -- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 msgr2=0x5616905f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f149d99c700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f149d99c700 1 -- 172.21.15.142:0/1343657749 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149810e4b0 con 0x5616905ebb70 2023-09-21T12:57:10.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f149d99c700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f0cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14900092e0 tx=0x7f1490004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308cf39c2967f431 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f1480ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:10.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000e040 con 0x5616905ebb70 2023-09-21T12:57:10.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14900157f0 con 0x5616905ebb70 2023-09-21T12:57:10.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.896+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5616904a0bb0 con 0x5616905ebb70 2023-09-21T12:57:10.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14900159b0 con 0x5616905ebb70 2023-09-21T12:57:10.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f14b2d53b80 10 client.25618 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561690343c60 con 0x5616905ebb70 2023-09-21T12:57:10.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5616904a0bb0 con 0x5616905ebb70 2023-09-21T12:57:10.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1490023bc0 con 0x5616905ebb70 2023-09-21T12:57:10.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f14b2d53b80 10 client.25618 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f14b2d53b80 10 client.25618 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:10.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.897+0000 7f14b2d53b80 20 client.25618 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.898+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690600c50 0x561690603070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.898+0000 7f14b2d53b80 4 client.25618 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:10.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.898+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5616905ad020 con 0x561690600c50 2023-09-21T12:57:10.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.899+0000 7f149d19b700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690600c50 0x561690603070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.899+0000 7f149d19b700 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690600c50 0x561690603070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e268c70090228205 server_cookie=af21f5d4809f8dc2 in_seq=0 out_seq=0 2023-09-21T12:57:10.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.899+0000 7f1480ff9700 10 client.25618 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.900+0000 7f1480ff9700 1 -- 172.21.15.142:0/1343657749 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5616905ad020 con 0x561690600c50 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.900+0000 7f1480ff9700 10 client.25618 handle_command_reply: tid=0 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 client.25618 shutdown 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 msgr2=0x5616905f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f0cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f14900092e0 tx=0x7f1490004b40 comp rx=0 tx=0).stop 2023-09-21T12:57:10.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 shutdown_connections 2023-09-21T12:57:10.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690600c50 0x561690603070 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f0cf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f1480ff9700 0 client.25618 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:10.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/1343657749 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 >> 172.21.15.142:0/1343657749 conn(0x56169050b000 msgr2=0x5616905d9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 shutdown_connections 2023-09-21T12:57:10.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.901+0000 7f14b2d53b80 1 -- 172.21.15.142:0/1343657749 wait complete. 2023-09-21T12:57:10.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.902+0000 7f14b2d53b80 20 client.25618 trim_cache size 0 max 16384 2023-09-21T12:57:10.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:10 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/789866978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:10.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:10 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/789866978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:10.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.927+0000 7f14b2d53b80 1 Processor -- start 2023-09-21T12:57:10.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.927+0000 7f14b2d53b80 1 -- start start 2023-09-21T12:57:10.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905e6e20 0x5616905f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 0x5616905f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616903b0920 con 0x5616905ebb70 2023-09-21T12:57:10.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616905f12f0 con 0x5616905e7740 2023-09-21T12:57:10.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616905d8460 con 0x5616905e6e20 2023-09-21T12:57:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f149c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f149d19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905e6e20 0x5616905f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f149c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33482/0 (socket says 172.21.15.142:33482) 2023-09-21T12:57:10.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.928+0000 7f149c99a700 1 -- 172.21.15.142:0/3382225501 learned_addr learned my addr 172.21.15.142:0/3382225501 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149d99c700 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 0x5616905f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 -- 172.21.15.142:0/3382225501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905e6e20 msgr2=0x5616905f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905e6e20 0x5616905f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 -- 172.21.15.142:0/3382225501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 msgr2=0x5616905f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 0x5616905f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 -- 172.21.15.142:0/3382225501 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616905f0120 con 0x5616905e7740 2023-09-21T12:57:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149d99c700 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 0x5616905f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f149c99a700 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1488099620 tx=0x7f14880991d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941accd006900796 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f1483fff700 1 -- 172.21.15.142:0/3382225501 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488099d90 con 0x5616905e7740 2023-09-21T12:57:10.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f1483fff700 1 -- 172.21.15.142:0/3382225501 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1488082e90 con 0x5616905e7740 2023-09-21T12:57:10.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.929+0000 7f1483fff700 1 -- 172.21.15.142:0/3382225501 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1488097ac0 con 0x5616905e7740 2023-09-21T12:57:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.930+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3382225501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 msgr2=0x5616905ecf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.930+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1488099620 tx=0x7f14880991d0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3382225501 shutdown_connections 2023-09-21T12:57:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905ebb70 0x5616905f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905e6e20 0x5616905f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/3382225501 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e7740 0x5616905ecf60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3382225501 >> 172.21.15.142:0/3382225501 conn(0x56169050b000 msgr2=0x5616905fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3382225501 shutdown_connections 2023-09-21T12:57:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 -- 172.21.15.142:0/3382225501 wait complete. 2023-09-21T12:57:10.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.931+0000 7f14b2d53b80 1 -- start start 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 Processor -- start 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690654ac0 con 0x5616905e7740 2023-09-21T12:57:10.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690654c00 con 0x5616905e6e20 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561690654d90 con 0x5616905ebb70 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.932+0000 7f14b2d53b80 10 client.0 _ll_register_callbacks cb 0x561690416a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33492/0 (socket says 172.21.15.142:33492) 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 -- 172.21.15.142:0/707977095 learned_addr learned my addr 172.21.15.142:0/707977095 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:10.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d99c700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 -- 172.21.15.142:0/707977095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 msgr2=0x5616905f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149c99a700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 -- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 msgr2=0x5616905f2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:10.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149d19b700 1 -- 172.21.15.142:0/707977095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149806ad60 con 0x5616905e6e20 2023-09-21T12:57:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.933+0000 7f149c99a700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f149d19b700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1494005e80 tx=0x7f1494005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b49ca903dfc8ad9c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f1480ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:10.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400f870 con 0x5616905e6e20 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f149400f9d0 con 0x5616905e6e20 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f149401e040 con 0x5616905e6e20 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f149400bec0 con 0x5616905e6e20 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f14b2d53b80 10 client.25664 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.934+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561690381250 con 0x5616905e6e20 2023-09-21T12:57:10.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f149401e040 con 0x5616905e6e20 2023-09-21T12:57:10.941 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:10 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/789866978' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f14940173f0 con 0x5616905e6e20 2023-09-21T12:57:10.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 10 client.25664 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 10 client.25664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 20 client.25664 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690655ff0 0x5616906583e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 4 client.25664 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.935+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561690528e60 con 0x561690655ff0 2023-09-21T12:57:10.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.936+0000 7f149c99a700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690655ff0 0x5616906583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.936+0000 7f149c99a700 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690655ff0 0x5616906583e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=376ed9353f31e620 server_cookie=f70f21ec28bfa36c in_seq=0 out_seq=0 2023-09-21T12:57:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.936+0000 7f1480ff9700 10 client.25664 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f1480ff9700 1 -- 172.21.15.142:0/707977095 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561690528e60 con 0x561690655ff0 2023-09-21T12:57:10.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f1480ff9700 10 client.25664 handle_command_reply: tid=0 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 client.25664 shutdown 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 msgr2=0x5616905f1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1494005e80 tx=0x7f1494005c00 comp rx=0 tx=0).stop 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 shutdown_connections 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x561690655ff0 0x5616906583e0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5616905ebb70 0x5616905f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5616905e6e20 0x5616905f1f00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f1480ff9700 0 client.25664 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:10.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 --2- 172.21.15.142:0/707977095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5616905e7740 0x5616905f2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 >> 172.21.15.142:0/707977095 conn(0x56169050b000 msgr2=0x5616905e9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 shutdown_connections 2023-09-21T12:57:10.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.937+0000 7f14b2d53b80 1 -- 172.21.15.142:0/707977095 wait complete. 2023-09-21T12:57:10.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.938+0000 7f14b2d53b80 20 client.25664 trim_cache size 0 max 16384 2023-09-21T12:57:10.947 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:10.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.938+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 msgr2=0x7f14840a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.938+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 0x7f14840a2e10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1490009500 tx=0x7f149000b040 comp rx=0 tx=0).stop 2023-09-21T12:57:10.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.938+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 msgr2=0x7f14981995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:10.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.938+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f148800e970 tx=0x7f148800ec80 comp rx=0 tx=0).stop 2023-09-21T12:57:10.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 shutdown_connections 2023-09-21T12:57:10.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14840a0950 0x7f14840a2e10 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1498100fa0 0x7f1498199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f149819da30 0x7f149819deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 --2- 172.21.15.142:0/3136364582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14981060c0 0x7f14981995d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:10.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 >> 172.21.15.142:0/3136364582 conn(0x7f14980fc860 msgr2=0x7f149810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:10.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 shutdown_connections 2023-09-21T12:57:10.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:10.939+0000 7f149f3ff700 1 -- 172.21.15.142:0/3136364582 wait complete. 2023-09-21T12:57:10.966 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:57:11.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 -- 172.21.15.142:0/4054305375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f4073b30 msgr2=0x7f14f410ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/4054305375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f4073b30 0x7f14f410ceb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f14e80098f0 tx=0x7f14e8009c00 comp rx=0 tx=0).stop 2023-09-21T12:57:11.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 -- 172.21.15.142:0/4054305375 shutdown_connections 2023-09-21T12:57:11.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/4054305375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f410f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/4054305375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 0x7f14f40735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/4054305375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f4073b30 0x7f14f410ceb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 -- 172.21.15.142:0/4054305375 >> 172.21.15.142:0/4054305375 conn(0x7f14f40fc680 msgr2=0x7f14f40feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 -- 172.21.15.142:0/4054305375 shutdown_connections 2023-09-21T12:57:11.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.303+0000 7f14f8f9d700 1 -- 172.21.15.142:0/4054305375 wait complete. 2023-09-21T12:57:11.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.305+0000 7f14f8f9d700 1 Processor -- start 2023-09-21T12:57:11.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.305+0000 7f14f8f9d700 1 -- start start 2023-09-21T12:57:11.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 0x7f14f4199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 0x7f14f419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f419e560 con 0x7f14f410d3f0 2023-09-21T12:57:11.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f419e6d0 con 0x7f14f4073210 2023-09-21T12:57:11.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f8f9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f419e890 con 0x7f14f419dae0 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 0x7f14f419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59982/0 (socket says 172.21.15.142:59982) 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f2ffd700 1 -- 172.21.15.142:0/866765526 learned_addr learned my addr 172.21.15.142:0/866765526 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.306+0000 7f14f37fe700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 0x7f14f4199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 -- 172.21.15.142:0/866765526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 msgr2=0x7f14f4199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 0x7f14f4199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 -- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 msgr2=0x7f14f4199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 -- 172.21.15.142:0/866765526 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e8009520 con 0x7f14f419dae0 2023-09-21T12:57:11.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:11.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f3fff700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 0x7f14f419df60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00efc0 tx=0x7f14ec00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f0ff9700 1 -- 172.21.15.142:0/866765526 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec018070 con 0x7f14f419dae0 2023-09-21T12:57:11.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f0ff9700 1 -- 172.21.15.142:0/866765526 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14ec00f040 con 0x7f14f419dae0 2023-09-21T12:57:11.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f41a5d90 con 0x7f14f419dae0 2023-09-21T12:57:11.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.307+0000 7f14f0ff9700 1 -- 172.21.15.142:0/866765526 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00cd30 con 0x7f14f419dae0 2023-09-21T12:57:11.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.308+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f41a62c0 con 0x7f14f419dae0 2023-09-21T12:57:11.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.313+0000 7f14f0ff9700 1 -- 172.21.15.142:0/866765526 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f14ec003a00 con 0x7f14f419dae0 2023-09-21T12:57:11.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.314+0000 7f150db79b80 1 Processor -- start 2023-09-21T12:57:11.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.315+0000 7f150db79b80 1 -- start start 2023-09-21T12:57:11.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d44fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5caaca0 con 0x5568f5d44bd0 2023-09-21T12:57:11.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5c8ec70 con 0x5568f5d454f0 2023-09-21T12:57:11.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f150db79b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5c8c590 con 0x5568f5d3f3c0 2023-09-21T12:57:11.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33514/0 (socket says 172.21.15.142:33514) 2023-09-21T12:57:11.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f14f37fe700 1 -- 172.21.15.142:0/1616431411 learned_addr learned my addr 172.21.15.142:0/1616431411 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:11.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.316+0000 7f14f0ff9700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 0x7f14dc0a2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f0ff9700 1 -- 172.21.15.142:0/866765526 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14ec0cba90 con 0x7f14f419dae0 2023-09-21T12:57:11.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d44fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f37fe700 1 -- 172.21.15.142:0/1616431411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d3f3c0 msgr2=0x5568f5d3f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f37fe700 1 -- 172.21.15.142:0/1616431411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 msgr2=0x5568f5d44fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d44fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f37fe700 1 -- 172.21.15.142:0/1616431411 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f5ab2de0 con 0x5568f5d454f0 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.317+0000 7f14f3fff700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 0x7f14dc0a2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.318+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009d60 tx=0x7f14e4011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15fa678ffd60f7d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.318+0000 7f14d9ffb700 1 -- 172.21.15.142:0/1616431411 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4019630 con 0x5568f5d454f0 2023-09-21T12:57:11.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.318+0000 7f14f3fff700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 0x7f14dc0a2eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0c9090 tx=0x7f14ec004cc0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.318+0000 7f14d9ffb700 1 -- 172.21.15.142:0/1616431411 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14e4019c50 con 0x5568f5d454f0 2023-09-21T12:57:11.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.318+0000 7f14d9ffb700 1 -- 172.21.15.142:0/1616431411 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400eb70 con 0x5568f5d454f0 2023-09-21T12:57:11.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 -- 172.21.15.142:0/1616431411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 msgr2=0x5568f5d3ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009d60 tx=0x7f14e4011720 comp rx=0 tx=0).stop 2023-09-21T12:57:11.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 -- 172.21.15.142:0/1616431411 shutdown_connections 2023-09-21T12:57:11.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d44fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 --2- 172.21.15.142:0/1616431411 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d3ee80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 -- 172.21.15.142:0/1616431411 >> 172.21.15.142:0/1616431411 conn(0x5568f5c63000 msgr2=0x5568f5d31540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 -- 172.21.15.142:0/1616431411 shutdown_connections 2023-09-21T12:57:11.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.319+0000 7f150db79b80 1 -- 172.21.15.142:0/1616431411 wait complete. 2023-09-21T12:57:11.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.320+0000 7f150db79b80 1 -- start start 2023-09-21T12:57:11.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 Processor -- start 2023-09-21T12:57:11.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d48830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d48d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5c87e80 con 0x5568f5d3f3c0 2023-09-21T12:57:11.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5c24740 con 0x5568f5d454f0 2023-09-21T12:57:11.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5c243e0 con 0x5568f5d44bd0 2023-09-21T12:57:11.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.321+0000 7f150db79b80 10 client.0 _ll_register_callbacks cb 0x5568f5b6ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:11.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33518/0 (socket says 172.21.15.142:33518) 2023-09-21T12:57:11.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 -- 172.21.15.142:0/675124366 learned_addr learned my addr 172.21.15.142:0/675124366 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:11.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f37fe700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d48d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 -- 172.21.15.142:0/675124366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 msgr2=0x5568f5d48d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d48d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 -- 172.21.15.142:0/675124366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 msgr2=0x5568f5d48830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d48830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.322+0000 7f14f2ffd700 1 -- 172.21.15.142:0/675124366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e40099c0 con 0x5568f5d454f0 2023-09-21T12:57:11.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e800bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fda371607446fdb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f14d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:11.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e801c070 con 0x5568f5d454f0 2023-09-21T12:57:11.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568f5bf8bb0 con 0x5568f5d454f0 2023-09-21T12:57:11.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14e800b9a0 con 0x5568f5d454f0 2023-09-21T12:57:11.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14e800bb60 con 0x5568f5d454f0 2023-09-21T12:57:11.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f150db79b80 10 client.25676 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:11.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.323+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5568f5a9bc60 con 0x5568f5d454f0 2023-09-21T12:57:11.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.324+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568f5bf8bb0 con 0x5568f5d454f0 2023-09-21T12:57:11.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f14e8022070 con 0x5568f5d454f0 2023-09-21T12:57:11.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 10 client.25676 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:11.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 10 client.25676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:11.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 20 client.25676 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:11.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5d58e50 0x5568f5d5b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 4 client.25676 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:11.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568f5d05020 con 0x5568f5d58e50 2023-09-21T12:57:11.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.325+0000 7f14f37fe700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5d58e50 0x5568f5d5b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.326+0000 7f14f37fe700 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5d58e50 0x5568f5d5b270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e804e9d21515ccd5 server_cookie=6f285408c4aa9fde in_seq=0 out_seq=0 2023-09-21T12:57:11.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.326+0000 7f14d2ffd700 10 client.25676 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:11.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f14d2ffd700 1 -- 172.21.15.142:0/675124366 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568f5d05020 con 0x5568f5d58e50 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f14d2ffd700 10 client.25676 handle_command_reply: tid=0 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 client.25676 shutdown 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 msgr2=0x5568f5d492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f14e8000c00 tx=0x7f14e800bf30 comp rx=0 tx=0).stop 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 shutdown_connections 2023-09-21T12:57:11.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5d58e50 0x5568f5d5b270 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d48830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5d492b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 --2- 172.21.15.142:0/675124366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d48d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 >> 172.21.15.142:0/675124366 conn(0x5568f5c63000 msgr2=0x5568f5d31360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f14d2ffd700 0 client.25676 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 shutdown_connections 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.327+0000 7f150db79b80 1 -- 172.21.15.142:0/675124366 wait complete. 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.328+0000 7f150db79b80 20 client.25676 trim_cache size 0 max 16384 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.353+0000 7f150db79b80 1 Processor -- start 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.353+0000 7f150db79b80 1 -- start start 2023-09-21T12:57:11.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d454f0 0x5568f5d42a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5b08920 con 0x5568f5d44bd0 2023-09-21T12:57:11.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5d331d0 con 0x5568f5d3f3c0 2023-09-21T12:57:11.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f150db79b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5d44850 con 0x5568f5d454f0 2023-09-21T12:57:11.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60022/0 (socket says 172.21.15.142:60022) 2023-09-21T12:57:11.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.354+0000 7f14f37fe700 1 -- 172.21.15.142:0/3300884907 learned_addr learned my addr 172.21.15.142:0/3300884907 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:11.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 -- 172.21.15.142:0/3300884907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d454f0 msgr2=0x5568f5d42a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:11.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d454f0 0x5568f5d42a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 -- 172.21.15.142:0/3300884907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d3f3c0 msgr2=0x5568f5d3ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 -- 172.21.15.142:0/3300884907 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568f5ad9250 con 0x5568f5d44bd0 2023-09-21T12:57:11.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.355+0000 7f14f37fe700 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14e4011b20 tx=0x7f14e4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d2b34e02aa7c92 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.356+0000 7f14da7fc700 1 -- 172.21.15.142:0/3300884907 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e402d820 con 0x5568f5d44bd0 2023-09-21T12:57:11.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.356+0000 7f14da7fc700 1 -- 172.21.15.142:0/3300884907 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14e402de40 con 0x5568f5d44bd0 2023-09-21T12:57:11.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.356+0000 7f14da7fc700 1 -- 172.21.15.142:0/3300884907 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4019a80 con 0x5568f5d44bd0 2023-09-21T12:57:11.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 -- 172.21.15.142:0/3300884907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 msgr2=0x5568f5d4fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f14e4011b20 tx=0x7f14e4009310 comp rx=0 tx=0).stop 2023-09-21T12:57:11.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 -- 172.21.15.142:0/3300884907 shutdown_connections 2023-09-21T12:57:11.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d454f0 0x5568f5d42a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d3f3c0 0x5568f5d3ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 --2- 172.21.15.142:0/3300884907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d44bd0 0x5568f5d4fef0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 -- 172.21.15.142:0/3300884907 >> 172.21.15.142:0/3300884907 conn(0x5568f5c63000 msgr2=0x5568f5d55260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 -- 172.21.15.142:0/3300884907 shutdown_connections 2023-09-21T12:57:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.357+0000 7f150db79b80 1 -- 172.21.15.142:0/3300884907 wait complete. 2023-09-21T12:57:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.358+0000 7f150db79b80 1 -- start start 2023-09-21T12:57:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.358+0000 7f150db79b80 1 Processor -- start 2023-09-21T12:57:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d4e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5dabc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5dac1c0 con 0x5568f5d3f3c0 2023-09-21T12:57:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5dac300 con 0x5568f5d454f0 2023-09-21T12:57:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568f5dac490 con 0x5568f5d44bd0 2023-09-21T12:57:11.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f150db79b80 10 client.0 _ll_register_callbacks cb 0x5568f5b6ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f14f2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d4e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f14f37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50228/0 (socket says 172.21.15.142:50228) 2023-09-21T12:57:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f14f37fe700 1 -- 172.21.15.142:0/1417416525 learned_addr learned my addr 172.21.15.142:0/1417416525 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:11.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.359+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5dabc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 -- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 msgr2=0x5568f5dabc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5dabc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 -- 172.21.15.142:0/1417416525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 msgr2=0x5568f5d4e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d4e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 -- 172.21.15.142:0/1417416525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568f5ab2de0 con 0x5568f5d44bd0 2023-09-21T12:57:11.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d4e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:11.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14f37fe700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009d60 tx=0x7f14e402d470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc55e13ae3171a6e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:11.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:11.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e402dcb0 con 0x5568f5d44bd0 2023-09-21T12:57:11.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14e4019c50 con 0x5568f5d44bd0 2023-09-21T12:57:11.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.360+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f14e4029070 con 0x5568f5d44bd0 2023-09-21T12:57:11.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14e40050c0 con 0x5568f5d44bd0 2023-09-21T12:57:11.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 10 client.25636 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:11.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5568f5ab12b0 con 0x5568f5d44bd0 2023-09-21T12:57:11.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14e4019c50 con 0x5568f5d44bd0 2023-09-21T12:57:11.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f14e4003680 con 0x5568f5d44bd0 2023-09-21T12:57:11.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 10 client.25636 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:11.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 10 client.25636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:11.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 20 client.25636 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:11.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5dad9e0 0x5568f5dafe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:11.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 4 client.25636 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:11.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.361+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5568f5c80e60 con 0x5568f5dad9e0 2023-09-21T12:57:11.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5dad9e0 0x5568f5dafe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:11.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f14f2ffd700 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5dad9e0 0x5568f5dafe00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4c32ac89f79bf4 server_cookie=49dd38890de1c4f7 in_seq=0 out_seq=0 2023-09-21T12:57:11.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f14d2ffd700 10 client.25636 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:11.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f14d2ffd700 1 -- 172.21.15.142:0/1417416525 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5568f5c80e60 con 0x5568f5dad9e0 2023-09-21T12:57:11.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f14d2ffd700 10 client.25636 handle_command_reply: tid=0 2023-09-21T12:57:11.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.362+0000 7f150db79b80 1 client.25636 shutdown 2023-09-21T12:57:11.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 msgr2=0x5568f5d4e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009d60 tx=0x7f14e402d470 comp rx=0 tx=0).stop 2023-09-21T12:57:11.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 shutdown_connections 2023-09-21T12:57:11.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568f5dad9e0 0x5568f5dafe00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568f5d3f3c0 0x5568f5d4e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568f5d454f0 0x5568f5dabc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 --2- 172.21.15.142:0/1417416525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568f5d44bd0 0x5568f5d4e610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 >> 172.21.15.142:0/1417416525 conn(0x5568f5c63000 msgr2=0x5568f5d42a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f14d2ffd700 0 client.25636 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:11.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 shutdown_connections 2023-09-21T12:57:11.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 1 -- 172.21.15.142:0/1417416525 wait complete. 2023-09-21T12:57:11.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.363+0000 7f150db79b80 20 client.25636 trim_cache size 0 max 16384 2023-09-21T12:57:11.474 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:11.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 msgr2=0x7f14dc0a2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 0x7f14dc0a2eb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14ec0c9090 tx=0x7f14ec004cc0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 msgr2=0x7f14f419df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:11.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 0x7f14f419df60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00efc0 tx=0x7f14ec00c3a0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 shutdown_connections 2023-09-21T12:57:11.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f14dc0a09f0 0x7f14dc0a2eb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14f419dae0 0x7f14f419df60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f14f4073210 0x7f14f4199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 --2- 172.21.15.142:0/866765526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f14f410d3f0 0x7f14f4199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:11.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.364+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 >> 172.21.15.142:0/866765526 conn(0x7f14f40fc680 msgr2=0x7f14f410f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:11.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.365+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 shutdown_connections 2023-09-21T12:57:11.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:11.365+0000 7f14f8f9d700 1 -- 172.21.15.142:0/866765526 wait complete. 2023-09-21T12:57:11.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:11 smithi142 ceph-mon[97663]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:11.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:11 smithi156 ceph-mon[134078]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:11.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:11 smithi160 ceph-mon[134450]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 24 KiB/s wr, 22 op/s 2023-09-21T12:57:12.478 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:57:12.479 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:57:12.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 -- 172.21.15.142:0/3594060956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c100fc0 msgr2=0x7fcf8c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 --2- 172.21.15.142:0/3594060956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c1013a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009990 tx=0x7fcf7c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 -- 172.21.15.142:0/3594060956 shutdown_connections 2023-09-21T12:57:12.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 --2- 172.21.15.142:0/3594060956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 --2- 172.21.15.142:0/3594060956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c1013a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 --2- 172.21.15.142:0/3594060956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c101970 0x7fcf8c1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 -- 172.21.15.142:0/3594060956 >> 172.21.15.142:0/3594060956 conn(0x7fcf8c0fc840 msgr2=0x7fcf8c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 -- 172.21.15.142:0/3594060956 shutdown_connections 2023-09-21T12:57:12.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.824+0000 7fcf913ff700 1 -- 172.21.15.142:0/3594060956 wait complete. 2023-09-21T12:57:12.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.826+0000 7fcf913ff700 1 Processor -- start 2023-09-21T12:57:12.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.826+0000 7fcf913ff700 1 -- start start 2023-09-21T12:57:12.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.826+0000 7fcf913ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.826+0000 7fcf913ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.826+0000 7fcf913ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c19db20 0x7fcf8c19dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf913ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c19e5a0 con 0x7fcf8c19db20 2023-09-21T12:57:12.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf913ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c19e710 con 0x7fcf8c100fc0 2023-09-21T12:57:12.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf913ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c19e8d0 con 0x7fcf8c1060e0 2023-09-21T12:57:12.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50250/0 (socket says 172.21.15.142:50250) 2023-09-21T12:57:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1196758247 learned_addr learned my addr 172.21.15.142:0/1196758247 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c19db20 0x7fcf8c19dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.827+0000 7fcf8affd700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1196758247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c100fc0 msgr2=0x7fcf8c199180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c199180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c19db20 msgr2=0x7fcf8c19dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c19db20 0x7fcf8c19dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1196758247 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84009c40 con 0x7fcf8c1060e0 2023-09-21T12:57:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000e970 tx=0x7fcf8000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf73fff700 1 -- 172.21.15.142:0/1196758247 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80009790 con 0x7fcf8c1060e0 2023-09-21T12:57:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf73fff700 1 -- 172.21.15.142:0/1196758247 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf8000c7c0 con 0x7fcf8c1060e0 2023-09-21T12:57:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf73fff700 1 -- 172.21.15.142:0/1196758247 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800054b0 con 0x7fcf8c1060e0 2023-09-21T12:57:12.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c0095f0 con 0x7fcf8c1060e0 2023-09-21T12:57:12.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.828+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c1a6130 con 0x7fcf8c1060e0 2023-09-21T12:57:12.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.834+0000 7fcf73fff700 1 -- 172.21.15.142:0/1196758247 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fcf8000c930 con 0x7fcf8c1060e0 2023-09-21T12:57:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.836+0000 7fcfa4cfdb80 1 Processor -- start 2023-09-21T12:57:12.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.836+0000 7fcfa4cfdb80 1 -- start start 2023-09-21T12:57:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be4f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bdbed20 con 0x56183be4a690 2023-09-21T12:57:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bda2cf0 con 0x56183be4afb0 2023-09-21T12:57:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bda0610 con 0x56183be4f3e0 2023-09-21T12:57:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcf73fff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 0x7fcf740a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33576/0 (socket says 172.21.15.142:33576) 2023-09-21T12:57:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.837+0000 7fcf8affd700 1 -- 172.21.15.142:0/3923850432 learned_addr learned my addr 172.21.15.142:0/3923850432 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf73fff700 1 -- 172.21.15.142:0/1196758247 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcf80014070 con 0x7fcf8c1060e0 2023-09-21T12:57:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 -- 172.21.15.142:0/3923850432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 msgr2=0x56183be4f840 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be4f840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 -- 172.21.15.142:0/3923850432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 msgr2=0x56183be4aa70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T12:57:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be4aa70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 -- 172.21.15.142:0/3923850432 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56183bbc6e60 con 0x56183be4afb0 2023-09-21T12:57:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.838+0000 7fcf8affd700 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005ea0 tx=0x7fcf7c005ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f2e0dc0945a1e6d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.839+0000 7fcf717fa700 1 -- 172.21.15.142:0/3923850432 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c01d070 con 0x56183be4afb0 2023-09-21T12:57:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.839+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 0x7fcf740a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.839+0000 7fcf717fa700 1 -- 172.21.15.142:0/3923850432 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf7c01e040 con 0x56183be4afb0 2023-09-21T12:57:12.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.839+0000 7fcf717fa700 1 -- 172.21.15.142:0/3923850432 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c004880 con 0x56183be4afb0 2023-09-21T12:57:12.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/3923850432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 msgr2=0x56183be4eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c005ea0 tx=0x7fcf7c005ed0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 0x7fcf740a2e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009fd0 tx=0x7fcf8400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/3923850432 shutdown_connections 2023-09-21T12:57:12.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be4aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be4f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/3923850432 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be4eea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/3923850432 >> 172.21.15.142:0/3923850432 conn(0x56183bd77080 msgr2=0x56183be45720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/3923850432 shutdown_connections 2023-09-21T12:57:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.840+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/3923850432 wait complete. 2023-09-21T12:57:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.841+0000 7fcfa4cfdb80 1 -- start start 2023-09-21T12:57:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.841+0000 7fcfa4cfdb80 1 Processor -- start 2023-09-21T12:57:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be56b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be543a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bd9bf00 con 0x56183be4a690 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bd387c0 con 0x56183be4afb0 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bd38460 con 0x56183be4f3e0 2023-09-21T12:57:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.842+0000 7fcfa4cfdb80 10 client.0 _ll_register_callbacks cb 0x56183bc82b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33588/0 (socket says 172.21.15.142:33588) 2023-09-21T12:57:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1346994231 learned_addr learned my addr 172.21.15.142:0/1346994231 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1346994231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 msgr2=0x56183be543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1346994231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 msgr2=0x56183be56b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be56b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1346994231 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c10e4d0 con 0x56183be4afb0 2023-09-21T12:57:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.843+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf80018000 tx=0x7fcf80099e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c03bcbce2aba0cc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800a1660 con 0x56183be4afb0 2023-09-21T12:57:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcf8000cc30 con 0x56183be4afb0 2023-09-21T12:57:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56183bd0cc30 con 0x56183be4afb0 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf80005630 con 0x56183be4afb0 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcfa4cfdb80 10 client.25691 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56183bbafce0 con 0x56183be4afb0 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.844+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf8007c080 con 0x56183be4afb0 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.845+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf800b3d20 con 0x56183be4afb0 2023-09-21T12:57:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.845+0000 7fcfa4cfdb80 10 client.25691 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.845+0000 7fcfa4cfdb80 10 client.25691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.845+0000 7fcfa4cfdb80 20 client.25691 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.845+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183be643e0 0x56183be66800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.846+0000 7fcfa4cfdb80 4 client.25691 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.846+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56183be190a0 con 0x56183be643e0 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.846+0000 7fcf8affd700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183be643e0 0x56183be66800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.847+0000 7fcf8affd700 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183be643e0 0x56183be66800 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c29734459f9cb07 server_cookie=81af3a3ca7761b8e in_seq=0 out_seq=0 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.847+0000 7fcf6eff5700 10 client.25691 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.847+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1346994231 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56183be190a0 con 0x56183be643e0 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.847+0000 7fcf6eff5700 10 client.25691 handle_command_reply: tid=0 2023-09-21T12:57:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.847+0000 7fcfa4cfdb80 1 client.25691 shutdown 2023-09-21T12:57:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 msgr2=0x56183be53d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fcf80018000 tx=0x7fcf80099e20 comp rx=0 tx=0).stop 2023-09-21T12:57:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 shutdown_connections 2023-09-21T12:57:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183be643e0 0x56183be66800 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be56b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcf6eff5700 0 client.25691 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1346994231 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4afb0 0x56183be53d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 >> 172.21.15.142:0/1346994231 conn(0x56183bd77080 msgr2=0x56183be44900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 shutdown_connections 2023-09-21T12:57:12.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.848+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1346994231 wait complete. 2023-09-21T12:57:12.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.849+0000 7fcfa4cfdb80 20 client.25691 trim_cache size 0 max 16384 2023-09-21T12:57:12.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.881+0000 7fcfa4cfdb80 1 Processor -- start 2023-09-21T12:57:12.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.881+0000 7fcfa4cfdb80 1 -- start start 2023-09-21T12:57:12.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be5b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 0x56183be51780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4f3e0 0x56183be49ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183be60e40 con 0x56183be4a690 2023-09-21T12:57:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183bc1c9a0 con 0x56183be4f3e0 2023-09-21T12:57:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183be4b6f0 con 0x56183be4afb0 2023-09-21T12:57:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.882+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be5b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be5b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60076/0 (socket says 172.21.15.142:60076) 2023-09-21T12:57:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8affd700 1 -- 172.21.15.142:0/711099502 learned_addr learned my addr 172.21.15.142:0/711099502 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 0x56183be51780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4f3e0 0x56183be49ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/711099502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4f3e0 msgr2=0x56183be49ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4f3e0 0x56183be49ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/711099502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 msgr2=0x56183be5b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be5b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/711099502 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56183bbed2d0 con 0x56183be4afb0 2023-09-21T12:57:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.883+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 0x56183be51780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf80099580 tx=0x7fcf8009d5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ad2b429331ac4ab server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.884+0000 7fcf71ffb700 1 -- 172.21.15.142:0/711099502 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf800a1660 con 0x56183be4afb0 2023-09-21T12:57:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.884+0000 7fcf71ffb700 1 -- 172.21.15.142:0/711099502 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56183bd0cc30 con 0x56183be4afb0 2023-09-21T12:57:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.884+0000 7fcf71ffb700 1 -- 172.21.15.142:0/711099502 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80005740 con 0x56183be4afb0 2023-09-21T12:57:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/711099502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 msgr2=0x56183be51780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 0x56183be51780 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcf80099580 tx=0x7fcf8009d5a0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/711099502 shutdown_connections 2023-09-21T12:57:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4a690 0x56183be5b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4f3e0 0x56183be49ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/711099502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4afb0 0x56183be51780 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/711099502 >> 172.21.15.142:0/711099502 conn(0x56183bd77080 msgr2=0x56183be49490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/711099502 shutdown_connections 2023-09-21T12:57:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/711099502 wait complete. 2023-09-21T12:57:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.885+0000 7fcfa4cfdb80 1 -- start start 2023-09-21T12:57:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.886+0000 7fcfa4cfdb80 1 Processor -- start 2023-09-21T12:57:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.886+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4a690 0x56183be5b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.886+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.886+0000 7fcfa4cfdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be58630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.886+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183be58d70 con 0x56183be4afb0 2023-09-21T12:57:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183be58ee0 con 0x56183be4a690 2023-09-21T12:57:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcfa4cfdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56183be590a0 con 0x56183be4f3e0 2023-09-21T12:57:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcfa4cfdb80 10 client.0 _ll_register_callbacks cb 0x56183bc82b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60078/0 (socket says 172.21.15.142:60078) 2023-09-21T12:57:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8a7fc700 1 -- 172.21.15.142:0/1595501251 learned_addr learned my addr 172.21.15.142:0/1595501251 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be58630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 -- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4a690 msgr2=0x56183be5b140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T12:57:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4a690 0x56183be5b140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 -- 172.21.15.142:0/1595501251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 msgr2=0x56183be5b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8b7fe700 1 -- 172.21.15.142:0/1595501251 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56183bbafce0 con 0x56183be4f3e0 2023-09-21T12:57:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.887+0000 7fcf8a7fc700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcf8b7fe700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be58630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf840060b0 tx=0x7fcf84004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3c529143b05d0f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcf6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8401c040 con 0x56183be4f3e0 2023-09-21T12:57:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf7c01e040 con 0x56183be4f3e0 2023-09-21T12:57:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcf84017cb0 con 0x56183be4f3e0 2023-09-21T12:57:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf8400e040 con 0x56183be4f3e0 2023-09-21T12:57:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcfa4cfdb80 10 client.25651 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.888+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56183bbc5330 con 0x56183be4f3e0 2023-09-21T12:57:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf7c01e040 con 0x56183be4f3e0 2023-09-21T12:57:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf8402a020 con 0x56183be4f3e0 2023-09-21T12:57:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 10 client.25651 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 10 client.25651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 20 client.25651 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183beba5a0 0x56183bebc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 4 client.25651 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:57:12.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.889+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56183bd94ee0 con 0x56183beba5a0 2023-09-21T12:57:12.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.890+0000 7fcf8affd700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183beba5a0 0x56183bebc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:12.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.890+0000 7fcf8affd700 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183beba5a0 0x56183bebc9c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c26ece4de79ca2d4 server_cookie=2e68e39416c737af in_seq=0 out_seq=0 2023-09-21T12:57:12.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.890+0000 7fcf6eff5700 10 client.25651 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.891+0000 7fcf6eff5700 1 -- 172.21.15.142:0/1595501251 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56183bd94ee0 con 0x56183beba5a0 2023-09-21T12:57:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.891+0000 7fcf6eff5700 10 client.25651 handle_command_reply: tid=0 2023-09-21T12:57:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.891+0000 7fcfa4cfdb80 1 client.25651 shutdown 2023-09-21T12:57:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 msgr2=0x56183be58630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be58630 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf840060b0 tx=0x7fcf84004ad0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 shutdown_connections 2023-09-21T12:57:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56183beba5a0 0x56183bebc9c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56183be4f3e0 0x56183be58630 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56183be4a690 0x56183be5b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 --2- 172.21.15.142:0/1595501251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56183be4afb0 0x56183be5b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 >> 172.21.15.142:0/1595501251 conn(0x56183bd77080 msgr2=0x56183be4e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.892+0000 7fcf6eff5700 0 client.25651 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.893+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 shutdown_connections 2023-09-21T12:57:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.893+0000 7fcfa4cfdb80 1 -- 172.21.15.142:0/1595501251 wait complete. 2023-09-21T12:57:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.893+0000 7fcfa4cfdb80 20 client.25651 trim_cache size 0 max 16384 2023-09-21T12:57:12.903 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:57:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "7a9d0465-da23-41e0-9da7-b648474ebad6", 2023-09-21T12:57:12.904 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:57:12.904 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:12.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 msgr2=0x7fcf740a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 0x7fcf740a2e10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcf84009fd0 tx=0x7fcf8400b040 comp rx=0 tx=0).stop 2023-09-21T12:57:12.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 msgr2=0x7fcf8c1996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:12.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcf8000e970 tx=0x7fcf8000ec80 comp rx=0 tx=0).stop 2023-09-21T12:57:12.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 shutdown_connections 2023-09-21T12:57:12.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcf740a0950 0x7fcf740a2e10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcf8c19db20 0x7fcf8c19dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcf8c100fc0 0x7fcf8c199180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 --2- 172.21.15.142:0/1196758247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcf8c1060e0 0x7fcf8c1996c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 >> 172.21.15.142:0/1196758247 conn(0x7fcf8c0fc840 msgr2=0x7fcf8c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.894+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 shutdown_connections 2023-09-21T12:57:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:12.895+0000 7fcf913ff700 1 -- 172.21.15.142:0/1196758247 wait complete. 2023-09-21T12:57:12.922 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:57:13.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 -- 172.21.15.142:0/2583588022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c1060e0 msgr2=0x7fba0c10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 --2- 172.21.15.142:0/2583588022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c1060e0 0x7fba0c10dc60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fba04009f90 tx=0x7fba0400b330 comp rx=0 tx=0).stop 2023-09-21T12:57:13.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 -- 172.21.15.142:0/2583588022 shutdown_connections 2023-09-21T12:57:13.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 --2- 172.21.15.142:0/2583588022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c100fc0 0x7fba0c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 --2- 172.21.15.142:0/2583588022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c1060e0 0x7fba0c10dc60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 --2- 172.21.15.142:0/2583588022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c101970 0x7fba0c1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 -- 172.21.15.142:0/2583588022 >> 172.21.15.142:0/2583588022 conn(0x7fba0c0fc840 msgr2=0x7fba0c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 -- 172.21.15.142:0/2583588022 shutdown_connections 2023-09-21T12:57:13.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.264+0000 7fba121ff700 1 -- 172.21.15.142:0/2583588022 wait complete. 2023-09-21T12:57:13.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 Processor -- start 2023-09-21T12:57:13.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 -- start start 2023-09-21T12:57:13.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c1060e0 0x7fba0c19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 0x7fba0c10cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c10d6a0 con 0x7fba0c10ca50 2023-09-21T12:57:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c10d810 con 0x7fba0c1060e0 2023-09-21T12:57:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.266+0000 7fba121ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1999b0 con 0x7fba0c100fc0 2023-09-21T12:57:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50292/0 (socket says 172.21.15.142:50292) 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 -- 172.21.15.142:0/438224290 learned_addr learned my addr 172.21.15.142:0/438224290 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0bfff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 0x7fba0c10cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0affd700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c1060e0 0x7fba0c19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 -- 172.21.15.142:0/438224290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c1060e0 msgr2=0x7fba0c19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c1060e0 0x7fba0c19e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 -- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 msgr2=0x7fba0c10cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 0x7fba0c10cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 -- 172.21.15.142:0/438224290 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba04009c40 con 0x7fba0c100fc0 2023-09-21T12:57:13.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0bfff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 0x7fba0c10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:13.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.267+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9c0 tx=0x7fb9fc00ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.268+0000 7fba08ff9700 1 -- 172.21.15.142:0/438224290 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00cbd0 con 0x7fba0c100fc0 2023-09-21T12:57:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.268+0000 7fba08ff9700 1 -- 172.21.15.142:0/438224290 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc00cd30 con 0x7fba0c100fc0 2023-09-21T12:57:13.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.268+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c199c90 con 0x7fba0c100fc0 2023-09-21T12:57:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.268+0000 7fba08ff9700 1 -- 172.21.15.142:0/438224290 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc005580 con 0x7fba0c100fc0 2023-09-21T12:57:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.268+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c19a1f0 con 0x7fba0c100fc0 2023-09-21T12:57:13.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.273+0000 7fba08ff9700 1 -- 172.21.15.142:0/438224290 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fb9fc004750 con 0x7fba0c100fc0 2023-09-21T12:57:13.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.274+0000 7fba25ae8b80 1 Processor -- start 2023-09-21T12:57:13.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.275+0000 7fba25ae8b80 1 -- start start 2023-09-21T12:57:13.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.275+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bd09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.275+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.275+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216b44ca0 con 0x558216bd0f30 2023-09-21T12:57:13.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216b28c70 con 0x558216bd5360 2023-09-21T12:57:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216b26590 con 0x558216bd0610 2023-09-21T12:57:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba08ff9700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 0x7fb9f40a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bd09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60108/0 (socket says 172.21.15.142:60108) 2023-09-21T12:57:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1153220292 learned_addr learned my addr 172.21.15.142:0/1153220292 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.276+0000 7fba0affd700 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba08ff9700 1 -- 172.21.15.142:0/438224290 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb9fc014070 con 0x7fba0c100fc0 2023-09-21T12:57:13.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0bfff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 0x7fb9f40a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1153220292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 msgr2=0x558216bd09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bd09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1153220292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 msgr2=0x558216bd57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.277+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1153220292 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55821694cde0 con 0x558216bd0f30 2023-09-21T12:57:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.278+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095c20 tx=0x7fb9fc009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1983db17dcf3a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.278+0000 7fb9f1ffb700 1 -- 172.21.15.142:0/1153220292 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc099e20 con 0x558216bd0f30 2023-09-21T12:57:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.278+0000 7fb9f1ffb700 1 -- 172.21.15.142:0/1153220292 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc005700 con 0x558216bd0f30 2023-09-21T12:57:13.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.278+0000 7fb9f1ffb700 1 -- 172.21.15.142:0/1153220292 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0165a0 con 0x558216bd0f30 2023-09-21T12:57:13.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1153220292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 msgr2=0x558216bd4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba0bfff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 0x7fb9f40a2e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba04009c10 tx=0x7fba0400b330 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc095c20 tx=0x7fb9fc009550 comp rx=0 tx=0).stop 2023-09-21T12:57:13.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1153220292 shutdown_connections 2023-09-21T12:57:13.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bd09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1153220292 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd4e20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1153220292 >> 172.21.15.142:0/1153220292 conn(0x558216afd000 msgr2=0x558216bcb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1153220292 shutdown_connections 2023-09-21T12:57:13.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.279+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1153220292 wait complete. 2023-09-21T12:57:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.280+0000 7fba25ae8b80 1 -- start start 2023-09-21T12:57:13.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 Processor -- start 2023-09-21T12:57:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bd9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0f30 0x558216bda320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216b21e80 con 0x558216bd0610 2023-09-21T12:57:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216abe740 con 0x558216bd5360 2023-09-21T12:57:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216abe3e0 con 0x558216bd0f30 2023-09-21T12:57:13.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.281+0000 7fba25ae8b80 10 client.0 _ll_register_callbacks cb 0x558216a08a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.282+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.282+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33620/0 (socket says 172.21.15.142:33620) 2023-09-21T12:57:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.282+0000 7fba0bfff700 1 -- 172.21.15.142:0/1021431517 learned_addr learned my addr 172.21.15.142:0/1021431517 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.282+0000 7fba0affd700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0f30 0x558216bda320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.282+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bd9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 -- 172.21.15.142:0/1021431517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0f30 msgr2=0x558216bda320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0f30 0x558216bda320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 -- 172.21.15.142:0/1021431517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 msgr2=0x558216bd9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bd9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 -- 172.21.15.142:0/1021431517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c19a1f0 con 0x558216bd5360 2023-09-21T12:57:13.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fba0bfff700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba04007b50 tx=0x7fba04009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45920b0357db05d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fb9eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:13.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.283+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400e070 con 0x558216bd5360 2023-09-21T12:57:13.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558216a92bb0 con 0x558216bd5360 2023-09-21T12:57:13.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fba0402b440 con 0x558216bd5360 2023-09-21T12:57:13.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba0402b640 con 0x558216bd5360 2023-09-21T12:57:13.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fba25ae8b80 10 client.25703 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:13.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558216935c60 con 0x558216bd5360 2023-09-21T12:57:13.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.284+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558216a92bb0 con 0x558216bd5360 2023-09-21T12:57:13.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fba04028070 con 0x558216bd5360 2023-09-21T12:57:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 10 client.25703 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 10 client.25703 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 20 client.25703 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:13.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216bea480 0x558216bec8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 4 client.25703 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558216b9f020 con 0x558216bea480 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.285+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216bea480 0x558216bec8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.286+0000 7fb9eaffd700 10 client.25703 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.286+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216bea480 0x558216bec8a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f697bb0eec9a5a0 server_cookie=265489d856fda23 in_seq=0 out_seq=0 2023-09-21T12:57:13.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.286+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1021431517 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558216b9f020 con 0x558216bea480 2023-09-21T12:57:13.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.286+0000 7fb9eaffd700 10 client.25703 handle_command_reply: tid=0 2023-09-21T12:57:13.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 client.25703 shutdown 2023-09-21T12:57:13.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 msgr2=0x558216bda860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fba04007b50 tx=0x7fba04009920 comp rx=0 tx=0).stop 2023-09-21T12:57:13.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 shutdown_connections 2023-09-21T12:57:13.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216bea480 0x558216bec8a0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bd9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bda860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fb9eaffd700 0 client.25703 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:13.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1021431517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0f30 0x558216bda320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 >> 172.21.15.142:0/1021431517 conn(0x558216afd000 msgr2=0x558216bcb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 shutdown_connections 2023-09-21T12:57:13.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.287+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1021431517 wait complete. 2023-09-21T12:57:13.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.288+0000 7fba25ae8b80 20 client.25703 trim_cache size 0 max 16384 2023-09-21T12:57:13.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 Processor -- start 2023-09-21T12:57:13.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 -- start start 2023-09-21T12:57:13.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582169a2920 con 0x558216bd0f30 2023-09-21T12:57:13.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216be6de0 con 0x558216bd5360 2023-09-21T12:57:13.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.321+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216be6350 con 0x558216bd0610 2023-09-21T12:57:13.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50324/0 (socket says 172.21.15.142:50324) 2023-09-21T12:57:13.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 -- 172.21.15.142:0/2033437972 learned_addr learned my addr 172.21.15.142:0/2033437972 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:13.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0bfff700 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 -- 172.21.15.142:0/2033437972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 msgr2=0x558216bd3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 -- 172.21.15.142:0/2033437972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 msgr2=0x558216bd33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 -- 172.21.15.142:0/2033437972 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558216973250 con 0x558216bd0610 2023-09-21T12:57:13.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.322+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0c9b50 tx=0x7fb9fc095a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7146b000ea811fba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.323+0000 7fb9f27fc700 1 -- 172.21.15.142:0/2033437972 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc09d550 con 0x558216bd0610 2023-09-21T12:57:13.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.323+0000 7fb9f27fc700 1 -- 172.21.15.142:0/2033437972 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc099720 con 0x558216bd0610 2023-09-21T12:57:13.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.323+0000 7fb9f27fc700 1 -- 172.21.15.142:0/2033437972 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc099be0 con 0x558216bd0610 2023-09-21T12:57:13.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- 172.21.15.142:0/2033437972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 msgr2=0x558216bda690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0c9b50 tx=0x7fb9fc095a60 comp rx=0 tx=0).stop 2023-09-21T12:57:13.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- 172.21.15.142:0/2033437972 shutdown_connections 2023-09-21T12:57:13.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd5360 0x558216bd3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd0610 0x558216bda690 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/2033437972 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0f30 0x558216bd33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- 172.21.15.142:0/2033437972 >> 172.21.15.142:0/2033437972 conn(0x558216afd000 msgr2=0x558216be5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- 172.21.15.142:0/2033437972 shutdown_connections 2023-09-21T12:57:13.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- 172.21.15.142:0/2033437972 wait complete. 2023-09-21T12:57:13.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.324+0000 7fba25ae8b80 1 -- start start 2023-09-21T12:57:13.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 Processor -- start 2023-09-21T12:57:13.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd0f30 0x558216bdfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 0x558216c372b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216c377f0 con 0x558216bd0610 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216c37960 con 0x558216bd0f30 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.325+0000 7fba25ae8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558216c37b20 con 0x558216bd5360 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba25ae8b80 10 client.0 _ll_register_callbacks cb 0x558216a08a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:13.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60136/0 (socket says 172.21.15.142:60136) 2023-09-21T12:57:13.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1422912189 learned_addr learned my addr 172.21.15.142:0/1422912189 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:13.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0affd700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd0f30 0x558216bdfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0bfff700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 0x558216c372b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1422912189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 msgr2=0x558216c372b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 0x558216c372b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd0f30 msgr2=0x558216bdfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:13.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd0f30 0x558216bdfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0b7fe700 1 -- 172.21.15.142:0/1422912189 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55821694cde0 con 0x558216bd0610 2023-09-21T12:57:13.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.326+0000 7fba0bfff700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 0x558216c372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fba0b7fe700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0a1260 tx=0x7fb9fc005910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbff0523f75c4a25 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fb9eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc016330 con 0x558216bd0610 2023-09-21T12:57:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9fc005700 con 0x558216bd0610 2023-09-21T12:57:13.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb9fc016490 con 0x558216bd0610 2023-09-21T12:57:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc0a1300 con 0x558216bd0610 2023-09-21T12:57:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fba25ae8b80 10 client.15657 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.327+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55821694b2b0 con 0x558216bd0610 2023-09-21T12:57:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.328+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9fc07c020 con 0x558216bd0610 2023-09-21T12:57:13.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb9fc01f060 con 0x558216bd0610 2023-09-21T12:57:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 10 client.15657 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 20 client.15657 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216c3edf0 0x558216c411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:13.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 4 client.15657 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:57:13.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558216b1ae60 con 0x558216c3edf0 2023-09-21T12:57:13.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.329+0000 7fba0affd700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216c3edf0 0x558216c411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:13.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fba0affd700 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216c3edf0 0x558216c411e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1761122e6e5d6693 server_cookie=3f661c6c9410c2d7 in_seq=0 out_seq=0 2023-09-21T12:57:13.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fb9eaffd700 10 client.15657 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:13.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fb9eaffd700 1 -- 172.21.15.142:0/1422912189 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558216b1ae60 con 0x558216c3edf0 2023-09-21T12:57:13.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fb9eaffd700 10 client.15657 handle_command_reply: tid=0 2023-09-21T12:57:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fba25ae8b80 1 client.15657 shutdown 2023-09-21T12:57:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 msgr2=0x558216bdf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.330+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0a1260 tx=0x7fb9fc005910 comp rx=0 tx=0).stop 2023-09-21T12:57:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 shutdown_connections 2023-09-21T12:57:13.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558216c3edf0 0x558216c411e0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558216bd0610 0x558216bdf6c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558216bd5360 0x558216c372b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 --2- 172.21.15.142:0/1422912189 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558216bd0f30 0x558216bdfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 >> 172.21.15.142:0/1422912189 conn(0x558216afd000 msgr2=0x558216bd33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fb9eaffd700 0 client.15657 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:13.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 shutdown_connections 2023-09-21T12:57:13.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 1 -- 172.21.15.142:0/1422912189 wait complete. 2023-09-21T12:57:13.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.331+0000 7fba25ae8b80 20 client.15657 trim_cache size 0 max 16384 2023-09-21T12:57:13.340 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:13.340 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "7a9d0465-da23-41e0-9da7-b648474ebad6": { 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "7a9d0465-da23-41e0-9da7-b648474ebad6", 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:57:13.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:57:13.342 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:57:13.342 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:13.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 msgr2=0x7fb9f40a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 0x7fb9f40a2e10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fba04009c10 tx=0x7fba0400b330 comp rx=0 tx=0).stop 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 msgr2=0x7fba0c19df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc00e9c0 tx=0x7fb9fc00ed80 comp rx=0 tx=0).stop 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 shutdown_connections 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb9f40a0950 0x7fb9f40a2e10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fba0c10ca50 0x7fba0c10cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba0c100fc0 0x7fba0c19df00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.332+0000 7fba121ff700 1 --2- 172.21.15.142:0/438224290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fba0c1060e0 0x7fba0c19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.333+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 >> 172.21.15.142:0/438224290 conn(0x7fba0c0fc840 msgr2=0x7fba0c104990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.333+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 shutdown_connections 2023-09-21T12:57:13.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:13.333+0000 7fba121ff700 1 -- 172.21.15.142:0/438224290 wait complete. 2023-09-21T12:57:13.361 INFO:tasks.cephfs.filesystem:scrub status for tag:7a9d0465-da23-41e0-9da7-b648474ebad6 - {'path': '/', 'tag': '7a9d0465-da23-41e0-9da7-b648474ebad6', 'options': 'recursive,force'} 2023-09-21T12:57:13.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:13 smithi142 ceph-mon[97663]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 19 op/s 2023-09-21T12:57:13.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:13 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:57:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:13 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:13 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:57:13.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:13 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:13 smithi156 ceph-mon[134078]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 19 op/s 2023-09-21T12:57:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:13 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:57:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:13 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:13 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:57:13.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:13 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:13 smithi160 ceph-mon[134450]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 19 op/s 2023-09-21T12:57:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:13 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:57:13.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:13 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:13.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:13 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:57:13.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:13 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:15 smithi156 ceph-mon[134078]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2023-09-21T12:57:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:15 smithi142 ceph-mon[97663]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2023-09-21T12:57:15.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:15 smithi160 ceph-mon[134450]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 682 B/s wr, 6 op/s 2023-09-21T12:57:16.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:16 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:57:16.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:16 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:57:16.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:16 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:57:17.859 INFO:tasks.workunit.client.0.smithi142.stderr:Updating files: 64% (7683/11967) Updating files: 65% (7779/11967) Updating files: 66% (7899/11967) Updating files: 67% (8018/11967) Updating files: 68% (8138/11967) Updating files: 69% (8258/11967) Updating files: 70% (8377/11967) Updating files: 71% (8497/11967) Updating files: 72% (8617/11967) Updating files: 73% (8736/11967) Updating files: 74% (8856/11967) Updating files: 75% (8976/11967) Updating files: 76% (9095/11967) Updating files: 77% (9215/11967) Updating files: 78% (9335/11967) Updating files: 79% (9454/11967) Updating files: 80% (9574/11967) Updating files: 81% (9694/11967) Updating files: 82% (9813/11967) Updating files: 83% (9933/11967) Updating files: 84% (10053/11967) Updating files: 85% (10172/11967) Updating files: 86% (10292/11967) Updating files: 87% (10412/11967) Updating files: 88% (10531/11967) Updating files: 89% (10651/11967) Updating files: 90% (10771/11967) Updating files: 91% (10890/11967) Updating files: 92% (11010/11967) Updating files: 93% (11130/11967) Updating files: 94% (11249/11967) Updating files: 95% (11369/11967) Updating files: 96% (11489/11967) Updating files: 97% (11608/11967) Updating files: 98% (11728/11967) Updating files: 99% (11848/11967) Updating files: 100% (11967/11967) Updating files: 100% (11967/11967), done. 2023-09-21T12:57:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:17 smithi156 ceph-mon[134078]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-09-21T12:57:17.921 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:17 smithi142 ceph-mon[97663]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-09-21T12:57:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:17 smithi160 ceph-mon[134450]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 682 B/s wr, 9 op/s 2023-09-21T12:57:18.536 INFO:tasks.workunit.client.0.smithi142.stderr:Note: switching to '41c9e835c3f621102ade35dd597317a42116a491'. 2023-09-21T12:57:18.537 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.537 INFO:tasks.workunit.client.0.smithi142.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-21T12:57:18.537 INFO:tasks.workunit.client.0.smithi142.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-21T12:57:18.537 INFO:tasks.workunit.client.0.smithi142.stderr:state without impacting any branches by switching back to a branch. 2023-09-21T12:57:18.537 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.538 INFO:tasks.workunit.client.0.smithi142.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-21T12:57:18.538 INFO:tasks.workunit.client.0.smithi142.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-21T12:57:18.538 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.538 INFO:tasks.workunit.client.0.smithi142.stderr: git switch -c 2023-09-21T12:57:18.538 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.539 INFO:tasks.workunit.client.0.smithi142.stderr:Or undo this operation with: 2023-09-21T12:57:18.539 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.539 INFO:tasks.workunit.client.0.smithi142.stderr: git switch - 2023-09-21T12:57:18.539 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.539 INFO:tasks.workunit.client.0.smithi142.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-21T12:57:18.540 INFO:tasks.workunit.client.0.smithi142.stderr: 2023-09-21T12:57:18.540 INFO:tasks.workunit.client.0.smithi142.stderr:HEAD is now at 41c9e835c3f mon/ConfigMonitor: --format=json does not work for config get or show 2023-09-21T12:57:18.545 DEBUG:teuthology.orchestra.run.smithi142:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-21T12:57:18.610 INFO:tasks.workunit.client.0.smithi142.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-21T12:57:18.615 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-21T12:57:18.615 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-21T12:57:19.189 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-21T12:57:19.269 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-21T12:57:19.333 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-21T12:57:19.337 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-21T12:57:19.337 INFO:tasks.workunit.client.0.smithi142.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-21T12:57:19.400 INFO:tasks.workunit.client.0.smithi142.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-21T12:57:19.407 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T12:57:19.407 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-21T12:57:19.451 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-09-21T12:57:19.452 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-09-21T12:57:19.453 DEBUG:teuthology.orchestra.run.smithi142:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=41c9e835c3f621102ade35dd597317a42116a491 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-09-21T12:57:19.549 INFO:tasks.workunit.client.0.smithi142.stderr:+ dbench 1 2023-09-21T12:57:19.562 INFO:tasks.workunit.client.0.smithi142.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-09-21T12:57:19.562 INFO:tasks.workunit.client.0.smithi142.stdout: 2023-09-21T12:57:19.562 INFO:tasks.workunit.client.0.smithi142.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-09-21T12:57:19.567 INFO:tasks.workunit.client.0.smithi142.stdout:0 of 1 processes prepared for launch 0 sec 2023-09-21T12:57:19.667 INFO:tasks.workunit.client.0.smithi142.stdout:1 of 1 processes prepared for launch 0 sec 2023-09-21T12:57:19.668 INFO:tasks.workunit.client.0.smithi142.stdout:releasing clients 2023-09-21T12:57:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:19 smithi156 ceph-mon[134078]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:57:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:19 smithi142 ceph-mon[97663]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:57:19.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:19 smithi160 ceph-mon[134450]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-09-21T12:57:20.667 INFO:tasks.workunit.client.0.smithi142.stdout: 1 3275 35.34 MB/sec warmup 1 sec latency 6.534 ms 2023-09-21T12:57:21.667 INFO:tasks.workunit.client.0.smithi142.stdout: 1 6129 24.03 MB/sec warmup 2 sec latency 6.112 ms 2023-09-21T12:57:21.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:21 smithi156 ceph-mon[134078]: pgmap v36: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 KiB/s wr, 22 op/s 2023-09-21T12:57:21.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:21 smithi142 ceph-mon[97663]: pgmap v36: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 KiB/s wr, 22 op/s 2023-09-21T12:57:21.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:21 smithi160 ceph-mon[134450]: pgmap v36: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 102 KiB/s wr, 22 op/s 2023-09-21T12:57:22.667 INFO:tasks.workunit.client.0.smithi142.stdout: 1 8794 21.49 MB/sec warmup 3 sec latency 8.513 ms 2023-09-21T12:57:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 -- 172.21.15.142:0/789198728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 msgr2=0x7fac6c1013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 --2- 172.21.15.142:0/789198728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c1013c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fac68009990 tx=0x7fac68009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 -- 172.21.15.142:0/789198728 shutdown_connections 2023-09-21T12:57:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 --2- 172.21.15.142:0/789198728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c1013c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 --2- 172.21.15.142:0/789198728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 --2- 172.21.15.142:0/789198728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c101990 0x7fac6c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 -- 172.21.15.142:0/789198728 >> 172.21.15.142:0/789198728 conn(0x7fac6c0fc840 msgr2=0x7fac6c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 -- 172.21.15.142:0/789198728 shutdown_connections 2023-09-21T12:57:23.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.523+0000 7fac733ff700 1 -- 172.21.15.142:0/789198728 wait complete. 2023-09-21T12:57:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.525+0000 7fac733ff700 1 Processor -- start 2023-09-21T12:57:23.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.525+0000 7fac733ff700 1 -- start start 2023-09-21T12:57:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c1a3140 0x7fac6c1a5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1a5a70 con 0x7fac6c100fe0 2023-09-21T12:57:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1a5bb0 con 0x7fac6c106100 2023-09-21T12:57:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac733ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1a5d20 con 0x7fac6c1a3140 2023-09-21T12:57:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7099a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37436/0 (socket says 172.21.15.142:37436) 2023-09-21T12:57:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 -- 172.21.15.142:0/3415137166 learned_addr learned my addr 172.21.15.142:0/3415137166 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7099a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40628/0 (socket says 172.21.15.142:40628) 2023-09-21T12:57:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7199c700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c1a3140 0x7fac6c1a5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 -- 172.21.15.142:0/3415137166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c1a3140 msgr2=0x7fac6c1a5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c1a3140 0x7fac6c1a5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 -- 172.21.15.142:0/3415137166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 msgr2=0x7fac6c073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.526+0000 7fac7119b700 1 -- 172.21.15.142:0/3415137166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac64009c40 con 0x7fac6c100fe0 2023-09-21T12:57:23.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac7119b700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c010 tx=0x7fac68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac627fc700 1 -- 172.21.15.142:0/3415137166 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6801d070 con 0x7fac6c100fe0 2023-09-21T12:57:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac627fc700 1 -- 172.21.15.142:0/3415137166 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac68022470 con 0x7fac6c100fe0 2023-09-21T12:57:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac680095f0 con 0x7fac6c100fe0 2023-09-21T12:57:23.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac627fc700 1 -- 172.21.15.142:0/3415137166 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68017650 con 0x7fac6c100fe0 2023-09-21T12:57:23.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.527+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c1a61d0 con 0x7fac6c100fe0 2023-09-21T12:57:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.531+0000 7fac627fc700 1 -- 172.21.15.142:0/3415137166 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fac680225e0 con 0x7fac6c100fe0 2023-09-21T12:57:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 Processor -- start 2023-09-21T12:57:23.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 -- start start 2023-09-21T12:57:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac627fc700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 0x7fac580a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac627fc700 1 -- 172.21.15.142:0/3415137166 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fac680cd3b0 con 0x7fac6c100fe0 2023-09-21T12:57:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dbe910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dbf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8d2ec40 con 0x55d8d8dbee50 2023-09-21T12:57:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8d12c10 con 0x55d8d8dba0a0 2023-09-21T12:57:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.533+0000 7fac86d02b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8d10530 con 0x55d8d8dba9c0 2023-09-21T12:57:23.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7199c700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 0x7fac580a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40636/0 (socket says 172.21.15.142:40636) 2023-09-21T12:57:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7099a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dbe910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 -- 172.21.15.142:0/2740127464 learned_addr learned my addr 172.21.15.142:0/2740127464 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 -- 172.21.15.142:0/2740127464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 msgr2=0x55d8d8dbe910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dbe910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 -- 172.21.15.142:0/2740127464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 msgr2=0x55d8d8dbf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dbf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 -- 172.21.15.142:0/2740127464 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8d8b36d80 con 0x55d8d8dba0a0 2023-09-21T12:57:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7119b700 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac68096b70 tx=0x7fac6809a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c556e2f481441316 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac577fe700 1 -- 172.21.15.142:0/2740127464 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6809ad70 con 0x55d8d8dba0a0 2023-09-21T12:57:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.534+0000 7fac7199c700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 0x7fac580a2d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac64009fd0 tx=0x7fac64009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac577fe700 1 -- 172.21.15.142:0/2740127464 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac6809a670 con 0x55d8d8dba0a0 2023-09-21T12:57:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac577fe700 1 -- 172.21.15.142:0/2740127464 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68085320 con 0x55d8d8dba0a0 2023-09-21T12:57:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 -- 172.21.15.142:0/2740127464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 msgr2=0x55d8d8dba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fac68096b70 tx=0x7fac6809a4c0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 -- 172.21.15.142:0/2740127464 shutdown_connections 2023-09-21T12:57:23.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dbf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dba480 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 --2- 172.21.15.142:0/2740127464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dbe910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.535+0000 7fac86d02b80 1 -- 172.21.15.142:0/2740127464 >> 172.21.15.142:0/2740127464 conn(0x55d8d8ce6fa0 msgr2=0x55d8d8db50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.536+0000 7fac86d02b80 1 -- 172.21.15.142:0/2740127464 shutdown_connections 2023-09-21T12:57:23.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.536+0000 7fac86d02b80 1 -- 172.21.15.142:0/2740127464 wait complete. 2023-09-21T12:57:23.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.536+0000 7fac86d02b80 1 -- start start 2023-09-21T12:57:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.536+0000 7fac86d02b80 1 Processor -- start 2023-09-21T12:57:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8d0be20 con 0x55d8d8dbee50 2023-09-21T12:57:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8ca86e0 con 0x55d8d8dba9c0 2023-09-21T12:57:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8ca8380 con 0x55d8d8dba0a0 2023-09-21T12:57:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac86d02b80 10 client.0 _ll_register_callbacks cb 0x55d8d8bf2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:23.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50952/0 (socket says 172.21.15.142:50952) 2023-09-21T12:57:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 -- 172.21.15.142:0/3774304254 learned_addr learned my addr 172.21.15.142:0/3774304254 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7199c700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7099a700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 -- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 msgr2=0x55d8d8dc3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 -- 172.21.15.142:0/3774304254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 msgr2=0x55d8d8dc3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7119b700 1 -- 172.21.15.142:0/3774304254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c1a61d0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.537+0000 7fac7099a700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac7119b700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac6809a600 tx=0x7fac68009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a56f665dd3a2aa0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6809e4a0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fac680987b0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8d8c7cb50 con 0x55d8d8dba0a0 2023-09-21T12:57:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac680850c0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac86d02b80 10 client.25678 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d8d8b1fc00 con 0x55d8d8dba0a0 2023-09-21T12:57:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac6807d020 con 0x55d8d8dba0a0 2023-09-21T12:57:23.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.538+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fac6809a9f0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 10 client.25678 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 10 client.25678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 20 client.25678 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8dd3780 0x55d8d8dd5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 4 client.25678 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8d8d88fc0 con 0x55d8d8dd3780 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac7099a700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8dd3780 0x55d8d8dd5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac54ff9700 10 client.25678 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.539+0000 7fac7099a700 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8dd3780 0x55d8d8dd5ba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1251ef2839112fa7 server_cookie=7b01f0ee8cdb76dc in_seq=0 out_seq=0 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.540+0000 7fac54ff9700 1 -- 172.21.15.142:0/3774304254 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8d8d88fc0 con 0x55d8d8dd3780 2023-09-21T12:57:23.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac54ff9700 10 client.25678 handle_command_reply: tid=0 2023-09-21T12:57:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 client.25678 shutdown 2023-09-21T12:57:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 msgr2=0x55d8d8dc6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fac6809a600 tx=0x7fac68009520 comp rx=0 tx=0).stop 2023-09-21T12:57:23.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 shutdown_connections 2023-09-21T12:57:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8dd3780 0x55d8d8dd5ba0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6620 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3774304254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 >> 172.21.15.142:0/3774304254 conn(0x55d8d8ce6fa0 msgr2=0x55d8d8db4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac54ff9700 0 client.25678 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:23.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 shutdown_connections 2023-09-21T12:57:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 1 -- 172.21.15.142:0/3774304254 wait complete. 2023-09-21T12:57:23.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.541+0000 7fac86d02b80 20 client.25678 trim_cache size 0 max 16384 2023-09-21T12:57:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 Processor -- start 2023-09-21T12:57:23.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 -- start start 2023-09-21T12:57:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8b8c8c0 con 0x55d8d8dbee50 2023-09-21T12:57:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8dbb190 con 0x55d8d8dba9c0 2023-09-21T12:57:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.559+0000 7fac86d02b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8db6a10 con 0x55d8d8dba0a0 2023-09-21T12:57:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50962/0 (socket says 172.21.15.142:50962) 2023-09-21T12:57:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7119b700 1 -- 172.21.15.142:0/3519593759 learned_addr learned my addr 172.21.15.142:0/3519593759 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7199c700 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 -- 172.21.15.142:0/3519593759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 msgr2=0x55d8d8dc6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 -- 172.21.15.142:0/3519593759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 msgr2=0x55d8d8dc1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7099a700 1 -- 172.21.15.142:0/3519593759 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8d8b5d1f0 con 0x55d8d8dba9c0 2023-09-21T12:57:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.560+0000 7fac7119b700 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.561+0000 7fac7099a700 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc1240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d8d8dd6480 tx=0x7fac5c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a4a97cd255b0ec server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.561+0000 7fac57fff700 1 -- 172.21.15.142:0/3519593759 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c004230 con 0x55d8d8dba9c0 2023-09-21T12:57:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.561+0000 7fac57fff700 1 -- 172.21.15.142:0/3519593759 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac5c018040 con 0x55d8d8dba9c0 2023-09-21T12:57:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.561+0000 7fac57fff700 1 -- 172.21.15.142:0/3519593759 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c004e60 con 0x55d8d8dba9c0 2023-09-21T12:57:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 -- 172.21.15.142:0/3519593759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 msgr2=0x55d8d8dc1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc1240 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d8d8dd6480 tx=0x7fac5c009260 comp rx=0 tx=0).stop 2023-09-21T12:57:23.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 -- 172.21.15.142:0/3519593759 shutdown_connections 2023-09-21T12:57:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dc6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 --2- 172.21.15.142:0/3519593759 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dc1240 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 -- 172.21.15.142:0/3519593759 >> 172.21.15.142:0/3519593759 conn(0x55d8d8ce6fa0 msgr2=0x55d8d8dbcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 -- 172.21.15.142:0/3519593759 shutdown_connections 2023-09-21T12:57:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.562+0000 7fac86d02b80 1 -- 172.21.15.142:0/3519593759 wait complete. 2023-09-21T12:57:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.563+0000 7fac86d02b80 1 -- start start 2023-09-21T12:57:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.563+0000 7fac86d02b80 1 Processor -- start 2023-09-21T12:57:23.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dca620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8dc9360 con 0x55d8d8dbee50 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8dc94d0 con 0x55d8d8dba0a0 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8d8dc9690 con 0x55d8d8dba9c0 2023-09-21T12:57:23.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac86d02b80 10 client.0 _ll_register_callbacks cb 0x55d8d8bf2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50972/0 (socket says 172.21.15.142:50972) 2023-09-21T12:57:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 -- 172.21.15.142:0/1618370490 learned_addr learned my addr 172.21.15.142:0/1618370490 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:23.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7199c700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 -- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 msgr2=0x55d8d8dca620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dca620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 -- 172.21.15.142:0/1618370490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 msgr2=0x55d8d8dc8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7099a700 1 -- 172.21.15.142:0/1618370490 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8d8b1fc00 con 0x55d8d8dba9c0 2023-09-21T12:57:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.564+0000 7fac7199c700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.565+0000 7fac7099a700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000c00 tx=0x7fac5c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cddb593f40166cdb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:23.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.565+0000 7fac54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:23.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c004e60 con 0x55d8d8dba9c0 2023-09-21T12:57:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac6809a670 con 0x55d8d8dba9c0 2023-09-21T12:57:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fac5c004030 con 0x55d8d8dba9c0 2023-09-21T12:57:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac5c0041f0 con 0x55d8d8dba9c0 2023-09-21T12:57:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac86d02b80 10 client.25684 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:23.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.566+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fac5c009ac0 con 0x55d8d8dba9c0 2023-09-21T12:57:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac6809a670 con 0x55d8d8dba9c0 2023-09-21T12:57:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fac5c005420 con 0x55d8d8dba9c0 2023-09-21T12:57:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 10 client.25684 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:23.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 10 client.25684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 20 client.25684 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8e285c0 0x55d8d8e2a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 4 client.25684 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8d8d04e00 con 0x55d8d8e285c0 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac7119b700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8e285c0 0x55d8d8e2a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:23.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac54ff9700 10 client.25684 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:23.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.567+0000 7fac7119b700 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8e285c0 0x55d8d8e2a9e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a165aa1fad73fe59 server_cookie=bc01fdfb5d8e2cf in_seq=0 out_seq=0 2023-09-21T12:57:23.667 INFO:tasks.workunit.client.0.smithi142.stdout: 1 11237 19.58 MB/sec warmup 4 sec latency 23.059 ms 2023-09-21T12:57:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac54ff9700 1 -- 172.21.15.142:0/1618370490 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8d8d04e00 con 0x55d8d8e285c0 2023-09-21T12:57:23.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac54ff9700 10 client.25684 handle_command_reply: tid=0 2023-09-21T12:57:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 client.25684 shutdown 2023-09-21T12:57:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 msgr2=0x55d8d8dcab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000c00 tx=0x7fac5c004a40 comp rx=0 tx=0).stop 2023-09-21T12:57:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 shutdown_connections 2023-09-21T12:57:23.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8d8e285c0 0x55d8d8e2a9e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8d8dbee50 0x55d8d8dc8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac54ff9700 0 client.25684 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8d8dba0a0 0x55d8d8dca620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.724+0000 7fac86d02b80 1 --2- 172.21.15.142:0/1618370490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8d8dba9c0 0x55d8d8dcab60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.725+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 >> 172.21.15.142:0/1618370490 conn(0x55d8d8ce6fa0 msgr2=0x55d8d8dbcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.725+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 shutdown_connections 2023-09-21T12:57:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.725+0000 7fac86d02b80 1 -- 172.21.15.142:0/1618370490 wait complete. 2023-09-21T12:57:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.725+0000 7fac86d02b80 20 client.25684 trim_cache size 0 max 16384 2023-09-21T12:57:23.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:57:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:57:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:57:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:57:23.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 msgr2=0x7fac580a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 0x7fac580a2d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fac64009fd0 tx=0x7fac64009920 comp rx=0 tx=0).stop 2023-09-21T12:57:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 msgr2=0x7fac6c0732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fac6800c010 tx=0x7fac68004730 comp rx=0 tx=0).stop 2023-09-21T12:57:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 shutdown_connections 2023-09-21T12:57:23.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fac580a08d0 0x7fac580a2d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fac6c100fe0 0x7fac6c0732c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac6c1a3140 0x7fac6c1a5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 --2- 172.21.15.142:0/3415137166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fac6c106100 0x7fac6c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:23.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 >> 172.21.15.142:0/3415137166 conn(0x7fac6c0fc840 msgr2=0x7fac6c104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 shutdown_connections 2023-09-21T12:57:23.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:23.726+0000 7fac733ff700 1 -- 172.21.15.142:0/3415137166 wait complete. 2023-09-21T12:57:23.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:23 smithi156 ceph-mon[134078]: pgmap v37: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:23.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:23 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:57:23.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:23 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:57:23.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:23 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:57:23.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:23 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:57:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:23 smithi142 ceph-mon[97663]: pgmap v37: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:23 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:57:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:23 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:57:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:23 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:57:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:23 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:57:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:23 smithi160 ceph-mon[134450]: pgmap v37: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:23 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:57:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:23 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:57:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:23 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:57:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:23 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:57:24.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 14451 19.42 MB/sec warmup 5 sec latency 15.279 ms 2023-09-21T12:57:25.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 17204 18.34 MB/sec warmup 6 sec latency 19.188 ms 2023-09-21T12:57:25.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:25 smithi156 ceph-mon[134078]: pgmap v38: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:25.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:25 smithi142 ceph-mon[97663]: pgmap v38: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:25 smithi160 ceph-mon[134450]: pgmap v38: 97 pgs: 97 active+clean; 2.3 MiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 103 KiB/s wr, 20 op/s 2023-09-21T12:57:26.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 20232 17.68 MB/sec warmup 7 sec latency 6.713 ms 2023-09-21T12:57:27.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 22820 17.60 MB/sec warmup 8 sec latency 6.590 ms 2023-09-21T12:57:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:27 smithi156 ceph-mon[134078]: pgmap v39: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 786 KiB/s wr, 156 op/s 2023-09-21T12:57:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:27 smithi142 ceph-mon[97663]: pgmap v39: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 786 KiB/s wr, 156 op/s 2023-09-21T12:57:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:27 smithi160 ceph-mon[134450]: pgmap v39: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 786 KiB/s wr, 156 op/s 2023-09-21T12:57:28.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 25626 17.25 MB/sec warmup 9 sec latency 14.091 ms 2023-09-21T12:57:29.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 28849 17.40 MB/sec warmup 10 sec latency 5.939 ms 2023-09-21T12:57:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:29 smithi156 ceph-mon[134078]: pgmap v40: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 786 KiB/s wr, 152 op/s 2023-09-21T12:57:29.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:29 smithi142 ceph-mon[97663]: pgmap v40: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 786 KiB/s wr, 152 op/s 2023-09-21T12:57:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:29 smithi160 ceph-mon[134450]: pgmap v40: 97 pgs: 97 active+clean; 9.1 MiB data, 352 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 786 KiB/s wr, 152 op/s 2023-09-21T12:57:30.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 32111 17.44 MB/sec warmup 11 sec latency 6.603 ms 2023-09-21T12:57:31.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 34893 17.13 MB/sec warmup 12 sec latency 22.962 ms 2023-09-21T12:57:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:31 smithi156 ceph-mon[134078]: pgmap v41: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.4 MiB/s wr, 243 op/s 2023-09-21T12:57:31.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:31 smithi142 ceph-mon[97663]: pgmap v41: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.4 MiB/s wr, 243 op/s 2023-09-21T12:57:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:31 smithi160 ceph-mon[134450]: pgmap v41: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 654 KiB/s rd, 1.4 MiB/s wr, 243 op/s 2023-09-21T12:57:32.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 37031 16.72 MB/sec warmup 13 sec latency 73.286 ms 2023-09-21T12:57:33.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 39927 16.57 MB/sec warmup 14 sec latency 6.558 ms 2023-09-21T12:57:33.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:33 smithi156 ceph-mon[134078]: pgmap v42: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:33.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:33 smithi142 ceph-mon[97663]: pgmap v42: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:33.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:33 smithi160 ceph-mon[134450]: pgmap v42: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:34.668 INFO:tasks.workunit.client.0.smithi142.stdout: 1 43009 16.70 MB/sec warmup 15 sec latency 20.411 ms 2023-09-21T12:57:35.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 46127 16.74 MB/sec warmup 16 sec latency 70.502 ms 2023-09-21T12:57:35.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:35 smithi156 ceph-mon[134078]: pgmap v43: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:35.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:35 smithi142 ceph-mon[97663]: pgmap v43: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:35.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:35 smithi160 ceph-mon[134450]: pgmap v43: 97 pgs: 97 active+clean; 16 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 1.3 MiB/s wr, 229 op/s 2023-09-21T12:57:36.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 48742 16.33 MB/sec warmup 17 sec latency 6.138 ms 2023-09-21T12:57:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 -- 172.21.15.142:0/801328964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc101980 msgr2=0x7f84fc1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 --2- 172.21.15.142:0/801328964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc101980 0x7f84fc1059c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f84f0009990 tx=0x7f84f0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 -- 172.21.15.142:0/801328964 shutdown_connections 2023-09-21T12:57:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 --2- 172.21.15.142:0/801328964 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc100fd0 0x7f84fc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 --2- 172.21.15.142:0/801328964 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc1060f0 0x7f84fc10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 --2- 172.21.15.142:0/801328964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc101980 0x7f84fc1059c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 -- 172.21.15.142:0/801328964 >> 172.21.15.142:0/801328964 conn(0x7f84fc0fc830 msgr2=0x7f84fc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 -- 172.21.15.142:0/801328964 shutdown_connections 2023-09-21T12:57:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.885+0000 7f8500dff700 1 -- 172.21.15.142:0/801328964 wait complete. 2023-09-21T12:57:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.886+0000 7f8500dff700 1 Processor -- start 2023-09-21T12:57:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 -- start start 2023-09-21T12:57:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 0x7f84fc1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 0x7f84fc19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc19e6a0 con 0x7f84fc1060f0 2023-09-21T12:57:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc19e810 con 0x7f84fc19dc20 2023-09-21T12:57:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f8500dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc19e9d0 con 0x7f84fc100fd0 2023-09-21T12:57:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50964/0 (socket says 172.21.15.142:50964) 2023-09-21T12:57:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f84fa59c700 1 -- 172.21.15.142:0/1537112192 learned_addr learned my addr 172.21.15.142:0/1537112192 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f84fad9d700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 0x7f84fc19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.887+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 0x7f84fc1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 -- 172.21.15.142:0/1537112192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 msgr2=0x7f84fc19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 0x7f84fc19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 -- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 msgr2=0x7f84fc1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 0x7f84fc1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 -- 172.21.15.142:0/1537112192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f00095f0 con 0x7f84fc100fd0 2023-09-21T12:57:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 0x7f84fc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fad9d700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 0x7f84fc19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00e9a0 tx=0x7f84ec00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84eb7fe700 1 -- 172.21.15.142:0/1537112192 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec009790 con 0x7f84fc100fd0 2023-09-21T12:57:36.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84eb7fe700 1 -- 172.21.15.142:0/1537112192 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84ec00cbd0 con 0x7f84fc100fd0 2023-09-21T12:57:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f84eb7fe700 1 -- 172.21.15.142:0/1537112192 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec018680 con 0x7f84fc100fd0 2023-09-21T12:57:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc1a5f30 con 0x7f84fc100fd0 2023-09-21T12:57:36.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.888+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc1a6360 con 0x7f84fc100fd0 2023-09-21T12:57:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.892+0000 7f84eb7fe700 1 -- 172.21.15.142:0/1537112192 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f84ec00cd40 con 0x7f84fc100fd0 2023-09-21T12:57:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 Processor -- start 2023-09-21T12:57:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 -- start start 2023-09-21T12:57:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1c0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c4e50 0x55981b1c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b134c40 con 0x55981b1c4e50 2023-09-21T12:57:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f84eb7fe700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 0x7f84e40a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b118c10 con 0x55981b1c09c0 2023-09-21T12:57:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.893+0000 7f8514676b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b116530 con 0x55981b1c00a0 2023-09-21T12:57:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84eb7fe700 1 -- 172.21.15.142:0/1537112192 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f84ec014070 con 0x7f84fc100fd0 2023-09-21T12:57:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60610/0 (socket says 172.21.15.142:60610) 2023-09-21T12:57:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 -- 172.21.15.142:0/4089703614 learned_addr learned my addr 172.21.15.142:0/4089703614 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fad9d700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1c0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fad9d700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c4e50 0x55981b1c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 0x7f84e40a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 -- 172.21.15.142:0/4089703614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 msgr2=0x55981b1c0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1c0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 -- 172.21.15.142:0/4089703614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c4e50 msgr2=0x55981b1c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c4e50 0x55981b1c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 -- 172.21.15.142:0/4089703614 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55981af3cd80 con 0x55981b1c09c0 2023-09-21T12:57:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fad9d700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.894+0000 7f84fa59c700 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec099590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbb0c519d5f8a8f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f84e8ff9700 1 -- 172.21.15.142:0/4089703614 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec099720 con 0x55981b1c09c0 2023-09-21T12:57:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f84e8ff9700 1 -- 172.21.15.142:0/4089703614 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84ec09d550 con 0x55981b1c09c0 2023-09-21T12:57:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f84e8ff9700 1 -- 172.21.15.142:0/4089703614 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec098e30 con 0x55981b1c09c0 2023-09-21T12:57:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f8514676b80 1 -- 172.21.15.142:0/4089703614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 msgr2=0x55981b1c4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 0x7f84e40a2d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84f000b2e0 tx=0x7f84f0005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.895+0000 7f8514676b80 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec099590 comp rx=0 tx=0).stop 2023-09-21T12:57:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 -- 172.21.15.142:0/4089703614 shutdown_connections 2023-09-21T12:57:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c4e50 0x55981b1c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1c0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 --2- 172.21.15.142:0/4089703614 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c09c0 0x55981b1c4910 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 -- 172.21.15.142:0/4089703614 >> 172.21.15.142:0/4089703614 conn(0x55981b0ecfa0 msgr2=0x55981b1bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 -- 172.21.15.142:0/4089703614 shutdown_connections 2023-09-21T12:57:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 -- 172.21.15.142:0/4089703614 wait complete. 2023-09-21T12:57:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.896+0000 7f8514676b80 1 -- start start 2023-09-21T12:57:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 Processor -- start 2023-09-21T12:57:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 0x55981b1c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b111e20 con 0x55981b1c09c0 2023-09-21T12:57:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b0ae6e0 con 0x55981b1c00a0 2023-09-21T12:57:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b0ae380 con 0x55981b1c4e50 2023-09-21T12:57:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f8514676b80 10 client.0 _ll_register_callbacks cb 0x55981aff8a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.897+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 0x55981b1c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60614/0 (socket says 172.21.15.142:60614) 2023-09-21T12:57:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 -- 172.21.15.142:0/1346479257 learned_addr learned my addr 172.21.15.142:0/1346479257 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 -- 172.21.15.142:0/1346479257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 msgr2=0x55981b1c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 0x55981b1c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 -- 172.21.15.142:0/1346479257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 msgr2=0x55981b1c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 -- 172.21.15.142:0/1346479257 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc1a6360 con 0x55981b1c00a0 2023-09-21T12:57:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fad9d700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 0x55981b1c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84fa59c700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f84ec096190 tx=0x7f84ec099c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d949f9c0aa33642a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0a1790 con 0x55981b1c00a0 2023-09-21T12:57:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55981b082b50 con 0x55981b1c00a0 2023-09-21T12:57:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.898+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f84ec099720 con 0x55981b1c00a0 2023-09-21T12:57:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84ec0a1510 con 0x55981b1c00a0 2023-09-21T12:57:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 10 client.25739 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55981af25c00 con 0x55981b1c00a0 2023-09-21T12:57:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55981b082b50 con 0x55981b1c00a0 2023-09-21T12:57:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84ec0b1d20 con 0x55981b1c00a0 2023-09-21T12:57:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 10 client.25739 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 10 client.25739 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 20 client.25739 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b1d9c80 0x55981b1dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 4 client.25739 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.899+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55981b18efc0 con 0x55981b1d9c80 2023-09-21T12:57:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.900+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b1d9c80 0x55981b1dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.900+0000 7f84e1ffb700 10 client.25739 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.900+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b1d9c80 0x55981b1dc0a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765e4e33f948f8b1 server_cookie=1bb6a91bfb56942c in_seq=0 out_seq=0 2023-09-21T12:57:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f84e1ffb700 1 -- 172.21.15.142:0/1346479257 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55981b18efc0 con 0x55981b1d9c80 2023-09-21T12:57:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f84e1ffb700 10 client.25739 handle_command_reply: tid=0 2023-09-21T12:57:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 client.25739 shutdown 2023-09-21T12:57:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 msgr2=0x55981b1cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f84ec096190 tx=0x7f84ec099c30 comp rx=0 tx=0).stop 2023-09-21T12:57:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 shutdown_connections 2023-09-21T12:57:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b1d9c80 0x55981b1dc0a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c4e50 0x55981b1c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c00a0 0x55981b1cc6a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 --2- 172.21.15.142:0/1346479257 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f84e1ffb700 0 client.25739 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 >> 172.21.15.142:0/1346479257 conn(0x55981b0ecfa0 msgr2=0x55981b1bacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 shutdown_connections 2023-09-21T12:57:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 1 -- 172.21.15.142:0/1346479257 wait complete. 2023-09-21T12:57:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.903+0000 7f8514676b80 20 client.25739 trim_cache size 0 max 16384 2023-09-21T12:57:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 Processor -- start 2023-09-21T12:57:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 -- start start 2023-09-21T12:57:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981af928c0 con 0x55981b1c09c0 2023-09-21T12:57:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b082b80 con 0x55981b1c4e50 2023-09-21T12:57:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f8514676b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b1cae90 con 0x55981b1c00a0 2023-09-21T12:57:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f84f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f84fad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.918+0000 7f84f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48130/0 (socket says 172.21.15.142:48130) 2023-09-21T12:57:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 -- 172.21.15.142:0/506676087 learned_addr learned my addr 172.21.15.142:0/506676087 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84fa59c700 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 -- 172.21.15.142:0/506676087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 msgr2=0x55981b1cc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1cc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 -- 172.21.15.142:0/506676087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 msgr2=0x55981b1c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 -- 172.21.15.142:0/506676087 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55981b1e0c90 con 0x55981b1c09c0 2023-09-21T12:57:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84fad9d700 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f84f0005b40 tx=0x7f84f001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186d2f14eea7b5c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84e97fa700 1 -- 172.21.15.142:0/506676087 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f002b040 con 0x55981b1c09c0 2023-09-21T12:57:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84e97fa700 1 -- 172.21.15.142:0/506676087 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84f002c040 con 0x55981b1c09c0 2023-09-21T12:57:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.919+0000 7f84e97fa700 1 -- 172.21.15.142:0/506676087 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f0004620 con 0x55981b1c09c0 2023-09-21T12:57:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- 172.21.15.142:0/506676087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 msgr2=0x55981b1c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f84f0005b40 tx=0x7f84f001f000 comp rx=0 tx=0).stop 2023-09-21T12:57:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- 172.21.15.142:0/506676087 shutdown_connections 2023-09-21T12:57:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1cc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 --2- 172.21.15.142:0/506676087 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1c9150 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- 172.21.15.142:0/506676087 >> 172.21.15.142:0/506676087 conn(0x55981b0ecfa0 msgr2=0x55981b1c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- 172.21.15.142:0/506676087 shutdown_connections 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- 172.21.15.142:0/506676087 wait complete. 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.920+0000 7f8514676b80 1 -- start start 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 Processor -- start 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b1cf590 con 0x55981b1c09c0 2023-09-21T12:57:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b1cf700 con 0x55981b1c4e50 2023-09-21T12:57:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981b1cf8c0 con 0x55981b1c00a0 2023-09-21T12:57:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f8514676b80 10 client.0 _ll_register_callbacks cb 0x55981aff8a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f84f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f84fa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50996/0 (socket says 172.21.15.142:50996) 2023-09-21T12:57:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f84fa59c700 1 -- 172.21.15.142:0/146594605 learned_addr learned my addr 172.21.15.142:0/146594605 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.921+0000 7f84fad9d700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 -- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 msgr2=0x55981b1cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 -- 172.21.15.142:0/146594605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 msgr2=0x55981b1d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 -- 172.21.15.142:0/146594605 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f4003a00 con 0x55981b1c00a0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84fa59c700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec00c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0928aea67749789 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ec0842b0 con 0x55981b1c00a0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f84ec09d550 con 0x55981b1c00a0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f84ec0b1020 con 0x55981b1c00a0 2023-09-21T12:57:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84ec09d160 con 0x55981b1c00a0 2023-09-21T12:57:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f8514676b80 10 client.25702 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f84fc10e4e0 con 0x55981b1c00a0 2023-09-21T12:57:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.922+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f84ec07c080 con 0x55981b1c00a0 2023-09-21T12:57:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f84ec090640 con 0x55981b1c00a0 2023-09-21T12:57:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 10 client.25702 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 10 client.25702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 20 client.25702 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b22e770 0x55981b230b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 4 client.25702 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:57:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55981b10ae00 con 0x55981b22e770 2023-09-21T12:57:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b22e770 0x55981b230b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f84e1ffb700 10 client.25702 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:36.923+0000 7f84f9d9b700 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b22e770 0x55981b230b60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bacd09b06b3ceb52 server_cookie=9fc4c28b5e700e40 in_seq=0 out_seq=0 2023-09-21T12:57:37.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.484+0000 7f84e1ffb700 1 -- 172.21.15.142:0/146594605 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55981b10ae00 con 0x55981b22e770 2023-09-21T12:57:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.484+0000 7f84e1ffb700 10 client.25702 handle_command_reply: tid=0 2023-09-21T12:57:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.484+0000 7f8514676b80 1 client.25702 shutdown 2023-09-21T12:57:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.484+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 msgr2=0x55981b1d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:37.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00c5b0 tx=0x7f84ec00c6e0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 shutdown_connections 2023-09-21T12:57:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55981b22e770 0x55981b230b60 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55981b1c4e50 0x55981b1cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55981b1c00a0 0x55981b1d0990 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f84e1ffb700 0 client.25702 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 --2- 172.21.15.142:0/146594605 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55981b1c09c0 0x55981b1d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 >> 172.21.15.142:0/146594605 conn(0x55981b0ecfa0 msgr2=0x55981b1c7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 shutdown_connections 2023-09-21T12:57:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 1 -- 172.21.15.142:0/146594605 wait complete. 2023-09-21T12:57:37.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.485+0000 7f8514676b80 20 client.25702 trim_cache size 0 max 16384 2023-09-21T12:57:37.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:57:37.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:57:37.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:57:37.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:57:37.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 msgr2=0x7f84e40a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:37.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 0x7f84e40a2d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84f000b2e0 tx=0x7f84f0005fd0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 msgr2=0x7f84fc199070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:37.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f84ec00e9a0 tx=0x7f84ec00ecb0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 shutdown_connections 2023-09-21T12:57:37.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f84e40a08d0 0x7f84e40a2d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f84fc19dc20 0x7f84fc19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f84fc100fd0 0x7f84fc199070 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 --2- 172.21.15.142:0/1537112192 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f84fc1060f0 0x7f84fc1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 >> 172.21.15.142:0/1537112192 conn(0x7f84fc0fc830 msgr2=0x7f84fc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:37.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 shutdown_connections 2023-09-21T12:57:37.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:37.486+0000 7f8500dff700 1 -- 172.21.15.142:0/1537112192 wait complete. 2023-09-21T12:57:37.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 49960 16.02 MB/sec warmup 18 sec latency 319.768 ms 2023-09-21T12:57:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:37 smithi156 ceph-mon[134078]: pgmap v44: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 2.0 MiB/s wr, 316 op/s 2023-09-21T12:57:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:37 smithi142 ceph-mon[97663]: pgmap v44: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 2.0 MiB/s wr, 316 op/s 2023-09-21T12:57:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:37 smithi160 ceph-mon[134450]: pgmap v44: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 2.0 MiB/s wr, 316 op/s 2023-09-21T12:57:38.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 53030 15.95 MB/sec warmup 19 sec latency 6.162 ms 2023-09-21T12:57:39.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 55715 15.78 MB/sec warmup 20 sec latency 6.284 ms 2023-09-21T12:57:39.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:39 smithi156 ceph-mon[134078]: pgmap v45: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-09-21T12:57:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:39 smithi142 ceph-mon[97663]: pgmap v45: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-09-21T12:57:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:39 smithi160 ceph-mon[134450]: pgmap v45: 97 pgs: 97 active+clean; 23 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 672 KiB/s rd, 1.3 MiB/s wr, 180 op/s 2023-09-21T12:57:40.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 58182 15.81 MB/sec warmup 21 sec latency 17.087 ms 2023-09-21T12:57:41.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 61017 15.74 MB/sec warmup 22 sec latency 6.936 ms 2023-09-21T12:57:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:41 smithi156 ceph-mon[134078]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 402 op/s 2023-09-21T12:57:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:41 smithi142 ceph-mon[97663]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 402 op/s 2023-09-21T12:57:41.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:41 smithi160 ceph-mon[134450]: pgmap v46: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.1 MiB/s wr, 402 op/s 2023-09-21T12:57:42.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 63982 15.82 MB/sec warmup 23 sec latency 85.632 ms 2023-09-21T12:57:43.363 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:57:43.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 -- 172.21.15.142:0/3949263022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f01060e0 msgr2=0x7f42f010dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 --2- 172.21.15.142:0/3949263022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f01060e0 0x7f42f010dc60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009f90 tx=0x7f42e800b330 comp rx=0 tx=0).stop 2023-09-21T12:57:43.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 -- 172.21.15.142:0/3949263022 shutdown_connections 2023-09-21T12:57:43.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 --2- 172.21.15.142:0/3949263022 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f01060e0 0x7f42f010dc60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 --2- 172.21.15.142:0/3949263022 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f0100fc0 0x7f42f01013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 --2- 172.21.15.142:0/3949263022 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0101970 0x7f42f01059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 -- 172.21.15.142:0/3949263022 >> 172.21.15.142:0/3949263022 conn(0x7f42f00fc840 msgr2=0x7f42f00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 -- 172.21.15.142:0/3949263022 shutdown_connections 2023-09-21T12:57:43.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.581+0000 7f42f57ff700 1 -- 172.21.15.142:0/3949263022 wait complete. 2023-09-21T12:57:43.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.583+0000 7f42f57ff700 1 Processor -- start 2023-09-21T12:57:43.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.583+0000 7f42f57ff700 1 -- start start 2023-09-21T12:57:43.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.583+0000 7f42f57ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.583+0000 7f42f57ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 0x7f42f0073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42f57ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 0x7f42f01a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42f57ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01a5600 con 0x7f42f0073b60 2023-09-21T12:57:43.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42f57ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01a5770 con 0x7f42f0100fc0 2023-09-21T12:57:43.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42f57ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f01a5930 con 0x7f42f01060e0 2023-09-21T12:57:43.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60660/0 (socket says 172.21.15.142:60660) 2023-09-21T12:57:43.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 -- 172.21.15.142:0/1681129620 learned_addr learned my addr 172.21.15.142:0/1681129620 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 0x7f42f0073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 0x7f42f01a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 -- 172.21.15.142:0/1681129620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 msgr2=0x7f42f0073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 0x7f42f0073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 -- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 msgr2=0x7f42f01a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 0x7f42f01a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 -- 172.21.15.142:0/1681129620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009c40 con 0x7f42f0100fc0 2023-09-21T12:57:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 0x7f42f01a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 0x7f42f0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.584+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e9a0 tx=0x7f42e000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.585+0000 7f42d7fff700 1 -- 172.21.15.142:0/1681129620 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e000eee0 con 0x7f42f0100fc0 2023-09-21T12:57:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.585+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f01a5c10 con 0x7f42f0100fc0 2023-09-21T12:57:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.585+0000 7f42d7fff700 1 -- 172.21.15.142:0/1681129620 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e000cbd0 con 0x7f42f0100fc0 2023-09-21T12:57:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.585+0000 7f42d7fff700 1 -- 172.21.15.142:0/1681129620 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0009790 con 0x7f42f0100fc0 2023-09-21T12:57:43.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.585+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f01a6170 con 0x7f42f0100fc0 2023-09-21T12:57:43.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.589+0000 7f42d7fff700 1 -- 172.21.15.142:0/1681129620 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f42e000cd40 con 0x7f42f0100fc0 2023-09-21T12:57:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 Processor -- start 2023-09-21T12:57:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 -- start start 2023-09-21T12:57:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f007e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252ef77ca0 con 0x56252f003610 2023-09-21T12:57:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252ef5bc70 con 0x56252f008360 2023-09-21T12:57:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.590+0000 7f430904ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252ef59590 con 0x56252f003f30 2023-09-21T12:57:43.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f007e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60668/0 (socket says 172.21.15.142:60668) 2023-09-21T12:57:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 -- 172.21.15.142:0/4175890706 learned_addr learned my addr 172.21.15.142:0/4175890706 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42d7fff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 0x7f42d80a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 -- 172.21.15.142:0/4175890706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 msgr2=0x56252f007e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f007e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 -- 172.21.15.142:0/4175890706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 msgr2=0x56252f0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 -- 172.21.15.142:0/4175890706 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56252ed7fde0 con 0x56252f008360 2023-09-21T12:57:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42d7fff700 1 -- 172.21.15.142:0/1681129620 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42e0014070 con 0x7f42f0100fc0 2023-09-21T12:57:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f42e40114f0 tx=0x7f42e4011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42fb683203010d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 0x7f42d80a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.591+0000 7f42d57fa700 1 -- 172.21.15.142:0/4175890706 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4004230 con 0x56252f008360 2023-09-21T12:57:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f42d57fa700 1 -- 172.21.15.142:0/4175890706 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e4004390 con 0x56252f008360 2023-09-21T12:57:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f42d57fa700 1 -- 172.21.15.142:0/4175890706 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e400e8b0 con 0x56252f008360 2023-09-21T12:57:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f430904ab80 1 -- 172.21.15.142:0/4175890706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 msgr2=0x56252f0087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 0x7f42d80a2d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009c10 tx=0x7f42e8009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f430904ab80 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f42e40114f0 tx=0x7f42e4011800 comp rx=0 tx=0).stop 2023-09-21T12:57:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.592+0000 7f430904ab80 1 -- 172.21.15.142:0/4175890706 shutdown_connections 2023-09-21T12:57:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f0087c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 --2- 172.21.15.142:0/4175890706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f007e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 -- 172.21.15.142:0/4175890706 >> 172.21.15.142:0/4175890706 conn(0x56252ef30000 msgr2=0x56252effe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 -- 172.21.15.142:0/4175890706 shutdown_connections 2023-09-21T12:57:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 -- 172.21.15.142:0/4175890706 wait complete. 2023-09-21T12:57:43.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 -- start start 2023-09-21T12:57:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.593+0000 7f430904ab80 1 Processor -- start 2023-09-21T12:57:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003f30 0x56252f00cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252ef54e80 con 0x56252f003f30 2023-09-21T12:57:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252eef1740 con 0x56252f008360 2023-09-21T12:57:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252eef13e0 con 0x56252f003610 2023-09-21T12:57:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f430904ab80 10 client.0 _ll_register_callbacks cb 0x56252ee3ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:43.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f42eeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:51046/0 (socket says 172.21.15.142:51046) 2023-09-21T12:57:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003f30 0x56252f00cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f42eeffd700 1 -- 172.21.15.142:0/721454615 learned_addr learned my addr 172.21.15.142:0/721454615 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.594+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 -- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 msgr2=0x56252f00d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 -- 172.21.15.142:0/721454615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003f30 msgr2=0x56252f00cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003f30 0x56252f00cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 -- 172.21.15.142:0/721454615 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e4009cd0 con 0x56252f003610 2023-09-21T12:57:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42eeffd700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42e0095c20 tx=0x7f42e0098ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2500ca3119b22e6b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e0099260 con 0x56252f003610 2023-09-21T12:57:43.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42e0099e20 con 0x56252f003610 2023-09-21T12:57:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56252eec5bb0 con 0x56252f003610 2023-09-21T12:57:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e0099080 con 0x56252f003610 2023-09-21T12:57:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f430904ab80 10 client.25714 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:43.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.595+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56252ed68c60 con 0x56252f003610 2023-09-21T12:57:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56252eec5bb0 con 0x56252f003610 2023-09-21T12:57:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42e00b1d20 con 0x56252f003610 2023-09-21T12:57:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 10 client.25714 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 10 client.25714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:43.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 20 client.25714 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f01d530 0x56252f01f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 4 client.25714 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56252efd2020 con 0x56252f01d530 2023-09-21T12:57:43.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.596+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f01d530 0x56252f01f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.597+0000 7f42d2ff5700 10 client.25714 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.597+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f01d530 0x56252f01f920 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b23b0887bcc9ec server_cookie=8d72d42c25c6355a in_seq=0 out_seq=0 2023-09-21T12:57:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f42d2ff5700 1 -- 172.21.15.142:0/721454615 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56252efd2020 con 0x56252f01d530 2023-09-21T12:57:43.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f42d2ff5700 10 client.25714 handle_command_reply: tid=0 2023-09-21T12:57:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 client.25714 shutdown 2023-09-21T12:57:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 msgr2=0x56252f00fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f42e0095c20 tx=0x7f42e0098ef0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 shutdown_connections 2023-09-21T12:57:43.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f01d530 0x56252f01f920 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00fbb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f42d2ff5700 0 client.25714 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:43.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 --2- 172.21.15.142:0/721454615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003f30 0x56252f00cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 >> 172.21.15.142:0/721454615 conn(0x56252ef30000 msgr2=0x56252effe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 shutdown_connections 2023-09-21T12:57:43.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 1 -- 172.21.15.142:0/721454615 wait complete. 2023-09-21T12:57:43.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.598+0000 7f430904ab80 20 client.25714 trim_cache size 0 max 16384 2023-09-21T12:57:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 Processor -- start 2023-09-21T12:57:43.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 -- start start 2023-09-21T12:57:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f008360 0x56252f009750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252edd5920 con 0x56252f008360 2023-09-21T12:57:43.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f014ad0 con 0x56252f003f30 2023-09-21T12:57:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.616+0000 7f430904ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f006d00 con 0x56252f003610 2023-09-21T12:57:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60690/0 (socket says 172.21.15.142:60690) 2023-09-21T12:57:43.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 -- 172.21.15.142:0/654892348 learned_addr learned my addr 172.21.15.142:0/654892348 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42eeffd700 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f008360 0x56252f009750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 -- 172.21.15.142:0/654892348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 msgr2=0x56252f00cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 -- 172.21.15.142:0/654892348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f008360 msgr2=0x56252f009750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f008360 0x56252f009750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 -- 172.21.15.142:0/654892348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56252f024590 con 0x56252f003f30 2023-09-21T12:57:43.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e4000c00 tx=0x7f42e4009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37d15f04465e2db server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42d5ffb700 1 -- 172.21.15.142:0/654892348 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4029070 con 0x56252f003f30 2023-09-21T12:57:43.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42d5ffb700 1 -- 172.21.15.142:0/654892348 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e40041a0 con 0x56252f003f30 2023-09-21T12:57:43.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.617+0000 7f42d5ffb700 1 -- 172.21.15.142:0/654892348 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4003d60 con 0x56252f003f30 2023-09-21T12:57:43.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 -- 172.21.15.142:0/654892348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 msgr2=0x56252f0144e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f42e4000c00 tx=0x7f42e4009310 comp rx=0 tx=0).stop 2023-09-21T12:57:43.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 -- 172.21.15.142:0/654892348 shutdown_connections 2023-09-21T12:57:43.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f008360 0x56252f009750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003610 0x56252f00cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 --2- 172.21.15.142:0/654892348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f003f30 0x56252f0144e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 -- 172.21.15.142:0/654892348 >> 172.21.15.142:0/654892348 conn(0x56252ef30000 msgr2=0x56252f00c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 -- 172.21.15.142:0/654892348 shutdown_connections 2023-09-21T12:57:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.618+0000 7f430904ab80 1 -- 172.21.15.142:0/654892348 wait complete. 2023-09-21T12:57:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 -- start start 2023-09-21T12:57:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 Processor -- start 2023-09-21T12:57:43.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f00b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f00bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f014880 con 0x56252f003610 2023-09-21T12:57:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f071370 con 0x56252f008360 2023-09-21T12:57:43.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f0714b0 con 0x56252f003f30 2023-09-21T12:57:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.619+0000 7f430904ab80 10 client.0 _ll_register_callbacks cb 0x56252ee3ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f00bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ef7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60698/0 (socket says 172.21.15.142:60698) 2023-09-21T12:57:43.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ef7fe700 1 -- 172.21.15.142:0/1494971117 learned_addr learned my addr 172.21.15.142:0/1494971117 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f00b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 -- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 msgr2=0x56252f00c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 -- 172.21.15.142:0/1494971117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 msgr2=0x56252f00b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:43.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f00b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 -- 172.21.15.142:0/1494971117 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56252ed7fde0 con 0x56252f003f30 2023-09-21T12:57:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ef7fe700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f00b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42ee7fc700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f00bcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x56252eff62c0 tx=0x7f42e4003710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dfcc248e27cdab2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.620+0000 7f42d2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4029040 con 0x56252f003f30 2023-09-21T12:57:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42e4004390 con 0x56252f003f30 2023-09-21T12:57:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42e4005040 con 0x56252f003f30 2023-09-21T12:57:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42e4005200 con 0x56252f003f30 2023-09-21T12:57:43.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 10 client.25720 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56252eda6250 con 0x56252f003f30 2023-09-21T12:57:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42e4004390 con 0x56252f003f30 2023-09-21T12:57:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42e4034070 con 0x56252f003f30 2023-09-21T12:57:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 10 client.25720 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:43.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 10 client.25720 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:43.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 20 client.25720 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:43.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f0729e0 0x56252f074dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 4 client.25720 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:57:43.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.621+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56252ef4de60 con 0x56252f0729e0 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.622+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f0729e0 0x56252f074dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.622+0000 7f42eeffd700 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f0729e0 0x56252f074dd0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ecee17fe53c62a server_cookie=75bb5e91e98fcd36 in_seq=0 out_seq=0 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.622+0000 7f42d2ff5700 10 client.25720 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f42d2ff5700 1 -- 172.21.15.142:0/1494971117 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56252ef4de60 con 0x56252f0729e0 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f42d2ff5700 10 client.25720 handle_command_reply: tid=0 2023-09-21T12:57:43.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 client.25720 shutdown 2023-09-21T12:57:43.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 msgr2=0x56252f00bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f00bcd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x56252eff62c0 tx=0x7f42e4003710 comp rx=0 tx=0).stop 2023-09-21T12:57:43.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 shutdown_connections 2023-09-21T12:57:43.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56252f0729e0 0x56252f074dd0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f42d2ff5700 0 client.25720 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:43.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56252f003610 0x56252f00b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56252f008360 0x56252f00c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 --2- 172.21.15.142:0/1494971117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56252f003f30 0x56252f00bcd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 >> 172.21.15.142:0/1494971117 conn(0x56252ef30000 msgr2=0x56252f007c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 shutdown_connections 2023-09-21T12:57:43.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 1 -- 172.21.15.142:0/1494971117 wait complete. 2023-09-21T12:57:43.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.624+0000 7f430904ab80 20 client.25720 trim_cache size 0 max 16384 2023-09-21T12:57:43.643 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:43.643 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:57:43.643 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:57:43.643 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 msgr2=0x7f42d80a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 0x7f42d80a2d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009c10 tx=0x7f42e8009920 comp rx=0 tx=0).stop 2023-09-21T12:57:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 msgr2=0x7f42f00730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f42e000e9a0 tx=0x7f42e000ed60 comp rx=0 tx=0).stop 2023-09-21T12:57:43.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 shutdown_connections 2023-09-21T12:57:43.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42d80a08d0 0x7f42d80a2d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f42f0073b60 0x7f42f01a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42f0100fc0 0x7f42f00730e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 --2- 172.21.15.142:0/1681129620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42f01060e0 0x7f42f0073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 >> 172.21.15.142:0/1681129620 conn(0x7f42f00fc840 msgr2=0x7f42f00fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 shutdown_connections 2023-09-21T12:57:43.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.625+0000 7f42f57ff700 1 -- 172.21.15.142:0/1681129620 wait complete. 2023-09-21T12:57:43.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:57:43.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:57:43.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 66761 15.71 MB/sec warmup 24 sec latency 10.207 ms 2023-09-21T12:57:43.712 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:43 smithi142 ceph-mon[97663]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2023-09-21T12:57:43.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 -- 172.21.15.142:0/2725440147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec941060f0 msgr2=0x7fec9410dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 --2- 172.21.15.142:0/2725440147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec941060f0 0x7fec9410dc70 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b0a0 tx=0x7fec8c00b3b0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 -- 172.21.15.142:0/2725440147 shutdown_connections 2023-09-21T12:57:43.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 --2- 172.21.15.142:0/2725440147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec941060f0 0x7fec9410dc70 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 --2- 172.21.15.142:0/2725440147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec941013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 --2- 172.21.15.142:0/2725440147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec94101980 0x7fec941059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 -- 172.21.15.142:0/2725440147 >> 172.21.15.142:0/2725440147 conn(0x7fec940fc890 msgr2=0x7fec940fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:43.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 -- 172.21.15.142:0/2725440147 shutdown_connections 2023-09-21T12:57:43.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.860+0000 7fec997ff700 1 -- 172.21.15.142:0/2725440147 wait complete. 2023-09-21T12:57:43.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 Processor -- start 2023-09-21T12:57:43.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 -- start start 2023-09-21T12:57:43.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec940730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 0x7fec94073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 0x7fec941a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941a5800 con 0x7fec94073b60 2023-09-21T12:57:43.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941a5970 con 0x7fec941060f0 2023-09-21T12:57:43.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.861+0000 7fec997ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec941a5b30 con 0x7fec94100fd0 2023-09-21T12:57:43.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 0x7fec941a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec92ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec940730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 0x7fec94073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec937fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 0x7fec941a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58732/0 (socket says 172.21.15.142:58732) 2023-09-21T12:57:43.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec937fe700 1 -- 172.21.15.142:0/1683352100 learned_addr learned my addr 172.21.15.142:0/1683352100 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:43.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 -- 172.21.15.142:0/1683352100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 msgr2=0x7fec940730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec940730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 -- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 msgr2=0x7fec941a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:43.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 0x7fec941a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:43.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 -- 172.21.15.142:0/1683352100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88009520 con 0x7fec941060f0 2023-09-21T12:57:43.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec92ffd700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec940730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:43.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.862+0000 7fec927fc700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 0x7fec94073620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec8800e9c0 tx=0x7fec8800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.863+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800cb70 con 0x7fec941060f0 2023-09-21T12:57:43.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.863+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c009d00 con 0x7fec941060f0 2023-09-21T12:57:43.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.863+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fec8800ee60 con 0x7fec941060f0 2023-09-21T12:57:43.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.863+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88003c60 con 0x7fec941060f0 2023-09-21T12:57:43.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.863+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec941a6190 con 0x7fec941060f0 2023-09-21T12:57:43.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.864+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94067bd0 con 0x7fec941060f0 2023-09-21T12:57:43.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.866+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fec88005030 con 0x7fec941060f0 2023-09-21T12:57:43.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.868+0000 7fec7bfff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 0x7fec7c0a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:43.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.868+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fec88014070 con 0x7fec941060f0 2023-09-21T12:57:43.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.868+0000 7fec92ffd700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 0x7fec7c0a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:43.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.868+0000 7fec92ffd700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 0x7fec7c0a2de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec84011490 tx=0x7fec84009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:43.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:43.870+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fec88095e50 con 0x7fec941060f0 2023-09-21T12:57:43.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:43 smithi156 ceph-mon[134078]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2023-09-21T12:57:43.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:43 smithi160 ceph-mon[134450]: pgmap v47: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 707 KiB/s rd, 1.4 MiB/s wr, 312 op/s 2023-09-21T12:57:44.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.142+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec94101bd0 con 0x7fec941060f0 2023-09-21T12:57:44.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.143+0000 7fec7bfff700 1 -- 172.21.15.142:0/1683352100 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+11332 (secure 0 0 0) 0x7fec94101bd0 con 0x7fec941060f0 2023-09-21T12:57:44.143 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:57:44.144 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:54:17.432339+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:57:44.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 msgr2=0x7fec7c0a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 0x7fec7c0a2de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fec84011490 tx=0x7fec84009260 comp rx=0 tx=0).stop 2023-09-21T12:57:44.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 msgr2=0x7fec94073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 0x7fec94073620 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fec8800e9c0 tx=0x7fec8800ecd0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 shutdown_connections 2023-09-21T12:57:44.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fec7c0a0920 0x7fec7c0a2de0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fec94073b60 0x7fec941a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec94100fd0 0x7fec940730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 --2- 172.21.15.142:0/1683352100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fec941060f0 0x7fec94073620 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 >> 172.21.15.142:0/1683352100 conn(0x7fec940fc890 msgr2=0x7fec940fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 shutdown_connections 2023-09-21T12:57:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.145+0000 7fec997ff700 1 -- 172.21.15.142:0/1683352100 wait complete. 2023-09-21T12:57:44.151 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 23 2023-09-21T12:57:44.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:57:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 -- 172.21.15.142:0/2663246260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74101970 msgr2=0x7fce741059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 --2- 172.21.15.142:0/2663246260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74101970 0x7fce741059b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fce68009990 tx=0x7fce68009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 -- 172.21.15.142:0/2663246260 shutdown_connections 2023-09-21T12:57:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 --2- 172.21.15.142:0/2663246260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce741060e0 0x7fce7410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 --2- 172.21.15.142:0/2663246260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce74100fc0 0x7fce741013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 --2- 172.21.15.142:0/2663246260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74101970 0x7fce741059b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 -- 172.21.15.142:0/2663246260 >> 172.21.15.142:0/2663246260 conn(0x7fce740fc840 msgr2=0x7fce740fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 -- 172.21.15.142:0/2663246260 shutdown_connections 2023-09-21T12:57:44.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.422+0000 7fce793ff700 1 -- 172.21.15.142:0/2663246260 wait complete. 2023-09-21T12:57:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.423+0000 7fce793ff700 1 Processor -- start 2023-09-21T12:57:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.423+0000 7fce793ff700 1 -- start start 2023-09-21T12:57:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74100fc0 0x7fce74196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 0x7fce7419bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7419c2b0 con 0x7fce74100fc0 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7419c420 con 0x7fce7419b830 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce793ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce7419c5e0 con 0x7fce741060e0 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49138/0 (socket says 172.21.15.142:49138) 2023-09-21T12:57:44.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 0x7fce7419bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 -- 172.21.15.142:0/81469960 learned_addr learned my addr 172.21.15.142:0/81469960 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce72ffd700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74100fc0 0x7fce74196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 -- 172.21.15.142:0/81469960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 msgr2=0x7fce7419bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 0x7fce7419bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 -- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74100fc0 msgr2=0x7fce74196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74100fc0 0x7fce74196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce727fc700 1 -- 172.21.15.142:0/81469960 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce680095f0 con 0x7fce741060e0 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.424+0000 7fce737fe700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 0x7fce7419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce727fc700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce680059d0 tx=0x7fce68005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce5bfff700 1 -- 172.21.15.142:0/81469960 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6801d070 con 0x7fce741060e0 2023-09-21T12:57:44.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce741a3ae0 con 0x7fce741060e0 2023-09-21T12:57:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce5bfff700 1 -- 172.21.15.142:0/81469960 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce68022470 con 0x7fce741060e0 2023-09-21T12:57:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce5bfff700 1 -- 172.21.15.142:0/81469960 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68017650 con 0x7fce741060e0 2023-09-21T12:57:44.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.425+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741a3f00 con 0x7fce741060e0 2023-09-21T12:57:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.429+0000 7fce5bfff700 1 -- 172.21.15.142:0/81469960 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fce680225e0 con 0x7fce741060e0 2023-09-21T12:57:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.430+0000 7fce8cd42b80 1 Processor -- start 2023-09-21T12:57:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.430+0000 7fce8cd42b80 1 -- start start 2023-09-21T12:57:44.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce5bfff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 0x7fce5c0a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce5bfff700 1 -- 172.21.15.142:0/81469960 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fce680cd530 con 0x7fce741060e0 2023-09-21T12:57:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 0x55a14a04ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a04d360 0x55a14a04d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149fbcca0 con 0x55a14a048610 2023-09-21T12:57:44.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149fa0c70 con 0x55a14a048f30 2023-09-21T12:57:44.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149f9e590 con 0x55a14a04d360 2023-09-21T12:57:44.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce737fe700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 0x7fce5c0a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a04d360 0x55a14a04d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58766/0 (socket says 172.21.15.142:58766) 2023-09-21T12:57:44.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce72ffd700 1 -- 172.21.15.142:0/1234656701 learned_addr learned my addr 172.21.15.142:0/1234656701 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.431+0000 7fce727fc700 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 0x55a14a04ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 -- 172.21.15.142:0/1234656701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a04d360 msgr2=0x55a14a04d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a04d360 0x55a14a04d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 -- 172.21.15.142:0/1234656701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 msgr2=0x55a14a04ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 0x55a14a04ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 -- 172.21.15.142:0/1234656701 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a149dc4de0 con 0x55a14a048610 2023-09-21T12:57:44.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce727fc700 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 0x55a14a04ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:44.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce737fe700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 0x7fce5c0a2d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009fd0 tx=0x7fce6c009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce64009d00 tx=0x7fce64011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890cff0c44473597 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce597fa700 1 -- 172.21.15.142:0/1234656701 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64004230 con 0x55a14a048610 2023-09-21T12:57:44.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce597fa700 1 -- 172.21.15.142:0/1234656701 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce64009e50 con 0x55a14a048610 2023-09-21T12:57:44.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.432+0000 7fce597fa700 1 -- 172.21.15.142:0/1234656701 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce640197a0 con 0x55a14a048610 2023-09-21T12:57:44.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1234656701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 msgr2=0x55a14a0489f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fce64009d00 tx=0x7fce64011720 comp rx=0 tx=0).stop 2023-09-21T12:57:44.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1234656701 shutdown_connections 2023-09-21T12:57:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a0489f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a04d360 0x55a14a04d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1234656701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a048f30 0x55a14a04ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1234656701 >> 172.21.15.142:0/1234656701 conn(0x55a149f75000 msgr2=0x55a14a0436a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1234656701 shutdown_connections 2023-09-21T12:57:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.433+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1234656701 wait complete. 2023-09-21T12:57:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 -- start start 2023-09-21T12:57:44.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 Processor -- start 2023-09-21T12:57:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048f30 0x55a14a051d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a052390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149f99e80 con 0x55a14a048f30 2023-09-21T12:57:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149f36740 con 0x55a14a04d360 2023-09-21T12:57:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.434+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149f363e0 con 0x55a14a048610 2023-09-21T12:57:44.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce8cd42b80 10 client.0 _ll_register_callbacks cb 0x55a149e80a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49154/0 (socket says 172.21.15.142:49154) 2023-09-21T12:57:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 -- 172.21.15.142:0/1897845152 learned_addr learned my addr 172.21.15.142:0/1897845152 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce737fe700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a052390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce727fc700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048f30 0x55a14a051d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 -- 172.21.15.142:0/1897845152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 msgr2=0x55a14a052390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a052390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 -- 172.21.15.142:0/1897845152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048f30 msgr2=0x55a14a051d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048f30 0x55a14a051d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 -- 172.21.15.142:0/1897845152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce741a3f00 con 0x55a14a048610 2023-09-21T12:57:44.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce72ffd700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce64005950 tx=0x7fce64004220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76ca8063f6700c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.435+0000 7fce56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:44.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64005240 con 0x55a14a048610 2023-09-21T12:57:44.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a149f0abb0 con 0x55a14a048610 2023-09-21T12:57:44.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fce64003ad0 con 0x55a14a048610 2023-09-21T12:57:44.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce64003dd0 con 0x55a14a048610 2023-09-21T12:57:44.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 10 client.25738 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:44.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fce640099e0 con 0x55a14a048610 2023-09-21T12:57:44.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a149f0abb0 con 0x55a14a048610 2023-09-21T12:57:44.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fce64021040 con 0x55a14a048610 2023-09-21T12:57:44.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 10 client.25738 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:44.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 10 client.25738 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:44.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 20 client.25738 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:44.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0667a0 0x55a14a068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 4 client.25738 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:44.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.436+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a14a017020 con 0x55a14a0667a0 2023-09-21T12:57:44.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.437+0000 7fce727fc700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0667a0 0x55a14a068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.437+0000 7fce727fc700 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0667a0 0x55a14a068bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41356241aab734eb server_cookie=a127e1b67e0a54c0 in_seq=0 out_seq=0 2023-09-21T12:57:44.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.437+0000 7fce56ff5700 10 client.25738 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:44.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce56ff5700 1 -- 172.21.15.142:0/1897845152 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a14a017020 con 0x55a14a0667a0 2023-09-21T12:57:44.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce56ff5700 10 client.25738 handle_command_reply: tid=0 2023-09-21T12:57:44.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 client.25738 shutdown 2023-09-21T12:57:44.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 msgr2=0x55a14a054a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fce64005950 tx=0x7fce64004220 comp rx=0 tx=0).stop 2023-09-21T12:57:44.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 shutdown_connections 2023-09-21T12:57:44.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0667a0 0x55a14a068bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a052390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048610 0x55a14a054a70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce56ff5700 0 client.25738 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/1897845152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048f30 0x55a14a051d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 >> 172.21.15.142:0/1897845152 conn(0x55a149f75000 msgr2=0x55a14a043290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 shutdown_connections 2023-09-21T12:57:44.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 1 -- 172.21.15.142:0/1897845152 wait complete. 2023-09-21T12:57:44.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.438+0000 7fce8cd42b80 20 client.25738 trim_cache size 0 max 16384 2023-09-21T12:57:44.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.453+0000 7fce8cd42b80 1 Processor -- start 2023-09-21T12:57:44.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.453+0000 7fce8cd42b80 1 -- start start 2023-09-21T12:57:44.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.453+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a054610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a051570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a149e1a920 con 0x55a14a048610 2023-09-21T12:57:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a0552d0 con 0x55a14a04d360 2023-09-21T12:57:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a04cbe0 con 0x55a14a048f30 2023-09-21T12:57:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58788/0 (socket says 172.21.15.142:58788) 2023-09-21T12:57:44.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 -- 172.21.15.142:0/2762578474 learned_addr learned my addr 172.21.15.142:0/2762578474 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce737fe700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a051570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce727fc700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a054610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 -- 172.21.15.142:0/2762578474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 msgr2=0x55a14a054610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a054610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 -- 172.21.15.142:0/2762578474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 msgr2=0x55a14a051570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a051570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce72ffd700 1 -- 172.21.15.142:0/2762578474 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a149dadc60 con 0x55a14a048610 2023-09-21T12:57:44.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.454+0000 7fce727fc700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a054610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.455+0000 7fce72ffd700 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fce64004e60 tx=0x7fce64009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e919482954e2ba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.455+0000 7fce59ffb700 1 -- 172.21.15.142:0/2762578474 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64003da0 con 0x55a14a048610 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.455+0000 7fce59ffb700 1 -- 172.21.15.142:0/2762578474 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce64015070 con 0x55a14a048610 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.455+0000 7fce59ffb700 1 -- 172.21.15.142:0/2762578474 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce64019b20 con 0x55a14a048610 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- 172.21.15.142:0/2762578474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 msgr2=0x55a14a062100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fce64004e60 tx=0x7fce64009750 comp rx=0 tx=0).stop 2023-09-21T12:57:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- 172.21.15.142:0/2762578474 shutdown_connections 2023-09-21T12:57:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a062100 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a051570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/2762578474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a054610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- 172.21.15.142:0/2762578474 >> 172.21.15.142:0/2762578474 conn(0x55a149f75000 msgr2=0x55a14a04c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- 172.21.15.142:0/2762578474 shutdown_connections 2023-09-21T12:57:44.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- 172.21.15.142:0/2762578474 wait complete. 2023-09-21T12:57:44.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.456+0000 7fce8cd42b80 1 -- start start 2023-09-21T12:57:44.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 Processor -- start 2023-09-21T12:57:44.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a05b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a0b9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a05c7c0 con 0x55a14a048610 2023-09-21T12:57:44.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a0b9b50 con 0x55a14a04d360 2023-09-21T12:57:44.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a14a0b9cc0 con 0x55a14a048f30 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.457+0000 7fce8cd42b80 10 client.0 _ll_register_callbacks cb 0x55a149e80a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49170/0 (socket says 172.21.15.142:49170) 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 -- 172.21.15.142:0/3439739215 learned_addr learned my addr 172.21.15.142:0/3439739215 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce72ffd700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a05b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce737fe700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a0b9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 -- 172.21.15.142:0/3439739215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 msgr2=0x55a14a0b9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a0b9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 -- 172.21.15.142:0/3439739215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 msgr2=0x55a14a05b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a05b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 -- 172.21.15.142:0/3439739215 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce680b2e70 con 0x55a14a048f30 2023-09-21T12:57:44.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce727fc700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce6809a950 tx=0x7fce68009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d615d98910c2215 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:44.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680a29a0 con 0x55a14a048f30 2023-09-21T12:57:44.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fce680228c0 con 0x55a14a048f30 2023-09-21T12:57:44.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.458+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce64009e50 con 0x55a14a048f30 2023-09-21T12:57:44.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce68099eb0 con 0x55a14a048f30 2023-09-21T12:57:44.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 10 client.25744 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:44.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fce640099e0 con 0x55a14a048f30 2023-09-21T12:57:44.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fce680a6020 con 0x55a14a048f30 2023-09-21T12:57:44.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fce680a2510 con 0x55a14a048f30 2023-09-21T12:57:44.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 10 client.25744 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:44.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 10 client.25744 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:44.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 20 client.25744 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:44.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0bb160 0x55a14a0bd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 4 client.25744 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:44.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a149f92e60 con 0x55a14a0bb160 2023-09-21T12:57:44.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.459+0000 7fce72ffd700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0bb160 0x55a14a0bd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce56ff5700 10 client.25744 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:44.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce72ffd700 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0bb160 0x55a14a0bd580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d936c2314f36e61b server_cookie=ec8e4effb3935923 in_seq=0 out_seq=0 2023-09-21T12:57:44.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce56ff5700 1 -- 172.21.15.142:0/3439739215 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a149f92e60 con 0x55a14a0bb160 2023-09-21T12:57:44.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce56ff5700 10 client.25744 handle_command_reply: tid=0 2023-09-21T12:57:44.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 client.25744 shutdown 2023-09-21T12:57:44.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 msgr2=0x55a14a05bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fce6809a950 tx=0x7fce68009310 comp rx=0 tx=0).stop 2023-09-21T12:57:44.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 shutdown_connections 2023-09-21T12:57:44.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55a14a0bb160 0x55a14a0bd580 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a14a048610 0x55a14a05b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a14a04d360 0x55a14a0b9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 --2- 172.21.15.142:0/3439739215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a14a048f30 0x55a14a05bed0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce56ff5700 0 client.25744 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:44.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 >> 172.21.15.142:0/3439739215 conn(0x55a149f75000 msgr2=0x55a14a062100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 shutdown_connections 2023-09-21T12:57:44.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 1 -- 172.21.15.142:0/3439739215 wait complete. 2023-09-21T12:57:44.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.460+0000 7fce8cd42b80 20 client.25744 trim_cache size 0 max 16384 2023-09-21T12:57:44.478 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:44.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 msgr2=0x7fce5c0a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 0x7fce5c0a2d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009fd0 tx=0x7fce6c009310 comp rx=0 tx=0).stop 2023-09-21T12:57:44.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 msgr2=0x7fce741973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fce680059d0 tx=0x7fce68005740 comp rx=0 tx=0).stop 2023-09-21T12:57:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 shutdown_connections 2023-09-21T12:57:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fce5c0a08d0 0x7fce5c0a2d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fce74100fc0 0x7fce74196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fce7419b830 0x7fce7419bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 --2- 172.21.15.142:0/81469960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce741060e0 0x7fce741973d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 >> 172.21.15.142:0/81469960 conn(0x7fce740fc840 msgr2=0x7fce740fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 shutdown_connections 2023-09-21T12:57:44.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.461+0000 7fce793ff700 1 -- 172.21.15.142:0/81469960 wait complete. 2023-09-21T12:57:44.482 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:57:44.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 68979 15.58 MB/sec warmup 25 sec latency 19.318 ms 2023-09-21T12:57:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 -- 172.21.15.142:0/876795665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 msgr2=0x7f056c1035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 --2- 172.21.15.142:0/876795665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c1035b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f055c009990 tx=0x7f055c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 -- 172.21.15.142:0/876795665 shutdown_connections 2023-09-21T12:57:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 --2- 172.21.15.142:0/876795665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c10fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 --2- 172.21.15.142:0/876795665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c1035b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 --2- 172.21.15.142:0/876795665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c103b80 0x7f056c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.700+0000 7f05721ff700 1 -- 172.21.15.142:0/876795665 >> 172.21.15.142:0/876795665 conn(0x7f056c0fea50 msgr2=0x7f056c100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.701+0000 7f05721ff700 1 -- 172.21.15.142:0/876795665 shutdown_connections 2023-09-21T12:57:44.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.701+0000 7f05721ff700 1 -- 172.21.15.142:0/876795665 wait complete. 2023-09-21T12:57:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.701+0000 7f05721ff700 1 Processor -- start 2023-09-21T12:57:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 -- start start 2023-09-21T12:57:44.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c19daf0 0x7f056c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c19e570 con 0x7f056c19daf0 2023-09-21T12:57:44.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c19e6e0 con 0x7f056c1082f0 2023-09-21T12:57:44.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f05721ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c19e8a0 con 0x7f056c1031d0 2023-09-21T12:57:44.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49658/0 (socket says 172.21.15.142:49658) 2023-09-21T12:57:44.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49198/0 (socket says 172.21.15.142:49198) 2023-09-21T12:57:44.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056affd700 1 -- 172.21.15.142:0/2948621553 learned_addr learned my addr 172.21.15.142:0/2948621553 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.702+0000 7f056bfff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c19daf0 0x7f056c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 -- 172.21.15.142:0/2948621553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 msgr2=0x7f056c199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 -- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c19daf0 msgr2=0x7f056c19df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c19daf0 0x7f056c19df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 -- 172.21.15.142:0/2948621553 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009520 con 0x7f056c1031d0 2023-09-21T12:57:44.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f056b7fe700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f055c000c00 tx=0x7f055c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f0568ff9700 1 -- 172.21.15.142:0/2948621553 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c01d070 con 0x7f056c1031d0 2023-09-21T12:57:44.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f0568ff9700 1 -- 172.21.15.142:0/2948621553 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f055c021410 con 0x7f056c1031d0 2023-09-21T12:57:44.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f0568ff9700 1 -- 172.21.15.142:0/2948621553 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c017650 con 0x7f056c1031d0 2023-09-21T12:57:44.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.703+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c0095f0 con 0x7f056c1031d0 2023-09-21T12:57:44.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.704+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1a5fe0 con 0x7f056c1031d0 2023-09-21T12:57:44.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.707+0000 7f0568ff9700 1 -- 172.21.15.142:0/2948621553 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f055c021580 con 0x7f056c1031d0 2023-09-21T12:57:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.708+0000 7f0585bc1b80 1 Processor -- start 2023-09-21T12:57:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.708+0000 7f0585bc1b80 1 -- start start 2023-09-21T12:57:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.708+0000 7f0568ff9700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 0x7f05540a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 0x55ebd442be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 0x55ebd442c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd439bca0 con 0x55ebd4427f30 2023-09-21T12:57:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0568ff9700 1 -- 172.21.15.142:0/2948621553 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f055c0cd4a0 con 0x7f056c1031d0 2023-09-21T12:57:44.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd437fc70 con 0x55ebd442c360 2023-09-21T12:57:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd437d590 con 0x55ebd4427610 2023-09-21T12:57:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 0x55ebd442c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 0x55ebd442c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49672/0 (socket says 172.21.15.142:49672) 2023-09-21T12:57:44.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056bfff700 1 -- 172.21.15.142:0/100610421 learned_addr learned my addr 172.21.15.142:0/100610421 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49208/0 (socket says 172.21.15.142:49208) 2023-09-21T12:57:44.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056bfff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 0x7f05540a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056affd700 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 0x55ebd442be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 -- 172.21.15.142:0/100610421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 msgr2=0x55ebd442c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 0x55ebd442c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 -- 172.21.15.142:0/100610421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 msgr2=0x55ebd442be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 0x55ebd442be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.709+0000 7f056b7fe700 1 -- 172.21.15.142:0/100610421 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd41a3de0 con 0x55ebd4427610 2023-09-21T12:57:44.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f056affd700 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 0x55ebd442be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:44.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f056b7fe700 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f055c0caa40 tx=0x7f055c09a530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c150ed274ac2d90e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f056bfff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 0x7f05540a2e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0564009fd0 tx=0x7f056400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f0551ffb700 1 -- 172.21.15.142:0/100610421 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c09ae60 con 0x55ebd4427610 2023-09-21T12:57:44.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f0551ffb700 1 -- 172.21.15.142:0/100610421 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f055c09a760 con 0x55ebd4427610 2023-09-21T12:57:44.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.710+0000 7f0551ffb700 1 -- 172.21.15.142:0/100610421 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c09e3d0 con 0x55ebd4427610 2023-09-21T12:57:44.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- 172.21.15.142:0/100610421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 msgr2=0x55ebd44279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f055c0caa40 tx=0x7f055c09a530 comp rx=0 tx=0).stop 2023-09-21T12:57:44.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- 172.21.15.142:0/100610421 shutdown_connections 2023-09-21T12:57:44.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd442c360 0x55ebd442c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427610 0x55ebd44279f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/100610421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427f30 0x55ebd442be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- 172.21.15.142:0/100610421 >> 172.21.15.142:0/100610421 conn(0x55ebd4354000 msgr2=0x55ebd44226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- 172.21.15.142:0/100610421 shutdown_connections 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- 172.21.15.142:0/100610421 wait complete. 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.711+0000 7f0585bc1b80 1 -- start start 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 Processor -- start 2023-09-21T12:57:44.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427610 0x55ebd4433ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd442c360 0x55ebd4431320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4378e80 con 0x55ebd4427610 2023-09-21T12:57:44.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4315740 con 0x55ebd4427f30 2023-09-21T12:57:44.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd43153e0 con 0x55ebd442c360 2023-09-21T12:57:44.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f0585bc1b80 10 client.0 _ll_register_callbacks cb 0x55ebd425fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:44.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f056affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f056affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49686/0 (socket says 172.21.15.142:49686) 2023-09-21T12:57:44.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f056affd700 1 -- 172.21.15.142:0/1665234076 learned_addr learned my addr 172.21.15.142:0/1665234076 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f056b7fe700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427610 0x55ebd4433ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.712+0000 7f056bfff700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd442c360 0x55ebd4431320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 -- 172.21.15.142:0/1665234076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd442c360 msgr2=0x55ebd4431320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd442c360 0x55ebd4431320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 -- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427610 msgr2=0x55ebd4433ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427610 0x55ebd4433ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 -- 172.21.15.142:0/1665234076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c1a5fe0 con 0x55ebd4427f30 2023-09-21T12:57:44.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f056affd700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0560011850 tx=0x7f0560011b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b92a2ec01c44757 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f054affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:44.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560016070 con 0x55ebd4427f30 2023-09-21T12:57:44.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ebd42e9bb0 con 0x55ebd4427f30 2023-09-21T12:57:44.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.713+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0560004830 con 0x55ebd4427f30 2023-09-21T12:57:44.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05600049f0 con 0x55ebd4427f30 2023-09-21T12:57:44.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 10 client.25799 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:44.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ebd418cc60 con 0x55ebd4427f30 2023-09-21T12:57:44.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0560027020 con 0x55ebd4427f30 2023-09-21T12:57:44.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0560021070 con 0x55ebd4427f30 2023-09-21T12:57:44.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 10 client.25799 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:44.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 10 client.25799 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:44.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 20 client.25799 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:44.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4441160 0x55ebd4443580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 4 client.25799 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:44.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ebd43f6020 con 0x55ebd4441160 2023-09-21T12:57:44.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.714+0000 7f056b7fe700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4441160 0x55ebd4443580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.715+0000 7f054affd700 10 client.25799 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:44.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.715+0000 7f056b7fe700 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4441160 0x55ebd4443580 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3a8cd0777b622866 server_cookie=4d8ef35b91db811a in_seq=0 out_seq=0 2023-09-21T12:57:44.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f054affd700 1 -- 172.21.15.142:0/1665234076 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ebd43f6020 con 0x55ebd4441160 2023-09-21T12:57:44.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f054affd700 10 client.25799 handle_command_reply: tid=0 2023-09-21T12:57:44.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 client.25799 shutdown 2023-09-21T12:57:44.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 msgr2=0x55ebd4430d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0560011850 tx=0x7f0560011b60 comp rx=0 tx=0).stop 2023-09-21T12:57:44.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 shutdown_connections 2023-09-21T12:57:44.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd4427610 0x55ebd4433ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4441160 0x55ebd4443580 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd442c360 0x55ebd4431320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/1665234076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427f30 0x55ebd4430d30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 >> 172.21.15.142:0/1665234076 conn(0x55ebd4354000 msgr2=0x55ebd4422230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f054affd700 0 client.25799 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:44.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 shutdown_connections 2023-09-21T12:57:44.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 1 -- 172.21.15.142:0/1665234076 wait complete. 2023-09-21T12:57:44.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.716+0000 7f0585bc1b80 20 client.25799 trim_cache size 0 max 16384 2023-09-21T12:57:44.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 Processor -- start 2023-09-21T12:57:44.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 -- start start 2023-09-21T12:57:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd44335e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd442e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd41f9920 con 0x55ebd442c360 2023-09-21T12:57:44.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd443e7a0 con 0x55ebd4427610 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4423ed0 con 0x55ebd4427f30 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f056bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd442e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.731+0000 7f056affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd44335e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49702/0 (socket says 172.21.15.142:49702) 2023-09-21T12:57:44.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 -- 172.21.15.142:0/4182554996 learned_addr learned my addr 172.21.15.142:0/4182554996 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 -- 172.21.15.142:0/4182554996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 msgr2=0x55ebd44335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd44335e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 -- 172.21.15.142:0/4182554996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 msgr2=0x55ebd442e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd442e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 -- 172.21.15.142:0/4182554996 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ebd44210b0 con 0x55ebd4427610 2023-09-21T12:57:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056affd700 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd44335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f056b7fe700 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f055c096c60 tx=0x7f055c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52e6b65406314f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f05527fc700 1 -- 172.21.15.142:0/4182554996 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0a2740 con 0x55ebd4427610 2023-09-21T12:57:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f05527fc700 1 -- 172.21.15.142:0/4182554996 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f055c09e120 con 0x55ebd4427610 2023-09-21T12:57:44.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.732+0000 7f05527fc700 1 -- 172.21.15.142:0/4182554996 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c099eb0 con 0x55ebd4427610 2023-09-21T12:57:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 -- 172.21.15.142:0/4182554996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 msgr2=0x55ebd4430ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f055c096c60 tx=0x7f055c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 -- 172.21.15.142:0/4182554996 shutdown_connections 2023-09-21T12:57:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd442e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4430ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/4182554996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd44335e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 -- 172.21.15.142:0/4182554996 >> 172.21.15.142:0/4182554996 conn(0x55ebd4354000 msgr2=0x55ebd44305d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 -- 172.21.15.142:0/4182554996 shutdown_connections 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.733+0000 7f0585bc1b80 1 -- 172.21.15.142:0/4182554996 wait complete. 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 -- start start 2023-09-21T12:57:44.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 Processor -- start 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4437d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd4438240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd44361f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4436900 con 0x55ebd442c360 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4436a70 con 0x55ebd4427610 2023-09-21T12:57:44.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ebd4436c30 con 0x55ebd4427f30 2023-09-21T12:57:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f0585bc1b80 10 client.0 _ll_register_callbacks cb 0x55ebd425fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4437d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4437d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49716/0 (socket says 172.21.15.142:49716) 2023-09-21T12:57:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f056affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd4438240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.734+0000 7f056b7fe700 1 -- 172.21.15.142:0/2708708657 learned_addr learned my addr 172.21.15.142:0/2708708657 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056bfff700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd44361f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 -- 172.21.15.142:0/2708708657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 msgr2=0x55ebd4437d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4437d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 -- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 msgr2=0x55ebd44361f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd44361f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 -- 172.21.15.142:0/2708708657 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ebd418cc60 con 0x55ebd4427f30 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f056affd700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd4438240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f056001aa20 tx=0x7f056001a780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=838d8b3a752b80e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f054affd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0560016070 con 0x55ebd4427f30 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0560000e40 con 0x55ebd4427f30 2023-09-21T12:57:44.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f055c09a760 con 0x55ebd4427f30 2023-09-21T12:57:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0560005240 con 0x55ebd4427f30 2023-09-21T12:57:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f0585bc1b80 10 client.25762 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.735+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ebd41a3de0 con 0x55ebd4427f30 2023-09-21T12:57:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f055c09a760 con 0x55ebd4427f30 2023-09-21T12:57:44.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0560011880 con 0x55ebd4427f30 2023-09-21T12:57:44.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 10 client.25762 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:44.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 10 client.25762 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:44.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 20 client.25762 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:44.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4496130 0x55ebd4498550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 4 client.25762 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ebd4371e60 con 0x55ebd4496130 2023-09-21T12:57:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.736+0000 7f056b7fe700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4496130 0x55ebd4498550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f056b7fe700 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4496130 0x55ebd4498550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db64e57d0c9cbeaa server_cookie=66c6fd2c09146463 in_seq=0 out_seq=0 2023-09-21T12:57:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f054affd700 10 client.25762 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:44.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f054affd700 1 -- 172.21.15.142:0/2708708657 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ebd4371e60 con 0x55ebd4496130 2023-09-21T12:57:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f054affd700 10 client.25762 handle_command_reply: tid=0 2023-09-21T12:57:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 client.25762 shutdown 2023-09-21T12:57:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 msgr2=0x55ebd4438240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd4438240 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f056001aa20 tx=0x7f056001a780 comp rx=0 tx=0).stop 2023-09-21T12:57:44.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 shutdown_connections 2023-09-21T12:57:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ebd442c360 0x55ebd44361f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ebd4496130 0x55ebd4498550 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ebd4427610 0x55ebd4437d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 --2- 172.21.15.142:0/2708708657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ebd4427f30 0x55ebd4438240 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f054affd700 0 client.25762 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 >> 172.21.15.142:0/2708708657 conn(0x55ebd4354000 msgr2=0x55ebd442b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 shutdown_connections 2023-09-21T12:57:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.737+0000 7f0585bc1b80 1 -- 172.21.15.142:0/2708708657 wait complete. 2023-09-21T12:57:44.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f0585bc1b80 20 client.25762 trim_cache size 0 max 16384 2023-09-21T12:57:44.755 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 msgr2=0x7f05540a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 0x7f05540a2e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0564009fd0 tx=0x7f056400b040 comp rx=0 tx=0).stop 2023-09-21T12:57:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 msgr2=0x7f056c199150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f055c000c00 tx=0x7f055c005740 comp rx=0 tx=0).stop 2023-09-21T12:57:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 shutdown_connections 2023-09-21T12:57:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f05540a0950 0x7f05540a2e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f056c19daf0 0x7f056c19df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f056c1031d0 0x7f056c199150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 --2- 172.21.15.142:0/2948621553 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f056c1082f0 0x7f056c199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 >> 172.21.15.142:0/2948621553 conn(0x7f056c0fea50 msgr2=0x7f056c106c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 shutdown_connections 2023-09-21T12:57:44.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.738+0000 7f05721ff700 1 -- 172.21.15.142:0/2948621553 wait complete. 2023-09-21T12:57:44.758 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:44 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1683352100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:44.759 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:57:44.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:44 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1683352100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:44.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:44 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1683352100' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:44.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 -- 172.21.15.142:0/2343767006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 msgr2=0x7f66d01013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 --2- 172.21.15.142:0/2343767006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d01013a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f66cc009990 tx=0x7f66cc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 -- 172.21.15.142:0/2343767006 shutdown_connections 2023-09-21T12:57:44.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 --2- 172.21.15.142:0/2343767006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 0x7f66d010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 --2- 172.21.15.142:0/2343767006 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d01013a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 --2- 172.21.15.142:0/2343767006 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d0101970 0x7f66d01059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 -- 172.21.15.142:0/2343767006 >> 172.21.15.142:0/2343767006 conn(0x7f66d00fc840 msgr2=0x7f66d00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 -- 172.21.15.142:0/2343767006 shutdown_connections 2023-09-21T12:57:44.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.976+0000 7f66d7dff700 1 -- 172.21.15.142:0/2343767006 wait complete. 2023-09-21T12:57:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.977+0000 7f66d7dff700 1 Processor -- start 2023-09-21T12:57:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.977+0000 7f66d7dff700 1 -- start start 2023-09-21T12:57:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.977+0000 7f66d7dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d7dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 0x7f66d0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d7dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d019d9b0 0x7f66d019de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d7dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d019e430 con 0x7f66d019d9b0 2023-09-21T12:57:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d7dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d019e5a0 con 0x7f66d0100fc0 2023-09-21T12:57:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d7dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d019e760 con 0x7f66d01060e0 2023-09-21T12:57:44.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49728/0 (socket says 172.21.15.142:49728) 2023-09-21T12:57:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 -- 172.21.15.142:0/1350838559 learned_addr learned my addr 172.21.15.142:0/1350838559 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d539a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 0x7f66d0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d639c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d019d9b0 0x7f66d019de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 -- 172.21.15.142:0/1350838559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 msgr2=0x7f66d0199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 0x7f66d0199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 -- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d019d9b0 msgr2=0x7f66d019de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d019d9b0 0x7f66d019de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 -- 172.21.15.142:0/1350838559 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0095f0 con 0x7f66d0100fc0 2023-09-21T12:57:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.978+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00f690 tx=0x7f66cc00f6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.979+0000 7f66c6ffd700 1 -- 172.21.15.142:0/1350838559 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc01d070 con 0x7f66d0100fc0 2023-09-21T12:57:44.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.979+0000 7f66c6ffd700 1 -- 172.21.15.142:0/1350838559 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66cc005a00 con 0x7f66d0100fc0 2023-09-21T12:57:44.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.979+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66d01a5c60 con 0x7f66d0100fc0 2023-09-21T12:57:44.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.979+0000 7f66c6ffd700 1 -- 172.21.15.142:0/1350838559 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc005420 con 0x7f66d0100fc0 2023-09-21T12:57:44.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.979+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d01a60e0 con 0x7f66d0100fc0 2023-09-21T12:57:44.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.982+0000 7f66c6ffd700 1 -- 172.21.15.142:0/1350838559 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f66cc005580 con 0x7f66d0100fc0 2023-09-21T12:57:44.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 Processor -- start 2023-09-21T12:57:44.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 -- start start 2023-09-21T12:57:44.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66c6ffd700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 0x7f66bc0a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e7ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e7d360 0x55d8e4e7d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4decca0 con 0x55d8e4e78610 2023-09-21T12:57:44.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4dd0c70 con 0x55d8e4e7d360 2023-09-21T12:57:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4dce590 con 0x55d8e4e78f30 2023-09-21T12:57:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66c6ffd700 1 -- 172.21.15.142:0/1350838559 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f66cc0cd2c0 con 0x7f66d0100fc0 2023-09-21T12:57:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.984+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d639c700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 0x7f66bc0a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58886/0 (socket says 172.21.15.142:58886) 2023-09-21T12:57:44.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d5b9b700 1 -- 172.21.15.142:0/512328518 learned_addr learned my addr 172.21.15.142:0/512328518 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:44.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e7ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d639c700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e7d360 0x55d8e4e7d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:44.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 -- 172.21.15.142:0/512328518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e7d360 msgr2=0x55d8e4e7d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e7d360 0x55d8e4e7d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 -- 172.21.15.142:0/512328518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 msgr2=0x55d8e4e789f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:44.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 -- 172.21.15.142:0/512328518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8e4bf4de0 con 0x55d8e4e78f30 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d539a700 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e7ce20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66d006a350 tx=0x7f66c0009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca2789d02af6a5f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66d639c700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 0x7f66bc0a2d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009550 tx=0x7f66c8003e30 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.985+0000 7f66bbfff700 1 -- 172.21.15.142:0/512328518 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00042f0 con 0x55d8e4e78f30 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66bbfff700 1 -- 172.21.15.142:0/512328518 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c0011dc0 con 0x55d8e4e78f30 2023-09-21T12:57:44.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66bbfff700 1 -- 172.21.15.142:0/512328518 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00193e0 con 0x55d8e4e78f30 2023-09-21T12:57:44.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 -- 172.21.15.142:0/512328518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 msgr2=0x55d8e4e7ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:44.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e7ce20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f66d006a350 tx=0x7f66c0009f60 comp rx=0 tx=0).stop 2023-09-21T12:57:44.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 -- 172.21.15.142:0/512328518 shutdown_connections 2023-09-21T12:57:44.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e789f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e7d360 0x55d8e4e7d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/512328518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e7ce20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:44.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 -- 172.21.15.142:0/512328518 >> 172.21.15.142:0/512328518 conn(0x55d8e4da5000 msgr2=0x55d8e4e736a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:44.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 -- 172.21.15.142:0/512328518 shutdown_connections 2023-09-21T12:57:44.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.986+0000 7f66eb78bb80 1 -- 172.21.15.142:0/512328518 wait complete. 2023-09-21T12:57:44.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.987+0000 7f66eb78bb80 1 -- start start 2023-09-21T12:57:45.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.987+0000 7f66eb78bb80 1 Processor -- start 2023-09-21T12:57:45.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78f30 0x55d8e4e81e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e82590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4dc9e80 con 0x55d8e4e78f30 2023-09-21T12:57:45.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4d66740 con 0x55d8e4e78610 2023-09-21T12:57:45.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4d663e0 con 0x55d8e4e7d360 2023-09-21T12:57:45.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66eb78bb80 10 client.0 _ll_register_callbacks cb 0x55d8e4cb0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:45.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49744/0 (socket says 172.21.15.142:49744) 2023-09-21T12:57:45.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d5b9b700 1 -- 172.21.15.142:0/2914222629 learned_addr learned my addr 172.21.15.142:0/2914222629 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:45.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e82590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d539a700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78f30 0x55d8e4e81e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 -- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 msgr2=0x55d8e4e84b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 -- 172.21.15.142:0/2914222629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78f30 msgr2=0x55d8e4e81e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78f30 0x55d8e4e81e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d639c700 1 -- 172.21.15.142:0/2914222629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66d01a60e0 con 0x55d8e4e7d360 2023-09-21T12:57:45.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.988+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:45.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66d639c700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e82590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66c8007b80 tx=0x7f66c8004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85212da375f42fdd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:45.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:45.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c801baf0 con 0x55d8e4e7d360 2023-09-21T12:57:45.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8e4d3abb0 con 0x55d8e4e7d360 2023-09-21T12:57:45.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f66c8021070 con 0x55d8e4e7d360 2023-09-21T12:57:45.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c801bc50 con 0x55d8e4e7d360 2023-09-21T12:57:45.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66eb78bb80 10 client.25774 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:45.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.989+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f66c00098e0 con 0x55d8e4e7d360 2023-09-21T12:57:45.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d8e4d3abb0 con 0x55d8e4e7d360 2023-09-21T12:57:45.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f66c8025c50 con 0x55d8e4e7d360 2023-09-21T12:57:45.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 10 client.25774 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:45.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 10 client.25774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:45.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 20 client.25774 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:45.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4e923f0 0x55d8e4e94810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 4 client.25774 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:45.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8e4e47020 con 0x55d8e4e923f0 2023-09-21T12:57:45.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.990+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4e923f0 0x55d8e4e94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.991+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4e923f0 0x55d8e4e94810 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83c23b9e7ae83d server_cookie=d47be9a654652813 in_seq=0 out_seq=0 2023-09-21T12:57:45.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.991+0000 7f66b97fa700 10 client.25774 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:45.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66b97fa700 1 -- 172.21.15.142:0/2914222629 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d8e4e47020 con 0x55d8e4e923f0 2023-09-21T12:57:45.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66b97fa700 10 client.25774 handle_command_reply: tid=0 2023-09-21T12:57:45.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 client.25774 shutdown 2023-09-21T12:57:45.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 msgr2=0x55d8e4e82590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:45.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e82590 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f66c8007b80 tx=0x7f66c8004b40 comp rx=0 tx=0).stop 2023-09-21T12:57:45.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 shutdown_connections 2023-09-21T12:57:45.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4e923f0 0x55d8e4e94810 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e82590 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e84b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/2914222629 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78f30 0x55d8e4e81e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 >> 172.21.15.142:0/2914222629 conn(0x55d8e4da5000 msgr2=0x55d8e4e73290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:45.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66b97fa700 0 client.25774 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:45.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 shutdown_connections 2023-09-21T12:57:45.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 1 -- 172.21.15.142:0/2914222629 wait complete. 2023-09-21T12:57:45.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:44.992+0000 7f66eb78bb80 20 client.25774 trim_cache size 0 max 16384 2023-09-21T12:57:45.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 Processor -- start 2023-09-21T12:57:45.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 -- start start 2023-09-21T12:57:45.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e7ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e94400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4c4a920 con 0x55d8e4e78610 2023-09-21T12:57:45.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4e89a20 con 0x55d8e4e78f30 2023-09-21T12:57:45.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4e80490 con 0x55d8e4e7d360 2023-09-21T12:57:45.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e7ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66d539a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66d539a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49752/0 (socket says 172.21.15.142:49752) 2023-09-21T12:57:45.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.007+0000 7f66d539a700 1 -- 172.21.15.142:0/524768831 learned_addr learned my addr 172.21.15.142:0/524768831 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:45.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d639c700 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e94400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 -- 172.21.15.142:0/524768831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 msgr2=0x55d8e4e94400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e94400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 -- 172.21.15.142:0/524768831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 msgr2=0x55d8e4e7ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e7ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 -- 172.21.15.142:0/524768831 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8e4bddc60 con 0x55d8e4e78f30 2023-09-21T12:57:45.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66d539a700 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009bd0 tx=0x7f66c0005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d8489ee3ae5fee8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:45.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66c4bff700 1 -- 172.21.15.142:0/524768831 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c0003700 con 0x55d8e4e78f30 2023-09-21T12:57:45.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66c4bff700 1 -- 172.21.15.142:0/524768831 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66c0003860 con 0x55d8e4e78f30 2023-09-21T12:57:45.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.008+0000 7f66c4bff700 1 -- 172.21.15.142:0/524768831 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c00054f0 con 0x55d8e4e78f30 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 -- 172.21.15.142:0/524768831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 msgr2=0x55d8e4e894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f66c0009bd0 tx=0x7f66c0005dc0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 -- 172.21.15.142:0/524768831 shutdown_connections 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e78610 0x55d8e4e7ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e7d360 0x55d8e4e94400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/524768831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78f30 0x55d8e4e894e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 -- 172.21.15.142:0/524768831 >> 172.21.15.142:0/524768831 conn(0x55d8e4da5000 msgr2=0x55d8e4e84790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:45.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 -- 172.21.15.142:0/524768831 shutdown_connections 2023-09-21T12:57:45.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.009+0000 7f66eb78bb80 1 -- 172.21.15.142:0/524768831 wait complete. 2023-09-21T12:57:45.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 -- start start 2023-09-21T12:57:45.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 Processor -- start 2023-09-21T12:57:45.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e7d360 0x55d8e4e81310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4e81a20 con 0x55d8e4e7d360 2023-09-21T12:57:45.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4e81b90 con 0x55d8e4e78610 2023-09-21T12:57:45.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8e4e81d50 con 0x55d8e4e78f30 2023-09-21T12:57:45.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.010+0000 7f66eb78bb80 10 client.0 _ll_register_callbacks cb 0x55d8e4cb0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:45.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49758/0 (socket says 172.21.15.142:49758) 2023-09-21T12:57:45.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 -- 172.21.15.142:0/197641540 learned_addr learned my addr 172.21.15.142:0/197641540 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:45.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d639c700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e7d360 0x55d8e4e81310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d539a700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 -- 172.21.15.142:0/197641540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 msgr2=0x55d8e4e80c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e80c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 -- 172.21.15.142:0/197641540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e7d360 msgr2=0x55d8e4e81310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e7d360 0x55d8e4e81310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 -- 172.21.15.142:0/197641540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66c001e040 con 0x55d8e4e78610 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66d5b9b700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0cd230 tx=0x7f66cc09a0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c47f3ed5e9f5967 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66b97fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.011+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0cc040 con 0x55d8e4e78610 2023-09-21T12:57:45.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f66cc00be40 con 0x55d8e4e78610 2023-09-21T12:57:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66c0011dc0 con 0x55d8e4e78610 2023-09-21T12:57:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66cc09ac80 con 0x55d8e4e78610 2023-09-21T12:57:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 10 client.25823 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d8e4c1b250 con 0x55d8e4e78610 2023-09-21T12:57:45.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66cc0a6070 con 0x55d8e4e78610 2023-09-21T12:57:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f66cc09a7e0 con 0x55d8e4e78610 2023-09-21T12:57:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 10 client.25823 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 10 client.25823 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 20 client.25823 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:45.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4ee6f50 0x55d8e4ee9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 4 client.25823 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d8e4dc2e60 con 0x55d8e4ee6f50 2023-09-21T12:57:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.012+0000 7f66d539a700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4ee6f50 0x55d8e4ee9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66d539a700 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4ee6f50 0x55d8e4ee9340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99b485a1ced0bd5 server_cookie=182ea3b75b429400 in_seq=0 out_seq=0 2023-09-21T12:57:45.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66b97fa700 10 client.25823 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66b97fa700 1 -- 172.21.15.142:0/197641540 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d8e4dc2e60 con 0x55d8e4ee6f50 2023-09-21T12:57:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66b97fa700 10 client.25823 handle_command_reply: tid=0 2023-09-21T12:57:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 client.25823 shutdown 2023-09-21T12:57:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 msgr2=0x55d8e4e806e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:45.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0cd230 tx=0x7f66cc09a0c0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 shutdown_connections 2023-09-21T12:57:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d8e4ee6f50 0x55d8e4ee9340 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d8e4e7d360 0x55d8e4e81310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d8e4e78610 0x55d8e4e806e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 --2- 172.21.15.142:0/197641540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d8e4e78f30 0x55d8e4e80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66b97fa700 0 client.25823 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.013+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 >> 172.21.15.142:0/197641540 conn(0x55d8e4da5000 msgr2=0x55d8e4e94400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 shutdown_connections 2023-09-21T12:57:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66eb78bb80 1 -- 172.21.15.142:0/197641540 wait complete. 2023-09-21T12:57:45.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66eb78bb80 20 client.25823 trim_cache size 0 max 16384 2023-09-21T12:57:45.032 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 msgr2=0x7f66bc0a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:45.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 0x7f66bc0a2d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009550 tx=0x7f66c8003e30 comp rx=0 tx=0).stop 2023-09-21T12:57:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 msgr2=0x7f66d0199010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00f690 tx=0x7f66cc00f6c0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 shutdown_connections 2023-09-21T12:57:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f66bc0a08d0 0x7f66bc0a2d90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f66d019d9b0 0x7f66d019de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f66d0100fc0 0x7f66d0199010 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 --2- 172.21.15.142:0/1350838559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66d01060e0 0x7f66d0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:45.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.014+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 >> 172.21.15.142:0/1350838559 conn(0x7f66d00fc840 msgr2=0x7f66d010cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:45.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.015+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 shutdown_connections 2023-09-21T12:57:45.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:45.015+0000 7f66d7dff700 1 -- 172.21.15.142:0/1350838559 wait complete. 2023-09-21T12:57:45.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 71624 15.52 MB/sec warmup 26 sec latency 12.849 ms 2023-09-21T12:57:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:45 smithi156 ceph-mon[134078]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.4 MiB/s wr, 309 op/s 2023-09-21T12:57:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:45 smithi142 ceph-mon[97663]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.4 MiB/s wr, 309 op/s 2023-09-21T12:57:45.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:45 smithi160 ceph-mon[134450]: pgmap v48: 97 pgs: 97 active+clean; 16 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 704 KiB/s rd, 1.4 MiB/s wr, 309 op/s 2023-09-21T12:57:46.036 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:57:46.037 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:57:46.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 -- 172.21.15.142:0/586854148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4101950 msgr2=0x7fb9a4105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/586854148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4101950 0x7fb9a4105990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb998009990 tx=0x7fb998009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 -- 172.21.15.142:0/586854148 shutdown_connections 2023-09-21T12:57:46.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/586854148 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 0x7fb9a410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/586854148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4100fa0 0x7fb9a4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/586854148 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4101950 0x7fb9a4105990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 -- 172.21.15.142:0/586854148 >> 172.21.15.142:0/586854148 conn(0x7fb9a40fc860 msgr2=0x7fb9a40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 -- 172.21.15.142:0/586854148 shutdown_connections 2023-09-21T12:57:46.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.263+0000 7fb9a93ff700 1 -- 172.21.15.142:0/586854148 wait complete. 2023-09-21T12:57:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 Processor -- start 2023-09-21T12:57:46.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 -- start start 2023-09-21T12:57:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 0x7fb9a4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 0x7fb9a41a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.264+0000 7fb9a93ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a57e0 con 0x7fb9a41060c0 2023-09-21T12:57:46.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a93ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a5950 con 0x7fb9a4100fa0 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a93ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a41a5b10 con 0x7fb9a4073b60 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49770/0 (socket says 172.21.15.142:49770) 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/1772589689 learned_addr learned my addr 172.21.15.142:0/1772589689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 0x7fb9a41a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 0x7fb9a4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 -- 172.21.15.142:0/1772589689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 msgr2=0x7fb9a40730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 -- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 msgr2=0x7fb9a4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 0x7fb9a4073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 -- 172.21.15.142:0/1772589689 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980095f0 con 0x7fb9a4073b60 2023-09-21T12:57:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.265+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 0x7fb9a41a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb99c007f10 tx=0x7fb99c00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.266+0000 7fb98bfff700 1 -- 172.21.15.142:0/1772589689 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c004db0 con 0x7fb9a4073b60 2023-09-21T12:57:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.266+0000 7fb98bfff700 1 -- 172.21.15.142:0/1772589689 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb99c00f040 con 0x7fb9a4073b60 2023-09-21T12:57:46.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.266+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a41a5df0 con 0x7fb9a4073b60 2023-09-21T12:57:46.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.266+0000 7fb98bfff700 1 -- 172.21.15.142:0/1772589689 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c005990 con 0x7fb9a4073b60 2023-09-21T12:57:46.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.266+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a41a62d0 con 0x7fb9a4073b60 2023-09-21T12:57:46.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.269+0000 7fb98bfff700 1 -- 172.21.15.142:0/1772589689 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7fb99c00db20 con 0x7fb9a4073b60 2023-09-21T12:57:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.270+0000 7fb9bcd4cb80 1 Processor -- start 2023-09-21T12:57:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.270+0000 7fb98bfff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 0x7fb98c0a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 -- start start 2023-09-21T12:57:46.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb98bfff700 1 -- 172.21.15.142:0/1772589689 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb99c0cb9c0 con 0x7fb9a4073b60 2023-09-21T12:57:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 0x7fb98c0a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 0x563efa286ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa2873e0 0x563efa287840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa1f6d20 con 0x563efa282fb0 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa1dacf0 con 0x563efa282690 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa1d8610 con 0x563efa2873e0 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49784/0 (socket says 172.21.15.142:49784) 2023-09-21T12:57:46.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2526958384 learned_addr learned my addr 172.21.15.142:0/2526958384 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.271+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 0x563efa286ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa2873e0 0x563efa287840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2526958384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa2873e0 msgr2=0x563efa287840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa2873e0 0x563efa287840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2526958384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 msgr2=0x563efa286ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 0x563efa286ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2526958384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ef9ffee60 con 0x563efa282690 2023-09-21T12:57:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 0x563efa286ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:46.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 0x7fb98c0a2e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb99800b2e0 tx=0x7fb99800b920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb9940117e0 tx=0x7fb994011af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b974338611f74227 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9897fa700 1 -- 172.21.15.142:0/2526958384 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400f480 con 0x563efa282690 2023-09-21T12:57:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9897fa700 1 -- 172.21.15.142:0/2526958384 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb99400faa0 con 0x563efa282690 2023-09-21T12:57:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.272+0000 7fb9897fa700 1 -- 172.21.15.142:0/2526958384 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994019b60 con 0x563efa282690 2023-09-21T12:57:46.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2526958384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 msgr2=0x563efa282a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb9940117e0 tx=0x7fb994011af0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2526958384 shutdown_connections 2023-09-21T12:57:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa2873e0 0x563efa287840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa282a70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2526958384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa282fb0 0x563efa286ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2526958384 >> 172.21.15.142:0/2526958384 conn(0x563efa1af080 msgr2=0x563efa27d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2526958384 shutdown_connections 2023-09-21T12:57:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.273+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2526958384 wait complete. 2023-09-21T12:57:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.274+0000 7fb9bcd4cb80 1 -- start start 2023-09-21T12:57:46.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.274+0000 7fb9bcd4cb80 1 Processor -- start 2023-09-21T12:57:46.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa28ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa28c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa1d3f00 con 0x563efa2873e0 2023-09-21T12:57:46.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa1707c0 con 0x563efa282690 2023-09-21T12:57:46.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa170460 con 0x563efa282fb0 2023-09-21T12:57:46.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9bcd4cb80 10 client.0 _ll_register_callbacks cb 0x563efa0bab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:46.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49312/0 (socket says 172.21.15.142:49312) 2023-09-21T12:57:46.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9a27fc700 1 -- 172.21.15.142:0/2919949147 learned_addr learned my addr 172.21.15.142:0/2919949147 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa28ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.275+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa28c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2919949147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 msgr2=0x563efa28be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2919949147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 msgr2=0x563efa28c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa28c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/2919949147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb994011440 con 0x563efa282690 2023-09-21T12:57:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa28ec10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb994009df0 tx=0x7fb99400f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0815385b3223754 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb986ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:46.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99400f920 con 0x563efa282690 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563efa144c30 con 0x563efa282690 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb994005ce0 con 0x563efa282690 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.276+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb994004250 con 0x563efa282690 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 10 client.25835 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563ef9fe7ce0 con 0x563efa282690 2023-09-21T12:57:46.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563efa144c30 con 0x563efa282690 2023-09-21T12:57:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb9940036a0 con 0x563efa282690 2023-09-21T12:57:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 10 client.25835 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 20 client.25835 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 4 client.25835 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563efa2510a0 con 0x563efa2a4bf0 2023-09-21T12:57:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.277+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.278+0000 7fb986ff5700 10 client.25835 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.278+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2a7010 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64d82609c227db4 server_cookie=a1d1d6eaa7a4d276 in_seq=0 out_seq=0 2023-09-21T12:57:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb986ff5700 1 -- 172.21.15.142:0/2919949147 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563efa2510a0 con 0x563efa2a4bf0 2023-09-21T12:57:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb986ff5700 10 client.25835 handle_command_reply: tid=0 2023-09-21T12:57:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 client.25835 shutdown 2023-09-21T12:57:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 msgr2=0x563efa28ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa28ec10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb994009df0 tx=0x7fb99400f730 comp rx=0 tx=0).stop 2023-09-21T12:57:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 shutdown_connections 2023-09-21T12:57:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2a7010 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa28c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb986ff5700 0 client.25835 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa28ec10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/2919949147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 >> 172.21.15.142:0/2919949147 conn(0x563efa1af080 msgr2=0x563efa27d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 shutdown_connections 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/2919949147 wait complete. 2023-09-21T12:57:46.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.279+0000 7fb9bcd4cb80 20 client.25835 trim_cache size 0 max 16384 2023-09-21T12:57:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.298+0000 7fb9bcd4cb80 1 Processor -- start 2023-09-21T12:57:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.298+0000 7fb9bcd4cb80 1 -- start start 2023-09-21T12:57:46.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa27d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa0549a0 con 0x563efa2873e0 2023-09-21T12:57:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa28cbd0 con 0x563efa282690 2023-09-21T12:57:46.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa2a1660 con 0x563efa282fb0 2023-09-21T12:57:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49794/0 (socket says 172.21.15.142:49794) 2023-09-21T12:57:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/979240127 learned_addr learned my addr 172.21.15.142:0/979240127 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49324/0 (socket says 172.21.15.142:49324) 2023-09-21T12:57:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa27d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/979240127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 msgr2=0x563efa28e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/979240127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 msgr2=0x563efa27d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa27d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/979240127 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563efa0252d0 con 0x563efa282690 2023-09-21T12:57:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.299+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb99402f040 tx=0x7fb9940057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f12f1348ce7e7ca server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb989ffb700 1 -- 172.21.15.142:0/979240127 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994015030 con 0x563efa282690 2023-09-21T12:57:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb989ffb700 1 -- 172.21.15.142:0/979240127 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb994005c80 con 0x563efa282690 2023-09-21T12:57:46.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb989ffb700 1 -- 172.21.15.142:0/979240127 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb994019990 con 0x563efa282690 2023-09-21T12:57:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/979240127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 msgr2=0x563efa29be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.300+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb99402f040 tx=0x7fb9940057f0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/979240127 shutdown_connections 2023-09-21T12:57:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa27d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29be30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/979240127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa28e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/979240127 >> 172.21.15.142:0/979240127 conn(0x563efa1af080 msgr2=0x563efa2865c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/979240127 shutdown_connections 2023-09-21T12:57:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/979240127 wait complete. 2023-09-21T12:57:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 -- start start 2023-09-21T12:57:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.301+0000 7fb9bcd4cb80 1 Processor -- start 2023-09-21T12:57:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa29ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa2f8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa29b460 con 0x563efa2873e0 2023-09-21T12:57:46.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa2f8f90 con 0x563efa282690 2023-09-21T12:57:46.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563efa2f90d0 con 0x563efa282fb0 2023-09-21T12:57:46.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9bcd4cb80 10 client.0 _ll_register_callbacks cb 0x563efa0bab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:46.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49798/0 (socket says 172.21.15.142:49798) 2023-09-21T12:57:46.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa29ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.302+0000 7fb9a2ffd700 1 -- 172.21.15.142:0/337003776 learned_addr learned my addr 172.21.15.142:0/337003776 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a37fe700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa2f8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 -- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 msgr2=0x563efa29a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 -- 172.21.15.142:0/337003776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 msgr2=0x563efa2f8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa2f8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 -- 172.21.15.142:0/337003776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a410e4b0 con 0x563efa282fb0 2023-09-21T12:57:46.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9a27fc700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa29ac30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x563efa28d4d0 tx=0x7fb998009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2257cedcdc6fcc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb986ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980364a0 con 0x563efa282fb0 2023-09-21T12:57:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb99400faa0 con 0x563efa282fb0 2023-09-21T12:57:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.303+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb99802c040 con 0x563efa282fb0 2023-09-21T12:57:46.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb998004500 con 0x563efa282fb0 2023-09-21T12:57:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 10 client.25798 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563ef9fe7ce0 con 0x563efa282fb0 2023-09-21T12:57:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb99400faa0 con 0x563efa282fb0 2023-09-21T12:57:46.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb99800f460 con 0x563efa282fb0 2023-09-21T12:57:46.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 10 client.25798 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:46.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 10 client.25798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:46.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 20 client.25798 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:46.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2fc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 4 client.25798 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:57:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x563efa1ccee0 con 0x563efa2a4bf0 2023-09-21T12:57:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.304+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2fc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.305+0000 7fb986ff5700 10 client.25798 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.305+0000 7fb9a2ffd700 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2fc6f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbeae2af03e8e820 server_cookie=360a83e28087c1b4 in_seq=0 out_seq=0 2023-09-21T12:57:46.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb986ff5700 1 -- 172.21.15.142:0/337003776 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563efa1ccee0 con 0x563efa2a4bf0 2023-09-21T12:57:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb986ff5700 10 client.25798 handle_command_reply: tid=0 2023-09-21T12:57:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 client.25798 shutdown 2023-09-21T12:57:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 msgr2=0x563efa29ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa29ac30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x563efa28d4d0 tx=0x7fb998009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 shutdown_connections 2023-09-21T12:57:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563efa2a4bf0 0x563efa2fc6f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563efa2873e0 0x563efa2f8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563efa282690 0x563efa29a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 --2- 172.21.15.142:0/337003776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563efa282fb0 0x563efa29ac30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 >> 172.21.15.142:0/337003776 conn(0x563efa1af080 msgr2=0x563efa281d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb986ff5700 0 client.25798 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.306+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 shutdown_connections 2023-09-21T12:57:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9bcd4cb80 1 -- 172.21.15.142:0/337003776 wait complete. 2023-09-21T12:57:46.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9bcd4cb80 20 client.25798 trim_cache size 0 max 16384 2023-09-21T12:57:46.321 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:46.321 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:57:46.321 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "b38b63f5-5518-4f6b-ac92-2c25591d8fa0", 2023-09-21T12:57:46.321 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:57:46.321 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 msgr2=0x7fb98c0a2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 0x7fb98c0a2e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb99800b2e0 tx=0x7fb99800b920 comp rx=0 tx=0).stop 2023-09-21T12:57:46.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 msgr2=0x7fb9a41a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 0x7fb9a41a5150 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb99c007f10 tx=0x7fb99c00d3b0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 shutdown_connections 2023-09-21T12:57:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb98c0a0950 0x7fb98c0a2e10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9a4073b60 0x7fb9a41a5150 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9a4100fa0 0x7fb9a40730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 --2- 172.21.15.142:0/1772589689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb9a41060c0 0x7fb9a4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.307+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 >> 172.21.15.142:0/1772589689 conn(0x7fb9a40fc860 msgr2=0x7fb9a40fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.308+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 shutdown_connections 2023-09-21T12:57:46.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.308+0000 7fb9a93ff700 1 -- 172.21.15.142:0/1772589689 wait complete. 2023-09-21T12:57:46.328 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:57:46.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 -- 172.21.15.142:0/2603084410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073aa0 msgr2=0x7f8d481117d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 --2- 172.21.15.142:0/2603084410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073aa0 0x7f8d481117d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d380098f0 tx=0x7f8d38009c00 comp rx=0 tx=0).stop 2023-09-21T12:57:46.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 -- 172.21.15.142:0/2603084410 shutdown_connections 2023-09-21T12:57:46.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 --2- 172.21.15.142:0/2603084410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48073180 0x7f8d48073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 --2- 172.21.15.142:0/2603084410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48111d10 0x7f8d48114100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 --2- 172.21.15.142:0/2603084410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073aa0 0x7f8d481117d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 -- 172.21.15.142:0/2603084410 >> 172.21.15.142:0/2603084410 conn(0x7f8d480fc7f0 msgr2=0x7f8d480fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 -- 172.21.15.142:0/2603084410 shutdown_connections 2023-09-21T12:57:46.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.555+0000 7f8d507ff700 1 -- 172.21.15.142:0/2603084410 wait complete. 2023-09-21T12:57:46.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.556+0000 7f8d507ff700 1 Processor -- start 2023-09-21T12:57:46.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 -- start start 2023-09-21T12:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073180 0x7f8d4819d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48111d10 0x7f8d481a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d481a2440 con 0x7f8d48111d10 2023-09-21T12:57:46.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d481a25b0 con 0x7f8d48073aa0 2023-09-21T12:57:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d507ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d481a2770 con 0x7f8d48073180 2023-09-21T12:57:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49816/0 (socket says 172.21.15.142:49816) 2023-09-21T12:57:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1590090233 learned_addr learned my addr 172.21.15.142:0/1590090233 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073180 0x7f8d4819d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48111d10 0x7f8d481a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1590090233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073180 msgr2=0x7f8d4819d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073180 0x7f8d4819d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48111d10 msgr2=0x7f8d481a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48111d10 0x7f8d481a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.557+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1590090233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d38009520 con 0x7f8d48073aa0 2023-09-21T12:57:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009230 tx=0x7f8d3800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d3f7fe700 1 -- 172.21.15.142:0/1590090233 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3801c070 con 0x7f8d48073aa0 2023-09-21T12:57:46.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d3f7fe700 1 -- 172.21.15.142:0/1590090233 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d3800bba0 con 0x7f8d48073aa0 2023-09-21T12:57:46.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d481a29f0 con 0x7f8d48073aa0 2023-09-21T12:57:46.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d3f7fe700 1 -- 172.21.15.142:0/1590090233 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d380038e0 con 0x7f8d48073aa0 2023-09-21T12:57:46.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.558+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d481aa290 con 0x7f8d48073aa0 2023-09-21T12:57:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.561+0000 7f8d3f7fe700 1 -- 172.21.15.142:0/1590090233 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 25) v1 ==== 135493+0+0 (secure 0 0 0) 0x7f8d38020030 con 0x7f8d48073aa0 2023-09-21T12:57:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.563+0000 7f8d6418ab80 1 Processor -- start 2023-09-21T12:57:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.563+0000 7f8d6418ab80 1 -- start start 2023-09-21T12:57:46.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.563+0000 7f8d3f7fe700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 0x7f8d340a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.563+0000 7f8d3f7fe700 1 -- 172.21.15.142:0/1590090233 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8d380cd160 con 0x7f8d48073aa0 2023-09-21T12:57:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85610 0x55c2fcd859f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fccf9ca0 con 0x55c2fcd85610 2023-09-21T12:57:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fccddc70 con 0x55c2fcd8a360 2023-09-21T12:57:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fccdb590 con 0x55c2fcd85f30 2023-09-21T12:57:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 0x7f8d340a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49352/0 (socket says 172.21.15.142:49352) 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85610 0x55c2fcd859f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1916503476 learned_addr learned my addr 172.21.15.142:0/1916503476 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1916503476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd8a360 msgr2=0x55c2fcd8a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1916503476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85610 msgr2=0x55c2fcd859f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85610 0x55c2fcd859f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 -- 172.21.15.142:0/1916503476 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2fcb01de0 con 0x55c2fcd85f30 2023-09-21T12:57:46.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.564+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d3809a3b0 tx=0x7f8d38009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4c4753ea8cb95c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d3cff9700 1 -- 172.21.15.142:0/1916503476 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38085110 con 0x55c2fcd85f30 2023-09-21T12:57:46.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 0x7f8d340a2d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d4806a2e0 tx=0x7f8d400099e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d3cff9700 1 -- 172.21.15.142:0/1916503476 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d3809ab20 con 0x55c2fcd85f30 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d3cff9700 1 -- 172.21.15.142:0/1916503476 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d38021380 con 0x55c2fcd85f30 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1916503476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 msgr2=0x55c2fcd89e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d3809a3b0 tx=0x7f8d38009470 comp rx=0 tx=0).stop 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1916503476 shutdown_connections 2023-09-21T12:57:46.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85610 0x55c2fcd859f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1916503476 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd89e20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.565+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1916503476 >> 172.21.15.142:0/1916503476 conn(0x55c2fccb2000 msgr2=0x55c2fcd806a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.566+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1916503476 shutdown_connections 2023-09-21T12:57:46.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.566+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1916503476 wait complete. 2023-09-21T12:57:46.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.566+0000 7f8d6418ab80 1 -- start start 2023-09-21T12:57:46.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.566+0000 7f8d6418ab80 1 Processor -- start 2023-09-21T12:57:46.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fccd6e80 con 0x55c2fcd85f30 2023-09-21T12:57:46.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcc73740 con 0x55c2fcd85610 2023-09-21T12:57:46.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcc733e0 con 0x55c2fcd8a360 2023-09-21T12:57:46.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d6418ab80 10 client.0 _ll_register_callbacks cb 0x55c2fcbbda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:46.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49826/0 (socket says 172.21.15.142:49826) 2023-09-21T12:57:46.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4e59b700 1 -- 172.21.15.142:0/1720215671 learned_addr learned my addr 172.21.15.142:0/1720215671 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4e59b700 1 -- 172.21.15.142:0/1720215671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 msgr2=0x55c2fcd8f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.567+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d4e59b700 1 -- 172.21.15.142:0/1720215671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 msgr2=0x55c2fcd8eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d4e59b700 1 -- 172.21.15.142:0/1720215671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d481aa290 con 0x55c2fcd85610 2023-09-21T12:57:46.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:46.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d44012860 tx=0x7f8d44012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95db0d3be919ec9a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:46.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44017070 con 0x55c2fcd85610 2023-09-21T12:57:46.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8d4400f830 con 0x55c2fcd85610 2023-09-21T12:57:46.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.568+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2fcc47bb0 con 0x55c2fcd85610 2023-09-21T12:57:46.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d440122e0 con 0x55c2fcd85610 2023-09-21T12:57:46.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 10 client.25850 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:46.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55c2fcaeac60 con 0x55c2fcd85610 2023-09-21T12:57:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c2fcc47bb0 con 0x55c2fcd85610 2023-09-21T12:57:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d44010b90 con 0x55c2fcd85610 2023-09-21T12:57:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 10 client.25850 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:46.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 10 client.25850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 20 client.25850 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcd9f1a0 0x55c2fcda15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 4 client.25850 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.569+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2fcd54020 con 0x55c2fcd9f1a0 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.570+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcd9f1a0 0x55c2fcda15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.570+0000 7f8d31ffb700 10 client.25850 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.570+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcd9f1a0 0x55c2fcda15c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8595aaae33c704e server_cookie=1ffc94c3ff23af1e in_seq=0 out_seq=0 2023-09-21T12:57:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d31ffb700 1 -- 172.21.15.142:0/1720215671 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c2fcd54020 con 0x55c2fcd9f1a0 2023-09-21T12:57:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d31ffb700 10 client.25850 handle_command_reply: tid=0 2023-09-21T12:57:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 client.25850 shutdown 2023-09-21T12:57:46.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 msgr2=0x55c2fcd91a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8d44012860 tx=0x7f8d44012c20 comp rx=0 tx=0).stop 2023-09-21T12:57:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 shutdown_connections 2023-09-21T12:57:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcd9f1a0 0x55c2fcda15c0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d31ffb700 0 client.25850 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd91a90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/1720215671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.571+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 >> 172.21.15.142:0/1720215671 conn(0x55c2fccb2000 msgr2=0x55c2fcd80230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.572+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 shutdown_connections 2023-09-21T12:57:46.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.572+0000 7f8d6418ab80 1 -- 172.21.15.142:0/1720215671 wait complete. 2023-09-21T12:57:46.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.572+0000 7f8d6418ab80 20 client.25850 trim_cache size 0 max 16384 2023-09-21T12:57:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.590+0000 7f8d6418ab80 1 Processor -- start 2023-09-21T12:57:46.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 -- start start 2023-09-21T12:57:46.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcb57920 con 0x55c2fcd8a360 2023-09-21T12:57:46.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcd81ed0 con 0x55c2fcd85610 2023-09-21T12:57:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcd7a990 con 0x55c2fcd85f30 2023-09-21T12:57:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4dd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49840/0 (socket says 172.21.15.142:49840) 2023-09-21T12:57:46.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 -- 172.21.15.142:0/2150264895 learned_addr learned my addr 172.21.15.142:0/2150264895 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 -- 172.21.15.142:0/2150264895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 msgr2=0x55c2fcd8b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 -- 172.21.15.142:0/2150264895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 msgr2=0x55c2fcd8e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4e59b700 1 -- 172.21.15.142:0/2150264895 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2fcb28250 con 0x55c2fcd85610 2023-09-21T12:57:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.591+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.592+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d440122e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=feb75de2760fe262 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.592+0000 7f8d3d7fa700 1 -- 172.21.15.142:0/2150264895 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44017030 con 0x55c2fcd85610 2023-09-21T12:57:46.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.592+0000 7f8d3d7fa700 1 -- 172.21.15.142:0/2150264895 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d44018040 con 0x55c2fcd85610 2023-09-21T12:57:46.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.592+0000 7f8d3d7fa700 1 -- 172.21.15.142:0/2150264895 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440052d0 con 0x55c2fcd85610 2023-09-21T12:57:46.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- 172.21.15.142:0/2150264895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 msgr2=0x55c2fcd96260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8d44000c00 tx=0x7f8d440122e0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- 172.21.15.142:0/2150264895 shutdown_connections 2023-09-21T12:57:46.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd8a360 0x55c2fcd8e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd96260 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/2150264895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd85f30 0x55c2fcd8b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- 172.21.15.142:0/2150264895 >> 172.21.15.142:0/2150264895 conn(0x55c2fccb2000 msgr2=0x55c2fcd9b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- 172.21.15.142:0/2150264895 shutdown_connections 2023-09-21T12:57:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- 172.21.15.142:0/2150264895 wait complete. 2023-09-21T12:57:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 -- start start 2023-09-21T12:57:46.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.593+0000 7f8d6418ab80 1 Processor -- start 2023-09-21T12:57:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd90af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd91030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcd96830 con 0x55c2fcd85f30 2023-09-21T12:57:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcdf2ff0 con 0x55c2fcd85610 2023-09-21T12:57:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2fcdf3160 con 0x55c2fcd8a360 2023-09-21T12:57:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d6418ab80 10 client.0 _ll_register_callbacks cb 0x55c2fcbbda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49844/0 (socket says 172.21.15.142:49844) 2023-09-21T12:57:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 -- 172.21.15.142:0/504854234 learned_addr learned my addr 172.21.15.142:0/504854234 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd91030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 -- 172.21.15.142:0/504854234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 msgr2=0x55c2fcd91030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd91030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 -- 172.21.15.142:0/504854234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 msgr2=0x55c2fcd90af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.594+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd90af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d4e59b700 1 -- 172.21.15.142:0/504854234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2fcb01de0 con 0x55c2fcd85610 2023-09-21T12:57:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d4ed9c700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd91030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:46.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d4e59b700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d44012d70 tx=0x7f8d44009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9af4f3302375d1c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44017040 con 0x55c2fcd85610 2023-09-21T12:57:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d3809ab20 con 0x55c2fcd85610 2023-09-21T12:57:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.595+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8d44004ae0 con 0x55c2fcd85610 2023-09-21T12:57:46.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.599+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d4400faa0 con 0x55c2fcd85610 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.599+0000 7f8d6418ab80 10 client.25856 fetch_fsmap learned FSMap version 23 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.599+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55c2fcaeac60 con 0x55c2fcd85610 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.599+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d3809ab20 con 0x55c2fcd85610 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.599+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 23) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8d4401c780 con 0x55c2fcd85610 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 10 client.25856 fetch_fsmap finished waiting for FSMap version 23 2023-09-21T12:57:46.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 10 client.25856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 20 client.25856 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcdf4530 0x55c2fcdf6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 4 client.25856 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c2fcccfe60 con 0x55c2fcdf4530 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcdf4530 0x55c2fcdf6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d31ffb700 10 client.25856 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.600+0000 7f8d4dd9a700 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcdf4530 0x55c2fcdf6920 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fe6e7b6e167098 server_cookie=49431edb86328fb2 in_seq=0 out_seq=0 2023-09-21T12:57:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d31ffb700 1 -- 172.21.15.142:0/504854234 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c2fcccfe60 con 0x55c2fcdf4530 2023-09-21T12:57:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d31ffb700 10 client.25856 handle_command_reply: tid=0 2023-09-21T12:57:46.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 client.25856 shutdown 2023-09-21T12:57:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 msgr2=0x55c2fcd905b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8d44012d70 tx=0x7f8d44009380 comp rx=0 tx=0).stop 2023-09-21T12:57:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 shutdown_connections 2023-09-21T12:57:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c2fcdf4530 0x55c2fcdf6920 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c2fcd8a360 0x55c2fcd91030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c2fcd85610 0x55c2fcd905b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 --2- 172.21.15.142:0/504854234 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c2fcd85f30 0x55c2fcd90af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d31ffb700 0 client.25856 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 >> 172.21.15.142:0/504854234 conn(0x55c2fccb2000 msgr2=0x55c2fcd8e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 shutdown_connections 2023-09-21T12:57:46.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 1 -- 172.21.15.142:0/504854234 wait complete. 2023-09-21T12:57:46.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.602+0000 7f8d6418ab80 20 client.25856 trim_cache size 0 max 16384 2023-09-21T12:57:46.613 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:46.613 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:57:46.614 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:57:46.614 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:46.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 msgr2=0x7f8d340a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 0x7f8d340a2d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8d4806a2e0 tx=0x7f8d400099e0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 msgr2=0x7f8d4819d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8d38009230 tx=0x7f8d3800fa00 comp rx=0 tx=0).stop 2023-09-21T12:57:46.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 shutdown_connections 2023-09-21T12:57:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8d340a08d0 0x7f8d340a2d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d48111d10 0x7f8d481a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d48073180 0x7f8d4819d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 --2- 172.21.15.142:0/1590090233 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d48073aa0 0x7f8d4819d9a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 >> 172.21.15.142:0/1590090233 conn(0x7f8d480fc7f0 msgr2=0x7f8d480fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.603+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 shutdown_connections 2023-09-21T12:57:46.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.604+0000 7f8d507ff700 1 -- 172.21.15.142:0/1590090233 wait complete. 2023-09-21T12:57:46.633 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:57:46.634 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:57:46.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:46 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:57:46.666 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:46 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:46 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:57:46.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:46 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.667 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:46 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:57:46.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 74680 15.60 MB/sec warmup 27 sec latency 54.106 ms 2023-09-21T12:57:46.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/3192162372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04101980 msgr2=0x7f8d041059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/3192162372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04101980 0x7f8d041059c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009990 tx=0x7f8cf8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/3192162372 shutdown_connections 2023-09-21T12:57:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/3192162372 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d041060f0 0x7f8d0410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/3192162372 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d04100fd0 0x7f8d041013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/3192162372 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04101980 0x7f8d041059c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/3192162372 >> 172.21.15.142:0/3192162372 conn(0x7f8d040fc890 msgr2=0x7f8d040fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/3192162372 shutdown_connections 2023-09-21T12:57:46.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.848+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/3192162372 wait complete. 2023-09-21T12:57:46.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 Processor -- start 2023-09-21T12:57:46.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 -- start start 2023-09-21T12:57:46.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 0x7f8d04199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 0x7f8d0419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419e490 con 0x7f8d04100fd0 2023-09-21T12:57:46.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419e600 con 0x7f8d041060f0 2023-09-21T12:57:46.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.849+0000 7f8d0a5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419e7c0 con 0x7f8d0419da10 2023-09-21T12:57:46.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59072/0 (socket says 172.21.15.142:59072) 2023-09-21T12:57:46.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 -- 172.21.15.142:0/1227287393 learned_addr learned my addr 172.21.15.142:0/1227287393 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:46.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d08b9c700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 0x7f8d0419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d037fe700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 0x7f8d04199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 -- 172.21.15.142:0/1227287393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 msgr2=0x7f8d0419de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 0x7f8d0419de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 -- 172.21.15.142:0/1227287393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 msgr2=0x7f8d04199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:46.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 0x7f8d04199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:46.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 -- 172.21.15.142:0/1227287393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009520 con 0x7f8d04100fd0 2023-09-21T12:57:46.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d08b9c700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 0x7f8d0419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:46.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d037fe700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 0x7f8d04199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:46.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.850+0000 7f8d03fff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400eb30 tx=0x7f8cf400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.851+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4009880 con 0x7f8d04100fd0 2023-09-21T12:57:46.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.851+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf80095f0 con 0x7f8d04100fd0 2023-09-21T12:57:46.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.851+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8cf40044e0 con 0x7f8d04100fd0 2023-09-21T12:57:46.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.851+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4003d80 con 0x7f8d04100fd0 2023-09-21T12:57:46.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.851+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d041a6070 con 0x7f8d04100fd0 2023-09-21T12:57:46.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.852+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d04067bd0 con 0x7f8d04100fd0 2023-09-21T12:57:46.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.854+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8cf4003f20 con 0x7f8d04100fd0 2023-09-21T12:57:46.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.856+0000 7f8d017fa700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 0x7f8cec0a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:46.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.856+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8cf4014070 con 0x7f8d04100fd0 2023-09-21T12:57:46.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.856+0000 7f8d037fe700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 0x7f8cec0a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:46.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.857+0000 7f8d037fe700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 0x7f8cec0a2cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d0419a680 tx=0x7f8cf8005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:46.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:46.860+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8cf4095cd0 con 0x7f8d04100fd0 2023-09-21T12:57:46.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:46 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:57:46.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:46 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:46 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:57:46.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:46 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:46 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:57:46.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:46 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:57:46.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:46 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:46 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:57:46.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:46 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:46.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:46 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:57:47.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.104+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d0419a430 con 0x7f8d04100fd0 2023-09-21T12:57:47.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.105+0000 7f8d017fa700 1 -- 172.21.15.142:0/1227287393 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f8cf40992f0 con 0x7f8d04100fd0 2023-09-21T12:57:47.105 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:57:47.105 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:57:46.421112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:57:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.107+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 msgr2=0x7f8cec0a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.107+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 0x7f8cec0a2cb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8d0419a680 tx=0x7f8cf8005fd0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 msgr2=0x7f8d041990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cf400eb30 tx=0x7f8cf400ee40 comp rx=0 tx=0).stop 2023-09-21T12:57:47.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 shutdown_connections 2023-09-21T12:57:47.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8cec0a07f0 0x7f8cec0a2cb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8d04100fd0 0x7f8d041990e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d0419da10 0x7f8d0419de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 --2- 172.21.15.142:0/1227287393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8d041060f0 0x7f8d04199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 >> 172.21.15.142:0/1227287393 conn(0x7f8d040fc890 msgr2=0x7f8d040fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 shutdown_connections 2023-09-21T12:57:47.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.108+0000 7f8d0a5ff700 1 -- 172.21.15.142:0/1227287393 wait complete. 2023-09-21T12:57:47.110 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-21T12:57:47.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:57:47.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.367+0000 7f63fbfff700 1 -- 172.21.15.142:0/2823351518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 msgr2=0x7f63f4101350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.367+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2823351518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f4101350 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63f00098f0 tx=0x7f63f0009c00 comp rx=0 tx=0).stop 2023-09-21T12:57:47.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 -- 172.21.15.142:0/2823351518 shutdown_connections 2023-09-21T12:57:47.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2823351518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f410dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2823351518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f4101350 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2823351518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4101920 0x7f63f4105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 -- 172.21.15.142:0/2823351518 >> 172.21.15.142:0/2823351518 conn(0x7f63f40fc7f0 msgr2=0x7f63f40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 -- 172.21.15.142:0/2823351518 shutdown_connections 2023-09-21T12:57:47.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.368+0000 7f63fbfff700 1 -- 172.21.15.142:0/2823351518 wait complete. 2023-09-21T12:57:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 Processor -- start 2023-09-21T12:57:47.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 -- start start 2023-09-21T12:57:47.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4073b60 0x7f63f41a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41a5740 con 0x7f63f4106090 2023-09-21T12:57:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41a58b0 con 0x7f63f4100f70 2023-09-21T12:57:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.369+0000 7f63fbfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f41a5a70 con 0x7f63f4073b60 2023-09-21T12:57:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59100/0 (socket says 172.21.15.142:59100) 2023-09-21T12:57:47.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f959a700 1 -- 172.21.15.142:0/2922644272 learned_addr learned my addr 172.21.15.142:0/2922644272 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63fa59c700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4073b60 0x7f63f41a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 -- 172.21.15.142:0/2922644272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4073b60 msgr2=0x7f63f41a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4073b60 0x7f63f41a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 -- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 msgr2=0x7f63f4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 -- 172.21.15.142:0/2922644272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e4009520 con 0x7f63f4100f70 2023-09-21T12:57:47.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f959a700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f40730e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009810 tx=0x7f63f000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63eaffd700 1 -- 172.21.15.142:0/2922644272 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f001c070 con 0x7f63f4100f70 2023-09-21T12:57:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63eaffd700 1 -- 172.21.15.142:0/2922644272 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63f000bba0 con 0x7f63f4100f70 2023-09-21T12:57:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63eaffd700 1 -- 172.21.15.142:0/2922644272 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0003970 con 0x7f63f4100f70 2023-09-21T12:57:47.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.370+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec009d00 con 0x7f63f4100f70 2023-09-21T12:57:47.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.371+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0009520 con 0x7f63f4100f70 2023-09-21T12:57:47.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.374+0000 7f63eaffd700 1 -- 172.21.15.142:0/2922644272 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f63f0020030 con 0x7f63f4100f70 2023-09-21T12:57:47.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.375+0000 7f640f890b80 1 Processor -- start 2023-09-21T12:57:47.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.375+0000 7f63eaffd700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 0x7f63e00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.375+0000 7f63eaffd700 1 -- 172.21.15.142:0/2922644272 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f63f00ccd30 con 0x7f63f4100f70 2023-09-21T12:57:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.375+0000 7f640f890b80 1 -- start start 2023-09-21T12:57:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.375+0000 7f63fa59c700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 0x7f63e00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837dd360 0x5607837dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078374cca0 con 0x5607837d8610 2023-09-21T12:57:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560783730c70 con 0x5607837d8f30 2023-09-21T12:57:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f640f890b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078372e590 con 0x5607837dd360 2023-09-21T12:57:47.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59106/0 (socket says 172.21.15.142:59106) 2023-09-21T12:57:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 -- 172.21.15.142:0/286968024 learned_addr learned my addr 172.21.15.142:0/286968024 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63fa59c700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 0x7f63e00a2cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009fd0 tx=0x7f63ec00b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63fa59c700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837dd360 0x5607837dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f959a700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 -- 172.21.15.142:0/286968024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837dd360 msgr2=0x5607837dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837dd360 0x5607837dd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 -- 172.21.15.142:0/286968024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 msgr2=0x5607837dce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837dce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f9d9b700 1 -- 172.21.15.142:0/286968024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560783554de0 con 0x5607837d8610 2023-09-21T12:57:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.376+0000 7f63f959a700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63f0096cb0 tx=0x7f63f0005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=142ad13b3d72440a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f63dffff700 1 -- 172.21.15.142:0/286968024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f009a940 con 0x5607837d8610 2023-09-21T12:57:47.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f63dffff700 1 -- 172.21.15.142:0/286968024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63f009a240 con 0x5607837d8610 2023-09-21T12:57:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f63dffff700 1 -- 172.21.15.142:0/286968024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00ca6d0 con 0x5607837d8610 2023-09-21T12:57:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 -- 172.21.15.142:0/286968024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 msgr2=0x5607837d89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63f0096cb0 tx=0x7f63f0005600 comp rx=0 tx=0).stop 2023-09-21T12:57:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 -- 172.21.15.142:0/286968024 shutdown_connections 2023-09-21T12:57:47.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837d89f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837dd360 0x5607837dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.377+0000 7f640f890b80 1 --2- 172.21.15.142:0/286968024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.378+0000 7f640f890b80 1 -- 172.21.15.142:0/286968024 >> 172.21.15.142:0/286968024 conn(0x560783705000 msgr2=0x5607837d36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.378+0000 7f640f890b80 1 -- 172.21.15.142:0/286968024 shutdown_connections 2023-09-21T12:57:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.378+0000 7f640f890b80 1 -- 172.21.15.142:0/286968024 wait complete. 2023-09-21T12:57:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.378+0000 7f640f890b80 1 -- start start 2023-09-21T12:57:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.378+0000 7f640f890b80 1 Processor -- start 2023-09-21T12:57:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837e4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560783729e80 con 0x5607837d8f30 2023-09-21T12:57:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607836c6740 con 0x5607837dd360 2023-09-21T12:57:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607836c63e0 con 0x5607837d8610 2023-09-21T12:57:47.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f640f890b80 10 client.0 _ll_register_callbacks cb 0x560783610a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59120/0 (socket says 172.21.15.142:59120) 2023-09-21T12:57:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 -- 172.21.15.142:0/95427102 learned_addr learned my addr 172.21.15.142:0/95427102 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63fa59c700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837e4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 -- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 msgr2=0x5607837e4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837e4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 -- 172.21.15.142:0/95427102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 msgr2=0x5607837e2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.379+0000 7f63f959a700 1 -- 172.21.15.142:0/95427102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f0009520 con 0x5607837d8f30 2023-09-21T12:57:47.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63fa59c700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63f959a700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f63e4012d20 tx=0x7f63e400f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b943cad73edef3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:47.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4017070 con 0x5607837d8f30 2023-09-21T12:57:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56078369abb0 con 0x5607837d8f30 2023-09-21T12:57:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f63e400fc00 con 0x5607837d8f30 2023-09-21T12:57:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63e40122e0 con 0x5607837d8f30 2023-09-21T12:57:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f640f890b80 10 client.15816 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x56078353dc60 con 0x5607837d8f30 2023-09-21T12:57:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.380+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56078369abb0 con 0x5607837d8f30 2023-09-21T12:57:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f63e4010430 con 0x5607837d8f30 2023-09-21T12:57:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 10 client.15816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 20 client.15816 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5607837fa920 0x5607837fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 4 client.15816 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:47.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607837a7020 con 0x5607837fa920 2023-09-21T12:57:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.381+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5607837fa920 0x5607837fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.382+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5607837fa920 0x5607837fcd40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3730119b8d164c7 server_cookie=f10985600c047721 in_seq=0 out_seq=0 2023-09-21T12:57:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.382+0000 7f63dd7fa700 10 client.15816 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.382+0000 7f63dd7fa700 1 -- 172.21.15.142:0/95427102 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607837a7020 con 0x5607837fa920 2023-09-21T12:57:47.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.382+0000 7f63dd7fa700 10 client.15816 handle_command_reply: tid=0 2023-09-21T12:57:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.382+0000 7f640f890b80 1 client.15816 shutdown 2023-09-21T12:57:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 msgr2=0x5607837e1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f63e4012d20 tx=0x7f63e400f6a0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 shutdown_connections 2023-09-21T12:57:47.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5607837fa920 0x5607837fcd40 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837e4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 --2- 172.21.15.142:0/95427102 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8f30 0x5607837e1d90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f63dd7fa700 0 client.15816 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:47.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 >> 172.21.15.142:0/95427102 conn(0x560783705000 msgr2=0x5607837d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 shutdown_connections 2023-09-21T12:57:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 1 -- 172.21.15.142:0/95427102 wait complete. 2023-09-21T12:57:47.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.383+0000 7f640f890b80 20 client.15816 trim_cache size 0 max 16384 2023-09-21T12:57:47.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.396+0000 7f640f890b80 1 Processor -- start 2023-09-21T12:57:47.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.396+0000 7f640f890b80 1 -- start start 2023-09-21T12:57:47.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8f30 0x5607837de750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607835aa920 con 0x5607837d8610 2023-09-21T12:57:47.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607837f7250 con 0x5607837dd360 2023-09-21T12:57:47.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f640f890b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607837f1fb0 con 0x5607837d8f30 2023-09-21T12:57:47.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59132/0 (socket says 172.21.15.142:59132) 2023-09-21T12:57:47.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 -- 172.21.15.142:0/3380941978 learned_addr learned my addr 172.21.15.142:0/3380941978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f959a700 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8f30 0x5607837de750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63fa59c700 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 -- 172.21.15.142:0/3380941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8f30 msgr2=0x5607837de750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8f30 0x5607837de750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 -- 172.21.15.142:0/3380941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 msgr2=0x5607837e1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.397+0000 7f63f9d9b700 1 -- 172.21.15.142:0/3380941978 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607837cf5b0 con 0x5607837d8610 2023-09-21T12:57:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f63f009a1d0 tx=0x7f63f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cb2fc69030c919 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f63e8ff9700 1 -- 172.21.15.142:0/3380941978 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f00a2220 con 0x5607837d8610 2023-09-21T12:57:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f63e8ff9700 1 -- 172.21.15.142:0/3380941978 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63f00b8170 con 0x5607837d8610 2023-09-21T12:57:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f63e8ff9700 1 -- 172.21.15.142:0/3380941978 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f0005260 con 0x5607837d8610 2023-09-21T12:57:47.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 -- 172.21.15.142:0/3380941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 msgr2=0x5607837f1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f63f009a1d0 tx=0x7f63f0000bc0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 -- 172.21.15.142:0/3380941978 shutdown_connections 2023-09-21T12:57:47.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837d8610 0x5607837f1a70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837dd360 0x5607837e1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 --2- 172.21.15.142:0/3380941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8f30 0x5607837de750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 -- 172.21.15.142:0/3380941978 >> 172.21.15.142:0/3380941978 conn(0x560783705000 msgr2=0x5607837db490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 -- 172.21.15.142:0/3380941978 shutdown_connections 2023-09-21T12:57:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.398+0000 7f640f890b80 1 -- 172.21.15.142:0/3380941978 wait complete. 2023-09-21T12:57:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.399+0000 7f640f890b80 1 -- start start 2023-09-21T12:57:47.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.399+0000 7f640f890b80 1 Processor -- start 2023-09-21T12:57:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.399+0000 7f640f890b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837eda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.399+0000 7f640f890b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.399+0000 7f640f890b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837dd360 0x5607837ee4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f640f890b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607837f1dc0 con 0x5607837dd360 2023-09-21T12:57:47.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f640f890b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078384d700 con 0x5607837d8f30 2023-09-21T12:57:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f640f890b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56078384d840 con 0x5607837d8610 2023-09-21T12:57:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f640f890b80 10 client.0 _ll_register_callbacks cb 0x560783610a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63fa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837dd360 0x5607837ee4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49916/0 (socket says 172.21.15.142:49916) 2023-09-21T12:57:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 -- 172.21.15.142:0/3311718459 learned_addr learned my addr 172.21.15.142:0/3311718459 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 -- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 msgr2=0x5607837eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 -- 172.21.15.142:0/3311718459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837dd360 msgr2=0x5607837ee4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837dd360 0x5607837ee4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 -- 172.21.15.142:0/3311718459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560783554de0 con 0x5607837d8f30 2023-09-21T12:57:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63f959a700 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63e4010890 tx=0x7f63e4005fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b00cd559766832 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.400+0000 7f63dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e4017040 con 0x5607837d8f30 2023-09-21T12:57:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f63e4000e40 con 0x5607837d8f30 2023-09-21T12:57:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63f009a240 con 0x5607837d8f30 2023-09-21T12:57:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63e400fec0 con 0x5607837d8f30 2023-09-21T12:57:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 10 client.25880 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f63f419aeb0 con 0x5607837d8f30 2023-09-21T12:57:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63f009a240 con 0x5607837d8f30 2023-09-21T12:57:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f63e4004710 con 0x5607837d8f30 2023-09-21T12:57:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 10 client.25880 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 10 client.25880 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:57:47.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 20 client.25880 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x56078384efe0 0x560783851400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 4 client.25880 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.401+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560783722e60 con 0x56078384efe0 2023-09-21T12:57:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x56078384efe0 0x560783851400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63dd7fa700 10 client.25880 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63f9d9b700 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x56078384efe0 0x560783851400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ed2fdf810f3963b8 server_cookie=1861ca3096bb9e2e in_seq=0 out_seq=0 2023-09-21T12:57:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63dd7fa700 1 -- 172.21.15.142:0/3311718459 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560783722e60 con 0x56078384efe0 2023-09-21T12:57:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63dd7fa700 10 client.25880 handle_command_reply: tid=0 2023-09-21T12:57:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 client.25880 shutdown 2023-09-21T12:57:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 msgr2=0x5607837edf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f63e4010890 tx=0x7f63e4005fc0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 shutdown_connections 2023-09-21T12:57:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x56078384efe0 0x560783851400 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607837dd360 0x5607837ee4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607837d8610 0x5607837eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 --2- 172.21.15.142:0/3311718459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607837d8f30 0x5607837edf90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f63dd7fa700 0 client.25880 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:57:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 >> 172.21.15.142:0/3311718459 conn(0x560783705000 msgr2=0x5607837e1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 shutdown_connections 2023-09-21T12:57:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.402+0000 7f640f890b80 1 -- 172.21.15.142:0/3311718459 wait complete. 2023-09-21T12:57:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f640f890b80 20 client.25880 trim_cache size 0 max 16384 2023-09-21T12:57:47.425 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 msgr2=0x7f63e00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 0x7f63e00a2cf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f63ec009fd0 tx=0x7f63ec00b040 comp rx=0 tx=0).stop 2023-09-21T12:57:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 msgr2=0x7f63f40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f40730e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009810 tx=0x7f63f000fa00 comp rx=0 tx=0).stop 2023-09-21T12:57:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 shutdown_connections 2023-09-21T12:57:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f63e00a0830 0x7f63e00a2cf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63f4073b60 0x7f63f41a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f63f4100f70 0x7f63f40730e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 --2- 172.21.15.142:0/2922644272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f63f4106090 0x7f63f4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 >> 172.21.15.142:0/2922644272 conn(0x7f63f40fc7f0 msgr2=0x7f63f4104940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 shutdown_connections 2023-09-21T12:57:47.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.403+0000 7f63fbfff700 1 -- 172.21.15.142:0/2922644272 wait complete. 2023-09-21T12:57:47.429 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:57:47.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/1234964938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d78100fc0 msgr2=0x7f5d781013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/1234964938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d78100fc0 0x7f5d781013a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5d68009990 tx=0x7f5d68009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/1234964938 shutdown_connections 2023-09-21T12:57:47.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/1234964938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d781060e0 0x7f5d7810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/1234964938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d78100fc0 0x7f5d781013a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/1234964938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d78101970 0x7f5d781059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/1234964938 >> 172.21.15.142:0/1234964938 conn(0x7f5d780fc840 msgr2=0x7f5d780fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/1234964938 shutdown_connections 2023-09-21T12:57:47.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.634+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/1234964938 wait complete. 2023-09-21T12:57:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.635+0000 7f5d7e9ff700 1 Processor -- start 2023-09-21T12:57:47.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.635+0000 7f5d7e9ff700 1 -- start start 2023-09-21T12:57:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d781060e0 0x7f5d781995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 0x7f5d7819deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7819e4b0 con 0x7f5d78100fc0 2023-09-21T12:57:47.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7819e620 con 0x7f5d7819da30 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7e9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7819e7e0 con 0x7f5d781060e0 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59160/0 (socket says 172.21.15.142:59160) 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 -- 172.21.15.142:0/212670942 learned_addr learned my addr 172.21.15.142:0/212670942 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d781060e0 0x7f5d781995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 0x7f5d7819deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 -- 172.21.15.142:0/212670942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d781060e0 msgr2=0x7f5d781995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d781060e0 0x7f5d781995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 -- 172.21.15.142:0/212670942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 msgr2=0x7f5d7819deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 0x7f5d7819deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d77fff700 1 -- 172.21.15.142:0/212670942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d60009520 con 0x7f5d78100fc0 2023-09-21T12:57:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.636+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 0x7f5d7819deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d77fff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005910 tx=0x7f5d68005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d75ffb700 1 -- 172.21.15.142:0/212670942 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6801d070 con 0x7f5d78100fc0 2023-09-21T12:57:47.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d70009c40 con 0x7f5d78100fc0 2023-09-21T12:57:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d75ffb700 1 -- 172.21.15.142:0/212670942 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d68022470 con 0x7f5d78100fc0 2023-09-21T12:57:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d75ffb700 1 -- 172.21.15.142:0/212670942 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d68017650 con 0x7f5d78100fc0 2023-09-21T12:57:47.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.637+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d680095f0 con 0x7f5d78100fc0 2023-09-21T12:57:47.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.640+0000 7f5d75ffb700 1 -- 172.21.15.142:0/212670942 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5d680225e0 con 0x7f5d78100fc0 2023-09-21T12:57:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.641+0000 7f5d922beb80 1 Processor -- start 2023-09-21T12:57:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.641+0000 7f5d75ffb700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 0x7f5d640a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.641+0000 7f5d75ffb700 1 -- 172.21.15.142:0/212670942 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5d680cd2f0 con 0x7f5d78100fc0 2023-09-21T12:57:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.641+0000 7f5d922beb80 1 -- start start 2023-09-21T12:57:47.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 0x7f5d640a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d5ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151cccca0 con 0x564151d58f30 2023-09-21T12:57:47.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151cb0c70 con 0x564151d5d360 2023-09-21T12:57:47.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d922beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151cae590 con 0x564151d58610 2023-09-21T12:57:47.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d7cf9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d7cf9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49950/0 (socket says 172.21.15.142:49950) 2023-09-21T12:57:47.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d7cf9c700 1 -- 172.21.15.142:0/3757368986 learned_addr learned my addr 172.21.15.142:0/3757368986 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d77fff700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.642+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d5ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 0x7f5d640a2c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d700079b0 tx=0x7f5d70007d70 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 -- 172.21.15.142:0/3757368986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 msgr2=0x564151d5d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 -- 172.21.15.142:0/3757368986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 msgr2=0x564151d5ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d5ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 -- 172.21.15.142:0/3757368986 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564151ad4de0 con 0x564151d58610 2023-09-21T12:57:47.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d77fff700 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d589f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d680caa10 tx=0x7f5d68009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cf891ea9286d4e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d6e7fc700 1 -- 172.21.15.142:0/3757368986 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6809af00 con 0x564151d58610 2023-09-21T12:57:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d6e7fc700 1 -- 172.21.15.142:0/3757368986 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d6809a800 con 0x564151d58610 2023-09-21T12:57:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.643+0000 7f5d6e7fc700 1 -- 172.21.15.142:0/3757368986 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6809ac80 con 0x564151d58610 2023-09-21T12:57:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- 172.21.15.142:0/3757368986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 msgr2=0x564151d589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d589f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d680caa10 tx=0x7f5d68009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- 172.21.15.142:0/3757368986 shutdown_connections 2023-09-21T12:57:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d5d360 0x564151d5d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d589f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 --2- 172.21.15.142:0/3757368986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d5ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- 172.21.15.142:0/3757368986 >> 172.21.15.142:0/3757368986 conn(0x564151c85000 msgr2=0x564151d536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- 172.21.15.142:0/3757368986 shutdown_connections 2023-09-21T12:57:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- 172.21.15.142:0/3757368986 wait complete. 2023-09-21T12:57:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.644+0000 7f5d922beb80 1 -- start start 2023-09-21T12:57:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 Processor -- start 2023-09-21T12:57:47.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 0x564151d61d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151ca9e80 con 0x564151d5d360 2023-09-21T12:57:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151c46740 con 0x564151d58610 2023-09-21T12:57:47.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151c463e0 con 0x564151d58f30 2023-09-21T12:57:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d922beb80 10 client.0 _ll_register_callbacks cb 0x564151b90a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.645+0000 7f5d7cf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 0x564151d61d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59184/0 (socket says 172.21.15.142:59184) 2023-09-21T12:57:47.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 -- 172.21.15.142:0/1889813242 learned_addr learned my addr 172.21.15.142:0/1889813242 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 0x564151d61d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49482/0 (socket says 172.21.15.142:49482) 2023-09-21T12:57:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d77fff700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 -- 172.21.15.142:0/1889813242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 msgr2=0x564151d61d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 0x564151d61d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 -- 172.21.15.142:0/1889813242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 msgr2=0x564151d64aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d64aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 -- 172.21.15.142:0/1889813242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d700177e0 con 0x564151d5d360 2023-09-21T12:57:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d77fff700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001a6f0 tx=0x7f5d7001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e1da94d025e4cb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d577fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7000e050 con 0x564151d5d360 2023-09-21T12:57:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564151c1abb0 con 0x564151d5d360 2023-09-21T12:57:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.646+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5d7001ae10 con 0x564151d5d360 2023-09-21T12:57:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d700197e0 con 0x564151d5d360 2023-09-21T12:57:47.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 10 client.15834 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f5d680095f0 con 0x564151d5d360 2023-09-21T12:57:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d70031020 con 0x564151d5d360 2023-09-21T12:57:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5d7002da30 con 0x564151d5d360 2023-09-21T12:57:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 10 client.15834 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 10 client.15834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 20 client.15834 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151d72070 0x564151d74490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 4 client.15834 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.647+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564151d27020 con 0x564151d72070 2023-09-21T12:57:47.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.648+0000 7f5d77fff700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151d72070 0x564151d74490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.648+0000 7f5d77fff700 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151d72070 0x564151d74490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56c5d18bcf6a9613 server_cookie=caae138f2a5734b9 in_seq=0 out_seq=0 2023-09-21T12:57:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.648+0000 7f5d577fe700 10 client.15834 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d577fe700 1 -- 172.21.15.142:0/1889813242 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564151d27020 con 0x564151d72070 2023-09-21T12:57:47.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d577fe700 10 client.15834 handle_command_reply: tid=0 2023-09-21T12:57:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 client.15834 shutdown 2023-09-21T12:57:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 msgr2=0x564151d62360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5d7001a6f0 tx=0x7f5d7001a000 comp rx=0 tx=0).stop 2023-09-21T12:57:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 shutdown_connections 2023-09-21T12:57:47.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d62360 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151d72070 0x564151d74490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 --2- 172.21.15.142:0/1889813242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58f30 0x564151d61d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d577fe700 0 client.15834 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:47.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 >> 172.21.15.142:0/1889813242 conn(0x564151c85000 msgr2=0x564151d53290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 shutdown_connections 2023-09-21T12:57:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 1 -- 172.21.15.142:0/1889813242 wait complete. 2023-09-21T12:57:47.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.649+0000 7f5d922beb80 20 client.15834 trim_cache size 0 max 16384 2023-09-21T12:57:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 Processor -- start 2023-09-21T12:57:47.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 -- start start 2023-09-21T12:57:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d69200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d5d360 0x564151d64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151b2a920 con 0x564151d58f30 2023-09-21T12:57:47.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151d69740 con 0x564151d58610 2023-09-21T12:57:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d922beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151d602d0 con 0x564151d5d360 2023-09-21T12:57:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59200/0 (socket says 172.21.15.142:59200) 2023-09-21T12:57:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d6ffff700 1 -- 172.21.15.142:0/211827056 learned_addr learned my addr 172.21.15.142:0/211827056 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d5d360 0x564151d64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.663+0000 7f5d77fff700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d69200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 -- 172.21.15.142:0/211827056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d5d360 msgr2=0x564151d64aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d5d360 0x564151d64aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 -- 172.21.15.142:0/211827056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 msgr2=0x564151d69200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d69200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 -- 172.21.15.142:0/211827056 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564151d4f5b0 con 0x564151d58f30 2023-09-21T12:57:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d77fff700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d69200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5d60004120 tx=0x7f5d60004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b347f51e253df9c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6effd700 1 -- 172.21.15.142:0/211827056 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60003cf0 con 0x564151d58f30 2023-09-21T12:57:47.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6effd700 1 -- 172.21.15.142:0/211827056 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5d60018040 con 0x564151d58f30 2023-09-21T12:57:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.664+0000 7f5d6effd700 1 -- 172.21.15.142:0/211827056 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60005610 con 0x564151d58f30 2023-09-21T12:57:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- 172.21.15.142:0/211827056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 msgr2=0x564151d64560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5d60004120 tx=0x7f5d60004430 comp rx=0 tx=0).stop 2023-09-21T12:57:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- 172.21.15.142:0/211827056 shutdown_connections 2023-09-21T12:57:47.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d5d360 0x564151d64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58610 0x564151d69200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 --2- 172.21.15.142:0/211827056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d58f30 0x564151d64560 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- 172.21.15.142:0/211827056 >> 172.21.15.142:0/211827056 conn(0x564151c85000 msgr2=0x564151d5f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- 172.21.15.142:0/211827056 shutdown_connections 2023-09-21T12:57:47.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- 172.21.15.142:0/211827056 wait complete. 2023-09-21T12:57:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 -- start start 2023-09-21T12:57:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.665+0000 7f5d922beb80 1 Processor -- start 2023-09-21T12:57:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d68950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d67090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151d67770 con 0x564151d5d360 2023-09-21T12:57:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151d678e0 con 0x564151d58f30 2023-09-21T12:57:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564151d67aa0 con 0x564151d58610 2023-09-21T12:57:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d922beb80 10 client.0 _ll_register_callbacks cb 0x564151b90a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d6ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49970/0 (socket says 172.21.15.142:49970) 2023-09-21T12:57:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d6ffff700 1 -- 172.21.15.142:0/2882893987 learned_addr learned my addr 172.21.15.142:0/2882893987 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d7cf9c700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d67090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.666+0000 7f5d77fff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d68950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 -- 172.21.15.142:0/2882893987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 msgr2=0x564151d68950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d68950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 -- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 msgr2=0x564151d67090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d67090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 -- 172.21.15.142:0/2882893987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d60009d90 con 0x564151d58f30 2023-09-21T12:57:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d6ffff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d600040f0 tx=0x7f5d60005420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16228f2a95407a24 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d577fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d60004b60 con 0x564151d58f30 2023-09-21T12:57:47.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564151d6ea80 con 0x564151d58f30 2023-09-21T12:57:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5d600056c0 con 0x564151d58f30 2023-09-21T12:57:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d60004cc0 con 0x564151d58f30 2023-09-21T12:57:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d922beb80 10 client.25898 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.667+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564151abdc60 con 0x564151d58f30 2023-09-21T12:57:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564151d6ea80 con 0x564151d58f30 2023-09-21T12:57:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5d60024040 con 0x564151d58f30 2023-09-21T12:57:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 10 client.25898 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 10 client.25898 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:57:47.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 20 client.25898 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151dc6fa0 0x564151dc93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 4 client.25898 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f5d6809a800 con 0x564151dc6fa0 2023-09-21T12:57:47.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.668+0000 7f5d77fff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151dc6fa0 0x564151dc93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d77fff700 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151dc6fa0 0x564151dc93c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=848cea836cbf265f server_cookie=97b3f0c0ee38c1f1 in_seq=0 out_seq=0 2023-09-21T12:57:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d577fe700 10 client.25898 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d577fe700 1 -- 172.21.15.142:0/2882893987 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f5d6809a800 con 0x564151dc6fa0 2023-09-21T12:57:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d577fe700 10 client.25898 handle_command_reply: tid=0 2023-09-21T12:57:47.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 client.25898 shutdown 2023-09-21T12:57:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 msgr2=0x564151d68e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5d600040f0 tx=0x7f5d60005420 comp rx=0 tx=0).stop 2023-09-21T12:57:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 shutdown_connections 2023-09-21T12:57:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564151d5d360 0x564151d67090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x564151dc6fa0 0x564151dc93c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564151d58610 0x564151d68950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 --2- 172.21.15.142:0/2882893987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564151d58f30 0x564151d68e90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 >> 172.21.15.142:0/2882893987 conn(0x564151c85000 msgr2=0x564151d5c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d577fe700 0 client.25898 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:57:47.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 shutdown_connections 2023-09-21T12:57:47.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 1 -- 172.21.15.142:0/2882893987 wait complete. 2023-09-21T12:57:47.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.669+0000 7f5d922beb80 20 client.25898 trim_cache size 0 max 16384 2023-09-21T12:57:47.690 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:47.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 74680 15.04 MB/sec warmup 28 sec latency 1006.072 ms 2023-09-21T12:57:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 msgr2=0x7f5d640a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 0x7f5d640a2c70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d700079b0 tx=0x7f5d70007d70 comp rx=0 tx=0).stop 2023-09-21T12:57:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 msgr2=0x7f5d78199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5d68005910 tx=0x7f5d68005720 comp rx=0 tx=0).stop 2023-09-21T12:57:47.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 shutdown_connections 2023-09-21T12:57:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5d640a07b0 0x7f5d640a2c70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5d78100fc0 0x7f5d78199090 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5d7819da30 0x7f5d7819deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 --2- 172.21.15.142:0/212670942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d781060e0 0x7f5d781995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 >> 172.21.15.142:0/212670942 conn(0x7f5d780fc840 msgr2=0x7f5d7810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 shutdown_connections 2023-09-21T12:57:47.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.670+0000 7f5d7e9ff700 1 -- 172.21.15.142:0/212670942 wait complete. 2023-09-21T12:57:47.694 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:47 smithi142 ceph-mon[97663]: pgmap v49: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 394 op/s 2023-09-21T12:57:47.695 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:47 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:57:47.695 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:47 smithi142 ceph-mon[97663]: mgrmap e26: x(active, since 92s), standbys: z, y 2023-09-21T12:57:47.695 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1227287393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:47.696 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:57:47.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 -- 172.21.15.142:0/2141295000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef38100fc0 msgr2=0x7fef381013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 --2- 172.21.15.142:0/2141295000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef38100fc0 0x7fef381013a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fef28009990 tx=0x7fef28009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 -- 172.21.15.142:0/2141295000 shutdown_connections 2023-09-21T12:57:47.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 --2- 172.21.15.142:0/2141295000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef381060e0 0x7fef3810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 --2- 172.21.15.142:0/2141295000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef38100fc0 0x7fef381013a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 --2- 172.21.15.142:0/2141295000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef38101970 0x7fef381059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 -- 172.21.15.142:0/2141295000 >> 172.21.15.142:0/2141295000 conn(0x7fef380fc840 msgr2=0x7fef380fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 -- 172.21.15.142:0/2141295000 shutdown_connections 2023-09-21T12:57:47.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.898+0000 7fef3dbff700 1 -- 172.21.15.142:0/2141295000 wait complete. 2023-09-21T12:57:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.899+0000 7fef3dbff700 1 Processor -- start 2023-09-21T12:57:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.899+0000 7fef3dbff700 1 -- start start 2023-09-21T12:57:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef381060e0 0x7fef38199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 0x7fef3819df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3819e540 con 0x7fef38100fc0 2023-09-21T12:57:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3819e6b0 con 0x7fef381060e0 2023-09-21T12:57:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef3dbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3819e870 con 0x7fef3819dac0 2023-09-21T12:57:47.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59216/0 (socket says 172.21.15.142:59216) 2023-09-21T12:57:47.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 -- 172.21.15.142:0/1790057451 learned_addr learned my addr 172.21.15.142:0/1790057451 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef36ffd700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef381060e0 0x7fef38199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef37fff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 0x7fef3819df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 -- 172.21.15.142:0/1790057451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 msgr2=0x7fef3819df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 0x7fef3819df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 -- 172.21.15.142:0/1790057451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef381060e0 msgr2=0x7fef38199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef381060e0 0x7fef38199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef377fe700 1 -- 172.21.15.142:0/1790057451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef280095f0 con 0x7fef38100fc0 2023-09-21T12:57:47.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.900+0000 7fef37fff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 0x7fef3819df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef377fe700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fef28005910 tx=0x7fef28005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef34ff9700 1 -- 172.21.15.142:0/1790057451 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2801d070 con 0x7fef38100fc0 2023-09-21T12:57:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef381a5d70 con 0x7fef38100fc0 2023-09-21T12:57:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef34ff9700 1 -- 172.21.15.142:0/1790057451 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef28022470 con 0x7fef38100fc0 2023-09-21T12:57:47.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef34ff9700 1 -- 172.21.15.142:0/1790057451 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef28017650 con 0x7fef38100fc0 2023-09-21T12:57:47.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.901+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef381a61a0 con 0x7fef38100fc0 2023-09-21T12:57:47.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:47 smithi156 ceph-mon[134078]: pgmap v49: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 394 op/s 2023-09-21T12:57:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:47 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:57:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:47 smithi156 ceph-mon[134078]: mgrmap e26: x(active, since 92s), standbys: z, y 2023-09-21T12:57:47.908 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1227287393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.906+0000 7fef34ff9700 1 -- 172.21.15.142:0/1790057451 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fef280225e0 con 0x7fef38100fc0 2023-09-21T12:57:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 Processor -- start 2023-09-21T12:57:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 -- start start 2023-09-21T12:57:47.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba837ca0 con 0x5581ba8c8360 2023-09-21T12:57:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba81bc70 con 0x5581ba8c3610 2023-09-21T12:57:47.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef51577b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba819590 con 0x5581ba8c3f30 2023-09-21T12:57:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.907+0000 7fef34ff9700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 0x7fef200a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef36ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef36ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59220/0 (socket says 172.21.15.142:59220) 2023-09-21T12:57:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef36ffd700 1 -- 172.21.15.142:0/328835624 learned_addr learned my addr 172.21.15.142:0/328835624 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef34ff9700 1 -- 172.21.15.142:0/1790057451 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef280cd300 con 0x7fef38100fc0 2023-09-21T12:57:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef37fff700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef37fff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 0x7fef200a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 -- 172.21.15.142:0/328835624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 msgr2=0x5581ba8c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 -- 172.21.15.142:0/328835624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 msgr2=0x5581ba8c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 -- 172.21.15.142:0/328835624 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ba63fde0 con 0x5581ba8c3f30 2023-09-21T12:57:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef36ffd700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:47.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.908+0000 7fef377fe700 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8c7e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef280caa80 tx=0x7fef28009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=160935749504696e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef1dffb700 1 -- 172.21.15.142:0/328835624 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2809b090 con 0x5581ba8c3f30 2023-09-21T12:57:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef1dffb700 1 -- 172.21.15.142:0/328835624 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2809a990 con 0x5581ba8c3f30 2023-09-21T12:57:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef1dffb700 1 -- 172.21.15.142:0/328835624 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2809abf0 con 0x5581ba8c3f30 2023-09-21T12:57:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 -- 172.21.15.142:0/328835624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 msgr2=0x5581ba8c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef37fff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 0x7fef200a2c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef30014ab0 tx=0x7fef3000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8c7e20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef280caa80 tx=0x7fef28009310 comp rx=0 tx=0).stop 2023-09-21T12:57:47.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 -- 172.21.15.142:0/328835624 shutdown_connections 2023-09-21T12:57:47.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 --2- 172.21.15.142:0/328835624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8c7e20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 -- 172.21.15.142:0/328835624 >> 172.21.15.142:0/328835624 conn(0x5581ba7f0000 msgr2=0x5581ba8be6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 -- 172.21.15.142:0/328835624 shutdown_connections 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.909+0000 7fef51577b80 1 -- 172.21.15.142:0/328835624 wait complete. 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.910+0000 7fef51577b80 1 -- start start 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.910+0000 7fef51577b80 1 Processor -- start 2023-09-21T12:57:47.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba814e80 con 0x5581ba8c8360 2023-09-21T12:57:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba7b1740 con 0x5581ba8c3610 2023-09-21T12:57:47.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba7b13e0 con 0x5581ba8c3f30 2023-09-21T12:57:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef51577b80 10 client.0 _ll_register_callbacks cb 0x5581ba6fba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef36ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef36ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8ccc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49530/0 (socket says 172.21.15.142:49530) 2023-09-21T12:57:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50014/0 (socket says 172.21.15.142:50014) 2023-09-21T12:57:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef36ffd700 1 -- 172.21.15.142:0/1715529366 learned_addr learned my addr 172.21.15.142:0/1715529366 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 -- 172.21.15.142:0/1715529366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 msgr2=0x5581ba8ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 -- 172.21.15.142:0/1715529366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 msgr2=0x5581ba8cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 -- 172.21.15.142:0/1715529366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c009920 con 0x5581ba8c3610 2023-09-21T12:57:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef377fe700 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28009380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a048972d7a5a6b9b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.911+0000 7fef16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:47.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2809adf0 con 0x5581ba8c3610 2023-09-21T12:57:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef2809e7c0 con 0x5581ba8c3610 2023-09-21T12:57:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581ba785bb0 con 0x5581ba8c3610 2023-09-21T12:57:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef280a2970 con 0x5581ba8c3610 2023-09-21T12:57:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 10 client.25910 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fef381a61a0 con 0x5581ba8c3610 2023-09-21T12:57:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5581ba785bb0 con 0x5581ba8c3610 2023-09-21T12:57:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fef28096810 con 0x5581ba8c3610 2023-09-21T12:57:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 10 client.25910 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 10 client.25910 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:47.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 20 client.25910 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba8dcb80 0x5581ba8def70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 4 client.25910 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.912+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581ba892020 con 0x5581ba8dcb80 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.913+0000 7fef36ffd700 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba8dcb80 0x5581ba8def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.913+0000 7fef36ffd700 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba8dcb80 0x5581ba8def70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6b5c255b2fea568 server_cookie=8a53f3c7f206293f in_seq=0 out_seq=0 2023-09-21T12:57:47.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.913+0000 7fef16ffd700 10 client.25910 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef16ffd700 1 -- 172.21.15.142:0/1715529366 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5581ba892020 con 0x5581ba8dcb80 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef16ffd700 10 client.25910 handle_command_reply: tid=0 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 client.25910 shutdown 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 msgr2=0x5581ba8cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fef28000c00 tx=0x7fef28009380 comp rx=0 tx=0).stop 2023-09-21T12:57:47.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 shutdown_connections 2023-09-21T12:57:47.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba8dcb80 0x5581ba8def70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c8360 0x5581ba8cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef16ffd700 0 client.25910 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:47.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c3610 0x5581ba8cfa70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 --2- 172.21.15.142:0/1715529366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 >> 172.21.15.142:0/1715529366 conn(0x5581ba7f0000 msgr2=0x5581ba8be230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 shutdown_connections 2023-09-21T12:57:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 1 -- 172.21.15.142:0/1715529366 wait complete. 2023-09-21T12:57:47.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.914+0000 7fef51577b80 20 client.25910 trim_cache size 0 max 16384 2023-09-21T12:57:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 Processor -- start 2023-09-21T12:57:47.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 -- start start 2023-09-21T12:57:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8c6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba695920 con 0x5581ba8c3610 2023-09-21T12:57:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba8cdc40 con 0x5581ba8c8360 2023-09-21T12:57:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef51577b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba8bfc60 con 0x5581ba8c3f30 2023-09-21T12:57:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59226/0 (socket says 172.21.15.142:59226) 2023-09-21T12:57:47.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef377fe700 1 -- 172.21.15.142:0/3908979528 learned_addr learned my addr 172.21.15.142:0/3908979528 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef37fff700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.928+0000 7fef36ffd700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 -- 172.21.15.142:0/3908979528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 msgr2=0x5581ba8cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 -- 172.21.15.142:0/3908979528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 msgr2=0x5581ba8c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 -- 172.21.15.142:0/3908979528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581ba628c60 con 0x5581ba8c3610 2023-09-21T12:57:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef37fff700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef377fe700 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fef28005cb0 tx=0x7fef28009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b44eb57666fd6c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef1e7fc700 1 -- 172.21.15.142:0/3908979528 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2809a760 con 0x5581ba8c3610 2023-09-21T12:57:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef1e7fc700 1 -- 172.21.15.142:0/3908979528 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2809b090 con 0x5581ba8c3610 2023-09-21T12:57:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef1e7fc700 1 -- 172.21.15.142:0/3908979528 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef280969c0 con 0x5581ba8c3610 2023-09-21T12:57:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.929+0000 7fef51577b80 1 -- 172.21.15.142:0/3908979528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 msgr2=0x5581ba8be180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fef28005cb0 tx=0x7fef28009310 comp rx=0 tx=0).stop 2023-09-21T12:57:47.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 -- 172.21.15.142:0/3908979528 shutdown_connections 2023-09-21T12:57:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba8be180 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 --2- 172.21.15.142:0/3908979528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba8cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 -- 172.21.15.142:0/3908979528 >> 172.21.15.142:0/3908979528 conn(0x5581ba7f0000 msgr2=0x5581ba8d93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 -- 172.21.15.142:0/3908979528 shutdown_connections 2023-09-21T12:57:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 -- 172.21.15.142:0/3908979528 wait complete. 2023-09-21T12:57:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 -- start start 2023-09-21T12:57:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.930+0000 7fef51577b80 1 Processor -- start 2023-09-21T12:57:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba92a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba8d2790 con 0x5581ba8c3610 2023-09-21T12:57:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba8d28d0 con 0x5581ba8c8360 2023-09-21T12:57:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581ba8d2a60 con 0x5581ba8c3f30 2023-09-21T12:57:47.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef51577b80 10 client.0 _ll_register_callbacks cb 0x5581ba6fba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef377fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59232/0 (socket says 172.21.15.142:59232) 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef377fe700 1 -- 172.21.15.142:0/2085522918 learned_addr learned my addr 172.21.15.142:0/2085522918 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef37fff700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.931+0000 7fef36ffd700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba92a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 -- 172.21.15.142:0/2085522918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 msgr2=0x5581ba92a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba92a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 -- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 msgr2=0x5581ba8d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 -- 172.21.15.142:0/2085522918 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef381a61a0 con 0x5581ba8c3610 2023-09-21T12:57:47.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef377fe700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef280cb000 tx=0x7fef280a2790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c16e32ef4f42eb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:57:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef280998f0 con 0x5581ba8c3610 2023-09-21T12:57:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef2809a990 con 0x5581ba8c3610 2023-09-21T12:57:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef2809e7c0 con 0x5581ba8c3610 2023-09-21T12:57:47.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef2809a760 con 0x5581ba8c3610 2023-09-21T12:57:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef51577b80 10 client.15858 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5581ba666250 con 0x5581ba8c3610 2023-09-21T12:57:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.932+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef2809a990 con 0x5581ba8c3610 2023-09-21T12:57:47.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fef28082070 con 0x5581ba8c3610 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 10 client.15858 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 20 client.15858 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba931440 0x5581ba933830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 4 client.15858 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:57:47.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5581ba80de60 con 0x5581ba931440 2023-09-21T12:57:47.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef36ffd700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba931440 0x5581ba933830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:47.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef16ffd700 10 client.15858 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:47.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.933+0000 7fef36ffd700 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba931440 0x5581ba933830 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd73a516f0ec53c3 server_cookie=67f45727953c1acb in_seq=0 out_seq=0 2023-09-21T12:57:47.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef16ffd700 1 -- 172.21.15.142:0/2085522918 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5581ba80de60 con 0x5581ba931440 2023-09-21T12:57:47.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef16ffd700 10 client.15858 handle_command_reply: tid=0 2023-09-21T12:57:47.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 client.15858 shutdown 2023-09-21T12:57:47.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 msgr2=0x5581ba929bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fef280cb000 tx=0x7fef280a2790 comp rx=0 tx=0).stop 2023-09-21T12:57:47.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 shutdown_connections 2023-09-21T12:57:47.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5581ba931440 0x5581ba933830 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5581ba8c3610 0x5581ba929bf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef16ffd700 0 client.15858 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5581ba8c8360 0x5581ba8d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 --2- 172.21.15.142:0/2085522918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5581ba8c3f30 0x5581ba92a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 >> 172.21.15.142:0/2085522918 conn(0x5581ba7f0000 msgr2=0x5581ba8c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 shutdown_connections 2023-09-21T12:57:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 1 -- 172.21.15.142:0/2085522918 wait complete. 2023-09-21T12:57:47.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.934+0000 7fef51577b80 20 client.15858 trim_cache size 0 max 16384 2023-09-21T12:57:47.956 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:57:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 msgr2=0x7fef200a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 0x7fef200a2c70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fef30014ab0 tx=0x7fef3000b040 comp rx=0 tx=0).stop 2023-09-21T12:57:47.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 msgr2=0x7fef38199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fef28005910 tx=0x7fef28005740 comp rx=0 tx=0).stop 2023-09-21T12:57:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 shutdown_connections 2023-09-21T12:57:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef200a07b0 0x7fef200a2c70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef38100fc0 0x7fef38199120 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef3819dac0 0x7fef3819df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 --2- 172.21.15.142:0/1790057451 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef381060e0 0x7fef38199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 >> 172.21.15.142:0/1790057451 conn(0x7fef380fc840 msgr2=0x7fef3810cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 shutdown_connections 2023-09-21T12:57:47.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:47.935+0000 7fef3dbff700 1 -- 172.21.15.142:0/1790057451 wait complete. 2023-09-21T12:57:47.961 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:47 smithi160 ceph-mon[134450]: pgmap v49: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.0 MiB/s wr, 394 op/s 2023-09-21T12:57:47.961 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:47 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T12:57:47.961 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:47 smithi160 ceph-mon[134450]: mgrmap e26: x(active, since 92s), standbys: z, y 2023-09-21T12:57:47.962 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1227287393' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:57:48.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 75012 14.57 MB/sec warmup 29 sec latency 1591.874 ms 2023-09-21T12:57:48.962 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:57:48.962 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:57:49.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 -- 172.21.15.142:0/250622518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2130101950 msgr2=0x7f2130105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 --2- 172.21.15.142:0/250622518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2130101950 0x7f2130105990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2124009990 tx=0x7f2124009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 -- 172.21.15.142:0/250622518 shutdown_connections 2023-09-21T12:57:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 --2- 172.21.15.142:0/250622518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2130100fa0 0x7f2130101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 --2- 172.21.15.142:0/250622518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301060c0 0x7f213010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 --2- 172.21.15.142:0/250622518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2130101950 0x7f2130105990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 -- 172.21.15.142:0/250622518 >> 172.21.15.142:0/250622518 conn(0x7f21300fc860 msgr2=0x7f21300fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.201+0000 7f21359ff700 1 -- 172.21.15.142:0/250622518 shutdown_connections 2023-09-21T12:57:49.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.202+0000 7f21359ff700 1 -- 172.21.15.142:0/250622518 wait complete. 2023-09-21T12:57:49.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 Processor -- start 2023-09-21T12:57:49.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 -- start start 2023-09-21T12:57:49.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21301060c0 0x7f21301995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f213019da50 0x7f213019ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019e4d0 con 0x7f21301060c0 2023-09-21T12:57:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019e640 con 0x7f213019da50 2023-09-21T12:57:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f21359ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213019e800 con 0x7f2130100fa0 2023-09-21T12:57:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f212effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f212effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49570/0 (socket says 172.21.15.142:49570) 2023-09-21T12:57:49.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f212effd700 1 -- 172.21.15.142:0/1995202549 learned_addr learned my addr 172.21.15.142:0/1995202549 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f212e7fc700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21301060c0 0x7f21301995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.203+0000 7f212f7fe700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f213019da50 0x7f213019ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 -- 172.21.15.142:0/1995202549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f213019da50 msgr2=0x7f213019ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f213019da50 0x7f213019ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 -- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21301060c0 msgr2=0x7f21301995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21301060c0 0x7f21301995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 -- 172.21.15.142:0/1995202549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21240095f0 con 0x7f2130100fa0 2023-09-21T12:57:49.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f212effd700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f212000e9a0 tx=0x7f212000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f21349fd700 1 -- 172.21.15.142:0/1995202549 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120009790 con 0x7f2130100fa0 2023-09-21T12:57:49.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f21349fd700 1 -- 172.21.15.142:0/1995202549 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2120010430 con 0x7f2130100fa0 2023-09-21T12:57:49.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.204+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21301a5d60 con 0x7f2130100fa0 2023-09-21T12:57:49.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.205+0000 7f21349fd700 1 -- 172.21.15.142:0/1995202549 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120018680 con 0x7f2130100fa0 2023-09-21T12:57:49.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.205+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21301a61e0 con 0x7f2130100fa0 2023-09-21T12:57:49.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.208+0000 7f21349fd700 1 -- 172.21.15.142:0/1995202549 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f21200105a0 con 0x7f2130100fa0 2023-09-21T12:57:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.210+0000 7f21349fd700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 0x7f21180a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.210+0000 7f21493b1b80 1 Processor -- start 2023-09-21T12:57:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.210+0000 7f21349fd700 1 -- 172.21.15.142:0/1995202549 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2120014070 con 0x7f2130100fa0 2023-09-21T12:57:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.210+0000 7f21493b1b80 1 -- start start 2023-09-21T12:57:49.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.210+0000 7f212e7fc700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 0x7f21180a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 0x559caf3f3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3f43e0 0x559caf3f4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf363d20 con 0x559caf3effb0 2023-09-21T12:57:49.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf347cf0 con 0x559caf3ef690 2023-09-21T12:57:49.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f21493b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf345610 con 0x559caf3f43e0 2023-09-21T12:57:49.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50056/0 (socket says 172.21.15.142:50056) 2023-09-21T12:57:49.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 -- 172.21.15.142:0/1454294167 learned_addr learned my addr 172.21.15.142:0/1454294167 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212f7fe700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3f43e0 0x559caf3f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212e7fc700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 0x7f21180a2c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f213019a6c0 tx=0x7f2124005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212e7fc700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 0x559caf3f3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 -- 172.21.15.142:0/1454294167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3f43e0 msgr2=0x559caf3f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3f43e0 0x559caf3f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 -- 172.21.15.142:0/1454294167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 msgr2=0x559caf3f3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 0x559caf3f3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212effd700 1 -- 172.21.15.142:0/1454294167 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559caf16be60 con 0x559caf3ef690 2023-09-21T12:57:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.211+0000 7f212e7fc700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 0x559caf3f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:57:49.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.212+0000 7f212effd700 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2120096040 tx=0x7f2120099000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16f86e61444c25e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.212+0000 7f2115ffb700 1 -- 172.21.15.142:0/1454294167 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212009d400 con 0x559caf3ef690 2023-09-21T12:57:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.212+0000 7f2115ffb700 1 -- 172.21.15.142:0/1454294167 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21200a1640 con 0x559caf3ef690 2023-09-21T12:57:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.212+0000 7f2115ffb700 1 -- 172.21.15.142:0/1454294167 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200109a0 con 0x559caf3ef690 2023-09-21T12:57:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- 172.21.15.142:0/1454294167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 msgr2=0x559caf3efa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2120096040 tx=0x7f2120099000 comp rx=0 tx=0).stop 2023-09-21T12:57:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- 172.21.15.142:0/1454294167 shutdown_connections 2023-09-21T12:57:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3f43e0 0x559caf3f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3ef690 0x559caf3efa70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 --2- 172.21.15.142:0/1454294167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3effb0 0x559caf3f3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- 172.21.15.142:0/1454294167 >> 172.21.15.142:0/1454294167 conn(0x559caf31c080 msgr2=0x559caf3ea720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- 172.21.15.142:0/1454294167 shutdown_connections 2023-09-21T12:57:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- 172.21.15.142:0/1454294167 wait complete. 2023-09-21T12:57:49.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.213+0000 7f21493b1b80 1 -- start start 2023-09-21T12:57:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 Processor -- start 2023-09-21T12:57:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf3f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3f9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf340f00 con 0x559caf3f43e0 2023-09-21T12:57:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf2dd7c0 con 0x559caf3effb0 2023-09-21T12:57:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf2dd460 con 0x559caf3ef690 2023-09-21T12:57:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.214+0000 7f21493b1b80 10 client.0 _ll_register_callbacks cb 0x559caf227b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:49.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50064/0 (socket says 172.21.15.142:50064) 2023-09-21T12:57:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 -- 172.21.15.142:0/238761129 learned_addr learned my addr 172.21.15.142:0/238761129 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212f7fe700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212effd700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf3f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 -- 172.21.15.142:0/238761129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 msgr2=0x559caf3f8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf3f8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 -- 172.21.15.142:0/238761129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 msgr2=0x559caf3f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 -- 172.21.15.142:0/238761129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21301a61e0 con 0x559caf3effb0 2023-09-21T12:57:49.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212effd700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf3f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:49.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f212e7fc700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2124009990 tx=0x7f212401a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2591a8216524265f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.215+0000 7f210effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:49.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124030470 con 0x559caf3effb0 2023-09-21T12:57:49.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f21240305d0 con 0x559caf3effb0 2023-09-21T12:57:49.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559caf2b1c30 con 0x559caf3effb0 2023-09-21T12:57:49.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2124030790 con 0x559caf3effb0 2023-09-21T12:57:49.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 10 client.25928 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:49.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559caf154ce0 con 0x559caf3effb0 2023-09-21T12:57:49.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f212403e020 con 0x559caf3effb0 2023-09-21T12:57:49.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f212403a880 con 0x559caf3effb0 2023-09-21T12:57:49.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 10 client.25928 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:49.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 10 client.25928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:49.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 20 client.25928 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:49.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf409470 0x559caf40b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 4 client.25928 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.216+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559caf3be0a0 con 0x559caf409470 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.217+0000 7f212effd700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf409470 0x559caf40b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.217+0000 7f212effd700 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf409470 0x559caf40b890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c28b20b76e0bef4 server_cookie=264087ae1415ecd5 in_seq=0 out_seq=0 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.217+0000 7f210effd700 10 client.25928 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f210effd700 1 -- 172.21.15.142:0/238761129 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559caf3be0a0 con 0x559caf409470 2023-09-21T12:57:49.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f210effd700 10 client.25928 handle_command_reply: tid=0 2023-09-21T12:57:49.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 client.25928 shutdown 2023-09-21T12:57:49.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 msgr2=0x559caf3f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2124009990 tx=0x7f212401a050 comp rx=0 tx=0).stop 2023-09-21T12:57:49.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 shutdown_connections 2023-09-21T12:57:49.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf409470 0x559caf40b890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf3f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 --2- 172.21.15.142:0/238761129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f9410 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 >> 172.21.15.142:0/238761129 conn(0x559caf31c080 msgr2=0x559caf3ea2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f210effd700 0 client.25928 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 shutdown_connections 2023-09-21T12:57:49.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.218+0000 7f21493b1b80 1 -- 172.21.15.142:0/238761129 wait complete. 2023-09-21T12:57:49.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.219+0000 7f21493b1b80 20 client.25928 trim_cache size 0 max 16384 2023-09-21T12:57:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.239+0000 7f21493b1b80 1 Processor -- start 2023-09-21T12:57:49.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.239+0000 7f21493b1b80 1 -- start start 2023-09-21T12:57:49.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf400540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3fa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf1c19a0 con 0x559caf3f43e0 2023-09-21T12:57:49.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf400a80 con 0x559caf3effb0 2023-09-21T12:57:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f21493b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf3f4180 con 0x559caf3ef690 2023-09-21T12:57:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3fa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf400540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf400540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49602/0 (socket says 172.21.15.142:49602) 2023-09-21T12:57:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212effd700 1 -- 172.21.15.142:0/107566536 learned_addr learned my addr 172.21.15.142:0/107566536 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.240+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50066/0 (socket says 172.21.15.142:50066) 2023-09-21T12:57:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 -- 172.21.15.142:0/107566536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 msgr2=0x559caf400540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf400540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 -- 172.21.15.142:0/107566536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 msgr2=0x559caf3fa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3fa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 -- 172.21.15.142:0/107566536 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559caf1922d0 con 0x559caf3effb0 2023-09-21T12:57:49.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f212e7fc700 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2124000c00 tx=0x7f2124009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51591a361c2c8fa6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f21167fc700 1 -- 172.21.15.142:0/107566536 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212403a480 con 0x559caf3effb0 2023-09-21T12:57:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f21167fc700 1 -- 172.21.15.142:0/107566536 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f212403e040 con 0x559caf3effb0 2023-09-21T12:57:49.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.241+0000 7f21167fc700 1 -- 172.21.15.142:0/107566536 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124030c60 con 0x559caf3effb0 2023-09-21T12:57:49.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- 172.21.15.142:0/107566536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 msgr2=0x559caf3f3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2124000c00 tx=0x7f2124009310 comp rx=0 tx=0).stop 2023-09-21T12:57:49.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- 172.21.15.142:0/107566536 shutdown_connections 2023-09-21T12:57:49.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3f43e0 0x559caf3fa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3ef690 0x559caf400540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 --2- 172.21.15.142:0/107566536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3effb0 0x559caf3f3c40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- 172.21.15.142:0/107566536 >> 172.21.15.142:0/107566536 conn(0x559caf31c080 msgr2=0x559caf3f3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- 172.21.15.142:0/107566536 shutdown_connections 2023-09-21T12:57:49.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- 172.21.15.142:0/107566536 wait complete. 2023-09-21T12:57:49.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.242+0000 7f21493b1b80 1 -- start start 2023-09-21T12:57:49.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 Processor -- start 2023-09-21T12:57:49.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3ef690 0x559caf457100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3f43e0 0x559caf4514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf451a80 con 0x559caf3ef690 2023-09-21T12:57:49.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf451bf0 con 0x559caf3f43e0 2023-09-21T12:57:49.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559caf451db0 con 0x559caf3effb0 2023-09-21T12:57:49.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.243+0000 7f21493b1b80 10 client.0 _ll_register_callbacks cb 0x559caf227b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:49.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3ef690 0x559caf457100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3f43e0 0x559caf4514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49608/0 (socket says 172.21.15.142:49608) 2023-09-21T12:57:49.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 -- 172.21.15.142:0/2821057000 learned_addr learned my addr 172.21.15.142:0/2821057000 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 -- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3f43e0 msgr2=0x559caf4514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3f43e0 0x559caf4514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 -- 172.21.15.142:0/2821057000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3ef690 msgr2=0x559caf457100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3ef690 0x559caf457100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 -- 172.21.15.142:0/2821057000 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559caf154ce0 con 0x559caf3effb0 2023-09-21T12:57:49.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f212e7fc700 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21240098e0 tx=0x7f212400bd20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3a568e9d2837b3a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f210effd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.244+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f212403a680 con 0x559caf3effb0 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f212403f080 con 0x559caf3effb0 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21200a1640 con 0x559caf3effb0 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2124030680 con 0x559caf3effb0 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 10 client.25891 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:49.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559caf16a330 con 0x559caf3effb0 2023-09-21T12:57:49.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21200a1640 con 0x559caf3effb0 2023-09-21T12:57:49.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f2124038070 con 0x559caf3effb0 2023-09-21T12:57:49.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 10 client.25891 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:49.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 10 client.25891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:49.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.245+0000 7f21493b1b80 20 client.25891 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:49.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf45eb90 0x559caf460fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f21493b1b80 4 client.25891 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:57:49.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559caf339ee0 con 0x559caf45eb90 2023-09-21T12:57:49.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f212effd700 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf45eb90 0x559caf460fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f212effd700 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf45eb90 0x559caf460fb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e2950879c31a2b server_cookie=2dce103dafe1a19 in_seq=0 out_seq=0 2023-09-21T12:57:49.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.246+0000 7f210effd700 10 client.25891 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f210effd700 1 -- 172.21.15.142:0/2821057000 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559caf339ee0 con 0x559caf45eb90 2023-09-21T12:57:49.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f210effd700 10 client.25891 handle_command_reply: tid=0 2023-09-21T12:57:49.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 client.25891 shutdown 2023-09-21T12:57:49.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 msgr2=0x559caf457640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f21240098e0 tx=0x7f212400bd20 comp rx=0 tx=0).stop 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 shutdown_connections 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559caf45eb90 0x559caf460fb0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559caf3ef690 0x559caf457100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559caf3f43e0 0x559caf4514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 --2- 172.21.15.142:0/2821057000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559caf3effb0 0x559caf457640 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f210effd700 0 client.25891 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.247+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 >> 172.21.15.142:0/2821057000 conn(0x559caf31c080 msgr2=0x559caf3ee490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 shutdown_connections 2023-09-21T12:57:49.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21493b1b80 1 -- 172.21.15.142:0/2821057000 wait complete. 2023-09-21T12:57:49.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21493b1b80 20 client.25891 trim_cache size 0 max 16384 2023-09-21T12:57:49.261 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:57:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "6620a6f4-8e41-42ec-aa6c-e3007748ab0e", 2023-09-21T12:57:49.261 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:57:49.262 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:49.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 msgr2=0x7f21180a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 0x7f21180a2c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f213019a6c0 tx=0x7f2124005fd0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 msgr2=0x7f21301990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f212000e9a0 tx=0x7f212000ecb0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 shutdown_connections 2023-09-21T12:57:49.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f21180a07b0 0x7f21180a2c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f213019da50 0x7f213019ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2130100fa0 0x7f21301990b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.248+0000 7f21359ff700 1 --2- 172.21.15.142:0/1995202549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f21301060c0 0x7f21301995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.249+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 >> 172.21.15.142:0/1995202549 conn(0x7f21300fc860 msgr2=0x7f21300fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.249+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 shutdown_connections 2023-09-21T12:57:49.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.249+0000 7f21359ff700 1 -- 172.21.15.142:0/1995202549 wait complete. 2023-09-21T12:57:49.272 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:57:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 -- 172.21.15.142:0/1311550152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c100fa0 msgr2=0x7f706c101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 --2- 172.21.15.142:0/1311550152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c100fa0 0x7f706c101380 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7068009990 tx=0x7f7068009ca0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 -- 172.21.15.142:0/1311550152 shutdown_connections 2023-09-21T12:57:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 --2- 172.21.15.142:0/1311550152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 0x7f706c10dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 --2- 172.21.15.142:0/1311550152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c100fa0 0x7f706c101380 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 --2- 172.21.15.142:0/1311550152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c101950 0x7f706c105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 -- 172.21.15.142:0/1311550152 >> 172.21.15.142:0/1311550152 conn(0x7f706c0fc860 msgr2=0x7f706c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 -- 172.21.15.142:0/1311550152 shutdown_connections 2023-09-21T12:57:49.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.501+0000 7f70733ff700 1 -- 172.21.15.142:0/1311550152 wait complete. 2023-09-21T12:57:49.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.502+0000 7f70733ff700 1 Processor -- start 2023-09-21T12:57:49.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.502+0000 7f70733ff700 1 -- start start 2023-09-21T12:57:49.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c100fa0 0x7f706c199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 0x7f706c1995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19e490 con 0x7f706c1060c0 2023-09-21T12:57:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19e600 con 0x7f706c19da10 2023-09-21T12:57:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f70733ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19e7c0 con 0x7f706c100fa0 2023-09-21T12:57:49.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50092/0 (socket says 172.21.15.142:50092) 2023-09-21T12:57:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 -- 172.21.15.142:0/3176514795 learned_addr learned my addr 172.21.15.142:0/3176514795 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707099a700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 0x7f706c1995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707119b700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c100fa0 0x7f706c199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 -- 172.21.15.142:0/3176514795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c100fa0 msgr2=0x7f706c199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c100fa0 0x7f706c199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 -- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 msgr2=0x7f706c1995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 0x7f706c1995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.503+0000 7f707199c700 1 -- 172.21.15.142:0/3176514795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c009520 con 0x7f706c19da10 2023-09-21T12:57:49.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f707199c700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f706400ef30 tx=0x7f706400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f70627fc700 1 -- 172.21.15.142:0/3176514795 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7064018070 con 0x7f706c19da10 2023-09-21T12:57:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70680095f0 con 0x7f706c19da10 2023-09-21T12:57:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f70627fc700 1 -- 172.21.15.142:0/3176514795 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f706400f040 con 0x7f706c19da10 2023-09-21T12:57:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f70627fc700 1 -- 172.21.15.142:0/3176514795 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706400cd00 con 0x7f706c19da10 2023-09-21T12:57:49.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.504+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c1a6060 con 0x7f706c19da10 2023-09-21T12:57:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.507+0000 7f70627fc700 1 -- 172.21.15.142:0/3176514795 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7064003a00 con 0x7f706c19da10 2023-09-21T12:57:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.509+0000 7f70627fc700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 0x7f70580a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.509+0000 7f7086d54b80 1 Processor -- start 2023-09-21T12:57:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.509+0000 7f70627fc700 1 -- 172.21.15.142:0/3176514795 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f70640cb9e0 con 0x7f706c19da10 2023-09-21T12:57:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.509+0000 7f707119b700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 0x7f70580a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 -- start start 2023-09-21T12:57:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92f30 0x5601d0f96e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f97360 0x5601d0f977c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0f06ca0 con 0x5601d0f92f30 2023-09-21T12:57:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0eeac70 con 0x5601d0f97360 2023-09-21T12:57:49.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f7086d54b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0ee8590 con 0x5601d0f92610 2023-09-21T12:57:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f707119b700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 0x7f70580a2c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f706800b2e0 tx=0x7f7068005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f707119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f707199c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f97360 0x5601d0f977c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.510+0000 7f707119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49636/0 (socket says 172.21.15.142:49636) 2023-09-21T12:57:49.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707099a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92f30 0x5601d0f96e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 -- 172.21.15.142:0/1080186424 learned_addr learned my addr 172.21.15.142:0/1080186424 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 -- 172.21.15.142:0/1080186424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f97360 msgr2=0x5601d0f977c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f97360 0x5601d0f977c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 -- 172.21.15.142:0/1080186424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92f30 msgr2=0x5601d0f96e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92f30 0x5601d0f96e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 -- 172.21.15.142:0/1080186424 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601d0d0ede0 con 0x5601d0f92610 2023-09-21T12:57:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f707119b700 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7068015000 tx=0x7f7068020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da186847886e2b5e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f70577fe700 1 -- 172.21.15.142:0/1080186424 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068004700 con 0x5601d0f92610 2023-09-21T12:57:49.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f70577fe700 1 -- 172.21.15.142:0/1080186424 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f706801e040 con 0x5601d0f92610 2023-09-21T12:57:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.511+0000 7f70577fe700 1 -- 172.21.15.142:0/1080186424 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706800fa50 con 0x5601d0f92610 2023-09-21T12:57:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 -- 172.21.15.142:0/1080186424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 msgr2=0x5601d0f929f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7068015000 tx=0x7f7068020000 comp rx=0 tx=0).stop 2023-09-21T12:57:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 -- 172.21.15.142:0/1080186424 shutdown_connections 2023-09-21T12:57:49.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f97360 0x5601d0f977c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0f929f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1080186424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92f30 0x5601d0f96e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 -- 172.21.15.142:0/1080186424 >> 172.21.15.142:0/1080186424 conn(0x5601d0ebf000 msgr2=0x5601d0f8d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 -- 172.21.15.142:0/1080186424 shutdown_connections 2023-09-21T12:57:49.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.512+0000 7f7086d54b80 1 -- 172.21.15.142:0/1080186424 wait complete. 2023-09-21T12:57:49.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.513+0000 7f7086d54b80 1 -- start start 2023-09-21T12:57:49.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.513+0000 7f7086d54b80 1 Processor -- start 2023-09-21T12:57:49.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 0x5601d0f9eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f97360 0x5601d0f9c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0ee3e80 con 0x5601d0f92610 2023-09-21T12:57:49.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0e80740 con 0x5601d0f92f30 2023-09-21T12:57:49.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0e803e0 con 0x5601d0f97360 2023-09-21T12:57:49.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f7086d54b80 10 client.0 _ll_register_callbacks cb 0x5601d0dcaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:49.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50104/0 (socket says 172.21.15.142:50104) 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 -- 172.21.15.142:0/1391534020 learned_addr learned my addr 172.21.15.142:0/1391534020 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707199c700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f97360 0x5601d0f9c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707119b700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 0x5601d0f9eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 -- 172.21.15.142:0/1391534020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f97360 msgr2=0x5601d0f9c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f97360 0x5601d0f9c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 -- 172.21.15.142:0/1391534020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 msgr2=0x5601d0f9eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 0x5601d0f9eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.514+0000 7f707099a700 1 -- 172.21.15.142:0/1391534020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c10e4b0 con 0x5601d0f92f30 2023-09-21T12:57:49.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f707119b700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 0x5601d0f9eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f707099a700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f705c0128a0 tx=0x7f705c012bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28ae2252de11206 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7054ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c017070 con 0x5601d0f92f30 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f705c00f670 con 0x5601d0f92f30 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601d0e54bb0 con 0x5601d0f92f30 2023-09-21T12:57:49.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f705c0122e0 con 0x5601d0f92f30 2023-09-21T12:57:49.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7086d54b80 10 client.25946 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:49.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.515+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5601d0cf7c60 con 0x5601d0f92f30 2023-09-21T12:57:49.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5601d0e54bb0 con 0x5601d0f92f30 2023-09-21T12:57:49.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f705c0109e0 con 0x5601d0f92f30 2023-09-21T12:57:49.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 10 client.25946 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 10 client.25946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 20 client.25946 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d0fac480 0x5601d0fae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 4 client.25946 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:49.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601d0f61020 con 0x5601d0fac480 2023-09-21T12:57:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.516+0000 7f707119b700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d0fac480 0x5601d0fae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.517+0000 7f707119b700 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d0fac480 0x5601d0fae8a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e83e9273a70b303f server_cookie=706f30cae61db741 in_seq=0 out_seq=0 2023-09-21T12:57:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.517+0000 7f7054ff9700 10 client.25946 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7054ff9700 1 -- 172.21.15.142:0/1391534020 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5601d0f61020 con 0x5601d0fac480 2023-09-21T12:57:49.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7054ff9700 10 client.25946 handle_command_reply: tid=0 2023-09-21T12:57:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 client.25946 shutdown 2023-09-21T12:57:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 msgr2=0x5601d0f9bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f705c0128a0 tx=0x7f705c012bb0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 shutdown_connections 2023-09-21T12:57:49.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d0fac480 0x5601d0fae8a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f92610 0x5601d0f9eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f97360 0x5601d0f9c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7054ff9700 0 client.25946 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 --2- 172.21.15.142:0/1391534020 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0f9bd90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.518+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 >> 172.21.15.142:0/1391534020 conn(0x5601d0ebf000 msgr2=0x5601d0f8d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.519+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 shutdown_connections 2023-09-21T12:57:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.519+0000 7f7086d54b80 1 -- 172.21.15.142:0/1391534020 wait complete. 2023-09-21T12:57:49.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.519+0000 7f7086d54b80 20 client.25946 trim_cache size 0 max 16384 2023-09-21T12:57:49.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.537+0000 7f7086d54b80 1 Processor -- start 2023-09-21T12:57:49.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.537+0000 7f7086d54b80 1 -- start start 2023-09-21T12:57:49.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 0x5601d0f94c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0f9b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0d64920 con 0x5601d0f97360 2023-09-21T12:57:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0fa9aa0 con 0x5601d0f92610 2023-09-21T12:57:49.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f7086d54b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0f9a340 con 0x5601d0f92f30 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707199c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0f9b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 0x5601d0f94c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707119b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 0x5601d0f94c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50114/0 (socket says 172.21.15.142:50114) 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49646/0 (socket says 172.21.15.142:49646) 2023-09-21T12:57:49.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707119b700 1 -- 172.21.15.142:0/2451801214 learned_addr learned my addr 172.21.15.142:0/2451801214 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 -- 172.21.15.142:0/2451801214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 msgr2=0x5601d0f94c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 0x5601d0f94c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 -- 172.21.15.142:0/2451801214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 msgr2=0x5601d0f9b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.538+0000 7f707099a700 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0f9b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.539+0000 7f707099a700 1 -- 172.21.15.142:0/2451801214 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601d0fb34d0 con 0x5601d0f92f30 2023-09-21T12:57:49.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.539+0000 7f707099a700 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f705c005c50 tx=0x7f705c009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a1a008759dfa64 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.539+0000 7f7057fff700 1 -- 172.21.15.142:0/2451801214 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c017070 con 0x5601d0f92f30 2023-09-21T12:57:49.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.539+0000 7f7057fff700 1 -- 172.21.15.142:0/2451801214 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f705c018040 con 0x5601d0f92f30 2023-09-21T12:57:49.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.539+0000 7f7057fff700 1 -- 172.21.15.142:0/2451801214 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c0056c0 con 0x5601d0f92f30 2023-09-21T12:57:49.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- 172.21.15.142:0/2451801214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 msgr2=0x5601d0f9e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f705c005c50 tx=0x7f705c009480 comp rx=0 tx=0).stop 2023-09-21T12:57:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- 172.21.15.142:0/2451801214 shutdown_connections 2023-09-21T12:57:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0f9b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92610 0x5601d0f94c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2451801214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92f30 0x5601d0f9e640 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- 172.21.15.142:0/2451801214 >> 172.21.15.142:0/2451801214 conn(0x5601d0ebf000 msgr2=0x5601d0fa7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- 172.21.15.142:0/2451801214 shutdown_connections 2023-09-21T12:57:49.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- 172.21.15.142:0/2451801214 wait complete. 2023-09-21T12:57:49.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 -- start start 2023-09-21T12:57:49.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.540+0000 7f7086d54b80 1 Processor -- start 2023-09-21T12:57:49.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0fa2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0fa2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d0fa3a30 con 0x5601d0f97360 2023-09-21T12:57:49.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d10002c0 con 0x5601d0f92f30 2023-09-21T12:57:49.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601d1000430 con 0x5601d0f92610 2023-09-21T12:57:49.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f7086d54b80 10 client.0 _ll_register_callbacks cb 0x5601d0dcaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:49.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f707119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f707119b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49652/0 (socket says 172.21.15.142:49652) 2023-09-21T12:57:49.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f707119b700 1 -- 172.21.15.142:0/2138523592 learned_addr learned my addr 172.21.15.142:0/2138523592 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:49.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.541+0000 7f707199c700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0fa2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 -- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 msgr2=0x5601d0fa2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707099a700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0fa2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0fa2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 -- 172.21.15.142:0/2138523592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 msgr2=0x5601d0fa2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:49.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0fa2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 -- 172.21.15.142:0/2138523592 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601d0cf7c60 con 0x5601d0f92610 2023-09-21T12:57:49.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f707119b700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7068005b20 tx=0x7f706800bb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1e2d3993ddc1ea7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:49.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7054ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:49.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7068034040 con 0x5601d0f92610 2023-09-21T12:57:49.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f706801e040 con 0x5601d0f92610 2023-09-21T12:57:49.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f706803bb10 con 0x5601d0f92610 2023-09-21T12:57:49.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f706803bcd0 con 0x5601d0f92610 2023-09-21T12:57:49.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7086d54b80 10 client.25909 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:49.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.542+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5601d0d35250 con 0x5601d0f92610 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f706804a020 con 0x5601d0f92610 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f70680049f0 con 0x5601d0f92610 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 10 client.25909 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 20 client.25909 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:49.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d10017b0 0x5601d1003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:49.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 4 client.25909 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:57:49.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5601d0edce60 con 0x5601d10017b0 2023-09-21T12:57:49.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.543+0000 7f707099a700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d10017b0 0x5601d1003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:49.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.544+0000 7f7054ff9700 10 client.25909 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.544+0000 7f707099a700 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d10017b0 0x5601d1003bd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f1c667b06a83a5c server_cookie=fd95ec8305613d1e in_seq=0 out_seq=0 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.544+0000 7f7054ff9700 1 -- 172.21.15.142:0/2138523592 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5601d0edce60 con 0x5601d10017b0 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.544+0000 7f7054ff9700 10 client.25909 handle_command_reply: tid=0 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.544+0000 7f7086d54b80 1 client.25909 shutdown 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 msgr2=0x5601d0fa1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7068005b20 tx=0x7f706800bb70 comp rx=0 tx=0).stop 2023-09-21T12:57:49.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 shutdown_connections 2023-09-21T12:57:49.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5601d10017b0 0x5601d1003bd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5601d0f97360 0x5601d0fa2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5601d0f92610 0x5601d0fa1ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 --2- 172.21.15.142:0/2138523592 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5601d0f92f30 0x5601d0fa2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7054ff9700 0 client.25909 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:49.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 >> 172.21.15.142:0/2138523592 conn(0x5601d0ebf000 msgr2=0x5601d0f9b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 shutdown_connections 2023-09-21T12:57:49.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 1 -- 172.21.15.142:0/2138523592 wait complete. 2023-09-21T12:57:49.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.545+0000 7f7086d54b80 20 client.25909 trim_cache size 0 max 16384 2023-09-21T12:57:49.558 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:57:49.558 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:57:49.558 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:57:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "6620a6f4-8e41-42ec-aa6c-e3007748ab0e": { 2023-09-21T12:57:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:57:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "6620a6f4-8e41-42ec-aa6c-e3007748ab0e", 2023-09-21T12:57:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:57:49.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:57:49.560 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:57:49.560 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:57:49.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 msgr2=0x7f70580a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 0x7f70580a2c70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f706800b2e0 tx=0x7f7068005fd0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 msgr2=0x7f706c19de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:49.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f706400ef30 tx=0x7f706400c3a0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 shutdown_connections 2023-09-21T12:57:49.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f70580a07b0 0x7f70580a2c70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f706c19da10 0x7f706c19de90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f706c100fa0 0x7f706c199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 --2- 172.21.15.142:0/3176514795 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f706c1060c0 0x7f706c1995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:49.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 >> 172.21.15.142:0/3176514795 conn(0x7f706c0fc860 msgr2=0x7f706c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:49.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 shutdown_connections 2023-09-21T12:57:49.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:57:49.546+0000 7f70733ff700 1 -- 172.21.15.142:0/3176514795 wait complete. 2023-09-21T12:57:49.565 INFO:tasks.cephfs.filesystem:scrub status for tag:6620a6f4-8e41-42ec-aa6c-e3007748ab0e - {'path': '/', 'tag': '6620a6f4-8e41-42ec-aa6c-e3007748ab0e', 'options': 'recursive,force'} 2023-09-21T12:57:49.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 77892 14.57 MB/sec warmup 30 sec latency 12.520 ms 2023-09-21T12:57:49.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:49 smithi156 ceph-mon[134078]: pgmap v50: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.4 MiB/s wr, 307 op/s 2023-09-21T12:57:49.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:49 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:57:49.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:49 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:49.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:49 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:57:49.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:49 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:49 smithi142 ceph-mon[97663]: pgmap v50: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.4 MiB/s wr, 307 op/s 2023-09-21T12:57:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:49 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:57:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:49 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:49.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:49 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:57:49.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:49 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:49.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:49 smithi160 ceph-mon[134450]: pgmap v50: 97 pgs: 97 active+clean; 22 MiB data, 443 MiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 1.4 MiB/s wr, 307 op/s 2023-09-21T12:57:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:49 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:57:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:49 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:49 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:57:49.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:49 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 -- 172.21.15.142:0/170999056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe478100fc0 msgr2=0x7fe4781013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 --2- 172.21.15.142:0/170999056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe478100fc0 0x7fe4781013a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe46800b0a0 tx=0x7fe46800b3b0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 -- 172.21.15.142:0/170999056 shutdown_connections 2023-09-21T12:57:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 --2- 172.21.15.142:0/170999056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe4781060e0 0x7fe47810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 --2- 172.21.15.142:0/170999056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe478100fc0 0x7fe4781013a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 --2- 172.21.15.142:0/170999056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478101970 0x7fe4781059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 -- 172.21.15.142:0/170999056 >> 172.21.15.142:0/170999056 conn(0x7fe4780fc840 msgr2=0x7fe4780fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.655+0000 7fe47ddff700 1 -- 172.21.15.142:0/170999056 shutdown_connections 2023-09-21T12:57:50.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.656+0000 7fe47ddff700 1 -- 172.21.15.142:0/170999056 wait complete. 2023-09-21T12:57:50.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.657+0000 7fe47ddff700 1 Processor -- start 2023-09-21T12:57:50.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.657+0000 7fe47ddff700 1 -- start start 2023-09-21T12:57:50.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478100fc0 0x7fe478197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe47819bc30 0x7fe47819c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47819c6b0 con 0x7fe478100fc0 2023-09-21T12:57:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47819c820 con 0x7fe47819bc30 2023-09-21T12:57:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe47ddff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47819c9e0 con 0x7fe4781060e0 2023-09-21T12:57:50.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478100fc0 0x7fe478197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49674/0 (socket says 172.21.15.142:49674) 2023-09-21T12:57:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 -- 172.21.15.142:0/2203103305 learned_addr learned my addr 172.21.15.142:0/2203103305 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe477fff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe47819bc30 0x7fe47819c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 -- 172.21.15.142:0/2203103305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe47819bc30 msgr2=0x7fe47819c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe47819bc30 0x7fe47819c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 -- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478100fc0 msgr2=0x7fe478197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478100fc0 0x7fe478197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.658+0000 7fe46ffff700 1 -- 172.21.15.142:0/2203103305 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468009d00 con 0x7fe4781060e0 2023-09-21T12:57:50.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe46ffff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e970 tx=0x7fe46000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe4757fa700 1 -- 172.21.15.142:0/2203103305 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460009790 con 0x7fe4781060e0 2023-09-21T12:57:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe4757fa700 1 -- 172.21.15.142:0/2203103305 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe46000c7e0 con 0x7fe4781060e0 2023-09-21T12:57:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4781a3f40 con 0x7fe4781060e0 2023-09-21T12:57:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe4757fa700 1 -- 172.21.15.142:0/2203103305 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600054e0 con 0x7fe4781060e0 2023-09-21T12:57:50.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.659+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4781a4410 con 0x7fe4781060e0 2023-09-21T12:57:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.663+0000 7fe4757fa700 1 -- 172.21.15.142:0/2203103305 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe46000c950 con 0x7fe4781060e0 2023-09-21T12:57:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 Processor -- start 2023-09-21T12:57:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 -- start start 2023-09-21T12:57:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe619480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe61e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe58dc40 con 0x556ebe6190a0 2023-09-21T12:57:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe571c10 con 0x556ebe61de50 2023-09-21T12:57:50.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.665+0000 7fe491656b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe56f530 con 0x556ebe6199c0 2023-09-21T12:57:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4757fa700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 0x7fe4640a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49678/0 (socket says 172.21.15.142:49678) 2023-09-21T12:57:50.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 -- 172.21.15.142:0/37769123 learned_addr learned my addr 172.21.15.142:0/37769123 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:50.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe477fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe619480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe46ffff700 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe61e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4757fa700 1 -- 172.21.15.142:0/2203103305 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe460014070 con 0x7fe4781060e0 2023-09-21T12:57:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe477fff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 0x7fe4640a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 -- 172.21.15.142:0/37769123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 msgr2=0x556ebe61e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe61e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 -- 172.21.15.142:0/37769123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 msgr2=0x556ebe619480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe619480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.666+0000 7fe4777fe700 1 -- 172.21.15.142:0/37769123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ebe395d80 con 0x556ebe6199c0 2023-09-21T12:57:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.667+0000 7fe477fff700 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe619480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:57:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.667+0000 7fe4777fe700 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe468009cc0 tx=0x7fe4680092e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2acb977c0d5eed0a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.667+0000 7fe46dffb700 1 -- 172.21.15.142:0/37769123 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800e040 con 0x556ebe6199c0 2023-09-21T12:57:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.667+0000 7fe46dffb700 1 -- 172.21.15.142:0/37769123 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe468006000 con 0x556ebe6199c0 2023-09-21T12:57:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.667+0000 7fe46dffb700 1 -- 172.21.15.142:0/37769123 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468003c60 con 0x556ebe6199c0 2023-09-21T12:57:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 -- 172.21.15.142:0/37769123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 msgr2=0x556ebe61d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe477fff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 0x7fe4640a2cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4700097a0 tx=0x7fe470009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe468009cc0 tx=0x7fe4680092e0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 -- 172.21.15.142:0/37769123 shutdown_connections 2023-09-21T12:57:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe619480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe61e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 --2- 172.21.15.142:0/37769123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe61d910 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 -- 172.21.15.142:0/37769123 >> 172.21.15.142:0/37769123 conn(0x556ebe545fa0 msgr2=0x556ebe6140c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 -- 172.21.15.142:0/37769123 shutdown_connections 2023-09-21T12:57:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.668+0000 7fe491656b80 1 -- 172.21.15.142:0/37769123 wait complete. 2023-09-21T12:57:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.669+0000 7fe491656b80 1 -- start start 2023-09-21T12:57:50.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.669+0000 7fe491656b80 1 Processor -- start 2023-09-21T12:57:50.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.669+0000 7fe491656b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 0x556ebe6227f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 0x556ebe622e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe56ae20 con 0x556ebe6190a0 2023-09-21T12:57:50.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe5076e0 con 0x556ebe6199c0 2023-09-21T12:57:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe507380 con 0x556ebe61de50 2023-09-21T12:57:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe491656b80 10 client.0 _ll_register_callbacks cb 0x556ebe451a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 0x556ebe6227f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59344/0 (socket says 172.21.15.142:59344) 2023-09-21T12:57:50.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe4777fe700 1 -- 172.21.15.142:0/3335022660 learned_addr learned my addr 172.21.15.142:0/3335022660 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:50.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 79595 14.41 MB/sec warmup 31 sec latency 10.778 ms 2023-09-21T12:57:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe477fff700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 0x556ebe622e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 -- 172.21.15.142:0/3335022660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 msgr2=0x556ebe622e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 0x556ebe622e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 -- 172.21.15.142:0/3335022660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 msgr2=0x556ebe6255e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe46ffff700 1 -- 172.21.15.142:0/3335022660 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47810e4d0 con 0x556ebe6199c0 2023-09-21T12:57:50.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe477fff700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 0x556ebe622e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:50.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.670+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:57:50.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe46ffff700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 0x556ebe6227f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe4600c98a0 tx=0x7fe460099050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c79a5bc5afbb9a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe456ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:57:50.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460099600 con 0x556ebe6199c0 2023-09-21T12:57:50.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ebe4dbb50 con 0x556ebe6199c0 2023-09-21T12:57:50.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe46009d430 con 0x556ebe6199c0 2023-09-21T12:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4600a1670 con 0x556ebe6199c0 2023-09-21T12:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe491656b80 10 client.25961 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556ebe37ec00 con 0x556ebe6199c0 2023-09-21T12:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.671+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe46007c020 con 0x556ebe6199c0 2023-09-21T12:57:50.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe460099860 con 0x556ebe6199c0 2023-09-21T12:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 10 client.25961 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 10 client.25961 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 20 client.25961 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe632ed0 0x556ebe6352f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 4 client.25961 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ebe5e7fc0 con 0x556ebe632ed0 2023-09-21T12:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe632ed0 0x556ebe6352f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe632ed0 0x556ebe6352f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=505b9f799d189ea5 server_cookie=743109e0ae3c7bd2 in_seq=0 out_seq=0 2023-09-21T12:57:50.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.672+0000 7fe456ffd700 10 client.25961 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.673+0000 7fe456ffd700 1 -- 172.21.15.142:0/3335022660 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556ebe5e7fc0 con 0x556ebe632ed0 2023-09-21T12:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.673+0000 7fe456ffd700 10 client.25961 handle_command_reply: tid=0 2023-09-21T12:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.673+0000 7fe491656b80 1 client.25961 shutdown 2023-09-21T12:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 msgr2=0x556ebe6227f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 0x556ebe6227f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe4600c98a0 tx=0x7fe460099050 comp rx=0 tx=0).stop 2023-09-21T12:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 shutdown_connections 2023-09-21T12:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe632ed0 0x556ebe6352f0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6190a0 0x556ebe6255e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe61de50 0x556ebe622e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 --2- 172.21.15.142:0/3335022660 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6199c0 0x556ebe6227f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe456ffd700 0 client.25961 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 >> 172.21.15.142:0/3335022660 conn(0x556ebe545fa0 msgr2=0x556ebe613cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 shutdown_connections 2023-09-21T12:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 1 -- 172.21.15.142:0/3335022660 wait complete. 2023-09-21T12:57:50.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.674+0000 7fe491656b80 20 client.25961 trim_cache size 0 max 16384 2023-09-21T12:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.690+0000 7fe491656b80 1 Processor -- start 2023-09-21T12:57:50.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.690+0000 7fe491656b80 1 -- start start 2023-09-21T12:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe625110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe61de50 0x556ebe61be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe3eb8c0 con 0x556ebe61de50 2023-09-21T12:57:50.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe630530 con 0x556ebe6190a0 2023-09-21T12:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe491656b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe614ed0 con 0x556ebe6199c0 2023-09-21T12:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50182/0 (socket says 172.21.15.142:50182) 2023-09-21T12:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 -- 172.21.15.142:0/3156313241 learned_addr learned my addr 172.21.15.142:0/3156313241 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:50.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 -- 172.21.15.142:0/3156313241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 msgr2=0x556ebe625110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe625110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 -- 172.21.15.142:0/3156313241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe61de50 msgr2=0x556ebe61be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe477fff700 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe61de50 0x556ebe61be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe61de50 0x556ebe61be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.691+0000 7fe4777fe700 1 -- 172.21.15.142:0/3156313241 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ebe3bc1f0 con 0x556ebe6190a0 2023-09-21T12:57:50.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe4777fe700 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe468007680 tx=0x7fe468007610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=908a6d5d1dfc93b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe46e7fc700 1 -- 172.21.15.142:0/3156313241 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800e070 con 0x556ebe6190a0 2023-09-21T12:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe46e7fc700 1 -- 172.21.15.142:0/3156313241 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe46800f040 con 0x556ebe6190a0 2023-09-21T12:57:50.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe46e7fc700 1 -- 172.21.15.142:0/3156313241 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468003df0 con 0x556ebe6190a0 2023-09-21T12:57:50.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe491656b80 1 -- 172.21.15.142:0/3156313241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 msgr2=0x556ebe629fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.692+0000 7fe491656b80 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe468007680 tx=0x7fe468007610 comp rx=0 tx=0).stop 2023-09-21T12:57:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 -- 172.21.15.142:0/3156313241 shutdown_connections 2023-09-21T12:57:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe61de50 0x556ebe61be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe6190a0 0x556ebe629fd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 --2- 172.21.15.142:0/3156313241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6199c0 0x556ebe625110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 -- 172.21.15.142:0/3156313241 >> 172.21.15.142:0/3156313241 conn(0x556ebe545fa0 msgr2=0x556ebe62e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 -- 172.21.15.142:0/3156313241 shutdown_connections 2023-09-21T12:57:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 -- 172.21.15.142:0/3156313241 wait complete. 2023-09-21T12:57:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 -- start start 2023-09-21T12:57:50.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.693+0000 7fe491656b80 1 Processor -- start 2023-09-21T12:57:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6199c0 0x556ebe6286f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe68a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe628e90 con 0x556ebe6199c0 2023-09-21T12:57:50.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe68a670 con 0x556ebe61de50 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ebe68a800 con 0x556ebe6190a0 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe491656b80 10 client.0 _ll_register_callbacks cb 0x556ebe451a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49702/0 (socket says 172.21.15.142:49702) 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 -- 172.21.15.142:0/841455542 learned_addr learned my addr 172.21.15.142:0/841455542 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:57:50.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe477fff700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe68a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe46ffff700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6199c0 0x556ebe6286f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 -- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 msgr2=0x556ebe68a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe68a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 -- 172.21.15.142:0/841455542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6199c0 msgr2=0x556ebe6286f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:57:50.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6199c0 0x556ebe6286f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.694+0000 7fe4777fe700 1 -- 172.21.15.142:0/841455542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556ebe395d80 con 0x556ebe6190a0 2023-09-21T12:57:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe4777fe700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe46802e4c0 tx=0x7fe46802e4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eba30ea58da4b02e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:57:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe456ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:57:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46800e040 con 0x556ebe6190a0 2023-09-21T12:57:50.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe468006000 con 0x556ebe6190a0 2023-09-21T12:57:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe46800bc60 con 0x556ebe6190a0 2023-09-21T12:57:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe46800be20 con 0x556ebe6190a0 2023-09-21T12:57:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe491656b80 10 client.25924 fetch_fsmap learned FSMap version 24 2023-09-21T12:57:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.695+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x556ebe394250 con 0x556ebe6190a0 2023-09-21T12:57:50.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe468006000 con 0x556ebe6190a0 2023-09-21T12:57:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fe468019070 con 0x556ebe6190a0 2023-09-21T12:57:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 10 client.25924 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:57:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 10 client.25924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:57:50.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 20 client.25924 populate_metadata read hostname 'smithi142' 2023-09-21T12:57:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe67ce10 0x556ebe67f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:57:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 4 client.25924 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:57:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556ebe563e00 con 0x556ebe67ce10 2023-09-21T12:57:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.696+0000 7fe46ffff700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe67ce10 0x556ebe67f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:57:50.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.697+0000 7fe46ffff700 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe67ce10 0x556ebe67f230 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5771200daa1bce57 server_cookie=394667d7957e08d7 in_seq=0 out_seq=0 2023-09-21T12:57:50.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.697+0000 7fe456ffd700 10 client.25924 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:50.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.858+0000 7fe456ffd700 1 -- 172.21.15.142:0/841455542 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556ebe563e00 con 0x556ebe67ce10 2023-09-21T12:57:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.858+0000 7fe456ffd700 10 client.25924 handle_command_reply: tid=0 2023-09-21T12:57:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.858+0000 7fe491656b80 1 client.25924 shutdown 2023-09-21T12:57:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.858+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 msgr2=0x556ebe6281b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.858+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe46802e4c0 tx=0x7fe46802e4f0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 shutdown_connections 2023-09-21T12:57:50.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556ebe67ce10 0x556ebe67f230 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556ebe61de50 0x556ebe68a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556ebe6190a0 0x556ebe6281b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 --2- 172.21.15.142:0/841455542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556ebe6199c0 0x556ebe6286f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 >> 172.21.15.142:0/841455542 conn(0x556ebe545fa0 msgr2=0x556ebe61be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe456ffd700 0 client.25924 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:57:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 shutdown_connections 2023-09-21T12:57:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 1 -- 172.21.15.142:0/841455542 wait complete. 2023-09-21T12:57:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.859+0000 7fe491656b80 20 client.25924 trim_cache size 0 max 16384 2023-09-21T12:57:50.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:57:50.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:57:50.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:57:50.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:57:50.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 msgr2=0x7fe4640a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 0x7fe4640a2cf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe4700097a0 tx=0x7fe470009260 comp rx=0 tx=0).stop 2023-09-21T12:57:50.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 msgr2=0x7fe4781975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:57:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe46000e970 tx=0x7fe46000ec80 comp rx=0 tx=0).stop 2023-09-21T12:57:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 shutdown_connections 2023-09-21T12:57:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe4640a0830 0x7fe4640a2cf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe478100fc0 0x7fe478197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe47819bc30 0x7fe47819c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 --2- 172.21.15.142:0/2203103305 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4781060e0 0x7fe4781975c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:57:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.860+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 >> 172.21.15.142:0/2203103305 conn(0x7fe4780fc840 msgr2=0x7fe4781049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:57:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.861+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 shutdown_connections 2023-09-21T12:57:50.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:57:50.861+0000 7fe47ddff700 1 -- 172.21.15.142:0/2203103305 wait complete. 2023-09-21T12:57:50.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:50 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:57:50.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:50 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:57:50.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:50 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:50 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:50 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:57:50.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:50 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:57:50.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:50 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:50 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:50 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:57:50.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:50 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:57:50.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:50 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:50.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:50 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:57:51.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 81890 14.39 MB/sec warmup 32 sec latency 105.256 ms 2023-09-21T12:57:51.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:51 smithi156 ceph-mon[134078]: pgmap v51: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.8 MiB/s wr, 388 op/s 2023-09-21T12:57:51.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:51 smithi142 ceph-mon[97663]: pgmap v51: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.8 MiB/s wr, 388 op/s 2023-09-21T12:57:51.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:51 smithi160 ceph-mon[134450]: pgmap v51: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 955 KiB/s rd, 1.8 MiB/s wr, 388 op/s 2023-09-21T12:57:52.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 83216 14.12 MB/sec warmup 33 sec latency 86.915 ms 2023-09-21T12:57:53.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 85406 14.11 MB/sec warmup 34 sec latency 206.560 ms 2023-09-21T12:57:53.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:53 smithi156 ceph-mon[134078]: pgmap v52: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:53.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:53 smithi142 ceph-mon[97663]: pgmap v52: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:53.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:53 smithi160 ceph-mon[134450]: pgmap v52: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:54.669 INFO:tasks.workunit.client.0.smithi142.stdout: 1 87037 13.87 MB/sec warmup 35 sec latency 11.444 ms 2023-09-21T12:57:55.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 89188 13.86 MB/sec warmup 36 sec latency 15.193 ms 2023-09-21T12:57:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:55 smithi156 ceph-mon[134078]: pgmap v53: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:55.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:55 smithi142 ceph-mon[97663]: pgmap v53: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:55.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:55 smithi160 ceph-mon[134450]: pgmap v53: 97 pgs: 97 active+clean; 26 MiB data, 458 MiB used, 1.0 TiB / 1.0 TiB avail; 581 KiB/s rd, 1.1 MiB/s wr, 165 op/s 2023-09-21T12:57:56.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 91308 13.70 MB/sec warmup 37 sec latency 90.221 ms 2023-09-21T12:57:56.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:56 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:57:56.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:56 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:57:56.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:56 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:57:57.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 93024 13.65 MB/sec warmup 38 sec latency 24.057 ms 2023-09-21T12:57:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:57 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:57:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:57 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:57:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:57 smithi156 ceph-mon[134078]: pgmap v54: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 353 op/s 2023-09-21T12:57:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:57 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:57:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:57 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:57:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:57 smithi142 ceph-mon[97663]: pgmap v54: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 353 op/s 2023-09-21T12:57:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:57 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:57:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:57 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:57:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:57 smithi160 ceph-mon[134450]: pgmap v54: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 353 op/s 2023-09-21T12:57:58.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 95925 13.74 MB/sec warmup 39 sec latency 10.939 ms 2023-09-21T12:57:59.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 97201 13.56 MB/sec warmup 40 sec latency 53.886 ms 2023-09-21T12:57:59.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:57:59 smithi156 ceph-mon[134078]: pgmap v55: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 268 op/s 2023-09-21T12:57:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:57:59 smithi142 ceph-mon[97663]: pgmap v55: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 268 op/s 2023-09-21T12:57:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:57:59 smithi160 ceph-mon[134450]: pgmap v55: 97 pgs: 97 active+clean; 42 MiB data, 496 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 268 op/s 2023-09-21T12:58:00.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 99478 13.54 MB/sec warmup 41 sec latency 22.843 ms 2023-09-21T12:58:01.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 100454 13.30 MB/sec warmup 42 sec latency 102.192 ms 2023-09-21T12:58:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:01 smithi156 ceph-mon[134078]: pgmap v56: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 421 op/s 2023-09-21T12:58:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:01 smithi142 ceph-mon[97663]: pgmap v56: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 421 op/s 2023-09-21T12:58:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:01 smithi160 ceph-mon[134450]: pgmap v56: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 421 op/s 2023-09-21T12:58:02.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 103128 13.38 MB/sec warmup 43 sec latency 16.803 ms 2023-09-21T12:58:03.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 104519 13.20 MB/sec warmup 44 sec latency 16.176 ms 2023-09-21T12:58:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:03 smithi156 ceph-mon[134078]: pgmap v57: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:03 smithi142 ceph-mon[97663]: pgmap v57: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:03.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:03 smithi160 ceph-mon[134450]: pgmap v57: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 -- 172.21.15.142:0/2073142939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc1060f0 msgr2=0x7f24bc10dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 --2- 172.21.15.142:0/2073142939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc1060f0 0x7f24bc10dc70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009f90 tx=0x7f24b400b330 comp rx=0 tx=0).stop 2023-09-21T12:58:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 -- 172.21.15.142:0/2073142939 shutdown_connections 2023-09-21T12:58:04.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 --2- 172.21.15.142:0/2073142939 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc100fd0 0x7f24bc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 --2- 172.21.15.142:0/2073142939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc1060f0 0x7f24bc10dc70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 --2- 172.21.15.142:0/2073142939 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc101980 0x7f24bc1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 -- 172.21.15.142:0/2073142939 >> 172.21.15.142:0/2073142939 conn(0x7f24bc0fc830 msgr2=0x7f24bc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 -- 172.21.15.142:0/2073142939 shutdown_connections 2023-09-21T12:58:04.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.014+0000 7f24c0fff700 1 -- 172.21.15.142:0/2073142939 wait complete. 2023-09-21T12:58:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.015+0000 7f24c0fff700 1 Processor -- start 2023-09-21T12:58:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.015+0000 7f24c0fff700 1 -- start start 2023-09-21T12:58:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 0x7f24bc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc19dd50 0x7f24bc19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc19e7d0 con 0x7f24bc19dd50 2023-09-21T12:58:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc19e940 con 0x7f24bc1060f0 2023-09-21T12:58:04.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24c0fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc19eb00 con 0x7f24bc100fd0 2023-09-21T12:58:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 0x7f24bc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49162/0 (socket says 172.21.15.142:49162) 2023-09-21T12:58:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 -- 172.21.15.142:0/4012020162 learned_addr learned my addr 172.21.15.142:0/4012020162 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:04.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 0x7f24bc1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47450/0 (socket says 172.21.15.142:47450) 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24bad9d700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc19dd50 0x7f24bc19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 -- 172.21.15.142:0/4012020162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 msgr2=0x7f24bc1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 0x7f24bc1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 -- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc19dd50 msgr2=0x7f24bc19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.016+0000 7f24ba59c700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc19dd50 0x7f24bc19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24ba59c700 1 -- 172.21.15.142:0/4012020162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac009520 con 0x7f24bc100fd0 2023-09-21T12:58:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24ba59c700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00eb30 tx=0x7f24ac00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24b37fe700 1 -- 172.21.15.142:0/4012020162 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac009880 con 0x7f24bc100fd0 2023-09-21T12:58:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24b37fe700 1 -- 172.21.15.142:0/4012020162 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24ac0044e0 con 0x7f24bc100fd0 2023-09-21T12:58:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b4009c40 con 0x7f24bc100fd0 2023-09-21T12:58:04.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24b37fe700 1 -- 172.21.15.142:0/4012020162 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac003d80 con 0x7f24bc100fd0 2023-09-21T12:58:04.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.017+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc1a63b0 con 0x7f24bc100fd0 2023-09-21T12:58:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.022+0000 7f24b37fe700 1 -- 172.21.15.142:0/4012020162 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f24ac003ee0 con 0x7f24bc100fd0 2023-09-21T12:58:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 Processor -- start 2023-09-21T12:58:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 -- start start 2023-09-21T12:58:04.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a4d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a51910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b749c1c40 con 0x555b74a4d9c0 2023-09-21T12:58:04.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b749a5c10 con 0x555b74a51e50 2023-09-21T12:58:04.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.023+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b749a3530 con 0x555b74a4d0a0 2023-09-21T12:58:04.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a51910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47458/0 (socket says 172.21.15.142:47458) 2023-09-21T12:58:04.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 -- 172.21.15.142:0/1005303194 learned_addr learned my addr 172.21.15.142:0/1005303194 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:04.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24bad9d700 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a4d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b37fe700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 0x7f24a80a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 -- 172.21.15.142:0/1005303194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 msgr2=0x555b74a4d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a4d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 -- 172.21.15.142:0/1005303194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 msgr2=0x555b74a51910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a51910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 -- 172.21.15.142:0/1005303194 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b747c9d80 con 0x555b74a51e50 2023-09-21T12:58:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b37fe700 1 -- 172.21.15.142:0/4012020162 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24ac014070 con 0x7f24bc100fd0 2023-09-21T12:58:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24bad9d700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 0x7f24a80a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.024+0000 7f24b3fff700 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009c70 tx=0x7f24a4009f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d8f6ca0100bf848 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24b0ff9700 1 -- 172.21.15.142:0/1005303194 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4011d10 con 0x555b74a51e50 2023-09-21T12:58:04.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24b0ff9700 1 -- 172.21.15.142:0/1005303194 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24a4011e70 con 0x555b74a51e50 2023-09-21T12:58:04.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24b0ff9700 1 -- 172.21.15.142:0/1005303194 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4005280 con 0x555b74a51e50 2023-09-21T12:58:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/1005303194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 msgr2=0x555b74a522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24bad9d700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 0x7f24a80a2c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009790 tx=0x7f24b4009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.025+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f24a4009c70 tx=0x7f24a4009f80 comp rx=0 tx=0).stop 2023-09-21T12:58:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/1005303194 shutdown_connections 2023-09-21T12:58:04.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a51e50 0x555b74a522b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a4d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/1005303194 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a51910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/1005303194 >> 172.21.15.142:0/1005303194 conn(0x555b74979fa0 msgr2=0x555b74a480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/1005303194 shutdown_connections 2023-09-21T12:58:04.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/1005303194 wait complete. 2023-09-21T12:58:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.026+0000 7f24d4a0cb80 1 -- start start 2023-09-21T12:58:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 Processor -- start 2023-09-21T12:58:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a59670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a51e50 0x555b74a56fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b7499ee20 con 0x555b74a51e50 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b7493b6e0 con 0x555b74a4d9c0 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.027+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b7493b380 con 0x555b74a4d0a0 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24d4a0cb80 10 client.0 _ll_register_callbacks cb 0x555b74885a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47474/0 (socket says 172.21.15.142:47474) 2023-09-21T12:58:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 -- 172.21.15.142:0/2732531344 learned_addr learned my addr 172.21.15.142:0/2732531344 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24bad9d700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a51e50 0x555b74a56fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a59670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 -- 172.21.15.142:0/2732531344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 msgr2=0x555b74a59670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a59670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 -- 172.21.15.142:0/2732531344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a51e50 msgr2=0x555b74a56fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a51e50 0x555b74a56fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 -- 172.21.15.142:0/2732531344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a4009920 con 0x555b74a4d9c0 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24b3fff700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4004c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4dc8209be6323b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.028+0000 7f24a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:04.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4004260 con 0x555b74a4d9c0 2023-09-21T12:58:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b7490fb50 con 0x555b74a4d9c0 2023-09-21T12:58:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24a40043c0 con 0x555b74a4d9c0 2023-09-21T12:58:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a4003680 con 0x555b74a4d9c0 2023-09-21T12:58:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 10 client.25979 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:04.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x555b747b2c00 con 0x555b74a4d9c0 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555b7490fb50 con 0x555b74a4d9c0 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f24a4004ff0 con 0x555b74a4d9c0 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 10 client.25979 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 10 client.25979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 20 client.25979 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:04.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74a66ec0 0x555b74a692e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 4 client.25979 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.029+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b74a1bfc0 con 0x555b74a66ec0 2023-09-21T12:58:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.030+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74a66ec0 0x555b74a692e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.030+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74a66ec0 0x555b74a692e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c775f4cb04706a5 server_cookie=2af0a5ab8e57556b in_seq=0 out_seq=0 2023-09-21T12:58:04.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.030+0000 7f24a1ffb700 10 client.25979 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2732531344 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555b74a1bfc0 con 0x555b74a66ec0 2023-09-21T12:58:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24a1ffb700 10 client.25979 handle_command_reply: tid=0 2023-09-21T12:58:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 client.25979 shutdown 2023-09-21T12:58:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 msgr2=0x555b74a568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f24a4006010 tx=0x7f24a4004c20 comp rx=0 tx=0).stop 2023-09-21T12:58:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 shutdown_connections 2023-09-21T12:58:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74a66ec0 0x555b74a692e0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a51e50 0x555b74a56fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a4d0a0 0x555b74a59670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2732531344 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d9c0 0x555b74a568f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 >> 172.21.15.142:0/2732531344 conn(0x555b74979fa0 msgr2=0x555b74a47cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24a1ffb700 0 client.25979 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.035+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 shutdown_connections 2023-09-21T12:58:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.036+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2732531344 wait complete. 2023-09-21T12:58:04.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.036+0000 7f24d4a0cb80 20 client.25979 trim_cache size 0 max 16384 2023-09-21T12:58:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 Processor -- start 2023-09-21T12:58:04.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 -- start start 2023-09-21T12:58:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74a4ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b7481f8c0 con 0x555b74a4d9c0 2023-09-21T12:58:04.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b74a57d50 con 0x555b74a4d0a0 2023-09-21T12:58:04.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.060+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b74a48ed0 con 0x555b74a51e50 2023-09-21T12:58:04.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47488/0 (socket says 172.21.15.142:47488) 2023-09-21T12:58:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43728/0 (socket says 172.21.15.142:43728) 2023-09-21T12:58:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 -- 172.21.15.142:0/123513046 learned_addr learned my addr 172.21.15.142:0/123513046 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:04.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24bad9d700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74a4ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 -- 172.21.15.142:0/123513046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 msgr2=0x555b74a4ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74a4ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 -- 172.21.15.142:0/123513046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 msgr2=0x555b74a591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 -- 172.21.15.142:0/123513046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b747f01f0 con 0x555b74a4d0a0 2023-09-21T12:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24bad9d700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74a4ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b3fff700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24ba59c700 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24ac095d50 tx=0x7f24ac0ce680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7008372496cb191 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b17fa700 1 -- 172.21.15.142:0/123513046 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac004190 con 0x555b74a4d0a0 2023-09-21T12:58:04.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b17fa700 1 -- 172.21.15.142:0/123513046 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24ac00cbd0 con 0x555b74a4d0a0 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.061+0000 7f24b17fa700 1 -- 172.21.15.142:0/123513046 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac00ce40 con 0x555b74a4d0a0 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/123513046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 msgr2=0x555b74a62760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f24ac095d50 tx=0x7f24ac0ce680 comp rx=0 tx=0).stop 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/123513046 shutdown_connections 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74a4ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a62760 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/123513046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/123513046 >> 172.21.15.142:0/123513046 conn(0x555b74979fa0 msgr2=0x555b74a68ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/123513046 shutdown_connections 2023-09-21T12:58:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.062+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/123513046 wait complete. 2023-09-21T12:58:04.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 -- start start 2023-09-21T12:58:04.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 Processor -- start 2023-09-21T12:58:04.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a5c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74ab3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b74ab41c0 con 0x555b74a4d9c0 2023-09-21T12:58:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b74ab4330 con 0x555b74a4d0a0 2023-09-21T12:58:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.063+0000 7f24d4a0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b74ab44f0 con 0x555b74a51e50 2023-09-21T12:58:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24d4a0cb80 10 client.0 _ll_register_callbacks cb 0x555b74885a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24bad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74ab3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a5c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47492/0 (socket says 172.21.15.142:47492) 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 -- 172.21.15.142:0/2973165399 learned_addr learned my addr 172.21.15.142:0/2973165399 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24bad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74ab3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49174/0 (socket says 172.21.15.142:49174) 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 -- 172.21.15.142:0/2973165399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 msgr2=0x555b74ab3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74ab3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 -- 172.21.15.142:0/2973165399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 msgr2=0x555b74a5c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a5c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 -- 172.21.15.142:0/2973165399 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b747b2c00 con 0x555b74a4d0a0 2023-09-21T12:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24ba59c700 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0c9ba0 tx=0x7f24ac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acb6cfdef939f1d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:04.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.064+0000 7f24a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ac0a18c0 con 0x555b74a4d0a0 2023-09-21T12:58:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24ac09d680 con 0x555b74a4d0a0 2023-09-21T12:58:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24a4011e70 con 0x555b74a4d0a0 2023-09-21T12:58:04.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24ac099f50 con 0x555b74a4d0a0 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 10 client.25985 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f24bc1a63b0 con 0x555b74a4d0a0 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24a4011e70 con 0x555b74a4d0a0 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f24ac099ab0 con 0x555b74a4d0a0 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 10 client.25985 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:04.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 10 client.25985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 20 client.25985 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74abb990 0x555b74abddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 4 client.25985 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:58:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.065+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555b74997e00 con 0x555b74abb990 2023-09-21T12:58:04.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.066+0000 7f24b3fff700 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74abb990 0x555b74abddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.066+0000 7f24a1ffb700 10 client.25985 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:04.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.066+0000 7f24b3fff700 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74abb990 0x555b74abddb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e4d44742c65aaa server_cookie=b38776c636f2ae39 in_seq=0 out_seq=0 2023-09-21T12:58:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.158+0000 7f24a1ffb700 1 -- 172.21.15.142:0/2973165399 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555b74997e00 con 0x555b74abb990 2023-09-21T12:58:04.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.158+0000 7f24a1ffb700 10 client.25985 handle_command_reply: tid=0 2023-09-21T12:58:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.158+0000 7f24d4a0cb80 1 client.25985 shutdown 2023-09-21T12:58:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 msgr2=0x555b74a5c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f24ac0c9ba0 tx=0x7f24ac004750 comp rx=0 tx=0).stop 2023-09-21T12:58:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 shutdown_connections 2023-09-21T12:58:04.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555b74abb990 0x555b74abddb0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b74a51e50 0x555b74ab3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b74a4d0a0 0x555b74a5c1e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24a1ffb700 0 client.25985 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 --2- 172.21.15.142:0/2973165399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b74a4d9c0 0x555b74a5c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 >> 172.21.15.142:0/2973165399 conn(0x555b74979fa0 msgr2=0x555b74a62760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 shutdown_connections 2023-09-21T12:58:04.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.159+0000 7f24d4a0cb80 1 -- 172.21.15.142:0/2973165399 wait complete. 2023-09-21T12:58:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.160+0000 7f24d4a0cb80 20 client.25985 trim_cache size 0 max 16384 2023-09-21T12:58:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:58:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:58:04.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:58:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:58:04.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.160+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 msgr2=0x7f24a80a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 0x7f24a80a2c70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009790 tx=0x7f24b4009920 comp rx=0 tx=0).stop 2023-09-21T12:58:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 msgr2=0x7f24bc1991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f24ac00eb30 tx=0x7f24ac00ee40 comp rx=0 tx=0).stop 2023-09-21T12:58:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 shutdown_connections 2023-09-21T12:58:04.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24a80a07b0 0x7f24a80a2c70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24bc19dd50 0x7f24bc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24bc100fd0 0x7f24bc1991a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 --2- 172.21.15.142:0/4012020162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24bc1060f0 0x7f24bc1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 >> 172.21.15.142:0/4012020162 conn(0x7f24bc0fc830 msgr2=0x7f24bc10c190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:04.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 shutdown_connections 2023-09-21T12:58:04.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:04.161+0000 7f24c0fff700 1 -- 172.21.15.142:0/4012020162 wait complete. 2023-09-21T12:58:04.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 106793 13.21 MB/sec warmup 45 sec latency 34.780 ms 2023-09-21T12:58:05.670 INFO:tasks.workunit.client.0.smithi142.stdout: 1 108892 13.08 MB/sec warmup 46 sec latency 10.474 ms 2023-09-21T12:58:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:05 smithi156 ceph-mon[134078]: pgmap v58: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:05 smithi142 ceph-mon[97663]: pgmap v58: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:05.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:05 smithi160 ceph-mon[134450]: pgmap v58: 97 pgs: 97 active+clean; 45 MiB data, 506 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.0 MiB/s wr, 340 op/s 2023-09-21T12:58:06.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 110440 13.06 MB/sec warmup 47 sec latency 55.369 ms 2023-09-21T12:58:07.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 112401 12.93 MB/sec warmup 48 sec latency 60.182 ms 2023-09-21T12:58:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:07 smithi156 ceph-mon[134078]: pgmap v59: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.6 MiB/s wr, 528 op/s 2023-09-21T12:58:07.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:07 smithi142 ceph-mon[97663]: pgmap v59: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.6 MiB/s wr, 528 op/s 2023-09-21T12:58:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:07 smithi160 ceph-mon[134450]: pgmap v59: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.6 MiB/s wr, 528 op/s 2023-09-21T12:58:08.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 114080 12.92 MB/sec warmup 49 sec latency 13.336 ms 2023-09-21T12:58:09.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 116757 12.93 MB/sec warmup 50 sec latency 11.607 ms 2023-09-21T12:58:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:09 smithi156 ceph-mon[134078]: pgmap v60: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2023-09-21T12:58:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:09 smithi142 ceph-mon[97663]: pgmap v60: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2023-09-21T12:58:09.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:09 smithi160 ceph-mon[134450]: pgmap v60: 97 pgs: 97 active+clean; 41 MiB data, 545 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.2 MiB/s wr, 341 op/s 2023-09-21T12:58:10.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 118297 12.83 MB/sec warmup 51 sec latency 11.861 ms 2023-09-21T12:58:11.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 120774 12.88 MB/sec warmup 52 sec latency 72.579 ms 2023-09-21T12:58:11.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:11 smithi156 ceph-mon[134078]: pgmap v61: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 462 op/s 2023-09-21T12:58:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:11 smithi142 ceph-mon[97663]: pgmap v61: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 462 op/s 2023-09-21T12:58:11.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:11 smithi160 ceph-mon[134450]: pgmap v61: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.7 MiB/s wr, 462 op/s 2023-09-21T12:58:12.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 121913 12.70 MB/sec warmup 53 sec latency 35.423 ms 2023-09-21T12:58:13.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 124489 12.78 MB/sec warmup 54 sec latency 12.961 ms 2023-09-21T12:58:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:13 smithi156 ceph-mon[134078]: pgmap v62: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:13 smithi142 ceph-mon[97663]: pgmap v62: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:13 smithi160 ceph-mon[134450]: pgmap v62: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:14.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 126436 12.66 MB/sec warmup 55 sec latency 14.559 ms 2023-09-21T12:58:15.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 128130 12.67 MB/sec warmup 56 sec latency 79.575 ms 2023-09-21T12:58:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:15 smithi156 ceph-mon[134078]: pgmap v63: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:15 smithi142 ceph-mon[97663]: pgmap v63: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:15.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:15 smithi160 ceph-mon[134450]: pgmap v63: 97 pgs: 97 active+clean; 45 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 3.1 MiB/s wr, 310 op/s 2023-09-21T12:58:16.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 129619 12.54 MB/sec warmup 57 sec latency 130.275 ms 2023-09-21T12:58:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 -- 172.21.15.142:0/3344322626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228105cf0 msgr2=0x7f92280681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 --2- 172.21.15.142:0/3344322626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228105cf0 0x7f92280681d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f921c009990 tx=0x7f921c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 -- 172.21.15.142:0/3344322626 shutdown_connections 2023-09-21T12:58:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 --2- 172.21.15.142:0/3344322626 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 0x7f9228103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 --2- 172.21.15.142:0/3344322626 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228105cf0 0x7f92280681d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 --2- 172.21.15.142:0/3344322626 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228068710 0x7f9228068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 -- 172.21.15.142:0/3344322626 >> 172.21.15.142:0/3344322626 conn(0x7f9228076800 msgr2=0x7f9228076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 -- 172.21.15.142:0/3344322626 shutdown_connections 2023-09-21T12:58:17.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.326+0000 7f922ebff700 1 -- 172.21.15.142:0/3344322626 wait complete. 2023-09-21T12:58:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.327+0000 7f922ebff700 1 Processor -- start 2023-09-21T12:58:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 -- start start 2023-09-21T12:58:17.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 0x7f922819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228105cf0 0x7f92281a2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92281a2640 con 0x7f9228105cf0 2023-09-21T12:58:17.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92281a27b0 con 0x7f92281037f0 2023-09-21T12:58:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922ebff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92281a2970 con 0x7f9228068710 2023-09-21T12:58:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59258/0 (socket says 172.21.15.142:59258) 2023-09-21T12:58:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922c99b700 1 -- 172.21.15.142:0/115174611 learned_addr learned my addr 172.21.15.142:0/115174611 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:17.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f922d19c700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228105cf0 0x7f92281a2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.328+0000 7f9227fff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 0x7f922819d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 -- 172.21.15.142:0/115174611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 msgr2=0x7f922819d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 0x7f922819d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 -- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228105cf0 msgr2=0x7f92281a2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228105cf0 0x7f92281a2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 -- 172.21.15.142:0/115174611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f921c0095f0 con 0x7f9228068710 2023-09-21T12:58:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922c99b700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f921c005740 tx=0x7f921c005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f9225ffb700 1 -- 172.21.15.142:0/115174611 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c01d070 con 0x7f9228068710 2023-09-21T12:58:17.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f9225ffb700 1 -- 172.21.15.142:0/115174611 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f921c005da0 con 0x7f9228068710 2023-09-21T12:58:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92281a2bf0 con 0x7f9228068710 2023-09-21T12:58:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f9225ffb700 1 -- 172.21.15.142:0/115174611 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0173f0 con 0x7f9228068710 2023-09-21T12:58:17.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.329+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92281aa490 con 0x7f9228068710 2023-09-21T12:58:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.333+0000 7f9225ffb700 1 -- 172.21.15.142:0/115174611 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f921c022670 con 0x7f9228068710 2023-09-21T12:58:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.334+0000 7f92424b1b80 1 Processor -- start 2023-09-21T12:58:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.334+0000 7f9225ffb700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 0x7f92180a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.334+0000 7f92424b1b80 1 -- start start 2023-09-21T12:58:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.334+0000 7f9225ffb700 1 -- 172.21.15.142:0/115174611 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f921c0cd240 con 0x7f9228068710 2023-09-21T12:58:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f922d19c700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 0x7f92180a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 0x55f8139c7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f8139cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81393bc40 con 0x55f8139c70a0 2023-09-21T12:58:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81391fc10 con 0x55f8139cbe50 2023-09-21T12:58:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f92424b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f81391d530 con 0x55f8139c79c0 2023-09-21T12:58:17.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f922d19c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f8139cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f922d19c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f8139cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60680/0 (socket says 172.21.15.142:60680) 2023-09-21T12:58:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59264/0 (socket says 172.21.15.142:59264) 2023-09-21T12:58:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f922d19c700 1 -- 172.21.15.142:0/1138381716 learned_addr learned my addr 172.21.15.142:0/1138381716 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:17.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 -- 172.21.15.142:0/1138381716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 msgr2=0x55f8139cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f8139cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f922c99b700 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 0x55f8139c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 -- 172.21.15.142:0/1138381716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 msgr2=0x55f8139c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 0x55f8139c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.335+0000 7f9227fff700 1 -- 172.21.15.142:0/1138381716 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f813743d80 con 0x55f8139c79c0 2023-09-21T12:58:17.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f922c99b700 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 0x55f8139c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:17.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f922d19c700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 0x7f92180a2cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f922000f930 tx=0x7f922000fcf0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f9227fff700 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9214009c00 tx=0x7f9214009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a650ff218617964 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f9212ffd700 1 -- 172.21.15.142:0/1138381716 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214011c30 con 0x55f8139c79c0 2023-09-21T12:58:17.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f9212ffd700 1 -- 172.21.15.142:0/1138381716 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9214004510 con 0x55f8139c79c0 2023-09-21T12:58:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.336+0000 7f9212ffd700 1 -- 172.21.15.142:0/1138381716 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214005280 con 0x55f8139c79c0 2023-09-21T12:58:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 -- 172.21.15.142:0/1138381716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 msgr2=0x55f8139cb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9214009c00 tx=0x7f9214009f10 comp rx=0 tx=0).stop 2023-09-21T12:58:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 -- 172.21.15.142:0/1138381716 shutdown_connections 2023-09-21T12:58:17.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c70a0 0x55f8139c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f8139cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1138381716 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c79c0 0x55f8139cb910 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 -- 172.21.15.142:0/1138381716 >> 172.21.15.142:0/1138381716 conn(0x55f8138f3fa0 msgr2=0x55f8139c20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 -- 172.21.15.142:0/1138381716 shutdown_connections 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.337+0000 7f92424b1b80 1 -- 172.21.15.142:0/1138381716 wait complete. 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 -- start start 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 Processor -- start 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f813918e20 con 0x55f8139cbe50 2023-09-21T12:58:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8138b56e0 con 0x55f8139c79c0 2023-09-21T12:58:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.338+0000 7f92424b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8138b5380 con 0x55f8139c70a0 2023-09-21T12:58:17.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f92424b1b80 10 client.0 _ll_register_callbacks cb 0x55f8137ffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f9227fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59276/0 (socket says 172.21.15.142:59276) 2023-09-21T12:58:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 -- 172.21.15.142:0/3839494969 learned_addr learned my addr 172.21.15.142:0/3839494969 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 -- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 msgr2=0x55f8139d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 -- 172.21.15.142:0/3839494969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 msgr2=0x55f8139d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 -- 172.21.15.142:0/3839494969 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140098e0 con 0x55f8139c70a0 2023-09-21T12:58:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f9227fff700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f922c99b700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f921c09a4b0 tx=0x7f921c09a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa7b3a1c566924b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f9207fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.339+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0224d0 con 0x55f8139c70a0 2023-09-21T12:58:17.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f921c09aeb0 con 0x55f8139c70a0 2023-09-21T12:58:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f813889b50 con 0x55f8139c70a0 2023-09-21T12:58:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f921c09a7b0 con 0x55f8139c70a0 2023-09-21T12:58:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 10 client.25954 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f81372cc00 con 0x55f8139c70a0 2023-09-21T12:58:17.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f813889b50 con 0x55f8139c70a0 2023-09-21T12:58:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f921c0b2d20 con 0x55f8139c70a0 2023-09-21T12:58:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 10 client.25954 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 20 client.25954 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:17.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f8139e0bf0 0x55f8139e3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 4 client.25954 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f813995fc0 con 0x55f8139e0bf0 2023-09-21T12:58:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.340+0000 7f9227fff700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f8139e0bf0 0x55f8139e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.341+0000 7f9207fff700 10 client.25954 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:17.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.341+0000 7f9227fff700 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f8139e0bf0 0x55f8139e3010 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3515c2d47afdc8ad server_cookie=140c76d92c6bbbf1 in_seq=0 out_seq=0 2023-09-21T12:58:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.341+0000 7f9207fff700 1 -- 172.21.15.142:0/3839494969 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f813995fc0 con 0x55f8139e0bf0 2023-09-21T12:58:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.341+0000 7f9207fff700 10 client.25954 handle_command_reply: tid=0 2023-09-21T12:58:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 client.25954 shutdown 2023-09-21T12:58:17.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 msgr2=0x55f8139d3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f921c09a4b0 tx=0x7f921c09a110 comp rx=0 tx=0).stop 2023-09-21T12:58:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 shutdown_connections 2023-09-21T12:58:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f8139e0bf0 0x55f8139e3010 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d3710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3839494969 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f9207fff700 0 client.25954 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 >> 172.21.15.142:0/3839494969 conn(0x55f8138f3fa0 msgr2=0x55f8139c1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 shutdown_connections 2023-09-21T12:58:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 1 -- 172.21.15.142:0/3839494969 wait complete. 2023-09-21T12:58:17.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.342+0000 7f92424b1b80 20 client.25954 trim_cache size 0 max 16384 2023-09-21T12:58:17.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.358+0000 7f92424b1b80 1 Processor -- start 2023-09-21T12:58:17.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.358+0000 7f92424b1b80 1 -- start start 2023-09-21T12:58:17.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139caed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8137998c0 con 0x55f8139cbe50 2023-09-21T12:58:17.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8139c34f0 con 0x55f8139c79c0 2023-09-21T12:58:17.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f92424b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8139c8160 con 0x55f8139c70a0 2023-09-21T12:58:17.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59282/0 (socket says 172.21.15.142:59282) 2023-09-21T12:58:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f922d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f922c99b700 1 -- 172.21.15.142:0/1778582158 learned_addr learned my addr 172.21.15.142:0/1778582158 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 -- 172.21.15.142:0/1778582158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 msgr2=0x55f8139c9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 -- 172.21.15.142:0/1778582158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 msgr2=0x55f8139caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f9227fff700 1 -- 172.21.15.142:0/1778582158 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f81376a1f0 con 0x55f8139c79c0 2023-09-21T12:58:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.359+0000 7f922c99b700 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.360+0000 7f9227fff700 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d3240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214004400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b78aa0267e08c816 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.360+0000 7f92137fe700 1 -- 172.21.15.142:0/1778582158 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92140048d0 con 0x55f8139c79c0 2023-09-21T12:58:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.360+0000 7f92137fe700 1 -- 172.21.15.142:0/1778582158 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9214028070 con 0x55f8139c79c0 2023-09-21T12:58:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.360+0000 7f92137fe700 1 -- 172.21.15.142:0/1778582158 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9214011c90 con 0x55f8139c79c0 2023-09-21T12:58:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 -- 172.21.15.142:0/1778582158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 msgr2=0x55f8139d3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d3240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214004400 comp rx=0 tx=0).stop 2023-09-21T12:58:17.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 -- 172.21.15.142:0/1778582158 shutdown_connections 2023-09-21T12:58:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139cbe50 0x55f8139caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139c9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 --2- 172.21.15.142:0/1778582158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139c79c0 0x55f8139d3240 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 -- 172.21.15.142:0/1778582158 >> 172.21.15.142:0/1778582158 conn(0x55f8138f3fa0 msgr2=0x55f8139c9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 -- 172.21.15.142:0/1778582158 shutdown_connections 2023-09-21T12:58:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.361+0000 7f92424b1b80 1 -- 172.21.15.142:0/1778582158 wait complete. 2023-09-21T12:58:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 -- start start 2023-09-21T12:58:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 Processor -- start 2023-09-21T12:58:17.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 0x55f8139d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f813a2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f813a2e050 con 0x55f8139c79c0 2023-09-21T12:58:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f813a2e1c0 con 0x55f8139cbe50 2023-09-21T12:58:17.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f813a2e380 con 0x55f8139c70a0 2023-09-21T12:58:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.362+0000 7f92424b1b80 10 client.0 _ll_register_callbacks cb 0x55f8137ffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59294/0 (socket says 172.21.15.142:59294) 2023-09-21T12:58:17.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 -- 172.21.15.142:0/3844687599 learned_addr learned my addr 172.21.15.142:0/3844687599 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922d19c700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f813a2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f9227fff700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 0x55f8139d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 -- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 msgr2=0x55f813a2da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f813a2da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 -- 172.21.15.142:0/3844687599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 msgr2=0x55f8139d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 0x55f8139d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 -- 172.21.15.142:0/3844687599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f81372cc00 con 0x55f8139c70a0 2023-09-21T12:58:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f9227fff700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 0x55f8139d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f922c99b700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f921c09a460 tx=0x7f921c005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbbfe495f78868b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f9207fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c00fd40 con 0x55f8139c70a0 2023-09-21T12:58:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f921c09aeb0 con 0x55f8139c70a0 2023-09-21T12:58:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.363+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9214004510 con 0x55f8139c70a0 2023-09-21T12:58:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f921c00fea0 con 0x55f8139c70a0 2023-09-21T12:58:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 10 client.25960 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f921401d040 con 0x55f8139c70a0 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9214004510 con 0x55f8139c70a0 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f921c096ec0 con 0x55f8139c70a0 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 10 client.25960 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 10 client.25960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:17.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 20 client.25960 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:17.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f813a358b0 0x55f813a37cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:17.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 4 client.25960 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:58:17.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f813911e00 con 0x55f813a358b0 2023-09-21T12:58:17.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.364+0000 7f9227fff700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f813a358b0 0x55f813a37cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.365+0000 7f9227fff700 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f813a358b0 0x55f813a37cd0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=712f2a2e5a39b949 server_cookie=f30b7e5e23006c9c in_seq=0 out_seq=0 2023-09-21T12:58:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.365+0000 7f9207fff700 10 client.25960 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f9207fff700 1 -- 172.21.15.142:0/3844687599 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f813911e00 con 0x55f813a358b0 2023-09-21T12:58:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f9207fff700 10 client.25960 handle_command_reply: tid=0 2023-09-21T12:58:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 client.25960 shutdown 2023-09-21T12:58:17.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 msgr2=0x55f8139d6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f921c09a460 tx=0x7f921c005f10 comp rx=0 tx=0).stop 2023-09-21T12:58:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 shutdown_connections 2023-09-21T12:58:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f813a358b0 0x55f813a37cd0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f8139cbe50 0x55f813a2da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f8139c70a0 0x55f8139d6200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f9207fff700 0 client.25960 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 --2- 172.21.15.142:0/3844687599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f8139c79c0 0x55f8139d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 >> 172.21.15.142:0/3844687599 conn(0x55f8138f3fa0 msgr2=0x55f8139caed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 shutdown_connections 2023-09-21T12:58:17.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 1 -- 172.21.15.142:0/3844687599 wait complete. 2023-09-21T12:58:17.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.429+0000 7f92424b1b80 20 client.25960 trim_cache size 0 max 16384 2023-09-21T12:58:17.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:58:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:58:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:58:17.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:58:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 msgr2=0x7f92180a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 0x7f92180a2cf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f922000f930 tx=0x7f922000fcf0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 msgr2=0x7f922819d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:17.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f921c005740 tx=0x7f921c005770 comp rx=0 tx=0).stop 2023-09-21T12:58:17.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 shutdown_connections 2023-09-21T12:58:17.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f92180a0830 0x7f92180a2cf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9228105cf0 0x7f92281a2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9228068710 0x7f922819d450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 --2- 172.21.15.142:0/115174611 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f92281037f0 0x7f922819d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 >> 172.21.15.142:0/115174611 conn(0x7f9228076800 msgr2=0x7f92281027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 shutdown_connections 2023-09-21T12:58:17.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:17.430+0000 7f922ebff700 1 -- 172.21.15.142:0/115174611 wait complete. 2023-09-21T12:58:17.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 131664 12.56 MB/sec warmup 58 sec latency 39.206 ms 2023-09-21T12:58:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:17 smithi156 ceph-mon[134078]: pgmap v64: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 436 op/s 2023-09-21T12:58:17.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:17 smithi142 ceph-mon[97663]: pgmap v64: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 436 op/s 2023-09-21T12:58:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:17 smithi160 ceph-mon[134450]: pgmap v64: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.8 MiB/s wr, 436 op/s 2023-09-21T12:58:18.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 133835 12.48 MB/sec warmup 59 sec latency 10.453 ms 2023-09-21T12:58:19.566 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:58:19.671 INFO:tasks.workunit.client.0.smithi142.stdout: 1 135542 12.47 MB/sec warmup 60 sec latency 11.633 ms 2023-09-21T12:58:19.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 -- 172.21.15.142:0/753408052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a41028b0 msgr2=0x7f55a410ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 --2- 172.21.15.142:0/753408052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a41028b0 0x7f55a410ad90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5598009990 tx=0x7f5598009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 -- 172.21.15.142:0/753408052 shutdown_connections 2023-09-21T12:58:19.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 --2- 172.21.15.142:0/753408052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a410b360 0x7f55a410d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 --2- 172.21.15.142:0/753408052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 --2- 172.21.15.142:0/753408052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a41028b0 0x7f55a410ad90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 -- 172.21.15.142:0/753408052 >> 172.21.15.142:0/753408052 conn(0x7f55a40fb730 msgr2=0x7f55a40fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 -- 172.21.15.142:0/753408052 shutdown_connections 2023-09-21T12:58:19.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.798+0000 7f55a99ff700 1 -- 172.21.15.142:0/753408052 wait complete. 2023-09-21T12:58:19.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 Processor -- start 2023-09-21T12:58:19.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 -- start start 2023-09-21T12:58:19.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 0x7f55a41973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a419be60 con 0x7f55a41028b0 2023-09-21T12:58:19.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a419bfd0 con 0x7f55a410b360 2023-09-21T12:58:19.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.799+0000 7f55a99ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a419c190 con 0x7f55a4101f90 2023-09-21T12:58:19.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59324/0 (socket says 172.21.15.142:59324) 2023-09-21T12:58:19.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60742/0 (socket says 172.21.15.142:60742) 2023-09-21T12:58:19.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 -- 172.21.15.142:0/782933248 learned_addr learned my addr 172.21.15.142:0/782933248 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:19.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a27fc700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 0x7f55a41973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 -- 172.21.15.142:0/782933248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 msgr2=0x7f55a419b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 -- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 msgr2=0x7f55a41973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 0x7f55a41973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 -- 172.21.15.142:0/782933248 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009520 con 0x7f55a4101f90 2023-09-21T12:58:19.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a37fe700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:19.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a27fc700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 0x7f55a41973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:19.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.800+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f559400eb30 tx=0x7f559400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.801+0000 7f55a89fd700 1 -- 172.21.15.142:0/782933248 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594009880 con 0x7f55a4101f90 2023-09-21T12:58:19.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.801+0000 7f55a89fd700 1 -- 172.21.15.142:0/782933248 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55940044e0 con 0x7f55a4101f90 2023-09-21T12:58:19.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.801+0000 7f55a89fd700 1 -- 172.21.15.142:0/782933248 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594003d80 con 0x7f55a4101f90 2023-09-21T12:58:19.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.801+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55980095f0 con 0x7f55a4101f90 2023-09-21T12:58:19.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.801+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a40ffb10 con 0x7f55a4101f90 2023-09-21T12:58:19.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.805+0000 7f55a89fd700 1 -- 172.21.15.142:0/782933248 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5594003f20 con 0x7f55a4101f90 2023-09-21T12:58:19.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 Processor -- start 2023-09-21T12:58:19.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 -- start start 2023-09-21T12:58:19.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615d999f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615d0dca0 con 0x561615d99610 2023-09-21T12:58:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615cf1c70 con 0x561615d9e360 2023-09-21T12:58:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.806+0000 7f55bd359b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615cef590 con 0x561615d99f30 2023-09-21T12:58:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59338/0 (socket says 172.21.15.142:59338) 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 -- 172.21.15.142:0/1784040823 learned_addr learned my addr 172.21.15.142:0/1784040823 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a37fe700 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615d999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 -- 172.21.15.142:0/1784040823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 msgr2=0x561615d9e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 -- 172.21.15.142:0/1784040823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 msgr2=0x561615d999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615d999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a2ffd700 1 -- 172.21.15.142:0/1784040823 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561615b15de0 con 0x561615d99f30 2023-09-21T12:58:19.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a37fe700 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615d999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:19.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.807+0000 7f55a89fd700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 0x7f558c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f55a89fd700 1 -- 172.21.15.142:0/782933248 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5594014070 con 0x7f55a4101f90 2023-09-21T12:58:19.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55940c9ab0 tx=0x7f55940cff90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2087c9e963933d04 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f55a37fe700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 0x7f558c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f5589ffb700 1 -- 172.21.15.142:0/1784040823 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594095be0 con 0x561615d99f30 2023-09-21T12:58:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f5589ffb700 1 -- 172.21.15.142:0/1784040823 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5594099670 con 0x561615d99f30 2023-09-21T12:58:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.808+0000 7f5589ffb700 1 -- 172.21.15.142:0/1784040823 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400ce00 con 0x561615d99f30 2023-09-21T12:58:19.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- 172.21.15.142:0/1784040823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 msgr2=0x561615d9de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55a37fe700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 0x7f558c0a2c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f559c009fd0 tx=0x7f559c012040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f55940c9ab0 tx=0x7f55940cff90 comp rx=0 tx=0).stop 2023-09-21T12:58:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- 172.21.15.142:0/1784040823 shutdown_connections 2023-09-21T12:58:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615d999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 --2- 172.21.15.142:0/1784040823 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615d9de20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- 172.21.15.142:0/1784040823 >> 172.21.15.142:0/1784040823 conn(0x561615cc6000 msgr2=0x561615d946a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- 172.21.15.142:0/1784040823 shutdown_connections 2023-09-21T12:58:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- 172.21.15.142:0/1784040823 wait complete. 2023-09-21T12:58:19.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.809+0000 7f55bd359b80 1 -- start start 2023-09-21T12:58:19.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 Processor -- start 2023-09-21T12:58:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99f30 0x561615da2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d9e360 0x561615da33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615ceae80 con 0x561615d99f30 2023-09-21T12:58:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615c87740 con 0x561615d99610 2023-09-21T12:58:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615c873e0 con 0x561615d9e360 2023-09-21T12:58:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.810+0000 7f55bd359b80 10 client.0 _ll_register_callbacks cb 0x561615bd1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:19.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60750/0 (socket says 172.21.15.142:60750) 2023-09-21T12:58:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 -- 172.21.15.142:0/678506105 learned_addr learned my addr 172.21.15.142:0/678506105 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a37fe700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d9e360 0x561615da33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a27fc700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99f30 0x561615da2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 -- 172.21.15.142:0/678506105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d9e360 msgr2=0x561615da33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d9e360 0x561615da33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 -- 172.21.15.142:0/678506105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99f30 msgr2=0x561615da2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99f30 0x561615da2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 -- 172.21.15.142:0/678506105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a40ffb10 con 0x561615d99610 2023-09-21T12:58:19.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55940997e0 tx=0x7f5594096260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664f502928f3d80a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f5582ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:19.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940b1ea0 con 0x561615d99610 2023-09-21T12:58:19.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f559400ce00 con 0x561615d99610 2023-09-21T12:58:19.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.811+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561615c5bbb0 con 0x561615d99610 2023-09-21T12:58:19.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5594095be0 con 0x561615d99610 2023-09-21T12:58:19.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 10 client.26015 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:19.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561615afec60 con 0x561615d99610 2023-09-21T12:58:19.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561615c5bbb0 con 0x561615d99610 2023-09-21T12:58:19.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5594099b00 con 0x561615d99610 2023-09-21T12:58:19.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 10 client.26015 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:19.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 10 client.26015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:19.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 20 client.26015 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:19.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615db2fe0 0x561615db5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 4 client.26015 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:19.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561615d68020 con 0x561615db2fe0 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.812+0000 7f55a27fc700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615db2fe0 0x561615db5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.813+0000 7f5582ffd700 10 client.26015 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.813+0000 7f55a27fc700 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615db2fe0 0x561615db5420 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eb6dd2e940c74c0 server_cookie=de6eddbe87884add in_seq=0 out_seq=0 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f5582ffd700 1 -- 172.21.15.142:0/678506105 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561615d68020 con 0x561615db2fe0 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f5582ffd700 10 client.26015 handle_command_reply: tid=0 2023-09-21T12:58:19.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 client.26015 shutdown 2023-09-21T12:58:19.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 msgr2=0x561615da5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f55940997e0 tx=0x7f5594096260 comp rx=0 tx=0).stop 2023-09-21T12:58:19.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 shutdown_connections 2023-09-21T12:58:19.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615db2fe0 0x561615db5420 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d9e360 0x561615da33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d99610 0x561615da5ac0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f5582ffd700 0 client.26015 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:19.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 --2- 172.21.15.142:0/678506105 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99f30 0x561615da2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 >> 172.21.15.142:0/678506105 conn(0x561615cc6000 msgr2=0x561615d94290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 shutdown_connections 2023-09-21T12:58:19.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.814+0000 7f55bd359b80 1 -- 172.21.15.142:0/678506105 wait complete. 2023-09-21T12:58:19.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.815+0000 7f55bd359b80 20 client.26015 trim_cache size 0 max 16384 2023-09-21T12:58:19.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 Processor -- start 2023-09-21T12:58:19.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 -- start start 2023-09-21T12:58:19.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615b6b920 con 0x561615d99610 2023-09-21T12:58:19.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615d8ec20 con 0x561615d9e360 2023-09-21T12:58:19.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55bd359b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615d9a6a0 con 0x561615d99f30 2023-09-21T12:58:19.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55a37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56808/0 (socket says 172.21.15.142:56808) 2023-09-21T12:58:19.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55a2ffd700 1 -- 172.21.15.142:0/3845251571 learned_addr learned my addr 172.21.15.142:0/3845251571 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:19.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.835+0000 7f55a27fc700 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 -- 172.21.15.142:0/3845251571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 msgr2=0x561615da5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 -- 172.21.15.142:0/3845251571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 msgr2=0x561615d9c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 -- 172.21.15.142:0/3845251571 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561615dba050 con 0x561615d99610 2023-09-21T12:58:19.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a37fe700 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:19.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f559400eb00 tx=0x7f55940cfd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31a7811b117cd909 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f558a7fc700 1 -- 172.21.15.142:0/3845251571 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940b1ea0 con 0x561615d99610 2023-09-21T12:58:19.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f558a7fc700 1 -- 172.21.15.142:0/3845251571 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5594095be0 con 0x561615d99610 2023-09-21T12:58:19.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.836+0000 7f558a7fc700 1 -- 172.21.15.142:0/3845251571 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940cf870 con 0x561615d99610 2023-09-21T12:58:19.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- 172.21.15.142:0/3845251571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 msgr2=0x561615daa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f559400eb00 tx=0x7f55940cfd00 comp rx=0 tx=0).stop 2023-09-21T12:58:19.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- 172.21.15.142:0/3845251571 shutdown_connections 2023-09-21T12:58:19.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615daa510 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615d9c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 --2- 172.21.15.142:0/3845251571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- 172.21.15.142:0/3845251571 >> 172.21.15.142:0/3845251571 conn(0x561615cc6000 msgr2=0x561615daf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- 172.21.15.142:0/3845251571 shutdown_connections 2023-09-21T12:58:19.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- 172.21.15.142:0/3845251571 wait complete. 2023-09-21T12:58:19.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.837+0000 7f55bd359b80 1 -- start start 2023-09-21T12:58:19.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.838+0000 7f55bd359b80 1 Processor -- start 2023-09-21T12:58:19.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615da9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615e05e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615daa590 con 0x561615d99610 2023-09-21T12:58:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615e06370 con 0x561615d9e360 2023-09-21T12:58:19.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561615e064b0 con 0x561615d99f30 2023-09-21T12:58:19.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55bd359b80 10 client.0 _ll_register_callbacks cb 0x561615bd1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:19.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59362/0 (socket says 172.21.15.142:59362) 2023-09-21T12:58:19.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 -- 172.21.15.142:0/2388426748 learned_addr learned my addr 172.21.15.142:0/2388426748 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:19.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615da9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a37fe700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615e05e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 -- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 msgr2=0x561615e05e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615e05e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 -- 172.21.15.142:0/2388426748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 msgr2=0x561615da9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:19.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615da9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.839+0000 7f55a27fc700 1 -- 172.21.15.142:0/2388426748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c016be0 con 0x561615d99f30 2023-09-21T12:58:19.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f55a27fc700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5598009990 tx=0x7f559800bb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8330177507e9f8ee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:19.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f5582ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:19.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598029cf0 con 0x561615d99f30 2023-09-21T12:58:19.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f55980290c0 con 0x561615d99f30 2023-09-21T12:58:19.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5594099670 con 0x561615d99f30 2023-09-21T12:58:19.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5598029e50 con 0x561615d99f30 2023-09-21T12:58:19.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f55bd359b80 10 client.25978 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:19.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x561615afec60 con 0x561615d99f30 2023-09-21T12:58:19.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.840+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5594099670 con 0x561615d99f30 2023-09-21T12:58:19.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5598004500 con 0x561615d99f30 2023-09-21T12:58:19.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 10 client.25978 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:19.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:19.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 20 client.25978 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:19.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615e07db0 0x561615e0a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:19.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 4 client.25978 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:58:19.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561615ce3e60 con 0x561615e07db0 2023-09-21T12:58:19.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615e07db0 0x561615e0a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:19.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f5582ffd700 10 client.25978 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:19.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.841+0000 7f55a2ffd700 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615e07db0 0x561615e0a1d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75bf9fb99821d925 server_cookie=38280055b3bcd7c3 in_seq=0 out_seq=0 2023-09-21T12:58:19.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f5582ffd700 1 -- 172.21.15.142:0/2388426748 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561615ce3e60 con 0x561615e07db0 2023-09-21T12:58:19.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f5582ffd700 10 client.25978 handle_command_reply: tid=0 2023-09-21T12:58:19.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 client.25978 shutdown 2023-09-21T12:58:19.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 msgr2=0x561615da9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5598009990 tx=0x7f559800bb60 comp rx=0 tx=0).stop 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 shutdown_connections 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561615e07db0 0x561615e0a1d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561615d99610 0x561615da9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561615d9e360 0x561615e05e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f5582ffd700 0 client.25978 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:19.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 --2- 172.21.15.142:0/2388426748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561615d99f30 0x561615da9c80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 >> 172.21.15.142:0/2388426748 conn(0x561615cc6000 msgr2=0x561615d9c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 shutdown_connections 2023-09-21T12:58:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 1 -- 172.21.15.142:0/2388426748 wait complete. 2023-09-21T12:58:19.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.842+0000 7f55bd359b80 20 client.25978 trim_cache size 0 max 16384 2023-09-21T12:58:19.856 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:19.856 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:58:19.856 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:58:19.857 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:19.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 msgr2=0x7f558c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 0x7f558c0a2c70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f559c009fd0 tx=0x7f559c012040 comp rx=0 tx=0).stop 2023-09-21T12:58:19.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 msgr2=0x7f55a4196e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:19.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f559400eb30 tx=0x7f559400ee40 comp rx=0 tx=0).stop 2023-09-21T12:58:19.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 shutdown_connections 2023-09-21T12:58:19.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f558c0a07b0 0x7f558c0a2c70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f55a410b360 0x7f55a419b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f55a4101f90 0x7f55a4196e80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 --2- 172.21.15.142:0/782933248 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f55a41028b0 0x7f55a41973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:19.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 >> 172.21.15.142:0/782933248 conn(0x7f55a40fb730 msgr2=0x7f55a40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:19.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 shutdown_connections 2023-09-21T12:58:19.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:19.843+0000 7f55a99ff700 1 -- 172.21.15.142:0/782933248 wait complete. 2023-09-21T12:58:19.862 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:58:19.863 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:58:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:19 smithi156 ceph-mon[134078]: pgmap v65: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 247 op/s 2023-09-21T12:58:19.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:19 smithi142 ceph-mon[97663]: pgmap v65: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 247 op/s 2023-09-21T12:58:19.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:19 smithi160 ceph-mon[134450]: pgmap v65: 97 pgs: 97 active+clean; 51 MiB data, 616 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 247 op/s 2023-09-21T12:58:20.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 -- 172.21.15.142:0/2392674365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c101980 msgr2=0x7fd34c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 --2- 172.21.15.142:0/2392674365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c101980 0x7fd34c1059c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009990 tx=0x7fd33c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 -- 172.21.15.142:0/2392674365 shutdown_connections 2023-09-21T12:58:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 --2- 172.21.15.142:0/2392674365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 0x7fd34c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 --2- 172.21.15.142:0/2392674365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c100fd0 0x7fd34c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 --2- 172.21.15.142:0/2392674365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c101980 0x7fd34c1059c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 -- 172.21.15.142:0/2392674365 >> 172.21.15.142:0/2392674365 conn(0x7fd34c0fc890 msgr2=0x7fd34c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 -- 172.21.15.142:0/2392674365 shutdown_connections 2023-09-21T12:58:20.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.101+0000 7fd3547ff700 1 -- 172.21.15.142:0/2392674365 wait complete. 2023-09-21T12:58:20.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 Processor -- start 2023-09-21T12:58:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 -- start start 2023-09-21T12:58:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 0x7fd34c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c19daa0 0x7fd34c19df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c19e520 con 0x7fd34c1060f0 2023-09-21T12:58:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c19e690 con 0x7fd34c19daa0 2023-09-21T12:58:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.102+0000 7fd3547ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34c19e850 con 0x7fd34c100fd0 2023-09-21T12:58:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd351d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 0x7fd34c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59374/0 (socket says 172.21.15.142:59374) 2023-09-21T12:58:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 -- 172.21.15.142:0/4117946596 learned_addr learned my addr 172.21.15.142:0/4117946596 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd352d9c700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c19daa0 0x7fd34c19df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 -- 172.21.15.142:0/4117946596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c19daa0 msgr2=0x7fd34c19df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c19daa0 0x7fd34c19df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 -- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 msgr2=0x7fd34c199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 0x7fd34c199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 -- 172.21.15.142:0/4117946596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348009520 con 0x7fd34c100fd0 2023-09-21T12:58:20.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.103+0000 7fd35259b700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd34800eb30 tx=0x7fd34800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.104+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348009880 con 0x7fd34c100fd0 2023-09-21T12:58:20.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.104+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3480044e0 con 0x7fd34c100fd0 2023-09-21T12:58:20.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.104+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0095f0 con 0x7fd34c100fd0 2023-09-21T12:58:20.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.104+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348003d80 con 0x7fd34c100fd0 2023-09-21T12:58:20.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.104+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34c1a6100 con 0x7fd34c100fd0 2023-09-21T12:58:20.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.105+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34c067bd0 con 0x7fd34c100fd0 2023-09-21T12:58:20.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.108+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd348003f20 con 0x7fd34c100fd0 2023-09-21T12:58:20.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.109+0000 7fd3437fe700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 0x7fd3380a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.109+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd348014070 con 0x7fd34c100fd0 2023-09-21T12:58:20.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.109+0000 7fd351d9a700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 0x7fd3380a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.110+0000 7fd351d9a700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 0x7fd3380a2cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd34c19a710 tx=0x7fd33c005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.110+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd348095fc0 con 0x7fd34c100fd0 2023-09-21T12:58:20.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.403+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd34c101b80 con 0x7fd34c100fd0 2023-09-21T12:58:20.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.404+0000 7fd3437fe700 1 -- 172.21.15.142:0/4117946596 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fd3480995e0 con 0x7fd34c100fd0 2023-09-21T12:58:20.404 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:58:20.404 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:57:46.421112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 msgr2=0x7fd3380a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 0x7fd3380a2cb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd34c19a710 tx=0x7fd33c005fd0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 msgr2=0x7fd34c199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd34800eb30 tx=0x7fd34800ee40 comp rx=0 tx=0).stop 2023-09-21T12:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 shutdown_connections 2023-09-21T12:58:20.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd3380a07f0 0x7fd3380a2cb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd34c19daa0 0x7fd34c19df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd34c100fd0 0x7fd34c199100 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 --2- 172.21.15.142:0/4117946596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd34c1060f0 0x7fd34c199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 >> 172.21.15.142:0/4117946596 conn(0x7fd34c0fc890 msgr2=0x7fd34c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 shutdown_connections 2023-09-21T12:58:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.407+0000 7fd3547ff700 1 -- 172.21.15.142:0/4117946596 wait complete. 2023-09-21T12:58:20.409 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-21T12:58:20.426 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:58:20.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 -- 172.21.15.142:0/3688119619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a30101950 msgr2=0x7f1a30105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 --2- 172.21.15.142:0/3688119619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a30101950 0x7f1a30105990 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009990 tx=0x7f1a24009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 -- 172.21.15.142:0/3688119619 shutdown_connections 2023-09-21T12:58:20.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 --2- 172.21.15.142:0/3688119619 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a301060c0 0x7f1a3010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 --2- 172.21.15.142:0/3688119619 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a30100fa0 0x7f1a30101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 --2- 172.21.15.142:0/3688119619 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a30101950 0x7f1a30105990 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 -- 172.21.15.142:0/3688119619 >> 172.21.15.142:0/3688119619 conn(0x7f1a300fc860 msgr2=0x7f1a300fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 -- 172.21.15.142:0/3688119619 shutdown_connections 2023-09-21T12:58:20.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.643+0000 7f1a351ff700 1 -- 172.21.15.142:0/3688119619 wait complete. 2023-09-21T12:58:20.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.644+0000 7f1a351ff700 1 Processor -- start 2023-09-21T12:58:20.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.644+0000 7f1a351ff700 1 -- start start 2023-09-21T12:58:20.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.644+0000 7f1a351ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 0x7f1a301990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.644+0000 7f1a351ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a351ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a3019da40 0x7f1a3019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a351ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3019e4c0 con 0x7f1a30100fa0 2023-09-21T12:58:20.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a351ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3019e630 con 0x7f1a301060c0 2023-09-21T12:58:20.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a351ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3019e7f0 con 0x7f1a3019da40 2023-09-21T12:58:20.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60798/0 (socket says 172.21.15.142:60798) 2023-09-21T12:58:20.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 -- 172.21.15.142:0/4168382424 learned_addr learned my addr 172.21.15.142:0/4168382424 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2f59e700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a3019da40 0x7f1a3019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 0x7f1a301990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 -- 172.21.15.142:0/4168382424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a3019da40 msgr2=0x7f1a3019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a3019da40 0x7f1a3019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 -- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 msgr2=0x7f1a301990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 0x7f1a301990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 -- 172.21.15.142:0/4168382424 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a240095f0 con 0x7f1a301060c0 2023-09-21T12:58:20.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 0x7f1a301990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:20.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.645+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a24005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.646+0000 7f1a17fff700 1 -- 172.21.15.142:0/4168382424 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2401d070 con 0x7f1a301060c0 2023-09-21T12:58:20.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.646+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a301a5cf0 con 0x7f1a301060c0 2023-09-21T12:58:20.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.646+0000 7f1a17fff700 1 -- 172.21.15.142:0/4168382424 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a24021410 con 0x7f1a301060c0 2023-09-21T12:58:20.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.646+0000 7f1a17fff700 1 -- 172.21.15.142:0/4168382424 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24017650 con 0x7f1a301060c0 2023-09-21T12:58:20.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.646+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a301a6170 con 0x7f1a301060c0 2023-09-21T12:58:20.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.650+0000 7f1a17fff700 1 -- 172.21.15.142:0/4168382424 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f1a24021580 con 0x7f1a301060c0 2023-09-21T12:58:20.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.652+0000 7f1a48b96b80 1 Processor -- start 2023-09-21T12:58:20.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.652+0000 7f1a48b96b80 1 -- start start 2023-09-21T12:58:20.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.652+0000 7f1a17fff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 0x7f1a180a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.652+0000 7f1a17fff700 1 -- 172.21.15.142:0/4168382424 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1a240cd250 con 0x7f1a301060c0 2023-09-21T12:58:20.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1f30 0x563f7cbd5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbd67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cb45ca0 con 0x563f7cbd6360 2023-09-21T12:58:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cb29c70 con 0x563f7cbd1f30 2023-09-21T12:58:20.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cb27590 con 0x563f7cbd1610 2023-09-21T12:58:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2f59e700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 0x7f1a180a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59410/0 (socket says 172.21.15.142:59410) 2023-09-21T12:58:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 -- 172.21.15.142:0/3054653466 learned_addr learned my addr 172.21.15.142:0/3054653466 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2f59e700 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbd67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 -- 172.21.15.142:0/3054653466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1f30 msgr2=0x563f7cbd5e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T12:58:20.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1f30 0x563f7cbd5e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 -- 172.21.15.142:0/3054653466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 msgr2=0x563f7cbd67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbd67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 -- 172.21.15.142:0/3054653466 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f7c94dde0 con 0x563f7cbd1610 2023-09-21T12:58:20.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.653+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009de0 tx=0x7f1a200116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3014ae10fb0db888 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.654+0000 7f1a2f59e700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 0x7f1a180a2c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800f870 tx=0x7f1a2800fc30 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.654+0000 7f1a157fa700 1 -- 172.21.15.142:0/3054653466 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20011ed0 con 0x563f7cbd1610 2023-09-21T12:58:20.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.654+0000 7f1a157fa700 1 -- 172.21.15.142:0/3054653466 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a20012910 con 0x563f7cbd1610 2023-09-21T12:58:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.654+0000 7f1a157fa700 1 -- 172.21.15.142:0/3054653466 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000f850 con 0x563f7cbd1610 2023-09-21T12:58:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3054653466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 msgr2=0x563f7cbd19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009de0 tx=0x7f1a200116c0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3054653466 shutdown_connections 2023-09-21T12:58:20.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbd67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1610 0x563f7cbd19f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3054653466 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1f30 0x563f7cbd5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3054653466 >> 172.21.15.142:0/3054653466 conn(0x563f7cafe000 msgr2=0x563f7cbcc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3054653466 shutdown_connections 2023-09-21T12:58:20.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.655+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3054653466 wait complete. 2023-09-21T12:58:20.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.656+0000 7f1a48b96b80 1 -- start start 2023-09-21T12:58:20.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.656+0000 7f1a48b96b80 1 Processor -- start 2023-09-21T12:58:20.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbdae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbdb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cb22e80 con 0x563f7cbd1610 2023-09-21T12:58:20.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cabf740 con 0x563f7cbd6360 2023-09-21T12:58:20.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cabf3e0 con 0x563f7cbd1f30 2023-09-21T12:58:20.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a48b96b80 10 client.0 _ll_register_callbacks cb 0x563f7ca09a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:20.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a2ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbdae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59420/0 (socket says 172.21.15.142:59420) 2023-09-21T12:58:20.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.657+0000 7f1a2e59c700 1 -- 172.21.15.142:0/3994092669 learned_addr learned my addr 172.21.15.142:0/3994092669 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2f59e700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbdb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 -- 172.21.15.142:0/3994092669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 msgr2=0x563f7cbdb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbdb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 -- 172.21.15.142:0/3994092669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 msgr2=0x563f7cbdae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbdae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 -- 172.21.15.142:0/3994092669 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20009a10 con 0x563f7cbd1f30 2023-09-21T12:58:20.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a240caa30 tx=0x7f1a2409a600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad23876e3a952e95 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:20.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2409a120 con 0x563f7cbd1f30 2023-09-21T12:58:20.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1a2409aec0 con 0x563f7cbd1f30 2023-09-21T12:58:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.658+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563f7ca93bb0 con 0x563f7cbd1f30 2023-09-21T12:58:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2409a7c0 con 0x563f7cbd1f30 2023-09-21T12:58:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 10 client.25996 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563f7c936c60 con 0x563f7cbd1f30 2023-09-21T12:58:20.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563f7ca93bb0 con 0x563f7cbd1f30 2023-09-21T12:58:20.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1a240a2310 con 0x563f7cbd1f30 2023-09-21T12:58:20.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 10 client.25996 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:20.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 10 client.25996 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:58:20.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 20 client.25996 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:20.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cbeb0a0 0x563f7cbed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 4 client.25996 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:20.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.659+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563f7cba0020 con 0x563f7cbeb0a0 2023-09-21T12:58:20.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.660+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cbeb0a0 0x563f7cbed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.660+0000 7f1a12ff5700 10 client.25996 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:20.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.660+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cbeb0a0 0x563f7cbed4c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=83566b462fe2267f server_cookie=cd901fa9abe046d7 in_seq=0 out_seq=0 2023-09-21T12:58:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.661+0000 7f1a12ff5700 1 -- 172.21.15.142:0/3994092669 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563f7cba0020 con 0x563f7cbeb0a0 2023-09-21T12:58:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.661+0000 7f1a12ff5700 10 client.25996 handle_command_reply: tid=0 2023-09-21T12:58:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.661+0000 7f1a48b96b80 1 client.25996 shutdown 2023-09-21T12:58:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.661+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 msgr2=0x563f7cbdb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.661+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1a240caa30 tx=0x7f1a2409a600 comp rx=0 tx=0).stop 2023-09-21T12:58:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 shutdown_connections 2023-09-21T12:58:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cbeb0a0 0x563f7cbed4c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbdae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbdb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a12ff5700 0 client.25996 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:20.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/3994092669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbdb3b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 >> 172.21.15.142:0/3994092669 conn(0x563f7cafe000 msgr2=0x563f7cbcc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 shutdown_connections 2023-09-21T12:58:20.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 1 -- 172.21.15.142:0/3994092669 wait complete. 2023-09-21T12:58:20.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.662+0000 7f1a48b96b80 20 client.25996 trim_cache size 0 max 16384 2023-09-21T12:58:20.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 138170 12.49 MB/sec warmup 61 sec latency 10.980 ms 2023-09-21T12:58:20.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.676+0000 7f1a48b96b80 1 Processor -- start 2023-09-21T12:58:20.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 -- start start 2023-09-21T12:58:20.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 0x563f7cbd3c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbe24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7c9a3920 con 0x563f7cbd6360 2023-09-21T12:58:20.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cbd2330 con 0x563f7cbd1610 2023-09-21T12:58:20.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cbe7dd0 con 0x563f7cbd1f30 2023-09-21T12:58:20.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 0x563f7cbd3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbe24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59428/0 (socket says 172.21.15.142:59428) 2023-09-21T12:58:20.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 -- 172.21.15.142:0/2081319068 learned_addr learned my addr 172.21.15.142:0/2081319068 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 0x563f7cbd3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60806/0 (socket says 172.21.15.142:60806) 2023-09-21T12:58:20.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 -- 172.21.15.142:0/2081319068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 msgr2=0x563f7cbd3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 0x563f7cbd3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 -- 172.21.15.142:0/2081319068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 msgr2=0x563f7cbe24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.677+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbe24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.678+0000 7f1a2e59c700 1 -- 172.21.15.142:0/2081319068 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563f7c974250 con 0x563f7cbd1f30 2023-09-21T12:58:20.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.678+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a2409a4c0 tx=0x7f1a2400b4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6aa6887a0c2e9f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.678+0000 7f1a15ffb700 1 -- 172.21.15.142:0/2081319068 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240b1030 con 0x563f7cbd1f30 2023-09-21T12:58:20.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.678+0000 7f1a15ffb700 1 -- 172.21.15.142:0/2081319068 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a2409a120 con 0x563f7cbd1f30 2023-09-21T12:58:20.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.678+0000 7f1a15ffb700 1 -- 172.21.15.142:0/2081319068 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24099f10 con 0x563f7cbd1f30 2023-09-21T12:58:20.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- 172.21.15.142:0/2081319068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 msgr2=0x563f7cbda130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1a2409a4c0 tx=0x7f1a2400b4b0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- 172.21.15.142:0/2081319068 shutdown_connections 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd6360 0x563f7cbe24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd1610 0x563f7cbd3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/2081319068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbda130 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- 172.21.15.142:0/2081319068 >> 172.21.15.142:0/2081319068 conn(0x563f7cafe000 msgr2=0x563f7cbd44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- 172.21.15.142:0/2081319068 shutdown_connections 2023-09-21T12:58:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- 172.21.15.142:0/2081319068 wait complete. 2023-09-21T12:58:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 -- start start 2023-09-21T12:58:20.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.679+0000 7f1a48b96b80 1 Processor -- start 2023-09-21T12:58:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbe04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbe0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbe0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cc3ded0 con 0x563f7cbd1610 2023-09-21T12:58:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cc3e010 con 0x563f7cbd6360 2023-09-21T12:58:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563f7cc3e1a0 con 0x563f7cbd1f30 2023-09-21T12:58:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a48b96b80 10 client.0 _ll_register_callbacks cb 0x563f7ca09a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:20.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a2f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbe0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a2e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbe0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a2f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbe0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60810/0 (socket says 172.21.15.142:60810) 2023-09-21T12:58:20.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a2f59e700 1 -- 172.21.15.142:0/978384162 learned_addr learned my addr 172.21.15.142:0/978384162 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.680+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbe04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 -- 172.21.15.142:0/978384162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 msgr2=0x563f7cbe0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbe0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 -- 172.21.15.142:0/978384162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 msgr2=0x563f7cbe04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbe04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 -- 172.21.15.142:0/978384162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563f7c936c60 con 0x563f7cbd1f30 2023-09-21T12:58:20.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a2e59c700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbe0a10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400b6f0 tx=0x7f1a24096500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cef43d29cde990ea server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a12ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:20.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240b1050 con 0x563f7cbd1f30 2023-09-21T12:58:20.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a20012910 con 0x563f7cbd1f30 2023-09-21T12:58:20.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1a240b2070 con 0x563f7cbd1f30 2023-09-21T12:58:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a2409e360 con 0x563f7cbd1f30 2023-09-21T12:58:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a48b96b80 10 client.26002 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x563f7c94c2b0 con 0x563f7cbd1f30 2023-09-21T12:58:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.681+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1a240a6080 con 0x563f7cbd1f30 2023-09-21T12:58:20.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1a240a03b0 con 0x563f7cbd1f30 2023-09-21T12:58:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 10 client.26002 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 10 client.26002 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:58:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 20 client.26002 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cc3f3f0 0x563f7cc417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 4 client.26002 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:20.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563f7cb1be60 con 0x563f7cc3f3f0 2023-09-21T12:58:20.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cc3f3f0 0x563f7cc417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a2ed9d700 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cc3f3f0 0x563f7cc417e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e4ca95bfcd57683 server_cookie=c584aa4b7b81376b in_seq=0 out_seq=0 2023-09-21T12:58:20.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.682+0000 7f1a12ff5700 10 client.26002 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a12ff5700 1 -- 172.21.15.142:0/978384162 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563f7cb1be60 con 0x563f7cc3f3f0 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a12ff5700 10 client.26002 handle_command_reply: tid=0 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 client.26002 shutdown 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 msgr2=0x563f7cbe0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbe0a10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400b6f0 tx=0x7f1a24096500 comp rx=0 tx=0).stop 2023-09-21T12:58:20.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 shutdown_connections 2023-09-21T12:58:20.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x563f7cc3f3f0 0x563f7cc417e0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563f7cbd1610 0x563f7cbe04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563f7cbd6360 0x563f7cbe0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 --2- 172.21.15.142:0/978384162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f7cbd1f30 0x563f7cbe0a10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a12ff5700 0 client.26002 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:20.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 >> 172.21.15.142:0/978384162 conn(0x563f7cafe000 msgr2=0x563f7cbd5440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 shutdown_connections 2023-09-21T12:58:20.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 1 -- 172.21.15.142:0/978384162 wait complete. 2023-09-21T12:58:20.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.683+0000 7f1a48b96b80 20 client.26002 trim_cache size 0 max 16384 2023-09-21T12:58:20.699 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:20.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 msgr2=0x7f1a180a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 0x7f1a180a2c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800f870 tx=0x7f1a2800fc30 comp rx=0 tx=0).stop 2023-09-21T12:58:20.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 msgr2=0x7f1a301995e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000c00 tx=0x7f1a24005740 comp rx=0 tx=0).stop 2023-09-21T12:58:20.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 shutdown_connections 2023-09-21T12:58:20.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1a180a07b0 0x7f1a180a2c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1a30100fa0 0x7f1a301990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a3019da40 0x7f1a3019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 --2- 172.21.15.142:0/4168382424 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1a301060c0 0x7f1a301995e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 >> 172.21.15.142:0/4168382424 conn(0x7f1a300fc860 msgr2=0x7f1a300fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 shutdown_connections 2023-09-21T12:58:20.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.684+0000 7f1a351ff700 1 -- 172.21.15.142:0/4168382424 wait complete. 2023-09-21T12:58:20.702 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:20 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4117946596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:20.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:58:20.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:20 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4117946596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:20.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 -- 172.21.15.142:0/1553488693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 msgr2=0x7f98ec102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 --2- 172.21.15.142:0/1553488693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec102380 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009990 tx=0x7f98e8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 -- 172.21.15.142:0/1553488693 shutdown_connections 2023-09-21T12:58:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 --2- 172.21.15.142:0/1553488693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 0x7f98ec10d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 --2- 172.21.15.142:0/1553488693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec102380 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 --2- 172.21.15.142:0/1553488693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 -- 172.21.15.142:0/1553488693 >> 172.21.15.142:0/1553488693 conn(0x7f98ec0fb740 msgr2=0x7f98ec0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 -- 172.21.15.142:0/1553488693 shutdown_connections 2023-09-21T12:58:20.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.926+0000 7f98f47ff700 1 -- 172.21.15.142:0/1553488693 wait complete. 2023-09-21T12:58:20.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.927+0000 7f98f47ff700 1 Processor -- start 2023-09-21T12:58:20.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 -- start start 2023-09-21T12:58:20.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec1996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 0x7f98ec19db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec19e150 con 0x7f98ec1028c0 2023-09-21T12:58:20.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec19e2c0 con 0x7f98ec10b370 2023-09-21T12:58:20.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f47ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ec19e480 con 0x7f98ec101fa0 2023-09-21T12:58:20.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f259b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f259b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59440/0 (socket says 172.21.15.142:59440) 2023-09-21T12:58:20.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f259b700 1 -- 172.21.15.142:0/287312042 learned_addr learned my addr 172.21.15.142:0/287312042 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec1996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.928+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 0x7f98ec19db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 -- 172.21.15.142:0/287312042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 msgr2=0x7f98ec19db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 0x7f98ec19db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 -- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 msgr2=0x7f98ec1996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec1996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 -- 172.21.15.142:0/287312042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009520 con 0x7f98ec101fa0 2023-09-21T12:58:20.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:20.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f259b700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005910 tx=0x7f98e8005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98e37fe700 1 -- 172.21.15.142:0/287312042 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e801d070 con 0x7f98ec101fa0 2023-09-21T12:58:20.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98e37fe700 1 -- 172.21.15.142:0/287312042 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e8022470 con 0x7f98ec101fa0 2023-09-21T12:58:20.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80095f0 con 0x7f98ec101fa0 2023-09-21T12:58:20.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98e37fe700 1 -- 172.21.15.142:0/287312042 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8017650 con 0x7f98ec101fa0 2023-09-21T12:58:20.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.929+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ec1a5dc0 con 0x7f98ec101fa0 2023-09-21T12:58:20.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.934+0000 7f99080bdb80 1 Processor -- start 2023-09-21T12:58:20.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.934+0000 7f98e37fe700 1 -- 172.21.15.142:0/287312042 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f98e80225e0 con 0x7f98ec101fa0 2023-09-21T12:58:20.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 -- start start 2023-09-21T12:58:20.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923ad360 0x557b923ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b9231cca0 con 0x557b923a8f30 2023-09-21T12:58:20.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b92300c70 con 0x557b923a8610 2023-09-21T12:58:20.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.935+0000 7f99080bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b922fe590 con 0x557b923ad360 2023-09-21T12:58:20.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60830/0 (socket says 172.21.15.142:60830) 2023-09-21T12:58:20.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 -- 172.21.15.142:0/3925888246 learned_addr learned my addr 172.21.15.142:0/3925888246 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f259b700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923ad360 0x557b923ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 -- 172.21.15.142:0/3925888246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923ad360 msgr2=0x557b923ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923ad360 0x557b923ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 -- 172.21.15.142:0/3925888246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 msgr2=0x557b923ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 -- 172.21.15.142:0/3925888246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b92124de0 con 0x557b923a8610 2023-09-21T12:58:20.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f259b700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:20.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011680 tx=0x7f98e4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51caf9ad82714f26 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98e0ff9700 1 -- 172.21.15.142:0/3925888246 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e040 con 0x557b923a8610 2023-09-21T12:58:20.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98e0ff9700 1 -- 172.21.15.142:0/3925888246 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e400f040 con 0x557b923a8610 2023-09-21T12:58:20.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.936+0000 7f98e0ff9700 1 -- 172.21.15.142:0/3925888246 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4004860 con 0x557b923a8610 2023-09-21T12:58:20.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f98e37fe700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 0x7f98d80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f98e37fe700 1 -- 172.21.15.142:0/287312042 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98e80cd2e0 con 0x7f98ec101fa0 2023-09-21T12:58:20.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 -- 172.21.15.142:0/3925888246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 msgr2=0x557b923a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011680 tx=0x7f98e4009920 comp rx=0 tx=0).stop 2023-09-21T12:58:20.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f98f259b700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 0x7f98d80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 -- 172.21.15.142:0/3925888246 shutdown_connections 2023-09-21T12:58:20.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923ad360 0x557b923ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8610 0x557b923a89f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.937+0000 7f99080bdb80 1 --2- 172.21.15.142:0/3925888246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.938+0000 7f99080bdb80 1 -- 172.21.15.142:0/3925888246 >> 172.21.15.142:0/3925888246 conn(0x557b922d5000 msgr2=0x557b923a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.938+0000 7f99080bdb80 1 -- 172.21.15.142:0/3925888246 shutdown_connections 2023-09-21T12:58:20.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.938+0000 7f99080bdb80 1 -- 172.21.15.142:0/3925888246 wait complete. 2023-09-21T12:58:20.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.938+0000 7f98f259b700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 0x7f98d80a2cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98e8097380 tx=0x7f98e801a040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.938+0000 7f99080bdb80 1 -- start start 2023-09-21T12:58:20.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 Processor -- start 2023-09-21T12:58:20.946 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:20 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4117946596' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 0x557b923b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923ad360 0x557b923b2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b922f9e80 con 0x557b923ad360 2023-09-21T12:58:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b92296740 con 0x557b923a8f30 2023-09-21T12:58:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b922963e0 con 0x557b923a8610 2023-09-21T12:58:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f99080bdb80 10 client.0 _ll_register_callbacks cb 0x557b921e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f98f1d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 0x557b923b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59464/0 (socket says 172.21.15.142:59464) 2023-09-21T12:58:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f98f2d9c700 1 -- 172.21.15.142:0/4194593922 learned_addr learned my addr 172.21.15.142:0/4194593922 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923ad360 0x557b923b2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.939+0000 7f98f1d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 0x557b923b1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60832/0 (socket says 172.21.15.142:60832) 2023-09-21T12:58:20.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 -- 172.21.15.142:0/4194593922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 msgr2=0x557b923b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 0x557b923b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 -- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923ad360 msgr2=0x557b923b2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923ad360 0x557b923b2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 -- 172.21.15.142:0/4194593922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e4011330 con 0x557b923a8610 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98e40049e0 tx=0x7f98e4004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90af22e3f17d21dc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e040 con 0x557b923a8610 2023-09-21T12:58:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b9226abb0 con 0x557b923a8610 2023-09-21T12:58:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.940+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98e4003f90 con 0x557b923a8610 2023-09-21T12:58:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e4007710 con 0x557b923a8610 2023-09-21T12:58:20.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 10 client.26014 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557b9210dc60 con 0x557b923a8610 2023-09-21T12:58:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557b9226abb0 con 0x557b923a8610 2023-09-21T12:58:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f98e40156a0 con 0x557b923a8610 2023-09-21T12:58:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 10 client.26014 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:20.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 10 client.26014 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:58:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 20 client.26014 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b923c2380 0x557b923c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 4 client.26014 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.941+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b92377020 con 0x557b923c2380 2023-09-21T12:58:20.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.942+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b923c2380 0x557b923c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.942+0000 7f98d5ffb700 10 client.26014 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.942+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b923c2380 0x557b923c47a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=59d4bbab538864d1 server_cookie=f977bb58617f49c in_seq=0 out_seq=0 2023-09-21T12:58:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f98d5ffb700 1 -- 172.21.15.142:0/4194593922 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557b92377020 con 0x557b923c2380 2023-09-21T12:58:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f98d5ffb700 10 client.26014 handle_command_reply: tid=0 2023-09-21T12:58:20.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 client.26014 shutdown 2023-09-21T12:58:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 msgr2=0x557b923b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f98e40049e0 tx=0x7f98e4004320 comp rx=0 tx=0).stop 2023-09-21T12:58:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 shutdown_connections 2023-09-21T12:58:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923ad360 0x557b923b2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b923c2380 0x557b923c47a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4a90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f98d5ffb700 0 client.26014 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 --2- 172.21.15.142:0/4194593922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923a8f30 0x557b923b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 >> 172.21.15.142:0/4194593922 conn(0x557b922d5000 msgr2=0x557b923a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 shutdown_connections 2023-09-21T12:58:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 1 -- 172.21.15.142:0/4194593922 wait complete. 2023-09-21T12:58:20.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.944+0000 7f99080bdb80 20 client.26014 trim_cache size 0 max 16384 2023-09-21T12:58:20.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 Processor -- start 2023-09-21T12:58:20.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 -- start start 2023-09-21T12:58:20.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923b1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b9217a920 con 0x557b923a8f30 2023-09-21T12:58:20.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b923b32f0 con 0x557b923ad360 2023-09-21T12:58:20.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.966+0000 7f99080bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b9239d990 con 0x557b923a8610 2023-09-21T12:58:20.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60848/0 (socket says 172.21.15.142:60848) 2023-09-21T12:58:20.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f1d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 -- 172.21.15.142:0/2859725735 learned_addr learned my addr 172.21.15.142:0/2859725735 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 -- 172.21.15.142:0/2859725735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 msgr2=0x557b923b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 -- 172.21.15.142:0/2859725735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 msgr2=0x557b923b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 -- 172.21.15.142:0/2859725735 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b923c9390 con 0x557b923ad360 2023-09-21T12:58:20.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011da0 tx=0x7f98e4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e45b070496fe8e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.967+0000 7f98e17fa700 1 -- 172.21.15.142:0/2859725735 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400e020 con 0x557b923ad360 2023-09-21T12:58:20.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f98e17fa700 1 -- 172.21.15.142:0/2859725735 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e4003fe0 con 0x557b923ad360 2023-09-21T12:58:20.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f98e17fa700 1 -- 172.21.15.142:0/2859725735 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4007c40 con 0x557b923ad360 2023-09-21T12:58:20.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 -- 172.21.15.142:0/2859725735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 msgr2=0x557b923b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98e4011da0 tx=0x7f98e4009920 comp rx=0 tx=0).stop 2023-09-21T12:58:20.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 -- 172.21.15.142:0/2859725735 shutdown_connections 2023-09-21T12:58:20.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b1a80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8610 0x557b923b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 --2- 172.21.15.142:0/2859725735 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8f30 0x557b923b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 -- 172.21.15.142:0/2859725735 >> 172.21.15.142:0/2859725735 conn(0x557b922d5000 msgr2=0x557b923ab430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 -- 172.21.15.142:0/2859725735 shutdown_connections 2023-09-21T12:58:20.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.968+0000 7f99080bdb80 1 -- 172.21.15.142:0/2859725735 wait complete. 2023-09-21T12:58:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 -- start start 2023-09-21T12:58:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 Processor -- start 2023-09-21T12:58:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8610 0x557b923b91e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b7a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b923b9af0 con 0x557b923a8610 2023-09-21T12:58:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b923b7fc0 con 0x557b923ad360 2023-09-21T12:58:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b923b8130 con 0x557b923a8f30 2023-09-21T12:58:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.969+0000 7f99080bdb80 10 client.0 _ll_register_callbacks cb 0x557b921e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:20.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59484/0 (socket says 172.21.15.142:59484) 2023-09-21T12:58:20.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 -- 172.21.15.142:0/155573742 learned_addr learned my addr 172.21.15.142:0/155573742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:20.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8610 0x557b923b91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 -- 172.21.15.142:0/155573742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 msgr2=0x557b923b7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 -- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8610 msgr2=0x557b923b91e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:20.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8610 0x557b923b91e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 -- 172.21.15.142:0/155573742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b9210dc60 con 0x557b923a8f30 2023-09-21T12:58:20.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98f1d9a700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x557b923c5070 tx=0x7f98dc01cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cd8120727afce61 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.970+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc017040 con 0x557b923a8f30 2023-09-21T12:58:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98e400f040 con 0x557b923a8f30 2023-09-21T12:58:20.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f98dc004d80 con 0x557b923a8f30 2023-09-21T12:58:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98dc004020 con 0x557b923a8f30 2023-09-21T12:58:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 10 client.26020 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x557b9214b250 con 0x557b923a8f30 2023-09-21T12:58:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98dc031080 con 0x557b923a8f30 2023-09-21T12:58:20.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f98dc003680 con 0x557b923a8f30 2023-09-21T12:58:20.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 10 client.26020 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:20.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 10 client.26020 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:58:20.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 20 client.26020 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:20.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b924175a0 0x557b924199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:20.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 4 client.26020 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:20.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557b922f2e60 con 0x557b924175a0 2023-09-21T12:58:20.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.971+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b924175a0 0x557b924199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:20.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f98d5ffb700 10 client.26020 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:20.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f98f2d9c700 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b924175a0 0x557b924199c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f89d94b200a7e29b server_cookie=396821ade156847b in_seq=0 out_seq=0 2023-09-21T12:58:20.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f98d5ffb700 1 -- 172.21.15.142:0/155573742 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557b922f2e60 con 0x557b924175a0 2023-09-21T12:58:20.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f98d5ffb700 10 client.26020 handle_command_reply: tid=0 2023-09-21T12:58:20.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 client.26020 shutdown 2023-09-21T12:58:20.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 msgr2=0x557b923b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x557b923c5070 tx=0x7f98dc01cbe0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 shutdown_connections 2023-09-21T12:58:20.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557b923a8610 0x557b923b91e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x557b924175a0 0x557b924199c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557b923ad360 0x557b923b7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 --2- 172.21.15.142:0/155573742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557b923a8f30 0x557b923b7540 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 >> 172.21.15.142:0/155573742 conn(0x557b922d5000 msgr2=0x557b923ac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f98d5ffb700 0 client.26020 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:20.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.972+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 shutdown_connections 2023-09-21T12:58:20.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f99080bdb80 1 -- 172.21.15.142:0/155573742 wait complete. 2023-09-21T12:58:20.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f99080bdb80 20 client.26020 trim_cache size 0 max 16384 2023-09-21T12:58:20.989 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:20.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 msgr2=0x7f98d80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 0x7f98d80a2cf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f98e8097380 tx=0x7f98e801a040 comp rx=0 tx=0).stop 2023-09-21T12:58:20.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 msgr2=0x7f98ec199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:20.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f98e8005910 tx=0x7f98e8005720 comp rx=0 tx=0).stop 2023-09-21T12:58:20.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 shutdown_connections 2023-09-21T12:58:20.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f98d80a0830 0x7f98d80a2cf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f98ec10b370 0x7f98ec19db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f98ec101fa0 0x7f98ec199170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 --2- 172.21.15.142:0/287312042 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f98ec1028c0 0x7f98ec1996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:20.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 >> 172.21.15.142:0/287312042 conn(0x7f98ec0fb740 msgr2=0x7f98ec10d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:20.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 shutdown_connections 2023-09-21T12:58:20.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:20.973+0000 7f98f47ff700 1 -- 172.21.15.142:0/287312042 wait complete. 2023-09-21T12:58:20.993 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:58:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 -- 172.21.15.142:0/1763748743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd28103ba0 msgr2=0x7fbd28107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/1763748743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd28103ba0 0x7fbd28107be0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbd180098f0 tx=0x7fbd18009c00 comp rx=0 tx=0).stop 2023-09-21T12:58:21.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 -- 172.21.15.142:0/1763748743 shutdown_connections 2023-09-21T12:58:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/1763748743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd28108310 0x7fbd2810fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/1763748743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd281031f0 0x7fbd281035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/1763748743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd28103ba0 0x7fbd28107be0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.209+0000 7fbd2fdff700 1 -- 172.21.15.142:0/1763748743 >> 172.21.15.142:0/1763748743 conn(0x7fbd280fea30 msgr2=0x7fbd28100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.210+0000 7fbd2fdff700 1 -- 172.21.15.142:0/1763748743 shutdown_connections 2023-09-21T12:58:21.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.210+0000 7fbd2fdff700 1 -- 172.21.15.142:0/1763748743 wait complete. 2023-09-21T12:58:21.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.211+0000 7fbd2fdff700 1 Processor -- start 2023-09-21T12:58:21.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.211+0000 7fbd2fdff700 1 -- start start 2023-09-21T12:58:21.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd28108310 0x7fbd281996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2819db00 0x7fbd2819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819e580 con 0x7fbd2819db00 2023-09-21T12:58:21.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819e6f0 con 0x7fbd281031f0 2023-09-21T12:58:21.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2819e8b0 con 0x7fbd28108310 2023-09-21T12:58:21.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60880/0 (socket says 172.21.15.142:60880) 2023-09-21T12:58:21.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3633473448 learned_addr learned my addr 172.21.15.142:0/3633473448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:21.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd28108310 0x7fbd281996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.212+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2819db00 0x7fbd2819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3633473448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd28108310 msgr2=0x7fbd281996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd28108310 0x7fbd281996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2819db00 msgr2=0x7fbd2819df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2819db00 0x7fbd2819df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3633473448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240095f0 con 0x7fbd281031f0 2023-09-21T12:58:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400ec10 tx=0x7fbd2400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd1effd700 1 -- 172.21.15.142:0/3633473448 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2400cc90 con 0x7fbd281031f0 2023-09-21T12:58:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd18009520 con 0x7fbd281031f0 2023-09-21T12:58:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd1effd700 1 -- 172.21.15.142:0/3633473448 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd240044e0 con 0x7fbd281031f0 2023-09-21T12:58:21.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd1effd700 1 -- 172.21.15.142:0/3633473448 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24010430 con 0x7fbd281031f0 2023-09-21T12:58:21.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.213+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a61b0 con 0x7fbd281031f0 2023-09-21T12:58:21.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.217+0000 7fbd1effd700 1 -- 172.21.15.142:0/3633473448 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fbd24003fb0 con 0x7fbd281031f0 2023-09-21T12:58:21.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.218+0000 7fbd43730b80 1 Processor -- start 2023-09-21T12:58:21.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 -- start start 2023-09-21T12:58:21.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd1effd700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 0x7fbd140a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd1effd700 1 -- 172.21.15.142:0/3633473448 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbd24014070 con 0x7fbd281031f0 2023-09-21T12:58:21.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x560331299e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56033129a360 0x56033129a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331209ca0 con 0x560331295f30 2023-09-21T12:58:21.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603311edc70 con 0x56033129a360 2023-09-21T12:58:21.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd43730b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603311eb590 con 0x560331295610 2023-09-21T12:58:21.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 0x7fbd140a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59512/0 (socket says 172.21.15.142:59512) 2023-09-21T12:58:21.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1067889778 learned_addr learned my addr 172.21.15.142:0/1067889778 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:21.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56033129a360 0x56033129a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.219+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x560331299e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1067889778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56033129a360 msgr2=0x56033129a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56033129a360 0x56033129a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1067889778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 msgr2=0x560331299e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x560331299e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1067889778 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560331011de0 con 0x560331295610 2023-09-21T12:58:21.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005d70 tx=0x7fbd24099550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=266df065ddcc188e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 0x7fbd140a2c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009ec0 tx=0x7fbd20009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd13fff700 1 -- 172.21.15.142:0/1067889778 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2409a090 con 0x560331295610 2023-09-21T12:58:21.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd13fff700 1 -- 172.21.15.142:0/1067889778 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd24099990 con 0x560331295610 2023-09-21T12:58:21.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.220+0000 7fbd13fff700 1 -- 172.21.15.142:0/1067889778 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24004330 con 0x560331295610 2023-09-21T12:58:21.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 -- 172.21.15.142:0/1067889778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 msgr2=0x5603312959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005d70 tx=0x7fbd24099550 comp rx=0 tx=0).stop 2023-09-21T12:58:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 -- 172.21.15.142:0/1067889778 shutdown_connections 2023-09-21T12:58:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56033129a360 0x56033129a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295610 0x5603312959f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1067889778 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x560331299e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 -- 172.21.15.142:0/1067889778 >> 172.21.15.142:0/1067889778 conn(0x5603311c2000 msgr2=0x5603312906a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 -- 172.21.15.142:0/1067889778 shutdown_connections 2023-09-21T12:58:21.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.221+0000 7fbd43730b80 1 -- 172.21.15.142:0/1067889778 wait complete. 2023-09-21T12:58:21.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.222+0000 7fbd43730b80 1 -- start start 2023-09-21T12:58:21.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.222+0000 7fbd43730b80 1 Processor -- start 2023-09-21T12:58:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603311e6e80 con 0x560331295f30 2023-09-21T12:58:21.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331183740 con 0x560331295610 2023-09-21T12:58:21.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603311833e0 con 0x56033129a360 2023-09-21T12:58:21.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd43730b80 10 client.0 _ll_register_callbacks cb 0x5603310cda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:21.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2e39c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60898/0 (socket says 172.21.15.142:60898) 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3141369075 learned_addr learned my addr 172.21.15.142:0/3141369075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2e39c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59528/0 (socket says 172.21.15.142:59528) 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.223+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3141369075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 msgr2=0x56033129f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3141369075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 msgr2=0x56033129ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3141369075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd281a61b0 con 0x560331295610 2023-09-21T12:58:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:21.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd240a14d0 tx=0x7fbd2409a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f974d493e49100cc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd117fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd240a1a00 con 0x560331295610 2023-09-21T12:58:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbd24084040 con 0x560331295610 2023-09-21T12:58:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560331157bb0 con 0x560331295610 2023-09-21T12:58:21.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd240b7be0 con 0x560331295610 2023-09-21T12:58:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd43730b80 10 client.26069 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.224+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560330ffac60 con 0x560331295610 2023-09-21T12:58:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd2407e080 con 0x560331295610 2023-09-21T12:58:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbd240ae020 con 0x560331295610 2023-09-21T12:58:21.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 10 client.26069 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 10 client.26069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 20 client.26069 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:21.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603312aeef0 0x5603312b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 4 client.26069 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560331264020 con 0x5603312aeef0 2023-09-21T12:58:21.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.225+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603312aeef0 0x5603312b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.226+0000 7fbd117fa700 10 client.26069 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.226+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603312aeef0 0x5603312b1310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e5ba1c64a464b7 server_cookie=c2c252ffbca8149e in_seq=0 out_seq=0 2023-09-21T12:58:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.226+0000 7fbd117fa700 1 -- 172.21.15.142:0/3141369075 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560331264020 con 0x5603312aeef0 2023-09-21T12:58:21.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.226+0000 7fbd117fa700 10 client.26069 handle_command_reply: tid=0 2023-09-21T12:58:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.226+0000 7fbd43730b80 1 client.26069 shutdown 2023-09-21T12:58:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 msgr2=0x5603312a1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbd240a14d0 tx=0x7fbd2409a100 comp rx=0 tx=0).stop 2023-09-21T12:58:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 shutdown_connections 2023-09-21T12:58:21.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603312aeef0 0x5603312b1310 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1b60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd117fa700 0 client.26069 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3141369075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 >> 172.21.15.142:0/3141369075 conn(0x5603311c2000 msgr2=0x560331290290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 shutdown_connections 2023-09-21T12:58:21.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 1 -- 172.21.15.142:0/3141369075 wait complete. 2023-09-21T12:58:21.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.227+0000 7fbd43730b80 20 client.26069 trim_cache size 0 max 16384 2023-09-21T12:58:21.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 Processor -- start 2023-09-21T12:58:21.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 -- start start 2023-09-21T12:58:21.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331067920 con 0x560331295f30 2023-09-21T12:58:21.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56033129f090 con 0x560331295610 2023-09-21T12:58:21.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.242+0000 7fbd43730b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331298cc0 con 0x56033129a360 2023-09-21T12:58:21.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60914/0 (socket says 172.21.15.142:60914) 2023-09-21T12:58:21.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3157690000 learned_addr learned my addr 172.21.15.142:0/3157690000 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:21.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3157690000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 msgr2=0x56033129eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3157690000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 msgr2=0x56033129e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 -- 172.21.15.142:0/3157690000 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560331038250 con 0x560331295610 2023-09-21T12:58:21.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005d70 tx=0x7fbd24097f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc88b941b655c5c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.243+0000 7fbd1cbff700 1 -- 172.21.15.142:0/3157690000 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24099bf0 con 0x560331295610 2023-09-21T12:58:21.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd1cbff700 1 -- 172.21.15.142:0/3157690000 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560331157bb0 con 0x560331295610 2023-09-21T12:58:21.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd1cbff700 1 -- 172.21.15.142:0/3157690000 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24009a10 con 0x560331295610 2023-09-21T12:58:21.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 -- 172.21.15.142:0/3157690000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 msgr2=0x5603312a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fbd24005d70 tx=0x7fbd24097f40 comp rx=0 tx=0).stop 2023-09-21T12:58:21.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 -- 172.21.15.142:0/3157690000 shutdown_connections 2023-09-21T12:58:21.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56033129a360 0x56033129eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a1690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 --2- 172.21.15.142:0/3157690000 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560331295f30 0x56033129e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 -- 172.21.15.142:0/3157690000 >> 172.21.15.142:0/3157690000 conn(0x5603311c2000 msgr2=0x56033129c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 -- 172.21.15.142:0/3157690000 shutdown_connections 2023-09-21T12:58:21.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.244+0000 7fbd43730b80 1 -- 172.21.15.142:0/3157690000 wait complete. 2023-09-21T12:58:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.245+0000 7fbd43730b80 1 -- start start 2023-09-21T12:58:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.245+0000 7fbd43730b80 1 Processor -- start 2023-09-21T12:58:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 0x5603312a4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 0x560331301d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331302260 con 0x56033129a360 2023-09-21T12:58:21.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603313023d0 con 0x560331295610 2023-09-21T12:58:21.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560331302590 con 0x560331295f30 2023-09-21T12:58:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd43730b80 10 client.0 _ll_register_callbacks cb 0x5603310cda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd2d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 0x5603312a4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd2db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60930/0 (socket says 172.21.15.142:60930) 2023-09-21T12:58:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1187122983 learned_addr learned my addr 172.21.15.142:0/1187122983 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.246+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 0x560331301d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1187122983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 msgr2=0x5603312a4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 0x5603312a4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1187122983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 msgr2=0x560331301d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 0x560331301d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 -- 172.21.15.142:0/1187122983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560330ffac60 con 0x560331295610 2023-09-21T12:58:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2e39c700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 0x560331301d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:21.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 0x5603312a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd2db9b700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbd24099920 tx=0x7fbd240c9d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48aed59e79daeae server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd117fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd24009a10 con 0x560331295610 2023-09-21T12:58:21.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbd24084040 con 0x560331295610 2023-09-21T12:58:21.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd24099990 con 0x560331295610 2023-09-21T12:58:21.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd240992f0 con 0x560331295610 2023-09-21T12:58:21.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd43730b80 10 client.26075 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:21.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5603310102b0 con 0x560331295610 2023-09-21T12:58:21.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.247+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd240a5080 con 0x560331295610 2023-09-21T12:58:21.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbd240ae070 con 0x560331295610 2023-09-21T12:58:21.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 10 client.26075 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:21.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 10 client.26075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:21.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 20 client.26075 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:21.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603313037e0 0x560331305bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:21.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 4 client.26075 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:21.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5603311dfe60 con 0x5603313037e0 2023-09-21T12:58:21.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603313037e0 0x560331305bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:21.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd2d39a700 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603313037e0 0x560331305bd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f4313addc782934 server_cookie=c1e01be0b90f47c0 in_seq=0 out_seq=0 2023-09-21T12:58:21.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.248+0000 7fbd117fa700 10 client.26075 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:21.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd117fa700 1 -- 172.21.15.142:0/1187122983 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5603311dfe60 con 0x5603313037e0 2023-09-21T12:58:21.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd117fa700 10 client.26075 handle_command_reply: tid=0 2023-09-21T12:58:21.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 client.26075 shutdown 2023-09-21T12:58:21.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 msgr2=0x5603312a46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbd24099920 tx=0x7fbd240c9d10 comp rx=0 tx=0).stop 2023-09-21T12:58:21.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 shutdown_connections 2023-09-21T12:58:21.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5603313037e0 0x560331305bd0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56033129a360 0x560331301d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560331295610 0x5603312a46c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd117fa700 0 client.26075 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:21.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 --2- 172.21.15.142:0/1187122983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560331295f30 0x5603312a4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 >> 172.21.15.142:0/1187122983 conn(0x5603311c2000 msgr2=0x5603312993b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 shutdown_connections 2023-09-21T12:58:21.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 1 -- 172.21.15.142:0/1187122983 wait complete. 2023-09-21T12:58:21.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.249+0000 7fbd43730b80 20 client.26075 trim_cache size 0 max 16384 2023-09-21T12:58:21.274 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:21.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 msgr2=0x7fbd140a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 0x7fbd140a2c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009ec0 tx=0x7fbd20009920 comp rx=0 tx=0).stop 2023-09-21T12:58:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 msgr2=0x7fbd28199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:21.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbd2400ec10 tx=0x7fbd2400ef20 comp rx=0 tx=0).stop 2023-09-21T12:58:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 shutdown_connections 2023-09-21T12:58:21.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd140a07b0 0x7fbd140a2c70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd2819db00 0x7fbd2819df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd281031f0 0x7fbd28199160 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 --2- 172.21.15.142:0/3633473448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd28108310 0x7fbd281996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 >> 172.21.15.142:0/3633473448 conn(0x7fbd280fea30 msgr2=0x7fbd280ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 shutdown_connections 2023-09-21T12:58:21.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:21.250+0000 7fbd2fdff700 1 -- 172.21.15.142:0/3633473448 wait complete. 2023-09-21T12:58:21.672 INFO:tasks.workunit.client.0.smithi142.stdout: 1 139044 12.37 MB/sec warmup 62 sec latency 62.661 ms 2023-09-21T12:58:21.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:21 smithi142 ceph-mon[97663]: pgmap v66: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 420 op/s 2023-09-21T12:58:21.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:21 smithi160 ceph-mon[134450]: pgmap v66: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 420 op/s 2023-09-21T12:58:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:21 smithi156 ceph-mon[134078]: pgmap v66: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.6 MiB/s wr, 420 op/s 2023-09-21T12:58:22.282 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:58:22.283 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:58:22.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 -- 172.21.15.142:0/2284688205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc100fb0 msgr2=0x7fcdcc101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/2284688205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc101390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009990 tx=0x7fcdbc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 -- 172.21.15.142:0/2284688205 shutdown_connections 2023-09-21T12:58:22.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/2284688205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc1060d0 0x7fcdcc10dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/2284688205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc101390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/2284688205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc101960 0x7fcdcc1059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 -- 172.21.15.142:0/2284688205 >> 172.21.15.142:0/2284688205 conn(0x7fcdcc0fc830 msgr2=0x7fcdcc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 -- 172.21.15.142:0/2284688205 shutdown_connections 2023-09-21T12:58:22.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.504+0000 7fcdd27ff700 1 -- 172.21.15.142:0/2284688205 wait complete. 2023-09-21T12:58:22.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 Processor -- start 2023-09-21T12:58:22.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 -- start start 2023-09-21T12:58:22.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc1060d0 0x7fcdcc1974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc19b910 0x7fcdcc19bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19c390 con 0x7fcdcc19b910 2023-09-21T12:58:22.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19c500 con 0x7fcdcc100fb0 2023-09-21T12:58:22.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.506+0000 7fcdd27ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc19c6c0 con 0x7fcdcc1060d0 2023-09-21T12:58:22.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60956/0 (socket says 172.21.15.142:60956) 2023-09-21T12:58:22.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 -- 172.21.15.142:0/3743077923 learned_addr learned my addr 172.21.15.142:0/3743077923 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc19b910 0x7fcdcc19bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc1060d0 0x7fcdcc1974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 -- 172.21.15.142:0/3743077923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc1060d0 msgr2=0x7fcdcc1974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc1060d0 0x7fcdcc1974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 -- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc19b910 msgr2=0x7fcdcc19bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc19b910 0x7fcdcc19bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 -- 172.21.15.142:0/3743077923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc0009520 con 0x7fcdcc100fb0 2023-09-21T12:58:22.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdcbfff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005910 tx=0x7fcdbc005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.507+0000 7fcdc97fa700 1 -- 172.21.15.142:0/3743077923 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc01d070 con 0x7fcdcc100fb0 2023-09-21T12:58:22.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.508+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc0095f0 con 0x7fcdcc100fb0 2023-09-21T12:58:22.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.508+0000 7fcdc97fa700 1 -- 172.21.15.142:0/3743077923 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdbc022470 con 0x7fcdcc100fb0 2023-09-21T12:58:22.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.508+0000 7fcdc97fa700 1 -- 172.21.15.142:0/3743077923 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc017650 con 0x7fcdcc100fb0 2023-09-21T12:58:22.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.508+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc1a3e60 con 0x7fcdcc100fb0 2023-09-21T12:58:22.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.511+0000 7fcdc97fa700 1 -- 172.21.15.142:0/3743077923 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcdbc0225e0 con 0x7fcdcc100fb0 2023-09-21T12:58:22.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 Processor -- start 2023-09-21T12:58:22.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 -- start start 2023-09-21T12:58:22.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b672b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b67c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714ad2d20 con 0x558714b633c0 2023-09-21T12:58:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714ab6cf0 con 0x558714b677f0 2023-09-21T12:58:22.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.512+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714ab4610 con 0x558714b62aa0 2023-09-21T12:58:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b67c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b672b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59580/0 (socket says 172.21.15.142:59580) 2023-09-21T12:58:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/142672950 learned_addr learned my addr 172.21.15.142:0/142672950 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b67c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60970/0 (socket says 172.21.15.142:60970) 2023-09-21T12:58:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/142672950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 msgr2=0x558714b67c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b67c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/142672950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 msgr2=0x558714b672b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b672b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/142672950 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587148dae60 con 0x558714b62aa0 2023-09-21T12:58:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdc97fa700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 0x7fcdb40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011680 tx=0x7fcdc4009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=611dca0dd102fc43 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.513+0000 7fcdc97fa700 1 -- 172.21.15.142:0/3743077923 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdbc0cd2c0 con 0x7fcdcc100fb0 2023-09-21T12:58:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcdcbfff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 0x7fcdb40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcdb27fc700 1 -- 172.21.15.142:0/142672950 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400e040 con 0x558714b62aa0 2023-09-21T12:58:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcdb27fc700 1 -- 172.21.15.142:0/142672950 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc400f040 con 0x558714b62aa0 2023-09-21T12:58:22.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcdb27fc700 1 -- 172.21.15.142:0/142672950 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40048c0 con 0x558714b62aa0 2023-09-21T12:58:22.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 -- 172.21.15.142:0/142672950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 msgr2=0x558714b62e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcdcbfff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 0x7fcdb40a2c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0a2280 tx=0x7fcdbc022f90 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4011680 tx=0x7fcdc4009920 comp rx=0 tx=0).stop 2023-09-21T12:58:22.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 -- 172.21.15.142:0/142672950 shutdown_connections 2023-09-21T12:58:22.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b67c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b62e80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/142672950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b672b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.514+0000 7fcde60d9b80 1 -- 172.21.15.142:0/142672950 >> 172.21.15.142:0/142672950 conn(0x558714a8b080 msgr2=0x558714b59720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.529 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.515+0000 7fcde60d9b80 1 -- 172.21.15.142:0/142672950 shutdown_connections 2023-09-21T12:58:22.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.515+0000 7fcde60d9b80 1 -- 172.21.15.142:0/142672950 wait complete. 2023-09-21T12:58:22.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.515+0000 7fcde60d9b80 1 -- start start 2023-09-21T12:58:22.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 Processor -- start 2023-09-21T12:58:22.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b6c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b677f0 0x558714b6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714aaff00 con 0x558714b633c0 2023-09-21T12:58:22.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714a4c7c0 con 0x558714b62aa0 2023-09-21T12:58:22.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714a4c460 con 0x558714b677f0 2023-09-21T12:58:22.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcde60d9b80 10 client.0 _ll_register_callbacks cb 0x558714996b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:22.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b6c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60980/0 (socket says 172.21.15.142:60980) 2023-09-21T12:58:22.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/1139018204 learned_addr learned my addr 172.21.15.142:0/1139018204 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.516+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b677f0 0x558714b6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1139018204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b677f0 msgr2=0x558714b6c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b677f0 0x558714b6c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 msgr2=0x558714b6ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1139018204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc4011330 con 0x558714b633c0 2023-09-21T12:58:22.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:22.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b6c200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc067a40 tx=0x7fcdc0011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874405f4e8b86e1d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:58:22.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0016070 con 0x558714b633c0 2023-09-21T12:58:22.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558714a20c30 con 0x558714b633c0 2023-09-21T12:58:22.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdc0004020 con 0x558714b633c0 2023-09-21T12:58:22.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdc00041e0 con 0x558714b633c0 2023-09-21T12:58:22.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.517+0000 7fcde60d9b80 10 client.16026 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:22.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5587148c3ce0 con 0x558714b633c0 2023-09-21T12:58:22.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc0027020 con 0x558714b633c0 2023-09-21T12:58:22.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcdc0021070 con 0x558714b633c0 2023-09-21T12:58:22.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 10 client.16026 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:22.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:22.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 20 client.16026 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:22.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714b7c970 0x558714b7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 4 client.16026 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:22.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558714b2d0a0 con 0x558714b7c970 2023-09-21T12:58:22.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.518+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714b7c970 0x558714b7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.519+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714b7c970 0x558714b7ed90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4805b8a7c2d555 server_cookie=7d42a0a8cd7ab495 in_seq=0 out_seq=0 2023-09-21T12:58:22.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.519+0000 7fcdab7fe700 10 client.16026 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1139018204 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558714b2d0a0 con 0x558714b7c970 2023-09-21T12:58:22.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcdab7fe700 10 client.16026 handle_command_reply: tid=0 2023-09-21T12:58:22.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 client.16026 shutdown 2023-09-21T12:58:22.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 msgr2=0x558714b6c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b6c200 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc067a40 tx=0x7fcdc0011b70 comp rx=0 tx=0).stop 2023-09-21T12:58:22.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 shutdown_connections 2023-09-21T12:58:22.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714b7c970 0x558714b7ed90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b677f0 0x558714b6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b6ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1139018204 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b6c200 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcdab7fe700 0 client.16026 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 >> 172.21.15.142:0/1139018204 conn(0x558714a8b080 msgr2=0x558714b59310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 shutdown_connections 2023-09-21T12:58:22.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.521+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1139018204 wait complete. 2023-09-21T12:58:22.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.522+0000 7fcde60d9b80 20 client.16026 trim_cache size 0 max 16384 2023-09-21T12:58:22.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.541+0000 7fcde60d9b80 1 Processor -- start 2023-09-21T12:58:22.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.541+0000 7fcde60d9b80 1 -- start start 2023-09-21T12:58:22.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b66820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b66d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587149309a0 con 0x558714b633c0 2023-09-21T12:58:22.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714b6d310 con 0x558714b677f0 2023-09-21T12:58:22.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714b53a10 con 0x558714b62aa0 2023-09-21T12:58:22.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59600/0 (socket says 172.21.15.142:59600) 2023-09-21T12:58:22.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/422107016 learned_addr learned my addr 172.21.15.142:0/422107016 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b66d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b66820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/422107016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 msgr2=0x558714b66d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b66d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/422107016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 msgr2=0x558714b66820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b66820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.542+0000 7fcdd0d9c700 1 -- 172.21.15.142:0/422107016 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558714b839c0 con 0x558714b62aa0 2023-09-21T12:58:22.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40043f0 tx=0x7fcdc400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77c2ae8c3d9a1d34 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcdb2ffd700 1 -- 172.21.15.142:0/422107016 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400e040 con 0x558714b62aa0 2023-09-21T12:58:22.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcdb2ffd700 1 -- 172.21.15.142:0/422107016 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdc4005960 con 0x558714b62aa0 2023-09-21T12:58:22.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcdb2ffd700 1 -- 172.21.15.142:0/422107016 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4003af0 con 0x558714b62aa0 2023-09-21T12:58:22.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 -- 172.21.15.142:0/422107016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 msgr2=0x558714b6b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40043f0 tx=0x7fcdc400b040 comp rx=0 tx=0).stop 2023-09-21T12:58:22.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 -- 172.21.15.142:0/422107016 shutdown_connections 2023-09-21T12:58:22.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b677f0 0x558714b66d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b62aa0 0x558714b6b9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.543+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/422107016 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b633c0 0x558714b66820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.544+0000 7fcde60d9b80 1 -- 172.21.15.142:0/422107016 >> 172.21.15.142:0/422107016 conn(0x558714a8b080 msgr2=0x558714b65880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.544+0000 7fcde60d9b80 1 -- 172.21.15.142:0/422107016 shutdown_connections 2023-09-21T12:58:22.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.544+0000 7fcde60d9b80 1 -- 172.21.15.142:0/422107016 wait complete. 2023-09-21T12:58:22.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.544+0000 7fcde60d9b80 1 -- start start 2023-09-21T12:58:22.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.544+0000 7fcde60d9b80 1 Processor -- start 2023-09-21T12:58:22.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b72870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b677f0 0x558714bca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714bcad30 con 0x558714b677f0 2023-09-21T12:58:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714bcaea0 con 0x558714b62aa0 2023-09-21T12:58:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558714bcb060 con 0x558714b633c0 2023-09-21T12:58:22.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcde60d9b80 10 client.0 _ll_register_callbacks cb 0x558714996b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:22.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59610/0 (socket says 172.21.15.142:59610) 2023-09-21T12:58:22.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1591456834 learned_addr learned my addr 172.21.15.142:0/1591456834 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b72870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b677f0 0x558714bca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 msgr2=0x558714b72870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b72870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1591456834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b677f0 msgr2=0x558714bca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b677f0 0x558714bca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 -- 172.21.15.142:0/1591456834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc4028040 con 0x558714b633c0 2023-09-21T12:58:22.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdcb7fe700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc067a40 tx=0x7fcdc00112d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7baa02c43e912165 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.545+0000 7fcdab7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:22.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0016070 con 0x558714b633c0 2023-09-21T12:58:22.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558714aa8ee0 con 0x558714b633c0 2023-09-21T12:58:22.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdc0000e40 con 0x558714b633c0 2023-09-21T12:58:22.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdc000fc20 con 0x558714b633c0 2023-09-21T12:58:22.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 10 client.26056 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:22.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5587149012d0 con 0x558714b633c0 2023-09-21T12:58:22.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558714aa8ee0 con 0x558714b633c0 2023-09-21T12:58:22.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcdc002a070 con 0x558714b633c0 2023-09-21T12:58:22.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 10 client.26056 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:22.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 10 client.26056 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:22.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 20 client.26056 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:22.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714bd2950 0x558714bd4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 4 client.26056 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:58:22.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.546+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558714aa8c00 con 0x558714bd2950 2023-09-21T12:58:22.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.547+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714bd2950 0x558714bd4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.547+0000 7fcdab7fe700 10 client.26056 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.547+0000 7fcdd0d9c700 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714bd2950 0x558714bd4d70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e317457e0d4d4b7f server_cookie=baaba242c9a7fd09 in_seq=0 out_seq=0 2023-09-21T12:58:22.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcdab7fe700 1 -- 172.21.15.142:0/1591456834 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558714aa8c00 con 0x558714bd2950 2023-09-21T12:58:22.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcdab7fe700 10 client.26056 handle_command_reply: tid=0 2023-09-21T12:58:22.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 client.26056 shutdown 2023-09-21T12:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 msgr2=0x558714b72db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc067a40 tx=0x7fcdc00112d0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 shutdown_connections 2023-09-21T12:58:22.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558714bd2950 0x558714bd4d70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558714b677f0 0x558714bca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558714b62aa0 0x558714b72870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 --2- 172.21.15.142:0/1591456834 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558714b633c0 0x558714b72db0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcdab7fe700 0 client.26056 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 >> 172.21.15.142:0/1591456834 conn(0x558714a8b080 msgr2=0x558714b66820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 shutdown_connections 2023-09-21T12:58:22.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.548+0000 7fcde60d9b80 1 -- 172.21.15.142:0/1591456834 wait complete. 2023-09-21T12:58:22.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcde60d9b80 20 client.26056 trim_cache size 0 max 16384 2023-09-21T12:58:22.566 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:22.566 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:58:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "e056bc89-c9ce-41f3-a4ab-54565ace9018", 2023-09-21T12:58:22.567 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:58:22.567 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 msgr2=0x7fcdb40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 0x7fcdb40a2c70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc0a2280 tx=0x7fcdbc022f90 comp rx=0 tx=0).stop 2023-09-21T12:58:22.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 msgr2=0x7fcdcc196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc005910 tx=0x7fcdbc005740 comp rx=0 tx=0).stop 2023-09-21T12:58:22.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 shutdown_connections 2023-09-21T12:58:22.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdb40a07b0 0x7fcdb40a2c70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcdcc19b910 0x7fcdcc19bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcdcc100fb0 0x7fcdcc196f70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 --2- 172.21.15.142:0/3743077923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcdcc1060d0 0x7fcdcc1974b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 >> 172.21.15.142:0/3743077923 conn(0x7fcdcc0fc830 msgr2=0x7fcdcc105210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.549+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 shutdown_connections 2023-09-21T12:58:22.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.550+0000 7fcdd27ff700 1 -- 172.21.15.142:0/3743077923 wait complete. 2023-09-21T12:58:22.572 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:58:22.672 INFO:tasks.workunit.client.0.smithi142.stdout: 1 141385 12.37 MB/sec warmup 63 sec latency 18.366 ms 2023-09-21T12:58:22.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.792+0000 7fda905ff700 1 -- 172.21.15.142:0/1274797965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88100fb0 msgr2=0x7fda88101390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.792+0000 7fda905ff700 1 --2- 172.21.15.142:0/1274797965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88100fb0 0x7fda88101390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fda84009990 tx=0x7fda84009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 -- 172.21.15.142:0/1274797965 shutdown_connections 2023-09-21T12:58:22.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 --2- 172.21.15.142:0/1274797965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda881060d0 0x7fda8810dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 --2- 172.21.15.142:0/1274797965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda88100fb0 0x7fda88101390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 --2- 172.21.15.142:0/1274797965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda88101960 0x7fda881059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 -- 172.21.15.142:0/1274797965 >> 172.21.15.142:0/1274797965 conn(0x7fda880fc830 msgr2=0x7fda880fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 -- 172.21.15.142:0/1274797965 shutdown_connections 2023-09-21T12:58:22.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.793+0000 7fda905ff700 1 -- 172.21.15.142:0/1274797965 wait complete. 2023-09-21T12:58:22.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 Processor -- start 2023-09-21T12:58:22.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 -- start start 2023-09-21T12:58:22.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda881060d0 0x7fda88199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 0x7fda8819de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8819e470 con 0x7fda881060d0 2023-09-21T12:58:22.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8819e5e0 con 0x7fda8819d9f0 2023-09-21T12:58:22.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.794+0000 7fda905ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8819e7a0 con 0x7fda88100fb0 2023-09-21T12:58:22.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59630/0 (socket says 172.21.15.142:59630) 2023-09-21T12:58:22.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 -- 172.21.15.142:0/3743746596 learned_addr learned my addr 172.21.15.142:0/3743746596 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 0x7fda8819de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8db9a700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda881060d0 0x7fda88199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 -- 172.21.15.142:0/3743746596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 msgr2=0x7fda8819de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 0x7fda8819de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 -- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda881060d0 msgr2=0x7fda88199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda881060d0 0x7fda88199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 -- 172.21.15.142:0/3743746596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda840095f0 con 0x7fda88100fb0 2023-09-21T12:58:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 0x7fda8819de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.795+0000 7fda8e39b700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda84005750 tx=0x7fda84005780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.796+0000 7fda7f7fe700 1 -- 172.21.15.142:0/3743746596 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8401d070 con 0x7fda88100fb0 2023-09-21T12:58:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.796+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda881a5ca0 con 0x7fda88100fb0 2023-09-21T12:58:22.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.796+0000 7fda7f7fe700 1 -- 172.21.15.142:0/3743746596 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda84022470 con 0x7fda88100fb0 2023-09-21T12:58:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.796+0000 7fda7f7fe700 1 -- 172.21.15.142:0/3743746596 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84017650 con 0x7fda88100fb0 2023-09-21T12:58:22.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.796+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda881a6170 con 0x7fda88100fb0 2023-09-21T12:58:22.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.799+0000 7fda7f7fe700 1 -- 172.21.15.142:0/3743746596 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fda840225e0 con 0x7fda88100fb0 2023-09-21T12:58:22.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.800+0000 7fdaa3e71b80 1 Processor -- start 2023-09-21T12:58:22.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.800+0000 7fdaa3e71b80 1 -- start start 2023-09-21T12:58:22.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976da49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976da8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976d18ca0 con 0x55f976da4610 2023-09-21T12:58:22.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976cfcc70 con 0x55f976da9360 2023-09-21T12:58:22.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976cfa590 con 0x55f976da4f30 2023-09-21T12:58:22.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda7f7fe700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 0x7fda740a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda8db9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976da8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda8db9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:32806/0 (socket says 172.21.15.142:32806) 2023-09-21T12:58:22.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda8db9a700 1 -- 172.21.15.142:0/2981517076 learned_addr learned my addr 172.21.15.142:0/2981517076 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.801+0000 7fda7f7fe700 1 -- 172.21.15.142:0/3743746596 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fda840cd130 con 0x7fda88100fb0 2023-09-21T12:58:22.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 0x7fda740a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 -- 172.21.15.142:0/2981517076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 msgr2=0x55f976da8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976da8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 -- 172.21.15.142:0/2981517076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 msgr2=0x55f976da49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976da49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 -- 172.21.15.142:0/2981517076 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f976b20de0 con 0x55f976da9360 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda78009cf0 tx=0x7fda78011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6c2f37f16f7285e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda7cbfe700 1 -- 172.21.15.142:0/2981517076 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78011d70 con 0x55f976da9360 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda7cbfe700 1 -- 172.21.15.142:0/2981517076 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda78004510 con 0x55f976da9360 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.802+0000 7fda7cbfe700 1 -- 172.21.15.142:0/2981517076 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78005280 con 0x55f976da9360 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2981517076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 msgr2=0x55f976da97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fda78009cf0 tx=0x7fda78011440 comp rx=0 tx=0).stop 2023-09-21T12:58:22.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 0x7fda740a2c70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda80009fd0 tx=0x7fda80009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2981517076 shutdown_connections 2023-09-21T12:58:22.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976da49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da9360 0x55f976da97c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2981517076 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976da8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2981517076 >> 172.21.15.142:0/2981517076 conn(0x55f976cd1000 msgr2=0x55f976d9f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2981517076 shutdown_connections 2023-09-21T12:58:22.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.803+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2981517076 wait complete. 2023-09-21T12:58:22.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.804+0000 7fdaa3e71b80 1 -- start start 2023-09-21T12:58:22.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.804+0000 7fdaa3e71b80 1 Processor -- start 2023-09-21T12:58:22.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dadda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976dae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976cf5e80 con 0x55f976da9360 2023-09-21T12:58:22.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976c92740 con 0x55f976da4f30 2023-09-21T12:58:22.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976c923e0 con 0x55f976da4610 2023-09-21T12:58:22.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fdaa3e71b80 10 client.0 _ll_register_callbacks cb 0x55f976bdca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:22.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59648/0 (socket says 172.21.15.142:59648) 2023-09-21T12:58:22.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 -- 172.21.15.142:0/2807494369 learned_addr learned my addr 172.21.15.142:0/2807494369 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976dae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dadda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 -- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 msgr2=0x55f976dadda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dadda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 -- 172.21.15.142:0/2807494369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 msgr2=0x55f976dae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976dae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 -- 172.21.15.142:0/2807494369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78009920 con 0x55f976da4610 2023-09-21T12:58:22.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda8e39b700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda840ca910 tx=0x7fda84014af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e86ea4abce5302e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.805+0000 7fda71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:22.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8409a1e0 con 0x55f976da4610 2023-09-21T12:58:22.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fda8409ada0 con 0x55f976da4610 2023-09-21T12:58:22.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f976c66bb0 con 0x55f976da4610 2023-09-21T12:58:22.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda8409a000 con 0x55f976da4610 2023-09-21T12:58:22.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 10 client.26068 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:22.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f976b09c60 con 0x55f976da4610 2023-09-21T12:58:22.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f976c66bb0 con 0x55f976da4610 2023-09-21T12:58:22.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fda8409a900 con 0x55f976da4610 2023-09-21T12:58:22.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 10 client.26068 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:22.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 10 client.26068 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:22.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 20 client.26068 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:22.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976dc6920 0x55f976dc8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 4 client.26068 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:22.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.806+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f976d73020 con 0x55f976dc6920 2023-09-21T12:58:22.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.807+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976dc6920 0x55f976dc8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.807+0000 7fda8db9a700 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976dc6920 0x55f976dc8d40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1430b8b7449ba1e8 server_cookie=7a51d956bde21ddd in_seq=0 out_seq=0 2023-09-21T12:58:22.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.807+0000 7fda71ffb700 10 client.26068 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.808+0000 7fda71ffb700 1 -- 172.21.15.142:0/2807494369 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f976d73020 con 0x55f976dc6920 2023-09-21T12:58:22.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.808+0000 7fda71ffb700 10 client.26068 handle_command_reply: tid=0 2023-09-21T12:58:22.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 client.26068 shutdown 2023-09-21T12:58:22.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 msgr2=0x55f976db0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fda840ca910 tx=0x7fda84014af0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 shutdown_connections 2023-09-21T12:58:22.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976dc6920 0x55f976dc8d40 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976dae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4610 0x55f976db0b90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/2807494369 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dadda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fda71ffb700 0 client.26068 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 >> 172.21.15.142:0/2807494369 conn(0x55f976cd1000 msgr2=0x55f976d9f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 shutdown_connections 2023-09-21T12:58:22.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/2807494369 wait complete. 2023-09-21T12:58:22.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.809+0000 7fdaa3e71b80 20 client.26068 trim_cache size 0 max 16384 2023-09-21T12:58:22.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.827+0000 7fdaa3e71b80 1 Processor -- start 2023-09-21T12:58:22.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 -- start start 2023-09-21T12:58:22.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976db06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976da7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976b76920 con 0x55f976da9360 2023-09-21T12:58:22.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976da5670 con 0x55f976da4610 2023-09-21T12:58:22.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976d9e460 con 0x55f976da4f30 2023-09-21T12:58:22.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fda8db9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976db06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fda8e39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:32816/0 (socket says 172.21.15.142:32816) 2023-09-21T12:58:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fda8e39b700 1 -- 172.21.15.142:0/1439913544 learned_addr learned my addr 172.21.15.142:0/1439913544 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.828+0000 7fda8eb9c700 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976da7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 -- 172.21.15.142:0/1439913544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 msgr2=0x55f976db06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976db06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 -- 172.21.15.142:0/1439913544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 msgr2=0x55f976da7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976da7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 -- 172.21.15.142:0/1439913544 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f976dcd970 con 0x55f976da4610 2023-09-21T12:58:22.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda84005720 tx=0x7fda84009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9e8e8894c5514ab server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda7d3ff700 1 -- 172.21.15.142:0/1439913544 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8409a1e0 con 0x55f976da4610 2023-09-21T12:58:22.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda7d3ff700 1 -- 172.21.15.142:0/1439913544 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda8409a000 con 0x55f976da4610 2023-09-21T12:58:22.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.829+0000 7fda7d3ff700 1 -- 172.21.15.142:0/1439913544 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda84099d00 con 0x55f976da4610 2023-09-21T12:58:22.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1439913544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 msgr2=0x55f976da6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fda84005720 tx=0x7fda84009310 comp rx=0 tx=0).stop 2023-09-21T12:58:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1439913544 shutdown_connections 2023-09-21T12:58:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da9360 0x55f976da7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4610 0x55f976da6c50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1439913544 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da4f30 0x55f976db06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1439913544 >> 172.21.15.142:0/1439913544 conn(0x55f976cd1000 msgr2=0x55f976dc2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1439913544 shutdown_connections 2023-09-21T12:58:22.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1439913544 wait complete. 2023-09-21T12:58:22.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.830+0000 7fdaa3e71b80 1 -- start start 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 Processor -- start 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976dbbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dbc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 0x55f976e19750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976e19c90 con 0x55f976da4610 2023-09-21T12:58:22.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976e19dd0 con 0x55f976da4f30 2023-09-21T12:58:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f976e19f10 con 0x55f976da9360 2023-09-21T12:58:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.831+0000 7fdaa3e71b80 10 client.0 _ll_register_callbacks cb 0x55f976bdca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8eb9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 0x55f976e19750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dbc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8eb9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 0x55f976e19750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59670/0 (socket says 172.21.15.142:59670) 2023-09-21T12:58:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8eb9c700 1 -- 172.21.15.142:0/1270251260 learned_addr learned my addr 172.21.15.142:0/1270251260 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976dbbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 -- 172.21.15.142:0/1270251260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 msgr2=0x55f976e19750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 0x55f976e19750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 -- 172.21.15.142:0/1270251260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 msgr2=0x55f976dbbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976dbbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 -- 172.21.15.142:0/1270251260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f976b09c60 con 0x55f976da4f30 2023-09-21T12:58:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976dbbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda8db9a700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dbc410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda78009cc0 tx=0x7fda78011970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5340fbe8d1b26859 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:22.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda78004200 con 0x55f976da4f30 2023-09-21T12:58:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fda7802a070 con 0x55f976da4f30 2023-09-21T12:58:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.832+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda78004510 con 0x55f976da4f30 2023-09-21T12:58:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda78004360 con 0x55f976da4f30 2023-09-21T12:58:22.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 10 client.26111 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55f976b47250 con 0x55f976da4f30 2023-09-21T12:58:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda7803c020 con 0x55f976da4f30 2023-09-21T12:58:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fda78004be0 con 0x55f976da4f30 2023-09-21T12:58:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 10 client.26111 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:22.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 20 client.26111 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976e1b700 0x55f976e1db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 4 client.26111 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:58:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.833+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f976ceee60 con 0x55f976e1b700 2023-09-21T12:58:22.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976e1b700 0x55f976e1db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda8e39b700 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976e1b700 0x55f976e1db20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e148b409d328a077 server_cookie=38d0c811c2bbc8c8 in_seq=0 out_seq=0 2023-09-21T12:58:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda71ffb700 10 client.26111 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda71ffb700 1 -- 172.21.15.142:0/1270251260 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f976ceee60 con 0x55f976e1b700 2023-09-21T12:58:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda71ffb700 10 client.26111 handle_command_reply: tid=0 2023-09-21T12:58:22.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 client.26111 shutdown 2023-09-21T12:58:22.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 msgr2=0x55f976dbc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dbc410 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fda78009cc0 tx=0x7fda78011970 comp rx=0 tx=0).stop 2023-09-21T12:58:22.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 shutdown_connections 2023-09-21T12:58:22.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f976e1b700 0x55f976e1db20 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f976da4610 0x55f976dbbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f976da9360 0x55f976e19750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 --2- 172.21.15.142:0/1270251260 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f976da4f30 0x55f976dbc410 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fda71ffb700 0 client.26111 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:22.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 >> 172.21.15.142:0/1270251260 conn(0x55f976cd1000 msgr2=0x55f976da7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 shutdown_connections 2023-09-21T12:58:22.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.834+0000 7fdaa3e71b80 1 -- 172.21.15.142:0/1270251260 wait complete. 2023-09-21T12:58:22.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fdaa3e71b80 20 client.26111 trim_cache size 0 max 16384 2023-09-21T12:58:22.848 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:22.848 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:58:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:58:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: "e056bc89-c9ce-41f3-a4ab-54565ace9018": { 2023-09-21T12:58:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:58:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "e056bc89-c9ce-41f3-a4ab-54565ace9018", 2023-09-21T12:58:22.849 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:58:22.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:58:22.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:58:22.850 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:22.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 msgr2=0x7fda740a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 0x7fda740a2c70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fda80009fd0 tx=0x7fda80009920 comp rx=0 tx=0).stop 2023-09-21T12:58:22.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 msgr2=0x7fda88199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:22.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fda84005750 tx=0x7fda84005780 comp rx=0 tx=0).stop 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 shutdown_connections 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fda740a07b0 0x7fda740a2c70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fda8819d9f0 0x7fda8819de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda88100fb0 0x7fda88199050 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 --2- 172.21.15.142:0/3743746596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fda881060d0 0x7fda88199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:22.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 >> 172.21.15.142:0/3743746596 conn(0x7fda880fc830 msgr2=0x7fda8810cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:22.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.835+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 shutdown_connections 2023-09-21T12:58:22.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:22.836+0000 7fda905ff700 1 -- 172.21.15.142:0/3743746596 wait complete. 2023-09-21T12:58:22.854 INFO:tasks.cephfs.filesystem:scrub status for tag:e056bc89-c9ce-41f3-a4ab-54565ace9018 - {'path': '/', 'tag': 'e056bc89-c9ce-41f3-a4ab-54565ace9018', 'options': 'recursive,force'} 2023-09-21T12:58:23.672 INFO:tasks.workunit.client.0.smithi142.stdout: 1 142951 12.31 MB/sec warmup 64 sec latency 12.091 ms 2023-09-21T12:58:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: pgmap v67: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:58:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:23.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:23 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: pgmap v67: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:58:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:23.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:23 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: pgmap v67: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:58:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:24.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:24.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:24.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:24.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:23 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:24.672 INFO:tasks.workunit.client.0.smithi142.stdout: 1 145572 12.36 MB/sec warmup 65 sec latency 23.766 ms 2023-09-21T12:58:24.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:58:24.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:24 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:58:24.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:24.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:24 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:58:25.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:24 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.672 INFO:tasks.workunit.client.0.smithi142.stdout: 1 146931 12.27 MB/sec warmup 66 sec latency 12.956 ms 2023-09-21T12:58:25.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:25 smithi142 ceph-mon[97663]: pgmap v68: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:25.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:25 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:58:25.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:25 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:58:25.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:25 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:25 smithi160 ceph-mon[134450]: pgmap v68: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:25 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:58:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:25 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:58:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:25 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:25 smithi156 ceph-mon[134078]: pgmap v68: 97 pgs: 97 active+clean; 46 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 3.1 MiB/s wr, 299 op/s 2023-09-21T12:58:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:25 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:58:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:25 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:58:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:25 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:58:26.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 149265 12.30 MB/sec warmup 67 sec latency 64.672 ms 2023-09-21T12:58:27.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 150826 12.20 MB/sec warmup 68 sec latency 25.817 ms 2023-09-21T12:58:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:27 smithi142 ceph-mon[97663]: pgmap v69: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 415 op/s 2023-09-21T12:58:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:27 smithi160 ceph-mon[134450]: pgmap v69: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 415 op/s 2023-09-21T12:58:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:27 smithi156 ceph-mon[134078]: pgmap v69: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.4 MiB/s wr, 415 op/s 2023-09-21T12:58:28.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 152982 12.22 MB/sec warmup 69 sec latency 17.674 ms 2023-09-21T12:58:29.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 155326 12.20 MB/sec warmup 70 sec latency 11.006 ms 2023-09-21T12:58:29.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:29 smithi142 ceph-mon[97663]: pgmap v70: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 289 op/s 2023-09-21T12:58:29.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:29 smithi160 ceph-mon[134450]: pgmap v70: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 289 op/s 2023-09-21T12:58:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:29 smithi156 ceph-mon[134078]: pgmap v70: 97 pgs: 97 active+clean; 51 MiB data, 648 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 289 op/s 2023-09-21T12:58:30.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.590+0000 7fbc913ff700 1 -- 172.21.15.142:0/2520996150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c108050 msgr2=0x7fbc8c108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.590+0000 7fbc913ff700 1 --2- 172.21.15.142:0/2520996150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c108050 0x7fbc8c108430 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbc800074e0 tx=0x7fbc8000af90 comp rx=0 tx=0).stop 2023-09-21T12:58:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 -- 172.21.15.142:0/2520996150 shutdown_connections 2023-09-21T12:58:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 --2- 172.21.15.142:0/2520996150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1146f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 --2- 172.21.15.142:0/2520996150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c108050 0x7fbc8c108430 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 --2- 172.21.15.142:0/2520996150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108a00 0x7fbc8c10c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 -- 172.21.15.142:0/2520996150 >> 172.21.15.142:0/2520996150 conn(0x7fbc8c06d2e0 msgr2=0x7fbc8c06d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 -- 172.21.15.142:0/2520996150 shutdown_connections 2023-09-21T12:58:30.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.591+0000 7fbc913ff700 1 -- 172.21.15.142:0/2520996150 wait complete. 2023-09-21T12:58:30.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.592+0000 7fbc913ff700 1 Processor -- start 2023-09-21T12:58:30.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.592+0000 7fbc913ff700 1 -- start start 2023-09-21T12:58:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108050 0x7fbc8c1a79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c1a17a0 0x7fbc8c1a1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a22a0 con 0x7fbc8c108050 2023-09-21T12:58:30.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a2410 con 0x7fbc8c1a17a0 2023-09-21T12:58:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc913ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c1a25d0 con 0x7fbc8c10cae0 2023-09-21T12:58:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc8a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:48994/0 (socket says 172.21.15.142:48994) 2023-09-21T12:58:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc8a7fc700 1 -- 172.21.15.142:0/1946419798 learned_addr learned my addr 172.21.15.142:0/1946419798 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:30.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c1a17a0 0x7fbc8c1a1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.593+0000 7fbc8affd700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108050 0x7fbc8c1a79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 -- 172.21.15.142:0/1946419798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c1a17a0 msgr2=0x7fbc8c1a1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c1a17a0 0x7fbc8c1a1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 -- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108050 msgr2=0x7fbc8c1a79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108050 0x7fbc8c1a79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 -- 172.21.15.142:0/1946419798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800071c0 con 0x7fbc8c10cae0 2023-09-21T12:58:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc8a7fc700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00d980 tx=0x7fbc7c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc73fff700 1 -- 172.21.15.142:0/1946419798 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00f890 con 0x7fbc8c10cae0 2023-09-21T12:58:30.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc73fff700 1 -- 172.21.15.142:0/1946419798 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc7c010460 con 0x7fbc8c10cae0 2023-09-21T12:58:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c1ae830 con 0x7fbc8c10cae0 2023-09-21T12:58:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc73fff700 1 -- 172.21.15.142:0/1946419798 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00e610 con 0x7fbc8c10cae0 2023-09-21T12:58:30.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.594+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c1aed90 con 0x7fbc8c10cae0 2023-09-21T12:58:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.597+0000 7fbc73fff700 1 -- 172.21.15.142:0/1946419798 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fbc7c0105d0 con 0x7fbc8c10cae0 2023-09-21T12:58:30.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 Processor -- start 2023-09-21T12:58:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 -- start start 2023-09-21T12:58:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229617b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617fe50 0x5622961802b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbc73fff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 0x7fbc740a2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960efc40 con 0x56229617b9c0 2023-09-21T12:58:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960d3c10 con 0x56229617b0a0 2023-09-21T12:58:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.599+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960d1530 con 0x56229617fe50 2023-09-21T12:58:30.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc73fff700 1 -- 172.21.15.142:0/1946419798 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc7c0cb940 con 0x7fbc8c10cae0 2023-09-21T12:58:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38212/0 (socket says 172.21.15.142:38212) 2023-09-21T12:58:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 -- 172.21.15.142:0/4023848290 learned_addr learned my addr 172.21.15.142:0/4023848290 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:30.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229617b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617fe50 0x5622961802b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 -- 172.21.15.142:0/4023848290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617fe50 msgr2=0x5622961802b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617fe50 0x5622961802b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 -- 172.21.15.142:0/4023848290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 msgr2=0x56229617b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229617b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8a7fc700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 0x7fbc740a2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8affd700 1 -- 172.21.15.142:0/4023848290 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562295ef7d80 con 0x56229617b9c0 2023-09-21T12:58:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.600+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229617b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:30.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.601+0000 7fbc8affd700 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbc80015000 tx=0x7fbc80005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56fb29d72b04be9d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.601+0000 7fbc8a7fc700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 0x7fbc740a2ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c098ac0 tx=0x7fbc7c095100 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.601+0000 7fbc717fa700 1 -- 172.21.15.142:0/4023848290 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000f070 con 0x56229617b9c0 2023-09-21T12:58:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.601+0000 7fbc717fa700 1 -- 172.21.15.142:0/4023848290 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc80007e80 con 0x56229617b9c0 2023-09-21T12:58:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.601+0000 7fbc717fa700 1 -- 172.21.15.142:0/4023848290 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80003e70 con 0x56229617b9c0 2023-09-21T12:58:30.607 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/4023848290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 msgr2=0x56229617f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.608 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbc80015000 tx=0x7fbc80005bc0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/4023848290 shutdown_connections 2023-09-21T12:58:30.613 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617fe50 0x5622961802b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229617b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/4023848290 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x56229617f910 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.602+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/4023848290 >> 172.21.15.142:0/4023848290 conn(0x5622960a7fa0 msgr2=0x5622961760c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.603+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/4023848290 shutdown_connections 2023-09-21T12:58:30.614 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.603+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/4023848290 wait complete. 2023-09-21T12:58:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.603+0000 7fbca4d2cb80 1 -- start start 2023-09-21T12:58:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 Processor -- start 2023-09-21T12:58:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x5622961876a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.615 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296185060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960cce20 con 0x56229617fe50 2023-09-21T12:58:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960696e0 con 0x56229617b0a0 2023-09-21T12:58:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562296069380 con 0x56229617b9c0 2023-09-21T12:58:30.616 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.604+0000 7fbca4d2cb80 10 client.0 _ll_register_callbacks cb 0x562295fb3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x5622961876a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49008/0 (socket says 172.21.15.142:49008) 2023-09-21T12:58:30.617 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 -- 172.21.15.142:0/682309156 learned_addr learned my addr 172.21.15.142:0/682309156 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296185060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 -- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 msgr2=0x5622961876a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x5622961876a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 -- 172.21.15.142:0/682309156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 msgr2=0x562296185060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.618 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296185060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 -- 172.21.15.142:0/682309156 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84011040 con 0x56229617b9c0 2023-09-21T12:58:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc8affd700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc80016040 tx=0x7fbc80005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee00827e0eeff8b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.605+0000 7fbc6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:30.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000f040 con 0x56229617b9c0 2023-09-21T12:58:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562296149fc0 con 0x56229617b9c0 2023-09-21T12:58:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc80003e20 con 0x56229617b9c0 2023-09-21T12:58:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc80003fe0 con 0x56229617b9c0 2023-09-21T12:58:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbca4d2cb80 10 client.26086 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:30.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fbc8c114f00 con 0x56229617b9c0 2023-09-21T12:58:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562296149fc0 con 0x56229617b9c0 2023-09-21T12:58:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.606+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbc8000a0d0 con 0x56229617b9c0 2023-09-21T12:58:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 10 client.26086 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:30.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 10 client.26086 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 20 client.26086 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562296194b80 0x562296196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 4 client.26086 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:30.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622960c5e00 con 0x562296194b80 2023-09-21T12:58:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562296194b80 0x562296196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbc6eff5700 10 client.26086 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.607+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562296194b80 0x562296196fa0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ae5fc1eb6b5db3 server_cookie=3fe9795ef2997751 in_seq=0 out_seq=0 2023-09-21T12:58:30.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbc6eff5700 1 -- 172.21.15.142:0/682309156 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5622960c5e00 con 0x562296194b80 2023-09-21T12:58:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbc6eff5700 10 client.26086 handle_command_reply: tid=0 2023-09-21T12:58:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 client.26086 shutdown 2023-09-21T12:58:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 msgr2=0x562296184920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbc80016040 tx=0x7fbc80005a80 comp rx=0 tx=0).stop 2023-09-21T12:58:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 shutdown_connections 2023-09-21T12:58:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562296194b80 0x562296196fa0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296185060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x5622961876a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbc6eff5700 0 client.26086 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/682309156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x562296184920 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.609+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 >> 172.21.15.142:0/682309156 conn(0x5622960a7fa0 msgr2=0x562296175cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.610+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 shutdown_connections 2023-09-21T12:58:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.610+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/682309156 wait complete. 2023-09-21T12:58:30.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.610+0000 7fbca4d2cb80 20 client.26086 trim_cache size 0 max 16384 2023-09-21T12:58:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.626+0000 7fbca4d2cb80 1 Processor -- start 2023-09-21T12:58:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.626+0000 7fbca4d2cb80 1 -- start start 2023-09-21T12:58:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x562296182240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617fe50 0x5622961871d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562295f4d8c0 con 0x56229617b9c0 2023-09-21T12:58:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562296185640 con 0x56229617fe50 2023-09-21T12:58:30.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622960c5e30 con 0x56229617b0a0 2023-09-21T12:58:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49014/0 (socket says 172.21.15.142:49014) 2023-09-21T12:58:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 -- 172.21.15.142:0/2313970930 learned_addr learned my addr 172.21.15.142:0/2313970930 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617fe50 0x5622961871d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8affd700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x562296182240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 -- 172.21.15.142:0/2313970930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617fe50 msgr2=0x5622961871d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617fe50 0x5622961871d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 -- 172.21.15.142:0/2313970930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 msgr2=0x562296182240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x562296182240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8b7fe700 1 -- 172.21.15.142:0/2313970930 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562296184490 con 0x56229617b0a0 2023-09-21T12:58:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.627+0000 7fbc8affd700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x562296182240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.628+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562296197880 tx=0x7fbc8400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecdc46792fc0d41 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.628+0000 7fbc71ffb700 1 -- 172.21.15.142:0/2313970930 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84021030 con 0x56229617b0a0 2023-09-21T12:58:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.628+0000 7fbc71ffb700 1 -- 172.21.15.142:0/2313970930 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc84022040 con 0x56229617b0a0 2023-09-21T12:58:30.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.628+0000 7fbc71ffb700 1 -- 172.21.15.142:0/2313970930 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc84008480 con 0x56229617b0a0 2023-09-21T12:58:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/2313970930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 msgr2=0x56229617d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x562296197880 tx=0x7fbc8400b040 comp rx=0 tx=0).stop 2023-09-21T12:58:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/2313970930 shutdown_connections 2023-09-21T12:58:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617fe50 0x5622961871d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b0a0 0x56229617d740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/2313970930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617b9c0 0x562296182240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/2313970930 >> 172.21.15.142:0/2313970930 conn(0x5622960a7fa0 msgr2=0x562296174870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/2313970930 shutdown_connections 2023-09-21T12:58:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.629+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/2313970930 wait complete. 2023-09-21T12:58:30.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.630+0000 7fbca4d2cb80 1 -- start start 2023-09-21T12:58:30.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.630+0000 7fbca4d2cb80 1 Processor -- start 2023-09-21T12:58:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229618b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296189f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229618a5f0 con 0x56229617fe50 2023-09-21T12:58:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229618a760 con 0x56229617b0a0 2023-09-21T12:58:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56229618a920 con 0x56229617b9c0 2023-09-21T12:58:30.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbca4d2cb80 10 client.0 _ll_register_callbacks cb 0x562295fb3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49030/0 (socket says 172.21.15.142:49030) 2023-09-21T12:58:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 -- 172.21.15.142:0/1195155100 learned_addr learned my addr 172.21.15.142:0/1195155100 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229618b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296189f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 -- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 msgr2=0x56229618b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229618b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 -- 172.21.15.142:0/1195155100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 msgr2=0x562296189f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296189f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8affd700 1 -- 172.21.15.142:0/1195155100 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84024210 con 0x56229617b9c0 2023-09-21T12:58:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.631+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296189f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.632+0000 7fbc8affd700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007e00 tx=0x7fbc80003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84bbcd17783ea2fd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.632+0000 7fbc6eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.632+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc8000f070 con 0x56229617b9c0 2023-09-21T12:58:30.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.632+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbc80003e20 con 0x56229617b9c0 2023-09-21T12:58:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.632+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56229603db50 con 0x56229617b9c0 2023-09-21T12:58:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc800058e0 con 0x56229617b9c0 2023-09-21T12:58:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 10 client.26092 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562295ee0c00 con 0x56229617b9c0 2023-09-21T12:58:30.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56229603db50 con 0x56229617b9c0 2023-09-21T12:58:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fbc80004660 con 0x56229617b9c0 2023-09-21T12:58:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 10 client.26092 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 10 client.26092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 20 client.26092 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:30.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622961e9630 0x5622961eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 4 client.26092 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:58:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.633+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5622960c5b20 con 0x5622961e9630 2023-09-21T12:58:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.634+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622961e9630 0x5622961eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.634+0000 7fbc8b7fe700 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622961e9630 0x5622961eba50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1baf2524a0a309bf server_cookie=7e5f337e3ee067f0 in_seq=0 out_seq=0 2023-09-21T12:58:30.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.634+0000 7fbc6eff5700 10 client.26092 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:30.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 156815 12.15 MB/sec warmup 71 sec latency 27.897 ms 2023-09-21T12:58:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbc6eff5700 1 -- 172.21.15.142:0/1195155100 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5622960c5b20 con 0x5622961e9630 2023-09-21T12:58:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbc6eff5700 10 client.26092 handle_command_reply: tid=0 2023-09-21T12:58:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 client.26092 shutdown 2023-09-21T12:58:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 msgr2=0x56229618bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007e00 tx=0x7fbc80003680 comp rx=0 tx=0).stop 2023-09-21T12:58:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 shutdown_connections 2023-09-21T12:58:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622961e9630 0x5622961eba50 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56229617fe50 0x562296189f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56229617b0a0 0x56229618b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbc6eff5700 0 client.26092 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 --2- 172.21.15.142:0/1195155100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56229617b9c0 0x56229618bdf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 >> 172.21.15.142:0/1195155100 conn(0x5622960a7fa0 msgr2=0x562296182240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.716+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 shutdown_connections 2023-09-21T12:58:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.717+0000 7fbca4d2cb80 1 -- 172.21.15.142:0/1195155100 wait complete. 2023-09-21T12:58:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.717+0000 7fbca4d2cb80 20 client.26092 trim_cache size 0 max 16384 2023-09-21T12:58:30.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:58:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:58:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:58:30.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:58:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 msgr2=0x7fbc740a2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 0x7fbc740a2ce0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c098ac0 tx=0x7fbc7c095100 comp rx=0 tx=0).stop 2023-09-21T12:58:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 msgr2=0x7fbc8c1a7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00d980 tx=0x7fbc7c00dc90 comp rx=0 tx=0).stop 2023-09-21T12:58:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 shutdown_connections 2023-09-21T12:58:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbc740a0820 0x7fbc740a2ce0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbc8c108050 0x7fbc8c1a79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbc8c1a17a0 0x7fbc8c1a1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 --2- 172.21.15.142:0/1946419798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc8c10cae0 0x7fbc8c1a7f10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.718+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 >> 172.21.15.142:0/1946419798 conn(0x7fbc8c06d2e0 msgr2=0x7fbc8c070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.719+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 shutdown_connections 2023-09-21T12:58:30.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:30.719+0000 7fbc913ff700 1 -- 172.21.15.142:0/1946419798 wait complete. 2023-09-21T12:58:31.673 INFO:tasks.workunit.client.0.smithi142.stdout: 1 159605 12.22 MB/sec warmup 72 sec latency 37.930 ms 2023-09-21T12:58:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:31 smithi160 ceph-mon[134450]: pgmap v71: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 407 op/s 2023-09-21T12:58:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:31 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:58:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:31 smithi156 ceph-mon[134078]: pgmap v71: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 407 op/s 2023-09-21T12:58:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:31 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:58:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:31 smithi142 ceph-mon[97663]: pgmap v71: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 407 op/s 2023-09-21T12:58:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:31 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:58:32.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 160823 12.10 MB/sec warmup 73 sec latency 44.685 ms 2023-09-21T12:58:32.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:32 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:58:32.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:32 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:58:33.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:32 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:58:33.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:32 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:58:33.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:32 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:58:33.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:32 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:58:33.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 163443 12.17 MB/sec warmup 74 sec latency 18.474 ms 2023-09-21T12:58:34.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:33 smithi156 ceph-mon[134078]: pgmap v72: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:34.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:33 smithi142 ceph-mon[97663]: pgmap v72: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:34.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:33 smithi160 ceph-mon[134450]: pgmap v72: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:34.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 165044 12.08 MB/sec warmup 75 sec latency 10.713 ms 2023-09-21T12:58:35.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 167177 12.10 MB/sec warmup 76 sec latency 13.575 ms 2023-09-21T12:58:36.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:35 smithi156 ceph-mon[134078]: pgmap v73: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:36.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:35 smithi142 ceph-mon[97663]: pgmap v73: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:35 smithi160 ceph-mon[134450]: pgmap v73: 97 pgs: 97 active+clean; 55 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.3 MiB/s wr, 234 op/s 2023-09-21T12:58:36.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 169477 12.09 MB/sec warmup 77 sec latency 12.818 ms 2023-09-21T12:58:37.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 170780 12.04 MB/sec warmup 78 sec latency 78.877 ms 2023-09-21T12:58:38.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:37 smithi156 ceph-mon[134078]: pgmap v74: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 405 op/s 2023-09-21T12:58:38.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:37 smithi142 ceph-mon[97663]: pgmap v74: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 405 op/s 2023-09-21T12:58:38.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:37 smithi160 ceph-mon[134450]: pgmap v74: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.5 MiB/s wr, 405 op/s 2023-09-21T12:58:38.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 173461 12.05 MB/sec warmup 79 sec latency 19.813 ms 2023-09-21T12:58:39.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 174895 12.00 MB/sec warmup 80 sec latency 10.401 ms 2023-09-21T12:58:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:39 smithi156 ceph-mon[134078]: pgmap v75: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-09-21T12:58:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:39 smithi142 ceph-mon[97663]: pgmap v75: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-09-21T12:58:40.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:39 smithi160 ceph-mon[134450]: pgmap v75: 97 pgs: 97 active+clean; 56 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-09-21T12:58:40.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 177592 12.06 MB/sec warmup 81 sec latency 11.010 ms 2023-09-21T12:58:41.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 178790 11.98 MB/sec warmup 82 sec latency 73.844 ms 2023-09-21T12:58:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:41 smithi156 ceph-mon[134078]: pgmap v76: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 410 op/s 2023-09-21T12:58:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:41 smithi142 ceph-mon[97663]: pgmap v76: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 410 op/s 2023-09-21T12:58:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:41 smithi160 ceph-mon[134450]: pgmap v76: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.6 MiB/s wr, 410 op/s 2023-09-21T12:58:42.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 181162 12.00 MB/sec warmup 83 sec latency 53.278 ms 2023-09-21T12:58:43.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 182561 11.92 MB/sec warmup 84 sec latency 29.214 ms 2023-09-21T12:58:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 -- 172.21.15.142:0/779554536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c100fe0 msgr2=0x7fdf0c1013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 --2- 172.21.15.142:0/779554536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c1013c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009990 tx=0x7fdf08009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 -- 172.21.15.142:0/779554536 shutdown_connections 2023-09-21T12:58:43.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 --2- 172.21.15.142:0/779554536 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c106100 0x7fdf0c10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 --2- 172.21.15.142:0/779554536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c1013c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 --2- 172.21.15.142:0/779554536 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c101990 0x7fdf0c1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 -- 172.21.15.142:0/779554536 >> 172.21.15.142:0/779554536 conn(0x7fdf0c0fc840 msgr2=0x7fdf0c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 -- 172.21.15.142:0/779554536 shutdown_connections 2023-09-21T12:58:43.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.878+0000 7fdf143ff700 1 -- 172.21.15.142:0/779554536 wait complete. 2023-09-21T12:58:43.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.879+0000 7fdf143ff700 1 Processor -- start 2023-09-21T12:58:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.879+0000 7fdf143ff700 1 -- start start 2023-09-21T12:58:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c106100 0x7fdf0c1974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c19bb30 0x7fdf0c19bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19c5b0 con 0x7fdf0c106100 2023-09-21T12:58:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19c720 con 0x7fdf0c100fe0 2023-09-21T12:58:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf143ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c19c8e0 con 0x7fdf0c19bb30 2023-09-21T12:58:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39964/0 (socket says 172.21.15.142:39964) 2023-09-21T12:58:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 -- 172.21.15.142:0/1785995554 learned_addr learned my addr 172.21.15.142:0/1785995554 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c106100 0x7fdf0c1974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1299c700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c19bb30 0x7fdf0c19bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 -- 172.21.15.142:0/1785995554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c19bb30 msgr2=0x7fdf0c19bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c19bb30 0x7fdf0c19bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 -- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c106100 msgr2=0x7fdf0c1974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c106100 0x7fdf0c1974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.880+0000 7fdf1219b700 1 -- 172.21.15.142:0/1785995554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf080095f0 con 0x7fdf0c100fe0 2023-09-21T12:58:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005910 tx=0x7fdf08005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf037fe700 1 -- 172.21.15.142:0/1785995554 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0801d070 con 0x7fdf0c100fe0 2023-09-21T12:58:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf037fe700 1 -- 172.21.15.142:0/1785995554 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf08022470 con 0x7fdf0c100fe0 2023-09-21T12:58:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c1a3de0 con 0x7fdf0c100fe0 2023-09-21T12:58:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf037fe700 1 -- 172.21.15.142:0/1785995554 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08017650 con 0x7fdf0c100fe0 2023-09-21T12:58:43.886 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.881+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1a4200 con 0x7fdf0c100fe0 2023-09-21T12:58:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.886+0000 7fdf037fe700 1 -- 172.21.15.142:0/1785995554 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdf080225e0 con 0x7fdf0c100fe0 2023-09-21T12:58:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 Processor -- start 2023-09-21T12:58:43.888 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 -- start start 2023-09-21T12:58:43.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 0x56445ecd4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 0x56445ecd52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.889 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ec44c40 con 0x56445ecd09c0 2023-09-21T12:58:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ec28c10 con 0x56445ecd00a0 2023-09-21T12:58:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ec26530 con 0x56445ecd4e50 2023-09-21T12:58:43.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf1299c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.887+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 0x56445ecd4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf037fe700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 0x7fdef80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1299c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39976/0 (socket says 172.21.15.142:39976) 2023-09-21T12:58:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1299c700 1 -- 172.21.15.142:0/1762967691 learned_addr learned my addr 172.21.15.142:0/1762967691 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:43.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 0x56445ecd52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf037fe700 1 -- 172.21.15.142:0/1785995554 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf080cd350 con 0x7fdf0c100fe0 2023-09-21T12:58:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1299c700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 0x7fdef80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 -- 172.21.15.142:0/1762967691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 msgr2=0x56445ecd0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 -- 172.21.15.142:0/1762967691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 msgr2=0x56445ecd4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 0x56445ecd4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 -- 172.21.15.142:0/1762967691 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56445ea4cd80 con 0x56445ecd4e50 2023-09-21T12:58:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1299c700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 0x56445ecd4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:43.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.888+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 0x56445ecd52b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c06a380 tx=0x7fdefc007ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da64c9c0b4648bf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.889+0000 7fdf1299c700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 0x7fdef80a2cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400fcb0 tx=0x7fdf04004b40 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.889+0000 7fdf00bfe700 1 -- 172.21.15.142:0/1762967691 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc004310 con 0x56445ecd4e50 2023-09-21T12:58:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.889+0000 7fdf00bfe700 1 -- 172.21.15.142:0/1762967691 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdefc010e40 con 0x56445ecd4e50 2023-09-21T12:58:43.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.889+0000 7fdf00bfe700 1 -- 172.21.15.142:0/1762967691 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc005020 con 0x56445ecd4e50 2023-09-21T12:58:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1762967691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 msgr2=0x56445ecd52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 0x56445ecd52b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c06a380 tx=0x7fdefc007ea0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1762967691 shutdown_connections 2023-09-21T12:58:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd4e50 0x56445ecd52b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ecd0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1762967691 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd09c0 0x56445ecd4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1762967691 >> 172.21.15.142:0/1762967691 conn(0x56445ebfcfa0 msgr2=0x56445eccb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1762967691 shutdown_connections 2023-09-21T12:58:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.890+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1762967691 wait complete. 2023-09-21T12:58:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 -- start start 2023-09-21T12:58:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 Processor -- start 2023-09-21T12:58:43.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd00a0 0x56445ecdc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 0x56445ecd9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ec21e20 con 0x56445ecd00a0 2023-09-21T12:58:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ebbe6e0 con 0x56445ecd4e50 2023-09-21T12:58:43.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ebbe380 con 0x56445ecd09c0 2023-09-21T12:58:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.891+0000 7fdf27c5eb80 10 client.0 _ll_register_callbacks cb 0x56445eb08a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd00a0 0x56445ecdc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1299c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 0x56445ecd9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:51992/0 (socket says 172.21.15.142:51992) 2023-09-21T12:58:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 -- 172.21.15.142:0/1334522714 learned_addr learned my addr 172.21.15.142:0/1334522714 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 -- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 msgr2=0x56445ecd9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 0x56445ecd9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 -- 172.21.15.142:0/1334522714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd00a0 msgr2=0x56445ecdc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd00a0 0x56445ecdc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 -- 172.21.15.142:0/1334522714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0400f820 con 0x56445ecd09c0 2023-09-21T12:58:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1299c700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 0x56445ecd9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdf1199a700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdefc007670 tx=0x7fdefc010bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73d13b230bbfc029 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdef5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:43.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.892+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc01f070 con 0x56445ecd09c0 2023-09-21T12:58:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56445eb92b50 con 0x56445ecd09c0 2023-09-21T12:58:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdefc004320 con 0x56445ecd09c0 2023-09-21T12:58:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdefc0044e0 con 0x56445ecd09c0 2023-09-21T12:58:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 10 client.26104 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:43.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fdf0c1a4200 con 0x56445ecd09c0 2023-09-21T12:58:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdefc031020 con 0x56445ecd09c0 2023-09-21T12:58:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdefc02d690 con 0x56445ecd09c0 2023-09-21T12:58:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 10 client.26104 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 10 client.26104 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:43.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 20 client.26104 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ece9f20 0x56445ecec340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 4 client.26104 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.893+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56445ec9efc0 con 0x56445ece9f20 2023-09-21T12:58:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.894+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ece9f20 0x56445ecec340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.894+0000 7fdf1219b700 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ece9f20 0x56445ecec340 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f1786fb2718d58 server_cookie=5d2e077a7d233f16 in_seq=0 out_seq=0 2023-09-21T12:58:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.894+0000 7fdef5ffb700 10 client.26104 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdef5ffb700 1 -- 172.21.15.142:0/1334522714 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56445ec9efc0 con 0x56445ece9f20 2023-09-21T12:58:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdef5ffb700 10 client.26104 handle_command_reply: tid=0 2023-09-21T12:58:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 client.26104 shutdown 2023-09-21T12:58:43.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 msgr2=0x56445ecd97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdefc007670 tx=0x7fdefc010bb0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 shutdown_connections 2023-09-21T12:58:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ece9f20 0x56445ecec340 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd00a0 0x56445ecdc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdef5ffb700 0 client.26104 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd4e50 0x56445ecd9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/1334522714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecd97f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 >> 172.21.15.142:0/1334522714 conn(0x56445ebfcfa0 msgr2=0x56445eccac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 shutdown_connections 2023-09-21T12:58:43.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/1334522714 wait complete. 2023-09-21T12:58:43.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.895+0000 7fdf27c5eb80 20 client.26104 trim_cache size 0 max 16384 2023-09-21T12:58:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 Processor -- start 2023-09-21T12:58:43.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 -- start start 2023-09-21T12:58:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecd6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445eaa28c0 con 0x56445ecd4e50 2023-09-21T12:58:43.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ecd58b0 con 0x56445ecd00a0 2023-09-21T12:58:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ecd0da0 con 0x56445ecd09c0 2023-09-21T12:58:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39990/0 (socket says 172.21.15.142:39990) 2023-09-21T12:58:43.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52002/0 (socket says 172.21.15.142:52002) 2023-09-21T12:58:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1219b700 1 -- 172.21.15.142:0/2049730950 learned_addr learned my addr 172.21.15.142:0/2049730950 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.912+0000 7fdf1299c700 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecd6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 -- 172.21.15.142:0/2049730950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 msgr2=0x56445ecdc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 -- 172.21.15.142:0/2049730950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 msgr2=0x56445ecd6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecd6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 -- 172.21.15.142:0/2049730950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0078a0 con 0x56445ecd00a0 2023-09-21T12:58:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1199a700 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005cd0 tx=0x7fdf080cf040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b081273f1c81581 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf013ff700 1 -- 172.21.15.142:0/2049730950 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0809a340 con 0x56445ecd00a0 2023-09-21T12:58:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf013ff700 1 -- 172.21.15.142:0/2049730950 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf0809b0e0 con 0x56445ecd00a0 2023-09-21T12:58:43.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.913+0000 7fdf013ff700 1 -- 172.21.15.142:0/2049730950 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0809ac40 con 0x56445ecd00a0 2023-09-21T12:58:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2049730950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 msgr2=0x56445ece57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005cd0 tx=0x7fdf080cf040 comp rx=0 tx=0).stop 2023-09-21T12:58:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2049730950 shutdown_connections 2023-09-21T12:58:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecd6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece57c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2049730950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2049730950 >> 172.21.15.142:0/2049730950 conn(0x56445ebfcfa0 msgr2=0x56445ecd3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2049730950 shutdown_connections 2023-09-21T12:58:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2049730950 wait complete. 2023-09-21T12:58:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 -- start start 2023-09-21T12:58:43.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.914+0000 7fdf27c5eb80 1 Processor -- start 2023-09-21T12:58:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdf050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecdf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ecdfad0 con 0x56445ecd4e50 2023-09-21T12:58:43.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ecdfc40 con 0x56445ecd00a0 2023-09-21T12:58:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56445ecdfe00 con 0x56445ecd09c0 2023-09-21T12:58:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf27c5eb80 10 client.0 _ll_register_callbacks cb 0x56445eb08a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf1219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40004/0 (socket says 172.21.15.142:40004) 2023-09-21T12:58:43.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf1219b700 1 -- 172.21.15.142:0/2811930193 learned_addr learned my addr 172.21.15.142:0/2811930193 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf1199a700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.915+0000 7fdf1299c700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecdf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 -- 172.21.15.142:0/2811930193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 msgr2=0x56445ecdf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 -- 172.21.15.142:0/2811930193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 msgr2=0x56445ecdf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecdf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 -- 172.21.15.142:0/2811930193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c1a4200 con 0x56445ecd00a0 2023-09-21T12:58:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1299c700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecdf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1199a700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:43.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf1219b700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdf08097450 tx=0x7fdf08009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68b98c2fb86087e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdef5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08022ac0 con 0x56445ecd00a0 2023-09-21T12:58:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf0809a9e0 con 0x56445ecd00a0 2023-09-21T12:58:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdefc010e40 con 0x56445ecd00a0 2023-09-21T12:58:43.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf08099ed0 con 0x56445ecd00a0 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf27c5eb80 10 client.26147 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.916+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fdf0c1a3de0 con 0x56445ecd00a0 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdefc010e40 con 0x56445ecd00a0 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdf080a2650 con 0x56445ecd00a0 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 10 client.26147 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:43.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 10 client.26147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 20 client.26147 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ed43240 0x56445ed45660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 4 client.26147 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:58:43.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56445ec1ae00 con 0x56445ed43240 2023-09-21T12:58:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf1199a700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ed43240 0x56445ed45660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdf1199a700 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ed43240 0x56445ed45660 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45e37b059bb6ae60 server_cookie=ab32f1e38e84130f in_seq=0 out_seq=0 2023-09-21T12:58:43.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.917+0000 7fdef5ffb700 10 client.26147 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdef5ffb700 1 -- 172.21.15.142:0/2811930193 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56445ec1ae00 con 0x56445ed43240 2023-09-21T12:58:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdef5ffb700 10 client.26147 handle_command_reply: tid=0 2023-09-21T12:58:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 client.26147 shutdown 2023-09-21T12:58:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 msgr2=0x56445ece0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdf08097450 tx=0x7fdf08009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 shutdown_connections 2023-09-21T12:58:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56445ed43240 0x56445ed45660 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56445ecd4e50 0x56445ecdf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56445ecd00a0 0x56445ece0dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdef5ffb700 0 client.26147 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 --2- 172.21.15.142:0/2811930193 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56445ecd09c0 0x56445ecdf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 >> 172.21.15.142:0/2811930193 conn(0x56445ebfcfa0 msgr2=0x56445ece57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 shutdown_connections 2023-09-21T12:58:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 1 -- 172.21.15.142:0/2811930193 wait complete. 2023-09-21T12:58:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.986+0000 7fdf27c5eb80 20 client.26147 trim_cache size 0 max 16384 2023-09-21T12:58:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:58:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:58:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:58:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:58:43.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 msgr2=0x7fdef80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 0x7fdef80a2cf0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400fcb0 tx=0x7fdf04004b40 comp rx=0 tx=0).stop 2023-09-21T12:58:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 msgr2=0x7fdf0c196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fdf08005910 tx=0x7fdf08005740 comp rx=0 tx=0).stop 2023-09-21T12:58:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 shutdown_connections 2023-09-21T12:58:43.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdef80a0830 0x7fdef80a2cf0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf0c19bb30 0x7fdf0c19bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf0c100fe0 0x7fdf0c196f80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 --2- 172.21.15.142:0/1785995554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf0c106100 0x7fdf0c1974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 >> 172.21.15.142:0/1785995554 conn(0x7fdf0c0fc840 msgr2=0x7fdf0c104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:43.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 shutdown_connections 2023-09-21T12:58:43.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:43.987+0000 7fdf143ff700 1 -- 172.21.15.142:0/1785995554 wait complete. 2023-09-21T12:58:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:43 smithi156 ceph-mon[134078]: pgmap v77: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:43 smithi142 ceph-mon[97663]: pgmap v77: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:44.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:43 smithi160 ceph-mon[134450]: pgmap v77: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:44.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 184822 11.94 MB/sec warmup 85 sec latency 31.228 ms 2023-09-21T12:58:45.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 186851 11.89 MB/sec warmup 86 sec latency 11.282 ms 2023-09-21T12:58:46.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:45 smithi156 ceph-mon[134078]: pgmap v78: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:45 smithi142 ceph-mon[97663]: pgmap v78: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:45 smithi160 ceph-mon[134450]: pgmap v78: 97 pgs: 97 active+clean; 60 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.5 MiB/s wr, 291 op/s 2023-09-21T12:58:46.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 188556 11.89 MB/sec warmup 87 sec latency 17.179 ms 2023-09-21T12:58:47.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 190911 11.89 MB/sec warmup 88 sec latency 45.998 ms 2023-09-21T12:58:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:47 smithi156 ceph-mon[134078]: pgmap v79: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 448 op/s 2023-09-21T12:58:48.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:47 smithi142 ceph-mon[97663]: pgmap v79: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 448 op/s 2023-09-21T12:58:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:47 smithi160 ceph-mon[134450]: pgmap v79: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 448 op/s 2023-09-21T12:58:48.674 INFO:tasks.workunit.client.0.smithi142.stdout: 1 192347 11.84 MB/sec warmup 89 sec latency 36.252 ms 2023-09-21T12:58:49.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 195172 11.90 MB/sec warmup 90 sec latency 41.026 ms 2023-09-21T12:58:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:49 smithi156 ceph-mon[134078]: pgmap v80: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-21T12:58:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:49 smithi142 ceph-mon[97663]: pgmap v80: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-21T12:58:50.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:49 smithi160 ceph-mon[134450]: pgmap v80: 97 pgs: 97 active+clean; 56 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-21T12:58:50.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 196506 11.84 MB/sec warmup 91 sec latency 14.486 ms 2023-09-21T12:58:51.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 199001 11.87 MB/sec warmup 92 sec latency 13.077 ms 2023-09-21T12:58:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:51 smithi156 ceph-mon[134078]: pgmap v81: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 395 op/s 2023-09-21T12:58:52.173 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:51 smithi142 ceph-mon[97663]: pgmap v81: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 395 op/s 2023-09-21T12:58:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:51 smithi160 ceph-mon[134450]: pgmap v81: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 395 op/s 2023-09-21T12:58:52.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 200900 11.80 MB/sec warmup 93 sec latency 27.565 ms 2023-09-21T12:58:52.855 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:58:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 -- 172.21.15.142:0/1936219965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b90100fa0 msgr2=0x7f1b90101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 --2- 172.21.15.142:0/1936219965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b90100fa0 0x7f1b90101380 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1b800098f0 tx=0x7f1b80009c00 comp rx=0 tx=0).stop 2023-09-21T12:58:53.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 -- 172.21.15.142:0/1936219965 shutdown_connections 2023-09-21T12:58:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 --2- 172.21.15.142:0/1936219965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b901060c0 0x7f1b9010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 --2- 172.21.15.142:0/1936219965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b90100fa0 0x7f1b90101380 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 --2- 172.21.15.142:0/1936219965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b90101950 0x7f1b90105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 -- 172.21.15.142:0/1936219965 >> 172.21.15.142:0/1936219965 conn(0x7f1b900fc860 msgr2=0x7f1b900fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 -- 172.21.15.142:0/1936219965 shutdown_connections 2023-09-21T12:58:53.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.071+0000 7f1b951ff700 1 -- 172.21.15.142:0/1936219965 wait complete. 2023-09-21T12:58:53.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.072+0000 7f1b951ff700 1 Processor -- start 2023-09-21T12:58:53.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.072+0000 7f1b951ff700 1 -- start start 2023-09-21T12:58:53.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b90100fa0 0x7f1b90196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 0x7f1b9019bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019c3a0 con 0x7f1b90100fa0 2023-09-21T12:58:53.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019c510 con 0x7f1b9019b920 2023-09-21T12:58:53.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b951ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9019c6d0 con 0x7f1b901060c0 2023-09-21T12:58:53.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 0x7f1b9019bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52022/0 (socket says 172.21.15.142:52022) 2023-09-21T12:58:53.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 -- 172.21.15.142:0/2014828731 learned_addr learned my addr 172.21.15.142:0/2014828731 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b90100fa0 0x7f1b90196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 -- 172.21.15.142:0/2014828731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 msgr2=0x7f1b9019bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 0x7f1b9019bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.073+0000 7f1b8e59c700 1 -- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b90100fa0 msgr2=0x7f1b90196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b90100fa0 0x7f1b90196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b8e59c700 1 -- 172.21.15.142:0/2014828731 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88009c40 con 0x7f1b901060c0 2023-09-21T12:58:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 0x7f1b9019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e9f0 tx=0x7f1b8400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b77fff700 1 -- 172.21.15.142:0/2014828731 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84009690 con 0x7f1b901060c0 2023-09-21T12:58:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b77fff700 1 -- 172.21.15.142:0/2014828731 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8400ce80 con 0x7f1b901060c0 2023-09-21T12:58:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b80009520 con 0x7f1b901060c0 2023-09-21T12:58:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b77fff700 1 -- 172.21.15.142:0/2014828731 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b84018420 con 0x7f1b901060c0 2023-09-21T12:58:53.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.074+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b901a3fd0 con 0x7f1b901060c0 2023-09-21T12:58:53.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.077+0000 7f1b77fff700 1 -- 172.21.15.142:0/2014828731 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f1b84010630 con 0x7f1b901060c0 2023-09-21T12:58:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1b77fff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 0x7f1b780a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 Processor -- start 2023-09-21T12:58:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1b77fff700 1 -- 172.21.15.142:0/2014828731 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b84014070 con 0x7f1b901060c0 2023-09-21T12:58:53.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 0x7f1b780a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 -- start start 2023-09-21T12:58:53.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b0658289f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06582ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b06579cca0 con 0x55b065828f30 2023-09-21T12:58:53.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065780c70 con 0x55b065828610 2023-09-21T12:58:53.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.079+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b06577e590 con 0x55b06582d360 2023-09-21T12:58:53.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52038/0 (socket says 172.21.15.142:52038) 2023-09-21T12:58:53.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06582ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 -- 172.21.15.142:0/2990350941 learned_addr learned my addr 172.21.15.142:0/2990350941 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b0658289f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 0x7f1b780a2cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009fd0 tx=0x7f1b80019040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 -- 172.21.15.142:0/2990350941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 msgr2=0x55b0658289f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b0658289f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 -- 172.21.15.142:0/2990350941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 msgr2=0x55b06582ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06582ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 -- 172.21.15.142:0/2990350941 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0655a4de0 con 0x55b06582d360 2023-09-21T12:58:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007610 tx=0x7f1b88009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1329854a4935fc58 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b757fa700 1 -- 172.21.15.142:0/2990350941 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88009100 con 0x55b06582d360 2023-09-21T12:58:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.080+0000 7f1b757fa700 1 -- 172.21.15.142:0/2990350941 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8800f040 con 0x55b06582d360 2023-09-21T12:58:53.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1b757fa700 1 -- 172.21.15.142:0/2990350941 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88017dd0 con 0x55b06582d360 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2990350941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 msgr2=0x55b06582d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1b88007610 tx=0x7f1b88009920 comp rx=0 tx=0).stop 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2990350941 shutdown_connections 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582d7c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b0658289f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2990350941 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06582ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2990350941 >> 172.21.15.142:0/2990350941 conn(0x55b065755000 msgr2=0x55b0658236a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2990350941 shutdown_connections 2023-09-21T12:58:53.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.081+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2990350941 wait complete. 2023-09-21T12:58:53.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.082+0000 7f1ba8a27b80 1 -- start start 2023-09-21T12:58:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.082+0000 7f1ba8a27b80 1 Processor -- start 2023-09-21T12:58:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b065834b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b065828f30 0x55b065831e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065779e80 con 0x55b065828610 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065716740 con 0x55b06582d360 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0657163e0 con 0x55b065828f30 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1ba8a27b80 10 client.0 _ll_register_callbacks cb 0x55b065660a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40018/0 (socket says 172.21.15.142:40018) 2023-09-21T12:58:53.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 -- 172.21.15.142:0/393552004 learned_addr learned my addr 172.21.15.142:0/393552004 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b065834b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b065828f30 0x55b065831e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 -- 172.21.15.142:0/393552004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b065828f30 msgr2=0x55b065831e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b065828f30 0x55b065831e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 -- 172.21.15.142:0/393552004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 msgr2=0x55b065834b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b065834b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 -- 172.21.15.142:0/393552004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b88009260 con 0x55b06582d360 2023-09-21T12:58:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b880178d0 tx=0x7f1b88017b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe61c6df1133f50 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.083+0000 7f1b72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:53.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88009100 con 0x55b06582d360 2023-09-21T12:58:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0656eabb0 con 0x55b06582d360 2023-09-21T12:58:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b88017e30 con 0x55b06582d360 2023-09-21T12:58:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b880176f0 con 0x55b06582d360 2023-09-21T12:58:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1ba8a27b80 10 client.26159 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:53.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b06558dc60 con 0x55b06582d360 2023-09-21T12:58:53.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0656eabb0 con 0x55b06582d360 2023-09-21T12:58:53.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.084+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1b88004080 con 0x55b06582d360 2023-09-21T12:58:53.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 10 client.26159 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:53.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 10 client.26159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 20 client.26159 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b065842410 0x55b065844830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 4 client.26159 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0657f7020 con 0x55b065842410 2023-09-21T12:58:53.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b065842410 0x55b065844830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b065842410 0x55b065844830 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64725b918deb9bd6 server_cookie=150638384295183 in_seq=0 out_seq=0 2023-09-21T12:58:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.085+0000 7f1b72ff5700 10 client.26159 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1b72ff5700 1 -- 172.21.15.142:0/393552004 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0657f7020 con 0x55b065842410 2023-09-21T12:58:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1b72ff5700 10 client.26159 handle_command_reply: tid=0 2023-09-21T12:58:53.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 client.26159 shutdown 2023-09-21T12:58:53.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 msgr2=0x55b0658325c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1b880178d0 tx=0x7f1b88017b60 comp rx=0 tx=0).stop 2023-09-21T12:58:53.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 shutdown_connections 2023-09-21T12:58:53.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b065842410 0x55b065844830 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b065834b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b06582d360 0x55b0658325c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/393552004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b065828f30 0x55b065831e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 >> 172.21.15.142:0/393552004 conn(0x55b065755000 msgr2=0x55b065823290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.086+0000 7f1b72ff5700 0 client.26159 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:53.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.087+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 shutdown_connections 2023-09-21T12:58:53.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.087+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/393552004 wait complete. 2023-09-21T12:58:53.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.087+0000 7f1ba8a27b80 20 client.26159 trim_cache size 0 max 16384 2023-09-21T12:58:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.104+0000 7f1ba8a27b80 1 Processor -- start 2023-09-21T12:58:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.104+0000 7f1ba8a27b80 1 -- start start 2023-09-21T12:58:53.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828f30 0x55b06583dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0655fa920 con 0x55b065828610 2023-09-21T12:58:53.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065822460 con 0x55b065828f30 2023-09-21T12:58:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065832ba0 con 0x55b06582d360 2023-09-21T12:58:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60410/0 (socket says 172.21.15.142:60410) 2023-09-21T12:58:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/535344220 learned_addr learned my addr 172.21.15.142:0/535344220 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828f30 0x55b06583dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/535344220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 msgr2=0x55b06582b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/535344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828f30 msgr2=0x55b06583dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828f30 0x55b06583dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/535344220 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0655cb250 con 0x55b065828610 2023-09-21T12:58:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.105+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b800098f0 tx=0x7f1b80021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c9f8b250a648a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1b75ffb700 1 -- 172.21.15.142:0/535344220 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8002a040 con 0x55b065828610 2023-09-21T12:58:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1b75ffb700 1 -- 172.21.15.142:0/535344220 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8002b040 con 0x55b065828610 2023-09-21T12:58:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1b75ffb700 1 -- 172.21.15.142:0/535344220 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8000b800 con 0x55b065828610 2023-09-21T12:58:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/535344220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 msgr2=0x55b06582ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.106+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b800098f0 tx=0x7f1b80021000 comp rx=0 tx=0).stop 2023-09-21T12:58:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/535344220 shutdown_connections 2023-09-21T12:58:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828610 0x55b06582ac50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b06582b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/535344220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828f30 0x55b06583dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/535344220 >> 172.21.15.142:0/535344220 conn(0x55b065755000 msgr2=0x55b065844420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/535344220 shutdown_connections 2023-09-21T12:58:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/535344220 wait complete. 2023-09-21T12:58:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 -- start start 2023-09-21T12:58:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.107+0000 7f1ba8a27b80 1 Processor -- start 2023-09-21T12:58:53.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06588e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b065838550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065838a90 con 0x55b065828f30 2023-09-21T12:58:53.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065838c00 con 0x55b065828610 2023-09-21T12:58:53.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b065838dc0 con 0x55b06582d360 2023-09-21T12:58:53.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1ba8a27b80 10 client.0 _ll_register_callbacks cb 0x55b065660a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:53.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40030/0 (socket says 172.21.15.142:40030) 2023-09-21T12:58:53.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/2705559339 learned_addr learned my addr 172.21.15.142:0/2705559339 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06588e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8f59e700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b065838550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/2705559339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 msgr2=0x55b065838550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b065838550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/2705559339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 msgr2=0x55b06588e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06588e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8ed9d700 1 -- 172.21.15.142:0/2705559339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b06558dc60 con 0x55b065828610 2023-09-21T12:58:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.108+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06588e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:53.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b8ed9d700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b80010010 tx=0x7f1b8000f910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4b8d78b53e3eeb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:53.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b8002a040 con 0x55b065828610 2023-09-21T12:58:53.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b8800f040 con 0x55b065828610 2023-09-21T12:58:53.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1b80034c70 con 0x55b065828610 2023-09-21T12:58:53.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b80034e30 con 0x55b065828610 2023-09-21T12:58:53.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1ba8a27b80 10 client.26165 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:53.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f1b9010e4b0 con 0x55b065828610 2023-09-21T12:58:53.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.109+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b8800f040 con 0x55b065828610 2023-09-21T12:58:53.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1b80005500 con 0x55b065828610 2023-09-21T12:58:53.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 10 client.26165 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:53.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 10 client.26165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:53.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 20 client.26165 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:53.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b06589f1d0 0x55b0658a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 4 client.26165 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:58:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b065772e60 con 0x55b06589f1d0 2023-09-21T12:58:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b06589f1d0 0x55b0658a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1b8e59c700 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b06589f1d0 0x55b0658a15f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b936539c59d539 server_cookie=845b3836f024b835 in_seq=0 out_seq=0 2023-09-21T12:58:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.110+0000 7f1b72ff5700 10 client.26165 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:53.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1b72ff5700 1 -- 172.21.15.142:0/2705559339 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b065772e60 con 0x55b06589f1d0 2023-09-21T12:58:53.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1b72ff5700 10 client.26165 handle_command_reply: tid=0 2023-09-21T12:58:53.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 client.26165 shutdown 2023-09-21T12:58:53.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 msgr2=0x55b06588e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1b80010010 tx=0x7f1b8000f910 comp rx=0 tx=0).stop 2023-09-21T12:58:53.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 shutdown_connections 2023-09-21T12:58:53.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b06589f1d0 0x55b0658a15f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b06582d360 0x55b065838550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b065828610 0x55b06588e3a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1b72ff5700 0 client.26165 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:53.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 --2- 172.21.15.142:0/2705559339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b065828f30 0x55b06588e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 >> 172.21.15.142:0/2705559339 conn(0x55b065755000 msgr2=0x55b06583dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 shutdown_connections 2023-09-21T12:58:53.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 1 -- 172.21.15.142:0/2705559339 wait complete. 2023-09-21T12:58:53.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.111+0000 7f1ba8a27b80 20 client.26165 trim_cache size 0 max 16384 2023-09-21T12:58:53.130 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:53.130 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:58:53.130 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:58:53.130 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:53.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 msgr2=0x7f1b780a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 0x7f1b780a2cf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1b80009fd0 tx=0x7f1b80019040 comp rx=0 tx=0).stop 2023-09-21T12:58:53.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 msgr2=0x7f1b901974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400e9f0 tx=0x7f1b8400ed00 comp rx=0 tx=0).stop 2023-09-21T12:58:53.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 shutdown_connections 2023-09-21T12:58:53.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1b780a0830 0x7f1b780a2cf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1b90100fa0 0x7f1b90196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1b9019b920 0x7f1b9019bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 --2- 172.21.15.142:0/2014828731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b901060c0 0x7f1b901974c0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 >> 172.21.15.142:0/2014828731 conn(0x7f1b900fc860 msgr2=0x7f1b90104a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 shutdown_connections 2023-09-21T12:58:53.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.112+0000 7f1b951ff700 1 -- 172.21.15.142:0/2014828731 wait complete. 2023-09-21T12:58:53.134 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:58:53.135 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:58:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 -- 172.21.15.142:0/1971281744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414101980 msgr2=0x7ff4141059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/1971281744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414101980 0x7ff4141059c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009990 tx=0x7ff3fc009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 -- 172.21.15.142:0/1971281744 shutdown_connections 2023-09-21T12:58:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/1971281744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff41410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/1971281744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff414100fd0 0x7ff4141013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/1971281744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414101980 0x7ff4141059c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 -- 172.21.15.142:0/1971281744 >> 172.21.15.142:0/1971281744 conn(0x7ff4140fc890 msgr2=0x7ff4140fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 -- 172.21.15.142:0/1971281744 shutdown_connections 2023-09-21T12:58:53.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.354+0000 7ff41a5ff700 1 -- 172.21.15.142:0/1971281744 wait complete. 2023-09-21T12:58:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.355+0000 7ff41a5ff700 1 Processor -- start 2023-09-21T12:58:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.355+0000 7ff41a5ff700 1 -- start start 2023-09-21T12:58:53.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 0x7ff414196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41419b850 0x7ff41419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41419c2d0 con 0x7ff414100fd0 2023-09-21T12:58:53.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41419c440 con 0x7ff41419b850 2023-09-21T12:58:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff41a5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff41419c600 con 0x7ff4141060f0 2023-09-21T12:58:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52098/0 (socket says 172.21.15.142:52098) 2023-09-21T12:58:53.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 -- 172.21.15.142:0/2197025579 learned_addr learned my addr 172.21.15.142:0/2197025579 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff413fff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 0x7ff414196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff418b9c700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41419b850 0x7ff41419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 -- 172.21.15.142:0/2197025579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41419b850 msgr2=0x7ff41419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41419b850 0x7ff41419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 -- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 msgr2=0x7ff414196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 0x7ff414196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff40bfff700 1 -- 172.21.15.142:0/2197025579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0095f0 con 0x7ff4141060f0 2023-09-21T12:58:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.356+0000 7ff413fff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 0x7ff414196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:53.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff40bfff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc01d070 con 0x7ff4141060f0 2023-09-21T12:58:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3fc021410 con 0x7ff4141060f0 2023-09-21T12:58:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4141a3b00 con 0x7ff4141060f0 2023-09-21T12:58:53.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc017650 con 0x7ff4141060f0 2023-09-21T12:58:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.357+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4141a3f80 con 0x7ff4141060f0 2023-09-21T12:58:53.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.358+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff414067bd0 con 0x7ff4141060f0 2023-09-21T12:58:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.360+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff3fc021580 con 0x7ff4141060f0 2023-09-21T12:58:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.361+0000 7ff411ffb700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 0x7ff4000a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.362+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff3fc0cd8a0 con 0x7ff4141060f0 2023-09-21T12:58:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.362+0000 7ff413fff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 0x7ff4000a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.362+0000 7ff413fff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 0x7ff4000a2d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff404011490 tx=0x7ff404009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.364+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff3fc0970f0 con 0x7ff4141060f0 2023-09-21T12:58:53.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.640+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff414198200 con 0x7ff4141060f0 2023-09-21T12:58:53.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.642+0000 7ff411ffb700 1 -- 172.21.15.142:0/2197025579 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11335 (secure 0 0 0) 0x7ff3fc09a710 con 0x7ff4141060f0 2023-09-21T12:58:53.641 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:58:53.642 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:57:46.421112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:58:53.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 msgr2=0x7ff4000a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 0x7ff4000a2d30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff404011490 tx=0x7ff404009260 comp rx=0 tx=0).stop 2023-09-21T12:58:53.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 msgr2=0x7ff4141973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc005740 comp rx=0 tx=0).stop 2023-09-21T12:58:53.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 shutdown_connections 2023-09-21T12:58:53.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff4000a0870 0x7ff4000a2d30 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff414100fd0 0x7ff414196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff41419b850 0x7ff41419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 --2- 172.21.15.142:0/2197025579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff4141060f0 0x7ff4141973f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 >> 172.21.15.142:0/2197025579 conn(0x7ff4140fc890 msgr2=0x7ff4140fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 shutdown_connections 2023-09-21T12:58:53.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.645+0000 7ff41a5ff700 1 -- 172.21.15.142:0/2197025579 wait complete. 2023-09-21T12:58:53.647 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-21T12:58:53.664 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:58:53.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 202640 11.82 MB/sec warmup 94 sec latency 64.134 ms 2023-09-21T12:58:53.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.880+0000 7f385cdff700 1 -- 172.21.15.142:0/3616197673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38580ffad0 msgr2=0x7f38580ffeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.880+0000 7f385cdff700 1 --2- 172.21.15.142:0/3616197673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38580ffad0 0x7f38580ffeb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3848009990 tx=0x7f3848009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 -- 172.21.15.142:0/3616197673 shutdown_connections 2023-09-21T12:58:53.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 --2- 172.21.15.142:0/3616197673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f385810d680 0x7f385810fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 --2- 172.21.15.142:0/3616197673 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38580ffad0 0x7f38580ffeb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 --2- 172.21.15.142:0/3616197673 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3858100480 0x7f385810d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 -- 172.21.15.142:0/3616197673 >> 172.21.15.142:0/3616197673 conn(0x7f38580fb730 msgr2=0x7f38580fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 -- 172.21.15.142:0/3616197673 shutdown_connections 2023-09-21T12:58:53.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.881+0000 7f385cdff700 1 -- 172.21.15.142:0/3616197673 wait complete. 2023-09-21T12:58:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 Processor -- start 2023-09-21T12:58:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 -- start start 2023-09-21T12:58:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 0x7f38581995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f385810d680 0x7f385819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819e070 con 0x7f385810d680 2023-09-21T12:58:53.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819e1e0 con 0x7f3858100480 2023-09-21T12:58:53.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.882+0000 7f385cdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f385819e3a0 con 0x7f38580ffad0 2023-09-21T12:58:53.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53348/0 (socket says 172.21.15.142:53348) 2023-09-21T12:58:53.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f3855d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 0x7f38581995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 -- 172.21.15.142:0/680502703 learned_addr learned my addr 172.21.15.142:0/680502703 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f3856d9d700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f385810d680 0x7f385819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 -- 172.21.15.142:0/680502703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 msgr2=0x7f38581995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 0x7f38581995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 -- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f385810d680 msgr2=0x7f385819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f385810d680 0x7f385819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f385659c700 1 -- 172.21.15.142:0/680502703 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3850009c40 con 0x7f38580ffad0 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.883+0000 7f3855d9b700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 0x7f38581995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:53.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f385659c700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3848005910 tx=0x7f3848004710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f38477fe700 1 -- 172.21.15.142:0/680502703 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384801d070 con 0x7f38580ffad0 2023-09-21T12:58:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f38477fe700 1 -- 172.21.15.142:0/680502703 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3848022470 con 0x7f38580ffad0 2023-09-21T12:58:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38480095f0 con 0x7f38580ffad0 2023-09-21T12:58:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f38477fe700 1 -- 172.21.15.142:0/680502703 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848017650 con 0x7f38580ffad0 2023-09-21T12:58:53.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.884+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38581a5ce0 con 0x7f38580ffad0 2023-09-21T12:58:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.887+0000 7f38477fe700 1 -- 172.21.15.142:0/680502703 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f38480225e0 con 0x7f38580ffad0 2023-09-21T12:58:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.889+0000 7f38477fe700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 0x7f38400a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.889+0000 7f387074bb80 1 Processor -- start 2023-09-21T12:58:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.889+0000 7f38477fe700 1 -- 172.21.15.142:0/680502703 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f38480cd130 con 0x7f38580ffad0 2023-09-21T12:58:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.889+0000 7f387074bb80 1 -- start start 2023-09-21T12:58:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.889+0000 7f3855d9b700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 0x7f38400a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbc57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cb34ca0 con 0x55990cbc0610 2023-09-21T12:58:53.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cb18c70 con 0x55990cbc0f30 2023-09-21T12:58:53.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f387074bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cb16590 con 0x55990cbc5360 2023-09-21T12:58:53.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f3855d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60414/0 (socket says 172.21.15.142:60414) 2023-09-21T12:58:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 -- 172.21.15.142:0/2532422528 learned_addr learned my addr 172.21.15.142:0/2532422528 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f3856d9d700 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbc57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f3855d9b700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 0x7f38400a2cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f385819a6a0 tx=0x7f384c009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 -- 172.21.15.142:0/2532422528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 msgr2=0x55990cbc57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbc57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 -- 172.21.15.142:0/2532422528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 msgr2=0x55990cbc4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f385659c700 1 -- 172.21.15.142:0/2532422528 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55990c93cde0 con 0x55990cbc0610 2023-09-21T12:58:53.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.890+0000 7f3856d9d700 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbc57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.891+0000 7f385659c700 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3848006010 tx=0x7f384809a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e861aa812685f95 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.891+0000 7f3844ff9700 1 -- 172.21.15.142:0/2532422528 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384809ad40 con 0x55990cbc0610 2023-09-21T12:58:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.891+0000 7f3844ff9700 1 -- 172.21.15.142:0/2532422528 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f384809a640 con 0x55990cbc0610 2023-09-21T12:58:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.891+0000 7f3844ff9700 1 -- 172.21.15.142:0/2532422528 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384809a8a0 con 0x55990cbc0610 2023-09-21T12:58:53.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- 172.21.15.142:0/2532422528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 msgr2=0x55990cbc09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3848006010 tx=0x7f384809a4e0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- 172.21.15.142:0/2532422528 shutdown_connections 2023-09-21T12:58:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbc09f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbc57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 --2- 172.21.15.142:0/2532422528 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- 172.21.15.142:0/2532422528 >> 172.21.15.142:0/2532422528 conn(0x55990caed000 msgr2=0x55990cbbb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- 172.21.15.142:0/2532422528 shutdown_connections 2023-09-21T12:58:53.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- 172.21.15.142:0/2532422528 wait complete. 2023-09-21T12:58:53.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.892+0000 7f387074bb80 1 -- start start 2023-09-21T12:58:53.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.893+0000 7f387074bb80 1 Processor -- start 2023-09-21T12:58:53.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc5360 0x55990cbca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cb11e80 con 0x55990cbc5360 2023-09-21T12:58:53.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990caae740 con 0x55990cbc0f30 2023-09-21T12:58:53.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990caae3e0 con 0x55990cbc0610 2023-09-21T12:58:53.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f387074bb80 10 client.0 _ll_register_callbacks cb 0x55990c9f8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:53.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53360/0 (socket says 172.21.15.142:53360) 2023-09-21T12:58:53.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 -- 172.21.15.142:0/1866852040 learned_addr learned my addr 172.21.15.142:0/1866852040 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f3855d9b700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f3856d9d700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc5360 0x55990cbca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 -- 172.21.15.142:0/1866852040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 msgr2=0x55990cbc9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 -- 172.21.15.142:0/1866852040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc5360 msgr2=0x55990cbca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc5360 0x55990cbca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 -- 172.21.15.142:0/1866852040 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38581a5ce0 con 0x55990cbc0610 2023-09-21T12:58:53.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f385659c700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38480a20f0 tx=0x7f3848022b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719e91a7fc60cf5a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.894+0000 7f383dffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:53.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384809e470 con 0x55990cbc0610 2023-09-21T12:58:53.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f38480a2620 con 0x55990cbc0610 2023-09-21T12:58:53.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55990ca82bb0 con 0x55990cbc0610 2023-09-21T12:58:53.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f384809a8a0 con 0x55990cbc0610 2023-09-21T12:58:53.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f387074bb80 10 client.26146 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55990c925c60 con 0x55990cbc0610 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55990ca82bb0 con 0x55990cbc0610 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.895+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f38480b8410 con 0x55990cbc0610 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 10 client.26146 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 10 client.26146 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:58:53.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 20 client.26146 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cbd9c10 0x55990cbdc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 4 client.26146 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55990cb8f020 con 0x55990cbd9c10 2023-09-21T12:58:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f3855d9b700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cbd9c10 0x55990cbdc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f383dffb700 10 client.26146 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.896+0000 7f3855d9b700 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cbd9c10 0x55990cbdc030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ce29631ec5b2a646 server_cookie=14ace25df1cfe008 in_seq=0 out_seq=0 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f383dffb700 1 -- 172.21.15.142:0/1866852040 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55990cb8f020 con 0x55990cbd9c10 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f383dffb700 10 client.26146 handle_command_reply: tid=0 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 client.26146 shutdown 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 msgr2=0x55990cbccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38480a20f0 tx=0x7f3848022b30 comp rx=0 tx=0).stop 2023-09-21T12:58:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 shutdown_connections 2023-09-21T12:58:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cbd9c10 0x55990cbdc030 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc5360 0x55990cbca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.897+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0610 0x55990cbccb30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f387074bb80 1 --2- 172.21.15.142:0/1866852040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0f30 0x55990cbc9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 >> 172.21.15.142:0/1866852040 conn(0x55990caed000 msgr2=0x55990cbbb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f383dffb700 0 client.26146 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:53.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 shutdown_connections 2023-09-21T12:58:53.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f387074bb80 1 -- 172.21.15.142:0/1866852040 wait complete. 2023-09-21T12:58:53.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.898+0000 7f387074bb80 20 client.26146 trim_cache size 0 max 16384 2023-09-21T12:58:53.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 Processor -- start 2023-09-21T12:58:53.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 -- start start 2023-09-21T12:58:53.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbcc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc5360 0x55990cbc9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cbd6b20 con 0x55990cbc0610 2023-09-21T12:58:53.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990c992920 con 0x55990cbc5360 2023-09-21T12:58:53.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f387074bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cbba460 con 0x55990cbc0f30 2023-09-21T12:58:53.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f3855d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f3855d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53374/0 (socket says 172.21.15.142:53374) 2023-09-21T12:58:53.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f385659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbcc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f3855d9b700 1 -- 172.21.15.142:0/905632915 learned_addr learned my addr 172.21.15.142:0/905632915 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.913+0000 7f3856d9d700 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc5360 0x55990cbc9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 -- 172.21.15.142:0/905632915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc5360 msgr2=0x55990cbc9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc5360 0x55990cbc9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 -- 172.21.15.142:0/905632915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 msgr2=0x55990cbcc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbcc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 -- 172.21.15.142:0/905632915 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55990cbb75b0 con 0x55990cbc0f30 2023-09-21T12:58:53.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f3855d9b700 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f384c011fd0 tx=0x7f384c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0bac6b829b05ba8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f38457fa700 1 -- 172.21.15.142:0/905632915 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c003a60 con 0x55990cbc0f30 2023-09-21T12:58:53.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f38457fa700 1 -- 172.21.15.142:0/905632915 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f384c003bc0 con 0x55990cbc0f30 2023-09-21T12:58:53.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.914+0000 7f38457fa700 1 -- 172.21.15.142:0/905632915 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384c01c660 con 0x55990cbc0f30 2023-09-21T12:58:53.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- 172.21.15.142:0/905632915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 msgr2=0x55990cbccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f384c011fd0 tx=0x7f384c014000 comp rx=0 tx=0).stop 2023-09-21T12:58:53.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- 172.21.15.142:0/905632915 shutdown_connections 2023-09-21T12:58:53.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0610 0x55990cbcc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc5360 0x55990cbc9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 --2- 172.21.15.142:0/905632915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc0f30 0x55990cbccb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- 172.21.15.142:0/905632915 >> 172.21.15.142:0/905632915 conn(0x55990caed000 msgr2=0x55990cbc7750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- 172.21.15.142:0/905632915 shutdown_connections 2023-09-21T12:58:53.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- 172.21.15.142:0/905632915 wait complete. 2023-09-21T12:58:53.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.915+0000 7f387074bb80 1 -- start start 2023-09-21T12:58:53.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 Processor -- start 2023-09-21T12:58:53.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 0x55990cc271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbcf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cbcf730 con 0x55990cbc0f30 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cbcf870 con 0x55990cbc0610 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990cbcfa00 con 0x55990cbc5360 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.916+0000 7f387074bb80 10 client.0 _ll_register_callbacks cb 0x55990c9f8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:53.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58682/0 (socket says 172.21.15.142:58682) 2023-09-21T12:58:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 -- 172.21.15.142:0/2509432133 learned_addr learned my addr 172.21.15.142:0/2509432133 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:53.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f3856d9d700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbcf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.923 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:53 smithi142 ceph-mon[97663]: pgmap v82: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:53.924 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:53 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2197025579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 -- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 msgr2=0x55990cbcf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f3855d9b700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 0x55990cc271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbcf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 -- 172.21.15.142:0/2509432133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 msgr2=0x55990cc271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 0x55990cc271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 -- 172.21.15.142:0/2509432133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c016040 con 0x55990cbc0610 2023-09-21T12:58:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f3856d9d700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbcf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:53.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f3855d9b700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 0x55990cc271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f385659c700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f384800fb10 tx=0x7f3848098bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5d7bae8752cd03 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.917+0000 7f383dffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384807e070 con 0x55990cbc0610 2023-09-21T12:58:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f384809a640 con 0x55990cbc0610 2023-09-21T12:58:53.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f384809ad40 con 0x55990cbc0610 2023-09-21T12:58:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f384809a180 con 0x55990cbc0610 2023-09-21T12:58:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 10 client.26189 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55990c963250 con 0x55990cbc0610 2023-09-21T12:58:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f384809a640 con 0x55990cbc0610 2023-09-21T12:58:53.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f38480b2bb0 con 0x55990cbc0610 2023-09-21T12:58:53.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 10 client.26189 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:53.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 10 client.26189 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:58:53.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 20 client.26189 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:53.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cc2e4f0 0x55990cc308e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 4 client.26189 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.918+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55990cb0ae60 con 0x55990cc2e4f0 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f3855d9b700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cc2e4f0 0x55990cc308e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f3855d9b700 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cc2e4f0 0x55990cc308e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1c67411d0c63b48 server_cookie=3fd034f6fd4a7927 in_seq=0 out_seq=0 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f383dffb700 10 client.26189 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:53.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f383dffb700 1 -- 172.21.15.142:0/2509432133 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55990cb0ae60 con 0x55990cc2e4f0 2023-09-21T12:58:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f383dffb700 10 client.26189 handle_command_reply: tid=0 2023-09-21T12:58:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 client.26189 shutdown 2023-09-21T12:58:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 msgr2=0x55990cc26ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f384800fb10 tx=0x7f3848098bf0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 shutdown_connections 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55990cc2e4f0 0x55990cc308e0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55990cbc5360 0x55990cbcf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f383dffb700 0 client.26189 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55990cbc0610 0x55990cc26ca0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 --2- 172.21.15.142:0/2509432133 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55990cbc0f30 0x55990cc271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.919+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 >> 172.21.15.142:0/2509432133 conn(0x55990caed000 msgr2=0x55990cbc4410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 shutdown_connections 2023-09-21T12:58:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f387074bb80 1 -- 172.21.15.142:0/2509432133 wait complete. 2023-09-21T12:58:53.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f387074bb80 20 client.26189 trim_cache size 0 max 16384 2023-09-21T12:58:53.934 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 msgr2=0x7f38400a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 0x7f38400a2cf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f385819a6a0 tx=0x7f384c009260 comp rx=0 tx=0).stop 2023-09-21T12:58:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 msgr2=0x7f3858199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3848005910 tx=0x7f3848004710 comp rx=0 tx=0).stop 2023-09-21T12:58:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 shutdown_connections 2023-09-21T12:58:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38400a0830 0x7f38400a2cf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f385810d680 0x7f385819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38580ffad0 0x7f3858199090 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 --2- 172.21.15.142:0/680502703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3858100480 0x7f38581995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.920+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 >> 172.21.15.142:0/680502703 conn(0x7f38580fb730 msgr2=0x7f385810f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.921+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 shutdown_connections 2023-09-21T12:58:53.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:53.921+0000 7f385cdff700 1 -- 172.21.15.142:0/680502703 wait complete. 2023-09-21T12:58:53.939 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:58:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:53 smithi156 ceph-mon[134078]: pgmap v82: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:53 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2197025579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:53 smithi160 ceph-mon[134450]: pgmap v82: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:53 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2197025579' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:58:54.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.196+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/1158071701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 msgr2=0x7fdc84101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.196+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/1158071701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84101220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdc80009990 tx=0x7fdc80009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/1158071701 shutdown_connections 2023-09-21T12:58:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/1158071701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc84105f60 0x7fdc8410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/1158071701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84101220 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/1158071701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc841017f0 0x7fdc84105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/1158071701 >> 172.21.15.142:0/1158071701 conn(0x7fdc840fc6a0 msgr2=0x7fdc840feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/1158071701 shutdown_connections 2023-09-21T12:58:54.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.197+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/1158071701 wait complete. 2023-09-21T12:58:54.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.198+0000 7fdc8ad9d700 1 Processor -- start 2023-09-21T12:58:54.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.198+0000 7fdc8ad9d700 1 -- start start 2023-09-21T12:58:54.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc84105f60 0x7fdc84199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8419d7b0 0x7fdc8419dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8419e230 con 0x7fdc84105f60 2023-09-21T12:58:54.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8419e3a0 con 0x7fdc84100e40 2023-09-21T12:58:54.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8ad9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc8419e560 con 0x7fdc8419d7b0 2023-09-21T12:58:54.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58694/0 (socket says 172.21.15.142:58694) 2023-09-21T12:58:54.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 -- 172.21.15.142:0/435943398 learned_addr learned my addr 172.21.15.142:0/435943398 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8419d7b0 0x7fdc8419dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc8959a700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc84105f60 0x7fdc84199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 -- 172.21.15.142:0/435943398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8419d7b0 msgr2=0x7fdc8419dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8419d7b0 0x7fdc8419dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 -- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc84105f60 msgr2=0x7fdc84199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc84105f60 0x7fdc84199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.199+0000 7fdc89d9b700 1 -- 172.21.15.142:0/435943398 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc74009520 con 0x7fdc84100e40 2023-09-21T12:58:54.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005910 tx=0x7fdc80004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc7affd700 1 -- 172.21.15.142:0/435943398 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8001d070 con 0x7fdc84100e40 2023-09-21T12:58:54.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c009c40 con 0x7fdc84100e40 2023-09-21T12:58:54.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc7affd700 1 -- 172.21.15.142:0/435943398 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc80022470 con 0x7fdc84100e40 2023-09-21T12:58:54.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc7affd700 1 -- 172.21.15.142:0/435943398 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc80017650 con 0x7fdc84100e40 2023-09-21T12:58:54.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.200+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc800095f0 con 0x7fdc84100e40 2023-09-21T12:58:54.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.203+0000 7fdc7affd700 1 -- 172.21.15.142:0/435943398 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdc800225e0 con 0x7fdc84100e40 2023-09-21T12:58:54.208 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.205+0000 7fdc9f9c7b80 1 Processor -- start 2023-09-21T12:58:54.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.205+0000 7fdc9f9c7b80 1 -- start start 2023-09-21T12:58:54.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc7affd700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 0x7fdc700a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc7affd700 1 -- 172.21.15.142:0/435943398 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdc800cd190 con 0x7fdc84100e40 2023-09-21T12:58:54.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9b49ca0 con 0x5596b9bdbce0 2023-09-21T12:58:54.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9b2dc70 con 0x5596b9bdb3c0 2023-09-21T12:58:54.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9b2b590 con 0x5596b9bd5bb0 2023-09-21T12:58:54.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 0x7fdc700a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc8a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58702/0 (socket says 172.21.15.142:58702) 2023-09-21T12:58:54.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.206+0000 7fdc89d9b700 1 -- 172.21.15.142:0/2336652920 learned_addr learned my addr 172.21.15.142:0/2336652920 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc8959a700 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 -- 172.21.15.142:0/2336652920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 msgr2=0x5596b9bd6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 -- 172.21.15.142:0/2336652920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 msgr2=0x5596b9bd5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 -- 172.21.15.142:0/2336652920 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b9951de0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc80006010 tx=0x7fdc8009a470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3c8e5822587995d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 0x7fdc700a2d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009fd0 tx=0x7fdc7c00f5a0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc6ffff700 1 -- 172.21.15.142:0/2336652920 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8009ada0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc6ffff700 1 -- 172.21.15.142:0/2336652920 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8009a6a0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.207+0000 7fdc6ffff700 1 -- 172.21.15.142:0/2336652920 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8009e120 con 0x5596b9bdb3c0 2023-09-21T12:58:54.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2336652920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 msgr2=0x5596b9bdb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fdc80006010 tx=0x7fdc8009a470 comp rx=0 tx=0).stop 2023-09-21T12:58:54.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2336652920 shutdown_connections 2023-09-21T12:58:54.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdb7a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2336652920 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2336652920 >> 172.21.15.142:0/2336652920 conn(0x5596b9b02000 msgr2=0x5596b9bd0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2336652920 shutdown_connections 2023-09-21T12:58:54.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.208+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2336652920 wait complete. 2023-09-21T12:58:54.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 -- start start 2023-09-21T12:58:54.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 Processor -- start 2023-09-21T12:58:54.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bd5bb0 0x5596b9be1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdbce0 0x5596b9bdf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.209+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9b26e80 con 0x5596b9bd5bb0 2023-09-21T12:58:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9ac3740 con 0x5596b9bdb3c0 2023-09-21T12:58:54.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9ac33e0 con 0x5596b9bdbce0 2023-09-21T12:58:54.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc9f9c7b80 10 client.0 _ll_register_callbacks cb 0x5596b9a0da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:54.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58716/0 (socket says 172.21.15.142:58716) 2023-09-21T12:58:54.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdbce0 0x5596b9bdf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 -- 172.21.15.142:0/2545472384 learned_addr learned my addr 172.21.15.142:0/2545472384 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bd5bb0 0x5596b9be1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 -- 172.21.15.142:0/2545472384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdbce0 msgr2=0x5596b9bdf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdbce0 0x5596b9bdf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 -- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bd5bb0 msgr2=0x5596b9be1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bd5bb0 0x5596b9be1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 -- 172.21.15.142:0/2545472384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc800095f0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc8959a700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc74011680 tx=0x7fdc74011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1606e80ee6bf1995 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.210+0000 7fdc6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74016070 con 0x5596b9bdb3c0 2023-09-21T12:58:54.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5596b9a97bb0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdc74004320 con 0x5596b9bdb3c0 2023-09-21T12:58:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc74004520 con 0x5596b9bdb3c0 2023-09-21T12:58:54.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc9f9c7b80 10 client.26201 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:54.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5596b993ac60 con 0x5596b9bdb3c0 2023-09-21T12:58:54.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5596b9a97bb0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.211+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdc74003680 con 0x5596b9bdb3c0 2023-09-21T12:58:54.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 10 client.26201 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:54.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 10 client.26201 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:58:54.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 20 client.26201 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9bef300 0x5596b9bf1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 4 client.26201 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596b9ba4020 con 0x5596b9bef300 2023-09-21T12:58:54.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9bef300 0x5596b9bf1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc6d7fa700 10 client.26201 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.212+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9bef300 0x5596b9bf1720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ed75d9cb7287dd09 server_cookie=42ebbf8efb2cd794 in_seq=0 out_seq=0 2023-09-21T12:58:54.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/2545472384 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5596b9ba4020 con 0x5596b9bef300 2023-09-21T12:58:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc6d7fa700 10 client.26201 handle_command_reply: tid=0 2023-09-21T12:58:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc9f9c7b80 1 client.26201 shutdown 2023-09-21T12:58:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 msgr2=0x5596b9bdeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdc74011680 tx=0x7fdc74011990 comp rx=0 tx=0).stop 2023-09-21T12:58:54.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.213+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 shutdown_connections 2023-09-21T12:58:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bd5bb0 0x5596b9be1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9bef300 0x5596b9bf1720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdbce0 0x5596b9bdf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/2545472384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9bdeea0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc6d7fa700 0 client.26201 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 >> 172.21.15.142:0/2545472384 conn(0x5596b9b02000 msgr2=0x5596b9bd0360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 shutdown_connections 2023-09-21T12:58:54.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/2545472384 wait complete. 2023-09-21T12:58:54.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.214+0000 7fdc9f9c7b80 20 client.26201 trim_cache size 0 max 16384 2023-09-21T12:58:54.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 Processor -- start 2023-09-21T12:58:54.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 -- start start 2023-09-21T12:58:54.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b99a7920 con 0x5596b9bdbce0 2023-09-21T12:58:54.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9bdb010 con 0x5596b9bdb3c0 2023-09-21T12:58:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9bebd00 con 0x5596b9bd5bb0 2023-09-21T12:58:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.231+0000 7fdc8959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53414/0 (socket says 172.21.15.142:53414) 2023-09-21T12:58:54.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc89d9b700 1 -- 172.21.15.142:0/3353600846 learned_addr learned my addr 172.21.15.142:0/3353600846 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58724/0 (socket says 172.21.15.142:58724) 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 -- 172.21.15.142:0/3353600846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 msgr2=0x5596b9bd5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 -- 172.21.15.142:0/3353600846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 msgr2=0x5596b9bd91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 -- 172.21.15.142:0/3353600846 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596b9978250 con 0x5596b9bdb3c0 2023-09-21T12:58:54.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:54.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdc74000c00 tx=0x7fdc74011ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72d458db5adbbffb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc78ff9700 1 -- 172.21.15.142:0/3353600846 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74016070 con 0x5596b9bdb3c0 2023-09-21T12:58:54.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc78ff9700 1 -- 172.21.15.142:0/3353600846 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc74003680 con 0x5596b9bdb3c0 2023-09-21T12:58:54.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.232+0000 7fdc78ff9700 1 -- 172.21.15.142:0/3353600846 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74023690 con 0x5596b9bdb3c0 2023-09-21T12:58:54.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3353600846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 msgr2=0x5596b9be1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdc74000c00 tx=0x7fdc74011ce0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3353600846 shutdown_connections 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9bd91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bd5bb0 0x5596b9bd5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3353600846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bdb3c0 0x5596b9be1850 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3353600846 >> 172.21.15.142:0/3353600846 conn(0x5596b9b02000 msgr2=0x5596b9bd5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3353600846 shutdown_connections 2023-09-21T12:58:54.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.233+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3353600846 wait complete. 2023-09-21T12:58:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 -- start start 2023-09-21T12:58:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 Processor -- start 2023-09-21T12:58:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 0x5596b9be5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 0x5596b9be6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9be43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9be49c0 con 0x5596b9bdbce0 2023-09-21T12:58:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9be4b30 con 0x5596b9bd5bb0 2023-09-21T12:58:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596b9be4cf0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc9f9c7b80 10 client.0 _ll_register_callbacks cb 0x5596b9a0da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:54.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.234+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 0x5596b9be5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 0x5596b9be6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc89d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 0x5596b9be5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58740/0 (socket says 172.21.15.142:58740) 2023-09-21T12:58:54.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc89d9b700 1 -- 172.21.15.142:0/3238903212 learned_addr learned my addr 172.21.15.142:0/3238903212 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9be43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 -- 172.21.15.142:0/3238903212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 msgr2=0x5596b9be5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 0x5596b9be5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 -- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 msgr2=0x5596b9be43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9be43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 -- 172.21.15.142:0/3238903212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc800b1040 con 0x5596b9bdb3c0 2023-09-21T12:58:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8a59c700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9be43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:58:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc8959a700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 0x5596b9be6350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5596b9bdff60 tx=0x7fdc74003f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7feb131644b9d376 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74016040 con 0x5596b9bdb3c0 2023-09-21T12:58:54.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc8009a6a0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.235+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdc74000e40 con 0x5596b9bdb3c0 2023-09-21T12:58:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc74005530 con 0x5596b9bdb3c0 2023-09-21T12:58:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 10 client.26170 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5596b993ac60 con 0x5596b9bdb3c0 2023-09-21T12:58:54.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc8009a6a0 con 0x5596b9bdb3c0 2023-09-21T12:58:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdc7401a410 con 0x5596b9bdb3c0 2023-09-21T12:58:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 10 client.26170 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 10 client.26170 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:58:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 20 client.26170 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:54.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9c43f60 0x5596b9c46350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 4 client.26170 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5596b9b1fe60 con 0x5596b9c43f60 2023-09-21T12:58:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.236+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9c43f60 0x5596b9c46350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.237+0000 7fdc89d9b700 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9c43f60 0x5596b9c46350 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e186b46e9f486ce9 server_cookie=a1c2a4fb5cb2d4ab in_seq=0 out_seq=0 2023-09-21T12:58:54.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.237+0000 7fdc6d7fa700 10 client.26170 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:54.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.237+0000 7fdc6d7fa700 1 -- 172.21.15.142:0/3238903212 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5596b9b1fe60 con 0x5596b9c43f60 2023-09-21T12:58:54.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.237+0000 7fdc6d7fa700 10 client.26170 handle_command_reply: tid=0 2023-09-21T12:58:54.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.237+0000 7fdc9f9c7b80 1 client.26170 shutdown 2023-09-21T12:58:54.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 msgr2=0x5596b9be6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 0x5596b9be6350 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x5596b9bdff60 tx=0x7fdc74003f00 comp rx=0 tx=0).stop 2023-09-21T12:58:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 shutdown_connections 2023-09-21T12:58:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5596b9bdbce0 0x5596b9be43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x5596b9c43f60 0x5596b9c46350 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5596b9bd5bb0 0x5596b9be5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 --2- 172.21.15.142:0/3238903212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5596b9bdb3c0 0x5596b9be6350 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 >> 172.21.15.142:0/3238903212 conn(0x5596b9b02000 msgr2=0x5596b9bd91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc6d7fa700 0 client.26170 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:58:54.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 shutdown_connections 2023-09-21T12:58:54.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 1 -- 172.21.15.142:0/3238903212 wait complete. 2023-09-21T12:58:54.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.238+0000 7fdc9f9c7b80 20 client.26170 trim_cache size 0 max 16384 2023-09-21T12:58:54.259 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 msgr2=0x7fdc700a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 0x7fdc700a2d10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c009fd0 tx=0x7fdc7c00f5a0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 msgr2=0x7fdc84198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdc80005910 tx=0x7fdc80004710 comp rx=0 tx=0).stop 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 shutdown_connections 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdc700a0850 0x7fdc700a2d10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc8419d7b0 0x7fdc8419dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdc84100e40 0x7fdc84198e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 --2- 172.21.15.142:0/435943398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdc84105f60 0x7fdc84199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 >> 172.21.15.142:0/435943398 conn(0x7fdc840fc6a0 msgr2=0x7fdc8410ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 shutdown_connections 2023-09-21T12:58:54.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.239+0000 7fdc8ad9d700 1 -- 172.21.15.142:0/435943398 wait complete. 2023-09-21T12:58:54.263 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:58:54.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 -- 172.21.15.142:0/1236527570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 msgr2=0x7fc7781035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/1236527570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc7781035d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc768009990 tx=0x7fc768009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 -- 172.21.15.142:0/1236527570 shutdown_connections 2023-09-21T12:58:54.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/1236527570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc7781035d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/1236527570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc778108310 0x7fc77810fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/1236527570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778103ba0 0x7fc778107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.496+0000 7fc77e1ff700 1 -- 172.21.15.142:0/1236527570 >> 172.21.15.142:0/1236527570 conn(0x7fc7780fea30 msgr2=0x7fc778100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.497+0000 7fc77e1ff700 1 -- 172.21.15.142:0/1236527570 shutdown_connections 2023-09-21T12:58:54.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.497+0000 7fc77e1ff700 1 -- 172.21.15.142:0/1236527570 wait complete. 2023-09-21T12:58:54.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 Processor -- start 2023-09-21T12:58:54.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 -- start start 2023-09-21T12:58:54.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778108310 0x7fc778199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 0x7fc77819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77819e560 con 0x7fc7781031f0 2023-09-21T12:58:54.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77819e6d0 con 0x7fc77819dae0 2023-09-21T12:58:54.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.498+0000 7fc77e1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77819e890 con 0x7fc778108310 2023-09-21T12:58:54.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60514/0 (socket says 172.21.15.142:60514) 2023-09-21T12:58:54.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 -- 172.21.15.142:0/761104704 learned_addr learned my addr 172.21.15.142:0/761104704 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc777fff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 0x7fc77819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc776ffd700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778108310 0x7fc778199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 -- 172.21.15.142:0/761104704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778108310 msgr2=0x7fc778199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778108310 0x7fc778199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 -- 172.21.15.142:0/761104704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 msgr2=0x7fc77819df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 0x7fc77819df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 -- 172.21.15.142:0/761104704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c009520 con 0x7fc7781031f0 2023-09-21T12:58:54.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc777fff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 0x7fc77819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:54.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.499+0000 7fc7777fe700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc768005910 tx=0x7fc768005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.500+0000 7fc774ff9700 1 -- 172.21.15.142:0/761104704 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76801d070 con 0x7fc7781031f0 2023-09-21T12:58:54.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.500+0000 7fc774ff9700 1 -- 172.21.15.142:0/761104704 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc768022470 con 0x7fc7781031f0 2023-09-21T12:58:54.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.500+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc770009c40 con 0x7fc7781031f0 2023-09-21T12:58:54.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.500+0000 7fc774ff9700 1 -- 172.21.15.142:0/761104704 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768017650 con 0x7fc7781031f0 2023-09-21T12:58:54.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.500+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7680095f0 con 0x7fc7781031f0 2023-09-21T12:58:54.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.503+0000 7fc774ff9700 1 -- 172.21.15.142:0/761104704 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc7680225e0 con 0x7fc7781031f0 2023-09-21T12:58:54.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.504+0000 7fc774ff9700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 0x7fc7600a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.505+0000 7fc774ff9700 1 -- 172.21.15.142:0/761104704 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc7680cd2c0 con 0x7fc7781031f0 2023-09-21T12:58:54.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.505+0000 7fc776ffd700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 0x7fc7600a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.505+0000 7fc791a66b80 1 Processor -- start 2023-09-21T12:58:54.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.505+0000 7fc791a66b80 1 -- start start 2023-09-21T12:58:54.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.505+0000 7fc776ffd700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 0x7fc7600a2c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77819a750 tx=0x7fc76c009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f67c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f680e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f5f0ca0 con 0x55862f67cf30 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f5d4c70 con 0x55862f681360 2023-09-21T12:58:54.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc791a66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f5d2590 con 0x55862f67c610 2023-09-21T12:58:54.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58768/0 (socket says 172.21.15.142:58768) 2023-09-21T12:58:54.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 -- 172.21.15.142:0/3053136767 learned_addr learned my addr 172.21.15.142:0/3053136767 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc7777fe700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f67c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc776ffd700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f680e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 -- 172.21.15.142:0/3053136767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 msgr2=0x55862f67c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f67c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 -- 172.21.15.142:0/3053136767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 msgr2=0x55862f680e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f680e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc777fff700 1 -- 172.21.15.142:0/3053136767 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55862f3f8de0 con 0x55862f681360 2023-09-21T12:58:54.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.506+0000 7fc776ffd700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f680e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:54.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc777fff700 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc770007610 tx=0x7fc770009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdc7607e62067684 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc75dffb700 1 -- 172.21.15.142:0/3053136767 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770009100 con 0x55862f681360 2023-09-21T12:58:54.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc75dffb700 1 -- 172.21.15.142:0/3053136767 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc77000f040 con 0x55862f681360 2023-09-21T12:58:54.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc75dffb700 1 -- 172.21.15.142:0/3053136767 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770017dd0 con 0x55862f681360 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc791a66b80 1 -- 172.21.15.142:0/3053136767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 msgr2=0x55862f6817c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.507+0000 7fc791a66b80 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc770007610 tx=0x7fc770009920 comp rx=0 tx=0).stop 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 -- 172.21.15.142:0/3053136767 shutdown_connections 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f6817c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f67c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 --2- 172.21.15.142:0/3053136767 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f680e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 -- 172.21.15.142:0/3053136767 >> 172.21.15.142:0/3053136767 conn(0x55862f5a9000 msgr2=0x55862f6776a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 -- 172.21.15.142:0/3053136767 shutdown_connections 2023-09-21T12:58:54.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 -- 172.21.15.142:0/3053136767 wait complete. 2023-09-21T12:58:54.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.508+0000 7fc791a66b80 1 -- start start 2023-09-21T12:58:54.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.509+0000 7fc791a66b80 1 Processor -- start 2023-09-21T12:58:54.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.509+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f688a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.509+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67cf30 0x55862f685d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.509+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.509+0000 7fc791a66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f5cde80 con 0x55862f67c610 2023-09-21T12:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc791a66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f56a740 con 0x55862f681360 2023-09-21T12:58:54.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc791a66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f56a3e0 con 0x55862f67cf30 2023-09-21T12:58:54.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc791a66b80 10 client.0 _ll_register_callbacks cb 0x55862f4b4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:54.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f688a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58770/0 (socket says 172.21.15.142:58770) 2023-09-21T12:58:54.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 -- 172.21.15.142:0/2101278114 learned_addr learned my addr 172.21.15.142:0/2101278114 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc776ffd700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67cf30 0x55862f685d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 -- 172.21.15.142:0/2101278114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67cf30 msgr2=0x55862f685d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67cf30 0x55862f685d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 -- 172.21.15.142:0/2101278114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 msgr2=0x55862f688a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f688a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 -- 172.21.15.142:0/2101278114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc770009260 con 0x55862f681360 2023-09-21T12:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc777fff700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7700178d0 tx=0x7fc770017be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d03ea3643fbb0ea6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.510+0000 7fc756ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770009100 con 0x55862f681360 2023-09-21T12:58:54.521 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55862f53ebb0 con 0x55862f681360 2023-09-21T12:58:54.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc770004ce0 con 0x55862f681360 2023-09-21T12:58:54.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc770004ea0 con 0x55862f681360 2023-09-21T12:58:54.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc791a66b80 10 client.26219 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:54.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55862f3e1c60 con 0x55862f681360 2023-09-21T12:58:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.511+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55862f53ebb0 con 0x55862f681360 2023-09-21T12:58:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc7700041c0 con 0x55862f681360 2023-09-21T12:58:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 10 client.26219 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 10 client.26219 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:54.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 20 client.26219 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6963e0 0x55862f698800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 4 client.26219 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55862f64b020 con 0x55862f6963e0 2023-09-21T12:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc7777fe700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6963e0 0x55862f698800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc756ffd700 10 client.26219 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.512+0000 7fc7777fe700 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6963e0 0x55862f698800 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef537fdfe8965e60 server_cookie=c4866a3d173b46b5 in_seq=0 out_seq=0 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc756ffd700 1 -- 172.21.15.142:0/2101278114 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55862f64b020 con 0x55862f6963e0 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc756ffd700 10 client.26219 handle_command_reply: tid=0 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 client.26219 shutdown 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 msgr2=0x55862f686330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc7700178d0 tx=0x7fc770017be0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 shutdown_connections 2023-09-21T12:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6963e0 0x55862f698800 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f688a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f686330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2101278114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67cf30 0x55862f685d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc756ffd700 0 client.26219 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 >> 172.21.15.142:0/2101278114 conn(0x55862f5a9000 msgr2=0x55862f676920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 shutdown_connections 2023-09-21T12:58:54.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.513+0000 7fc791a66b80 1 -- 172.21.15.142:0/2101278114 wait complete. 2023-09-21T12:58:54.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.514+0000 7fc791a66b80 20 client.26219 trim_cache size 0 max 16384 2023-09-21T12:58:54.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.527+0000 7fc791a66b80 1 Processor -- start 2023-09-21T12:58:54.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.527+0000 7fc791a66b80 1 -- start start 2023-09-21T12:58:54.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f67ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 0x55862f6837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f44e920 con 0x55862f67c610 2023-09-21T12:58:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f67d670 con 0x55862f67cf30 2023-09-21T12:58:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc791a66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f67d440 con 0x55862f681360 2023-09-21T12:58:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc776ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc776ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58786/0 (socket says 172.21.15.142:58786) 2023-09-21T12:58:54.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc776ffd700 1 -- 172.21.15.142:0/2278704577 learned_addr learned my addr 172.21.15.142:0/2278704577 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc7777fe700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f67ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.528+0000 7fc777fff700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 0x55862f6837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 -- 172.21.15.142:0/2278704577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 msgr2=0x55862f6837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 0x55862f6837c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 -- 172.21.15.142:0/2278704577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 msgr2=0x55862f67ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f67ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 -- 172.21.15.142:0/2278704577 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55862f41f250 con 0x55862f67cf30 2023-09-21T12:58:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc777fff700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 0x55862f6837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc776ffd700 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0042e0 tx=0x7fc76c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a27acbc3cdc6a4dd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc75e7fc700 1 -- 172.21.15.142:0/2278704577 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c023070 con 0x55862f67cf30 2023-09-21T12:58:54.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc75e7fc700 1 -- 172.21.15.142:0/2278704577 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc76c028460 con 0x55862f67cf30 2023-09-21T12:58:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.529+0000 7fc75e7fc700 1 -- 172.21.15.142:0/2278704577 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c01d670 con 0x55862f67cf30 2023-09-21T12:58:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- 172.21.15.142:0/2278704577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 msgr2=0x55862f68d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0042e0 tx=0x7fc76c014000 comp rx=0 tx=0).stop 2023-09-21T12:58:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- 172.21.15.142:0/2278704577 shutdown_connections 2023-09-21T12:58:54.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67c610 0x55862f67ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f681360 0x55862f6837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 --2- 172.21.15.142:0/2278704577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f67cf30 0x55862f68d4e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- 172.21.15.142:0/2278704577 >> 172.21.15.142:0/2278704577 conn(0x55862f5a9000 msgr2=0x55862f691c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- 172.21.15.142:0/2278704577 shutdown_connections 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- 172.21.15.142:0/2278704577 wait complete. 2023-09-21T12:58:54.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.530+0000 7fc791a66b80 1 -- start start 2023-09-21T12:58:54.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 Processor -- start 2023-09-21T12:58:54.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f68b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f68bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f68c110 con 0x55862f67cf30 2023-09-21T12:58:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f68c250 con 0x55862f681360 2023-09-21T12:58:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55862f68c410 con 0x55862f67c610 2023-09-21T12:58:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc791a66b80 10 client.0 _ll_register_callbacks cb 0x55862f4b4a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc777fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f68bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc776ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f68b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc7777fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53492/0 (socket says 172.21.15.142:53492) 2023-09-21T12:58:54.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.531+0000 7fc7777fe700 1 -- 172.21.15.142:0/1197758938 learned_addr learned my addr 172.21.15.142:0/1197758938 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 -- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 msgr2=0x55862f68bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f68bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 -- 172.21.15.142:0/1197758938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 msgr2=0x55862f68b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:54.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f68b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 -- 172.21.15.142:0/1197758938 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c017070 con 0x55862f67c610 2023-09-21T12:58:54.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc776ffd700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f68b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:54.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc7777fe700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc768005b40 tx=0x7fc76801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c0e661a7a71a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc756ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7680cc040 con 0x55862f67c610 2023-09-21T12:58:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc77000f040 con 0x55862f67c610 2023-09-21T12:58:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc76809aff0 con 0x55862f67c610 2023-09-21T12:58:54.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc76809a8f0 con 0x55862f67c610 2023-09-21T12:58:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc791a66b80 10 client.26188 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.532+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55862f3f72b0 con 0x55862f67c610 2023-09-21T12:58:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc77000f040 con 0x55862f67c610 2023-09-21T12:58:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc768099de0 con 0x55862f67c610 2023-09-21T12:58:54.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 10 client.26188 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 10 client.26188 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 20 client.26188 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6eb360 0x55862f6ed780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 4 client.26188 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55862f5c6e60 con 0x55862f6eb360 2023-09-21T12:58:54.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc776ffd700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6eb360 0x55862f6ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc756ffd700 10 client.26188 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.533+0000 7fc776ffd700 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6eb360 0x55862f6ed780 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb7a6e2d17f3669 server_cookie=2f013b3137a5e2ad in_seq=0 out_seq=0 2023-09-21T12:58:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc756ffd700 1 -- 172.21.15.142:0/1197758938 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55862f5c6e60 con 0x55862f6eb360 2023-09-21T12:58:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc756ffd700 10 client.26188 handle_command_reply: tid=0 2023-09-21T12:58:54.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 client.26188 shutdown 2023-09-21T12:58:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 msgr2=0x55862f68d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc768005b40 tx=0x7fc76801a040 comp rx=0 tx=0).stop 2023-09-21T12:58:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 shutdown_connections 2023-09-21T12:58:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55862f6eb360 0x55862f6ed780 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55862f681360 0x55862f68bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc756ffd700 0 client.26188 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55862f67c610 0x55862f68d3a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 --2- 172.21.15.142:0/1197758938 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55862f67cf30 0x55862f68b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 >> 172.21.15.142:0/1197758938 conn(0x55862f5a9000 msgr2=0x55862f6803b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 shutdown_connections 2023-09-21T12:58:54.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 1 -- 172.21.15.142:0/1197758938 wait complete. 2023-09-21T12:58:54.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.534+0000 7fc791a66b80 20 client.26188 trim_cache size 0 max 16384 2023-09-21T12:58:54.549 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:58:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 msgr2=0x7fc7600a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 0x7fc7600a2c70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc77819a750 tx=0x7fc76c009260 comp rx=0 tx=0).stop 2023-09-21T12:58:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 msgr2=0x7fc778199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:54.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc768005910 tx=0x7fc768005740 comp rx=0 tx=0).stop 2023-09-21T12:58:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 shutdown_connections 2023-09-21T12:58:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7600a07b0 0x7fc7600a2c70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7781031f0 0x7fc778199140 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc77819dae0 0x7fc77819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 --2- 172.21.15.142:0/761104704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc778108310 0x7fc778199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:54.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 >> 172.21.15.142:0/761104704 conn(0x7fc7780fea30 msgr2=0x7fc7780ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:54.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 shutdown_connections 2023-09-21T12:58:54.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:54.535+0000 7fc77e1ff700 1 -- 172.21.15.142:0/761104704 wait complete. 2023-09-21T12:58:54.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 205065 11.81 MB/sec warmup 95 sec latency 14.914 ms 2023-09-21T12:58:55.554 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:58:55.554 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:58:55.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 206642 11.78 MB/sec warmup 96 sec latency 11.239 ms 2023-09-21T12:58:55.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.785+0000 7fc7e1fff700 1 -- 172.21.15.142:0/4262222271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc1060e0 msgr2=0x7fc7dc10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/4262222271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc10dc60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009f90 tx=0x7fc7d400b330 comp rx=0 tx=0).stop 2023-09-21T12:58:55.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 -- 172.21.15.142:0/4262222271 shutdown_connections 2023-09-21T12:58:55.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/4262222271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc10dc60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/4262222271 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/4262222271 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc101970 0x7fc7dc1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 -- 172.21.15.142:0/4262222271 >> 172.21.15.142:0/4262222271 conn(0x7fc7dc0fc840 msgr2=0x7fc7dc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 -- 172.21.15.142:0/4262222271 shutdown_connections 2023-09-21T12:58:55.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.786+0000 7fc7e1fff700 1 -- 172.21.15.142:0/4262222271 wait complete. 2023-09-21T12:58:55.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 Processor -- start 2023-09-21T12:58:55.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 -- start start 2023-09-21T12:58:55.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc1997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19e6a0 con 0x7fc7dc1060e0 2023-09-21T12:58:55.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19e810 con 0x7fc7dc100fc0 2023-09-21T12:58:55.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7e1fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7dc19e9d0 con 0x7fc7dc19dc20 2023-09-21T12:58:55.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7db7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.787+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53510/0 (socket says 172.21.15.142:53510) 2023-09-21T12:58:55.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 -- 172.21.15.142:0/169619567 learned_addr learned my addr 172.21.15.142:0/169619567 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:55.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7db7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58824/0 (socket says 172.21.15.142:58824) 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7daffd700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc1997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 -- 172.21.15.142:0/169619567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 msgr2=0x7fc7dc199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 -- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 msgr2=0x7fc7dc1997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc1997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 -- 172.21.15.142:0/169619567 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00095f0 con 0x7fc7dc19dc20 2023-09-21T12:58:55.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7daffd700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:55.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009f60 tx=0x7fc7d4004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7d8ff9700 1 -- 172.21.15.142:0/169619567 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d400e040 con 0x7fc7dc19dc20 2023-09-21T12:58:55.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7d8ff9700 1 -- 172.21.15.142:0/169619567 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d4008e80 con 0x7fc7dc19dc20 2023-09-21T12:58:55.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7d8ff9700 1 -- 172.21.15.142:0/169619567 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40052a0 con 0x7fc7dc19dc20 2023-09-21T12:58:55.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.788+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d4009c40 con 0x7fc7dc19dc20 2023-09-21T12:58:55.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.789+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7dc1a6170 con 0x7fc7dc19dc20 2023-09-21T12:58:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.792+0000 7fc7d8ff9700 1 -- 172.21.15.142:0/169619567 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc7d401d470 con 0x7fc7dc19dc20 2023-09-21T12:58:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7d8ff9700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 0x7fc7c40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7f5881b80 1 Processor -- start 2023-09-21T12:58:55.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7d8ff9700 1 -- 172.21.15.142:0/169619567 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc7d40cd640 con 0x7fc7dc19dc20 2023-09-21T12:58:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 0x7fc7c40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7f5881b80 1 -- start start 2023-09-21T12:58:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03434ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.794+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e0343513e0 0x55e034351840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0342c0d20 con 0x55e0343513e0 2023-09-21T12:58:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0342a4cf0 con 0x55e03434cfb0 2023-09-21T12:58:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0342a2610 con 0x55e03434c690 2023-09-21T12:58:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58840/0 (socket says 172.21.15.142:58840) 2023-09-21T12:58:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 -- 172.21.15.142:0/2039618093 learned_addr learned my addr 172.21.15.142:0/2039618093 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e0343513e0 0x55e034351840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03434ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 0x7fc7c40a2c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009c60 tx=0x7fc7cc009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 -- 172.21.15.142:0/2039618093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 msgr2=0x55e03434ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03434ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 -- 172.21.15.142:0/2039618093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e0343513e0 msgr2=0x55e034351840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e0343513e0 0x55e034351840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 -- 172.21.15.142:0/2039618093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0340c8e60 con 0x55e03434cfb0 2023-09-21T12:58:55.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03434ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.795+0000 7fc7daffd700 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009f20 tx=0x7fc7d00116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3af8c51058c1280f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.796+0000 7fc7c1ffb700 1 -- 172.21.15.142:0/2039618093 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d0011ee0 con 0x55e03434cfb0 2023-09-21T12:58:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.796+0000 7fc7c1ffb700 1 -- 172.21.15.142:0/2039618093 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0004cf0 con 0x55e03434cfb0 2023-09-21T12:58:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.796+0000 7fc7c1ffb700 1 -- 172.21.15.142:0/2039618093 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00126b0 con 0x55e03434cfb0 2023-09-21T12:58:55.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.796+0000 7fc7f5881b80 1 -- 172.21.15.142:0/2039618093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 msgr2=0x55e034350ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.796+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009f20 tx=0x7fc7d00116c0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 -- 172.21.15.142:0/2039618093 shutdown_connections 2023-09-21T12:58:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e0343513e0 0x55e034351840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03434ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/2039618093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e03434cfb0 0x55e034350ea0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 -- 172.21.15.142:0/2039618093 >> 172.21.15.142:0/2039618093 conn(0x55e034279080 msgr2=0x55e034347720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 -- 172.21.15.142:0/2039618093 shutdown_connections 2023-09-21T12:58:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 -- 172.21.15.142:0/2039618093 wait complete. 2023-09-21T12:58:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 -- start start 2023-09-21T12:58:55.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.797+0000 7fc7f5881b80 1 Processor -- start 2023-09-21T12:58:55.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434c690 0x55e034358bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 0x55e034355ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e03429df00 con 0x55e03434c690 2023-09-21T12:58:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e03423a7c0 con 0x55e0343513e0 2023-09-21T12:58:55.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e03423a460 con 0x55e03434cfb0 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7f5881b80 10 client.0 _ll_register_callbacks cb 0x55e034184b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7daffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 0x55e034355ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7daffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 0x55e034355ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53538/0 (socket says 172.21.15.142:53538) 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7daffd700 1 -- 172.21.15.142:0/3827787198 learned_addr learned my addr 172.21.15.142:0/3827787198 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434c690 0x55e034358bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.809 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.798+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 -- 172.21.15.142:0/3827787198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 msgr2=0x55e034355ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 0x55e034355ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 -- 172.21.15.142:0/3827787198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434c690 msgr2=0x55e034358bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434c690 0x55e034358bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.810 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 -- 172.21.15.142:0/3827787198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7cc017070 con 0x55e0343513e0 2023-09-21T12:58:55.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343565d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40cad60 tx=0x7fc7d409a9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e9d1ad27e5ef56 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7baffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:55.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d409b250 con 0x55e0343513e0 2023-09-21T12:58:55.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e03420ec30 con 0x55e0343513e0 2023-09-21T12:58:55.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc7d409ab50 con 0x55e0343513e0 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7d409e980 con 0x55e0343513e0 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7f5881b80 10 client.26237 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.799+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fc7d0009b50 con 0x55e0343513e0 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e03420ec30 con 0x55e0343513e0 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc7d409adb0 con 0x55e0343513e0 2023-09-21T12:58:55.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 20 client.26237 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e034366380 0x55e0343687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 4 client.26237 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:55.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e03431b0a0 con 0x55e034366380 2023-09-21T12:58:55.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.800+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e034366380 0x55e0343687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.801+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e034366380 0x55e0343687a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efe1169b85c1126 server_cookie=e01324fc91799e78 in_seq=0 out_seq=0 2023-09-21T12:58:55.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.801+0000 7fc7baffd700 10 client.26237 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:55.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.801+0000 7fc7baffd700 1 -- 172.21.15.142:0/3827787198 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e03431b0a0 con 0x55e034366380 2023-09-21T12:58:55.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.801+0000 7fc7baffd700 10 client.26237 handle_command_reply: tid=0 2023-09-21T12:58:55.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.801+0000 7fc7f5881b80 1 client.26237 shutdown 2023-09-21T12:58:55.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 msgr2=0x55e0343565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343565d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40cad60 tx=0x7fc7d409a9a0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 shutdown_connections 2023-09-21T12:58:55.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e034366380 0x55e0343687a0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434c690 0x55e034358bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343565d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7baffd700 0 client.26237 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:55.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3827787198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434cfb0 0x55e034355ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 >> 172.21.15.142:0/3827787198 conn(0x55e034279080 msgr2=0x55e034347310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 shutdown_connections 2023-09-21T12:58:55.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3827787198 wait complete. 2023-09-21T12:58:55.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.802+0000 7fc7f5881b80 20 client.26237 trim_cache size 0 max 16384 2023-09-21T12:58:55.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 Processor -- start 2023-09-21T12:58:55.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 -- start start 2023-09-21T12:58:55.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e034350c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e0343556e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e03411e9a0 con 0x55e03434cfb0 2023-09-21T12:58:55.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e034348ce0 con 0x55e0343513e0 2023-09-21T12:58:55.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e034368e00 con 0x55e03434c690 2023-09-21T12:58:55.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7db7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e034350c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7daffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e0343556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58858/0 (socket says 172.21.15.142:58858) 2023-09-21T12:58:55.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.821+0000 7fc7dbfff700 1 -- 172.21.15.142:0/3757186265 learned_addr learned my addr 172.21.15.142:0/3757186265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:55.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3757186265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 msgr2=0x55e034355c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3757186265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 msgr2=0x55e0343556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e0343556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3757186265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0340b1ce0 con 0x55e03434c690 2023-09-21T12:58:55.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:55.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7daffd700 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e0343556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:55.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e034350c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4012000 tx=0x7fc7cc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ad628aa98c13d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7c27fc700 1 -- 172.21.15.142:0/3757186265 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc022030 con 0x55e03434c690 2023-09-21T12:58:55.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7c27fc700 1 -- 172.21.15.142:0/3757186265 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7cc023040 con 0x55e03434c690 2023-09-21T12:58:55.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.822+0000 7fc7c27fc700 1 -- 172.21.15.142:0/3757186265 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc004830 con 0x55e03434c690 2023-09-21T12:58:55.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3757186265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 msgr2=0x55e034350c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e034350c00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4012000 tx=0x7fc7cc014000 comp rx=0 tx=0).stop 2023-09-21T12:58:55.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3757186265 shutdown_connections 2023-09-21T12:58:55.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e034355c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e034350c00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3757186265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e0343556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3757186265 >> 172.21.15.142:0/3757186265 conn(0x55e034279080 msgr2=0x55e0343504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3757186265 shutdown_connections 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.823+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3757186265 wait complete. 2023-09-21T12:58:55.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.824+0000 7fc7f5881b80 1 -- start start 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.824+0000 7fc7f5881b80 1 Processor -- start 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e03435c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0343b4690 con 0x55e03434cfb0 2023-09-21T12:58:55.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0343b47d0 con 0x55e0343513e0 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0343b4990 con 0x55e03434c690 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7f5881b80 10 client.0 _ll_register_callbacks cb 0x7fc7d4096e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53558/0 (socket says 172.21.15.142:53558) 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3819184906 learned_addr learned my addr 172.21.15.142:0/3819184906 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:55.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7daffd700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e03435c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 msgr2=0x55e0343b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3819184906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 msgr2=0x55e03435c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:55.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e03435c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 -- 172.21.15.142:0/3819184906 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d001e040 con 0x55e03434c690 2023-09-21T12:58:55.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7daffd700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e03435c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:55.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:55.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7db7fe700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0042b0 tx=0x7fc7cc02b430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aadc3b711616be1d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:55.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.825+0000 7fc7baffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:55.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc022040 con 0x55e03434c690 2023-09-21T12:58:55.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7d0004cf0 con 0x55e03434c690 2023-09-21T12:58:55.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc7cc003f30 con 0x55e03434c690 2023-09-21T12:58:55.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7cc005050 con 0x55e03434c690 2023-09-21T12:58:55.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 10 client.26206 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fc7d0009b50 con 0x55e03434c690 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0004cf0 con 0x55e03434c690 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fc7cc033410 con 0x55e03434c690 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 10 client.26206 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 10 client.26206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:55.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 20 client.26206 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:55.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e0343bc1f0 0x55e0343be610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:55.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 4 client.26206 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:58:55.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.826+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e034296ee0 con 0x55e0343bc1f0 2023-09-21T12:58:55.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.827+0000 7fc7daffd700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e0343bc1f0 0x55e0343be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:55.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.827+0000 7fc7daffd700 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e0343bc1f0 0x55e0343be610 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cfde2516c33d182 server_cookie=cdf06d3a8f67e624 in_seq=0 out_seq=0 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.827+0000 7fc7baffd700 10 client.26206 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.828+0000 7fc7baffd700 1 -- 172.21.15.142:0/3819184906 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e034296ee0 con 0x55e0343bc1f0 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.828+0000 7fc7baffd700 10 client.26206 handle_command_reply: tid=0 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.828+0000 7fc7f5881b80 1 client.26206 shutdown 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 msgr2=0x55e03435c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc0042b0 tx=0x7fc7cc02b430 comp rx=0 tx=0).stop 2023-09-21T12:58:55.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 shutdown_connections 2023-09-21T12:58:55.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e0343bc1f0 0x55e0343be610 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e0343513e0 0x55e0343b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e03434c690 0x55e03435c410 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7baffd700 0 client.26206 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:55.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 --2- 172.21.15.142:0/3819184906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e03434cfb0 0x55e03435c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 >> 172.21.15.142:0/3819184906 conn(0x55e034279080 msgr2=0x55e03434b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 shutdown_connections 2023-09-21T12:58:55.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 1 -- 172.21.15.142:0/3819184906 wait complete. 2023-09-21T12:58:55.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.829+0000 7fc7f5881b80 20 client.26206 trim_cache size 0 max 16384 2023-09-21T12:58:55.842 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:55.842 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:58:55.842 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "d2167ad9-93cf-40b4-b2b3-df7d4bb2cac3", 2023-09-21T12:58:55.842 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:58:55.843 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:55.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 msgr2=0x7fc7c40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 0x7fc7c40a2c70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009c60 tx=0x7fc7cc009260 comp rx=0 tx=0).stop 2023-09-21T12:58:55.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 msgr2=0x7fc7dc19e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:55.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009f60 tx=0x7fc7d4004c80 comp rx=0 tx=0).stop 2023-09-21T12:58:55.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 shutdown_connections 2023-09-21T12:58:55.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7c40a07b0 0x7fc7c40a2c70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7dc19dc20 0x7fc7dc19e0a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7dc100fc0 0x7fc7dc199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 --2- 172.21.15.142:0/169619567 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7dc1060e0 0x7fc7dc1997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 >> 172.21.15.142:0/169619567 conn(0x7fc7dc0fc840 msgr2=0x7fc7dc102980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 shutdown_connections 2023-09-21T12:58:55.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:55.830+0000 7fc7e1fff700 1 -- 172.21.15.142:0/169619567 wait complete. 2023-09-21T12:58:55.851 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:58:55.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:55 smithi142 ceph-mon[97663]: pgmap v83: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:56.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 -- 172.21.15.142:0/52961596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c100fc0 msgr2=0x7f073c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 --2- 172.21.15.142:0/52961596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c100fc0 0x7f073c1013a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f072c009990 tx=0x7f072c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 -- 172.21.15.142:0/52961596 shutdown_connections 2023-09-21T12:58:56.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 --2- 172.21.15.142:0/52961596 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c1060e0 0x7f073c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 --2- 172.21.15.142:0/52961596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c100fc0 0x7f073c1013a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 --2- 172.21.15.142:0/52961596 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c101970 0x7f073c1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 -- 172.21.15.142:0/52961596 >> 172.21.15.142:0/52961596 conn(0x7f073c0fc840 msgr2=0x7f073c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 -- 172.21.15.142:0/52961596 shutdown_connections 2023-09-21T12:58:56.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.071+0000 7f07427ff700 1 -- 172.21.15.142:0/52961596 wait complete. 2023-09-21T12:58:56.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.072+0000 7f07427ff700 1 Processor -- start 2023-09-21T12:58:56.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 -- start start 2023-09-21T12:58:56.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 0x7f073c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c19e540 con 0x7f073c19dac0 2023-09-21T12:58:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c19e6b0 con 0x7f073c100fc0 2023-09-21T12:58:56.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f07427ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c19e870 con 0x7f073c1060e0 2023-09-21T12:58:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f073bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 0x7f073c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60604/0 (socket says 172.21.15.142:60604) 2023-09-21T12:58:56.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f0740d9c700 1 -- 172.21.15.142:0/1570064100 learned_addr learned my addr 172.21.15.142:0/1570064100 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:56.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.073+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53584/0 (socket says 172.21.15.142:53584) 2023-09-21T12:58:56.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 -- 172.21.15.142:0/1570064100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 msgr2=0x7f073c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 -- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 msgr2=0x7f073c19df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 -- 172.21.15.142:0/1570064100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072c0095f0 con 0x7f073c100fc0 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073b7fe700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f0740d9c700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.074+0000 7f073bfff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 0x7f073c199120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072c000c00 tx=0x7f072c005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.075+0000 7f07397fa700 1 -- 172.21.15.142:0/1570064100 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c01d070 con 0x7f073c100fc0 2023-09-21T12:58:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.075+0000 7f07397fa700 1 -- 172.21.15.142:0/1570064100 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f072c021410 con 0x7f073c100fc0 2023-09-21T12:58:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.075+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c1a5d70 con 0x7f073c100fc0 2023-09-21T12:58:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.075+0000 7f07397fa700 1 -- 172.21.15.142:0/1570064100 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072c017650 con 0x7f073c100fc0 2023-09-21T12:58:56.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.075+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c1a61a0 con 0x7f073c100fc0 2023-09-21T12:58:56.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.080+0000 7f07397fa700 1 -- 172.21.15.142:0/1570064100 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f072c021580 con 0x7f073c100fc0 2023-09-21T12:58:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.081+0000 7f0756117b80 1 Processor -- start 2023-09-21T12:58:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.081+0000 7f0756117b80 1 -- start start 2023-09-21T12:58:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741eaf30 0x55ca741eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca7415eca0 con 0x55ca741ef360 2023-09-21T12:58:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca74142c70 con 0x55ca741ea610 2023-09-21T12:58:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0756117b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca74140590 con 0x55ca741eaf30 2023-09-21T12:58:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f073bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741eaf30 0x55ca741eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58888/0 (socket says 172.21.15.142:58888) 2023-09-21T12:58:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 -- 172.21.15.142:0/3251797361 learned_addr learned my addr 172.21.15.142:0/3251797361 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 -- 172.21.15.142:0/3251797361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741eaf30 msgr2=0x55ca741eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741eaf30 0x55ca741eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 -- 172.21.15.142:0/3251797361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 msgr2=0x55ca741ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.082+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f0740d9c700 1 -- 172.21.15.142:0/3251797361 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca73f66de0 con 0x55ca741ea610 2023-09-21T12:58:56.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f07397fa700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 0x7f07240a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0734009500 tx=0x7f0734009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1da618b69244c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f07397fa700 1 -- 172.21.15.142:0/1570064100 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f072c0cd2a0 con 0x7f073c100fc0 2023-09-21T12:58:56.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f07227fc700 1 -- 172.21.15.142:0/3251797361 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400e900 con 0x55ca741ea610 2023-09-21T12:58:56.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f07227fc700 1 -- 172.21.15.142:0/3251797361 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f073400f040 con 0x55ca741ea610 2023-09-21T12:58:56.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f07227fc700 1 -- 172.21.15.142:0/3251797361 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734017d20 con 0x55ca741ea610 2023-09-21T12:58:56.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.083+0000 7f073bfff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 0x7f07240a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 -- 172.21.15.142:0/3251797361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 msgr2=0x55ca741ea9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f073bfff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 0x7f07240a2cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f072c09a4b0 tx=0x7f072c0d0d10 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0734009500 tx=0x7f0734009920 comp rx=0 tx=0).stop 2023-09-21T12:58:56.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 -- 172.21.15.142:0/3251797361 shutdown_connections 2023-09-21T12:58:56.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ea610 0x55ca741ea9f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 --2- 172.21.15.142:0/3251797361 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741eaf30 0x55ca741eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 -- 172.21.15.142:0/3251797361 >> 172.21.15.142:0/3251797361 conn(0x55ca74117000 msgr2=0x55ca741e56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.084+0000 7f0756117b80 1 -- 172.21.15.142:0/3251797361 shutdown_connections 2023-09-21T12:58:56.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.085+0000 7f0756117b80 1 -- 172.21.15.142:0/3251797361 wait complete. 2023-09-21T12:58:56.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.085+0000 7f0756117b80 1 -- start start 2023-09-21T12:58:56.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.085+0000 7f0756117b80 1 Processor -- start 2023-09-21T12:58:56.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741f4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca7413be80 con 0x55ca741ef360 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca740d8740 con 0x55ca741eaf30 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca740d83e0 con 0x55ca741ea610 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.086+0000 7f0756117b80 10 client.0 _ll_register_callbacks cb 0x55ca74022a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58890/0 (socket says 172.21.15.142:58890) 2023-09-21T12:58:56.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 -- 172.21.15.142:0/98463489 learned_addr learned my addr 172.21.15.142:0/98463489 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:56.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f0740d9c700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f0740d9c700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 -- 172.21.15.142:0/98463489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 msgr2=0x55ca741f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 -- 172.21.15.142:0/98463489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 msgr2=0x55ca741f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 -- 172.21.15.142:0/98463489 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07340091e0 con 0x55ca741eaf30 2023-09-21T12:58:56.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f073b7fe700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0730010650 tx=0x7f0730010a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edc2ee00fa27154f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.087+0000 7f071b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:58:56.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0730004520 con 0x55ca741eaf30 2023-09-21T12:58:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca740acbb0 con 0x55ca741eaf30 2023-09-21T12:58:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0730003680 con 0x55ca741eaf30 2023-09-21T12:58:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0730003840 con 0x55ca741eaf30 2023-09-21T12:58:56.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f0756117b80 10 client.26255 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ca73f4fc60 con 0x55ca741eaf30 2023-09-21T12:58:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.088+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ca740acbb0 con 0x55ca741eaf30 2023-09-21T12:58:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f073001ab50 con 0x55ca741eaf30 2023-09-21T12:58:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 10 client.26255 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:56.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 10 client.26255 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:56.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 20 client.26255 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:56.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca74204610 0x55ca74206a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 4 client.26255 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:56.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca741b9020 con 0x55ca74204610 2023-09-21T12:58:56.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0740d9c700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca74204610 0x55ca74206a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f0740d9c700 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca74204610 0x55ca74206a30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=197bc13331a38f2e server_cookie=670f160f02a7bf4b in_seq=0 out_seq=0 2023-09-21T12:58:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.089+0000 7f071b7fe700 10 client.26255 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.090+0000 7f071b7fe700 1 -- 172.21.15.142:0/98463489 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ca741b9020 con 0x55ca74204610 2023-09-21T12:58:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.090+0000 7f071b7fe700 10 client.26255 handle_command_reply: tid=0 2023-09-21T12:58:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.090+0000 7f0756117b80 1 client.26255 shutdown 2023-09-21T12:58:56.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.090+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 msgr2=0x55ca741f3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.090+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0730010650 tx=0x7f0730010a10 comp rx=0 tx=0).stop 2023-09-21T12:58:56.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 shutdown_connections 2023-09-21T12:58:56.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca74204610 0x55ca74206a30 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741ef360 0x55ca741f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 --2- 172.21.15.142:0/98463489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741eaf30 0x55ca741f3dc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f071b7fe700 0 client.26255 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 >> 172.21.15.142:0/98463489 conn(0x55ca74117000 msgr2=0x55ca741e5290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 shutdown_connections 2023-09-21T12:58:56.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 1 -- 172.21.15.142:0/98463489 wait complete. 2023-09-21T12:58:56.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.091+0000 7f0756117b80 20 client.26255 trim_cache size 0 max 16384 2023-09-21T12:58:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 Processor -- start 2023-09-21T12:58:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 -- start start 2023-09-21T12:58:56.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca73fbc920 con 0x55ca741eaf30 2023-09-21T12:58:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca741e6490 con 0x55ca741ef360 2023-09-21T12:58:56.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.113+0000 7f0756117b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca741e6ce0 con 0x55ca741ea610 2023-09-21T12:58:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58902/0 (socket says 172.21.15.142:58902) 2023-09-21T12:58:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60624/0 (socket says 172.21.15.142:60624) 2023-09-21T12:58:56.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f073b7fe700 1 -- 172.21.15.142:0/3761999654 learned_addr learned my addr 172.21.15.142:0/3761999654 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 -- 172.21.15.142:0/3761999654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 msgr2=0x55ca741f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 -- 172.21.15.142:0/3761999654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 msgr2=0x55ca741f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 -- 172.21.15.142:0/3761999654 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca73f8d250 con 0x55ca741ef360 2023-09-21T12:58:56.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0740d9c700 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0734009fd0 tx=0x7f0734009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46f7676b1d9e9ac server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0722ffd700 1 -- 172.21.15.142:0/3761999654 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073402b3e0 con 0x55ca741ef360 2023-09-21T12:58:56.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0722ffd700 1 -- 172.21.15.142:0/3761999654 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f073402b540 con 0x55ca741ef360 2023-09-21T12:58:56.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.114+0000 7f0722ffd700 1 -- 172.21.15.142:0/3761999654 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400e700 con 0x55ca741ef360 2023-09-21T12:58:56.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 -- 172.21.15.142:0/3761999654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 msgr2=0x55ca741f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0734009fd0 tx=0x7f0734009e90 comp rx=0 tx=0).stop 2023-09-21T12:58:56.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 -- 172.21.15.142:0/3761999654 shutdown_connections 2023-09-21T12:58:56.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f1750 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 --2- 172.21.15.142:0/3761999654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 -- 172.21.15.142:0/3761999654 >> 172.21.15.142:0/3761999654 conn(0x55ca74117000 msgr2=0x55ca741ed430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 -- 172.21.15.142:0/3761999654 shutdown_connections 2023-09-21T12:58:56.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.115+0000 7f0756117b80 1 -- 172.21.15.142:0/3761999654 wait complete. 2023-09-21T12:58:56.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.116+0000 7f0756117b80 1 -- start start 2023-09-21T12:58:56.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.116+0000 7f0756117b80 1 Processor -- start 2023-09-21T12:58:56.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.116+0000 7f0756117b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca741fa200 con 0x55ca741eaf30 2023-09-21T12:58:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca741fa340 con 0x55ca741ef360 2023-09-21T12:58:56.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca741fa500 con 0x55ca741ea610 2023-09-21T12:58:56.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0756117b80 10 client.0 _ll_register_callbacks cb 0x55ca74022a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:56.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f073b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53632/0 (socket says 172.21.15.142:53632) 2023-09-21T12:58:56.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 -- 172.21.15.142:0/2939982999 learned_addr learned my addr 172.21.15.142:0/2939982999 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 -- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 msgr2=0x55ca741f9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 -- 172.21.15.142:0/2939982999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 msgr2=0x55ca741f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:56.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.117+0000 7f0740d9c700 1 -- 172.21.15.142:0/2939982999 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca73f66de0 con 0x55ca741ea610 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0740d9c700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0734009020 tx=0x7f07340177b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e7f2835e25b888 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734017980 con 0x55ca741ea610 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f073400f040 con 0x55ca741ea610 2023-09-21T12:58:56.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0734017ae0 con 0x55ca741ea610 2023-09-21T12:58:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f073402b830 con 0x55ca741ea610 2023-09-21T12:58:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 10 client.26224 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ca73f652b0 con 0x55ca741ea610 2023-09-21T12:58:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f073400f040 con 0x55ca741ea610 2023-09-21T12:58:56.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0734035040 con 0x55ca741ea610 2023-09-21T12:58:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 10 client.26224 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 10 client.26224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 20 client.26224 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca742594e0 0x55ca7425b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:56.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 4 client.26224 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:58:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.118+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca74134e60 con 0x55ca742594e0 2023-09-21T12:58:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.119+0000 7f073b7fe700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca742594e0 0x55ca7425b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.119+0000 7f073b7fe700 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca742594e0 0x55ca7425b900 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f74ec7e64d148bf1 server_cookie=22ff2a1eb0506f83 in_seq=0 out_seq=0 2023-09-21T12:58:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.119+0000 7f071b7fe700 10 client.26224 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:56.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f071b7fe700 1 -- 172.21.15.142:0/2939982999 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ca74134e60 con 0x55ca742594e0 2023-09-21T12:58:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f071b7fe700 10 client.26224 handle_command_reply: tid=0 2023-09-21T12:58:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 client.26224 shutdown 2023-09-21T12:58:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 msgr2=0x55ca741fb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0734009020 tx=0x7f07340177b0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 shutdown_connections 2023-09-21T12:58:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ca742594e0 0x55ca7425b900 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ca741ef360 0x55ca741f9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ca741ea610 0x55ca741fb430 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 --2- 172.21.15.142:0/2939982999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ca741eaf30 0x55ca741f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f071b7fe700 0 client.26224 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 >> 172.21.15.142:0/2939982999 conn(0x55ca74117000 msgr2=0x55ca741f1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 shutdown_connections 2023-09-21T12:58:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 1 -- 172.21.15.142:0/2939982999 wait complete. 2023-09-21T12:58:56.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.120+0000 7f0756117b80 20 client.26224 trim_cache size 0 max 16384 2023-09-21T12:58:56.134 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:58:56.134 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:58:56.134 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:58:56.134 INFO:teuthology.orchestra.run.smithi142.stdout: "d2167ad9-93cf-40b4-b2b3-df7d4bb2cac3": { 2023-09-21T12:58:56.134 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:58:56.135 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "d2167ad9-93cf-40b4-b2b3-df7d4bb2cac3", 2023-09-21T12:58:56.135 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:58:56.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:58:56.135 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:58:56.135 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:58:56.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 msgr2=0x7f07240a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 0x7f07240a2cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f072c09a4b0 tx=0x7f072c0d0d10 comp rx=0 tx=0).stop 2023-09-21T12:58:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 msgr2=0x7f073c199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 0x7f073c199120 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f072c000c00 tx=0x7f072c005740 comp rx=0 tx=0).stop 2023-09-21T12:58:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 shutdown_connections 2023-09-21T12:58:56.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f07240a0830 0x7f07240a2cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f073c19dac0 0x7f073c19df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f073c100fc0 0x7f073c199120 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 --2- 172.21.15.142:0/1570064100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f073c1060e0 0x7f073c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:56.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 >> 172.21.15.142:0/1570064100 conn(0x7f073c0fc840 msgr2=0x7f073c10cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:56.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 shutdown_connections 2023-09-21T12:58:56.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:58:56.121+0000 7f07427ff700 1 -- 172.21.15.142:0/1570064100 wait complete. 2023-09-21T12:58:56.141 INFO:tasks.cephfs.filesystem:scrub status for tag:d2167ad9-93cf-40b4-b2b3-df7d4bb2cac3 - {'path': '/', 'tag': 'd2167ad9-93cf-40b4-b2b3-df7d4bb2cac3', 'options': 'recursive,force'} 2023-09-21T12:58:56.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:55 smithi156 ceph-mon[134078]: pgmap v83: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:56.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:55 smithi160 ceph-mon[134450]: pgmap v83: 97 pgs: 97 active+clean; 61 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.5 MiB/s wr, 274 op/s 2023-09-21T12:58:56.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 209286 11.83 MB/sec warmup 97 sec latency 24.735 ms 2023-09-21T12:58:57.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 -- 172.21.15.142:0/555176775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a8101790 msgr2=0x7ff9a81057d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/555176775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a8101790 0x7ff9a81057d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009990 tx=0x7ff99c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 -- 172.21.15.142:0/555176775 shutdown_connections 2023-09-21T12:58:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/555176775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8100de0 0x7ff9a81011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/555176775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8105f00 0x7ff9a810da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/555176775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a8101790 0x7ff9a81057d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 -- 172.21.15.142:0/555176775 >> 172.21.15.142:0/555176775 conn(0x7ff9a80fc660 msgr2=0x7ff9a80fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.142+0000 7ff9ac99d700 1 -- 172.21.15.142:0/555176775 shutdown_connections 2023-09-21T12:58:57.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.143+0000 7ff9ac99d700 1 -- 172.21.15.142:0/555176775 wait complete. 2023-09-21T12:58:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.143+0000 7ff9ac99d700 1 Processor -- start 2023-09-21T12:58:57.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 -- start start 2023-09-21T12:58:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8105f00 0x7ff9a8197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 0x7ff9a819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819c1f0 con 0x7ff9a8105f00 2023-09-21T12:58:57.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819c360 con 0x7ff9a8100de0 2023-09-21T12:58:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9ac99d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a819c520 con 0x7ff9a819b770 2023-09-21T12:58:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58922/0 (socket says 172.21.15.142:58922) 2023-09-21T12:58:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9a77fe700 1 -- 172.21.15.142:0/3039639700 learned_addr learned my addr 172.21.15.142:0/3039639700 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:57.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 0x7ff9a819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.144+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8105f00 0x7ff9a8197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 -- 172.21.15.142:0/3039639700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 msgr2=0x7ff9a819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 0x7ff9a819bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 -- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8105f00 msgr2=0x7ff9a8197310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8105f00 0x7ff9a8197310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 -- 172.21.15.142:0/3039639700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0095f0 con 0x7ff9a8100de0 2023-09-21T12:58:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 0x7ff9a819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e9a0 tx=0x7ff99800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a4ff9700 1 -- 172.21.15.142:0/3039639700 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998009790 con 0x7ff9a8100de0 2023-09-21T12:58:57.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a4ff9700 1 -- 172.21.15.142:0/3039639700 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff998010430 con 0x7ff9a8100de0 2023-09-21T12:58:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a81a3a80 con 0x7ff9a8100de0 2023-09-21T12:58:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9a4ff9700 1 -- 172.21.15.142:0/3039639700 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998018680 con 0x7ff9a8100de0 2023-09-21T12:58:57.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.145+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a81a3fb0 con 0x7ff9a8100de0 2023-09-21T12:58:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.149+0000 7ff9a4ff9700 1 -- 172.21.15.142:0/3039639700 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff9980105a0 con 0x7ff9a8100de0 2023-09-21T12:58:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.150+0000 7ff9c145bb80 1 Processor -- start 2023-09-21T12:58:57.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.150+0000 7ff9c145bb80 1 -- start start 2023-09-21T12:58:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.150+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 0x55b901943260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.150+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 0x55b901943c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901955ec0 0x55b9019582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9018b7c40 con 0x55b901946fe0 2023-09-21T12:58:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b90189bc10 con 0x55b9019437a0 2023-09-21T12:58:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b901899530 con 0x55b901955ec0 2023-09-21T12:58:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a4ff9700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 0x7ff9900a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 0x55b901943260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 0x55b901943c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 0x55b901943260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:60658/0 (socket says 172.21.15.142:60658) 2023-09-21T12:58:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a6ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901955ec0 0x55b9019582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a7fff700 1 -- 172.21.15.142:0/843248731 learned_addr learned my addr 172.21.15.142:0/843248731 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 0x7ff9900a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a4ff9700 1 -- 172.21.15.142:0/3039639700 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff998014070 con 0x7ff9a8100de0 2023-09-21T12:58:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 -- 172.21.15.142:0/843248731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901955ec0 msgr2=0x55b9019582b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901955ec0 0x55b9019582b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 -- 172.21.15.142:0/843248731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 msgr2=0x55b901943260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 0x55b901943260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.151+0000 7ff9a77fe700 1 -- 172.21.15.142:0/843248731 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9016bfd80 con 0x55b9019437a0 2023-09-21T12:58:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.152+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 0x55b901943c20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9980c9840 tx=0x7ff99806c6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555e27dedba001a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.152+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 0x7ff9900a2cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0019430 tx=0x7ff9a0009130 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.152+0000 7ff98dffb700 1 -- 172.21.15.142:0/843248731 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980652e0 con 0x55b9019437a0 2023-09-21T12:58:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.152+0000 7ff98dffb700 1 -- 172.21.15.142:0/843248731 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff998099ca0 con 0x55b9019437a0 2023-09-21T12:58:57.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.152+0000 7ff98dffb700 1 -- 172.21.15.142:0/843248731 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980109a0 con 0x55b9019437a0 2023-09-21T12:58:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- 172.21.15.142:0/843248731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 msgr2=0x55b901943c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 0x55b901943c20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff9980c9840 tx=0x7ff99806c6c0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- 172.21.15.142:0/843248731 shutdown_connections 2023-09-21T12:58:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901946fe0 0x55b901943260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901955ec0 0x55b9019582b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/843248731 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b9019437a0 0x55b901943c20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- 172.21.15.142:0/843248731 >> 172.21.15.142:0/843248731 conn(0x55b90186ffa0 msgr2=0x55b90193e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- 172.21.15.142:0/843248731 shutdown_connections 2023-09-21T12:58:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- 172.21.15.142:0/843248731 wait complete. 2023-09-21T12:58:57.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.153+0000 7ff9c145bb80 1 -- start start 2023-09-21T12:58:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 Processor -- start 2023-09-21T12:58:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b901952b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b901953200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b901894e20 con 0x55b901955ec0 2023-09-21T12:58:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9018316e0 con 0x55b901946fe0 2023-09-21T12:58:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b901831380 con 0x55b9019437a0 2023-09-21T12:58:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.154+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9c145bb80 10 client.0 _ll_register_callbacks cb 0x55b90177ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53656/0 (socket says 172.21.15.142:53656) 2023-09-21T12:58:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 -- 172.21.15.142:0/595626085 learned_addr learned my addr 172.21.15.142:0/595626085 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b901953200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b901952b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 -- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 msgr2=0x55b901952b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b901952b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 -- 172.21.15.142:0/595626085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 msgr2=0x55b901953200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b901953200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 -- 172.21.15.142:0/595626085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a81a3fb0 con 0x55b9019437a0 2023-09-21T12:58:57.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b901953200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff998099530 tx=0x7ff9980959d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f0b7e231ae06b53 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff986ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99809d3d0 con 0x55b9019437a0 2023-09-21T12:58:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff9980995a0 con 0x55b9019437a0 2023-09-21T12:58:57.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.155+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b901805b50 con 0x55b9019437a0 2023-09-21T12:58:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff998099800 con 0x55b9019437a0 2023-09-21T12:58:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 10 client.26236 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b9016a8c00 con 0x55b9019437a0 2023-09-21T12:58:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b901805b50 con 0x55b9019437a0 2023-09-21T12:58:57.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff998098500 con 0x55b9019437a0 2023-09-21T12:58:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 10 client.26236 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 10 client.26236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 20 client.26236 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b901965480 0x55b9019678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 4 client.26236 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:58:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b901911fc0 con 0x55b901965480 2023-09-21T12:58:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.156+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b901965480 0x55b9019678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.157+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b901965480 0x55b9019678a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16436c2f6fd9ecb8 server_cookie=ed5c8eb2f9ca9e5a in_seq=0 out_seq=0 2023-09-21T12:58:57.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.157+0000 7ff986ffd700 10 client.26236 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:57.172 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:58:57.172 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.172 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:57.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:57.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:58:57.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.173 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:56 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.174 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.157+0000 7ff986ffd700 1 -- 172.21.15.142:0/595626085 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b901911fc0 con 0x55b901965480 2023-09-21T12:58:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.157+0000 7ff986ffd700 10 client.26236 handle_command_reply: tid=0 2023-09-21T12:58:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.157+0000 7ff9c145bb80 1 client.26236 shutdown 2023-09-21T12:58:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 msgr2=0x55b901955890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff998099530 tx=0x7ff9980959d0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 shutdown_connections 2023-09-21T12:58:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b901965480 0x55b9019678a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b901953200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff986ffd700 0 client.26236 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955890 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/595626085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b901952b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 >> 172.21.15.142:0/595626085 conn(0x55b90186ffa0 msgr2=0x55b90193df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 shutdown_connections 2023-09-21T12:58:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 1 -- 172.21.15.142:0/595626085 wait complete. 2023-09-21T12:58:57.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.158+0000 7ff9c145bb80 20 client.26236 trim_cache size 0 max 16384 2023-09-21T12:58:57.178 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:58:57.178 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.179 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:57.179 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:57.179 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:58:57.179 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.180 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.180 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:56 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 Processor -- start 2023-09-21T12:58:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 -- start start 2023-09-21T12:58:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b9019417b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9017158c0 con 0x55b901955ec0 2023-09-21T12:58:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b901953ae0 con 0x55b901946fe0 2023-09-21T12:58:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.174+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b901961860 con 0x55b9019437a0 2023-09-21T12:58:57.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58932/0 (socket says 172.21.15.142:58932) 2023-09-21T12:58:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2236222108 learned_addr learned my addr 172.21.15.142:0/2236222108 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:57.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b9019417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2236222108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 msgr2=0x55b901955430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2236222108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 msgr2=0x55b9019417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b9019417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2236222108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9016e61f0 con 0x55b901946fe0 2023-09-21T12:58:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b9019417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:58:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009990 tx=0x7ff99c005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ccd5660668eb897 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff98e7fc700 1 -- 172.21.15.142:0/2236222108 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c02a070 con 0x55b901946fe0 2023-09-21T12:58:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.175+0000 7ff98e7fc700 1 -- 172.21.15.142:0/2236222108 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff99c01e040 con 0x55b901946fe0 2023-09-21T12:58:57.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff98e7fc700 1 -- 172.21.15.142:0/2236222108 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c01d040 con 0x55b901946fe0 2023-09-21T12:58:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2236222108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 msgr2=0x55b9019520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009990 tx=0x7ff99c005fb0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2236222108 shutdown_connections 2023-09-21T12:58:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b901955ec0 0x55b9019417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b9019437a0 0x55b901955430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2236222108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901946fe0 0x55b9019520f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2236222108 >> 172.21.15.142:0/2236222108 conn(0x55b90186ffa0 msgr2=0x55b901961150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2236222108 shutdown_connections 2023-09-21T12:58:57.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.176+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2236222108 wait complete. 2023-09-21T12:58:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 -- start start 2023-09-21T12:58:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 Processor -- start 2023-09-21T12:58:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 0x55b90195b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901955ec0 0x55b90195bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9019b92a0 con 0x55b9019437a0 2023-09-21T12:58:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9019b93e0 con 0x55b901955ec0 2023-09-21T12:58:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.177+0000 7ff9c145bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9019b9520 con 0x55b901946fe0 2023-09-21T12:58:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9c145bb80 10 client.0 _ll_register_callbacks cb 0x55b90177ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:58:57.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53676/0 (socket says 172.21.15.142:53676) 2023-09-21T12:58:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2321250645 learned_addr learned my addr 172.21.15.142:0/2321250645 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:58:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 0x55b90195b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a7fff700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901955ec0 0x55b90195bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901955ec0 msgr2=0x55b90195bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901955ec0 0x55b90195bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2321250645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 msgr2=0x55b90195b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:58:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 0x55b90195b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a6ffd700 1 -- 172.21.15.142:0/2321250645 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a810e2f0 con 0x55b901946fe0 2023-09-21T12:58:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.178+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 0x55b90195b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:58:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff9a6ffd700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff99c000c00 tx=0x7ff99c005390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e8b87c29af1fe server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:58:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:58:57.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c02a070 con 0x55b901946fe0 2023-09-21T12:58:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff998099ca0 con 0x55b901946fe0 2023-09-21T12:58:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff99c00ba00 con 0x55b901946fe0 2023-09-21T12:58:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff99c01d040 con 0x55b901946fe0 2023-09-21T12:58:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff9c145bb80 10 client.26242 fetch_fsmap learned FSMap version 24 2023-09-21T12:58:57.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b9016be250 con 0x55b901946fe0 2023-09-21T12:58:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff998099ca0 con 0x55b901946fe0 2023-09-21T12:58:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.179+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff99c00fd20 con 0x55b901946fe0 2023-09-21T12:58:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 10 client.26242 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:58:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 10 client.26242 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:58:57.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 20 client.26242 populate_metadata read hostname 'smithi142' 2023-09-21T12:58:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b9019ba750 0x55b9019bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:58:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 4 client.26242 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:58:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b90188de00 con 0x55b9019ba750 2023-09-21T12:58:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b9019ba750 0x55b9019bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:58:57.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff9a77fe700 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b9019ba750 0x55b9019bcb70 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fb64a4652b4e43e server_cookie=8c967646a2069fa1 in_seq=0 out_seq=0 2023-09-21T12:58:57.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.180+0000 7ff986ffd700 10 client.26242 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:57.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:58:57.199 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:57.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:57.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:58:57.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.200 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.201 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:56 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:58:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.348+0000 7ff986ffd700 1 -- 172.21.15.142:0/2321250645 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b90188de00 con 0x55b9019ba750 2023-09-21T12:58:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.348+0000 7ff986ffd700 10 client.26242 handle_command_reply: tid=0 2023-09-21T12:58:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.348+0000 7ff9c145bb80 1 client.26242 shutdown 2023-09-21T12:58:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 msgr2=0x55b90195b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff99c000c00 tx=0x7ff99c005390 comp rx=0 tx=0).stop 2023-09-21T12:58:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 shutdown_connections 2023-09-21T12:58:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b9019ba750 0x55b9019bcb70 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b9019437a0 0x55b90195b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b901955ec0 0x55b90195bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 --2- 172.21.15.142:0/2321250645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b901946fe0 0x55b90195b5c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff986ffd700 0 client.26242 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:58:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 >> 172.21.15.142:0/2321250645 conn(0x55b90186ffa0 msgr2=0x55b9019417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 shutdown_connections 2023-09-21T12:58:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 1 -- 172.21.15.142:0/2321250645 wait complete. 2023-09-21T12:58:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.349+0000 7ff9c145bb80 20 client.26242 trim_cache size 0 max 16384 2023-09-21T12:58:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:58:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:58:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:58:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:58:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 msgr2=0x7ff9900a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 0x7ff9900a2cf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0019430 tx=0x7ff9a0009130 comp rx=0 tx=0).stop 2023-09-21T12:58:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 msgr2=0x7ff9a8196dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:58:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff99800e9a0 tx=0x7ff99800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 shutdown_connections 2023-09-21T12:58:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9900a0830 0x7ff9900a2cf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9a819b770 0x7ff9a819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff9a8100de0 0x7ff9a8196dd0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 --2- 172.21.15.142:0/3039639700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff9a8105f00 0x7ff9a8197310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:58:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 >> 172.21.15.142:0/3039639700 conn(0x7ff9a80fc660 msgr2=0x7ff9a80fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:58:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 shutdown_connections 2023-09-21T12:58:57.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:58:57.350+0000 7ff9ac99d700 1 -- 172.21.15.142:0/3039639700 wait complete. 2023-09-21T12:58:57.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 210324 11.75 MB/sec warmup 98 sec latency 121.344 ms 2023-09-21T12:58:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:57 smithi156 ceph-mon[134078]: pgmap v84: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2023-09-21T12:58:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:57 smithi142 ceph-mon[97663]: pgmap v84: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2023-09-21T12:58:58.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:57 smithi160 ceph-mon[134450]: pgmap v84: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 392 op/s 2023-09-21T12:58:58.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 213031 11.80 MB/sec warmup 99 sec latency 26.183 ms 2023-09-21T12:58:59.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 214460 11.73 MB/sec warmup 100 sec latency 11.354 ms 2023-09-21T12:59:00.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:58:59 smithi156 ceph-mon[134078]: pgmap v85: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-09-21T12:59:00.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:58:59 smithi142 ceph-mon[97663]: pgmap v85: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-09-21T12:59:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:58:59 smithi160 ceph-mon[134450]: pgmap v85: 97 pgs: 97 active+clean; 65 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 236 op/s 2023-09-21T12:59:00.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 216623 11.75 MB/sec warmup 101 sec latency 23.985 ms 2023-09-21T12:59:01.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 218016 11.69 MB/sec warmup 102 sec latency 10.290 ms 2023-09-21T12:59:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:01 smithi156 ceph-mon[134078]: pgmap v86: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 437 op/s 2023-09-21T12:59:02.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:01 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:01 smithi142 ceph-mon[97663]: pgmap v86: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 437 op/s 2023-09-21T12:59:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:01 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:01 smithi160 ceph-mon[134450]: pgmap v86: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 3.8 MiB/s wr, 437 op/s 2023-09-21T12:59:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:01 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:02.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 220243 11.71 MB/sec warmup 103 sec latency 73.986 ms 2023-09-21T12:59:03.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:02 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:03.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:02 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:03.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:02 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:03.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:02 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:03.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:02 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:03.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:02 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:03.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 222166 11.66 MB/sec warmup 104 sec latency 23.127 ms 2023-09-21T12:59:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:03 smithi156 ceph-mon[134078]: pgmap v87: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:04.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:03 smithi142 ceph-mon[97663]: pgmap v87: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:03 smithi160 ceph-mon[134450]: pgmap v87: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:04.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 223977 11.67 MB/sec warmup 105 sec latency 14.588 ms 2023-09-21T12:59:05.675 INFO:tasks.workunit.client.0.smithi142.stdout: 1 225915 11.63 MB/sec warmup 106 sec latency 104.969 ms 2023-09-21T12:59:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:05 smithi156 ceph-mon[134078]: pgmap v88: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:06.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:05 smithi142 ceph-mon[97663]: pgmap v88: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:06.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:05 smithi160 ceph-mon[134450]: pgmap v88: 97 pgs: 97 active+clean; 61 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 2.5 MiB/s wr, 318 op/s 2023-09-21T12:59:06.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 227649 11.63 MB/sec warmup 107 sec latency 13.795 ms 2023-09-21T12:59:07.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 229833 11.63 MB/sec warmup 108 sec latency 22.690 ms 2023-09-21T12:59:08.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:07 smithi156 ceph-mon[134078]: pgmap v89: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 439 op/s 2023-09-21T12:59:08.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:07 smithi142 ceph-mon[97663]: pgmap v89: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 439 op/s 2023-09-21T12:59:08.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:07 smithi160 ceph-mon[134450]: pgmap v89: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 439 op/s 2023-09-21T12:59:08.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 231405 11.60 MB/sec warmup 109 sec latency 17.393 ms 2023-09-21T12:59:09.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 234132 11.65 MB/sec warmup 110 sec latency 67.519 ms 2023-09-21T12:59:10.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:09 smithi156 ceph-mon[134078]: pgmap v90: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 321 op/s 2023-09-21T12:59:10.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:09 smithi142 ceph-mon[97663]: pgmap v90: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 321 op/s 2023-09-21T12:59:10.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:09 smithi160 ceph-mon[134450]: pgmap v90: 97 pgs: 97 active+clean; 68 MiB data, 848 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.8 MiB/s wr, 321 op/s 2023-09-21T12:59:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 -- 172.21.15.142:0/2654815269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948101990 msgr2=0x7f09481059d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2654815269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948101990 0x7f09481059d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f093c009990 tx=0x7f093c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 -- 172.21.15.142:0/2654815269 shutdown_connections 2023-09-21T12:59:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2654815269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0948100fe0 0x7f09481013c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2654815269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 0x7f094810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2654815269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948101990 0x7f09481059d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 -- 172.21.15.142:0/2654815269 >> 172.21.15.142:0/2654815269 conn(0x7f09480fc840 msgr2=0x7f09480fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 -- 172.21.15.142:0/2654815269 shutdown_connections 2023-09-21T12:59:10.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.515+0000 7f094d9ff700 1 -- 172.21.15.142:0/2654815269 wait complete. 2023-09-21T12:59:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.516+0000 7f094d9ff700 1 Processor -- start 2023-09-21T12:59:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.516+0000 7f094d9ff700 1 -- start start 2023-09-21T12:59:10.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 0x7f0948199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094819dc70 0x7f094819e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819e6f0 con 0x7f094819dc70 2023-09-21T12:59:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819e860 con 0x7f0948100fe0 2023-09-21T12:59:10.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f094d9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f094819ea20 con 0x7f0948106100 2023-09-21T12:59:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59902/0 (socket says 172.21.15.142:59902) 2023-09-21T12:59:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 -- 172.21.15.142:0/2376133064 learned_addr learned my addr 172.21.15.142:0/2376133064 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f09477fe700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094819dc70 0x7f094819e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f09467fc700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 0x7f0948199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 -- 172.21.15.142:0/2376133064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 msgr2=0x7f0948199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 0x7f0948199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.517+0000 7f0946ffd700 1 -- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094819dc70 msgr2=0x7f094819e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f0946ffd700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094819dc70 0x7f094819e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f0946ffd700 1 -- 172.21.15.142:0/2376133064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0095f0 con 0x7f0948100fe0 2023-09-21T12:59:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f0946ffd700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f093800e9a0 tx=0x7f093800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f094c9fd700 1 -- 172.21.15.142:0/2376133064 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938009790 con 0x7f0948100fe0 2023-09-21T12:59:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f094c9fd700 1 -- 172.21.15.142:0/2376133064 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0938010430 con 0x7f0948100fe0 2023-09-21T12:59:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09481a5f80 con 0x7f0948100fe0 2023-09-21T12:59:10.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f094c9fd700 1 -- 172.21.15.142:0/2376133064 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938018680 con 0x7f0948100fe0 2023-09-21T12:59:10.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.518+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09481a63b0 con 0x7f0948100fe0 2023-09-21T12:59:10.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.521+0000 7f094c9fd700 1 -- 172.21.15.142:0/2376133064 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f09380105a0 con 0x7f0948100fe0 2023-09-21T12:59:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 Processor -- start 2023-09-21T12:59:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 -- start start 2023-09-21T12:59:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f094c9fd700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 0x7f09300a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b50480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f094c9fd700 1 -- 172.21.15.142:0/2376133064 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f0938014070 con 0x7f0948100fe0 2023-09-21T12:59:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907ac4c40 con 0x55e907b500a0 2023-09-21T12:59:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907aa8c10 con 0x55e907b54e50 2023-09-21T12:59:10.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f096131eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907aa6530 con 0x55e907b509c0 2023-09-21T12:59:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f09467fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f09467fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35800/0 (socket says 172.21.15.142:35800) 2023-09-21T12:59:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b50480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f09477fe700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 0x7f09300a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.523+0000 7f09467fc700 1 -- 172.21.15.142:0/3569553073 learned_addr learned my addr 172.21.15.142:0/3569553073 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09477fe700 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 -- 172.21.15.142:0/3569553073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 msgr2=0x55e907b552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 -- 172.21.15.142:0/3569553073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 msgr2=0x55e907b50480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b50480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 -- 172.21.15.142:0/3569553073 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e9078ccd80 con 0x55e907b509c0 2023-09-21T12:59:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09467fc700 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f094806a380 tx=0x7f093c00b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d41258c4b0d265e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f09477fe700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 0x7f09300a2cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0940009550 tx=0x7f0940009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f092dffb700 1 -- 172.21.15.142:0/3569553073 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01d070 con 0x55e907b509c0 2023-09-21T12:59:10.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f092dffb700 1 -- 172.21.15.142:0/3569553073 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f093c01e040 con 0x55e907b509c0 2023-09-21T12:59:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.524+0000 7f092dffb700 1 -- 172.21.15.142:0/3569553073 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0047f0 con 0x55e907b509c0 2023-09-21T12:59:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 -- 172.21.15.142:0/3569553073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 msgr2=0x55e907b54910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f094806a380 tx=0x7f093c00b610 comp rx=0 tx=0).stop 2023-09-21T12:59:10.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 -- 172.21.15.142:0/3569553073 shutdown_connections 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b50480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 --2- 172.21.15.142:0/3569553073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b54910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 -- 172.21.15.142:0/3569553073 >> 172.21.15.142:0/3569553073 conn(0x55e907a7cfa0 msgr2=0x55e907b4b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 -- 172.21.15.142:0/3569553073 shutdown_connections 2023-09-21T12:59:10.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.525+0000 7f096131eb80 1 -- 172.21.15.142:0/3569553073 wait complete. 2023-09-21T12:59:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.526+0000 7f096131eb80 1 -- start start 2023-09-21T12:59:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.526+0000 7f096131eb80 1 Processor -- start 2023-09-21T12:59:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b54e50 0x55e907b59e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907aa1e20 con 0x55e907b500a0 2023-09-21T12:59:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907a3e6e0 con 0x55e907b509c0 2023-09-21T12:59:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907a3e380 con 0x55e907b54e50 2023-09-21T12:59:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f096131eb80 10 client.0 _ll_register_callbacks cb 0x55e907988a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:10.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59924/0 (socket says 172.21.15.142:59924) 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 -- 172.21.15.142:0/3183335557 learned_addr learned my addr 172.21.15.142:0/3183335557 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09477fe700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b54e50 0x55e907b59e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 -- 172.21.15.142:0/3183335557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b54e50 msgr2=0x55e907b59e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b54e50 0x55e907b59e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.527+0000 7f09467fc700 1 -- 172.21.15.142:0/3183335557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 msgr2=0x55e907b5c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f09467fc700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f09467fc700 1 -- 172.21.15.142:0/3183335557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094810e4f0 con 0x55e907b509c0 2023-09-21T12:59:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:10.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f09467fc700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b2e0 tx=0x7f093c0055e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0a2eef6cf64ef4f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f0926ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01d040 con 0x55e907b509c0 2023-09-21T12:59:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f093c00fd10 con 0x55e907b509c0 2023-09-21T12:59:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e907a12b50 con 0x55e907b509c0 2023-09-21T12:59:10.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093c005720 con 0x55e907b509c0 2023-09-21T12:59:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f096131eb80 10 client.26291 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.528+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e9078b5c00 con 0x55e907b509c0 2023-09-21T12:59:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e907a12b50 con 0x55e907b509c0 2023-09-21T12:59:10.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f093c022400 con 0x55e907b509c0 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 10 client.26291 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 10 client.26291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 20 client.26291 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907b699f0 0x55e907b6be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 4 client.26291 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:10.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e907b1efc0 con 0x55e907b699f0 2023-09-21T12:59:10.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.529+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907b699f0 0x55e907b6be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.530+0000 7f0926ffd700 10 client.26291 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.530+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907b699f0 0x55e907b6be10 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5b16dd0707ecb0b server_cookie=3c249266197d861f in_seq=0 out_seq=0 2023-09-21T12:59:10.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.530+0000 7f0926ffd700 1 -- 172.21.15.142:0/3183335557 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e907b1efc0 con 0x55e907b699f0 2023-09-21T12:59:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.530+0000 7f0926ffd700 10 client.26291 handle_command_reply: tid=0 2023-09-21T12:59:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.530+0000 7f096131eb80 1 client.26291 shutdown 2023-09-21T12:59:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 msgr2=0x55e907b59880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b2e0 tx=0x7f093c0055e0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 shutdown_connections 2023-09-21T12:59:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907b699f0 0x55e907b6be10 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b54e50 0x55e907b59e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 --2- 172.21.15.142:0/3183335557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b59880 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f0926ffd700 0 client.26291 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 >> 172.21.15.142:0/3183335557 conn(0x55e907a7cfa0 msgr2=0x55e907b4ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 shutdown_connections 2023-09-21T12:59:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 1 -- 172.21.15.142:0/3183335557 wait complete. 2023-09-21T12:59:10.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.531+0000 7f096131eb80 20 client.26291 trim_cache size 0 max 16384 2023-09-21T12:59:10.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 Processor -- start 2023-09-21T12:59:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 -- start start 2023-09-21T12:59:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b500a0 0x55e907b5c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b54e50 0x55e907b57780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9079228c0 con 0x55e907b54e50 2023-09-21T12:59:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907b1efc0 con 0x55e907b509c0 2023-09-21T12:59:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.547+0000 7f096131eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907a12b50 con 0x55e907b500a0 2023-09-21T12:59:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09477fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b54e50 0x55e907b57780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f0946ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b500a0 0x55e907b5c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59936/0 (socket says 172.21.15.142:59936) 2023-09-21T12:59:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 -- 172.21.15.142:0/2436592282 learned_addr learned my addr 172.21.15.142:0/2436592282 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 -- 172.21.15.142:0/2436592282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b500a0 msgr2=0x55e907b5c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b500a0 0x55e907b5c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 -- 172.21.15.142:0/2436592282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b54e50 msgr2=0x55e907b57780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b54e50 0x55e907b57780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 -- 172.21.15.142:0/2436592282 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e907b70a00 con 0x55e907b509c0 2023-09-21T12:59:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f09467fc700 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f093c022790 tx=0x7f093c009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9e4f8b82779bed4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f092e7fc700 1 -- 172.21.15.142:0/2436592282 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c005bc0 con 0x55e907b509c0 2023-09-21T12:59:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f092e7fc700 1 -- 172.21.15.142:0/2436592282 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f093c005980 con 0x55e907b509c0 2023-09-21T12:59:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.548+0000 7f092e7fc700 1 -- 172.21.15.142:0/2436592282 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c0346c0 con 0x55e907b509c0 2023-09-21T12:59:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 -- 172.21.15.142:0/2436592282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 msgr2=0x55e907b57240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f093c022790 tx=0x7f093c009510 comp rx=0 tx=0).stop 2023-09-21T12:59:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 -- 172.21.15.142:0/2436592282 shutdown_connections 2023-09-21T12:59:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b54e50 0x55e907b57780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b500a0 0x55e907b5c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 --2- 172.21.15.142:0/2436592282 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b509c0 0x55e907b57240 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 -- 172.21.15.142:0/2436592282 >> 172.21.15.142:0/2436592282 conn(0x55e907a7cfa0 msgr2=0x55e907b52ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 -- 172.21.15.142:0/2436592282 shutdown_connections 2023-09-21T12:59:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.549+0000 7f096131eb80 1 -- 172.21.15.142:0/2436592282 wait complete. 2023-09-21T12:59:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.550+0000 7f096131eb80 1 -- start start 2023-09-21T12:59:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.550+0000 7f096131eb80 1 Processor -- start 2023-09-21T12:59:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b5fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907bbc7e0 con 0x55e907b500a0 2023-09-21T12:59:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907bbc950 con 0x55e907b54e50 2023-09-21T12:59:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e907bbcb10 con 0x55e907b509c0 2023-09-21T12:59:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f096131eb80 10 client.0 _ll_register_callbacks cb 0x55e907988a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35834/0 (socket says 172.21.15.142:35834) 2023-09-21T12:59:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 -- 172.21.15.142:0/3741964579 learned_addr learned my addr 172.21.15.142:0/3741964579 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09477fe700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b5fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 -- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 msgr2=0x55e907b5fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b5fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 -- 172.21.15.142:0/3741964579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 msgr2=0x55e907b5ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.551+0000 7f09467fc700 1 -- 172.21.15.142:0/3741964579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e9078b5c00 con 0x55e907b509c0 2023-09-21T12:59:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f09467fc700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b6f0 tx=0x7f093c005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc5cb1456185a396 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:10.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093c01d030 con 0x55e907b509c0 2023-09-21T12:59:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f093c01e040 con 0x55e907b509c0 2023-09-21T12:59:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f093c000e40 con 0x55e907b509c0 2023-09-21T12:59:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f093c0055c0 con 0x55e907b509c0 2023-09-21T12:59:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f096131eb80 10 client.26260 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55e9078f31f0 con 0x55e907b509c0 2023-09-21T12:59:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f093c053020 con 0x55e907b509c0 2023-09-21T12:59:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.552+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f093c04fba0 con 0x55e907b509c0 2023-09-21T12:59:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 10 client.26260 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 10 client.26260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 20 client.26260 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907bbde90 0x55e907bc02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 4 client.26260 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:59:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e907a9ae00 con 0x55e907bbde90 2023-09-21T12:59:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907bbde90 0x55e907bc02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f0946ffd700 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907bbde90 0x55e907bc02b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=918d3efd5a124e9f server_cookie=32cbdf088210895c in_seq=0 out_seq=0 2023-09-21T12:59:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.553+0000 7f0926ffd700 10 client.26260 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.625+0000 7f0926ffd700 1 -- 172.21.15.142:0/3741964579 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e907a9ae00 con 0x55e907bbde90 2023-09-21T12:59:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.625+0000 7f0926ffd700 10 client.26260 handle_command_reply: tid=0 2023-09-21T12:59:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.625+0000 7f096131eb80 1 client.26260 shutdown 2023-09-21T12:59:10.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 msgr2=0x55e907b5f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b6f0 tx=0x7f093c005e80 comp rx=0 tx=0).stop 2023-09-21T12:59:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 shutdown_connections 2023-09-21T12:59:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e907bbde90 0x55e907bc02b0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e907b500a0 0x55e907b5ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e907b54e50 0x55e907b5fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f0926ffd700 0 client.26260 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 --2- 172.21.15.142:0/3741964579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e907b509c0 0x55e907b5f4d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 >> 172.21.15.142:0/3741964579 conn(0x55e907a7cfa0 msgr2=0x55e907b57240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 shutdown_connections 2023-09-21T12:59:10.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.626+0000 7f096131eb80 1 -- 172.21.15.142:0/3741964579 wait complete. 2023-09-21T12:59:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.627+0000 7f096131eb80 20 client.26260 trim_cache size 0 max 16384 2023-09-21T12:59:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:59:10.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:59:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:59:10.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:59:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 msgr2=0x7f09300a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 0x7f09300a2cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0940009550 tx=0x7f0940009920 comp rx=0 tx=0).stop 2023-09-21T12:59:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 msgr2=0x7f09481990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f093800e9a0 tx=0x7f093800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 shutdown_connections 2023-09-21T12:59:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f09300a0830 0x7f09300a2cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f094819dc70 0x7f094819e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0948100fe0 0x7f09481990c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 --2- 172.21.15.142:0/2376133064 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0948106100 0x7f0948199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:10.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 >> 172.21.15.142:0/2376133064 conn(0x7f09480fc840 msgr2=0x7f09480fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 shutdown_connections 2023-09-21T12:59:10.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:10.628+0000 7f094d9ff700 1 -- 172.21.15.142:0/2376133064 wait complete. 2023-09-21T12:59:10.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 235240 11.58 MB/sec warmup 111 sec latency 38.688 ms 2023-09-21T12:59:11.676 INFO:tasks.workunit.client.0.smithi142.stdout: 1 237929 11.62 MB/sec warmup 112 sec latency 15.314 ms 2023-09-21T12:59:12.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:11 smithi156 ceph-mon[134078]: pgmap v91: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 436 op/s 2023-09-21T12:59:12.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:11 smithi142 ceph-mon[97663]: pgmap v91: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 436 op/s 2023-09-21T12:59:12.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:11 smithi160 ceph-mon[134450]: pgmap v91: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 4.1 MiB/s wr, 436 op/s 2023-09-21T12:59:12.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 239290 11.57 MB/sec warmup 113 sec latency 24.465 ms 2023-09-21T12:59:13.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 241565 11.59 MB/sec warmup 114 sec latency 51.400 ms 2023-09-21T12:59:14.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:13 smithi156 ceph-mon[134078]: pgmap v92: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:14.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:13 smithi142 ceph-mon[97663]: pgmap v92: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:14.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:13 smithi160 ceph-mon[134450]: pgmap v92: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:14.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 243489 11.54 MB/sec warmup 115 sec latency 15.820 ms 2023-09-21T12:59:15.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 245267 11.55 MB/sec warmup 116 sec latency 14.787 ms 2023-09-21T12:59:16.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:15 smithi156 ceph-mon[134078]: pgmap v93: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:16.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:15 smithi142 ceph-mon[97663]: pgmap v93: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:16.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:15 smithi160 ceph-mon[134450]: pgmap v93: 97 pgs: 97 active+clean; 71 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 236 op/s 2023-09-21T12:59:16.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 247778 11.56 MB/sec warmup 117 sec latency 15.647 ms 2023-09-21T12:59:17.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 249388 11.54 MB/sec warmup 118 sec latency 15.208 ms 2023-09-21T12:59:18.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:17 smithi156 ceph-mon[134078]: pgmap v94: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2023-09-21T12:59:18.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:17 smithi142 ceph-mon[97663]: pgmap v94: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2023-09-21T12:59:18.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:17 smithi160 ceph-mon[134450]: pgmap v94: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.3 MiB/s wr, 404 op/s 2023-09-21T12:59:18.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 252034 11.57 MB/sec warmup 119 sec latency 41.662 ms 2023-09-21T12:59:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:19 smithi156 ceph-mon[134078]: pgmap v95: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2023-09-21T12:59:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:19 smithi142 ceph-mon[97663]: pgmap v95: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2023-09-21T12:59:20.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:19 smithi160 ceph-mon[134450]: pgmap v95: 97 pgs: 97 active+clean; 70 MiB data, 888 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 284 op/s 2023-09-21T12:59:20.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 255761 14.00 MB/sec execute 1 sec latency 22.428 ms 2023-09-21T12:59:21.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 257621 9.91 MB/sec execute 2 sec latency 13.862 ms 2023-09-21T12:59:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:21 smithi156 ceph-mon[134078]: pgmap v96: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 399 op/s 2023-09-21T12:59:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:21 smithi142 ceph-mon[97663]: pgmap v96: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 399 op/s 2023-09-21T12:59:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:21 smithi160 ceph-mon[134450]: pgmap v96: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 399 op/s 2023-09-21T12:59:22.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 259385 11.04 MB/sec execute 3 sec latency 75.658 ms 2023-09-21T12:59:23.677 INFO:tasks.workunit.client.0.smithi142.stdout: 1 261539 10.28 MB/sec execute 4 sec latency 40.500 ms 2023-09-21T12:59:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.807+0000 7f49ee7ff700 1 -- 172.21.15.142:0/4211895566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8105010 msgr2=0x7f49e810cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.807+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/4211895566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8105010 0x7f49e810cb90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009f90 tx=0x7f49e000b330 comp rx=0 tx=0).stop 2023-09-21T12:59:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 -- 172.21.15.142:0/4211895566 shutdown_connections 2023-09-21T12:59:23.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/4211895566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8100120 0x7f49e8100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/4211895566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8105010 0x7f49e810cb90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/4211895566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100ad0 0x7f49e81048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 -- 172.21.15.142:0/4211895566 >> 172.21.15.142:0/4211895566 conn(0x7f49e8076800 msgr2=0x7f49e8076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 -- 172.21.15.142:0/4211895566 shutdown_connections 2023-09-21T12:59:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.808+0000 7f49ee7ff700 1 -- 172.21.15.142:0/4211895566 wait complete. 2023-09-21T12:59:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 Processor -- start 2023-09-21T12:59:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 -- start start 2023-09-21T12:59:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100120 0x7f49e810c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8105010 0x7f49e810c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8109db0 con 0x7f49e8105010 2023-09-21T12:59:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8109f20 con 0x7f49e8109220 2023-09-21T12:59:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.810+0000 7f49ee7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e810a0e0 con 0x7f49e8100120 2023-09-21T12:59:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37834/0 (socket says 172.21.15.142:37834) 2023-09-21T12:59:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 -- 172.21.15.142:0/3378374044 learned_addr learned my addr 172.21.15.142:0/3378374044 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49e7fff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100120 0x7f49e810c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49e77fe700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8105010 0x7f49e810c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 -- 172.21.15.142:0/3378374044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100120 msgr2=0x7f49e810c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100120 0x7f49e810c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 -- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8105010 msgr2=0x7f49e810c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8105010 0x7f49e810c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.811+0000 7f49ecd9c700 1 -- 172.21.15.142:0/3378374044 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8009520 con 0x7f49e8109220 2023-09-21T12:59:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49e0004c80 tx=0x7f49e0004cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49e57fa700 1 -- 172.21.15.142:0/3378374044 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000e040 con 0x7f49e8109220 2023-09-21T12:59:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49e57fa700 1 -- 172.21.15.142:0/3378374044 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e0004e50 con 0x7f49e8109220 2023-09-21T12:59:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e0009c40 con 0x7f49e8109220 2023-09-21T12:59:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e819ffc0 con 0x7f49e8109220 2023-09-21T12:59:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.812+0000 7f49e57fa700 1 -- 172.21.15.142:0/3378374044 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e00052a0 con 0x7f49e8109220 2023-09-21T12:59:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.820+0000 7f49e57fa700 1 -- 172.21.15.142:0/3378374044 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f49e001d470 con 0x7f49e8109220 2023-09-21T12:59:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.821+0000 7f49e57fa700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 0x7f49d00a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.822+0000 7f49e57fa700 1 -- 172.21.15.142:0/3378374044 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f49e00cd4e0 con 0x7f49e8109220 2023-09-21T12:59:23.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.823+0000 7f4a02124b80 1 Processor -- start 2023-09-21T12:59:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.823+0000 7f4a02124b80 1 -- start start 2023-09-21T12:59:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.823+0000 7f49e7fff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 0x7f49d00a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 0x55dcd1028480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 0x55dcd102c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f9cc40 con 0x55dcd10289c0 2023-09-21T12:59:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f80c10 con 0x55dcd102ce50 2023-09-21T12:59:23.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f4a02124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f7e530 con 0x55dcd10280a0 2023-09-21T12:59:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55206/0 (socket says 172.21.15.142:55206) 2023-09-21T12:59:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.824+0000 7f49ecd9c700 1 -- 172.21.15.142:0/873370899 learned_addr learned my addr 172.21.15.142:0/873370899 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:23.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.825+0000 7f49e7fff700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 0x55dcd1028480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.825+0000 7f49e77fe700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 0x55dcd102c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49ecd9c700 1 -- 172.21.15.142:0/873370899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 msgr2=0x55dcd1028480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 0x55dcd1028480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49ecd9c700 1 -- 172.21.15.142:0/873370899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 msgr2=0x55dcd102c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 0x55dcd102c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49ecd9c700 1 -- 172.21.15.142:0/873370899 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcd0da4d80 con 0x55dcd102ce50 2023-09-21T12:59:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49e7fff700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 0x55dcd1028480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:59:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.828+0000 7f49e77fe700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 0x55dcd102c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:59:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.829+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49e0097460 tx=0x7f49e0018f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc97a07e9b21fd1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.829+0000 7f49e7fff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 0x7f49d00a2d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49d8011520 tx=0x7f49d80118e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.829+0000 7f49ce7fc700 1 -- 172.21.15.142:0/873370899 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e00ba0b0 con 0x55dcd102ce50 2023-09-21T12:59:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.830+0000 7f49ce7fc700 1 -- 172.21.15.142:0/873370899 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e009a350 con 0x55dcd102ce50 2023-09-21T12:59:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.830+0000 7f49ce7fc700 1 -- 172.21.15.142:0/873370899 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e009ac50 con 0x55dcd102ce50 2023-09-21T12:59:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 -- 172.21.15.142:0/873370899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 msgr2=0x55dcd102d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49e0097460 tx=0x7f49e0018f90 comp rx=0 tx=0).stop 2023-09-21T12:59:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 -- 172.21.15.142:0/873370899 shutdown_connections 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd102d2b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10280a0 0x55dcd1028480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 --2- 172.21.15.142:0/873370899 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10289c0 0x55dcd102c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 -- 172.21.15.142:0/873370899 >> 172.21.15.142:0/873370899 conn(0x55dcd0f54fa0 msgr2=0x55dcd10230c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 -- 172.21.15.142:0/873370899 shutdown_connections 2023-09-21T12:59:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.831+0000 7f4a02124b80 1 -- 172.21.15.142:0/873370899 wait complete. 2023-09-21T12:59:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.832+0000 7f4a02124b80 1 -- start start 2023-09-21T12:59:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.832+0000 7f4a02124b80 1 Processor -- start 2023-09-21T12:59:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd1034520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1031d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f79e20 con 0x55dcd10280a0 2023-09-21T12:59:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f166e0 con 0x55dcd102ce50 2023-09-21T12:59:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0f16380 con 0x55dcd10289c0 2023-09-21T12:59:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f4a02124b80 10 client.0 _ll_register_callbacks cb 0x55dcd0e60a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1031d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56034/0 (socket says 172.21.15.142:56034) 2023-09-21T12:59:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f49e77fe700 1 -- 172.21.15.142:0/1624859610 learned_addr learned my addr 172.21.15.142:0/1624859610 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.833+0000 7f49e7fff700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd1034520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 -- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 msgr2=0x55dcd1031d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1031d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 -- 172.21.15.142:0/1624859610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 msgr2=0x55dcd1034520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd1034520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 -- 172.21.15.142:0/1624859610 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e819ffc0 con 0x55dcd10289c0 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e7fff700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd1034520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1031d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49e77fe700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0106a0 tx=0x7f49dc0109b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28658cda246ef1c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc012860 con 0x55dcd10289c0 2023-09-21T12:59:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcd0eeab50 con 0x55dcd10289c0 2023-09-21T12:59:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f49dc016070 con 0x55dcd10289c0 2023-09-21T12:59:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49dc0129c0 con 0x55dcd10289c0 2023-09-21T12:59:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f4a02124b80 10 client.26269 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.834+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55dcd0d8dc00 con 0x55dcd10289c0 2023-09-21T12:59:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dcd0eeab50 con 0x55dcd10289c0 2023-09-21T12:59:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f49dc01acb0 con 0x55dcd10289c0 2023-09-21T12:59:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 10 client.26269 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 10 client.26269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 20 client.26269 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:23.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1041e80 0x55dcd10442a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 4 client.26269 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcd0ff6fc0 con 0x55dcd1041e80 2023-09-21T12:59:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.835+0000 7f49e7fff700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1041e80 0x55dcd10442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.836+0000 7f49c77fe700 10 client.26269 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:23.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.836+0000 7f49e7fff700 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1041e80 0x55dcd10442a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa6d8d56f3023329 server_cookie=6ed6bc626c7a95e9 in_seq=0 out_seq=0 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.836+0000 7f49c77fe700 1 -- 172.21.15.142:0/1624859610 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dcd0ff6fc0 con 0x55dcd1041e80 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.836+0000 7f49c77fe700 10 client.26269 handle_command_reply: tid=0 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.836+0000 7f4a02124b80 1 client.26269 shutdown 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 msgr2=0x55dcd10317a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0106a0 tx=0x7f49dc0109b0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 shutdown_connections 2023-09-21T12:59:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1041e80 0x55dcd10442a0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd1034520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1031d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 --2- 172.21.15.142:0/1624859610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd10317a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f49c77fe700 0 client.26269 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 >> 172.21.15.142:0/1624859610 conn(0x55dcd0f54fa0 msgr2=0x55dcd1022310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 shutdown_connections 2023-09-21T12:59:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 1 -- 172.21.15.142:0/1624859610 wait complete. 2023-09-21T12:59:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.837+0000 7f4a02124b80 20 client.26269 trim_cache size 0 max 16384 2023-09-21T12:59:23.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 Processor -- start 2023-09-21T12:59:23.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 -- start start 2023-09-21T12:59:23.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd102f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd0dfa8c0 con 0x55dcd10280a0 2023-09-21T12:59:23.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd1028810 con 0x55dcd102ce50 2023-09-21T12:59:23.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f4a02124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd102f780 con 0x55dcd10289c0 2023-09-21T12:59:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f49ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55216/0 (socket says 172.21.15.142:55216) 2023-09-21T12:59:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f49ecd9c700 1 -- 172.21.15.142:0/671897917 learned_addr learned my addr 172.21.15.142:0/671897917 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:23.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f49e77fe700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.854+0000 7f49e7fff700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd102f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 -- 172.21.15.142:0/671897917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 msgr2=0x55dcd1038ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 -- 172.21.15.142:0/671897917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 msgr2=0x55dcd102f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd102f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 -- 172.21.15.142:0/671897917 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcd1048ed0 con 0x55dcd102ce50 2023-09-21T12:59:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49e7fff700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd102f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49e009a4c0 tx=0x7f49e000bf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc89c0039d16adce server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ceffd700 1 -- 172.21.15.142:0/671897917 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e009e820 con 0x55dcd102ce50 2023-09-21T12:59:23.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ceffd700 1 -- 172.21.15.142:0/671897917 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e0011e50 con 0x55dcd102ce50 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.855+0000 7f49ceffd700 1 -- 172.21.15.142:0/671897917 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e009a140 con 0x55dcd102ce50 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- 172.21.15.142:0/671897917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 msgr2=0x55dcd1030f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49e009a4c0 tx=0x7f49e000bf70 comp rx=0 tx=0).stop 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- 172.21.15.142:0/671897917 shutdown_connections 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd10280a0 0x55dcd102f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd102ce50 0x55dcd1030f60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 --2- 172.21.15.142:0/671897917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- 172.21.15.142:0/671897917 >> 172.21.15.142:0/671897917 conn(0x55dcd0f54fa0 msgr2=0x55dcd102aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- 172.21.15.142:0/671897917 shutdown_connections 2023-09-21T12:59:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- 172.21.15.142:0/671897917 wait complete. 2023-09-21T12:59:23.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.856+0000 7f4a02124b80 1 -- start start 2023-09-21T12:59:23.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 Processor -- start 2023-09-21T12:59:23.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd102ce50 0x55dcd1034e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd1035550 con 0x55dcd102ce50 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd10356c0 con 0x55dcd10280a0 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcd1035880 con 0x55dcd10289c0 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f4a02124b80 10 client.0 _ll_register_callbacks cb 0x55dcd0e60a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f49e7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55232/0 (socket says 172.21.15.142:55232) 2023-09-21T12:59:23.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f49e7fff700 1 -- 172.21.15.142:0/550848444 learned_addr learned my addr 172.21.15.142:0/550848444 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f49e77fe700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.857+0000 7f49ecd9c700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd102ce50 0x55dcd1034e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 -- 172.21.15.142:0/550848444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 msgr2=0x55dcd1038da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 -- 172.21.15.142:0/550848444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd102ce50 msgr2=0x55dcd1034e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd102ce50 0x55dcd1034e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 -- 172.21.15.142:0/550848444 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcd0da4d80 con 0x55dcd10280a0 2023-09-21T12:59:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49e7fff700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55dcd1044b80 tx=0x7f49d80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94f7955840ffd96e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:23.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d8025050 con 0x55dcd10280a0 2023-09-21T12:59:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f49d800f9e0 con 0x55dcd10280a0 2023-09-21T12:59:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.858+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49e009a350 con 0x55dcd10280a0 2023-09-21T12:59:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49d8028590 con 0x55dcd10280a0 2023-09-21T12:59:23.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 10 client.26315 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55dcd0dcb1f0 con 0x55dcd10280a0 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e009a350 con 0x55dcd10280a0 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f49d803ac10 con 0x55dcd10280a0 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 10 client.26315 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 10 client.26315 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:23.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 20 client.26315 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1096dd0 0x55dcd10991f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 4 client.26315 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:59:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dcd0f72e00 con 0x55dcd1096dd0 2023-09-21T12:59:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.859+0000 7f49e77fe700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1096dd0 0x55dcd10991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:23.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.860+0000 7f49c77fe700 10 client.26315 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:23.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.860+0000 7f49e77fe700 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1096dd0 0x55dcd10991f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3dab8a029ea751 server_cookie=9a8ca792266ad1ec in_seq=0 out_seq=0 2023-09-21T12:59:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.933+0000 7f49c77fe700 1 -- 172.21.15.142:0/550848444 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dcd0f72e00 con 0x55dcd1096dd0 2023-09-21T12:59:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.933+0000 7f49c77fe700 10 client.26315 handle_command_reply: tid=0 2023-09-21T12:59:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 client.26315 shutdown 2023-09-21T12:59:23.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 msgr2=0x55dcd1038860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55dcd1044b80 tx=0x7f49d80047c0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 shutdown_connections 2023-09-21T12:59:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55dcd1096dd0 0x55dcd10991f0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dcd102ce50 0x55dcd1034e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dcd10280a0 0x55dcd1038860 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 --2- 172.21.15.142:0/550848444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dcd10289c0 0x55dcd1038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 >> 172.21.15.142:0/550848444 conn(0x55dcd0f54fa0 msgr2=0x55dcd1026ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f49c77fe700 0 client.26315 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 shutdown_connections 2023-09-21T12:59:23.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.934+0000 7f4a02124b80 1 -- 172.21.15.142:0/550848444 wait complete. 2023-09-21T12:59:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.935+0000 7f4a02124b80 20 client.26315 trim_cache size 0 max 16384 2023-09-21T12:59:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:59:23.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:59:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:59:23.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:59:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.935+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 msgr2=0x7f49d00a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.935+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 0x7f49d00a2d70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f49d8011520 tx=0x7f49d80118e0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.935+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 msgr2=0x7f49e81096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:23.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.935+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49e0004c80 tx=0x7f49e0004cb0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 shutdown_connections 2023-09-21T12:59:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d00a08b0 0x7f49d00a2d70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49e8109220 0x7f49e81096d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49e8100120 0x7f49e810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 --2- 172.21.15.142:0/3378374044 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49e8105010 0x7f49e810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 >> 172.21.15.142:0/3378374044 conn(0x7f49e8076800 msgr2=0x7f49e81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 shutdown_connections 2023-09-21T12:59:23.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:23.936+0000 7f49ee7ff700 1 -- 172.21.15.142:0/3378374044 wait complete. 2023-09-21T12:59:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:23 smithi156 ceph-mon[134078]: pgmap v97: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:24.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:23 smithi142 ceph-mon[97663]: pgmap v97: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:24.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:23 smithi160 ceph-mon[134450]: pgmap v97: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:24.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 263106 10.46 MB/sec execute 5 sec latency 32.242 ms 2023-09-21T12:59:25.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 265533 10.81 MB/sec execute 6 sec latency 10.905 ms 2023-09-21T12:59:26.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:59:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:25 smithi156 ceph-mon[134078]: pgmap v98: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:25 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:59:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:25 smithi142 ceph-mon[97663]: pgmap v98: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:25 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:59:26.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:25 smithi160 ceph-mon[134450]: pgmap v98: 97 pgs: 97 active+clean; 75 MiB data, 931 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.8 MiB/s wr, 284 op/s 2023-09-21T12:59:26.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:25 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T12:59:26.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2625982420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7941017f0 msgr2=0x7fd794105830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2625982420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7941017f0 0x7fd794105830 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd7840098f0 tx=0x7fd784009c00 comp rx=0 tx=0).stop 2023-09-21T12:59:26.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2625982420 shutdown_connections 2023-09-21T12:59:26.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2625982420 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794105f60 0x7fd79410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2625982420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794100e40 0x7fd794101220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2625982420 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd7941017f0 0x7fd794105830 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2625982420 >> 172.21.15.142:0/2625982420 conn(0x7fd7940fc6a0 msgr2=0x7fd7940feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2625982420 shutdown_connections 2023-09-21T12:59:26.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.390+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2625982420 wait complete. 2023-09-21T12:59:26.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.391+0000 7fd79ab9d700 1 Processor -- start 2023-09-21T12:59:26.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.391+0000 7fd79ab9d700 1 -- start start 2023-09-21T12:59:26.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794100e40 0x7fd79419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 0x7fd794196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794197530 con 0x7fd794100e40 2023-09-21T12:59:26.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794197670 con 0x7fd794105f60 2023-09-21T12:59:26.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79ab9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd794197830 con 0x7fd794196ab0 2023-09-21T12:59:26.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd799b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794100e40 0x7fd79419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55252/0 (socket says 172.21.15.142:55252) 2023-09-21T12:59:26.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 -- 172.21.15.142:0/2214876891 learned_addr learned my addr 172.21.15.142:0/2214876891 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79a39c700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 0x7fd794196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 -- 172.21.15.142:0/2214876891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 msgr2=0x7fd794196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 0x7fd794196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 -- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794100e40 msgr2=0x7fd79419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794100e40 0x7fd79419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.392+0000 7fd79939a700 1 -- 172.21.15.142:0/2214876891 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7900095f0 con 0x7fd794105f60 2023-09-21T12:59:26.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd79a39c700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 0x7fd794196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:26.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd79939a700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd784009fd0 tx=0x7fd78400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd78affd700 1 -- 172.21.15.142:0/2214876891 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78401c070 con 0x7fd794105f60 2023-09-21T12:59:26.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd78affd700 1 -- 172.21.15.142:0/2214876891 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd78400bb20 con 0x7fd794105f60 2023-09-21T12:59:26.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd784009520 con 0x7fd794105f60 2023-09-21T12:59:26.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd78affd700 1 -- 172.21.15.142:0/2214876891 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd784004930 con 0x7fd794105f60 2023-09-21T12:59:26.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.393+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940733b0 con 0x7fd794105f60 2023-09-21T12:59:26.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.398+0000 7fd78affd700 1 -- 172.21.15.142:0/2214876891 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd784020070 con 0x7fd794105f60 2023-09-21T12:59:26.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 Processor -- start 2023-09-21T12:59:26.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 -- start start 2023-09-21T12:59:26.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b685670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b686030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b5f9ca0 con 0x55749b68b3c0 2023-09-21T12:59:26.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b5ddc70 con 0x55749b685bb0 2023-09-21T12:59:26.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b5db590 con 0x55749b68bce0 2023-09-21T12:59:26.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd79a39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd79939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b686030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd79a39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35970/0 (socket says 172.21.15.142:35970) 2023-09-21T12:59:26.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd79a39c700 1 -- 172.21.15.142:0/4123043009 learned_addr learned my addr 172.21.15.142:0/4123043009 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.399+0000 7fd799b9b700 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b685670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 -- 172.21.15.142:0/4123043009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 msgr2=0x55749b685670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b685670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 -- 172.21.15.142:0/4123043009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 msgr2=0x55749b686030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b686030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 -- 172.21.15.142:0/4123043009 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55749b401de0 con 0x55749b68b3c0 2023-09-21T12:59:26.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79939a700 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b686030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:26.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd79a39c700 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd78c003eb0 tx=0x7fd78c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf23fd16aaffb8f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd78affd700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 0x7fd7800ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.400+0000 7fd77ffff700 1 -- 172.21.15.142:0/4123043009 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0092d0 con 0x55749b68b3c0 2023-09-21T12:59:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd77ffff700 1 -- 172.21.15.142:0/4123043009 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd78c00f040 con 0x55749b68b3c0 2023-09-21T12:59:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd77ffff700 1 -- 172.21.15.142:0/4123043009 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c00e7e0 con 0x55749b68b3c0 2023-09-21T12:59:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd78affd700 1 -- 172.21.15.142:0/2214876891 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd7840ccb50 con 0x7fd794105f60 2023-09-21T12:59:26.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd799b9b700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 0x7fd7800ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4123043009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 msgr2=0x55749b68b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd799b9b700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 0x7fd7800ab5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55749b682170 tx=0x7fd790009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.401+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd78c003eb0 tx=0x7fd78c009920 comp rx=0 tx=0).stop 2023-09-21T12:59:26.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4123043009 shutdown_connections 2023-09-21T12:59:26.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b68b7a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b686030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4123043009 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b685670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4123043009 >> 172.21.15.142:0/4123043009 conn(0x55749b5b2000 msgr2=0x55749b680650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4123043009 shutdown_connections 2023-09-21T12:59:26.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4123043009 wait complete. 2023-09-21T12:59:26.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.402+0000 7fd7af6e7b80 1 -- start start 2023-09-21T12:59:26.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 Processor -- start 2023-09-21T12:59:26.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 0x55749b68f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 0x55749b68fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b5d6e80 con 0x55749b68bce0 2023-09-21T12:59:26.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b573740 con 0x55749b685bb0 2023-09-21T12:59:26.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b5733e0 con 0x55749b68b3c0 2023-09-21T12:59:26.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd7af6e7b80 10 client.0 _ll_register_callbacks cb 0x55749b4bda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:26.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.403+0000 7fd799b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd79939a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 0x55749b68f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd79a39c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 0x55749b68fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55262/0 (socket says 172.21.15.142:55262) 2023-09-21T12:59:26.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 -- 172.21.15.142:0/2469045987 learned_addr learned my addr 172.21.15.142:0/2469045987 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 -- 172.21.15.142:0/2469045987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 msgr2=0x55749b68f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 0x55749b68f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 -- 172.21.15.142:0/2469045987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 msgr2=0x55749b68fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 0x55749b68fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 -- 172.21.15.142:0/2469045987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7940733b0 con 0x55749b685bb0 2023-09-21T12:59:26.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd79a39c700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 0x55749b68fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:26.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd79939a700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 0x55749b68f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:26.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd799b9b700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd7900045f0 tx=0x7fd7900047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6368f643725e6ee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd77d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790017070 con 0x55749b685bb0 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.404+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd790003e20 con 0x55749b685bb0 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55749b547bb0 con 0x55749b685bb0 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd790029440 con 0x55749b685bb0 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 10 client.26327 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:26.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fd78c003b90 con 0x55749b685bb0 2023-09-21T12:59:26.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55749b547bb0 con 0x55749b685bb0 2023-09-21T12:59:26.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd79001f690 con 0x55749b685bb0 2023-09-21T12:59:26.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 10 client.26327 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:26.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 10 client.26327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:26.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 20 client.26327 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:26.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b69f840 0x55749b6a1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 4 client.26327 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:26.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.405+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55749b654020 con 0x55749b69f840 2023-09-21T12:59:26.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.406+0000 7fd79939a700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b69f840 0x55749b6a1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.406+0000 7fd79939a700 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b69f840 0x55749b6a1c60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2c67cb5df58f10 server_cookie=c2d4199bda6d51c8 in_seq=0 out_seq=0 2023-09-21T12:59:26.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.406+0000 7fd77d7fa700 10 client.26327 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:26.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.407+0000 7fd77d7fa700 1 -- 172.21.15.142:0/2469045987 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55749b654020 con 0x55749b69f840 2023-09-21T12:59:26.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.407+0000 7fd77d7fa700 10 client.26327 handle_command_reply: tid=0 2023-09-21T12:59:26.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.407+0000 7fd7af6e7b80 1 client.26327 shutdown 2023-09-21T12:59:26.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 msgr2=0x55749b68f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd7900045f0 tx=0x7fd7900047c0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 shutdown_connections 2023-09-21T12:59:26.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b69f840 0x55749b6a1c60 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68bce0 0x55749b68fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b68f010 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd77d7fa700 0 client.26327 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:26.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/2469045987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68b3c0 0x55749b68f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 >> 172.21.15.142:0/2469045987 conn(0x55749b5b2000 msgr2=0x55749b680360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 shutdown_connections 2023-09-21T12:59:26.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/2469045987 wait complete. 2023-09-21T12:59:26.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.408+0000 7fd7af6e7b80 20 client.26327 trim_cache size 0 max 16384 2023-09-21T12:59:26.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 Processor -- start 2023-09-21T12:59:26.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 -- start start 2023-09-21T12:59:26.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 0x55749b685670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b68a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b457920 con 0x55749b685bb0 2023-09-21T12:59:26.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b67ae50 con 0x55749b68b3c0 2023-09-21T12:59:26.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.430+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b6924d0 con 0x55749b68bce0 2023-09-21T12:59:26.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55268/0 (socket says 172.21.15.142:55268) 2023-09-21T12:59:26.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 -- 172.21.15.142:0/4172591460 learned_addr learned my addr 172.21.15.142:0/4172591460 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79a39c700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b68a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd799b9b700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 0x55749b685670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 -- 172.21.15.142:0/4172591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 msgr2=0x55749b68a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b68a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 -- 172.21.15.142:0/4172591460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 msgr2=0x55749b685670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 0x55749b685670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 -- 172.21.15.142:0/4172591460 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55749b6a6870 con 0x55749b68b3c0 2023-09-21T12:59:26.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd799b9b700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 0x55749b685670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:26.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd79939a700 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd784096a80 tx=0x7fd7840d05c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53e58fc1b8ed30bc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.431+0000 7fd788bff700 1 -- 172.21.15.142:0/4172591460 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7840d00f0 con 0x55749b68b3c0 2023-09-21T12:59:26.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd788bff700 1 -- 172.21.15.142:0/4172591460 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd7840963a0 con 0x55749b68b3c0 2023-09-21T12:59:26.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd788bff700 1 -- 172.21.15.142:0/4172591460 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78409de90 con 0x55749b68b3c0 2023-09-21T12:59:26.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4172591460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 msgr2=0x55749b696750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd784096a80 tx=0x7fd7840d05c0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4172591460 shutdown_connections 2023-09-21T12:59:26.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b685bb0 0x55749b685670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b68a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/4172591460 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b68b3c0 0x55749b696750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.432+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4172591460 >> 172.21.15.142:0/4172591460 conn(0x55749b5b2000 msgr2=0x55749b68a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.433+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4172591460 shutdown_connections 2023-09-21T12:59:26.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.433+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/4172591460 wait complete. 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.433+0000 7fd7af6e7b80 1 -- start start 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.433+0000 7fd7af6e7b80 1 Processor -- start 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b6ed470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b6e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b6e7cc0 con 0x55749b68b3c0 2023-09-21T12:59:26.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b6e7e30 con 0x55749b685bb0 2023-09-21T12:59:26.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55749b6e7ff0 con 0x55749b68bce0 2023-09-21T12:59:26.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd7af6e7b80 10 client.0 _ll_register_callbacks cb 0x55749b4bda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:26.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55284/0 (socket says 172.21.15.142:55284) 2023-09-21T12:59:26.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 -- 172.21.15.142:0/547024510 learned_addr learned my addr 172.21.15.142:0/547024510 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd79a39c700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b6e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd79939a700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b6ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 -- 172.21.15.142:0/547024510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 msgr2=0x55749b6e75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b6e75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 -- 172.21.15.142:0/547024510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 msgr2=0x55749b6ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:26.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b6ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd799b9b700 1 -- 172.21.15.142:0/547024510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd784009520 con 0x55749b685bb0 2023-09-21T12:59:26.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd79a39c700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b6e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:26.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.434+0000 7fd79939a700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b6ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd799b9b700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd79001fa10 tx=0x7fd79001fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c72e00c21dc9ef4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd77d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd790017050 con 0x55749b685bb0 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd79001f630 con 0x55749b685bb0 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd78c00f040 con 0x55749b685bb0 2023-09-21T12:59:26.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd79001f7f0 con 0x55749b685bb0 2023-09-21T12:59:26.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd7af6e7b80 10 client.26333 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:26.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.435+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55749b3eac60 con 0x55749b685bb0 2023-09-21T12:59:26.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.436+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd78c00f040 con 0x55749b685bb0 2023-09-21T12:59:26.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fd790038030 con 0x55749b685bb0 2023-09-21T12:59:26.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 10 client.26333 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:26.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 10 client.26333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:26.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 20 client.26333 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:26.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b6f4d70 0x55749b6f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 4 client.26333 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:59:26.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55749b5cfe60 con 0x55749b6f4d70 2023-09-21T12:59:26.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd79939a700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b6f4d70 0x55749b6f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd79939a700 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b6f4d70 0x55749b6f7190 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca366caecd5c15d9 server_cookie=3bf3b49889dcfe60 in_seq=0 out_seq=0 2023-09-21T12:59:26.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.437+0000 7fd77d7fa700 10 client.26333 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:26.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd77d7fa700 1 -- 172.21.15.142:0/547024510 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55749b5cfe60 con 0x55749b6f4d70 2023-09-21T12:59:26.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd77d7fa700 10 client.26333 handle_command_reply: tid=0 2023-09-21T12:59:26.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 client.26333 shutdown 2023-09-21T12:59:26.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 msgr2=0x55749b6ecf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd79001fa10 tx=0x7fd79001fc80 comp rx=0 tx=0).stop 2023-09-21T12:59:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 shutdown_connections 2023-09-21T12:59:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55749b6f4d70 0x55749b6f7190 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd77d7fa700 0 client.26333 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55749b68bce0 0x55749b6e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55749b685bb0 0x55749b6ecf30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 --2- 172.21.15.142:0/547024510 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55749b68b3c0 0x55749b6ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 >> 172.21.15.142:0/547024510 conn(0x55749b5b2000 msgr2=0x55749b68aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 shutdown_connections 2023-09-21T12:59:26.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.438+0000 7fd7af6e7b80 1 -- 172.21.15.142:0/547024510 wait complete. 2023-09-21T12:59:26.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd7af6e7b80 20 client.26333 trim_cache size 0 max 16384 2023-09-21T12:59:26.452 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:59:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:59:26.452 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:59:26.453 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:59:26.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 msgr2=0x7fd7800ab5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 0x7fd7800ab5b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55749b682170 tx=0x7fd790009310 comp rx=0 tx=0).stop 2023-09-21T12:59:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 msgr2=0x7fd79419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd784009fd0 tx=0x7fd78400fa00 comp rx=0 tx=0).stop 2023-09-21T12:59:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 shutdown_connections 2023-09-21T12:59:26.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd7800a90f0 0x7fd7800ab5b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd794100e40 0x7fd79419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd794196ab0 0x7fd794196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 --2- 172.21.15.142:0/2214876891 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd794105f60 0x7fd79419cf80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 >> 172.21.15.142:0/2214876891 conn(0x7fd7940fc6a0 msgr2=0x7fd7940fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 shutdown_connections 2023-09-21T12:59:26.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.439+0000 7fd79ab9d700 1 -- 172.21.15.142:0/2214876891 wait complete. 2023-09-21T12:59:26.458 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:59:26.459 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T12:59:26.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 266654 10.20 MB/sec execute 7 sec latency 26.365 ms 2023-09-21T12:59:26.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 -- 172.21.15.142:0/2639861711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101970 msgr2=0x7f2e581059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/2639861711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101970 0x7f2e581059b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2e48009990 tx=0x7f2e48009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 -- 172.21.15.142:0/2639861711 shutdown_connections 2023-09-21T12:59:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/2639861711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e581060e0 0x7f2e5810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/2639861711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e58100fc0 0x7f2e581013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/2639861711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e58101970 0x7f2e581059b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 -- 172.21.15.142:0/2639861711 >> 172.21.15.142:0/2639861711 conn(0x7f2e580fc800 msgr2=0x7f2e580fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 -- 172.21.15.142:0/2639861711 shutdown_connections 2023-09-21T12:59:26.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.726+0000 7f2e5fdff700 1 -- 172.21.15.142:0/2639861711 wait complete. 2023-09-21T12:59:26.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.727+0000 7f2e5fdff700 1 Processor -- start 2023-09-21T12:59:26.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.727+0000 7f2e5fdff700 1 -- start start 2023-09-21T12:59:26.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.727+0000 7f2e5fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e58100fc0 0x7f2e58196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e5819b810 0x7f2e5819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5819c290 con 0x7f2e58100fc0 2023-09-21T12:59:26.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5819c400 con 0x7f2e5819b810 2023-09-21T12:59:26.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5819c5c0 con 0x7f2e581060e0 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56112/0 (socket says 172.21.15.142:56112) 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 -- 172.21.15.142:0/1049639106 learned_addr learned my addr 172.21.15.142:0/1049639106 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5e39c700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e5819b810 0x7f2e5819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5db9b700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e58100fc0 0x7f2e58196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 -- 172.21.15.142:0/1049639106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e5819b810 msgr2=0x7f2e5819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e5819b810 0x7f2e5819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 -- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e58100fc0 msgr2=0x7f2e58196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e58100fc0 0x7f2e58196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 -- 172.21.15.142:0/1049639106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e54009520 con 0x7f2e581060e0 2023-09-21T12:59:26.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.728+0000 7f2e5d39a700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e48004730 tx=0x7f2e48004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.729+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4801d070 con 0x7f2e581060e0 2023-09-21T12:59:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.729+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e480095f0 con 0x7f2e581060e0 2023-09-21T12:59:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.729+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e581a3db0 con 0x7f2e581060e0 2023-09-21T12:59:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.729+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e480047d0 con 0x7f2e581060e0 2023-09-21T12:59:26.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.729+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e480053d0 con 0x7f2e581060e0 2023-09-21T12:59:26.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.730+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e58067bd0 con 0x7f2e581060e0 2023-09-21T12:59:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.732+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2e48005530 con 0x7f2e581060e0 2023-09-21T12:59:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.733+0000 7f2e4effd700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 0x7f2e440a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.734+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2e480cd160 con 0x7f2e581060e0 2023-09-21T12:59:26.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.734+0000 7f2e5db9b700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 0x7f2e440a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.734+0000 7f2e5db9b700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 0x7f2e440a2cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009df0 tx=0x7f2e54009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:26.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:26.737+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2e4805ae10 con 0x7f2e581060e0 2023-09-21T12:59:26.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:26 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:59:26.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:26 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:59:26.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:26 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:59:27.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.025+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e58101a40 con 0x7f2e581060e0 2023-09-21T12:59:27.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.026+0000 7f2e4effd700 1 -- 172.21.15.142:0/1049639106 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11335 (secure 0 0 0) 0x7f2e48096ad0 con 0x7f2e581060e0 2023-09-21T12:59:27.026 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T12:59:27.026 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:57:46.421112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T12:59:27.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 msgr2=0x7f2e440a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 0x7f2e440a2cb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e54009df0 tx=0x7f2e54009260 comp rx=0 tx=0).stop 2023-09-21T12:59:27.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 msgr2=0x7f2e581973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2e48004730 tx=0x7f2e48004760 comp rx=0 tx=0).stop 2023-09-21T12:59:27.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 shutdown_connections 2023-09-21T12:59:27.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2e440a07f0 0x7f2e440a2cb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2e58100fc0 0x7f2e58196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2e5819b810 0x7f2e5819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 --2- 172.21.15.142:0/1049639106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e581060e0 0x7f2e581973b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 >> 172.21.15.142:0/1049639106 conn(0x7f2e580fc800 msgr2=0x7f2e580fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 shutdown_connections 2023-09-21T12:59:27.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.029+0000 7f2e5fdff700 1 -- 172.21.15.142:0/1049639106 wait complete. 2023-09-21T12:59:27.032 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-21T12:59:27.049 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T12:59:27.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:26 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:59:27.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:26 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:59:27.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:26 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:59:27.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:26 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T12:59:27.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:26 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T12:59:27.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:26 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T12:59:27.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 -- 172.21.15.142:0/858841068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8101970 msgr2=0x7f90f81059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/858841068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8101970 0x7f90f81059b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f90e8009990 tx=0x7f90e8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 -- 172.21.15.142:0/858841068 shutdown_connections 2023-09-21T12:59:27.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/858841068 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/858841068 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 0x7f90f81013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/858841068 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8101970 0x7f90f81059b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 -- 172.21.15.142:0/858841068 >> 172.21.15.142:0/858841068 conn(0x7f90f80fc840 msgr2=0x7f90f80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.274+0000 7f90ff3ff700 1 -- 172.21.15.142:0/858841068 shutdown_connections 2023-09-21T12:59:27.276 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.275+0000 7f90ff3ff700 1 -- 172.21.15.142:0/858841068 wait complete. 2023-09-21T12:59:27.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.276+0000 7f90ff3ff700 1 Processor -- start 2023-09-21T12:59:27.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.276+0000 7f90ff3ff700 1 -- start start 2023-09-21T12:59:27.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 0x7f90f819aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 0x7f90f8194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8195520 con 0x7f90f81060e0 2023-09-21T12:59:27.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8195660 con 0x7f90f8194aa0 2023-09-21T12:59:27.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90ff3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8195820 con 0x7f90f8100fc0 2023-09-21T12:59:27.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90fc99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 0x7f90f819aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90fc99a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36034/0 (socket says 172.21.15.142:36034) 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90fc99a700 1 -- 172.21.15.142:0/787771113 learned_addr learned my addr 172.21.15.142:0/787771113 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.277+0000 7f90fd99c700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 0x7f90f8194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 -- 172.21.15.142:0/787771113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 msgr2=0x7f90f819aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 0x7f90f819aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 -- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 msgr2=0x7f90f819af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 -- 172.21.15.142:0/787771113 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80095f0 con 0x7f90f8194aa0 2023-09-21T12:59:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fc99a700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90fd99c700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 0x7f90f8194f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90f000efc0 tx=0x7f90f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90ee7fc700 1 -- 172.21.15.142:0/787771113 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0018070 con 0x7f90f8194aa0 2023-09-21T12:59:27.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90ee7fc700 1 -- 172.21.15.142:0/787771113 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90f000f040 con 0x7f90f8194aa0 2023-09-21T12:59:27.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f81a18a0 con 0x7f90f8194aa0 2023-09-21T12:59:27.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90ee7fc700 1 -- 172.21.15.142:0/787771113 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f000cd40 con 0x7f90f8194aa0 2023-09-21T12:59:27.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.278+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f81a1db0 con 0x7f90f8194aa0 2023-09-21T12:59:27.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.282+0000 7f90ee7fc700 1 -- 172.21.15.142:0/787771113 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f90f0003a00 con 0x7f90f8194aa0 2023-09-21T12:59:27.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.283+0000 7f90ee7fc700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 0x7f90e40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.283+0000 7f90ee7fc700 1 -- 172.21.15.142:0/787771113 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90f00cbaf0 con 0x7f90f8194aa0 2023-09-21T12:59:27.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.284+0000 7f90fd19b700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 0x7f90e40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.284+0000 7f9112d5eb80 1 Processor -- start 2023-09-21T12:59:27.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.284+0000 7f90fd19b700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 0x7f90e40a2c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90f4015340 tx=0x7f90f400f040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.284+0000 7f9112d5eb80 1 -- start start 2023-09-21T12:59:27.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb5ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 0x55697bb5b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bacaca0 con 0x55697bb56610 2023-09-21T12:59:27.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697baaec70 con 0x55697bb56f30 2023-09-21T12:59:27.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697baac590 con 0x55697bb5b360 2023-09-21T12:59:27.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fc99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb5ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fc99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb5ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55324/0 (socket says 172.21.15.142:55324) 2023-09-21T12:59:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fc99a700 1 -- 172.21.15.142:0/4231569706 learned_addr learned my addr 172.21.15.142:0/4231569706 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36048/0 (socket says 172.21.15.142:36048) 2023-09-21T12:59:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.285+0000 7f90fd99c700 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 0x55697bb5b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 -- 172.21.15.142:0/4231569706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 msgr2=0x55697bb5ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb5ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 -- 172.21.15.142:0/4231569706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 msgr2=0x55697bb569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 -- 172.21.15.142:0/4231569706 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697b8d2de0 con 0x55697bb5b360 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90fd99c700 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 0x55697bb5b7c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90f00c9210 tx=0x7f90f0098dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8d2ca136a59c29f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90e37fe700 1 -- 172.21.15.142:0/4231569706 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f001b320 con 0x55697bb5b360 2023-09-21T12:59:27.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90e37fe700 1 -- 172.21.15.142:0/4231569706 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90f0004ad0 con 0x55697bb5b360 2023-09-21T12:59:27.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.286+0000 7f90e37fe700 1 -- 172.21.15.142:0/4231569706 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0099260 con 0x55697bb5b360 2023-09-21T12:59:27.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 -- 172.21.15.142:0/4231569706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 msgr2=0x55697bb5b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 0x55697bb5b7c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f90f00c9210 tx=0x7f90f0098dd0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 -- 172.21.15.142:0/4231569706 shutdown_connections 2023-09-21T12:59:27.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb5b360 0x55697bb5b7c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/4231569706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb5ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 -- 172.21.15.142:0/4231569706 >> 172.21.15.142:0/4231569706 conn(0x55697ba83000 msgr2=0x55697bb516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 -- 172.21.15.142:0/4231569706 shutdown_connections 2023-09-21T12:59:27.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.287+0000 7f9112d5eb80 1 -- 172.21.15.142:0/4231569706 wait complete. 2023-09-21T12:59:27.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.288+0000 7f9112d5eb80 1 -- start start 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.288+0000 7f9112d5eb80 1 Processor -- start 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb60340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bb60880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697baa7e80 con 0x55697bb5b360 2023-09-21T12:59:27.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697ba44740 con 0x55697bb56f30 2023-09-21T12:59:27.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697ba443e0 con 0x55697bb56610 2023-09-21T12:59:27.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f9112d5eb80 10 client.0 _ll_register_callbacks cb 0x55697b98ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56154/0 (socket says 172.21.15.142:56154) 2023-09-21T12:59:27.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 -- 172.21.15.142:0/1413837340 learned_addr learned my addr 172.21.15.142:0/1413837340 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fc99a700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb60340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd99c700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bb60880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 -- 172.21.15.142:0/1413837340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 msgr2=0x55697bb60340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb60340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 -- 172.21.15.142:0/1413837340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 msgr2=0x55697bb60880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bb60880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.289+0000 7f90fd19b700 1 -- 172.21.15.142:0/1413837340 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f81a1db0 con 0x55697bb56610 2023-09-21T12:59:27.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90fc99a700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb60340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:27.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90fd19b700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90f40039b0 tx=0x7f90f4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5e28105fbbcdf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:27.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4012040 con 0x55697bb56610 2023-09-21T12:59:27.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55697ba18bb0 con 0x55697bb56610 2023-09-21T12:59:27.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90f4020040 con 0x55697bb56610 2023-09-21T12:59:27.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90f401b950 con 0x55697bb56610 2023-09-21T12:59:27.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f9112d5eb80 10 client.26311 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.290+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55697b8bbc60 con 0x55697bb56610 2023-09-21T12:59:27.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55697ba18bb0 con 0x55697bb56610 2023-09-21T12:59:27.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f90f4027c70 con 0x55697bb56610 2023-09-21T12:59:27.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 10 client.26311 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 10 client.26311 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:59:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 20 client.26311 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bb70550 0x55697bb72970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 4 client.26311 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55697bb25020 con 0x55697bb70550 2023-09-21T12:59:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.291+0000 7f90fc99a700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bb70550 0x55697bb72970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.292+0000 7f90fc99a700 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bb70550 0x55697bb72970 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=880d562ca6f60576 server_cookie=48933fc7d434d735 in_seq=0 out_seq=0 2023-09-21T12:59:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.292+0000 7f90e0ff9700 10 client.26311 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:59:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.292+0000 7f90e0ff9700 1 -- 172.21.15.142:0/1413837340 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55697bb25020 con 0x55697bb70550 2023-09-21T12:59:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.292+0000 7f90e0ff9700 10 client.26311 handle_command_reply: tid=0 2023-09-21T12:59:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.292+0000 7f9112d5eb80 1 client.26311 shutdown 2023-09-21T12:59:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 msgr2=0x55697bb5fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90f40039b0 tx=0x7f90f4004750 comp rx=0 tx=0).stop 2023-09-21T12:59:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 shutdown_connections 2023-09-21T12:59:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bb70550 0x55697bb72970 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bb60880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb5fe00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1413837340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb60340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f90e0ff9700 0 client.26311 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:59:27.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 >> 172.21.15.142:0/1413837340 conn(0x55697ba83000 msgr2=0x55697bb51290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 shutdown_connections 2023-09-21T12:59:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1413837340 wait complete. 2023-09-21T12:59:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.293+0000 7f9112d5eb80 20 client.26311 trim_cache size 0 max 16384 2023-09-21T12:59:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 Processor -- start 2023-09-21T12:59:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 -- start start 2023-09-21T12:59:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56f30 0x55697bb5a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697b928920 con 0x55697bb56610 2023-09-21T12:59:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bb49110 con 0x55697bb5b360 2023-09-21T12:59:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.309+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bb57670 con 0x55697bb56f30 2023-09-21T12:59:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55334/0 (socket says 172.21.15.142:55334) 2023-09-21T12:59:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 -- 172.21.15.142:0/1096097556 learned_addr learned my addr 172.21.15.142:0/1096097556 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd19b700 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fc99a700 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56f30 0x55697bb5a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 -- 172.21.15.142:0/1096097556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56f30 msgr2=0x55697bb5a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56f30 0x55697bb5a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 -- 172.21.15.142:0/1096097556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 msgr2=0x55697bb674e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb674e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 -- 172.21.15.142:0/1096097556 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55697b8f9250 con 0x55697bb5b360 2023-09-21T12:59:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90fd99c700 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90f0098d00 tx=0x7f90f0004dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5af8d61fa2833 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90e3fff700 1 -- 172.21.15.142:0/1096097556 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f001b320 con 0x55697bb5b360 2023-09-21T12:59:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90e3fff700 1 -- 172.21.15.142:0/1096097556 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90f0099700 con 0x55697bb5b360 2023-09-21T12:59:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.310+0000 7f90e3fff700 1 -- 172.21.15.142:0/1096097556 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00984f0 con 0x55697bb5b360 2023-09-21T12:59:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1096097556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 msgr2=0x55697bb5a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f90f0098d00 tx=0x7f90f0004dc0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1096097556 shutdown_connections 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb56610 0x55697bb674e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb5b360 0x55697bb5a8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/1096097556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56f30 0x55697bb5a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1096097556 >> 172.21.15.142:0/1096097556 conn(0x55697ba83000 msgr2=0x55697bb59430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1096097556 shutdown_connections 2023-09-21T12:59:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.311+0000 7f9112d5eb80 1 -- 172.21.15.142:0/1096097556 wait complete. 2023-09-21T12:59:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.312+0000 7f9112d5eb80 1 -- start start 2023-09-21T12:59:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.312+0000 7f9112d5eb80 1 Processor -- start 2023-09-21T12:59:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb66e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bbbd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bbbd850 con 0x55697bb5b360 2023-09-21T12:59:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bbbd9c0 con 0x55697bb56f30 2023-09-21T12:59:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55697bbbdb80 con 0x55697bb56610 2023-09-21T12:59:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f9112d5eb80 10 client.0 _ll_register_callbacks cb 0x55697b98ea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56176/0 (socket says 172.21.15.142:56176) 2023-09-21T12:59:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 -- 172.21.15.142:0/339561364 learned_addr learned my addr 172.21.15.142:0/339561364 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fc99a700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb66e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd99c700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bbbd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 -- 172.21.15.142:0/339561364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 msgr2=0x55697bb66e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb66e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 -- 172.21.15.142:0/339561364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 msgr2=0x55697bbbd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bbbd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd19b700 1 -- 172.21.15.142:0/339561364 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55697b8d2de0 con 0x55697bb56610 2023-09-21T12:59:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.313+0000 7f90fd99c700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bbbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90fd19b700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90f4019410 tx=0x7f90f401b4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc9f777ba03fcc84 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f4012040 con 0x55697bb56610 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90f0004ad0 con 0x55697bb56610 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f90f4019bb0 con 0x55697bb56610 2023-09-21T12:59:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90f4015c20 con 0x55697bb56610 2023-09-21T12:59:27.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f9112d5eb80 10 client.26317 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55697b8d12b0 con 0x55697bb56610 2023-09-21T12:59:27.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.314+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f90f0004ad0 con 0x55697bb56610 2023-09-21T12:59:27.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f90f4005420 con 0x55697bb56610 2023-09-21T12:59:27.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 10 client.26317 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 10 client.26317 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T12:59:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 20 client.26317 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bbc5150 0x55697bbc7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 4 client.26317 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:59:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55697baa0e60 con 0x55697bbc5150 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f90fc99a700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bbc5150 0x55697bbc7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f90e0ff9700 10 client.26317 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.315+0000 7f90fc99a700 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bbc5150 0x55697bbc7570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a8f9c038a592fff server_cookie=938d882693977186 in_seq=0 out_seq=0 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f90e0ff9700 1 -- 172.21.15.142:0/339561364 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55697baa0e60 con 0x55697bbc5150 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f90e0ff9700 10 client.26317 handle_command_reply: tid=0 2023-09-21T12:59:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 client.26317 shutdown 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 msgr2=0x55697bb66920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f90f4019410 tx=0x7f90f401b4b0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 shutdown_connections 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55697bbc5150 0x55697bbc7570 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55697bb5b360 0x55697bbbd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55697bb56610 0x55697bb66920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f90e0ff9700 0 client.26317 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T12:59:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 --2- 172.21.15.142:0/339561364 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55697bb56f30 0x55697bb66e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 >> 172.21.15.142:0/339561364 conn(0x55697ba83000 msgr2=0x55697bb5a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 shutdown_connections 2023-09-21T12:59:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 1 -- 172.21.15.142:0/339561364 wait complete. 2023-09-21T12:59:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.316+0000 7f9112d5eb80 20 client.26317 trim_cache size 0 max 16384 2023-09-21T12:59:27.330 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:59:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 msgr2=0x7f90e40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 0x7f90e40a2c70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90f4015340 tx=0x7f90f400f040 comp rx=0 tx=0).stop 2023-09-21T12:59:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 msgr2=0x7f90f8194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 0x7f90f8194f50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90f000efc0 tx=0x7f90f000c3a0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 shutdown_connections 2023-09-21T12:59:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f90e40a07b0 0x7f90e40a2c70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f90f8194aa0 0x7f90f8194f50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f8100fc0 0x7f90f819aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 --2- 172.21.15.142:0/787771113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f90f81060e0 0x7f90f819af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 >> 172.21.15.142:0/787771113 conn(0x7f90f80fc840 msgr2=0x7f90f80fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 shutdown_connections 2023-09-21T12:59:27.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.317+0000 7f90ff3ff700 1 -- 172.21.15.142:0/787771113 wait complete. 2023-09-21T12:59:27.338 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T12:59:27.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 -- 172.21.15.142:0/1263532682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200ffb00 msgr2=0x7f79200ffee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 --2- 172.21.15.142:0/1263532682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200ffb00 0x7f79200ffee0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f791c009990 tx=0x7f791c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 -- 172.21.15.142:0/1263532682 shutdown_connections 2023-09-21T12:59:27.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 --2- 172.21.15.142:0/1263532682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f79200ffb00 0x7f79200ffee0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 --2- 172.21.15.142:0/1263532682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f792010d6b0 0x7f792010faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 --2- 172.21.15.142:0/1263532682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f792010d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.564+0000 7f7927fff700 1 -- 172.21.15.142:0/1263532682 >> 172.21.15.142:0/1263532682 conn(0x7f79200fb740 msgr2=0x7f79200fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.565+0000 7f7927fff700 1 -- 172.21.15.142:0/1263532682 shutdown_connections 2023-09-21T12:59:27.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.565+0000 7f7927fff700 1 -- 172.21.15.142:0/1263532682 wait complete. 2023-09-21T12:59:27.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.566+0000 7f7927fff700 1 Processor -- start 2023-09-21T12:59:27.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.566+0000 7f7927fff700 1 -- start start 2023-09-21T12:59:27.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 0x7f79201990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f7920199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792010d6b0 0x7f792019da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792019e0a0 con 0x7f792010d6b0 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792019e210 con 0x7f79200ffb00 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7927fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f792019e3d0 con 0x7f79201004b0 2023-09-21T12:59:27.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 0x7f79201990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f7920199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 0x7f79201990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55354/0 (socket says 172.21.15.142:55354) 2023-09-21T12:59:27.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f7925d9b700 1 -- 172.21.15.142:0/3239560374 learned_addr learned my addr 172.21.15.142:0/3239560374 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792659c700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792010d6b0 0x7f792019da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 -- 172.21.15.142:0/3239560374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 msgr2=0x7f79201990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 0x7f79201990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 -- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792010d6b0 msgr2=0x7f792019da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792010d6b0 0x7f792019da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.567+0000 7f792559a700 1 -- 172.21.15.142:0/3239560374 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7918009c40 con 0x7f79201004b0 2023-09-21T12:59:27.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f792559a700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f7920199600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9f0 tx=0x7f791000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f7916ffd700 1 -- 172.21.15.142:0/3239560374 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791000c9c0 con 0x7f79201004b0 2023-09-21T12:59:27.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f7916ffd700 1 -- 172.21.15.142:0/3239560374 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7910010430 con 0x7f79201004b0 2023-09-21T12:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791c0095f0 con 0x7f79201004b0 2023-09-21T12:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f7916ffd700 1 -- 172.21.15.142:0/3239560374 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910018680 con 0x7f79201004b0 2023-09-21T12:59:27.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.568+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792019e8a0 con 0x7f79201004b0 2023-09-21T12:59:27.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.571+0000 7f7916ffd700 1 -- 172.21.15.142:0/3239560374 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7910010860 con 0x7f79201004b0 2023-09-21T12:59:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.573+0000 7f7916ffd700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 0x7f790c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.573+0000 7f7916ffd700 1 -- 172.21.15.142:0/3239560374 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7910014070 con 0x7f79201004b0 2023-09-21T12:59:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.573+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 0x7f790c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.573+0000 7f793b8b1b80 1 Processor -- start 2023-09-21T12:59:27.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.573+0000 7f793b8b1b80 1 -- start start 2023-09-21T12:59:27.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad227c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac91ca0 con 0x55ff1ad1d610 2023-09-21T12:59:27.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac75c70 con 0x55ff1ad22360 2023-09-21T12:59:27.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac73590 con 0x55ff1ad1df30 2023-09-21T12:59:27.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f792559a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f792659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f792559a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56200/0 (socket says 172.21.15.142:56200) 2023-09-21T12:59:27.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f792559a700 1 -- 172.21.15.142:0/3866307945 learned_addr learned my addr 172.21.15.142:0/3866307945 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 0x7f790c0a2cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c006010 tx=0x7f791c00b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.574+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 -- 172.21.15.142:0/3866307945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 msgr2=0x55ff1ad227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 -- 172.21.15.142:0/3866307945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 msgr2=0x55ff1ad1d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 -- 172.21.15.142:0/3866307945 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff1aa99de0 con 0x55ff1ad1df30 2023-09-21T12:59:27.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792659c700 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:27.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f792559a700 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f79100959e0 tx=0x7f7910099140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd3a59140e81554 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f790bfff700 1 -- 172.21.15.142:0/3866307945 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791009d120 con 0x55ff1ad1df30 2023-09-21T12:59:27.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f790bfff700 1 -- 172.21.15.142:0/3866307945 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79100994e0 con 0x55ff1ad1df30 2023-09-21T12:59:27.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.575+0000 7f790bfff700 1 -- 172.21.15.142:0/3866307945 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100841d0 con 0x55ff1ad1df30 2023-09-21T12:59:27.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3866307945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 msgr2=0x55ff1ad21e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f79100959e0 tx=0x7f7910099140 comp rx=0 tx=0).stop 2023-09-21T12:59:27.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3866307945 shutdown_connections 2023-09-21T12:59:27.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3866307945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad21e20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3866307945 >> 172.21.15.142:0/3866307945 conn(0x55ff1ac4a000 msgr2=0x55ff1ad186a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3866307945 shutdown_connections 2023-09-21T12:59:27.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.576+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3866307945 wait complete. 2023-09-21T12:59:27.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.577+0000 7f793b8b1b80 1 -- start start 2023-09-21T12:59:27.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.577+0000 7f793b8b1b80 1 Processor -- start 2023-09-21T12:59:27.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.577+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad29b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.577+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad22360 0x55ff1ad27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac6ee80 con 0x55ff1ad1d610 2023-09-21T12:59:27.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac0b740 con 0x55ff1ad1df30 2023-09-21T12:59:27.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ac0b3e0 con 0x55ff1ad22360 2023-09-21T12:59:27.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f793b8b1b80 10 client.0 _ll_register_callbacks cb 0x55ff1ab55a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55372/0 (socket says 172.21.15.142:55372) 2023-09-21T12:59:27.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad29b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 -- 172.21.15.142:0/2047217365 learned_addr learned my addr 172.21.15.142:0/2047217365 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792659c700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad22360 0x55ff1ad27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 -- 172.21.15.142:0/2047217365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad22360 msgr2=0x55ff1ad27520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad22360 0x55ff1ad27520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 -- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 msgr2=0x55ff1ad29b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad29b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 -- 172.21.15.142:0/2047217365 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791800e330 con 0x55ff1ad1df30 2023-09-21T12:59:27.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f792559a700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f79100c9d00 tx=0x7f79100c9720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdc0d2a9a58d0509 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f79097fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:27.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.578+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100a1550 con 0x55ff1ad1df30 2023-09-21T12:59:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7910084040 con 0x55ff1ad1df30 2023-09-21T12:59:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ff1abdfbb0 con 0x55ff1ad1df30 2023-09-21T12:59:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79100989d0 con 0x55ff1ad1df30 2023-09-21T12:59:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 10 client.26369 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f792019e8a0 con 0x55ff1ad1df30 2023-09-21T12:59:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ff1abdfbb0 con 0x55ff1ad1df30 2023-09-21T12:59:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f79100b7250 con 0x55ff1ad1df30 2023-09-21T12:59:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 10 client.26369 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 10 client.26369 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:59:27.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 20 client.26369 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad36f70 0x55ff1ad39390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 4 client.26369 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.579+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ff1acec020 con 0x55ff1ad36f70 2023-09-21T12:59:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.580+0000 7f7925d9b700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad36f70 0x55ff1ad39390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.580+0000 7f7925d9b700 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad36f70 0x55ff1ad39390 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b4a0c06178ec4727 server_cookie=715c4a9b7edcdff9 in_seq=0 out_seq=0 2023-09-21T12:59:27.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.580+0000 7f79097fa700 10 client.26369 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:59:27.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f79097fa700 1 -- 172.21.15.142:0/2047217365 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ff1acec020 con 0x55ff1ad36f70 2023-09-21T12:59:27.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f79097fa700 10 client.26369 handle_command_reply: tid=0 2023-09-21T12:59:27.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 client.26369 shutdown 2023-09-21T12:59:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 msgr2=0x55ff1ad26de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f79100c9d00 tx=0x7f79100c9720 comp rx=0 tx=0).stop 2023-09-21T12:59:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 shutdown_connections 2023-09-21T12:59:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad29b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad36f70 0x55ff1ad39390 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad22360 0x55ff1ad27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f79097fa700 0 client.26369 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:59:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/2047217365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad26de0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 >> 172.21.15.142:0/2047217365 conn(0x55ff1ac4a000 msgr2=0x55ff1ad18290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 shutdown_connections 2023-09-21T12:59:27.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 1 -- 172.21.15.142:0/2047217365 wait complete. 2023-09-21T12:59:27.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.581+0000 7f793b8b1b80 20 client.26369 trim_cache size 0 max 16384 2023-09-21T12:59:27.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.595+0000 7f793b8b1b80 1 Processor -- start 2023-09-21T12:59:27.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 -- start start 2023-09-21T12:59:27.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad32be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad24750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1aaef920 con 0x55ff1ad1d610 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ad1e670 con 0x55ff1ad22360 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ad142e0 con 0x55ff1ad1df30 2023-09-21T12:59:27.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36094/0 (socket says 172.21.15.142:36094) 2023-09-21T12:59:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f7925d9b700 1 -- 172.21.15.142:0/896093338 learned_addr learned my addr 172.21.15.142:0/896093338 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f792559a700 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad32be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.596+0000 7f792659c700 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad24750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 -- 172.21.15.142:0/896093338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 msgr2=0x55ff1ad24750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad24750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 -- 172.21.15.142:0/896093338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 msgr2=0x55ff1ad1fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 -- 172.21.15.142:0/896093338 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ff1ad3dfc0 con 0x55ff1ad1df30 2023-09-21T12:59:27.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f792559a700 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad32be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7910009800 tx=0x7f7910097a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e531641b06847e09 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f7914ff9700 1 -- 172.21.15.142:0/896093338 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910004750 con 0x55ff1ad1df30 2023-09-21T12:59:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f7914ff9700 1 -- 172.21.15.142:0/896093338 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79100a1550 con 0x55ff1ad1df30 2023-09-21T12:59:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.597+0000 7f7914ff9700 1 -- 172.21.15.142:0/896093338 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791009d3a0 con 0x55ff1ad1df30 2023-09-21T12:59:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- 172.21.15.142:0/896093338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 msgr2=0x55ff1ad32be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad32be0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7910009800 tx=0x7f7910097a90 comp rx=0 tx=0).stop 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- 172.21.15.142:0/896093338 shutdown_connections 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad1d610 0x55ff1ad1fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad22360 0x55ff1ad24750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/896093338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1df30 0x55ff1ad32be0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- 172.21.15.142:0/896093338 >> 172.21.15.142:0/896093338 conn(0x55ff1ac4a000 msgr2=0x55ff1ad33780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- 172.21.15.142:0/896093338 shutdown_connections 2023-09-21T12:59:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- 172.21.15.142:0/896093338 wait complete. 2023-09-21T12:59:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.598+0000 7f793b8b1b80 1 -- start start 2023-09-21T12:59:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 Processor -- start 2023-09-21T12:59:27.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad2cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad22360 0x55ff1ad89da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ad8a2e0 con 0x55ff1ad22360 2023-09-21T12:59:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ad8a420 con 0x55ff1ad1df30 2023-09-21T12:59:27.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ff1ad8a590 con 0x55ff1ad1d610 2023-09-21T12:59:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f793b8b1b80 10 client.0 _ll_register_callbacks cb 0x55ff1ab55a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f792559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad2cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f7925d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56232/0 (socket says 172.21.15.142:56232) 2023-09-21T12:59:27.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.599+0000 7f7925d9b700 1 -- 172.21.15.142:0/3908977710 learned_addr learned my addr 172.21.15.142:0/3908977710 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f792659c700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad22360 0x55ff1ad89da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 -- 172.21.15.142:0/3908977710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 msgr2=0x55ff1ad2cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad2cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 -- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad22360 msgr2=0x55ff1ad89da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad22360 0x55ff1ad89da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 -- 172.21.15.142:0/3908977710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f792019e8a0 con 0x55ff1ad1d610 2023-09-21T12:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f792559a700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad2cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f7925d9b700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f791c005910 tx=0x7f791c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba13026183c0d09 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f79097fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f791c005490 con 0x55ff1ad1d610 2023-09-21T12:59:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79100994e0 con 0x55ff1ad1d610 2023-09-21T12:59:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.600+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f791c0055f0 con 0x55ff1ad1d610 2023-09-21T12:59:27.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f791c033a10 con 0x55ff1ad1d610 2023-09-21T12:59:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 10 client.26335 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ff1aa82c60 con 0x55ff1ad1d610 2023-09-21T12:59:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f79100994e0 con 0x55ff1ad1d610 2023-09-21T12:59:27.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f791c00fb30 con 0x55ff1ad1d610 2023-09-21T12:59:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 10 client.26335 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 10 client.26335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T12:59:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 20 client.26335 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad8bd20 0x55ff1ad8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 4 client.26335 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:59:27.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ff1ac67e60 con 0x55ff1ad8bd20 2023-09-21T12:59:27.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.601+0000 7f792559a700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad8bd20 0x55ff1ad8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f79097fa700 10 client.26335 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T12:59:27.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f792559a700 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad8bd20 0x55ff1ad8e140 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b304845d0f1763f server_cookie=c5f74ae5c4d27264 in_seq=0 out_seq=0 2023-09-21T12:59:27.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f79097fa700 1 -- 172.21.15.142:0/3908977710 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ff1ac67e60 con 0x55ff1ad8bd20 2023-09-21T12:59:27.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f79097fa700 10 client.26335 handle_command_reply: tid=0 2023-09-21T12:59:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f793b8b1b80 1 client.26335 shutdown 2023-09-21T12:59:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 msgr2=0x55ff1ad2c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.602+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f791c005910 tx=0x7f791c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 shutdown_connections 2023-09-21T12:59:27.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ff1ad22360 0x55ff1ad89da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55ff1ad8bd20 0x55ff1ad8e140 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ff1ad1d610 0x55ff1ad2c660 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f79097fa700 0 client.26335 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T12:59:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 --2- 172.21.15.142:0/3908977710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ff1ad1df30 0x55ff1ad2cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 >> 172.21.15.142:0/3908977710 conn(0x55ff1ac4a000 msgr2=0x55ff1ad32be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 shutdown_connections 2023-09-21T12:59:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 1 -- 172.21.15.142:0/3908977710 wait complete. 2023-09-21T12:59:27.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.603+0000 7f793b8b1b80 20 client.26335 trim_cache size 0 max 16384 2023-09-21T12:59:27.623 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:59:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 msgr2=0x7f790c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 0x7f790c0a2cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f791c006010 tx=0x7f791c00b260 comp rx=0 tx=0).stop 2023-09-21T12:59:27.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 msgr2=0x7f7920199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f7920199600 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9f0 tx=0x7f791000ed00 comp rx=0 tx=0).stop 2023-09-21T12:59:27.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 shutdown_connections 2023-09-21T12:59:27.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f790c0a0830 0x7f790c0a2cf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f792010d6b0 0x7f792019da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f79200ffb00 0x7f79201990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 --2- 172.21.15.142:0/3239560374 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79201004b0 0x7f7920199600 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 >> 172.21.15.142:0/3239560374 conn(0x7f79200fb740 msgr2=0x7f792010f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 shutdown_connections 2023-09-21T12:59:27.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.604+0000 7f7927fff700 1 -- 172.21.15.142:0/3239560374 wait complete. 2023-09-21T12:59:27.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T12:59:27.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 269058 10.49 MB/sec execute 8 sec latency 29.649 ms 2023-09-21T12:59:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1817842365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 msgr2=0x7f17e81013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1817842365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e81013a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f17d8009990 tx=0x7f17d8009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1817842365 shutdown_connections 2023-09-21T12:59:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1817842365 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e81060e0 0x7f17e810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1817842365 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e81013a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1817842365 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e8101970 0x7f17e81059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1817842365 >> 172.21.15.142:0/1817842365 conn(0x7f17e80fc840 msgr2=0x7f17e80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1817842365 shutdown_connections 2023-09-21T12:59:27.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.853+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1817842365 wait complete. 2023-09-21T12:59:27.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.854+0000 7f17ee7ff700 1 Processor -- start 2023-09-21T12:59:27.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.854+0000 7f17ee7ff700 1 -- start start 2023-09-21T12:59:27.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 0x7f17e8199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e819daa0 0x7f17e819df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e819e520 con 0x7f17e81060e0 2023-09-21T12:59:27.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e819e690 con 0x7f17e819daa0 2023-09-21T12:59:27.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ee7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e819e850 con 0x7f17e8100fc0 2023-09-21T12:59:27.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56256/0 (socket says 172.21.15.142:56256) 2023-09-21T12:59:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 -- 172.21.15.142:0/1227343518 learned_addr learned my addr 172.21.15.142:0/1227343518 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e819daa0 0x7f17e819df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 0x7f17e8199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 -- 172.21.15.142:0/1227343518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e819daa0 msgr2=0x7f17e819df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e819daa0 0x7f17e819df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 -- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 msgr2=0x7f17e8199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 0x7f17e8199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e7fff700 1 -- 172.21.15.142:0/1227343518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80095f0 con 0x7f17e8100fc0 2023-09-21T12:59:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.855+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 0x7f17e8199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:27.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17d8005910 tx=0x7f17d8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17e57fa700 1 -- 172.21.15.142:0/1227343518 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d801d070 con 0x7f17e8100fc0 2023-09-21T12:59:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e81a5d50 con 0x7f17e8100fc0 2023-09-21T12:59:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17e57fa700 1 -- 172.21.15.142:0/1227343518 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17d8022470 con 0x7f17e8100fc0 2023-09-21T12:59:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17e57fa700 1 -- 172.21.15.142:0/1227343518 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8017650 con 0x7f17e8100fc0 2023-09-21T12:59:27.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.856+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e81a6170 con 0x7f17e8100fc0 2023-09-21T12:59:27.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.859+0000 7f17e57fa700 1 -- 172.21.15.142:0/1227343518 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f17d80225e0 con 0x7f17e8100fc0 2023-09-21T12:59:27.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.860+0000 7f1802071b80 1 Processor -- start 2023-09-21T12:59:27.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.860+0000 7f1802071b80 1 -- start start 2023-09-21T12:59:27.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822f30 0x55b1c6826e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c68277c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6796ca0 con 0x55b1c6827360 2023-09-21T12:59:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c677ac70 con 0x55b1c6822610 2023-09-21T12:59:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f1802071b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6778590 con 0x55b1c6822f30 2023-09-21T12:59:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55414/0 (socket says 172.21.15.142:55414) 2023-09-21T12:59:27.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 -- 172.21.15.142:0/1299290506 learned_addr learned my addr 172.21.15.142:0/1299290506 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822f30 0x55b1c6826e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c68277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 -- 172.21.15.142:0/1299290506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822f30 msgr2=0x55b1c6826e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822f30 0x55b1c6826e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 -- 172.21.15.142:0/1299290506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 msgr2=0x55b1c68277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c68277c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.861+0000 7f17ecd9c700 1 -- 172.21.15.142:0/1299290506 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1c659ede0 con 0x55b1c6822610 2023-09-21T12:59:27.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f17e0011680 tx=0x7f17e0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c1d9739e4f11551 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17ce7fc700 1 -- 172.21.15.142:0/1299290506 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e000e040 con 0x55b1c6822610 2023-09-21T12:59:27.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17e57fa700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 0x7f17d00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17ce7fc700 1 -- 172.21.15.142:0/1299290506 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e000f040 con 0x55b1c6822610 2023-09-21T12:59:27.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17ce7fc700 1 -- 172.21.15.142:0/1299290506 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e0004860 con 0x55b1c6822610 2023-09-21T12:59:27.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17e57fa700 1 -- 172.21.15.142:0/1227343518 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17d80cd390 con 0x7f17e8100fc0 2023-09-21T12:59:27.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.862+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 0x7f17d00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- 172.21.15.142:0/1299290506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 msgr2=0x55b1c68229f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f17e0011680 tx=0x7f17e0009920 comp rx=0 tx=0).stop 2023-09-21T12:59:27.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f17e7fff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 0x7f17d00a2c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17d8029000 tx=0x7f17d8022f90 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- 172.21.15.142:0/1299290506 shutdown_connections 2023-09-21T12:59:27.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c68277c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822610 0x55b1c68229f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 --2- 172.21.15.142:0/1299290506 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822f30 0x55b1c6826e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- 172.21.15.142:0/1299290506 >> 172.21.15.142:0/1299290506 conn(0x55b1c674f000 msgr2=0x55b1c681d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- 172.21.15.142:0/1299290506 shutdown_connections 2023-09-21T12:59:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- 172.21.15.142:0/1299290506 wait complete. 2023-09-21T12:59:27.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.863+0000 7f1802071b80 1 -- start start 2023-09-21T12:59:27.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.864+0000 7f1802071b80 1 Processor -- start 2023-09-21T12:59:27.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c682ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6773e80 con 0x55b1c6822610 2023-09-21T12:59:27.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6710740 con 0x55b1c6822f30 2023-09-21T12:59:27.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c67103e0 con 0x55b1c6827360 2023-09-21T12:59:27.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f1802071b80 10 client.0 _ll_register_callbacks cb 0x55b1c665aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17ecd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c682ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55418/0 (socket says 172.21.15.142:55418) 2023-09-21T12:59:27.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 -- 172.21.15.142:0/321708318 learned_addr learned my addr 172.21.15.142:0/321708318 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 -- 172.21.15.142:0/321708318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 msgr2=0x55b1c682c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 -- 172.21.15.142:0/321708318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 msgr2=0x55b1c682ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c682ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17e77fe700 1 -- 172.21.15.142:0/321708318 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e0011330 con 0x55b1c6822f30 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.865+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c682ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17e77fe700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17dc012780 tx=0x7f17dc012b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e9aa7d5fc9766e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:27.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc0109e0 con 0x55b1c6822f30 2023-09-21T12:59:27.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1c66e4bb0 con 0x55b1c6822f30 2023-09-21T12:59:27.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17dc010b40 con 0x55b1c6822f30 2023-09-21T12:59:27.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17dc010d00 con 0x55b1c6822f30 2023-09-21T12:59:27.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f1802071b80 10 client.26387 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b1c6587c60 con 0x55b1c6822f30 2023-09-21T12:59:27.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.866+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b1c66e4bb0 con 0x55b1c6822f30 2023-09-21T12:59:27.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f17dc01c480 con 0x55b1c6822f30 2023-09-21T12:59:27.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 10 client.26387 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 10 client.26387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:27.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 20 client.26387 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c683c500 0x55b1c683e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 4 client.26387 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:27.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1c67f1020 con 0x55b1c683c500 2023-09-21T12:59:27.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c683c500 0x55b1c683e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c683c500 0x55b1c683e920 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a333544b70fb7345 server_cookie=5f2db1a0651be21f in_seq=0 out_seq=0 2023-09-21T12:59:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.867+0000 7f17c77fe700 10 client.26387 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f17c77fe700 1 -- 172.21.15.142:0/321708318 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1c67f1020 con 0x55b1c683c500 2023-09-21T12:59:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f17c77fe700 10 client.26387 handle_command_reply: tid=0 2023-09-21T12:59:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 client.26387 shutdown 2023-09-21T12:59:27.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 msgr2=0x55b1c682bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f17dc012780 tx=0x7f17dc012b40 comp rx=0 tx=0).stop 2023-09-21T12:59:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 shutdown_connections 2023-09-21T12:59:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c683c500 0x55b1c683e920 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c682ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f17c77fe700 0 client.26387 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:27.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 --2- 172.21.15.142:0/321708318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c682bd20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.868+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 >> 172.21.15.142:0/321708318 conn(0x55b1c674f000 msgr2=0x55b1c681c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.869+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 shutdown_connections 2023-09-21T12:59:27.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.869+0000 7f1802071b80 1 -- 172.21.15.142:0/321708318 wait complete. 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.869+0000 7f1802071b80 20 client.26387 trim_cache size 0 max 16384 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.882+0000 7f1802071b80 1 Processor -- start 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.882+0000 7f1802071b80 1 -- start start 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c68253b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c65f4920 con 0x55b1c6822610 2023-09-21T12:59:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6823670 con 0x55b1c6822f30 2023-09-21T12:59:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f1802071b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c6822d80 con 0x55b1c6827360 2023-09-21T12:59:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17ecd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c68253b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55426/0 (socket says 172.21.15.142:55426) 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 -- 172.21.15.142:0/1496232824 learned_addr learned my addr 172.21.15.142:0/1496232824 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 -- 172.21.15.142:0/1496232824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 msgr2=0x55b1c682b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 -- 172.21.15.142:0/1496232824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 msgr2=0x55b1c68253b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c68253b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 -- 172.21.15.142:0/1496232824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1c65c5250 con 0x55b1c6822f30 2023-09-21T12:59:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.883+0000 7f17e77fe700 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009920 tx=0x7f17dc0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77a40d9b88654b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f17ceffd700 1 -- 172.21.15.142:0/1496232824 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc01c3f0 con 0x55b1c6822f30 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f17ceffd700 1 -- 172.21.15.142:0/1496232824 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17dc01c550 con 0x55b1c6822f30 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f17ceffd700 1 -- 172.21.15.142:0/1496232824 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc010de0 con 0x55b1c6822f30 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 -- 172.21.15.142:0/1496232824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 msgr2=0x55b1c68258f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009920 tx=0x7f17dc0095c0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 -- 172.21.15.142:0/1496232824 shutdown_connections 2023-09-21T12:59:27.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6822610 0x55b1c68253b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6827360 0x55b1c682b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 --2- 172.21.15.142:0/1496232824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c68258f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 -- 172.21.15.142:0/1496232824 >> 172.21.15.142:0/1496232824 conn(0x55b1c674f000 msgr2=0x55b1c6829750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.884+0000 7f1802071b80 1 -- 172.21.15.142:0/1496232824 shutdown_connections 2023-09-21T12:59:27.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.885+0000 7f1802071b80 1 -- 172.21.15.142:0/1496232824 wait complete. 2023-09-21T12:59:27.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.885+0000 7f1802071b80 1 -- start start 2023-09-21T12:59:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.885+0000 7f1802071b80 1 Processor -- start 2023-09-21T12:59:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.885+0000 7f1802071b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822610 0x55b1c6889650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c682f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c682fb30 con 0x55b1c6827360 2023-09-21T12:59:27.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c682fca0 con 0x55b1c6822f30 2023-09-21T12:59:27.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c682fe60 con 0x55b1c6822610 2023-09-21T12:59:27.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f1802071b80 10 client.0 _ll_register_callbacks cb 0x55b1c665aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:27.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17ecd9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822610 0x55b1c6889650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55434/0 (socket says 172.21.15.142:55434) 2023-09-21T12:59:27.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 -- 172.21.15.142:0/3175763110 learned_addr learned my addr 172.21.15.142:0/3175763110 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:27.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c682f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 -- 172.21.15.142:0/3175763110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822610 msgr2=0x55b1c6889650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822610 0x55b1c6889650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 -- 172.21.15.142:0/3175763110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 msgr2=0x55b1c682f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:27.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c682f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 -- 172.21.15.142:0/3175763110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1c6587c60 con 0x55b1c6822f30 2023-09-21T12:59:27.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c682f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:27.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17e77fe700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17dc01ca20 tx=0x7f17dc01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=117b730239899829 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:27.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.886+0000 7f17c77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:27.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc005590 con 0x55b1c6822f30 2023-09-21T12:59:27.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17e000f040 con 0x55b1c6822f30 2023-09-21T12:59:27.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17dc000e40 con 0x55b1c6822f30 2023-09-21T12:59:27.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17dc0056f0 con 0x55b1c6822f30 2023-09-21T12:59:27.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 10 client.26393 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:27.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b1c659d2b0 con 0x55b1c6822f30 2023-09-21T12:59:27.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17e000f040 con 0x55b1c6822f30 2023-09-21T12:59:27.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f17dc003be0 con 0x55b1c6822f30 2023-09-21T12:59:27.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 10 client.26393 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:27.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 10 client.26393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:27.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 20 client.26393 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:27.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c6891200 0x55b1c6893620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:27.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 4 client.26393 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T12:59:27.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.887+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b1c676ce60 con 0x55b1c6891200 2023-09-21T12:59:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c6891200 0x55b1c6893620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17c77fe700 10 client.26393 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17ecd9c700 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c6891200 0x55b1c6893620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2c31e0264c466b8 server_cookie=d42919ccdc18c65f in_seq=0 out_seq=0 2023-09-21T12:59:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17c77fe700 1 -- 172.21.15.142:0/3175763110 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b1c676ce60 con 0x55b1c6891200 2023-09-21T12:59:27.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17c77fe700 10 client.26393 handle_command_reply: tid=0 2023-09-21T12:59:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 client.26393 shutdown 2023-09-21T12:59:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 msgr2=0x55b1c6889b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f17dc01ca20 tx=0x7f17dc01c3f0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 shutdown_connections 2023-09-21T12:59:27.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b1c6891200 0x55b1c6893620 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b1c6827360 0x55b1c682f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b1c6822610 0x55b1c6889650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f17c77fe700 0 client.26393 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 --2- 172.21.15.142:0/3175763110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b1c6822f30 0x55b1c6889b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.888+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 >> 172.21.15.142:0/3175763110 conn(0x55b1c674f000 msgr2=0x55b1c6829750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 shutdown_connections 2023-09-21T12:59:27.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f1802071b80 1 -- 172.21.15.142:0/3175763110 wait complete. 2023-09-21T12:59:27.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f1802071b80 20 client.26393 trim_cache size 0 max 16384 2023-09-21T12:59:27.906 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T12:59:27.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 msgr2=0x7f17d00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 0x7f17d00a2c70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f17d8029000 tx=0x7f17d8022f90 comp rx=0 tx=0).stop 2023-09-21T12:59:27.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 msgr2=0x7f17e8199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:27.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17d8005910 tx=0x7f17d8005740 comp rx=0 tx=0).stop 2023-09-21T12:59:27.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 shutdown_connections 2023-09-21T12:59:27.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17d00a07b0 0x7f17d00a2c70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17e819daa0 0x7f17e819df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17e8100fc0 0x7f17e8199100 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 --2- 172.21.15.142:0/1227343518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17e81060e0 0x7f17e8199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:27.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.889+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 >> 172.21.15.142:0/1227343518 conn(0x7f17e80fc840 msgr2=0x7f17e8102980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:27.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.890+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 shutdown_connections 2023-09-21T12:59:27.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:27.890+0000 7f17ee7ff700 1 -- 172.21.15.142:0/1227343518 wait complete. 2023-09-21T12:59:27.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:27 smithi142 ceph-mon[97663]: pgmap v99: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 444 op/s 2023-09-21T12:59:27.910 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:27 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1049639106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:59:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:27 smithi156 ceph-mon[134078]: pgmap v99: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 444 op/s 2023-09-21T12:59:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:27 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1049639106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:59:28.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:27 smithi160 ceph-mon[134450]: pgmap v99: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 444 op/s 2023-09-21T12:59:28.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:27 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1049639106' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T12:59:28.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 270470 10.12 MB/sec execute 9 sec latency 42.185 ms 2023-09-21T12:59:28.911 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T12:59:28.912 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T12:59:29.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 -- 172.21.15.142:0/4151945865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b0100fa0 msgr2=0x7f94b0101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 --2- 172.21.15.142:0/4151945865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b0100fa0 0x7f94b0101380 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f94a0009990 tx=0x7f94a0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 -- 172.21.15.142:0/4151945865 shutdown_connections 2023-09-21T12:59:29.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 --2- 172.21.15.142:0/4151945865 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b01060c0 0x7f94b010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 --2- 172.21.15.142:0/4151945865 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b0100fa0 0x7f94b0101380 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 --2- 172.21.15.142:0/4151945865 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b0101950 0x7f94b0105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 -- 172.21.15.142:0/4151945865 >> 172.21.15.142:0/4151945865 conn(0x7f94b00fc860 msgr2=0x7f94b00fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 -- 172.21.15.142:0/4151945865 shutdown_connections 2023-09-21T12:59:29.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.136+0000 7f94b4bff700 1 -- 172.21.15.142:0/4151945865 wait complete. 2023-09-21T12:59:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.137+0000 7f94b4bff700 1 Processor -- start 2023-09-21T12:59:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.137+0000 7f94b4bff700 1 -- start start 2023-09-21T12:59:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 0x7f94b0196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b01060c0 0x7f94b0197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019c300 con 0x7f94b0100fa0 2023-09-21T12:59:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019c470 con 0x7f94b01060c0 2023-09-21T12:59:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94b4bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b019c630 con 0x7f94b019b880 2023-09-21T12:59:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 0x7f94b0196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 0x7f94b0196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36184/0 (socket says 172.21.15.142:36184) 2023-09-21T12:59:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94ae59c700 1 -- 172.21.15.142:0/2131156482 learned_addr learned my addr 172.21.15.142:0/2131156482 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56328/0 (socket says 172.21.15.142:56328) 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94add9b700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b01060c0 0x7f94b0197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 -- 172.21.15.142:0/2131156482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b01060c0 msgr2=0x7f94b0197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b01060c0 0x7f94b0197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 -- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 msgr2=0x7f94b0196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 0x7f94b0196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.138+0000 7f94aed9d700 1 -- 172.21.15.142:0/2131156482 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a00095f0 con 0x7f94b019b880 2023-09-21T12:59:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f94aed9d700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f94a800efc0 tx=0x7f94a800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f949f7fe700 1 -- 172.21.15.142:0/2131156482 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8018070 con 0x7f94b019b880 2023-09-21T12:59:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f949f7fe700 1 -- 172.21.15.142:0/2131156482 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94a800f040 con 0x7f94b019b880 2023-09-21T12:59:29.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f949f7fe700 1 -- 172.21.15.142:0/2131156482 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800cd40 con 0x7f94b019b880 2023-09-21T12:59:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b01a3b30 con 0x7f94b019b880 2023-09-21T12:59:29.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.139+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b01a3fc0 con 0x7f94b019b880 2023-09-21T12:59:29.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.143+0000 7f949f7fe700 1 -- 172.21.15.142:0/2131156482 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f94a8003a00 con 0x7f94b019b880 2023-09-21T12:59:29.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.144+0000 7f949f7fe700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 0x7f94980a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.145+0000 7f949f7fe700 1 -- 172.21.15.142:0/2131156482 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94a80cbaa0 con 0x7f94b019b880 2023-09-21T12:59:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.145+0000 7f94ae59c700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 0x7f94980a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.145+0000 7f94c84f2b80 1 Processor -- start 2023-09-21T12:59:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.145+0000 7f94c84f2b80 1 -- start start 2023-09-21T12:59:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.145+0000 7f94ae59c700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 0x7f94980a2cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006010 tx=0x7f94a000b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99f7f0 0x55ad6e99fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e90ad20 con 0x55ad6e99f7f0 2023-09-21T12:59:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e8eecf0 con 0x55ad6e99aaa0 2023-09-21T12:59:29.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e8ec610 con 0x55ad6e99b3c0 2023-09-21T12:59:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56332/0 (socket says 172.21.15.142:56332) 2023-09-21T12:59:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99f7f0 0x55ad6e99fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 -- 172.21.15.142:0/3041715106 learned_addr learned my addr 172.21.15.142:0/3041715106 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94ae59c700 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 -- 172.21.15.142:0/3041715106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99aaa0 msgr2=0x55ad6e99ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 -- 172.21.15.142:0/3041715106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99f7f0 msgr2=0x55ad6e99fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99f7f0 0x55ad6e99fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.146+0000 7f94add9b700 1 -- 172.21.15.142:0/3041715106 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad6e712e60 con 0x55ad6e99b3c0 2023-09-21T12:59:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.147+0000 7f94add9b700 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009cf0 tx=0x7f94a4011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc6d1dbecdc624ae server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.147+0000 7f949cff9700 1 -- 172.21.15.142:0/3041715106 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4011d80 con 0x55ad6e99b3c0 2023-09-21T12:59:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.147+0000 7f949cff9700 1 -- 172.21.15.142:0/3041715106 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94a4004510 con 0x55ad6e99b3c0 2023-09-21T12:59:29.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.147+0000 7f949cff9700 1 -- 172.21.15.142:0/3041715106 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a4005280 con 0x55ad6e99b3c0 2023-09-21T12:59:29.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3041715106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 msgr2=0x55ad6e99f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f94a4009cf0 tx=0x7f94a4011440 comp rx=0 tx=0).stop 2023-09-21T12:59:29.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3041715106 shutdown_connections 2023-09-21T12:59:29.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99f7f0 0x55ad6e99fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3041715106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e99f2b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3041715106 >> 172.21.15.142:0/3041715106 conn(0x55ad6e8c3080 msgr2=0x55ad6e991720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3041715106 shutdown_connections 2023-09-21T12:59:29.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.148+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3041715106 wait complete. 2023-09-21T12:59:29.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.149+0000 7f94c84f2b80 1 -- start start 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.149+0000 7f94c84f2b80 1 Processor -- start 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e8e7f00 con 0x55ad6e99aaa0 2023-09-21T12:59:29.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e8847c0 con 0x55ad6e99b3c0 2023-09-21T12:59:29.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e884460 con 0x55ad6e99f7f0 2023-09-21T12:59:29.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94c84f2b80 10 client.0 _ll_register_callbacks cb 0x55ad6e7ceb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:29.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94add9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56342/0 (socket says 172.21.15.142:56342) 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.150+0000 7f94aed9d700 1 -- 172.21.15.142:0/1905708174 learned_addr learned my addr 172.21.15.142:0/1905708174 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 -- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 msgr2=0x55ad6e9a48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 -- 172.21.15.142:0/1905708174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 msgr2=0x55ad6e9a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 -- 172.21.15.142:0/1905708174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a4009920 con 0x55ad6e99f7f0 2023-09-21T12:59:29.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94add9b700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94aed9d700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c6f0 tx=0x7f94a8098990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95505953c6f232fc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f9495ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:29.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80996b0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94a8098fb0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad6e858c30 con 0x55ad6e99f7f0 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94a809cde0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94c84f2b80 10 client.26365 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ad6e6fbce0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.151+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ad6e858c30 con 0x55ad6e99f7f0 2023-09-21T12:59:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f94a80985a0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 10 client.26365 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 10 client.26365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 20 client.26365 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:29.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6e9b4880 0x55ad6e9b6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 4 client.26365 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad6e9650a0 con 0x55ad6e9b4880 2023-09-21T12:59:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.152+0000 7f94ae59c700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6e9b4880 0x55ad6e9b6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.153+0000 7f94ae59c700 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6e9b4880 0x55ad6e9b6ca0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=630b1ecdd1fbbdbd server_cookie=899d3f9e3f04965f in_seq=0 out_seq=0 2023-09-21T12:59:29.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.153+0000 7f9495ffb700 10 client.26365 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.153+0000 7f9495ffb700 1 -- 172.21.15.142:0/1905708174 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad6e9650a0 con 0x55ad6e9b4880 2023-09-21T12:59:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.153+0000 7f9495ffb700 10 client.26365 handle_command_reply: tid=0 2023-09-21T12:59:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.153+0000 7f94c84f2b80 1 client.26365 shutdown 2023-09-21T12:59:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 msgr2=0x55ad6e9a4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f94a800c6f0 tx=0x7f94a8098990 comp rx=0 tx=0).stop 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 shutdown_connections 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6e9b4880 0x55ad6e9b6ca0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6e9a4df0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/1905708174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f9495ffb700 0 client.26365 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 >> 172.21.15.142:0/1905708174 conn(0x55ad6e8c3080 msgr2=0x55ad6e991310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 shutdown_connections 2023-09-21T12:59:29.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 1 -- 172.21.15.142:0/1905708174 wait complete. 2023-09-21T12:59:29.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.154+0000 7f94c84f2b80 20 client.26365 trim_cache size 0 max 16384 2023-09-21T12:59:29.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.178+0000 7f94c84f2b80 1 Processor -- start 2023-09-21T12:59:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.178+0000 7f94c84f2b80 1 -- start start 2023-09-21T12:59:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.178+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.178+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9ab9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e7689a0 con 0x55ad6e99aaa0 2023-09-21T12:59:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e992ce0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e99b7a0 con 0x55ad6e99b3c0 2023-09-21T12:59:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55474/0 (socket says 172.21.15.142:55474) 2023-09-21T12:59:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 -- 172.21.15.142:0/3249829742 learned_addr learned my addr 172.21.15.142:0/3249829742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94add9b700 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9ab9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 -- 172.21.15.142:0/3249829742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 msgr2=0x55ad6e9ab9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9ab9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 -- 172.21.15.142:0/3249829742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 msgr2=0x55ad6e99f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 -- 172.21.15.142:0/3249829742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad6e7392d0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94add9b700 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:29.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.179+0000 7f94aed9d700 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94a8095a20 tx=0x7f94a8004dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7f61bb1fd7b13c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.180+0000 7f949d7fa700 1 -- 172.21.15.142:0/3249829742 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80a0dc0 con 0x55ad6e99f7f0 2023-09-21T12:59:29.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.180+0000 7f949d7fa700 1 -- 172.21.15.142:0/3249829742 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94a801b320 con 0x55ad6e99f7f0 2023-09-21T12:59:29.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.180+0000 7f949d7fa700 1 -- 172.21.15.142:0/3249829742 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80a0f90 con 0x55ad6e99f7f0 2023-09-21T12:59:29.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.180+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3249829742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 msgr2=0x55ad6e995ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.180+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94a8095a20 tx=0x7f94a8004dc0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3249829742 shutdown_connections 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e99f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99f7f0 0x55ad6e995ba0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3249829742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9ab9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3249829742 >> 172.21.15.142:0/3249829742 conn(0x55ad6e8c3080 msgr2=0x55ad6e995490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3249829742 shutdown_connections 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3249829742 wait complete. 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.181+0000 7f94c84f2b80 1 -- start start 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 Processor -- start 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6ea086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6e9a9270 con 0x55ad6e99aaa0 2023-09-21T12:59:29.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6ea08bf0 con 0x55ad6e99b3c0 2023-09-21T12:59:29.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad6ea08d60 con 0x55ad6e99f7f0 2023-09-21T12:59:29.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.182+0000 7f94c84f2b80 10 client.0 _ll_register_callbacks cb 0x55ad6e7ceb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:29.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94add9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94add9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55480/0 (socket says 172.21.15.142:55480) 2023-09-21T12:59:29.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36212/0 (socket says 172.21.15.142:36212) 2023-09-21T12:59:29.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94add9b700 1 -- 172.21.15.142:0/3756549710 learned_addr learned my addr 172.21.15.142:0/3756549710 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94aed9d700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6ea086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 -- 172.21.15.142:0/3756549710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 msgr2=0x55ad6ea086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6ea086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 -- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 msgr2=0x55ad6e9a8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 -- 172.21.15.142:0/3756549710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad6e6fbce0 con 0x55ad6e99aaa0 2023-09-21T12:59:29.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94add9b700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f94ae59c700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55ad6e9b75b0 tx=0x7f94a0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9948e4cd9c29f653 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.183+0000 7f9495ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T12:59:29.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a0036d10 con 0x55ad6e99aaa0 2023-09-21T12:59:29.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94a4004510 con 0x55ad6e99aaa0 2023-09-21T12:59:29.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94a00360c0 con 0x55ad6e99aaa0 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94a0036e70 con 0x55ad6e99aaa0 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f94c84f2b80 10 client.16326 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ad6e711330 con 0x55ad6e99aaa0 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f94a4004510 con 0x55ad6e99aaa0 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f94a0004cc0 con 0x55ad6e99aaa0 2023-09-21T12:59:29.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.184+0000 7f94c84f2b80 10 client.16326 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94c84f2b80 10 client.16326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94c84f2b80 20 client.16326 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6ea0a4a0 0x55ad6ea0c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94c84f2b80 4 client.16326 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T12:59:29.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ad6e8e0ee0 con 0x55ad6ea0a4a0 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94add9b700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6ea0a4a0 0x55ad6ea0c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f9495ffb700 10 client.16326 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.185+0000 7f94add9b700 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6ea0a4a0 0x55ad6ea0c8c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db1de3bb223037f3 server_cookie=1795a4486456877 in_seq=0 out_seq=0 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f9495ffb700 1 -- 172.21.15.142:0/3756549710 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ad6e8e0ee0 con 0x55ad6ea0a4a0 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f9495ffb700 10 client.16326 handle_command_reply: tid=0 2023-09-21T12:59:29.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 client.16326 shutdown 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 msgr2=0x55ad6e9a83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x55ad6e9b75b0 tx=0x7f94a0009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 shutdown_connections 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ad6ea0a4a0 0x55ad6ea0c8c0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ad6e99aaa0 0x55ad6e9a83f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f9495ffb700 0 client.16326 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ad6e99f7f0 0x55ad6ea086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 --2- 172.21.15.142:0/3756549710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ad6e99b3c0 0x55ad6e9a8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.186+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 >> 172.21.15.142:0/3756549710 conn(0x55ad6e8c3080 msgr2=0x55ad6e995d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 shutdown_connections 2023-09-21T12:59:29.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94c84f2b80 1 -- 172.21.15.142:0/3756549710 wait complete. 2023-09-21T12:59:29.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94c84f2b80 20 client.16326 trim_cache size 0 max 16384 2023-09-21T12:59:29.199 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:59:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T12:59:29.199 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "735f1def-b355-4d3e-bd40-8d0a55b5ad02", 2023-09-21T12:59:29.200 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T12:59:29.200 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:59:29.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 msgr2=0x7f94980a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 0x7f94980a2cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006010 tx=0x7f94a000b260 comp rx=0 tx=0).stop 2023-09-21T12:59:29.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 msgr2=0x7f94b019bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.187+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f94a800efc0 tx=0x7f94a800c3a0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 shutdown_connections 2023-09-21T12:59:29.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f94980a0830 0x7f94980a2cf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f94b0100fa0 0x7f94b0196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94b019b880 0x7f94b019bd00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 --2- 172.21.15.142:0/2131156482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f94b01060c0 0x7f94b0197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 >> 172.21.15.142:0/2131156482 conn(0x7f94b00fc860 msgr2=0x7f94b01049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 shutdown_connections 2023-09-21T12:59:29.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.188+0000 7f94b4bff700 1 -- 172.21.15.142:0/2131156482 wait complete. 2023-09-21T12:59:29.209 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:59:29.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.423+0000 7f15b3bff700 1 -- 172.21.15.142:0/552879804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac101970 msgr2=0x7f15ac1059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.423+0000 7f15b3bff700 1 --2- 172.21.15.142:0/552879804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac101970 0x7f15ac1059b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f159c009990 tx=0x7f159c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 -- 172.21.15.142:0/552879804 shutdown_connections 2023-09-21T12:59:29.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 --2- 172.21.15.142:0/552879804 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac1060e0 0x7f15ac10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 --2- 172.21.15.142:0/552879804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac100fc0 0x7f15ac1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 --2- 172.21.15.142:0/552879804 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac101970 0x7f15ac1059b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 -- 172.21.15.142:0/552879804 >> 172.21.15.142:0/552879804 conn(0x7f15ac0fc840 msgr2=0x7f15ac0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 -- 172.21.15.142:0/552879804 shutdown_connections 2023-09-21T12:59:29.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.424+0000 7f15b3bff700 1 -- 172.21.15.142:0/552879804 wait complete. 2023-09-21T12:59:29.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 Processor -- start 2023-09-21T12:59:29.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 -- start start 2023-09-21T12:59:29.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 0x7f15ac196ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 0x7f15ac197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c300 con 0x7f15ac100fc0 2023-09-21T12:59:29.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c470 con 0x7f15ac19b880 2023-09-21T12:59:29.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b3bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac19c630 con 0x7f15ac1060e0 2023-09-21T12:59:29.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 0x7f15ac196ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b119a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 0x7f15ac197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 0x7f15ac196ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36234/0 (socket says 172.21.15.142:36234) 2023-09-21T12:59:29.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b199b700 1 -- 172.21.15.142:0/1573089994 learned_addr learned my addr 172.21.15.142:0/1573089994 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.425+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55494/0 (socket says 172.21.15.142:55494) 2023-09-21T12:59:29.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 -- 172.21.15.142:0/1573089994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 msgr2=0x7f15ac19bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 -- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 msgr2=0x7f15ac196ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 0x7f15ac196ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 -- 172.21.15.142:0/1573089994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0095f0 con 0x7f15ac1060e0 2023-09-21T12:59:29.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b219c700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b119a700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 0x7f15ac197420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15ac06a350 tx=0x7f159c009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15a2ffd700 1 -- 172.21.15.142:0/1573089994 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c01d070 con 0x7f15ac1060e0 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac073010 con 0x7f15ac1060e0 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15a2ffd700 1 -- 172.21.15.142:0/1573089994 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159c021410 con 0x7f15ac1060e0 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.426+0000 7f15a2ffd700 1 -- 172.21.15.142:0/1573089994 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c017650 con 0x7f15ac1060e0 2023-09-21T12:59:29.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.427+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac073570 con 0x7f15ac1060e0 2023-09-21T12:59:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.430+0000 7f15a2ffd700 1 -- 172.21.15.142:0/1573089994 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f159c021810 con 0x7f15ac1060e0 2023-09-21T12:59:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.431+0000 7f15c7427b80 1 Processor -- start 2023-09-21T12:59:29.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.431+0000 7f15a2ffd700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 0x7f15980a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.431+0000 7f15c7427b80 1 -- start start 2023-09-21T12:59:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.431+0000 7f15a2ffd700 1 -- 172.21.15.142:0/1573089994 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f159c0cd160 con 0x7f15ac1060e0 2023-09-21T12:59:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b219c700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 0x7f15980a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 0x55c9893ace20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893ad360 0x55c9893ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98931cca0 con 0x55c9893ad360 2023-09-21T12:59:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c989300c70 con 0x55c9893a8f30 2023-09-21T12:59:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15c7427b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9892fe590 con 0x55c9893a8610 2023-09-21T12:59:29.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56394/0 (socket says 172.21.15.142:56394) 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b199b700 1 -- 172.21.15.142:0/1604624036 learned_addr learned my addr 172.21.15.142:0/1604624036 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 0x55c9893ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b219c700 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893ad360 0x55c9893ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 -- 172.21.15.142:0/1604624036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 msgr2=0x55c9893a89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 -- 172.21.15.142:0/1604624036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893ad360 msgr2=0x55c9893ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893ad360 0x55c9893ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b119a700 1 -- 172.21.15.142:0/1604624036 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c989124de0 con 0x55c9893a8f30 2023-09-21T12:59:29.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.432+0000 7f15b199b700 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.433+0000 7f15b119a700 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 0x55c9893ace20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f159c0ca880 tx=0x7f159c096a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecb1aa81559f52dc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.433+0000 7f15b219c700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 0x7f15980a2c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15a401c330 tx=0x7f15a400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.433+0000 7f1597fff700 1 -- 172.21.15.142:0/1604624036 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c09ad70 con 0x55c9893a8f30 2023-09-21T12:59:29.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.433+0000 7f1597fff700 1 -- 172.21.15.142:0/1604624036 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159c09a670 con 0x55c9893a8f30 2023-09-21T12:59:29.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.433+0000 7f1597fff700 1 -- 172.21.15.142:0/1604624036 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c09e120 con 0x55c9893a8f30 2023-09-21T12:59:29.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- 172.21.15.142:0/1604624036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 msgr2=0x55c9893ace20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 0x55c9893ace20 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f159c0ca880 tx=0x7f159c096a80 comp rx=0 tx=0).stop 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- 172.21.15.142:0/1604624036 shutdown_connections 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893ad360 0x55c9893ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893a89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1604624036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893a8f30 0x55c9893ace20 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- 172.21.15.142:0/1604624036 >> 172.21.15.142:0/1604624036 conn(0x55c9892d5000 msgr2=0x55c9893a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- 172.21.15.142:0/1604624036 shutdown_connections 2023-09-21T12:59:29.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- 172.21.15.142:0/1604624036 wait complete. 2023-09-21T12:59:29.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.434+0000 7f15c7427b80 1 -- start start 2023-09-21T12:59:29.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 Processor -- start 2023-09-21T12:59:29.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 0x55c9893b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9892f9e80 con 0x55c9893a8610 2023-09-21T12:59:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c989296740 con 0x55c9893ad360 2023-09-21T12:59:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9892963e0 con 0x55c9893a8f30 2023-09-21T12:59:29.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.435+0000 7f15c7427b80 10 client.0 _ll_register_callbacks cb 0x55c9891e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 0x55c9893b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36256/0 (socket says 172.21.15.142:36256) 2023-09-21T12:59:29.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55516/0 (socket says 172.21.15.142:55516) 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b199b700 1 -- 172.21.15.142:0/2321535019 learned_addr learned my addr 172.21.15.142:0/2321535019 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 -- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 msgr2=0x55c9893b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 -- 172.21.15.142:0/2321535019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 msgr2=0x55c9893b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 -- 172.21.15.142:0/2321535019 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8009a80 con 0x55c9893a8f30 2023-09-21T12:59:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b199b700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15b119a700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 0x55c9893b1d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f159c09e660 tx=0x7f159c005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed01b9a2e481d75d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15957fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0a2650 con 0x55c9893a8f30 2023-09-21T12:59:29.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c98926abb0 con 0x55c9893a8f30 2023-09-21T12:59:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.436+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f159c09e4a0 con 0x55c9893a8f30 2023-09-21T12:59:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f159c0661a0 con 0x55c9893a8f30 2023-09-21T12:59:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 10 client.26383 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f159c083e70 con 0x55c9893a8f30 2023-09-21T12:59:29.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c98926abb0 con 0x55c9893a8f30 2023-09-21T12:59:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f159c09a940 con 0x55c9893a8f30 2023-09-21T12:59:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 10 client.26383 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 10 client.26383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 20 client.26383 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:29.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c9893c1bc0 0x55c9893c3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 4 client.26383 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c989377020 con 0x55c9893c1bc0 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.437+0000 7f15b199b700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c9893c1bc0 0x55c9893c3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.438+0000 7f15b199b700 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c9893c1bc0 0x55c9893c3fb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91374ccf467754a server_cookie=f0f401a603643547 in_seq=0 out_seq=0 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.438+0000 7f15957fa700 10 client.26383 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15957fa700 1 -- 172.21.15.142:0/2321535019 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c989377020 con 0x55c9893c1bc0 2023-09-21T12:59:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15957fa700 10 client.26383 handle_command_reply: tid=0 2023-09-21T12:59:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 client.26383 shutdown 2023-09-21T12:59:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 msgr2=0x55c9893b1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 0x55c9893b1d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f159c09e660 tx=0x7f159c005a90 comp rx=0 tx=0).stop 2023-09-21T12:59:29.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 shutdown_connections 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c9893c1bc0 0x55c9893c3fb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8610 0x55c9893b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15957fa700 0 client.26383 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 --2- 172.21.15.142:0/2321535019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8f30 0x55c9893b1d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 >> 172.21.15.142:0/2321535019 conn(0x55c9892d5000 msgr2=0x55c9893a3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 shutdown_connections 2023-09-21T12:59:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 1 -- 172.21.15.142:0/2321535019 wait complete. 2023-09-21T12:59:29.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.439+0000 7f15c7427b80 20 client.26383 trim_cache size 0 max 16384 2023-09-21T12:59:29.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 Processor -- start 2023-09-21T12:59:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 -- start start 2023-09-21T12:59:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98917a920 con 0x55c9893a8f30 2023-09-21T12:59:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c98926abb0 con 0x55c9893ad360 2023-09-21T12:59:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15c7427b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9893a94b0 con 0x55c9893a8610 2023-09-21T12:59:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15b119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15b119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36260/0 (socket says 172.21.15.142:36260) 2023-09-21T12:59:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15b119a700 1 -- 172.21.15.142:0/1041348442 learned_addr learned my addr 172.21.15.142:0/1041348442 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15b219c700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.457+0000 7f15b199b700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 -- 172.21.15.142:0/1041348442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 msgr2=0x55c9893aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 -- 172.21.15.142:0/1041348442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 msgr2=0x55c9893b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 -- 172.21.15.142:0/1041348442 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9893b18f0 con 0x55c9893a8f30 2023-09-21T12:59:29.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b199b700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15b119a700 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0ca880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4a9a6a24978f2c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15a0bff700 1 -- 172.21.15.142:0/1041348442 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c0a2650 con 0x55c9893a8f30 2023-09-21T12:59:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15a0bff700 1 -- 172.21.15.142:0/1041348442 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159c09e4a0 con 0x55c9893a8f30 2023-09-21T12:59:29.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.458+0000 7f15a0bff700 1 -- 172.21.15.142:0/1041348442 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c09a8d0 con 0x55c9893a8f30 2023-09-21T12:59:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- 172.21.15.142:0/1041348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 msgr2=0x55c9893b4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c0ca880 comp rx=0 tx=0).stop 2023-09-21T12:59:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- 172.21.15.142:0/1041348442 shutdown_connections 2023-09-21T12:59:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c9893b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1041348442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b4630 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- 172.21.15.142:0/1041348442 >> 172.21.15.142:0/1041348442 conn(0x55c9892d5000 msgr2=0x55c9893ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- 172.21.15.142:0/1041348442 shutdown_connections 2023-09-21T12:59:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- 172.21.15.142:0/1041348442 wait complete. 2023-09-21T12:59:29.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.459+0000 7f15c7427b80 1 -- start start 2023-09-21T12:59:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.460+0000 7f15c7427b80 1 Processor -- start 2023-09-21T12:59:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.460+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893b7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c989414eb0 con 0x55c9893a8f30 2023-09-21T12:59:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c989414ff0 con 0x55c9893ad360 2023-09-21T12:59:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9894151b0 con 0x55c9893a8610 2023-09-21T12:59:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15c7427b80 10 client.0 _ll_register_callbacks cb 0x55c9891e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b119a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55540/0 (socket says 172.21.15.142:55540) 2023-09-21T12:59:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 -- 172.21.15.142:0/1027898744 learned_addr learned my addr 172.21.15.142:0/1027898744 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56426/0 (socket says 172.21.15.142:56426) 2023-09-21T12:59:29.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 -- 172.21.15.142:0/1027898744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 msgr2=0x55c9893b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 -- 172.21.15.142:0/1027898744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 msgr2=0x55c9893b7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b219c700 1 -- 172.21.15.142:0/1027898744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a8012760 con 0x55c9893ad360 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.461+0000 7f15b119a700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:29.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15b219c700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15a401ca80 tx=0x7f15a4012040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0c9f46ab2768cf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:29.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:29.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4015030 con 0x55c9893ad360 2023-09-21T12:59:29.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f15a4024040 con 0x55c9893ad360 2023-09-21T12:59:29.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f159c09a670 con 0x55c9893ad360 2023-09-21T12:59:29.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15a401fe10 con 0x55c9893ad360 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 10 client.26429 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f159c083e70 con 0x55c9893ad360 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f159c09a670 con 0x55c9893ad360 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f15a4004020 con 0x55c9893ad360 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 10 client.26429 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:29.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 10 client.26429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 20 client.26429 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.462+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c989416940 0x55c989418d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15c7427b80 4 client.26429 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:59:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c9892f2e60 con 0x55c989416940 2023-09-21T12:59:29.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15b199b700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c989416940 0x55c989418d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15957fa700 10 client.26429 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15b199b700 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c989416940 0x55c989418d60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18a5a3756286bb66 server_cookie=a79de7d7414ac245 in_seq=0 out_seq=0 2023-09-21T12:59:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15957fa700 1 -- 172.21.15.142:0/1027898744 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55c9892f2e60 con 0x55c989416940 2023-09-21T12:59:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15957fa700 10 client.26429 handle_command_reply: tid=0 2023-09-21T12:59:29.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15c7427b80 1 client.26429 shutdown 2023-09-21T12:59:29.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.463+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 msgr2=0x55c989414970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f15a401ca80 tx=0x7f15a4012040 comp rx=0 tx=0).stop 2023-09-21T12:59:29.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 shutdown_connections 2023-09-21T12:59:29.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c989416940 0x55c989418d60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c9893ad360 0x55c989414970 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c9893a8610 0x55c9893b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 --2- 172.21.15.142:0/1027898744 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c9893a8f30 0x55c9893b7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15957fa700 0 client.26429 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:29.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 >> 172.21.15.142:0/1027898744 conn(0x55c9892d5000 msgr2=0x55c9893a7410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 shutdown_connections 2023-09-21T12:59:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 1 -- 172.21.15.142:0/1027898744 wait complete. 2023-09-21T12:59:29.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15c7427b80 20 client.26429 trim_cache size 0 max 16384 2023-09-21T12:59:29.478 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:59:29.478 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T12:59:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T12:59:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "735f1def-b355-4d3e-bd40-8d0a55b5ad02": { 2023-09-21T12:59:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T12:59:29.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "735f1def-b355-4d3e-bd40-8d0a55b5ad02", 2023-09-21T12:59:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T12:59:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:59:29.480 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T12:59:29.480 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:59:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 msgr2=0x7f15980a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 0x7f15980a2c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f15a401c330 tx=0x7f15a400b040 comp rx=0 tx=0).stop 2023-09-21T12:59:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 msgr2=0x7f15ac197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 0x7f15ac197420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f15ac06a350 tx=0x7f159c009580 comp rx=0 tx=0).stop 2023-09-21T12:59:29.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 shutdown_connections 2023-09-21T12:59:29.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.464+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f15980a07b0 0x7f15980a2c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f15ac100fc0 0x7f15ac196ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f15ac19b880 0x7f15ac19bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 --2- 172.21.15.142:0/1573089994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15ac1060e0 0x7f15ac197420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:29.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 >> 172.21.15.142:0/1573089994 conn(0x7f15ac0fc840 msgr2=0x7f15ac0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:29.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 shutdown_connections 2023-09-21T12:59:29.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:29.465+0000 7f15b3bff700 1 -- 172.21.15.142:0/1573089994 wait complete. 2023-09-21T12:59:29.484 INFO:tasks.cephfs.filesystem:scrub status for tag:735f1def-b355-4d3e-bd40-8d0a55b5ad02 - {'path': '/', 'tag': '735f1def-b355-4d3e-bd40-8d0a55b5ad02', 'options': 'recursive,force'} 2023-09-21T12:59:29.679 INFO:tasks.workunit.client.0.smithi142.stdout: 1 273255 10.83 MB/sec execute 10 sec latency 17.781 ms 2023-09-21T12:59:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: pgmap v100: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T12:59:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T12:59:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:59:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:59:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:29 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: pgmap v100: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T12:59:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T12:59:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:59:30.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:59:30.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:29 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: pgmap v100: 97 pgs: 97 active+clean; 73 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T12:59:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T12:59:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:59:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:59:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:29 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:30.678 INFO:tasks.workunit.client.0.smithi142.stdout: 1 274586 10.42 MB/sec execute 11 sec latency 13.950 ms 2023-09-21T12:59:31.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:30 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T12:59:31.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:30 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:31.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:30 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T12:59:31.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:30 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:30 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T12:59:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:30 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T12:59:31.679 INFO:tasks.workunit.client.0.smithi142.stdout: 1 276980 10.70 MB/sec execute 12 sec latency 17.266 ms 2023-09-21T12:59:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:31 smithi156 ceph-mon[134078]: pgmap v101: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 392 op/s 2023-09-21T12:59:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:31 smithi142 ceph-mon[97663]: pgmap v101: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 392 op/s 2023-09-21T12:59:32.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:31 smithi160 ceph-mon[134450]: pgmap v101: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 392 op/s 2023-09-21T12:59:32.679 INFO:tasks.workunit.client.0.smithi142.stdout: 1 278457 10.31 MB/sec execute 13 sec latency 56.824 ms 2023-09-21T12:59:33.679 INFO:tasks.workunit.client.0.smithi142.stdout: 1 280626 10.56 MB/sec execute 14 sec latency 22.891 ms 2023-09-21T12:59:34.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:33 smithi156 ceph-mon[134078]: pgmap v102: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:34.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:33 smithi142 ceph-mon[97663]: pgmap v102: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:34.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:33 smithi160 ceph-mon[134450]: pgmap v102: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:34.679 INFO:tasks.workunit.client.0.smithi142.stdout: 1 282619 10.32 MB/sec execute 15 sec latency 36.178 ms 2023-09-21T12:59:35.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 284249 10.43 MB/sec execute 16 sec latency 26.683 ms 2023-09-21T12:59:36.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:35 smithi156 ceph-mon[134078]: pgmap v103: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:36.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:35 smithi142 ceph-mon[97663]: pgmap v103: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:35 smithi160 ceph-mon[134450]: pgmap v103: 97 pgs: 97 active+clean; 77 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-21T12:59:36.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 286240 10.24 MB/sec execute 17 sec latency 24.543 ms 2023-09-21T12:59:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 -- 172.21.15.142:0/3983329754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c073ad0 msgr2=0x7fa48c10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 --2- 172.21.15.142:0/3983329754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c073ad0 0x7fa48c10d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009990 tx=0x7fa47c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 -- 172.21.15.142:0/3983329754 shutdown_connections 2023-09-21T12:59:37.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 --2- 172.21.15.142:0/3983329754 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c10d600 0x7fa48c10fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 --2- 172.21.15.142:0/3983329754 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 --2- 172.21.15.142:0/3983329754 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c073ad0 0x7fa48c10d0c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 -- 172.21.15.142:0/3983329754 >> 172.21.15.142:0/3983329754 conn(0x7fa48c0fc890 msgr2=0x7fa48c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 -- 172.21.15.142:0/3983329754 shutdown_connections 2023-09-21T12:59:37.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.088+0000 7fa4945ff700 1 -- 172.21.15.142:0/3983329754 wait complete. 2023-09-21T12:59:37.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 Processor -- start 2023-09-21T12:59:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 -- start start 2023-09-21T12:59:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c073ad0 0x7fa48c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c10d600 0x7fa48c19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19e310 con 0x7fa48c10d600 2023-09-21T12:59:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19e480 con 0x7fa48c073ad0 2023-09-21T12:59:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa4945ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c19e640 con 0x7fa48c0731b0 2023-09-21T12:59:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa49239b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa49239b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58832/0 (socket says 172.21.15.142:58832) 2023-09-21T12:59:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.089+0000 7fa49239b700 1 -- 172.21.15.142:0/1865248259 learned_addr learned my addr 172.21.15.142:0/1865248259 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa492b9c700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c10d600 0x7fa48c19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa491b9a700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c073ad0 0x7fa48c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 -- 172.21.15.142:0/1865248259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c073ad0 msgr2=0x7fa48c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c073ad0 0x7fa48c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 -- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c10d600 msgr2=0x7fa48c19dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c10d600 0x7fa48c19dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 -- 172.21.15.142:0/1865248259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c0095f0 con 0x7fa48c0731b0 2023-09-21T12:59:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa49239b700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa48800e9a0 tx=0x7fa48800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa4837fe700 1 -- 172.21.15.142:0/1865248259 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488009790 con 0x7fa48c0731b0 2023-09-21T12:59:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa4837fe700 1 -- 172.21.15.142:0/1865248259 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa488010430 con 0x7fa48c0731b0 2023-09-21T12:59:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c19e920 con 0x7fa48c0731b0 2023-09-21T12:59:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.090+0000 7fa4837fe700 1 -- 172.21.15.142:0/1865248259 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488018680 con 0x7fa48c0731b0 2023-09-21T12:59:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.091+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c1a6160 con 0x7fa48c0731b0 2023-09-21T12:59:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.094+0000 7fa4837fe700 1 -- 172.21.15.142:0/1865248259 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa4880105a0 con 0x7fa48c0731b0 2023-09-21T12:59:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.095+0000 7fa4a7ef6b80 1 Processor -- start 2023-09-21T12:59:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.095+0000 7fa4837fe700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 0x7fa4780a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.095+0000 7fa4a7ef6b80 1 -- start start 2023-09-21T12:59:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.095+0000 7fa4837fe700 1 -- 172.21.15.142:0/1865248259 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa488014070 con 0x7fa48c0731b0 2023-09-21T12:59:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.095+0000 7fa492b9c700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 0x7fa4780a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf61d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf61e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf58dc40 con 0x5574cf61de50 2023-09-21T12:59:37.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf571c10 con 0x5574cf6190a0 2023-09-21T12:59:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf56f530 con 0x5574cf6199c0 2023-09-21T12:59:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58380/0 (socket says 172.21.15.142:58380) 2023-09-21T12:59:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 -- 172.21.15.142:0/4058134557 learned_addr learned my addr 172.21.15.142:0/4058134557 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa491b9a700 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf61d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa492b9c700 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf61e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 -- 172.21.15.142:0/4058134557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 msgr2=0x5574cf61d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf61d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 -- 172.21.15.142:0/4058134557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 msgr2=0x5574cf61e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf61e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa49239b700 1 -- 172.21.15.142:0/4058134557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574cf395d80 con 0x5574cf6190a0 2023-09-21T12:59:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.096+0000 7fa492b9c700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 0x7fa4780a2c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa48c06a440 tx=0x7fa484009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa49239b700 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa488096050 tx=0x7fa488099010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f14687bad6516c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa480bfe700 1 -- 172.21.15.142:0/4058134557 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48809d410 con 0x5574cf6190a0 2023-09-21T12:59:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa480bfe700 1 -- 172.21.15.142:0/4058134557 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4880a1650 con 0x5574cf6190a0 2023-09-21T12:59:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa480bfe700 1 -- 172.21.15.142:0/4058134557 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488099840 con 0x5574cf6190a0 2023-09-21T12:59:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/4058134557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 msgr2=0x5574cf619480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.097+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa488096050 tx=0x7fa488099010 comp rx=0 tx=0).stop 2023-09-21T12:59:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/4058134557 shutdown_connections 2023-09-21T12:59:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf61e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf619480 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/4058134557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf61d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/4058134557 >> 172.21.15.142:0/4058134557 conn(0x5574cf545fa0 msgr2=0x5574cf6140c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/4058134557 shutdown_connections 2023-09-21T12:59:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/4058134557 wait complete. 2023-09-21T12:59:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 -- start start 2023-09-21T12:59:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.098+0000 7fa4a7ef6b80 1 Processor -- start 2023-09-21T12:59:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf622850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf622f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf56ae20 con 0x5574cf61de50 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf5076e0 con 0x5574cf6190a0 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf507380 con 0x5574cf6199c0 2023-09-21T12:59:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa4a7ef6b80 10 client.0 _ll_register_callbacks cb 0x5574cf451a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa491b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf622850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58388/0 (socket says 172.21.15.142:58388) 2023-09-21T12:59:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa49239b700 1 -- 172.21.15.142:0/924195676 learned_addr learned my addr 172.21.15.142:0/924195676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa492b9c700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf622f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa49239b700 1 -- 172.21.15.142:0/924195676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 msgr2=0x5574cf622850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.099+0000 7fa49239b700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf622850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa49239b700 1 -- 172.21.15.142:0/924195676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 msgr2=0x5574cf622f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa49239b700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf622f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa49239b700 1 -- 172.21.15.142:0/924195676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c1a6160 con 0x5574cf6190a0 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa492b9c700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf622f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa49239b700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa4880c9e00 tx=0x7fa4880996a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e42030706a1b0c82 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa475ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48809d490 con 0x5574cf6190a0 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa488098ad0 con 0x5574cf6190a0 2023-09-21T12:59:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574cf4dbb50 con 0x5574cf6190a0 2023-09-21T12:59:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa488098c90 con 0x5574cf6190a0 2023-09-21T12:59:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa4a7ef6b80 10 client.26441 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5574cf37ec00 con 0x5574cf6190a0 2023-09-21T12:59:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.100+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5574cf4dbb50 con 0x5574cf6190a0 2023-09-21T12:59:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa4880a11c0 con 0x5574cf6190a0 2023-09-21T12:59:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 10 client.26441 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 10 client.26441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 20 client.26441 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf632c60 0x5574cf635080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 4 client.26441 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574cf5e7fc0 con 0x5574cf632c60 2023-09-21T12:59:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa491b9a700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf632c60 0x5574cf635080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa475ffb700 10 client.26441 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.101+0000 7fa491b9a700 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf632c60 0x5574cf635080 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf0701b34de82986 server_cookie=c8d4a09bdba95df0 in_seq=0 out_seq=0 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.102+0000 7fa475ffb700 1 -- 172.21.15.142:0/924195676 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5574cf5e7fc0 con 0x5574cf632c60 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.102+0000 7fa475ffb700 10 client.26441 handle_command_reply: tid=0 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.102+0000 7fa4a7ef6b80 1 client.26441 shutdown 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 msgr2=0x5574cf625640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fa4880c9e00 tx=0x7fa4880996a0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 shutdown_connections 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf632c60 0x5574cf635080 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf622f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf625640 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/924195676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6199c0 0x5574cf622850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa475ffb700 0 client.26441 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:37.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 >> 172.21.15.142:0/924195676 conn(0x5574cf545fa0 msgr2=0x5574cf613cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 shutdown_connections 2023-09-21T12:59:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/924195676 wait complete. 2023-09-21T12:59:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.103+0000 7fa4a7ef6b80 20 client.26441 trim_cache size 0 max 16384 2023-09-21T12:59:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 Processor -- start 2023-09-21T12:59:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 -- start start 2023-09-21T12:59:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 0x5574cf625170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6199c0 0x5574cf6256b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf6220f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf3eb8c0 con 0x5574cf61de50 2023-09-21T12:59:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf615740 con 0x5574cf6199c0 2023-09-21T12:59:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.119+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf60bca0 con 0x5574cf6190a0 2023-09-21T12:59:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa492b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf6220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 0x5574cf625170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa492b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf6220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58672/0 (socket says 172.21.15.142:58672) 2023-09-21T12:59:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa492b9c700 1 -- 172.21.15.142:0/1577946584 learned_addr learned my addr 172.21.15.142:0/1577946584 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa491b9a700 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6199c0 0x5574cf6256b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 -- 172.21.15.142:0/1577946584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6199c0 msgr2=0x5574cf6256b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6199c0 0x5574cf6256b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 -- 172.21.15.142:0/1577946584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 msgr2=0x5574cf6220f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf6220f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 -- 172.21.15.142:0/1577946584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574cf639c70 con 0x5574cf6190a0 2023-09-21T12:59:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa49239b700 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 0x5574cf625170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa488099520 tx=0x7fa488010c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511e2cd0e3a94138 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa4813ff700 1 -- 172.21.15.142:0/1577946584 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488099ce0 con 0x5574cf6190a0 2023-09-21T12:59:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa4813ff700 1 -- 172.21.15.142:0/1577946584 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa48809d410 con 0x5574cf6190a0 2023-09-21T12:59:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.120+0000 7fa4813ff700 1 -- 172.21.15.142:0/1577946584 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488099840 con 0x5574cf6190a0 2023-09-21T12:59:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/1577946584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 msgr2=0x5574cf625170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 0x5574cf625170 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa488099520 tx=0x7fa488010c80 comp rx=0 tx=0).stop 2023-09-21T12:59:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/1577946584 shutdown_connections 2023-09-21T12:59:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf61de50 0x5574cf6220f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf6190a0 0x5574cf625170 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/1577946584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6199c0 0x5574cf6256b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/1577946584 >> 172.21.15.142:0/1577946584 conn(0x5574cf545fa0 msgr2=0x5574cf620240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/1577946584 shutdown_connections 2023-09-21T12:59:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.121+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/1577946584 wait complete. 2023-09-21T12:59:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.122+0000 7fa4a7ef6b80 1 -- start start 2023-09-21T12:59:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.122+0000 7fa4a7ef6b80 1 Processor -- start 2023-09-21T12:59:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 0x5574cf6286c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf61de50 0x5574cf685a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf685f90 con 0x5574cf6199c0 2023-09-21T12:59:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf6860d0 con 0x5574cf6190a0 2023-09-21T12:59:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574cf686290 con 0x5574cf61de50 2023-09-21T12:59:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa4a7ef6b80 10 client.0 _ll_register_callbacks cb 0x5574cf451a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa491b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 0x5574cf6286c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58414/0 (socket says 172.21.15.142:58414) 2023-09-21T12:59:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 -- 172.21.15.142:0/546033676 learned_addr learned my addr 172.21.15.142:0/546033676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa492b9c700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf61de50 0x5574cf685a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 -- 172.21.15.142:0/546033676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf61de50 msgr2=0x5574cf685a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf61de50 0x5574cf685a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 -- 172.21.15.142:0/546033676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 msgr2=0x5574cf6286c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 0x5574cf6286c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa49239b700 1 -- 172.21.15.142:0/546033676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574cf37ec00 con 0x5574cf6190a0 2023-09-21T12:59:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.123+0000 7fa491b9a700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 0x5574cf6286c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa49239b700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa488099570 tx=0x7fa488099030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4473a4b3f6b704d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa488099a40 con 0x5574cf6190a0 2023-09-21T12:59:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa488065330 con 0x5574cf6190a0 2023-09-21T12:59:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4880a1650 con 0x5574cf6190a0 2023-09-21T12:59:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa488099ce0 con 0x5574cf6190a0 2023-09-21T12:59:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 10 client.26447 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x5574cf3bc1f0 con 0x5574cf6190a0 2023-09-21T12:59:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4880a1650 con 0x5574cf6190a0 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa488098620 con 0x5574cf6190a0 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 10 client.26447 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 10 client.26447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.124+0000 7fa4a7ef6b80 20 client.26447 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf6875d0 0x5574cf6899f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa4a7ef6b80 4 client.26447 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:59:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5574cf563e00 con 0x5574cf6875d0 2023-09-21T12:59:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa491b9a700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf6875d0 0x5574cf6899f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa475ffb700 10 client.26447 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.125+0000 7fa491b9a700 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf6875d0 0x5574cf6899f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3b5608522d5b127 server_cookie=b2a325b09f74faf2 in_seq=0 out_seq=0 2023-09-21T12:59:37.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:36 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:37.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:36 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:37.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:36 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa475ffb700 1 -- 172.21.15.142:0/546033676 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5574cf563e00 con 0x5574cf6875d0 2023-09-21T12:59:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa475ffb700 10 client.26447 handle_command_reply: tid=0 2023-09-21T12:59:37.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 client.26447 shutdown 2023-09-21T12:59:37.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 msgr2=0x5574cf628180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa488099570 tx=0x7fa488099030 comp rx=0 tx=0).stop 2023-09-21T12:59:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 shutdown_connections 2023-09-21T12:59:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5574cf6875d0 0x5574cf6899f0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5574cf61de50 0x5574cf685a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5574cf6190a0 0x5574cf628180 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 --2- 172.21.15.142:0/546033676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5574cf6199c0 0x5574cf6286c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.194+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 >> 172.21.15.142:0/546033676 conn(0x5574cf545fa0 msgr2=0x5574cf61ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.195+0000 7fa475ffb700 0 client.26447 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.195+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 shutdown_connections 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.195+0000 7fa4a7ef6b80 1 -- 172.21.15.142:0/546033676 wait complete. 2023-09-21T12:59:37.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.195+0000 7fa4a7ef6b80 20 client.26447 trim_cache size 0 max 16384 2023-09-21T12:59:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:59:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:59:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:59:37.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:59:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 msgr2=0x7fa4780a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 0x7fa4780a2c70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa48c06a440 tx=0x7fa484009920 comp rx=0 tx=0).stop 2023-09-21T12:59:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 msgr2=0x7fa48c199120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa48800e9a0 tx=0x7fa48800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 shutdown_connections 2023-09-21T12:59:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa4780a07b0 0x7fa4780a2c70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa48c10d600 0x7fa48c19dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa48c0731b0 0x7fa48c199120 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 --2- 172.21.15.142:0/1865248259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa48c073ad0 0x7fa48c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 >> 172.21.15.142:0/1865248259 conn(0x7fa48c0fc890 msgr2=0x7fa48c10f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 shutdown_connections 2023-09-21T12:59:37.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:37.196+0000 7fa4945ff700 1 -- 172.21.15.142:0/1865248259 wait complete. 2023-09-21T12:59:37.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 287885 10.34 MB/sec execute 18 sec latency 64.530 ms 2023-09-21T12:59:38.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:37 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:38.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:37 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T12:59:38.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:37 smithi156 ceph-mon[134078]: pgmap v104: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 383 op/s 2023-09-21T12:59:38.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:37 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:38.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:37 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T12:59:38.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:37 smithi142 ceph-mon[97663]: pgmap v104: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 383 op/s 2023-09-21T12:59:38.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:37 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:38.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:37 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T12:59:38.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:37 smithi160 ceph-mon[134450]: pgmap v104: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.8 MiB/s wr, 383 op/s 2023-09-21T12:59:38.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 290203 10.39 MB/sec execute 19 sec latency 50.523 ms 2023-09-21T12:59:39.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 291665 10.28 MB/sec execute 20 sec latency 13.750 ms 2023-09-21T12:59:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:39 smithi156 ceph-mon[134078]: pgmap v105: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2023-09-21T12:59:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:39 smithi142 ceph-mon[97663]: pgmap v105: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2023-09-21T12:59:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:39 smithi160 ceph-mon[134450]: pgmap v105: 97 pgs: 97 active+clean; 82 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 222 op/s 2023-09-21T12:59:40.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 294362 10.60 MB/sec execute 21 sec latency 9.467 ms 2023-09-21T12:59:41.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 295249 10.22 MB/sec execute 22 sec latency 151.504 ms 2023-09-21T12:59:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:41 smithi156 ceph-mon[134078]: pgmap v106: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 385 op/s 2023-09-21T12:59:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:41 smithi142 ceph-mon[97663]: pgmap v106: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 385 op/s 2023-09-21T12:59:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:41 smithi160 ceph-mon[134450]: pgmap v106: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 385 op/s 2023-09-21T12:59:42.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 298048 10.52 MB/sec execute 23 sec latency 11.147 ms 2023-09-21T12:59:43.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 299205 10.23 MB/sec execute 24 sec latency 27.079 ms 2023-09-21T12:59:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:43 smithi156 ceph-mon[134078]: pgmap v107: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:43 smithi142 ceph-mon[97663]: pgmap v107: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:43 smithi160 ceph-mon[134450]: pgmap v107: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:44.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 301744 10.49 MB/sec execute 25 sec latency 66.922 ms 2023-09-21T12:59:45.680 INFO:tasks.workunit.client.0.smithi142.stdout: 1 303228 10.30 MB/sec execute 26 sec latency 9.994 ms 2023-09-21T12:59:46.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:45 smithi156 ceph-mon[134078]: pgmap v108: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:45 smithi142 ceph-mon[97663]: pgmap v108: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:45 smithi160 ceph-mon[134450]: pgmap v108: 97 pgs: 97 active+clean; 79 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-21T12:59:46.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 305479 10.43 MB/sec execute 27 sec latency 23.080 ms 2023-09-21T12:59:47.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 307624 10.34 MB/sec execute 28 sec latency 17.054 ms 2023-09-21T12:59:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:47 smithi156 ceph-mon[134078]: pgmap v109: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 382 op/s 2023-09-21T12:59:48.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:47 smithi142 ceph-mon[97663]: pgmap v109: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 382 op/s 2023-09-21T12:59:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:47 smithi160 ceph-mon[134450]: pgmap v109: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 382 op/s 2023-09-21T12:59:48.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 309231 10.37 MB/sec execute 29 sec latency 47.192 ms 2023-09-21T12:59:49.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 311939 10.51 MB/sec execute 30 sec latency 24.366 ms 2023-09-21T12:59:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:49 smithi156 ceph-mon[134078]: pgmap v110: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 274 op/s 2023-09-21T12:59:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:49 smithi142 ceph-mon[97663]: pgmap v110: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 274 op/s 2023-09-21T12:59:50.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:49 smithi160 ceph-mon[134450]: pgmap v110: 97 pgs: 97 active+clean; 83 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 274 op/s 2023-09-21T12:59:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.347+0000 7fa16e3ff700 1 -- 172.21.15.142:0/838069472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168101980 msgr2=0x7fa1681059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.347+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/838069472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168101980 0x7fa1681059c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009990 tx=0x7fa15c009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 -- 172.21.15.142:0/838069472 shutdown_connections 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/838069472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa168100fd0 0x7fa1681013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/838069472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa1681060f0 0x7fa16810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/838069472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168101980 0x7fa1681059c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 -- 172.21.15.142:0/838069472 >> 172.21.15.142:0/838069472 conn(0x7fa1680fc830 msgr2=0x7fa1680fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 -- 172.21.15.142:0/838069472 shutdown_connections 2023-09-21T12:59:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.348+0000 7fa16e3ff700 1 -- 172.21.15.142:0/838069472 wait complete. 2023-09-21T12:59:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 Processor -- start 2023-09-21T12:59:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 -- start start 2023-09-21T12:59:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 0x7fa1681995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa16819dc60 0x7fa16819e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16819e6e0 con 0x7fa1681060f0 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16819e850 con 0x7fa16819dc60 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa16e3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16819ea10 con 0x7fa168100fd0 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.349+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 0x7fa1681995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57190/0 (socket says 172.21.15.142:57190) 2023-09-21T12:59:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 -- 172.21.15.142:0/2315634940 learned_addr learned my addr 172.21.15.142:0/2315634940 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa16819dc60 0x7fa16819e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 -- 172.21.15.142:0/2315634940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa16819dc60 msgr2=0x7fa16819e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa16819dc60 0x7fa16819e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 -- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 msgr2=0x7fa1681995f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 0x7fa1681995f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 -- 172.21.15.142:0/2315634940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c0095f0 con 0x7fa168100fd0 2023-09-21T12:59:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa1677fe700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 0x7fa1681995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa167fff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa15800e9a0 tx=0x7fa15800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa1657fa700 1 -- 172.21.15.142:0/2315634940 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158009790 con 0x7fa168100fd0 2023-09-21T12:59:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa1657fa700 1 -- 172.21.15.142:0/2315634940 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa158010430 con 0x7fa168100fd0 2023-09-21T12:59:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1681a5f70 con 0x7fa168100fd0 2023-09-21T12:59:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.350+0000 7fa1657fa700 1 -- 172.21.15.142:0/2315634940 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa158018680 con 0x7fa168100fd0 2023-09-21T12:59:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.351+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1681a6390 con 0x7fa168100fd0 2023-09-21T12:59:50.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.354+0000 7fa1657fa700 1 -- 172.21.15.142:0/2315634940 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa1580105a0 con 0x7fa168100fd0 2023-09-21T12:59:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.355+0000 7fa181d93b80 1 Processor -- start 2023-09-21T12:59:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.355+0000 7fa181d93b80 1 -- start start 2023-09-21T12:59:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.355+0000 7fa1657fa700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 0x7fa1500a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa1657fa700 1 -- 172.21.15.142:0/2315634940 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa158014070 con 0x7fa168100fd0 2023-09-21T12:59:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb96910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 0x560cfcb972b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcb06c40 con 0x560cfcb96e50 2023-09-21T12:59:50.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcaeac10 con 0x560cfcb929c0 2023-09-21T12:59:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa181d93b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcae8530 con 0x560cfcb920a0 2023-09-21T12:59:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 0x7fa1500a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57198/0 (socket says 172.21.15.142:57198) 2023-09-21T12:59:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 -- 172.21.15.142:0/4244040906 learned_addr learned my addr 172.21.15.142:0/4244040906 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa16c99c700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 0x560cfcb972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa1677fe700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb96910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 -- 172.21.15.142:0/4244040906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 msgr2=0x560cfcb96910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb96910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 -- 172.21.15.142:0/4244040906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 msgr2=0x560cfcb972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 0x560cfcb972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa167fff700 1 -- 172.21.15.142:0/4244040906 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cfc90ed80 con 0x560cfcb920a0 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.356+0000 7fa16c99c700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 0x560cfcb972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa167fff700 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa158095ff0 tx=0x7fa158098fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f33573eaa7e91ff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 0x7fa1500a2c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa160009ec0 tx=0x7fa160009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa14e7fc700 1 -- 172.21.15.142:0/4244040906 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580acea0 con 0x560cfcb920a0 2023-09-21T12:59:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa14e7fc700 1 -- 172.21.15.142:0/4244040906 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa15809d3b0 con 0x560cfcb920a0 2023-09-21T12:59:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa14e7fc700 1 -- 172.21.15.142:0/4244040906 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1580997e0 con 0x560cfcb920a0 2023-09-21T12:59:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa181d93b80 1 -- 172.21.15.142:0/4244040906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 msgr2=0x560cfcb92480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.357+0000 7fa181d93b80 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa158095ff0 tx=0x7fa158098fb0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 -- 172.21.15.142:0/4244040906 shutdown_connections 2023-09-21T12:59:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb96e50 0x560cfcb972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb92480 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 --2- 172.21.15.142:0/4244040906 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb96910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 -- 172.21.15.142:0/4244040906 >> 172.21.15.142:0/4244040906 conn(0x560cfcabefa0 msgr2=0x560cfcb8d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 -- 172.21.15.142:0/4244040906 shutdown_connections 2023-09-21T12:59:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 -- 172.21.15.142:0/4244040906 wait complete. 2023-09-21T12:59:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 -- start start 2023-09-21T12:59:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.358+0000 7fa181d93b80 1 Processor -- start 2023-09-21T12:59:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb929c0 0x560cfcb9b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcae3e20 con 0x560cfcb929c0 2023-09-21T12:59:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfca806e0 con 0x560cfcb96e50 2023-09-21T12:59:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfca80380 con 0x560cfcb920a0 2023-09-21T12:59:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa181d93b80 10 client.0 _ll_register_callbacks cb 0x560cfc9caa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa16c99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb929c0 0x560cfcb9b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa167fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57214/0 (socket says 172.21.15.142:57214) 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa16c99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43686/0 (socket says 172.21.15.142:43686) 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.359+0000 7fa167fff700 1 -- 172.21.15.142:0/2356531679 learned_addr learned my addr 172.21.15.142:0/2356531679 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 -- 172.21.15.142:0/2356531679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 msgr2=0x560cfcb9e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 -- 172.21.15.142:0/2356531679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb929c0 msgr2=0x560cfcb9b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb929c0 0x560cfcb9b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 -- 172.21.15.142:0/2356531679 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1681a6390 con 0x560cfcb96e50 2023-09-21T12:59:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa167fff700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa160009fd0 tx=0x7fa160004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=745659a3d0d694fc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa1477fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160020070 con 0x560cfcb96e50 2023-09-21T12:59:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cfca54b50 con 0x560cfcb96e50 2023-09-21T12:59:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.360+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa16001b640 con 0x560cfcb96e50 2023-09-21T12:59:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa16000e070 con 0x560cfcb96e50 2023-09-21T12:59:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 10 client.26459 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560cfc8f7c00 con 0x560cfcb96e50 2023-09-21T12:59:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa160034020 con 0x560cfcb96e50 2023-09-21T12:59:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa1600308e0 con 0x560cfcb96e50 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 10 client.26459 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 10 client.26459 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 20 client.26459 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcbac090 0x560cfcbae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 4 client.26459 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cfcb60fc0 con 0x560cfcbac090 2023-09-21T12:59:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.361+0000 7fa167fff700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcbac090 0x560cfcbae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.362+0000 7fa167fff700 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcbac090 0x560cfcbae4b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e42a12117b881f1 server_cookie=34a26ec155a1c1b9 in_seq=0 out_seq=0 2023-09-21T12:59:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.362+0000 7fa1477fe700 10 client.26459 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.362+0000 7fa1477fe700 1 -- 172.21.15.142:0/2356531679 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560cfcb60fc0 con 0x560cfcbac090 2023-09-21T12:59:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.362+0000 7fa1477fe700 10 client.26459 handle_command_reply: tid=0 2023-09-21T12:59:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.362+0000 7fa181d93b80 1 client.26459 shutdown 2023-09-21T12:59:50.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 msgr2=0x560cfcb9bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa160009fd0 tx=0x7fa160004b40 comp rx=0 tx=0).stop 2023-09-21T12:59:50.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 shutdown_connections 2023-09-21T12:59:50.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcbac090 0x560cfcbae4b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb96e50 0x560cfcb9bf60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb920a0 0x560cfcb9e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2356531679 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb929c0 0x560cfcb9b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa1477fe700 0 client.26459 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:50.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 >> 172.21.15.142:0/2356531679 conn(0x560cfcabefa0 msgr2=0x560cfcb8cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 shutdown_connections 2023-09-21T12:59:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 1 -- 172.21.15.142:0/2356531679 wait complete. 2023-09-21T12:59:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.363+0000 7fa181d93b80 20 client.26459 trim_cache size 0 max 16384 2023-09-21T12:59:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 Processor -- start 2023-09-21T12:59:50.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 -- start start 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcb94ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfc9648c0 con 0x560cfcb920a0 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcb9c980 con 0x560cfcb929c0 2023-09-21T12:59:50.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.380+0000 7fa181d93b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcb87470 con 0x560cfcb96e50 2023-09-21T12:59:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa167fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43702/0 (socket says 172.21.15.142:43702) 2023-09-21T12:59:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa167fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38392/0 (socket says 172.21.15.142:38392) 2023-09-21T12:59:50.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 -- 172.21.15.142:0/2185159962 learned_addr learned my addr 172.21.15.142:0/2185159962 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcb94ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 -- 172.21.15.142:0/2185159962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 msgr2=0x560cfcb94ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcb94ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 -- 172.21.15.142:0/2185159962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 msgr2=0x560cfcb9a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 -- 172.21.15.142:0/2185159962 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cfc9351f0 con 0x560cfcb929c0 2023-09-21T12:59:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa16c99c700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcb94ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa167fff700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.381+0000 7fa1677fe700 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009990 tx=0x7fa15c005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e60eadbd0329adc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.382+0000 7fa14effd700 1 -- 172.21.15.142:0/2185159962 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c01d070 con 0x560cfcb929c0 2023-09-21T12:59:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.382+0000 7fa14effd700 1 -- 172.21.15.142:0/2185159962 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa15c01e040 con 0x560cfcb929c0 2023-09-21T12:59:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.382+0000 7fa14effd700 1 -- 172.21.15.142:0/2185159962 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c004b30 con 0x560cfcb929c0 2023-09-21T12:59:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.382+0000 7fa181d93b80 1 -- 172.21.15.142:0/2185159962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 msgr2=0x560cfcb9e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.382+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa15c009990 tx=0x7fa15c005960 comp rx=0 tx=0).stop 2023-09-21T12:59:50.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 -- 172.21.15.142:0/2185159962 shutdown_connections 2023-09-21T12:59:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcb9a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcb94ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 --2- 172.21.15.142:0/2185159962 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcb9e190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 -- 172.21.15.142:0/2185159962 >> 172.21.15.142:0/2185159962 conn(0x560cfcabefa0 msgr2=0x560cfcbb2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 -- 172.21.15.142:0/2185159962 shutdown_connections 2023-09-21T12:59:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 -- 172.21.15.142:0/2185159962 wait complete. 2023-09-21T12:59:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 -- start start 2023-09-21T12:59:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.383+0000 7fa181d93b80 1 Processor -- start 2023-09-21T12:59:50.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcba2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcba10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcba17c0 con 0x560cfcb920a0 2023-09-21T12:59:50.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcba1930 con 0x560cfcb929c0 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfcba1af0 con 0x560cfcb96e50 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa181d93b80 10 client.0 _ll_register_callbacks cb 0x560cfc9caa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa167fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcba2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa16c99c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcba10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43718/0 (socket says 172.21.15.142:43718) 2023-09-21T12:59:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 -- 172.21.15.142:0/1719311346 learned_addr learned my addr 172.21.15.142:0/1719311346 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa167fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcba2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38408/0 (socket says 172.21.15.142:38408) 2023-09-21T12:59:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 -- 172.21.15.142:0/1719311346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 msgr2=0x560cfcba10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcba10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 -- 172.21.15.142:0/1719311346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 msgr2=0x560cfcba2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcba2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.384+0000 7fa1677fe700 1 -- 172.21.15.142:0/1719311346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cfc90ed80 con 0x560cfcb929c0 2023-09-21T12:59:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1677fe700 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0098e0 tx=0x7fa15c00fa50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e43bd94a998cf3d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1477fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:50.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c01d040 con 0x560cfcb929c0 2023-09-21T12:59:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa15809d3b0 con 0x560cfcb929c0 2023-09-21T12:59:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa15c004500 con 0x560cfcb929c0 2023-09-21T12:59:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa15c009290 con 0x560cfcb929c0 2023-09-21T12:59:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa181d93b80 10 client.26465 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:50.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x560cfc8f7c00 con 0x560cfcb929c0 2023-09-21T12:59:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.385+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa15809d3b0 con 0x560cfcb929c0 2023-09-21T12:59:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fa15c004b10 con 0x560cfcb929c0 2023-09-21T12:59:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 10 client.26465 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:50.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 10 client.26465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 20 client.26465 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcc00ca0 0x560cfcc030c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:50.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 4 client.26465 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T12:59:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560cfcadce00 con 0x560cfcc00ca0 2023-09-21T12:59:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa167fff700 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcc00ca0 0x560cfcc030c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa1477fe700 10 client.26465 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:50.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.386+0000 7fa167fff700 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcc00ca0 0x560cfcc030c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4c0d9016ece4c20 server_cookie=84e96b3a5d5a00a4 in_seq=0 out_seq=0 2023-09-21T12:59:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa1477fe700 1 -- 172.21.15.142:0/1719311346 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560cfcadce00 con 0x560cfcc00ca0 2023-09-21T12:59:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa1477fe700 10 client.26465 handle_command_reply: tid=0 2023-09-21T12:59:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 client.26465 shutdown 2023-09-21T12:59:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 msgr2=0x560cfcba3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa15c0098e0 tx=0x7fa15c00fa50 comp rx=0 tx=0).stop 2023-09-21T12:59:50.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 shutdown_connections 2023-09-21T12:59:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560cfcc00ca0 0x560cfcc030c0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560cfcb920a0 0x560cfcba2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560cfcb96e50 0x560cfcba10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 --2- 172.21.15.142:0/1719311346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560cfcb929c0 0x560cfcba3120 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa1477fe700 0 client.26465 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 >> 172.21.15.142:0/1719311346 conn(0x560cfcabefa0 msgr2=0x560cfcb94ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 shutdown_connections 2023-09-21T12:59:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.461+0000 7fa181d93b80 1 -- 172.21.15.142:0/1719311346 wait complete. 2023-09-21T12:59:50.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.462+0000 7fa181d93b80 20 client.26465 trim_cache size 0 max 16384 2023-09-21T12:59:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T12:59:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T12:59:50.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T12:59:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T12:59:50.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.462+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 msgr2=0x7fa1500a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.462+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 0x7fa1500a2c70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa160009ec0 tx=0x7fa160009920 comp rx=0 tx=0).stop 2023-09-21T12:59:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.462+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 msgr2=0x7fa1681990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.462+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa15800e9a0 tx=0x7fa15800ecb0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 shutdown_connections 2023-09-21T12:59:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa1500a07b0 0x7fa1500a2c70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa16819dc60 0x7fa16819e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa168100fd0 0x7fa1681990b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 --2- 172.21.15.142:0/2315634940 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa1681060f0 0x7fa1681995f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:50.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 >> 172.21.15.142:0/2315634940 conn(0x7fa1680fc830 msgr2=0x7fa1680fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 shutdown_connections 2023-09-21T12:59:50.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T12:59:50.463+0000 7fa16e3ff700 1 -- 172.21.15.142:0/2315634940 wait complete. 2023-09-21T12:59:50.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 313291 10.39 MB/sec execute 31 sec latency 55.753 ms 2023-09-21T12:59:51.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 315917 10.59 MB/sec execute 32 sec latency 10.682 ms 2023-09-21T12:59:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:51 smithi156 ceph-mon[134078]: pgmap v111: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 427 op/s 2023-09-21T12:59:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:51 smithi142 ceph-mon[97663]: pgmap v111: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 427 op/s 2023-09-21T12:59:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:51 smithi160 ceph-mon[134450]: pgmap v111: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 427 op/s 2023-09-21T12:59:52.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 317353 10.43 MB/sec execute 33 sec latency 12.376 ms 2023-09-21T12:59:53.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 319574 10.52 MB/sec execute 34 sec latency 54.002 ms 2023-09-21T12:59:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:53 smithi156 ceph-mon[134078]: pgmap v112: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:54.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:53 smithi142 ceph-mon[97663]: pgmap v112: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:53 smithi160 ceph-mon[134450]: pgmap v112: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:54.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 321631 10.43 MB/sec execute 35 sec latency 26.581 ms 2023-09-21T12:59:55.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 323387 10.48 MB/sec execute 36 sec latency 11.216 ms 2023-09-21T12:59:56.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:55 smithi156 ceph-mon[134078]: pgmap v113: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:56.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:55 smithi142 ceph-mon[97663]: pgmap v113: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:56.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:55 smithi160 ceph-mon[134450]: pgmap v113: 97 pgs: 97 active+clean; 88 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 265 op/s 2023-09-21T12:59:56.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 325989 10.56 MB/sec execute 37 sec latency 10.312 ms 2023-09-21T12:59:57.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 327461 10.48 MB/sec execute 38 sec latency 12.476 ms 2023-09-21T12:59:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:57 smithi156 ceph-mon[134078]: pgmap v114: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 386 op/s 2023-09-21T12:59:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:57 smithi142 ceph-mon[97663]: pgmap v114: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 386 op/s 2023-09-21T12:59:58.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:57 smithi160 ceph-mon[134450]: pgmap v114: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 386 op/s 2023-09-21T12:59:58.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 330094 10.65 MB/sec execute 39 sec latency 12.270 ms 2023-09-21T12:59:59.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T12:59:59.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 331310 10.51 MB/sec execute 40 sec latency 58.668 ms 2023-09-21T12:59:59.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 -- 172.21.15.142:0/2586559502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c101ef0 msgr2=0x7fdd9c1022d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 --2- 172.21.15.142:0/2586559502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c1022d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdd98009990 tx=0x7fdd98009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 -- 172.21.15.142:0/2586559502 shutdown_connections 2023-09-21T12:59:59.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 --2- 172.21.15.142:0/2586559502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c10b310 0x7fdd9c10d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 --2- 172.21.15.142:0/2586559502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c1022d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 --2- 172.21.15.142:0/2586559502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c10acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 -- 172.21.15.142:0/2586559502 >> 172.21.15.142:0/2586559502 conn(0x7fdd9c0fb730 msgr2=0x7fdd9c0fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 -- 172.21.15.142:0/2586559502 shutdown_connections 2023-09-21T12:59:59.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.705+0000 7fdda3bff700 1 -- 172.21.15.142:0/2586559502 wait complete. 2023-09-21T12:59:59.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.706+0000 7fdda3bff700 1 Processor -- start 2023-09-21T12:59:59.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.706+0000 7fdda3bff700 1 -- start start 2023-09-21T12:59:59.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 0x7fdd9c19da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c19e090 con 0x7fdd9c101ef0 2023-09-21T12:59:59.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c19e200 con 0x7fdd9c10b310 2023-09-21T12:59:59.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda3bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c19e3c0 con 0x7fdd9c102810 2023-09-21T12:59:59.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda119a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 0x7fdd9c19da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda119a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56514/0 (socket says 172.21.15.142:56514) 2023-09-21T12:59:59.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda119a700 1 -- 172.21.15.142:0/1804943080 learned_addr learned my addr 172.21.15.142:0/1804943080 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:59.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda199b700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda119a700 1 -- 172.21.15.142:0/1804943080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 msgr2=0x7fdd9c19da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.707+0000 7fdda119a700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 0x7fdd9c19da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda119a700 1 -- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c101ef0 msgr2=0x7fdd9c199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda119a700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda119a700 1 -- 172.21.15.142:0/1804943080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980095f0 con 0x7fdd9c102810 2023-09-21T12:59:59.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda219c700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 0x7fdd9c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T12:59:59.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda119a700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e9f0 tx=0x7fdd8c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdd92ffd700 1 -- 172.21.15.142:0/1804943080 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00c9c0 con 0x7fdd9c102810 2023-09-21T12:59:59.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c19e6a0 con 0x7fdd9c102810 2023-09-21T12:59:59.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdd92ffd700 1 -- 172.21.15.142:0/1804943080 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8c010430 con 0x7fdd9c102810 2023-09-21T12:59:59.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdd92ffd700 1 -- 172.21.15.142:0/1804943080 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c018680 con 0x7fdd9c102810 2023-09-21T12:59:59.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.708+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c1a5ee0 con 0x7fdd9c102810 2023-09-21T12:59:59.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.712+0000 7fdd92ffd700 1 -- 172.21.15.142:0/1804943080 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdd8c010860 con 0x7fdd9c102810 2023-09-21T12:59:59.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.713+0000 7fddb75bcb80 1 Processor -- start 2023-09-21T12:59:59.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.714+0000 7fddb75bcb80 1 -- start start 2023-09-21T12:59:59.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdd92ffd700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 0x7fdd880a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85af30 0x55c43b85ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b7ceca0 con 0x55c43b85af30 2023-09-21T12:59:59.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b7b2c70 con 0x55c43b85a610 2023-09-21T12:59:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b7b0590 con 0x55c43b85f360 2023-09-21T12:59:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdd92ffd700 1 -- 172.21.15.142:0/1804943080 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdd8c014070 con 0x7fdd9c102810 2023-09-21T12:59:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdda219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdda219c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44832/0 (socket says 172.21.15.142:44832) 2023-09-21T12:59:59.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdda219c700 1 -- 172.21.15.142:0/3026768757 learned_addr learned my addr 172.21.15.142:0/3026768757 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:59.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.715+0000 7fdda219c700 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 -- 172.21.15.142:0/3026768757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 msgr2=0x55c43b85f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 -- 172.21.15.142:0/3026768757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85af30 msgr2=0x55c43b85ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85af30 0x55c43b85ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 -- 172.21.15.142:0/3026768757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c43b5d6de0 con 0x55c43b85a610 2023-09-21T12:59:59.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda219c700 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdd94008cb0 tx=0x7fdd94009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=571b7c323e811e0c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdda199b700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 0x7fdd880a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdd87fff700 1 -- 172.21.15.142:0/3026768757 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94008320 con 0x55c43b85a610 2023-09-21T12:59:59.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdd87fff700 1 -- 172.21.15.142:0/3026768757 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd9400f040 con 0x55c43b85a610 2023-09-21T12:59:59.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.716+0000 7fdd87fff700 1 -- 172.21.15.142:0/3026768757 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94007940 con 0x55c43b85a610 2023-09-21T12:59:59.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 -- 172.21.15.142:0/3026768757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 msgr2=0x55c43b85a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fdda199b700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 0x7fdd880a2c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b2e0 tx=0x7fdd98005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fdd94008cb0 tx=0x7fdd94009920 comp rx=0 tx=0).stop 2023-09-21T12:59:59.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 -- 172.21.15.142:0/3026768757 shutdown_connections 2023-09-21T12:59:59.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85a610 0x55c43b85a9f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/3026768757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85af30 0x55c43b85ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 -- 172.21.15.142:0/3026768757 >> 172.21.15.142:0/3026768757 conn(0x55c43b787000 msgr2=0x55c43b8556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 -- 172.21.15.142:0/3026768757 shutdown_connections 2023-09-21T12:59:59.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.717+0000 7fddb75bcb80 1 -- 172.21.15.142:0/3026768757 wait complete. 2023-09-21T12:59:59.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.718+0000 7fddb75bcb80 1 -- start start 2023-09-21T12:59:59.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.718+0000 7fddb75bcb80 1 Processor -- start 2023-09-21T12:59:59.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b863f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b7abe80 con 0x55c43b85f360 2023-09-21T12:59:59.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b748740 con 0x55c43b85af30 2023-09-21T12:59:59.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b7483e0 con 0x55c43b85a610 2023-09-21T12:59:59.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fddb75bcb80 10 client.0 _ll_register_callbacks cb 0x55c43b692a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:59.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fdda119a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fdda119a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44842/0 (socket says 172.21.15.142:44842) 2023-09-21T12:59:59.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fdda119a700 1 -- 172.21.15.142:0/2811514163 learned_addr learned my addr 172.21.15.142:0/2811514163 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:59.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fdda199b700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b863f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.719+0000 7fdda219c700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 -- 172.21.15.142:0/2811514163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 msgr2=0x55c43b863f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b863f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 -- 172.21.15.142:0/2811514163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 msgr2=0x55c43b8649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 -- 172.21.15.142:0/2811514163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd94008990 con 0x55c43b85af30 2023-09-21T12:59:59.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda219c700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T12:59:59.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdda119a700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c5b0 tx=0x7fdd8c0992b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8c908a4e9a5f20 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.720+0000 7fdd857fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T12:59:59.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c099c80 con 0x55c43b85af30 2023-09-21T12:59:59.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdd8c06dd00 con 0x55c43b85af30 2023-09-21T12:59:59.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c43b71cbb0 con 0x55c43b85af30 2023-09-21T12:59:59.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd8c0657f0 con 0x55c43b85af30 2023-09-21T12:59:59.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fddb75bcb80 10 client.26477 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:59.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.721+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c43b5bfc60 con 0x55c43b85af30 2023-09-21T12:59:59.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c43b71cbb0 con 0x55c43b85af30 2023-09-21T12:59:59.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd8c098d10 con 0x55c43b85af30 2023-09-21T12:59:59.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 10 client.26477 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:59.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 10 client.26477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:59.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 20 client.26477 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:59.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8745e0 0x55c43b876a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 4 client.26477 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T12:59:59.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c43b829020 con 0x55c43b8745e0 2023-09-21T12:59:59.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.723+0000 7fdda199b700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8745e0 0x55c43b876a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.725+0000 7fdda199b700 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8745e0 0x55c43b876a00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a10a56ead780be3 server_cookie=5b4d82c00e516fc0 in_seq=0 out_seq=0 2023-09-21T12:59:59.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.725+0000 7fdd857fa700 10 client.26477 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:59.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.726+0000 7fdd857fa700 1 -- 172.21.15.142:0/2811514163 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c43b829020 con 0x55c43b8745e0 2023-09-21T12:59:59.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.726+0000 7fdd857fa700 10 client.26477 handle_command_reply: tid=0 2023-09-21T12:59:59.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.726+0000 7fddb75bcb80 1 client.26477 shutdown 2023-09-21T12:59:59.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 msgr2=0x55c43b864480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c5b0 tx=0x7fdd8c0992b0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 shutdown_connections 2023-09-21T12:59:59.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8745e0 0x55c43b876a00 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b863f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fdd857fa700 0 client.26477 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:59.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/2811514163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b864480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.727+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 >> 172.21.15.142:0/2811514163 conn(0x55c43b787000 msgr2=0x55c43b855290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.728+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 shutdown_connections 2023-09-21T12:59:59.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.728+0000 7fddb75bcb80 1 -- 172.21.15.142:0/2811514163 wait complete. 2023-09-21T12:59:59.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.730+0000 7fddb75bcb80 20 client.26477 trim_cache size 0 max 16384 2023-09-21T12:59:59.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 Processor -- start 2023-09-21T12:59:59.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 -- start start 2023-09-21T12:59:59.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85a610 0x55c43b86b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b62c920 con 0x55c43b85a610 2023-09-21T12:59:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b85b510 con 0x55c43b85af30 2023-09-21T12:59:59.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.754+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b871cd0 con 0x55c43b85f360 2023-09-21T12:59:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda199b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85a610 0x55c43b86b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44848/0 (socket says 172.21.15.142:44848) 2023-09-21T12:59:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 -- 172.21.15.142:0/372567766 learned_addr learned my addr 172.21.15.142:0/372567766 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:59.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda219c700 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 -- 172.21.15.142:0/372567766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 msgr2=0x55c43b85e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 -- 172.21.15.142:0/372567766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85a610 msgr2=0x55c43b86b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85a610 0x55c43b86b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 -- 172.21.15.142:0/372567766 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c43b5fd250 con 0x55c43b85af30 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.755+0000 7fdda119a700 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000c00 tx=0x7fdd8c010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63537488eac33715 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.756+0000 7fdd90bff700 1 -- 172.21.15.142:0/372567766 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0a1890 con 0x55c43b85af30 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.756+0000 7fdd90bff700 1 -- 172.21.15.142:0/372567766 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8c0ae020 con 0x55c43b85af30 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.756+0000 7fdd90bff700 1 -- 172.21.15.142:0/372567766 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c099cc0 con 0x55c43b85af30 2023-09-21T12:59:59.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.756+0000 7fddb75bcb80 1 -- 172.21.15.142:0/372567766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 msgr2=0x55c43b85e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.756+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c000c00 tx=0x7fdd8c010c60 comp rx=0 tx=0).stop 2023-09-21T12:59:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 -- 172.21.15.142:0/372567766 shutdown_connections 2023-09-21T12:59:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85a610 0x55c43b86b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85f360 0x55c43b85e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/372567766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b85e090 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 -- 172.21.15.142:0/372567766 >> 172.21.15.142:0/372567766 conn(0x55c43b787000 msgr2=0x55c43b86fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 -- 172.21.15.142:0/372567766 shutdown_connections 2023-09-21T12:59:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 -- 172.21.15.142:0/372567766 wait complete. 2023-09-21T12:59:59.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 -- start start 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.757+0000 7fddb75bcb80 1 Processor -- start 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b867c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b8c7900 con 0x55c43b85f360 2023-09-21T12:59:59.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b8c7a70 con 0x55c43b85af30 2023-09-21T12:59:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c43b8c7c30 con 0x55c43b85a610 2023-09-21T12:59:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fddb75bcb80 10 client.0 _ll_register_callbacks cb 0x55c43b692a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T12:59:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fdda199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fdda199b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56556/0 (socket says 172.21.15.142:56556) 2023-09-21T12:59:59.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fdda199b700 1 -- 172.21.15.142:0/193031158 learned_addr learned my addr 172.21.15.142:0/193031158 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T12:59:59.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.758+0000 7fdda119a700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b867c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 -- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 msgr2=0x55c43b867c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b867c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 -- 172.21.15.142:0/193031158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 msgr2=0x55c43b8c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T12:59:59.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 -- 172.21.15.142:0/193031158 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c43b5bfc60 con 0x55c43b85a610 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdda199b700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd980098e0 tx=0x7fdd98009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab245ef2951c4656 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdd857fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.759+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9802b040 con 0x55c43b85a610 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd9400f040 con 0x55c43b85a610 2023-09-21T12:59:59.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdd980339f0 con 0x55c43b85a610 2023-09-21T12:59:59.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd98033bb0 con 0x55c43b85a610 2023-09-21T12:59:59.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 10 client.26443 fetch_fsmap learned FSMap version 24 2023-09-21T12:59:59.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55c43b5d52b0 con 0x55c43b85a610 2023-09-21T12:59:59.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd9400f040 con 0x55c43b85a610 2023-09-21T12:59:59.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fdd9803c690 con 0x55c43b85a610 2023-09-21T12:59:59.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 10 client.26443 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T12:59:59.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 10 client.26443 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T12:59:59.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 20 client.26443 populate_metadata read hostname 'smithi142' 2023-09-21T12:59:59.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8d1c90 0x55c43b8d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T12:59:59.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 4 client.26443 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T12:59:59.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.760+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c43b7a4e60 con 0x55c43b8d1c90 2023-09-21T12:59:59.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fdda119a700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8d1c90 0x55c43b8d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T12:59:59.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fdda119a700 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8d1c90 0x55c43b8d40b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f72fdc40f195aa0 server_cookie=c59bb886ce738590 in_seq=0 out_seq=0 2023-09-21T12:59:59.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fdd857fa700 10 client.26443 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:59.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fdd857fa700 1 -- 172.21.15.142:0/193031158 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c43b7a4e60 con 0x55c43b8d1c90 2023-09-21T12:59:59.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fdd857fa700 10 client.26443 handle_command_reply: tid=0 2023-09-21T12:59:59.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.761+0000 7fddb75bcb80 1 client.26443 shutdown 2023-09-21T12:59:59.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 msgr2=0x55c43b8676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdd980098e0 tx=0x7fdd98009ca0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 shutdown_connections 2023-09-21T12:59:59.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c43b8d1c90 0x55c43b8d40b0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c43b85f360 0x55c43b8c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c43b85a610 0x55c43b8676e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fdd857fa700 0 client.26443 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T12:59:59.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 --2- 172.21.15.142:0/193031158 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c43b85af30 0x55c43b867c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 >> 172.21.15.142:0/193031158 conn(0x55c43b787000 msgr2=0x55c43b861750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 shutdown_connections 2023-09-21T12:59:59.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 1 -- 172.21.15.142:0/193031158 wait complete. 2023-09-21T12:59:59.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.762+0000 7fddb75bcb80 20 client.26443 trim_cache size 0 max 16384 2023-09-21T12:59:59.775 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T12:59:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T12:59:59.775 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T12:59:59.776 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T12:59:59.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 msgr2=0x7fdd880a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 0x7fdd880a2c70 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800b2e0 tx=0x7fdd98005fd0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 msgr2=0x7fdd9c199660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T12:59:59.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00e9f0 tx=0x7fdd8c00ed00 comp rx=0 tx=0).stop 2023-09-21T12:59:59.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 shutdown_connections 2023-09-21T12:59:59.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdd880a07b0 0x7fdd880a2c70 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdd9c101ef0 0x7fdd9c199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdd9c10b310 0x7fdd9c19da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 --2- 172.21.15.142:0/1804943080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdd9c102810 0x7fdd9c199660 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T12:59:59.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.763+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 >> 172.21.15.142:0/1804943080 conn(0x7fdd9c0fb730 msgr2=0x7fdd9c10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T12:59:59.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.764+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 shutdown_connections 2023-09-21T12:59:59.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T12:59:59.764+0000 7fdda3bff700 1 -- 172.21.15.142:0/1804943080 wait complete. 2023-09-21T12:59:59.793 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T12:59:59.794 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:00:00.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 -- 172.21.15.142:0/1069723454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca0103bc0 msgr2=0x7fcca0107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 --2- 172.21.15.142:0/1069723454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca0103bc0 0x7fcca0107c00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009990 tx=0x7fcc94009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 -- 172.21.15.142:0/1069723454 shutdown_connections 2023-09-21T13:00:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 --2- 172.21.15.142:0/1069723454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0108330 0x7fcca010feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 --2- 172.21.15.142:0/1069723454 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0103210 0x7fcca01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 --2- 172.21.15.142:0/1069723454 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca0103bc0 0x7fcca0107c00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 -- 172.21.15.142:0/1069723454 >> 172.21.15.142:0/1069723454 conn(0x7fcca00fea70 msgr2=0x7fcca0100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 -- 172.21.15.142:0/1069723454 shutdown_connections 2023-09-21T13:00:00.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.035+0000 7fcca61ff700 1 -- 172.21.15.142:0/1069723454 wait complete. 2023-09-21T13:00:00.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.036+0000 7fcca61ff700 1 Processor -- start 2023-09-21T13:00:00.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 -- start start 2023-09-21T13:00:00.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 0x7fcca0199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 0x7fcca019de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca019e440 con 0x7fcca019d9c0 2023-09-21T13:00:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca019e5b0 con 0x7fcca0108330 2023-09-21T13:00:00.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcca61ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca019e770 con 0x7fcca0103210 2023-09-21T13:00:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcc9f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcc9f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56574/0 (socket says 172.21.15.142:56574) 2023-09-21T13:00:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcc9effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 0x7fcca0199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcc9f7fe700 1 -- 172.21.15.142:0/636481123 learned_addr learned my addr 172.21.15.142:0/636481123 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.037+0000 7fcc9ffff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 0x7fcca019de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 -- 172.21.15.142:0/636481123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 msgr2=0x7fcca0199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 0x7fcca0199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 -- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 msgr2=0x7fcca019de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 0x7fcca019de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 -- 172.21.15.142:0/636481123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc940095f0 con 0x7fcca0103210 2023-09-21T13:00:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9ffff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 0x7fcca019de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9effd700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 0x7fcca0199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9f7fe700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e9a0 tx=0x7fcc9000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90009790 con 0x7fcca0103210 2023-09-21T13:00:00.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc9000cbd0 con 0x7fcca0103210 2023-09-21T13:00:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca01a5cd0 con 0x7fcca0103210 2023-09-21T13:00:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc90018680 con 0x7fcca0103210 2023-09-21T13:00:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.038+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca01a61b0 con 0x7fcca0103210 2023-09-21T13:00:00.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.039+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca0067bd0 con 0x7fcca0103210 2023-09-21T13:00:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.042+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcc9000cd40 con 0x7fcca0103210 2023-09-21T13:00:00.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.044+0000 7fcc9cff9700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 0x7fcc880a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.044+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcc90014070 con 0x7fcca0103210 2023-09-21T13:00:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.044+0000 7fcc9effd700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 0x7fcc880a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.045+0000 7fcc9effd700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 0x7fcc880a2cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400b2e0 tx=0x7fcc94005960 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.045+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcc90095e00 con 0x7fcca0103210 2023-09-21T13:00:00.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 12:59:59 smithi156 ceph-mon[134078]: pgmap v115: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-21T13:00:00.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 12:59:59 smithi142 ceph-mon[97663]: pgmap v115: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-21T13:00:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 12:59:59 smithi160 ceph-mon[134450]: pgmap v115: 97 pgs: 97 active+clean; 85 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-21T13:00:00.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.361+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcca0103df0 con 0x7fcca0103210 2023-09-21T13:00:00.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.362+0000 7fcc9cff9700 1 -- 172.21.15.142:0/636481123 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+11335 (secure 0 0 0) 0x7fcc90099420 con 0x7fcca0103210 2023-09-21T13:00:00.361 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:00:00.362 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T12:57:46.421112+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:00:00.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 msgr2=0x7fcc880a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 0x7fcc880a2cb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400b2e0 tx=0x7fcc94005960 comp rx=0 tx=0).stop 2023-09-21T13:00:00.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 msgr2=0x7fcca0199020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000e9a0 tx=0x7fcc9000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 shutdown_connections 2023-09-21T13:00:00.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcc880a07f0 0x7fcc880a2cb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcca019d9c0 0x7fcca019de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcca0103210 0x7fcca0199020 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 --2- 172.21.15.142:0/636481123 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcca0108330 0x7fcca0199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 >> 172.21.15.142:0/636481123 conn(0x7fcca00fea70 msgr2=0x7fcca00ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 shutdown_connections 2023-09-21T13:00:00.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.365+0000 7fcca61ff700 1 -- 172.21.15.142:0/636481123 wait complete. 2023-09-21T13:00:00.367 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 24 2023-09-21T13:00:00.391 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:00:00.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 -- 172.21.15.142:0/1474044487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 msgr2=0x7fddc4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 --2- 172.21.15.142:0/1474044487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4101380 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009990 tx=0x7fddb4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 -- 172.21.15.142:0/1474044487 shutdown_connections 2023-09-21T13:00:00.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 --2- 172.21.15.142:0/1474044487 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 --2- 172.21.15.142:0/1474044487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4101380 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 --2- 172.21.15.142:0/1474044487 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc4101950 0x7fddc4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 -- 172.21.15.142:0/1474044487 >> 172.21.15.142:0/1474044487 conn(0x7fddc40fc860 msgr2=0x7fddc40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 -- 172.21.15.142:0/1474044487 shutdown_connections 2023-09-21T13:00:00.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.620+0000 7fddc8dff700 1 -- 172.21.15.142:0/1474044487 wait complete. 2023-09-21T13:00:00.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.621+0000 7fddc8dff700 1 Processor -- start 2023-09-21T13:00:00.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.621+0000 7fddc8dff700 1 -- start start 2023-09-21T13:00:00.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.621+0000 7fddc8dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc41973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc8dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc419b840 0x7fddc419bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc419c2c0 con 0x7fddc41060c0 2023-09-21T13:00:00.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc8dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc419c430 con 0x7fddc419b840 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc8dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc419c5f0 con 0x7fddc4100fa0 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56594/0 (socket says 172.21.15.142:56594) 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 -- 172.21.15.142:0/4237831887 learned_addr learned my addr 172.21.15.142:0/4237831887 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc419b840 0x7fddc419bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddbbfff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc41973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 -- 172.21.15.142:0/4237831887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc419b840 msgr2=0x7fddc419bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc419b840 0x7fddc419bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 -- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 msgr2=0x7fddc41973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc41973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 -- 172.21.15.142:0/4237831887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40095f0 con 0x7fddc4100fa0 2023-09-21T13:00:00.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddbbfff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc41973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:00.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.622+0000 7fddc259c700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005910 tx=0x7fddb4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.623+0000 7fddbb7fe700 1 -- 172.21.15.142:0/4237831887 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb401d070 con 0x7fddc4100fa0 2023-09-21T13:00:00.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.623+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc41a3af0 con 0x7fddc4100fa0 2023-09-21T13:00:00.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.623+0000 7fddbb7fe700 1 -- 172.21.15.142:0/4237831887 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddb4022470 con 0x7fddc4100fa0 2023-09-21T13:00:00.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.623+0000 7fddbb7fe700 1 -- 172.21.15.142:0/4237831887 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb4017650 con 0x7fddc4100fa0 2023-09-21T13:00:00.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.623+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc41a3f20 con 0x7fddc4100fa0 2023-09-21T13:00:00.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.626+0000 7fddbb7fe700 1 -- 172.21.15.142:0/4237831887 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fddb40225e0 con 0x7fddc4100fa0 2023-09-21T13:00:00.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.627+0000 7fdddc692b80 1 Processor -- start 2023-09-21T13:00:00.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 -- start start 2023-09-21T13:00:00.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 0x5591444d9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddbb7fe700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 0x7fddb00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444da7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559144449ca0 con 0x5591444d5f30 2023-09-21T13:00:00.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914442dc70 con 0x5591444d5610 2023-09-21T13:00:00.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fdddc692b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55914442b590 con 0x5591444da360 2023-09-21T13:00:00.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddbb7fe700 1 -- 172.21.15.142:0/4237831887 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fddb40cd360 con 0x7fddc4100fa0 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44894/0 (socket says 172.21.15.142:44894) 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddc2d9d700 1 -- 172.21.15.142:0/1736404564 learned_addr learned my addr 172.21.15.142:0/1736404564 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444da7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.628+0000 7fddbbfff700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 0x5591444d9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc259c700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 0x7fddb00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 -- 172.21.15.142:0/1736404564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 msgr2=0x5591444da7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444da7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 -- 172.21.15.142:0/1736404564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 msgr2=0x5591444d9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 0x5591444d9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 -- 172.21.15.142:0/1736404564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559144251de0 con 0x5591444d5610 2023-09-21T13:00:00.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddbbfff700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 0x5591444d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:00.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009060 tx=0x7fddbc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=839395518e143091 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddb8ff9700 1 -- 172.21.15.142:0/1736404564 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e070 con 0x5591444d5610 2023-09-21T13:00:00.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddb8ff9700 1 -- 172.21.15.142:0/1736404564 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddbc00f040 con 0x5591444d5610 2023-09-21T13:00:00.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddb8ff9700 1 -- 172.21.15.142:0/1736404564 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc018cd0 con 0x5591444d5610 2023-09-21T13:00:00.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.629+0000 7fddc259c700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 0x7fddb00a2c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddb4006010 tx=0x7fddb401a040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 -- 172.21.15.142:0/1736404564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 msgr2=0x5591444d59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fddbc009060 tx=0x7fddbc009920 comp rx=0 tx=0).stop 2023-09-21T13:00:00.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 -- 172.21.15.142:0/1736404564 shutdown_connections 2023-09-21T13:00:00.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444da7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5610 0x5591444d59f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 --2- 172.21.15.142:0/1736404564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5f30 0x5591444d9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 -- 172.21.15.142:0/1736404564 >> 172.21.15.142:0/1736404564 conn(0x559144402000 msgr2=0x5591444d06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 -- 172.21.15.142:0/1736404564 shutdown_connections 2023-09-21T13:00:00.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.630+0000 7fdddc692b80 1 -- 172.21.15.142:0/1736404564 wait complete. 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 -- start start 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 Processor -- start 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444d5610 0x5591444deec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444da360 0x5591444df940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559144426e80 con 0x5591444da360 2023-09-21T13:00:00.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591443c3740 con 0x5591444d5f30 2023-09-21T13:00:00.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591443c33e0 con 0x5591444d5610 2023-09-21T13:00:00.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.631+0000 7fdddc692b80 10 client.0 _ll_register_callbacks cb 0x55914430da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:00.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44902/0 (socket says 172.21.15.142:44902) 2023-09-21T13:00:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 -- 172.21.15.142:0/3716193945 learned_addr learned my addr 172.21.15.142:0/3716193945 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444d5610 0x5591444deec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444da360 0x5591444df940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 -- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444d5610 msgr2=0x5591444deec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444d5610 0x5591444deec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 -- 172.21.15.142:0/3716193945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444da360 msgr2=0x5591444df940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444da360 0x5591444df940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 -- 172.21.15.142:0/3716193945 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddbc0089b0 con 0x5591444d5f30 2023-09-21T13:00:00.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fddbbfff700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddac013800 tx=0x7fddac013bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11ab95a3e92c812f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fdda9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:00.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac011ac0 con 0x5591444d5f30 2023-09-21T13:00:00.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fddac011c20 con 0x5591444d5f30 2023-09-21T13:00:00.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.632+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559144397bb0 con 0x5591444d5f30 2023-09-21T13:00:00.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddac011de0 con 0x5591444d5f30 2023-09-21T13:00:00.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 10 client.26501 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:00.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55914423ac60 con 0x5591444d5f30 2023-09-21T13:00:00.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559144397bb0 con 0x5591444d5f30 2023-09-21T13:00:00.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fddac01d510 con 0x5591444d5f30 2023-09-21T13:00:00.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 10 client.26501 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:00.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 10 client.26501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:00:00.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 20 client.26501 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:00.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5591444ef660 0x5591444f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 4 client.26501 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:00.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.633+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591444a4020 con 0x5591444ef660 2023-09-21T13:00:00.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.634+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5591444ef660 0x5591444f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.634+0000 7fdda9ffb700 10 client.26501 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:00.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.634+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5591444ef660 0x5591444f1a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=339d2fb8dadc2eb8 server_cookie=a0dbab5e6833555c in_seq=0 out_seq=0 2023-09-21T13:00:00.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdda9ffb700 1 -- 172.21.15.142:0/3716193945 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5591444a4020 con 0x5591444ef660 2023-09-21T13:00:00.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdda9ffb700 10 client.26501 handle_command_reply: tid=0 2023-09-21T13:00:00.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 client.26501 shutdown 2023-09-21T13:00:00.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 msgr2=0x5591444df400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fddac013800 tx=0x7fddac013bc0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 shutdown_connections 2023-09-21T13:00:00.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5591444ef660 0x5591444f1a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444da360 0x5591444df940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444d5610 0x5591444deec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdda9ffb700 0 client.26501 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 --2- 172.21.15.142:0/3716193945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444df400 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.635+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 >> 172.21.15.142:0/3716193945 conn(0x559144402000 msgr2=0x5591444d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.636+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 shutdown_connections 2023-09-21T13:00:00.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.636+0000 7fdddc692b80 1 -- 172.21.15.142:0/3716193945 wait complete. 2023-09-21T13:00:00.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.636+0000 7fdddc692b80 20 client.26501 trim_cache size 0 max 16384 2023-09-21T13:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 Processor -- start 2023-09-21T13:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 -- start start 2023-09-21T13:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444eac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591442a7920 con 0x5591444d5610 2023-09-21T13:00:00.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591444cff90 con 0x5591444d5f30 2023-09-21T13:00:00.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.649+0000 7fdddc692b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591444d8190 con 0x5591444da360 2023-09-21T13:00:00.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55636/0 (socket says 172.21.15.142:55636) 2023-09-21T13:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 -- 172.21.15.142:0/361654078 learned_addr learned my addr 172.21.15.142:0/361654078 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddbbfff700 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 -- 172.21.15.142:0/361654078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 msgr2=0x5591444eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444eac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 -- 172.21.15.142:0/361654078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 msgr2=0x5591444db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 -- 172.21.15.142:0/361654078 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591444f6670 con 0x5591444d5610 2023-09-21T13:00:00.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006080 tx=0x7fddbc0093f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0edbdb60cd2eff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddb97fa700 1 -- 172.21.15.142:0/361654078 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e040 con 0x5591444d5610 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddb97fa700 1 -- 172.21.15.142:0/361654078 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddbc034070 con 0x5591444d5610 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.650+0000 7fddb97fa700 1 -- 172.21.15.142:0/361654078 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc018920 con 0x5591444d5610 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 -- 172.21.15.142:0/361654078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 msgr2=0x5591444d7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fddbc006080 tx=0x7fddbc0093f0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 -- 172.21.15.142:0/361654078 shutdown_connections 2023-09-21T13:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444d7c50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 --2- 172.21.15.142:0/361654078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 -- 172.21.15.142:0/361654078 >> 172.21.15.142:0/361654078 conn(0x559144402000 msgr2=0x5591444cf880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 -- 172.21.15.142:0/361654078 shutdown_connections 2023-09-21T13:00:00.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.651+0000 7fdddc692b80 1 -- 172.21.15.142:0/361654078 wait complete. 2023-09-21T13:00:00.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 -- start start 2023-09-21T13:00:00.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 Processor -- start 2023-09-21T13:00:00.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444e4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559144542620 con 0x5591444d5610 2023-09-21T13:00:00.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559144542790 con 0x5591444d5f30 2023-09-21T13:00:00.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559144542950 con 0x5591444da360 2023-09-21T13:00:00.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fdddc692b80 10 client.0 _ll_register_callbacks cb 0x55914430da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:00.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fddc2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55644/0 (socket says 172.21.15.142:55644) 2023-09-21T13:00:00.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.652+0000 7fddc2d9d700 1 -- 172.21.15.142:0/2952215268 learned_addr learned my addr 172.21.15.142:0/2952215268 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444e4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddbbfff700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 -- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 msgr2=0x5591444e4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444e4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 -- 172.21.15.142:0/2952215268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 msgr2=0x5591444e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 -- 172.21.15.142:0/2952215268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559144251de0 con 0x5591444d5610 2023-09-21T13:00:00.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fddc2d9d700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000f80 tx=0x7fddbc005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715b810f177fb7db server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fdda9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:00:00.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc00e040 con 0x5591444d5610 2023-09-21T13:00:00.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fddbc00f040 con 0x5591444d5610 2023-09-21T13:00:00.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.653+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fddbc030ab0 con 0x5591444d5610 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddbc030c70 con 0x5591444d5610 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 10 client.16416 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559144278250 con 0x5591444d5610 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddbc00f040 con 0x5591444d5610 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fddbc018640 con 0x5591444d5610 2023-09-21T13:00:00.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 10 client.16416 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 10 client.16416 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:00:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 20 client.16416 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x559144543d30 0x559144546120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 4 client.16416 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:00.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55914441fe60 con 0x559144543d30 2023-09-21T13:00:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.654+0000 7fddbbfff700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x559144543d30 0x559144546120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdda9ffb700 10 client.16416 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fddbbfff700 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x559144543d30 0x559144546120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be24537d8d3c6ca7 server_cookie=edf3b1dbfc78c3cf in_seq=0 out_seq=0 2023-09-21T13:00:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdda9ffb700 1 -- 172.21.15.142:0/2952215268 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55914441fe60 con 0x559144543d30 2023-09-21T13:00:00.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdda9ffb700 10 client.16416 handle_command_reply: tid=0 2023-09-21T13:00:00.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 client.16416 shutdown 2023-09-21T13:00:00.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 msgr2=0x5591444e3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fddbc000f80 tx=0x7fddbc005040 comp rx=0 tx=0).stop 2023-09-21T13:00:00.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 shutdown_connections 2023-09-21T13:00:00.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x559144543d30 0x559144546120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5591444d5610 0x5591444e3da0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5591444da360 0x5591444e4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdda9ffb700 0 client.16416 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 --2- 172.21.15.142:0/2952215268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5591444d5f30 0x5591444e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 >> 172.21.15.142:0/2952215268 conn(0x559144402000 msgr2=0x5591444dc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 shutdown_connections 2023-09-21T13:00:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.655+0000 7fdddc692b80 1 -- 172.21.15.142:0/2952215268 wait complete. 2023-09-21T13:00:00.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fdddc692b80 20 client.16416 trim_cache size 0 max 16384 2023-09-21T13:00:00.672 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 msgr2=0x7fddb00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 0x7fddb00a2c70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fddb4006010 tx=0x7fddb401a040 comp rx=0 tx=0).stop 2023-09-21T13:00:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 msgr2=0x7fddc4196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fddb4005910 tx=0x7fddb4005740 comp rx=0 tx=0).stop 2023-09-21T13:00:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 shutdown_connections 2023-09-21T13:00:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fddb00a07b0 0x7fddb00a2c70 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fddc419b840 0x7fddc419bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fddc4100fa0 0x7fddc4196ea0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 --2- 172.21.15.142:0/4237831887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fddc41060c0 0x7fddc41973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 >> 172.21.15.142:0/4237831887 conn(0x7fddc40fc860 msgr2=0x7fddc4105200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 shutdown_connections 2023-09-21T13:00:00.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.656+0000 7fddc8dff700 1 -- 172.21.15.142:0/4237831887 wait complete. 2023-09-21T13:00:00.676 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:00:00.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 333144 10.48 MB/sec execute 41 sec latency 30.248 ms 2023-09-21T13:00:00.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/305845521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44100fc0 msgr2=0x7ffa441013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/305845521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44100fc0 0x7ffa441013a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ffa340098f0 tx=0x7ffa34009c00 comp rx=0 tx=0).stop 2023-09-21T13:00:00.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/305845521 shutdown_connections 2023-09-21T13:00:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/305845521 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa441060e0 0x7ffa4410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/305845521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44100fc0 0x7ffa441013a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/305845521 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa44101970 0x7ffa441059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/305845521 >> 172.21.15.142:0/305845521 conn(0x7ffa440fc840 msgr2=0x7ffa440fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/305845521 shutdown_connections 2023-09-21T13:00:00.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.900+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/305845521 wait complete. 2023-09-21T13:00:00.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.901+0000 7ffa4a9ff700 1 Processor -- start 2023-09-21T13:00:00.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 -- start start 2023-09-21T13:00:00.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa441060e0 0x7ffa44073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 0x7ffa441a5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441a5820 con 0x7ffa441060e0 2023-09-21T13:00:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441a5990 con 0x7ffa44100fc0 2023-09-21T13:00:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa4a9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa441a5b50 con 0x7ffa44073b60 2023-09-21T13:00:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa441060e0 0x7ffa44073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa48f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 0x7ffa441a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44924/0 (socket says 172.21.15.142:44924) 2023-09-21T13:00:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.902+0000 7ffa43fff700 1 -- 172.21.15.142:0/3991395345 learned_addr learned my addr 172.21.15.142:0/3991395345 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 -- 172.21.15.142:0/3991395345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 msgr2=0x7ffa441a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 0x7ffa441a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 -- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa441060e0 msgr2=0x7ffa44073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa441060e0 0x7ffa44073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 -- 172.21.15.142:0/3991395345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa3c009d00 con 0x7ffa44100fc0 2023-09-21T13:00:00.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 0x7ffa441a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:00.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009810 tx=0x7ffa3400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa417fa700 1 -- 172.21.15.142:0/3991395345 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3401c070 con 0x7ffa44100fc0 2023-09-21T13:00:00.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34009520 con 0x7ffa44100fc0 2023-09-21T13:00:00.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa417fa700 1 -- 172.21.15.142:0/3991395345 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa3400ba40 con 0x7ffa44100fc0 2023-09-21T13:00:00.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa417fa700 1 -- 172.21.15.142:0/3991395345 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34004930 con 0x7ffa44100fc0 2023-09-21T13:00:00.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.903+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa441a60c0 con 0x7ffa44100fc0 2023-09-21T13:00:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.907+0000 7ffa417fa700 1 -- 172.21.15.142:0/3991395345 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ffa34020070 con 0x7ffa44100fc0 2023-09-21T13:00:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 Processor -- start 2023-09-21T13:00:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 -- start start 2023-09-21T13:00:00.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa417fa700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 0x7ffa2c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b549f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa417fa700 1 -- 172.21.15.142:0/3991395345 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa340ccae0 con 0x7ffa44100fc0 2023-09-21T13:00:00.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b58e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73ac8ca0 con 0x562a73b59360 2023-09-21T13:00:00.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73aacc70 con 0x562a73b54610 2023-09-21T13:00:00.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.909+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73aaa590 con 0x562a73b54f30 2023-09-21T13:00:00.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b58e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b58e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56658/0 (socket says 172.21.15.142:56658) 2023-09-21T13:00:00.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa437fe700 1 -- 172.21.15.142:0/1231215874 learned_addr learned my addr 172.21.15.142:0/1231215874 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 0x7ffa2c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 -- 172.21.15.142:0/1231215874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 msgr2=0x562a73b58e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b58e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 -- 172.21.15.142:0/1231215874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 msgr2=0x562a73b597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 -- 172.21.15.142:0/1231215874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a738d0de0 con 0x562a73b54610 2023-09-21T13:00:00.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:00:00.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa43fff700 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b549f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffa340ca200 tx=0x7ffa340999d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1f7f90ad6226884 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa2a7fc700 1 -- 172.21.15.142:0/1231215874 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34099ff0 con 0x562a73b54610 2023-09-21T13:00:00.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa2a7fc700 1 -- 172.21.15.142:0/1231215874 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa3409de20 con 0x562a73b54610 2023-09-21T13:00:00.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.910+0000 7ffa2a7fc700 1 -- 172.21.15.142:0/1231215874 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340994e0 con 0x562a73b54610 2023-09-21T13:00:00.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1231215874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 msgr2=0x562a73b549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 0x7ffa2c0a2cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009610 tx=0x7ffa3c0099e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b549f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ffa340ca200 tx=0x7ffa340999d0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1231215874 shutdown_connections 2023-09-21T13:00:00.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b549f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1231215874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b58e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1231215874 >> 172.21.15.142:0/1231215874 conn(0x562a73a81000 msgr2=0x562a73b4f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1231215874 shutdown_connections 2023-09-21T13:00:00.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.911+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1231215874 wait complete. 2023-09-21T13:00:00.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.912+0000 7ffa5e31cb80 1 -- start start 2023-09-21T13:00:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.912+0000 7ffa5e31cb80 1 Processor -- start 2023-09-21T13:00:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b5dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b59360 0x562a73b5e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73aa5e80 con 0x562a73b54610 2023-09-21T13:00:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73a42740 con 0x562a73b59360 2023-09-21T13:00:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73a423e0 con 0x562a73b54f30 2023-09-21T13:00:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa5e31cb80 10 client.0 _ll_register_callbacks cb 0x562a7398ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55680/0 (socket says 172.21.15.142:55680) 2023-09-21T13:00:00.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 -- 172.21.15.142:0/3267003500 learned_addr learned my addr 172.21.15.142:0/3267003500 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b5dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b59360 0x562a73b5e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 -- 172.21.15.142:0/3267003500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 msgr2=0x562a73b5dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.924 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b5dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 -- 172.21.15.142:0/3267003500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b59360 msgr2=0x562a73b5e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b59360 0x562a73b5e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 -- 172.21.15.142:0/3267003500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa441a60c0 con 0x562a73b54610 2023-09-21T13:00:00.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffa34011040 tx=0x7ffa34009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd30d58d4d68865e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.913+0000 7ffa237fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:00:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa34099ff0 con 0x562a73b54610 2023-09-21T13:00:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa3409a460 con 0x562a73b54610 2023-09-21T13:00:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a73a16bb0 con 0x562a73b54610 2023-09-21T13:00:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa340b20d0 con 0x562a73b54610 2023-09-21T13:00:00.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 10 client.16425 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562a738b9c60 con 0x562a73b54610 2023-09-21T13:00:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a73a16bb0 con 0x562a73b54610 2023-09-21T13:00:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffa3409eb60 con 0x562a73b54610 2023-09-21T13:00:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 10 client.16425 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:00.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 10 client.16425 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:00:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 20 client.16425 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73b6dc00 0x562a73b70020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 4 client.16425 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.914+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a73b23020 con 0x562a73b6dc00 2023-09-21T13:00:00.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.915+0000 7ffa437fe700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73b6dc00 0x562a73b70020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.915+0000 7ffa437fe700 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73b6dc00 0x562a73b70020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f01162944a96f04 server_cookie=82b19d7eaaf4a78 in_seq=0 out_seq=0 2023-09-21T13:00:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.915+0000 7ffa237fe700 10 client.16425 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa237fe700 1 -- 172.21.15.142:0/3267003500 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a73b23020 con 0x562a73b6dc00 2023-09-21T13:00:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa237fe700 10 client.16425 handle_command_reply: tid=0 2023-09-21T13:00:00.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 client.16425 shutdown 2023-09-21T13:00:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 msgr2=0x562a73b60a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ffa34011040 tx=0x7ffa34009260 comp rx=0 tx=0).stop 2023-09-21T13:00:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 shutdown_connections 2023-09-21T13:00:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b60a40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73b6dc00 0x562a73b70020 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b59360 0x562a73b5e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3267003500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b5dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa237fe700 0 client.16425 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 >> 172.21.15.142:0/3267003500 conn(0x562a73a81000 msgr2=0x562a73b4f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 shutdown_connections 2023-09-21T13:00:00.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.916+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3267003500 wait complete. 2023-09-21T13:00:00.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.917+0000 7ffa5e31cb80 20 client.16425 trim_cache size 0 max 16384 2023-09-21T13:00:00.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.930+0000 7ffa5e31cb80 1 Processor -- start 2023-09-21T13:00:00.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.930+0000 7ffa5e31cb80 1 -- start start 2023-09-21T13:00:00.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b65260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 0x562a73b605e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73926920 con 0x562a73b54610 2023-09-21T13:00:00.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73b5f2a0 con 0x562a73b54f30 2023-09-21T13:00:00.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73b49990 con 0x562a73b59360 2023-09-21T13:00:00.938 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 0x562a73b605e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b65260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56676/0 (socket says 172.21.15.142:56676) 2023-09-21T13:00:00.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 0x562a73b605e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44946/0 (socket says 172.21.15.142:44946) 2023-09-21T13:00:00.939 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 -- 172.21.15.142:0/1971696419 learned_addr learned my addr 172.21.15.142:0/1971696419 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 -- 172.21.15.142:0/1971696419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 msgr2=0x562a73b605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 0x562a73b605e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 -- 172.21.15.142:0/1971696419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 msgr2=0x562a73b65260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b65260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.940 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.931+0000 7ffa48f9c700 1 -- 172.21.15.142:0/1971696419 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a738f7250 con 0x562a73b59360 2023-09-21T13:00:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.932+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c027d60 tx=0x7ffa3c016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67734b4d66de1f43 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.932+0000 7ffa2affd700 1 -- 172.21.15.142:0/1971696419 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c00e020 con 0x562a73b59360 2023-09-21T13:00:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.932+0000 7ffa2affd700 1 -- 172.21.15.142:0/1971696419 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa3c00f040 con 0x562a73b59360 2023-09-21T13:00:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.932+0000 7ffa2affd700 1 -- 172.21.15.142:0/1971696419 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c01c040 con 0x562a73b59360 2023-09-21T13:00:00.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1971696419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 msgr2=0x562a73b5d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c027d60 tx=0x7ffa3c016000 comp rx=0 tx=0).stop 2023-09-21T13:00:00.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1971696419 shutdown_connections 2023-09-21T13:00:00.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b54610 0x562a73b65260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b59360 0x562a73b5d4e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/1971696419 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54f30 0x562a73b605e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1971696419 >> 172.21.15.142:0/1971696419 conn(0x562a73a81000 msgr2=0x562a73b6a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1971696419 shutdown_connections 2023-09-21T13:00:00.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/1971696419 wait complete. 2023-09-21T13:00:00.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 -- start start 2023-09-21T13:00:00.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.933+0000 7ffa5e31cb80 1 Processor -- start 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b631f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b63730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73b63c70 con 0x562a73b59360 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73b63db0 con 0x562a73b54610 2023-09-21T13:00:00.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a73b63f70 con 0x562a73b54f30 2023-09-21T13:00:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa5e31cb80 10 client.0 _ll_register_callbacks cb 0x562a7398ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44958/0 (socket says 172.21.15.142:44958) 2023-09-21T13:00:00.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa437fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56684/0 (socket says 172.21.15.142:56684) 2023-09-21T13:00:00.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 -- 172.21.15.142:0/3366814486 learned_addr learned my addr 172.21.15.142:0/3366814486 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:00.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa48f9c700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b63730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 -- 172.21.15.142:0/3366814486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 msgr2=0x562a73b631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.934+0000 7ffa43fff700 1 -- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 msgr2=0x562a73b63730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b63730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa43fff700 1 -- 172.21.15.142:0/3366814486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa3c027a40 con 0x562a73b54610 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa43fff700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa3409ef20 tx=0x7ffa34099ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a76ff0caae95f2f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:00.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa340057a0 con 0x562a73b54610 2023-09-21T13:00:00.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ffa3407c020 con 0x562a73b54610 2023-09-21T13:00:00.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffa3409de20 con 0x562a73b54610 2023-09-21T13:00:00.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa34099ff0 con 0x562a73b54610 2023-09-21T13:00:00.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa5e31cb80 10 client.26525 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:00.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x562a738cf2b0 con 0x562a73b54610 2023-09-21T13:00:00.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffa3409de20 con 0x562a73b54610 2023-09-21T13:00:00.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.935+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ffa340a1bd0 con 0x562a73b54610 2023-09-21T13:00:00.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 10 client.26525 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:00.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 10 client.26525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:00:00.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 20 client.26525 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:00.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73bc29e0 0x562a73bc4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:00.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 4 client.26525 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:00.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562a73a9ee60 con 0x562a73bc29e0 2023-09-21T13:00:00.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa437fe700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73bc29e0 0x562a73bc4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:00.950 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa437fe700 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73bc29e0 0x562a73bc4dd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=524c20323e7c811d server_cookie=51d5ea8b1edc47b8 in_seq=0 out_seq=0 2023-09-21T13:00:00.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.936+0000 7ffa237fe700 10 client.26525 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:00.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa237fe700 1 -- 172.21.15.142:0/3366814486 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562a73a9ee60 con 0x562a73bc29e0 2023-09-21T13:00:00.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa237fe700 10 client.26525 handle_command_reply: tid=0 2023-09-21T13:00:00.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 client.26525 shutdown 2023-09-21T13:00:00.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 msgr2=0x562a73b64f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ffa3409ef20 tx=0x7ffa34099ef0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 shutdown_connections 2023-09-21T13:00:00.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562a73b59360 0x562a73b63730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562a73bc29e0 0x562a73bc4dd0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562a73b54610 0x562a73b64f00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 --2- 172.21.15.142:0/3366814486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562a73b54f30 0x562a73b631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa237fe700 0 client.26525 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:00.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 >> 172.21.15.142:0/3366814486 conn(0x562a73a81000 msgr2=0x562a73b53410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 shutdown_connections 2023-09-21T13:00:00.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 1 -- 172.21.15.142:0/3366814486 wait complete. 2023-09-21T13:00:00.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.937+0000 7ffa5e31cb80 20 client.26525 trim_cache size 0 max 16384 2023-09-21T13:00:00.954 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:00.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 msgr2=0x7ffa2c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 0x7ffa2c0a2cf0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009610 tx=0x7ffa3c0099e0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 msgr2=0x7ffa440730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:00.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ffa34009810 tx=0x7ffa3400fa00 comp rx=0 tx=0).stop 2023-09-21T13:00:00.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 shutdown_connections 2023-09-21T13:00:00.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ffa2c0a0830 0x7ffa2c0a2cf0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa44073b60 0x7ffa441a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ffa44100fc0 0x7ffa440730e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 --2- 172.21.15.142:0/3991395345 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ffa441060e0 0x7ffa44073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:00.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 >> 172.21.15.142:0/3991395345 conn(0x7ffa440fc840 msgr2=0x7ffa44104ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:00.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 shutdown_connections 2023-09-21T13:00:00.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:00.938+0000 7ffa4a9ff700 1 -- 172.21.15.142:0/3991395345 wait complete. 2023-09-21T13:00:00.959 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:00 smithi142 ceph-mon[97663]: overall HEALTH_OK 2023-09-21T13:00:00.959 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:00 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/636481123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:00.960 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:00:01.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:00 smithi156 ceph-mon[134078]: overall HEALTH_OK 2023-09-21T13:00:01.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:00 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/636481123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:01.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 -- 172.21.15.142:0/2780434821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 msgr2=0x7f5ddc10d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 --2- 172.21.15.142:0/2780434821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc10d7d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400b0a0 tx=0x7f5dd400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 -- 172.21.15.142:0/2780434821 shutdown_connections 2023-09-21T13:00:01.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 --2- 172.21.15.142:0/2780434821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc101f80 0x7f5ddc102360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 --2- 172.21.15.142:0/2780434821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc10d7d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 --2- 172.21.15.142:0/2780434821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc1028a0 0x7f5ddc10ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 -- 172.21.15.142:0/2780434821 >> 172.21.15.142:0/2780434821 conn(0x7f5ddc0fb740 msgr2=0x7f5ddc0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 -- 172.21.15.142:0/2780434821 shutdown_connections 2023-09-21T13:00:01.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.174+0000 7f5de0bff700 1 -- 172.21.15.142:0/2780434821 wait complete. 2023-09-21T13:00:01.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.176+0000 7f5de0bff700 1 Processor -- start 2023-09-21T13:00:01.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.176+0000 7f5de0bff700 1 -- start start 2023-09-21T13:00:01.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 0x7f5ddc199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc1028a0 0x7f5ddc199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc19e220 con 0x7f5ddc1028a0 2023-09-21T13:00:01.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc19e390 con 0x7f5ddc10b350 2023-09-21T13:00:01.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5de0bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ddc19e550 con 0x7f5ddc101f80 2023-09-21T13:00:01.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 0x7f5ddc199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5dd9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc1028a0 0x7f5ddc199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 0x7f5ddc199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56708/0 (socket says 172.21.15.142:56708) 2023-09-21T13:00:01.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5dda59c700 1 -- 172.21.15.142:0/971384151 learned_addr learned my addr 172.21.15.142:0/971384151 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:01.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 -- 172.21.15.142:0/971384151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 msgr2=0x7f5ddc199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 0x7f5ddc199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 -- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc1028a0 msgr2=0x7f5ddc199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc1028a0 0x7f5ddc199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.177+0000 7f5ddad9d700 1 -- 172.21.15.142:0/971384151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4009d00 con 0x7f5ddc10b350 2023-09-21T13:00:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5ddad9d700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc19dbe0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009fd0 tx=0x7f5dd4007930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5dcb7fe700 1 -- 172.21.15.142:0/971384151 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd400e040 con 0x7f5ddc10b350 2023-09-21T13:00:01.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5dcb7fe700 1 -- 172.21.15.142:0/971384151 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dd401d470 con 0x7f5ddc10b350 2023-09-21T13:00:01.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ddc19e7d0 con 0x7f5ddc10b350 2023-09-21T13:00:01.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5dcb7fe700 1 -- 172.21.15.142:0/971384151 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd40052a0 con 0x7f5ddc10b350 2023-09-21T13:00:01.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.178+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ddc102e60 con 0x7f5ddc10b350 2023-09-21T13:00:01.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.183+0000 7f5dcb7fe700 1 -- 172.21.15.142:0/971384151 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5dd401d5e0 con 0x7f5ddc10b350 2023-09-21T13:00:01.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 Processor -- start 2023-09-21T13:00:01.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 -- start start 2023-09-21T13:00:01.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715f30 0x55b0f4719e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f471a360 0x55b0f471a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f4689ca0 con 0x55b0f4715f30 2023-09-21T13:00:01.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f466dc70 con 0x55b0f4715610 2023-09-21T13:00:01.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.184+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f466b590 con 0x55b0f471a360 2023-09-21T13:00:01.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dcb7fe700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 0x7f5dc40a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44978/0 (socket says 172.21.15.142:44978) 2023-09-21T13:00:01.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 -- 172.21.15.142:0/4271227873 learned_addr learned my addr 172.21.15.142:0/4271227873 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:01.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f471a360 0x55b0f471a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dda59c700 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715f30 0x55b0f4719e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dcb7fe700 1 -- 172.21.15.142:0/971384151 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5dd40cd2e0 con 0x7f5ddc10b350 2023-09-21T13:00:01.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5ddad9d700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 0x7f5dc40a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 -- 172.21.15.142:0/4271227873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f471a360 msgr2=0x55b0f471a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f471a360 0x55b0f471a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 -- 172.21.15.142:0/4271227873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715f30 msgr2=0x55b0f4719e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715f30 0x55b0f4719e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.185+0000 7f5dd9d9b700 1 -- 172.21.15.142:0/4271227873 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f4491de0 con 0x55b0f4715610 2023-09-21T13:00:01.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.186+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0005950 tx=0x7f5dd00058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=569e1a25f116606e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.186+0000 7f5ddad9d700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 0x7f5dc40a2cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5dd409a7e0 tx=0x7f5dd400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.186+0000 7f5dc8ff9700 1 -- 172.21.15.142:0/4271227873 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0013e70 con 0x55b0f4715610 2023-09-21T13:00:01.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.186+0000 7f5dc8ff9700 1 -- 172.21.15.142:0/4271227873 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dd00044e0 con 0x55b0f4715610 2023-09-21T13:00:01.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.186+0000 7f5dc8ff9700 1 -- 172.21.15.142:0/4271227873 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0005020 con 0x55b0f4715610 2023-09-21T13:00:01.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:00 smithi160 ceph-mon[134450]: overall HEALTH_OK 2023-09-21T13:00:01.191 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:00 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/636481123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- 172.21.15.142:0/4271227873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 msgr2=0x55b0f47159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5dd0005950 tx=0x7f5dd00058e0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- 172.21.15.142:0/4271227873 shutdown_connections 2023-09-21T13:00:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f471a360 0x55b0f471a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47159f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/4271227873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715f30 0x55b0f4719e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- 172.21.15.142:0/4271227873 >> 172.21.15.142:0/4271227873 conn(0x55b0f4642000 msgr2=0x55b0f47106a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- 172.21.15.142:0/4271227873 shutdown_connections 2023-09-21T13:00:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- 172.21.15.142:0/4271227873 wait complete. 2023-09-21T13:00:01.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.187+0000 7f5df45e7b80 1 -- start start 2023-09-21T13:00:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.188+0000 7f5df45e7b80 1 Processor -- start 2023-09-21T13:00:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f4721ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f4666e80 con 0x55b0f471a360 2023-09-21T13:00:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f4603740 con 0x55b0f4715610 2023-09-21T13:00:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f46033e0 con 0x55b0f4715f30 2023-09-21T13:00:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5df45e7b80 10 client.0 _ll_register_callbacks cb 0x55b0f454da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56720/0 (socket says 172.21.15.142:56720) 2023-09-21T13:00:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 -- 172.21.15.142:0/1744812494 learned_addr learned my addr 172.21.15.142:0/1744812494 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f4721ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 -- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 msgr2=0x55b0f4721ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f4721ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 -- 172.21.15.142:0/1744812494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 msgr2=0x55b0f471f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 -- 172.21.15.142:0/1744812494 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd001b040 con 0x55b0f4715f30 2023-09-21T13:00:01.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f4721ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:01.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dda59c700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc012980 tx=0x7f5dcc012d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d370dc36df533646 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.189+0000 7f5dc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:01.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc017070 con 0x55b0f4715f30 2023-09-21T13:00:01.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0f45d7bb0 con 0x55b0f4715f30 2023-09-21T13:00:01.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5dcc004050 con 0x55b0f4715f30 2023-09-21T13:00:01.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dcc004210 con 0x55b0f4715f30 2023-09-21T13:00:01.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 10 client.26497 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:01.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b0f447ac60 con 0x55b0f4715f30 2023-09-21T13:00:01.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0f45d7bb0 con 0x55b0f4715f30 2023-09-21T13:00:01.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5dcc003820 con 0x55b0f4715f30 2023-09-21T13:00:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 10 client.26497 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 10 client.26497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 20 client.26497 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f472f530 0x55b0f4731950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 4 client.26497 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:01.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.190+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0f46e4020 con 0x55b0f472f530 2023-09-21T13:00:01.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.191+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f472f530 0x55b0f4731950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.191+0000 7f5dc1ffb700 10 client.26497 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:01.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.191+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f472f530 0x55b0f4731950 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19a1ea8643d0fa53 server_cookie=b206021e08d4ba78 in_seq=0 out_seq=0 2023-09-21T13:00:01.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/1744812494 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0f46e4020 con 0x55b0f472f530 2023-09-21T13:00:01.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5dc1ffb700 10 client.26497 handle_command_reply: tid=0 2023-09-21T13:00:01.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 client.26497 shutdown 2023-09-21T13:00:01.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 msgr2=0x55b0f471ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc012980 tx=0x7f5dcc012d40 comp rx=0 tx=0).stop 2023-09-21T13:00:01.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 shutdown_connections 2023-09-21T13:00:01.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f472f530 0x55b0f4731950 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f4721ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/1744812494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471ed50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5dc1ffb700 0 client.26497 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:01.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 >> 172.21.15.142:0/1744812494 conn(0x55b0f4642000 msgr2=0x55b0f470f880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 shutdown_connections 2023-09-21T13:00:01.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.192+0000 7f5df45e7b80 1 -- 172.21.15.142:0/1744812494 wait complete. 2023-09-21T13:00:01.207 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.193+0000 7f5df45e7b80 20 client.26497 trim_cache size 0 max 16384 2023-09-21T13:00:01.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.206+0000 7f5df45e7b80 1 Processor -- start 2023-09-21T13:00:01.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 -- start start 2023-09-21T13:00:01.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f44e7920 con 0x55b0f471a360 2023-09-21T13:00:01.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f4708110 con 0x55b0f4715610 2023-09-21T13:00:01.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f4726a20 con 0x55b0f4715f30 2023-09-21T13:00:01.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56726/0 (socket says 172.21.15.142:56726) 2023-09-21T13:00:01.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 -- 172.21.15.142:0/3026990366 learned_addr learned my addr 172.21.15.142:0/3026990366 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:01.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 -- 172.21.15.142:0/3026990366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 msgr2=0x55b0f47264e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47264e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 -- 172.21.15.142:0/3026990366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 msgr2=0x55b0f471ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.207+0000 7f5dda59c700 1 -- 172.21.15.142:0/3026990366 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f44b8250 con 0x55b0f4715f30 2023-09-21T13:00:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc003c50 tx=0x7f5dcc012320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=736b29bab3567fb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5dc97fa700 1 -- 172.21.15.142:0/3026990366 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc017040 con 0x55b0f4715f30 2023-09-21T13:00:01.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5dc97fa700 1 -- 172.21.15.142:0/3026990366 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dcc003880 con 0x55b0f4715f30 2023-09-21T13:00:01.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5dc97fa700 1 -- 172.21.15.142:0/3026990366 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc005730 con 0x55b0f4715f30 2023-09-21T13:00:01.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3026990366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 msgr2=0x55b0f471c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.208+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc003c50 tx=0x7f5dcc012320 comp rx=0 tx=0).stop 2023-09-21T13:00:01.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3026990366 shutdown_connections 2023-09-21T13:00:01.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f471a360 0x55b0f471ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f4715610 0x55b0f47264e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3026990366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471c780 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3026990366 >> 172.21.15.142:0/3026990366 conn(0x55b0f4642000 msgr2=0x55b0f472ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3026990366 shutdown_connections 2023-09-21T13:00:01.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3026990366 wait complete. 2023-09-21T13:00:01.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 -- start start 2023-09-21T13:00:01.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.209+0000 7f5df45e7b80 1 Processor -- start 2023-09-21T13:00:01.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f471a360 0x55b0f471e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f471e7b0 con 0x55b0f4715610 2023-09-21T13:00:01.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f471e920 con 0x55b0f471a360 2023-09-21T13:00:01.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f471eae0 con 0x55b0f4715f30 2023-09-21T13:00:01.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5df45e7b80 10 client.0 _ll_register_callbacks cb 0x55b0f454da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dd9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dd9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55762/0 (socket says 172.21.15.142:55762) 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dd9d9b700 1 -- 172.21.15.142:0/3110869991 learned_addr learned my addr 172.21.15.142:0/3110869991 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f471a360 0x55b0f471e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 -- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f471a360 msgr2=0x55b0f471e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f471a360 0x55b0f471e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 -- 172.21.15.142:0/3110869991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 msgr2=0x55b0f471d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:01.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dda59c700 1 -- 172.21.15.142:0/3110869991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0f447ac60 con 0x55b0f4715f30 2023-09-21T13:00:01.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.210+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:01.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dda59c700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471da60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00f7a0 tx=0x7f5dcc0039f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96a91a4795569540 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:01.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dc1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:01.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc017040 con 0x55b0f4715f30 2023-09-21T13:00:01.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5dd00044e0 con 0x55b0f4715f30 2023-09-21T13:00:01.223 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5dcc003e40 con 0x55b0f4715f30 2023-09-21T13:00:01.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dcc003700 con 0x55b0f4715f30 2023-09-21T13:00:01.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5df45e7b80 10 client.26503 fetch_fsmap learned FSMap version 24 2023-09-21T13:00:01.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55b0f44902b0 con 0x55b0f4715f30 2023-09-21T13:00:01.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.211+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dd00044e0 con 0x55b0f4715f30 2023-09-21T13:00:01.224 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 24) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5dcc02b020 con 0x55b0f4715f30 2023-09-21T13:00:01.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 10 client.26503 fetch_fsmap finished waiting for FSMap version 24 2023-09-21T13:00:01.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 10 client.26503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:01.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 20 client.26503 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:01.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f4783e20 0x55b0f4786240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:01.225 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 4 client.26503 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:01.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b0f465fe60 con 0x55b0f4783e20 2023-09-21T13:00:01.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f4783e20 0x55b0f4786240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:01.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5dd9d9b700 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f4783e20 0x55b0f4786240 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78fda6be45a772eb server_cookie=1edb9ecb4dc077e in_seq=0 out_seq=0 2023-09-21T13:00:01.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.212+0000 7f5dc1ffb700 10 client.26503 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:01.226 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5dc1ffb700 1 -- 172.21.15.142:0/3110869991 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b0f465fe60 con 0x55b0f4783e20 2023-09-21T13:00:01.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5dc1ffb700 10 client.26503 handle_command_reply: tid=0 2023-09-21T13:00:01.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 client.26503 shutdown 2023-09-21T13:00:01.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 msgr2=0x55b0f471da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471da60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00f7a0 tx=0x7f5dcc0039f0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 shutdown_connections 2023-09-21T13:00:01.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b0f4783e20 0x55b0f4786240 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b0f4715610 0x55b0f471d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b0f471a360 0x55b0f471e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5dc1ffb700 0 client.26503 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:01.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 --2- 172.21.15.142:0/3110869991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b0f4715f30 0x55b0f471da60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 >> 172.21.15.142:0/3110869991 conn(0x55b0f4642000 msgr2=0x55b0f47183f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 shutdown_connections 2023-09-21T13:00:01.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 1 -- 172.21.15.142:0/3110869991 wait complete. 2023-09-21T13:00:01.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.213+0000 7f5df45e7b80 20 client.26503 trim_cache size 0 max 16384 2023-09-21T13:00:01.232 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:01.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 msgr2=0x7f5dc40a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 0x7f5dc40a2cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5dd409a7e0 tx=0x7f5dd400b040 comp rx=0 tx=0).stop 2023-09-21T13:00:01.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 msgr2=0x7f5ddc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:01.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc19dbe0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009fd0 tx=0x7f5dd4007930 comp rx=0 tx=0).stop 2023-09-21T13:00:01.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 shutdown_connections 2023-09-21T13:00:01.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dc40a0830 0x7f5dc40a2cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5ddc10b350 0x7f5ddc19dbe0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ddc101f80 0x7f5ddc199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 --2- 172.21.15.142:0/971384151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5ddc1028a0 0x7f5ddc199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:01.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 >> 172.21.15.142:0/971384151 conn(0x7f5ddc0fb740 msgr2=0x7f5ddc10d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:01.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 shutdown_connections 2023-09-21T13:00:01.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:01.214+0000 7f5de0bff700 1 -- 172.21.15.142:0/971384151 wait complete. 2023-09-21T13:00:01.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 334365 10.37 MB/sec execute 42 sec latency 37.371 ms 2023-09-21T13:00:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:01 smithi156 ceph-mon[134078]: pgmap v116: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 396 op/s 2023-09-21T13:00:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:01 smithi142 ceph-mon[97663]: pgmap v116: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 396 op/s 2023-09-21T13:00:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:01 smithi160 ceph-mon[134450]: pgmap v116: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 396 op/s 2023-09-21T13:00:02.237 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T13:00:02.238 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T13:00:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/188228304 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf34103b70 msgr2=0x7fdf34107bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/188228304 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf34103b70 0x7fdf34107bb0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009990 tx=0x7fdf28009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/188228304 shutdown_connections 2023-09-21T13:00:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/188228304 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf341082e0 0x7fdf3410fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/188228304 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf341035a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/188228304 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf34103b70 0x7fdf34107bb0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.446+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/188228304 >> 172.21.15.142:0/188228304 conn(0x7fdf340fea40 msgr2=0x7fdf34100e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.447+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/188228304 shutdown_connections 2023-09-21T13:00:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.447+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/188228304 wait complete. 2023-09-21T13:00:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 Processor -- start 2023-09-21T13:00:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 -- start start 2023-09-21T13:00:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf341082e0 0x7fdf341997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf3419dc10 0x7fdf3419e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3419e690 con 0x7fdf3419dc10 2023-09-21T13:00:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3419e800 con 0x7fdf341031c0 2023-09-21T13:00:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.448+0000 7fdf3a7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3419e9c0 con 0x7fdf341082e0 2023-09-21T13:00:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45012/0 (socket says 172.21.15.142:45012) 2023-09-21T13:00:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 -- 172.21.15.142:0/3247248796 learned_addr learned my addr 172.21.15.142:0/3247248796 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf3419dc10 0x7fdf3419e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf337fe700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf341082e0 0x7fdf341997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 -- 172.21.15.142:0/3247248796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf341082e0 msgr2=0x7fdf341997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf341082e0 0x7fdf341997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 -- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf3419dc10 msgr2=0x7fdf3419e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf3419dc10 0x7fdf3419e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 -- 172.21.15.142:0/3247248796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280095f0 con 0x7fdf341031c0 2023-09-21T13:00:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.449+0000 7fdf33fff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9a0 tx=0x7fdf2400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.450+0000 7fdf317fa700 1 -- 172.21.15.142:0/3247248796 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24009790 con 0x7fdf341031c0 2023-09-21T13:00:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.450+0000 7fdf317fa700 1 -- 172.21.15.142:0/3247248796 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf24010430 con 0x7fdf341031c0 2023-09-21T13:00:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.450+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf341a5f20 con 0x7fdf341031c0 2023-09-21T13:00:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.450+0000 7fdf317fa700 1 -- 172.21.15.142:0/3247248796 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24018680 con 0x7fdf341031c0 2023-09-21T13:00:02.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.450+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf341a6350 con 0x7fdf341031c0 2023-09-21T13:00:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.454+0000 7fdf317fa700 1 -- 172.21.15.142:0/3247248796 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdf240105a0 con 0x7fdf341031c0 2023-09-21T13:00:02.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.455+0000 7fdf4e12bb80 1 Processor -- start 2023-09-21T13:00:02.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.455+0000 7fdf4e12bb80 1 -- start start 2023-09-21T13:00:02.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a42a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a46ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7329b6d20 con 0x55b732a42fb0 2023-09-21T13:00:02.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b73299acf0 con 0x55b732a473e0 2023-09-21T13:00:02.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732998610 con 0x55b732a42690 2023-09-21T13:00:02.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a46ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45024/0 (socket says 172.21.15.142:45024) 2023-09-21T13:00:02.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 -- 172.21.15.142:0/2333210085 learned_addr learned my addr 172.21.15.142:0/2333210085 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf317fa700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 0x7fdf1c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a42a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 -- 172.21.15.142:0/2333210085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 msgr2=0x55b732a42a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a42a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 -- 172.21.15.142:0/2333210085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 msgr2=0x55b732a46ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a46ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf337fe700 1 -- 172.21.15.142:0/2333210085 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7327bee60 con 0x55b732a473e0 2023-09-21T13:00:02.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.456+0000 7fdf317fa700 1 -- 172.21.15.142:0/3247248796 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf24014070 con 0x7fdf341031c0 2023-09-21T13:00:02.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.457+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 0x7fdf1c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.457+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009990 tx=0x7fdf2800b5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c08db7b62e16bac server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.457+0000 7fdf1a7fc700 1 -- 172.21.15.142:0/2333210085 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2801d070 con 0x55b732a473e0 2023-09-21T13:00:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.457+0000 7fdf1a7fc700 1 -- 172.21.15.142:0/2333210085 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2801e040 con 0x55b732a473e0 2023-09-21T13:00:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.457+0000 7fdf1a7fc700 1 -- 172.21.15.142:0/2333210085 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28004880 con 0x55b732a473e0 2023-09-21T13:00:02.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2333210085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 msgr2=0x55b732a47840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 0x7fdf1c0a2cf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009ec0 tx=0x7fdf2c009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009990 tx=0x7fdf2800b5b0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2333210085 shutdown_connections 2023-09-21T13:00:02.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a47840 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a42a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2333210085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a46ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2333210085 >> 172.21.15.142:0/2333210085 conn(0x55b73296f080 msgr2=0x55b732a3d720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2333210085 shutdown_connections 2023-09-21T13:00:02.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.458+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2333210085 wait complete. 2023-09-21T13:00:02.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 -- start start 2023-09-21T13:00:02.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 Processor -- start 2023-09-21T13:00:02.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a473e0 0x55b732a4c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732993f00 con 0x55b732a473e0 2023-09-21T13:00:02.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7329307c0 con 0x55b732a42690 2023-09-21T13:00:02.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732930460 con 0x55b732a42fb0 2023-09-21T13:00:02.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.459+0000 7fdf4e12bb80 10 client.0 _ll_register_callbacks cb 0x55b73287ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:02.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56760/0 (socket says 172.21.15.142:56760) 2023-09-21T13:00:02.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45030/0 (socket says 172.21.15.142:45030) 2023-09-21T13:00:02.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 -- 172.21.15.142:0/1103624542 learned_addr learned my addr 172.21.15.142:0/1103624542 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a473e0 0x55b732a4c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 -- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 msgr2=0x55b732a4eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 -- 172.21.15.142:0/1103624542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a473e0 msgr2=0x55b732a4c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a473e0 0x55b732a4c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 -- 172.21.15.142:0/1103624542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf341106d0 con 0x55b732a42fb0 2023-09-21T13:00:02.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf33fff700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:02.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf337fe700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf280056d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79f15adb41445b47 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf137fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:02.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2801d030 con 0x55b732a42fb0 2023-09-21T13:00:02.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b732904c30 con 0x55b732a42fb0 2023-09-21T13:00:02.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.460+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf28004910 con 0x55b732a42fb0 2023-09-21T13:00:02.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf28005bc0 con 0x55b732a42fb0 2023-09-21T13:00:02.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 10 client.26515 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:02.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55b7327a7ce0 con 0x55b732a42fb0 2023-09-21T13:00:02.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b732904c30 con 0x55b732a42fb0 2023-09-21T13:00:02.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fdf2800fa00 con 0x55b732a42fb0 2023-09-21T13:00:02.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 10 client.26515 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:02.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 10 client.26515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:02.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 20 client.26515 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:02.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732a5bf60 0x55b732a5e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 4 client.26515 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:02.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b732a110a0 con 0x55b732a5bf60 2023-09-21T13:00:02.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.461+0000 7fdf33fff700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732a5bf60 0x55b732a5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.462+0000 7fdf33fff700 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732a5bf60 0x55b732a5e380 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41dd33b73b68e20e server_cookie=e54de5ca251e87bc in_seq=0 out_seq=0 2023-09-21T13:00:02.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.462+0000 7fdf137fe700 10 client.26515 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf137fe700 1 -- 172.21.15.142:0/1103624542 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b732a110a0 con 0x55b732a5bf60 2023-09-21T13:00:02.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf137fe700 10 client.26515 handle_command_reply: tid=0 2023-09-21T13:00:02.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 client.26515 shutdown 2023-09-21T13:00:02.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 msgr2=0x55b732a4bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf280056d0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 shutdown_connections 2023-09-21T13:00:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732a5bf60 0x55b732a5e380 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a473e0 0x55b732a4c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf137fe700 0 client.26515 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a4eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/1103624542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42fb0 0x55b732a4bd60 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 >> 172.21.15.142:0/1103624542 conn(0x55b73296f080 msgr2=0x55b732a3d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 shutdown_connections 2023-09-21T13:00:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/1103624542 wait complete. 2023-09-21T13:00:02.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.463+0000 7fdf4e12bb80 20 client.26515 trim_cache size 0 max 16384 2023-09-21T13:00:02.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.481+0000 7fdf4e12bb80 1 Processor -- start 2023-09-21T13:00:02.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.481+0000 7fdf4e12bb80 1 -- start start 2023-09-21T13:00:02.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a4ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a491b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7328149a0 con 0x55b732a42fb0 2023-09-21T13:00:02.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732a110a0 con 0x55b732a473e0 2023-09-21T13:00:02.498 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732904c30 con 0x55b732a42690 2023-09-21T13:00:02.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf38d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56774/0 (socket says 172.21.15.142:56774) 2023-09-21T13:00:02.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 -- 172.21.15.142:0/682059666 learned_addr learned my addr 172.21.15.142:0/682059666 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf337fe700 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a4ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 -- 172.21.15.142:0/682059666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 msgr2=0x55b732a491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 -- 172.21.15.142:0/682059666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 msgr2=0x55b732a4ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a4ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf33fff700 1 -- 172.21.15.142:0/682059666 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7327e52d0 con 0x55b732a42690 2023-09-21T13:00:02.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.482+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:02.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.483+0000 7fdf33fff700 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e970 tx=0x7fdf240ce340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77e4c2bab7f5221 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.483+0000 7fdf1affd700 1 -- 172.21.15.142:0/682059666 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2409d170 con 0x55b732a42690 2023-09-21T13:00:02.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.483+0000 7fdf1affd700 1 -- 172.21.15.142:0/682059666 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf24099050 con 0x55b732a42690 2023-09-21T13:00:02.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.483+0000 7fdf1affd700 1 -- 172.21.15.142:0/682059666 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a1580 con 0x55b732a42690 2023-09-21T13:00:02.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.483+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/682059666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 msgr2=0x55b732a4b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e970 tx=0x7fdf240ce340 comp rx=0 tx=0).stop 2023-09-21T13:00:02.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/682059666 shutdown_connections 2023-09-21T13:00:02.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a473e0 0x55b732a491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a42690 0x55b732a4b520 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/682059666 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a4ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/682059666 >> 172.21.15.142:0/682059666 conn(0x55b73296f080 msgr2=0x55b732a464c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/682059666 shutdown_connections 2023-09-21T13:00:02.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/682059666 wait complete. 2023-09-21T13:00:02.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 -- start start 2023-09-21T13:00:02.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.484+0000 7fdf4e12bb80 1 Processor -- start 2023-09-21T13:00:02.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a527e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 0x55b732aafda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732ab02e0 con 0x55b732a42fb0 2023-09-21T13:00:02.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732ab0420 con 0x55b732a42690 2023-09-21T13:00:02.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b732ab0560 con 0x55b732a473e0 2023-09-21T13:00:02.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf4e12bb80 10 client.0 _ll_register_callbacks cb 0x55b73287ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:02.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45056/0 (socket says 172.21.15.142:45056) 2023-09-21T13:00:02.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf337fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf33fff700 1 -- 172.21.15.142:0/2017673360 learned_addr learned my addr 172.21.15.142:0/2017673360 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.485+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 0x55b732aafda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 -- 172.21.15.142:0/2017673360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 msgr2=0x55b732aafda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 0x55b732aafda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 -- 172.21.15.142:0/2017673360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 msgr2=0x55b732a527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 -- 172.21.15.142:0/2017673360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c018480 con 0x55b732a42690 2023-09-21T13:00:02.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf38d9c700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 0x55b732aafda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:02.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:02.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf33fff700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdf24095f80 tx=0x7fdf240c97c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8d9d9b1296230bc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf137fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:02.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf24099c10 con 0x55b732a42690 2023-09-21T13:00:02.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fdf240a1580 con 0x55b732a42690 2023-09-21T13:00:02.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf2801e040 con 0x55b732a42690 2023-09-21T13:00:02.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf24099510 con 0x55b732a42690 2023-09-21T13:00:02.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf4e12bb80 10 client.26561 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:02.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.486+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x7fdf341a6350 con 0x55b732a42690 2023-09-21T13:00:02.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf2801e040 con 0x55b732a42690 2023-09-21T13:00:02.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fdf24099770 con 0x55b732a42690 2023-09-21T13:00:02.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 10 client.26561 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:02.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 10 client.26561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 20 client.26561 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732ab1890 0x55b732ab3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 4 client.26561 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T13:00:02.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b73298cee0 con 0x55b732ab1890 2023-09-21T13:00:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732ab1890 0x55b732ab3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf137fe700 10 client.26561 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.487+0000 7fdf337fe700 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732ab1890 0x55b732ab3cb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e169605994c75fb9 server_cookie=f5b7fa7eac6133e5 in_seq=0 out_seq=0 2023-09-21T13:00:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf137fe700 1 -- 172.21.15.142:0/2017673360 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b73298cee0 con 0x55b732ab1890 2023-09-21T13:00:02.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf137fe700 10 client.26561 handle_command_reply: tid=0 2023-09-21T13:00:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 client.26561 shutdown 2023-09-21T13:00:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 msgr2=0x55b732a522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdf24095f80 tx=0x7fdf240c97c0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 shutdown_connections 2023-09-21T13:00:02.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b732ab1890 0x55b732ab3cb0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b732a473e0 0x55b732aafda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b732a42690 0x55b732a522a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 --2- 172.21.15.142:0/2017673360 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b732a42fb0 0x55b732a527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.489+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 >> 172.21.15.142:0/2017673360 conn(0x55b73296f080 msgr2=0x55b732a4d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf137fe700 0 client.26561 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 shutdown_connections 2023-09-21T13:00:02.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf4e12bb80 1 -- 172.21.15.142:0/2017673360 wait complete. 2023-09-21T13:00:02.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf4e12bb80 20 client.26561 trim_cache size 0 max 16384 2023-09-21T13:00:02.519 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:00:02.520 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T13:00:02.520 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "47e9b433-fe8d-4b1b-a7fe-2eb428abfab8", 2023-09-21T13:00:02.520 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T13:00:02.521 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:00:02.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 msgr2=0x7fdf1c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 0x7fdf1c0a2cf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c009ec0 tx=0x7fdf2c009040 comp rx=0 tx=0).stop 2023-09-21T13:00:02.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 msgr2=0x7fdf34199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400e9a0 tx=0x7fdf2400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 shutdown_connections 2023-09-21T13:00:02.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.490+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdf1c0a0830 0x7fdf1c0a2cf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdf3419dc10 0x7fdf3419e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdf341031c0 0x7fdf34199270 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 --2- 172.21.15.142:0/3247248796 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf341082e0 0x7fdf341997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 >> 172.21.15.142:0/3247248796 conn(0x7fdf340fea40 msgr2=0x7fdf340ff5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 shutdown_connections 2023-09-21T13:00:02.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.491+0000 7fdf3a7ff700 1 -- 172.21.15.142:0/3247248796 wait complete. 2023-09-21T13:00:02.528 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:00:02.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 337118 10.52 MB/sec execute 43 sec latency 13.846 ms 2023-09-21T13:00:02.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 -- 172.21.15.142:0/2138976070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f4073190 msgr2=0x7fd0f4073570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/2138976070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f4073190 0x7fd0f4073570 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40098f0 tx=0x7fd0e4009c00 comp rx=0 tx=0).stop 2023-09-21T13:00:02.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 -- 172.21.15.142:0/2138976070 shutdown_connections 2023-09-21T13:00:02.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/2138976070 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f410d620 0x7fd0f410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/2138976070 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f4073190 0x7fd0f4073570 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/2138976070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073ab0 0x7fd0f410d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 -- 172.21.15.142:0/2138976070 >> 172.21.15.142:0/2138976070 conn(0x7fd0f40fc850 msgr2=0x7fd0f40fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 -- 172.21.15.142:0/2138976070 shutdown_connections 2023-09-21T13:00:02.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.739+0000 7fd0f8dff700 1 -- 172.21.15.142:0/2138976070 wait complete. 2023-09-21T13:00:02.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.740+0000 7fd0f8dff700 1 Processor -- start 2023-09-21T13:00:02.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.740+0000 7fd0f8dff700 1 -- start start 2023-09-21T13:00:02.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f4073ab0 0x7fd0f41995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 0x7fd0f419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f419e070 con 0x7fd0f4073ab0 2023-09-21T13:00:02.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f419e1e0 con 0x7fd0f410d620 2023-09-21T13:00:02.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f8dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f419e3a0 con 0x7fd0f4073190 2023-09-21T13:00:02.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 0x7fd0f419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56804/0 (socket says 172.21.15.142:56804) 2023-09-21T13:00:02.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f259c700 1 -- 172.21.15.142:0/13280072 learned_addr learned my addr 172.21.15.142:0/13280072 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f4073ab0 0x7fd0f41995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/13280072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 msgr2=0x7fd0f4199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f4073ab0 msgr2=0x7fd0f41995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f4073ab0 0x7fd0f41995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/13280072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4009520 con 0x7fd0f410d620 2023-09-21T13:00:02.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.741+0000 7fd0f259c700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:02.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 0x7fd0f419da30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00efc0 tx=0x7fd0ec00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0e37fe700 1 -- 172.21.15.142:0/13280072 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec018070 con 0x7fd0f410d620 2023-09-21T13:00:02.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0e37fe700 1 -- 172.21.15.142:0/13280072 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ec00f040 con 0x7fd0f410d620 2023-09-21T13:00:02.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f419e620 con 0x7fd0f410d620 2023-09-21T13:00:02.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0e37fe700 1 -- 172.21.15.142:0/13280072 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec00cd30 con 0x7fd0f410d620 2023-09-21T13:00:02.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.742+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f41a5ec0 con 0x7fd0f410d620 2023-09-21T13:00:02.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.745+0000 7fd0e37fe700 1 -- 172.21.15.142:0/13280072 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd0ec003a00 con 0x7fd0f410d620 2023-09-21T13:00:02.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.746+0000 7fd10c665b80 1 Processor -- start 2023-09-21T13:00:02.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0e37fe700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 0x7fd0dc0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 -- start start 2023-09-21T13:00:02.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0e37fe700 1 -- 172.21.15.142:0/13280072 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd0ec0cba90 con 0x7fd0f410d620 2023-09-21T13:00:02.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 0x7fd0dc0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca67e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca6837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca5f2ca0 con 0x5617ca67e610 2023-09-21T13:00:02.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca5d6c70 con 0x5617ca683360 2023-09-21T13:00:02.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd10c665b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca5d4590 con 0x5617ca67ef30 2023-09-21T13:00:02.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56818/0 (socket says 172.21.15.142:56818) 2023-09-21T13:00:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/614759377 learned_addr learned my addr 172.21.15.142:0/614759377 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.747+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca6837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f259c700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca67e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/614759377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 msgr2=0x5617ca6837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca6837c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/614759377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 msgr2=0x5617ca67e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca67e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/614759377 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617ca3fade0 con 0x5617ca67ef30 2023-09-21T13:00:02.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f259c700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca67e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:00:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 0x7fd0dc0a2cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8011630 tx=0x7fd0e80119f0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8011df0 tx=0x7fd0e801d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f774fd3c65ef4c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0e0ff9700 1 -- 172.21.15.142:0/614759377 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8003b90 con 0x5617ca67ef30 2023-09-21T13:00:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0e0ff9700 1 -- 172.21.15.142:0/614759377 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0e8015070 con 0x5617ca67ef30 2023-09-21T13:00:02.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.748+0000 7fd0e0ff9700 1 -- 172.21.15.142:0/614759377 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e80052f0 con 0x5617ca67ef30 2023-09-21T13:00:02.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 -- 172.21.15.142:0/614759377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 msgr2=0x5617ca682e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8011df0 tx=0x7fd0e801d000 comp rx=0 tx=0).stop 2023-09-21T13:00:02.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 -- 172.21.15.142:0/614759377 shutdown_connections 2023-09-21T13:00:02.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca67e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca6837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 --2- 172.21.15.142:0/614759377 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca682e20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 -- 172.21.15.142:0/614759377 >> 172.21.15.142:0/614759377 conn(0x5617ca5ab000 msgr2=0x5617ca6796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 -- 172.21.15.142:0/614759377 shutdown_connections 2023-09-21T13:00:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.749+0000 7fd10c665b80 1 -- 172.21.15.142:0/614759377 wait complete. 2023-09-21T13:00:02.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.750+0000 7fd10c665b80 1 -- start start 2023-09-21T13:00:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.750+0000 7fd10c665b80 1 Processor -- start 2023-09-21T13:00:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.750+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.750+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 0x5617ca687de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 0x5617ca688520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd10c665b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca5cfe80 con 0x5617ca67e610 2023-09-21T13:00:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd10c665b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca56c740 con 0x5617ca67ef30 2023-09-21T13:00:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd10c665b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca56c3e0 con 0x5617ca683360 2023-09-21T13:00:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd10c665b80 10 client.0 _ll_register_callbacks cb 0x5617ca4b6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 0x5617ca687de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 0x5617ca688520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 0x5617ca687de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45098/0 (socket says 172.21.15.142:45098) 2023-09-21T13:00:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55828/0 (socket says 172.21.15.142:55828) 2023-09-21T13:00:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/1185471943 learned_addr learned my addr 172.21.15.142:0/1185471943 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 msgr2=0x5617ca687de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 0x5617ca687de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1185471943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 msgr2=0x5617ca68ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1185471943 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e8004040 con 0x5617ca683360 2023-09-21T13:00:02.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 0x5617ca688520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0c91b0 tx=0x7fd0ec098bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493c112f682997f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.751+0000 7fd0d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec004ad0 con 0x5617ca683360 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd0ec0996a0 con 0x5617ca683360 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617ca540bb0 con 0x5617ca683360 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0ec098fa0 con 0x5617ca683360 2023-09-21T13:00:02.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 10 client.26533 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5617ca3e3c60 con 0x5617ca683360 2023-09-21T13:00:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ec07b080 con 0x5617ca683360 2023-09-21T13:00:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd0ec098490 con 0x5617ca683360 2023-09-21T13:00:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 10 client.26533 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:02.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 10 client.26533 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:02.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 20 client.26533 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:02.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6983c0 0x5617ca69a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 4 client.26533 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:02.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.752+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617ca64d020 con 0x5617ca6983c0 2023-09-21T13:00:02.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.753+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6983c0 0x5617ca69a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.753+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6983c0 0x5617ca69a7e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63e2bf7b6788f941 server_cookie=63a67509fc03a15a in_seq=0 out_seq=0 2023-09-21T13:00:02.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.753+0000 7fd0d9ffb700 10 client.26533 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1185471943 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5617ca64d020 con 0x5617ca6983c0 2023-09-21T13:00:02.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd0d9ffb700 10 client.26533 handle_command_reply: tid=0 2023-09-21T13:00:02.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 client.26533 shutdown 2023-09-21T13:00:02.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 msgr2=0x5617ca688520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 0x5617ca688520 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0c91b0 tx=0x7fd0ec098bd0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 shutdown_connections 2023-09-21T13:00:02.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6983c0 0x5617ca69a7e0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca683360 0x5617ca688520 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1185471943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67ef30 0x5617ca687de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd0d9ffb700 0 client.26533 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 >> 172.21.15.142:0/1185471943 conn(0x5617ca5ab000 msgr2=0x5617ca678880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 shutdown_connections 2023-09-21T13:00:02.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 1 -- 172.21.15.142:0/1185471943 wait complete. 2023-09-21T13:00:02.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.754+0000 7fd10c665b80 20 client.26533 trim_cache size 0 max 16384 2023-09-21T13:00:02.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.771+0000 7fd10c665b80 1 Processor -- start 2023-09-21T13:00:02.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.771+0000 7fd10c665b80 1 -- start start 2023-09-21T13:00:02.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca6875a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca683360 0x5617ca687ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca450920 con 0x5617ca683360 2023-09-21T13:00:02.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca671140 con 0x5617ca67e610 2023-09-21T13:00:02.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd10c665b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca686370 con 0x5617ca67ef30 2023-09-21T13:00:02.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45110/0 (socket says 172.21.15.142:45110) 2023-09-21T13:00:02.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca683360 0x5617ca687ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 -- 172.21.15.142:0/1954328516 learned_addr learned my addr 172.21.15.142:0/1954328516 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca6875a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 -- 172.21.15.142:0/1954328516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 msgr2=0x5617ca6875a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca6875a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 -- 172.21.15.142:0/1954328516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca683360 msgr2=0x5617ca687ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca683360 0x5617ca687ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f259c700 1 -- 172.21.15.142:0/1954328516 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617ca6755b0 con 0x5617ca67e610 2023-09-21T13:00:02.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.772+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca6875a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:02.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40098c0 tx=0x7fd0e4009400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d066c494d459b3b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd0e17fa700 1 -- 172.21.15.142:0/1954328516 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e401c040 con 0x5617ca67e610 2023-09-21T13:00:02.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd0e17fa700 1 -- 172.21.15.142:0/1954328516 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0e401d040 con 0x5617ca67e610 2023-09-21T13:00:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd0e17fa700 1 -- 172.21.15.142:0/1954328516 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400b560 con 0x5617ca67e610 2023-09-21T13:00:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd10c665b80 1 -- 172.21.15.142:0/1954328516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 msgr2=0x5617ca68a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.773+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40098c0 tx=0x7fd0e4009400 comp rx=0 tx=0).stop 2023-09-21T13:00:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 -- 172.21.15.142:0/1954328516 shutdown_connections 2023-09-21T13:00:02.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca683360 0x5617ca687ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca67e610 0x5617ca68a700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1954328516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca6875a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 -- 172.21.15.142:0/1954328516 >> 172.21.15.142:0/1954328516 conn(0x5617ca5ab000 msgr2=0x5617ca685750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 -- 172.21.15.142:0/1954328516 shutdown_connections 2023-09-21T13:00:02.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 -- 172.21.15.142:0/1954328516 wait complete. 2023-09-21T13:00:02.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 -- start start 2023-09-21T13:00:02.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.774+0000 7fd10c665b80 1 Processor -- start 2023-09-21T13:00:02.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca68fa80 con 0x5617ca67e610 2023-09-21T13:00:02.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca68bf70 con 0x5617ca683360 2023-09-21T13:00:02.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617ca68c130 con 0x5617ca67ef30 2023-09-21T13:00:02.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd10c665b80 10 client.0 _ll_register_callbacks cb 0x5617ca4b6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:02.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd0f259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.775+0000 7fd0f1d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56842/0 (socket says 172.21.15.142:56842) 2023-09-21T13:00:02.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45112/0 (socket says 172.21.15.142:45112) 2023-09-21T13:00:02.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f1d9b700 1 -- 172.21.15.142:0/1589793288 learned_addr learned my addr 172.21.15.142:0/1589793288 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:02.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1589793288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 msgr2=0x5617ca68b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1589793288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 msgr2=0x5617ca68f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:02.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 -- 172.21.15.142:0/1589793288 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f41106d0 con 0x5617ca683360 2023-09-21T13:00:02.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f1d9b700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:02.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0f2d9d700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0090a0 tx=0x7fd0ec0060e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35b68598ed20a39f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:02.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:02.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec09dd10 con 0x5617ca683360 2023-09-21T13:00:02.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0e8015070 con 0x5617ca683360 2023-09-21T13:00:02.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd0ec0b5030 con 0x5617ca683360 2023-09-21T13:00:02.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0ec09de70 con 0x5617ca683360 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd10c665b80 10 client.26579 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.776+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5617ca421250 con 0x5617ca683360 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0e8015070 con 0x5617ca683360 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd0ec097f00 con 0x5617ca683360 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 10 client.26579 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:02.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 10 client.26579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:02.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 20 client.26579 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:02.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6ed1a0 0x5617ca6ef590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:02.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 4 client.26579 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:00:02.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5617ca5c8e60 con 0x5617ca6ed1a0 2023-09-21T13:00:02.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.777+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6ed1a0 0x5617ca6ef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd0f259c700 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6ed1a0 0x5617ca6ef590 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed6dc23dcc37649 server_cookie=c6af02977ceda295 in_seq=0 out_seq=0 2023-09-21T13:00:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd0d9ffb700 10 client.26579 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd0d9ffb700 1 -- 172.21.15.142:0/1589793288 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5617ca5c8e60 con 0x5617ca6ed1a0 2023-09-21T13:00:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd0d9ffb700 10 client.26579 handle_command_reply: tid=0 2023-09-21T13:00:02.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 client.26579 shutdown 2023-09-21T13:00:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 msgr2=0x5617ca68ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec0090a0 tx=0x7fd0ec0060e0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 shutdown_connections 2023-09-21T13:00:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5617ca6ed1a0 0x5617ca6ef590 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5617ca67e610 0x5617ca68f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd0d9ffb700 0 client.26579 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5617ca683360 0x5617ca68ba00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 --2- 172.21.15.142:0/1589793288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5617ca67ef30 0x5617ca68b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 >> 172.21.15.142:0/1589793288 conn(0x5617ca5ab000 msgr2=0x5617ca682c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 shutdown_connections 2023-09-21T13:00:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 1 -- 172.21.15.142:0/1589793288 wait complete. 2023-09-21T13:00:02.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.778+0000 7fd10c665b80 20 client.26579 trim_cache size 0 max 16384 2023-09-21T13:00:02.793 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:00:02.794 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T13:00:02.794 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:00:02.794 INFO:teuthology.orchestra.run.smithi142.stdout: "47e9b433-fe8d-4b1b-a7fe-2eb428abfab8": { 2023-09-21T13:00:02.794 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:00:02.794 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "47e9b433-fe8d-4b1b-a7fe-2eb428abfab8", 2023-09-21T13:00:02.795 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:00:02.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:00:02.795 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:00:02.795 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:00:02.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 msgr2=0x7fd0dc0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 0x7fd0dc0a2cf0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd0e8011630 tx=0x7fd0e80119f0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 msgr2=0x7fd0f419da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:02.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 0x7fd0f419da30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00efc0 tx=0x7fd0ec00c3a0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 shutdown_connections 2023-09-21T13:00:02.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd0dc0a0830 0x7fd0dc0a2cf0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd0f410d620 0x7fd0f419da30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f4073190 0x7fd0f4199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 --2- 172.21.15.142:0/13280072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd0f4073ab0 0x7fd0f41995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:02.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 >> 172.21.15.142:0/13280072 conn(0x7fd0f40fc850 msgr2=0x7fd0f410f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:02.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 shutdown_connections 2023-09-21T13:00:02.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:02.779+0000 7fd0f8dff700 1 -- 172.21.15.142:0/13280072 wait complete. 2023-09-21T13:00:02.799 INFO:tasks.cephfs.filesystem:scrub status for tag:47e9b433-fe8d-4b1b-a7fe-2eb428abfab8 - {'path': '/', 'tag': '47e9b433-fe8d-4b1b-a7fe-2eb428abfab8', 'options': 'recursive,force'} 2023-09-21T13:00:03.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:02 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:03.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:02 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:03.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:02 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:03.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.623+0000 7f2ed17ff700 1 -- 172.21.15.142:0/2055894229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 msgr2=0x7f2ecc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.623+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/2055894229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc068c20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009990 tx=0x7f2ec0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 -- 172.21.15.142:0/2055894229 shutdown_connections 2023-09-21T13:00:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/2055894229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc10d650 0x7f2ecc10fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/2055894229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc101cd0 0x7f2ecc0681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/2055894229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc068c20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 -- 172.21.15.142:0/2055894229 >> 172.21.15.142:0/2055894229 conn(0x7f2ecc076800 msgr2=0x7f2ecc076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 -- 172.21.15.142:0/2055894229 shutdown_connections 2023-09-21T13:00:03.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.624+0000 7f2ed17ff700 1 -- 172.21.15.142:0/2055894229 wait complete. 2023-09-21T13:00:03.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.625+0000 7f2ed17ff700 1 Processor -- start 2023-09-21T13:00:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.625+0000 7f2ed17ff700 1 -- start start 2023-09-21T13:00:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc10d650 0x7f2ecc199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 0x7f2ecc19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc19e710 con 0x7f2ecc19dc90 2023-09-21T13:00:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc19e880 con 0x7f2ecc10d650 2023-09-21T13:00:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ed17ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc19ea40 con 0x7f2ecc0687a0 2023-09-21T13:00:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56864/0 (socket says 172.21.15.142:56864) 2023-09-21T13:00:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 -- 172.21.15.142:0/1005621970 learned_addr learned my addr 172.21.15.142:0/1005621970 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:03.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc10d650 0x7f2ecc199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 0x7f2ecc19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 -- 172.21.15.142:0/1005621970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc10d650 msgr2=0x7f2ecc199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc10d650 0x7f2ecc199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 -- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 msgr2=0x7f2ecc19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 0x7f2ecc19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecaffd700 1 -- 172.21.15.142:0/1005621970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00095f0 con 0x7f2ecc0687a0 2023-09-21T13:00:03.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.626+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 0x7f2ecc19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9a0 tx=0x7f2ebc00ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2eb3fff700 1 -- 172.21.15.142:0/1005621970 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc009790 con 0x7f2ecc0687a0 2023-09-21T13:00:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc1a5fa0 con 0x7f2ecc0687a0 2023-09-21T13:00:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2eb3fff700 1 -- 172.21.15.142:0/1005621970 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ebc00cbd0 con 0x7f2ecc0687a0 2023-09-21T13:00:03.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2eb3fff700 1 -- 172.21.15.142:0/1005621970 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc018680 con 0x7f2ecc0687a0 2023-09-21T13:00:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.627+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc1a6470 con 0x7f2ecc0687a0 2023-09-21T13:00:03.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.632+0000 7f2eb3fff700 1 -- 172.21.15.142:0/1005621970 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2ebc00cd40 con 0x7f2ecc0687a0 2023-09-21T13:00:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.633+0000 7f2ee5159b80 1 Processor -- start 2023-09-21T13:00:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.633+0000 7f2eb3fff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 0x7f2eb40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 -- start start 2023-09-21T13:00:03.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2eb3fff700 1 -- 172.21.15.142:0/1005621970 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ebc014070 con 0x7f2ecc0687a0 2023-09-21T13:00:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 0x7f2eb40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e24cc40 con 0x55c62e2d89c0 2023-09-21T13:00:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e230c10 con 0x55c62e2d80a0 2023-09-21T13:00:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e22e530 con 0x55c62e2dce50 2023-09-21T13:00:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45152/0 (socket says 172.21.15.142:45152) 2023-09-21T13:00:03.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.634+0000 7f2ecaffd700 1 -- 172.21.15.142:0/3672582640 learned_addr learned my addr 172.21.15.142:0/3672582640 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 -- 172.21.15.142:0/3672582640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 msgr2=0x55c62e2dd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 -- 172.21.15.142:0/3672582640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 msgr2=0x55c62e2dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 -- 172.21.15.142:0/3672582640 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c62e054d80 con 0x55c62e2d80a0 2023-09-21T13:00:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:00:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 0x7f2eb40a2c70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d20 tx=0x7f2ec4009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc096120 tx=0x7f2ebc0995b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27ccc946cc31ee00 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2eb17fa700 1 -- 172.21.15.142:0/3672582640 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc09d4e0 con 0x55c62e2d80a0 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2eb17fa700 1 -- 172.21.15.142:0/3672582640 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ebc0a1720 con 0x55c62e2d80a0 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.635+0000 7f2eb17fa700 1 -- 172.21.15.142:0/3672582640 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0a1290 con 0x55c62e2d80a0 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3672582640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 msgr2=0x55c62e2d8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc096120 tx=0x7f2ebc0995b0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3672582640 shutdown_connections 2023-09-21T13:00:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2d8480 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3672582640 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3672582640 >> 172.21.15.142:0/3672582640 conn(0x55c62e204fa0 msgr2=0x55c62e2d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3672582640 shutdown_connections 2023-09-21T13:00:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.636+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3672582640 wait complete. 2023-09-21T13:00:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.637+0000 7f2ee5159b80 1 -- start start 2023-09-21T13:00:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.637+0000 7f2ee5159b80 1 Processor -- start 2023-09-21T13:00:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2e45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 0x55c62e2e1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e229e20 con 0x55c62e2dce50 2023-09-21T13:00:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e1c66e0 con 0x55c62e2d80a0 2023-09-21T13:00:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e1c6380 con 0x55c62e2d89c0 2023-09-21T13:00:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ee5159b80 10 client.0 _ll_register_callbacks cb 0x55c62e110a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2eca7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 0x55c62e2e1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 0x55c62e2e1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55902/0 (socket says 172.21.15.142:55902) 2023-09-21T13:00:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ecb7fe700 1 -- 172.21.15.142:0/3068823945 learned_addr learned my addr 172.21.15.142:0/3068823945 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.638+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2e45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 -- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 msgr2=0x55c62e2e45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2e45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 -- 172.21.15.142:0/3068823945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 msgr2=0x55c62e2e1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 0x55c62e2e1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 -- 172.21.15.142:0/3068823945 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc1a6470 con 0x55c62e2d89c0 2023-09-21T13:00:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0000c00 tx=0x7f2ec000b610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf85b4bf48270f80 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.639+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec001d070 con 0x55c62e2d89c0 2023-09-21T13:00:03.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c62e19ab50 con 0x55c62e2d89c0 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ec0004500 con 0x55c62e2d89c0 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec00046c0 con 0x55c62e2d89c0 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 10 client.26548 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c62e03dc00 con 0x55c62e2d89c0 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c62e19ab50 con 0x55c62e2d89c0 2023-09-21T13:00:03.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2ec0024850 con 0x55c62e2d89c0 2023-09-21T13:00:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 10 client.26548 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 10 client.26548 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 20 client.26548 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:03.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e2f2060 0x55c62e2f4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 4 client.26548 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.640+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c62e2a6fc0 con 0x55c62e2f2060 2023-09-21T13:00:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.641+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e2f2060 0x55c62e2f4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.641+0000 7f2eaeff5700 10 client.26548 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:03.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.641+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e2f2060 0x55c62e2f4480 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d3d8727eff2e935 server_cookie=241a391fdad049ef in_seq=0 out_seq=0 2023-09-21T13:00:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3068823945 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c62e2a6fc0 con 0x55c62e2f2060 2023-09-21T13:00:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2eaeff5700 10 client.26548 handle_command_reply: tid=0 2023-09-21T13:00:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 client.26548 shutdown 2023-09-21T13:00:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 msgr2=0x55c62e2e1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0000c00 tx=0x7f2ec000b610 comp rx=0 tx=0).stop 2023-09-21T13:00:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 shutdown_connections 2023-09-21T13:00:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e2f2060 0x55c62e2f4480 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2dce50 0x55c62e2e1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d80a0 0x55c62e2e45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2eaeff5700 0 client.26548 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3068823945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1850 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 >> 172.21.15.142:0/3068823945 conn(0x55c62e204fa0 msgr2=0x55c62e2d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 shutdown_connections 2023-09-21T13:00:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.642+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3068823945 wait complete. 2023-09-21T13:00:03.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.643+0000 7f2ee5159b80 20 client.26548 trim_cache size 0 max 16384 2023-09-21T13:00:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.659+0000 7f2ee5159b80 1 Processor -- start 2023-09-21T13:00:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.659+0000 7f2ee5159b80 1 -- start start 2023-09-21T13:00:03.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 0x55c62e2e9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 0x55c62e2daf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e0aa8c0 con 0x55c62e2d89c0 2023-09-21T13:00:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e2d49b0 con 0x55c62e2dce50 2023-09-21T13:00:03.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e2e2e30 con 0x55c62e2d80a0 2023-09-21T13:00:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 0x55c62e2daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 0x55c62e2e9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 0x55c62e2daf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45174/0 (socket says 172.21.15.142:45174) 2023-09-21T13:00:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecb7fe700 1 -- 172.21.15.142:0/832102878 learned_addr learned my addr 172.21.15.142:0/832102878 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:03.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 -- 172.21.15.142:0/832102878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 msgr2=0x55c62e2daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 0x55c62e2daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 -- 172.21.15.142:0/832102878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 msgr2=0x55c62e2e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.660+0000 7f2ecaffd700 1 -- 172.21.15.142:0/832102878 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c62e2f90b0 con 0x55c62e2d80a0 2023-09-21T13:00:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.661+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 0x55c62e2e9030 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc098fa0 tx=0x7f2ebc010b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c664f4a0826033e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.661+0000 7f2eb1ffb700 1 -- 172.21.15.142:0/832102878 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc09d120 con 0x55c62e2d80a0 2023-09-21T13:00:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.661+0000 7f2eb1ffb700 1 -- 172.21.15.142:0/832102878 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ebc09d280 con 0x55c62e2d80a0 2023-09-21T13:00:03.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.661+0000 7f2eb1ffb700 1 -- 172.21.15.142:0/832102878 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0a14f0 con 0x55c62e2d80a0 2023-09-21T13:00:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- 172.21.15.142:0/832102878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 msgr2=0x55c62e2e9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 0x55c62e2e9030 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc098fa0 tx=0x7f2ebc010b20 comp rx=0 tx=0).stop 2023-09-21T13:00:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- 172.21.15.142:0/832102878 shutdown_connections 2023-09-21T13:00:03.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2dce50 0x55c62e2daf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2d80a0 0x55c62e2e9030 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/832102878 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d89c0 0x55c62e2e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- 172.21.15.142:0/832102878 >> 172.21.15.142:0/832102878 conn(0x55c62e204fa0 msgr2=0x55c62e2ed790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- 172.21.15.142:0/832102878 shutdown_connections 2023-09-21T13:00:03.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- 172.21.15.142:0/832102878 wait complete. 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.662+0000 7f2ee5159b80 1 -- start start 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 Processor -- start 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d80a0 0x55c62e2e08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e2e1480 con 0x55c62e2d80a0 2023-09-21T13:00:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e2e15f0 con 0x55c62e2d89c0 2023-09-21T13:00:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62e2dd770 con 0x55c62e2dce50 2023-09-21T13:00:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2ee5159b80 10 client.0 _ll_register_callbacks cb 0x55c62e110a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.663+0000 7f2eca7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2eca7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45186/0 (socket says 172.21.15.142:45186) 2023-09-21T13:00:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2eca7fc700 1 -- 172.21.15.142:0/3644220680 learned_addr learned my addr 172.21.15.142:0/3644220680 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d80a0 0x55c62e2e08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 -- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 msgr2=0x55c62e2e0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 -- 172.21.15.142:0/3644220680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d80a0 msgr2=0x55c62e2e08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d80a0 0x55c62e2e08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 -- 172.21.15.142:0/3644220680 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c62e054d80 con 0x55c62e2dce50 2023-09-21T13:00:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2eca7fc700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:03.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2ecb7fe700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55c62e2cf070 tx=0x7f2ec4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ff5dc0decd5194 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2eaeff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.664+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4004bb0 con 0x55c62e2dce50 2023-09-21T13:00:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ebc0a1720 con 0x55c62e2dce50 2023-09-21T13:00:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f2ec4004d10 con 0x55c62e2dce50 2023-09-21T13:00:03.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ec4014a10 con 0x55c62e2dce50 2023-09-21T13:00:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 10 client.26554 fetch_fsmap learned FSMap version 25 2023-09-21T13:00:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55c62e07b1f0 con 0x55c62e2dce50 2023-09-21T13:00:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ebc0a1720 con 0x55c62e2dce50 2023-09-21T13:00:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 25) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2ec4024b90 con 0x55c62e2dce50 2023-09-21T13:00:03.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 10 client.26554 fetch_fsmap finished waiting for FSMap version 25 2023-09-21T13:00:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 10 client.26554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 20 client.26554 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e346b80 0x55c62e348fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 4 client.26554 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:00:03.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c62e222e00 con 0x55c62e346b80 2023-09-21T13:00:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.665+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e346b80 0x55c62e348fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.666+0000 7f2ecaffd700 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e346b80 0x55c62e348fa0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b885c5a04acf0c5c server_cookie=80b9a07c32ca276d in_seq=0 out_seq=0 2023-09-21T13:00:03.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.666+0000 7f2eaeff5700 10 client.26554 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:03.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 338412 10.43 MB/sec execute 44 sec latency 16.878 ms 2023-09-21T13:00:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.745+0000 7f2eaeff5700 1 -- 172.21.15.142:0/3644220680 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c62e222e00 con 0x55c62e346b80 2023-09-21T13:00:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.745+0000 7f2eaeff5700 10 client.26554 handle_command_reply: tid=0 2023-09-21T13:00:03.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.745+0000 7f2ee5159b80 1 client.26554 shutdown 2023-09-21T13:00:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 msgr2=0x55c62e2dd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd230 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x55c62e2cf070 tx=0x7f2ec4004ad0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 shutdown_connections 2023-09-21T13:00:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c62e346b80 0x55c62e348fa0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c62e2d80a0 0x55c62e2e08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c62e2dce50 0x55c62e2dd230 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 --2- 172.21.15.142:0/3644220680 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c62e2d89c0 0x55c62e2e0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 >> 172.21.15.142:0/3644220680 conn(0x55c62e204fa0 msgr2=0x55c62e2daf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.749+0000 7f2eaeff5700 0 client.26554 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:03.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.751+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 shutdown_connections 2023-09-21T13:00:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:00:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:00:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:00:03.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:00:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.751+0000 7f2ee5159b80 1 -- 172.21.15.142:0/3644220680 wait complete. 2023-09-21T13:00:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.752+0000 7f2ee5159b80 20 client.26554 trim_cache size 0 max 16384 2023-09-21T13:00:03.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.753+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 msgr2=0x7f2eb40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.753+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 0x7f2eb40a2c70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ec4009d20 tx=0x7f2ec4009040 comp rx=0 tx=0).stop 2023-09-21T13:00:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.753+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 msgr2=0x7f2ecc1990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.753+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9a0 tx=0x7f2ebc00ecb0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 shutdown_connections 2023-09-21T13:00:03.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2eb40a07b0 0x7f2eb40a2c70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2ecc19dc90 0x7f2ecc19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2ecc0687a0 0x7f2ecc1990e0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9a0 tx=0x7f2ebc00ecb0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 --2- 172.21.15.142:0/1005621970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2ecc10d650 0x7f2ecc199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:03.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.754+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 >> 172.21.15.142:0/1005621970 conn(0x7f2ecc076800 msgr2=0x7f2ecc0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.755+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 shutdown_connections 2023-09-21T13:00:03.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:03.755+0000 7f2ed17ff700 1 -- 172.21.15.142:0/1005621970 wait complete. 2023-09-21T13:00:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: pgmap v117: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T13:00:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:04.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.158 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:03 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: pgmap v117: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:04.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T13:00:04.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:04.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:04.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:04.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:04.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.170 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.170 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:03 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: pgmap v117: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T13:00:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:04.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:03 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:04.681 INFO:tasks.workunit.client.0.smithi142.stdout: 1 340742 10.50 MB/sec execute 45 sec latency 71.904 ms 2023-09-21T13:00:05.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 342049 10.39 MB/sec execute 46 sec latency 21.308 ms 2023-09-21T13:00:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:05 smithi156 ceph-mon[134078]: pgmap v118: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:06.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:05 smithi142 ceph-mon[97663]: pgmap v118: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:06.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:05 smithi160 ceph-mon[134450]: pgmap v118: 97 pgs: 97 active+clean; 90 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-21T13:00:06.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 344288 10.46 MB/sec execute 47 sec latency 82.907 ms 2023-09-21T13:00:07.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 345586 10.36 MB/sec execute 48 sec latency 14.562 ms 2023-09-21T13:00:08.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:07 smithi156 ceph-mon[134078]: pgmap v119: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 425 op/s 2023-09-21T13:00:08.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:07 smithi142 ceph-mon[97663]: pgmap v119: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 425 op/s 2023-09-21T13:00:08.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:07 smithi160 ceph-mon[134450]: pgmap v119: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 4.0 MiB/s wr, 425 op/s 2023-09-21T13:00:08.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 347921 10.42 MB/sec execute 49 sec latency 14.664 ms 2023-09-21T13:00:09.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 349418 10.33 MB/sec execute 50 sec latency 64.710 ms 2023-09-21T13:00:10.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:09 smithi156 ceph-mon[134078]: pgmap v120: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-09-21T13:00:10.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:09 smithi142 ceph-mon[97663]: pgmap v120: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-09-21T13:00:10.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:09 smithi160 ceph-mon[134450]: pgmap v120: 97 pgs: 97 active+clean; 87 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.8 MiB/s wr, 304 op/s 2023-09-21T13:00:10.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 351542 10.40 MB/sec execute 51 sec latency 49.367 ms 2023-09-21T13:00:11.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 353548 10.33 MB/sec execute 52 sec latency 30.353 ms 2023-09-21T13:00:12.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:11 smithi156 ceph-mon[134078]: pgmap v121: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-09-21T13:00:12.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:11 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:12.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:11 smithi142 ceph-mon[97663]: pgmap v121: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-09-21T13:00:12.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:11 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:12.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:11 smithi160 ceph-mon[134450]: pgmap v121: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-09-21T13:00:12.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:11 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:12.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 355279 10.37 MB/sec execute 53 sec latency 13.426 ms 2023-09-21T13:00:13.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:12 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:13.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:12 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:13.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:12 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:13.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:12 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:13.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:12 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:13.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:12 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:13.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 357629 10.41 MB/sec execute 54 sec latency 34.303 ms 2023-09-21T13:00:14.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:13 smithi156 ceph-mon[134078]: pgmap v122: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:14.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:13 smithi142 ceph-mon[97663]: pgmap v122: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:14.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:13 smithi160 ceph-mon[134450]: pgmap v122: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:14.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 358931 10.34 MB/sec execute 55 sec latency 53.738 ms 2023-09-21T13:00:15.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 361609 10.41 MB/sec execute 56 sec latency 27.025 ms 2023-09-21T13:00:16.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:15 smithi156 ceph-mon[134078]: pgmap v123: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:16.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:15 smithi142 ceph-mon[97663]: pgmap v123: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:16.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:15 smithi160 ceph-mon[134450]: pgmap v123: 97 pgs: 97 active+clean; 93 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 291 op/s 2023-09-21T13:00:16.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 362384 10.31 MB/sec execute 57 sec latency 122.634 ms 2023-09-21T13:00:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 -- 172.21.15.142:0/3384914508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4106130 msgr2=0x7f76f410dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/3384914508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4106130 0x7f76f410dcb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b0a0 tx=0x7f76ec00b3b0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 -- 172.21.15.142:0/3384914508 shutdown_connections 2023-09-21T13:00:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/3384914508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4106130 0x7f76f410dcb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/3384914508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4101010 0x7f76f41013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/3384914508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41019c0 0x7f76f4105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 -- 172.21.15.142:0/3384914508 >> 172.21.15.142:0/3384914508 conn(0x7f76f40fc8b0 msgr2=0x7f76f40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 -- 172.21.15.142:0/3384914508 shutdown_connections 2023-09-21T13:00:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.926+0000 7f76fa9ff700 1 -- 172.21.15.142:0/3384914508 wait complete. 2023-09-21T13:00:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.927+0000 7f76fa9ff700 1 Processor -- start 2023-09-21T13:00:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.927+0000 7f76fa9ff700 1 -- start start 2023-09-21T13:00:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4101010 0x7f76f40732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 0x7f76f41a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41a5b20 con 0x7f76f41a31f0 2023-09-21T13:00:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41a5c60 con 0x7f76f4106130 2023-09-21T13:00:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76fa9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f41a5dd0 con 0x7f76f4101010 2023-09-21T13:00:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4101010 0x7f76f40732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48082/0 (socket says 172.21.15.142:48082) 2023-09-21T13:00:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 -- 172.21.15.142:0/1807124390 learned_addr learned my addr 172.21.15.142:0/1807124390 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 0x7f76f41a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 -- 172.21.15.142:0/1807124390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4101010 msgr2=0x7f76f40732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4101010 0x7f76f40732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 -- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 msgr2=0x7f76f41a55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 0x7f76f41a55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f37fe700 1 -- 172.21.15.142:0/1807124390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e8009520 con 0x7f76f4106130 2023-09-21T13:00:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.928+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 0x7f76f41a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76f37fe700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f76e800ea30 tx=0x7f76e800ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76f17fa700 1 -- 172.21.15.142:0/1807124390 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8009820 con 0x7f76f4106130 2023-09-21T13:00:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76f17fa700 1 -- 172.21.15.142:0/1807124390 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76e80044e0 con 0x7f76f4106130 2023-09-21T13:00:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76f17fa700 1 -- 172.21.15.142:0/1807124390 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8003dc0 con 0x7f76f4106130 2023-09-21T13:00:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec009d00 con 0x7f76f4106130 2023-09-21T13:00:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.929+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f41a63e0 con 0x7f76f4106130 2023-09-21T13:00:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.933+0000 7f76f17fa700 1 -- 172.21.15.142:0/1807124390 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f76e8003f80 con 0x7f76f4106130 2023-09-21T13:00:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.934+0000 7f76f17fa700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 0x7f76dc0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f76f17fa700 1 -- 172.21.15.142:0/1807124390 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76e8014070 con 0x7f76f4106130 2023-09-21T13:00:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 Processor -- start 2023-09-21T13:00:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f76f3fff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 0x7f76dc0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 -- start start 2023-09-21T13:00:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb761480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7619c0 0x561fdb765910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb6d5c40 con 0x561fdb7619c0 2023-09-21T13:00:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb6b9c10 con 0x561fdb765e50 2023-09-21T13:00:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.935+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb6b7530 con 0x561fdb7610a0 2023-09-21T13:00:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48090/0 (socket says 172.21.15.142:48090) 2023-09-21T13:00:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 -- 172.21.15.142:0/3351512427 learned_addr learned my addr 172.21.15.142:0/3351512427 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f37fe700 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7619c0 0x561fdb765910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f3fff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 0x7f76dc0a2c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c60 tx=0x7f76e4009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f3fff700 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb761480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 -- 172.21.15.142:0/3351512427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 msgr2=0x561fdb761480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb761480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 -- 172.21.15.142:0/3351512427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7619c0 msgr2=0x561fdb765910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7619c0 0x561fdb765910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 -- 172.21.15.142:0/3351512427 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fdb4ddd80 con 0x561fdb765e50 2023-09-21T13:00:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.936+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76ec015000 tx=0x7f76ec0092e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=715b4268f75ea9df server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.937+0000 7f76da7fc700 1 -- 172.21.15.142:0/3351512427 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e050 con 0x561fdb765e50 2023-09-21T13:00:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.937+0000 7f76da7fc700 1 -- 172.21.15.142:0/3351512427 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76ec007dc0 con 0x561fdb765e50 2023-09-21T13:00:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.937+0000 7f76da7fc700 1 -- 172.21.15.142:0/3351512427 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec0054a0 con 0x561fdb765e50 2023-09-21T13:00:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 -- 172.21.15.142:0/3351512427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 msgr2=0x561fdb7662b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f76ec015000 tx=0x7f76ec0092e0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 -- 172.21.15.142:0/3351512427 shutdown_connections 2023-09-21T13:00:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb765e50 0x561fdb7662b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb761480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/3351512427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7619c0 0x561fdb765910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 -- 172.21.15.142:0/3351512427 >> 172.21.15.142:0/3351512427 conn(0x561fdb68dfa0 msgr2=0x561fdb75c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 -- 172.21.15.142:0/3351512427 shutdown_connections 2023-09-21T13:00:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.938+0000 7f770e3a8b80 1 -- 172.21.15.142:0/3351512427 wait complete. 2023-09-21T13:00:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.939+0000 7f770e3a8b80 1 -- start start 2023-09-21T13:00:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.939+0000 7f770e3a8b80 1 Processor -- start 2023-09-21T13:00:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb76d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb6b2e20 con 0x561fdb7610a0 2023-09-21T13:00:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb64f6e0 con 0x561fdb7619c0 2023-09-21T13:00:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb64f380 con 0x561fdb765e50 2023-09-21T13:00:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f770e3a8b80 10 client.0 _ll_register_callbacks cb 0x561fdb599a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb76d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34656/0 (socket says 172.21.15.142:34656) 2023-09-21T13:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 -- 172.21.15.142:0/4245954874 learned_addr learned my addr 172.21.15.142:0/4245954874 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f37fe700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 -- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 msgr2=0x561fdb76a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 -- 172.21.15.142:0/4245954874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 msgr2=0x561fdb76d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb76d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f8f9c700 1 -- 172.21.15.142:0/4245954874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f410e520 con 0x561fdb765e50 2023-09-21T13:00:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.940+0000 7f76f3fff700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb76d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b3f0 tx=0x7f76ec0076b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f327787f7c2df9e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f76d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec029070 con 0x561fdb765e50 2023-09-21T13:00:16.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fdb623b50 con 0x561fdb765e50 2023-09-21T13:00:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76ec007bc0 con 0x561fdb765e50 2023-09-21T13:00:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec0078a0 con 0x561fdb765e50 2023-09-21T13:00:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f770e3a8b80 10 client.26566 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.941+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561fdb4c6c00 con 0x561fdb765e50 2023-09-21T13:00:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561fdb623b50 con 0x561fdb765e50 2023-09-21T13:00:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76ec02c030 con 0x561fdb765e50 2023-09-21T13:00:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 10 client.26566 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 10 client.26566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 20 client.26566 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb783220 0x561fdb785610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 4 client.26566 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fdb72ffc0 con 0x561fdb783220 2023-09-21T13:00:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.942+0000 7f76f3fff700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb783220 0x561fdb785610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.943+0000 7f76d37fe700 10 client.26566 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.943+0000 7f76f3fff700 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb783220 0x561fdb785610 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789dca871c4163fd server_cookie=c19725a4cdf7661d in_seq=0 out_seq=0 2023-09-21T13:00:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.943+0000 7f76d37fe700 1 -- 172.21.15.142:0/4245954874 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561fdb72ffc0 con 0x561fdb783220 2023-09-21T13:00:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.943+0000 7f76d37fe700 10 client.26566 handle_command_reply: tid=0 2023-09-21T13:00:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.943+0000 7f770e3a8b80 1 client.26566 shutdown 2023-09-21T13:00:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 msgr2=0x561fdb76af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00b3f0 tx=0x7f76ec0076b0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 shutdown_connections 2023-09-21T13:00:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb783220 0x561fdb785610 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb76d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb76af50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/4245954874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 >> 172.21.15.142:0/4245954874 conn(0x561fdb68dfa0 msgr2=0x561fdb75b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f76d37fe700 0 client.26566 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 shutdown_connections 2023-09-21T13:00:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 1 -- 172.21.15.142:0/4245954874 wait complete. 2023-09-21T13:00:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.944+0000 7f770e3a8b80 20 client.26566 trim_cache size 0 max 16384 2023-09-21T13:00:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 Processor -- start 2023-09-21T13:00:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 -- start start 2023-09-21T13:00:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb765e50 0x561fdb76add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb5338c0 con 0x561fdb765e50 2023-09-21T13:00:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb75d750 con 0x561fdb7619c0 2023-09-21T13:00:16.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.963+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb76b310 con 0x561fdb7610a0 2023-09-21T13:00:16.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34672/0 (socket says 172.21.15.142:34672) 2023-09-21T13:00:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 -- 172.21.15.142:0/2850839827 learned_addr learned my addr 172.21.15.142:0/2850839827 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb765e50 0x561fdb76add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f37fe700 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 -- 172.21.15.142:0/2850839827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 msgr2=0x561fdb76a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 -- 172.21.15.142:0/2850839827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb765e50 msgr2=0x561fdb76add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb765e50 0x561fdb76add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.964+0000 7f76f3fff700 1 -- 172.21.15.142:0/2850839827 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fdb77fc60 con 0x561fdb7610a0 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.965+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009220 tx=0x7f76e4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d614c4588296571 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.965+0000 7f76daffd700 1 -- 172.21.15.142:0/2850839827 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4022030 con 0x561fdb7610a0 2023-09-21T13:00:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.965+0000 7f76daffd700 1 -- 172.21.15.142:0/2850839827 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76e4023040 con 0x561fdb7610a0 2023-09-21T13:00:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.965+0000 7f76daffd700 1 -- 172.21.15.142:0/2850839827 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e4004830 con 0x561fdb7610a0 2023-09-21T13:00:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2850839827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 msgr2=0x561fdb76a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:16.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009220 tx=0x7f76e4014000 comp rx=0 tx=0).stop 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2850839827 shutdown_connections 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb765e50 0x561fdb76add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb7610a0 0x561fdb76a1c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2850839827 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb76a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2850839827 >> 172.21.15.142:0/2850839827 conn(0x561fdb68dfa0 msgr2=0x561fdb768240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:16.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2850839827 shutdown_connections 2023-09-21T13:00:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2850839827 wait complete. 2023-09-21T13:00:16.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.966+0000 7f770e3a8b80 1 -- start start 2023-09-21T13:00:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.967+0000 7f770e3a8b80 1 Processor -- start 2023-09-21T13:00:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.967+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb776810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.967+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f770e3a8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb777290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb7d5f70 con 0x561fdb7610a0 2023-09-21T13:00:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb7d60b0 con 0x561fdb7619c0 2023-09-21T13:00:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f770e3a8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fdb7d6270 con 0x561fdb765e50 2023-09-21T13:00:16.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f770e3a8b80 10 client.0 _ll_register_callbacks cb 0x561fdb599a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb777290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48132/0 (socket says 172.21.15.142:48132) 2023-09-21T13:00:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f37fe700 1 -- 172.21.15.142:0/2871346091 learned_addr learned my addr 172.21.15.142:0/2871346091 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb776810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 -- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 msgr2=0x561fdb776d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 -- 172.21.15.142:0/2871346091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 msgr2=0x561fdb776810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb776810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 -- 172.21.15.142:0/2871346091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e4017070 con 0x561fdb765e50 2023-09-21T13:00:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f37fe700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb776810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76f8f9c700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb777290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a20 tx=0x7f76ec000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a92861e98fc984b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.968+0000 7f76d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:16.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec00e070 con 0x561fdb765e50 2023-09-21T13:00:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76ec007dc0 con 0x561fdb765e50 2023-09-21T13:00:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76ec007bc0 con 0x561fdb765e50 2023-09-21T13:00:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ec029070 con 0x561fdb765e50 2023-09-21T13:00:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 10 client.26572 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x561fdb5041f0 con 0x561fdb765e50 2023-09-21T13:00:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76ec007dc0 con 0x561fdb765e50 2023-09-21T13:00:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76ec035070 con 0x561fdb765e50 2023-09-21T13:00:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 10 client.26572 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 10 client.26572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 20 client.26572 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb7d7500 0x561fdb7d98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 4 client.26572 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:00:16.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.969+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561fdb6abe00 con 0x561fdb7d7500 2023-09-21T13:00:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.970+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb7d7500 0x561fdb7d98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.970+0000 7f76f3fff700 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb7d7500 0x561fdb7d98f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cceeeca2802af12c server_cookie=f4de76699eea044e in_seq=0 out_seq=0 2023-09-21T13:00:16.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:16.970+0000 7f76d37fe700 10 client.26572 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:17.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f76d37fe700 1 -- 172.21.15.142:0/2871346091 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561fdb6abe00 con 0x561fdb7d7500 2023-09-21T13:00:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f76d37fe700 10 client.26572 handle_command_reply: tid=0 2023-09-21T13:00:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 client.26572 shutdown 2023-09-21T13:00:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 msgr2=0x561fdb777290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:17.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb777290 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009a20 tx=0x7f76ec000f40 comp rx=0 tx=0).stop 2023-09-21T13:00:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 shutdown_connections 2023-09-21T13:00:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x561fdb7d7500 0x561fdb7d98f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x561fdb7610a0 0x561fdb776810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x561fdb765e50 0x561fdb777290 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f76d37fe700 0 client.26572 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 --2- 172.21.15.142:0/2871346091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x561fdb7619c0 0x561fdb776d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 >> 172.21.15.142:0/2871346091 conn(0x561fdb68dfa0 msgr2=0x561fdb768240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 shutdown_connections 2023-09-21T13:00:17.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.033+0000 7f770e3a8b80 1 -- 172.21.15.142:0/2871346091 wait complete. 2023-09-21T13:00:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f770e3a8b80 20 client.26572 trim_cache size 0 max 16384 2023-09-21T13:00:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:00:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:00:17.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:00:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:00:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 msgr2=0x7f76dc0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:17.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 0x7f76dc0a2c70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f76e4009c60 tx=0x7f76e4009260 comp rx=0 tx=0).stop 2023-09-21T13:00:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 msgr2=0x7f76f4073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f76e800ea30 tx=0x7f76e800ed40 comp rx=0 tx=0).stop 2023-09-21T13:00:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 shutdown_connections 2023-09-21T13:00:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76dc0a07b0 0x7f76dc0a2c70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76f41a31f0 0x7f76f41a55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76f4101010 0x7f76f40732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 --2- 172.21.15.142:0/1807124390 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76f4106130 0x7f76f4073800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.034+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 >> 172.21.15.142:0/1807124390 conn(0x7f76f40fc8b0 msgr2=0x7f76f40fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.035+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 shutdown_connections 2023-09-21T13:00:17.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:17.035+0000 7f76fa9ff700 1 -- 172.21.15.142:0/1807124390 wait complete. 2023-09-21T13:00:17.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 364773 10.35 MB/sec execute 58 sec latency 48.617 ms 2023-09-21T13:00:18.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:17 smithi156 ceph-mon[134078]: pgmap v124: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 397 op/s 2023-09-21T13:00:18.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:17 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:18.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:17 smithi142 ceph-mon[97663]: pgmap v124: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 397 op/s 2023-09-21T13:00:18.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:17 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:18.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:17 smithi160 ceph-mon[134450]: pgmap v124: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 397 op/s 2023-09-21T13:00:18.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:17 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:00:18.682 INFO:tasks.workunit.client.0.smithi142.stdout: 1 366319 10.30 MB/sec execute 59 sec latency 11.780 ms 2023-09-21T13:00:19.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 368916 10.40 MB/sec execute 60 sec latency 24.965 ms 2023-09-21T13:00:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:19 smithi156 ceph-mon[134078]: pgmap v125: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 214 op/s 2023-09-21T13:00:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:19 smithi142 ceph-mon[97663]: pgmap v125: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 214 op/s 2023-09-21T13:00:20.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:19 smithi160 ceph-mon[134450]: pgmap v125: 97 pgs: 97 active+clean; 98 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 214 op/s 2023-09-21T13:00:20.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 370309 10.34 MB/sec execute 61 sec latency 18.998 ms 2023-09-21T13:00:21.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 372799 10.40 MB/sec execute 62 sec latency 13.723 ms 2023-09-21T13:00:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:21 smithi156 ceph-mon[134078]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 366 op/s 2023-09-21T13:00:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:21 smithi142 ceph-mon[97663]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 366 op/s 2023-09-21T13:00:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:21 smithi160 ceph-mon[134450]: pgmap v126: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 366 op/s 2023-09-21T13:00:22.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 374880 10.35 MB/sec execute 63 sec latency 12.122 ms 2023-09-21T13:00:23.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 376668 10.38 MB/sec execute 64 sec latency 12.211 ms 2023-09-21T13:00:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:23 smithi156 ceph-mon[134078]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:24.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:23 smithi142 ceph-mon[97663]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:24.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:23 smithi160 ceph-mon[134450]: pgmap v127: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:24.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 378986 10.41 MB/sec execute 65 sec latency 32.411 ms 2023-09-21T13:00:25.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 380542 10.36 MB/sec execute 66 sec latency 15.882 ms 2023-09-21T13:00:26.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:25 smithi156 ceph-mon[134078]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:25 smithi142 ceph-mon[97663]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:26.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:25 smithi160 ceph-mon[134450]: pgmap v128: 97 pgs: 97 active+clean; 97 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 257 op/s 2023-09-21T13:00:26.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 383168 10.46 MB/sec execute 67 sec latency 12.139 ms 2023-09-21T13:00:27.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 384336 10.36 MB/sec execute 68 sec latency 15.348 ms 2023-09-21T13:00:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:27 smithi156 ceph-mon[134078]: pgmap v129: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 373 op/s 2023-09-21T13:00:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:27 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:00:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:27 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:00:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:27 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:00:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:27 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:00:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:27 smithi142 ceph-mon[97663]: pgmap v129: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 373 op/s 2023-09-21T13:00:27.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:27 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:00:27.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:27 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:00:27.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:27 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:00:27.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:27 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:00:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:27 smithi160 ceph-mon[134450]: pgmap v129: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 373 op/s 2023-09-21T13:00:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:27 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:00:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:27 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:00:27.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:27 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:00:27.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:27 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:00:28.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 386745 10.44 MB/sec execute 69 sec latency 85.974 ms 2023-09-21T13:00:29.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 387860 10.34 MB/sec execute 70 sec latency 43.093 ms 2023-09-21T13:00:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:29 smithi156 ceph-mon[134078]: pgmap v130: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2023-09-21T13:00:29.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:29 smithi142 ceph-mon[97663]: pgmap v130: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2023-09-21T13:00:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:29 smithi160 ceph-mon[134450]: pgmap v130: 97 pgs: 97 active+clean; 105 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 267 op/s 2023-09-21T13:00:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 -- 172.21.15.142:0/2527946808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 msgr2=0x7f03b41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/2527946808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41013b0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f03a40098f0 tx=0x7f03a4009c00 comp rx=0 tx=0).stop 2023-09-21T13:00:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 -- 172.21.15.142:0/2527946808 shutdown_connections 2023-09-21T13:00:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/2527946808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41013b0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/2527946808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/2527946808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b4101980 0x7f03b41059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 -- 172.21.15.142:0/2527946808 >> 172.21.15.142:0/2527946808 conn(0x7f03b40fc830 msgr2=0x7f03b40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.195+0000 7f03ba9ff700 1 -- 172.21.15.142:0/2527946808 shutdown_connections 2023-09-21T13:00:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.196+0000 7f03ba9ff700 1 -- 172.21.15.142:0/2527946808 wait complete. 2023-09-21T13:00:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.197+0000 7f03ba9ff700 1 Processor -- start 2023-09-21T13:00:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.197+0000 7f03ba9ff700 1 -- start start 2023-09-21T13:00:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.197+0000 7f03ba9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.197+0000 7f03ba9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03ba9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b419dc70 0x7f03b419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03ba9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b419e6f0 con 0x7f03b4100fd0 2023-09-21T13:00:30.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03ba9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b419e860 con 0x7f03b41060f0 2023-09-21T13:00:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03ba9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b419ea20 con 0x7f03b419dc70 2023-09-21T13:00:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35798/0 (socket says 172.21.15.142:35798) 2023-09-21T13:00:30.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 -- 172.21.15.142:0/35789894 learned_addr learned my addr 172.21.15.142:0/35789894 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b419dc70 0x7f03b419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 -- 172.21.15.142:0/35789894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b419dc70 msgr2=0x7f03b419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b419dc70 0x7f03b419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 -- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 msgr2=0x7f03b41990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.198+0000 7f03b37fe700 1 -- 172.21.15.142:0/35789894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac009d00 con 0x7f03b41060f0 2023-09-21T13:00:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03b37fe700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e970 tx=0x7f03a800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03b17fa700 1 -- 172.21.15.142:0/35789894 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8009790 con 0x7f03b41060f0 2023-09-21T13:00:30.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a4009520 con 0x7f03b41060f0 2023-09-21T13:00:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03b17fa700 1 -- 172.21.15.142:0/35789894 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03a800c7e0 con 0x7f03b41060f0 2023-09-21T13:00:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03b17fa700 1 -- 172.21.15.142:0/35789894 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a80054e0 con 0x7f03b41060f0 2023-09-21T13:00:30.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.199+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b41a6270 con 0x7f03b41060f0 2023-09-21T13:00:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.202+0000 7f03b17fa700 1 -- 172.21.15.142:0/35789894 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f03a800c950 con 0x7f03b41060f0 2023-09-21T13:00:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03ce3beb80 1 Processor -- start 2023-09-21T13:00:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03b17fa700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 0x7f039c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03ce3beb80 1 -- start start 2023-09-21T13:00:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03b17fa700 1 -- 172.21.15.142:0/35789894 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f03a8014070 con 0x7f03b41060f0 2023-09-21T13:00:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 0x7f039c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.204+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 0x5635e8a9d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a9de50 0x5635e8a9e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8a0dc40 con 0x5635e8a999c0 2023-09-21T13:00:30.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e89f1c10 con 0x5635e8a990a0 2023-09-21T13:00:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e89ef530 con 0x5635e8a9de50 2023-09-21T13:00:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 0x5635e8a9d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35800/0 (socket says 172.21.15.142:35800) 2023-09-21T13:00:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 -- 172.21.15.142:0/3691198761 learned_addr learned my addr 172.21.15.142:0/3691198761 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 0x5635e8a9d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33184/0 (socket says 172.21.15.142:33184) 2023-09-21T13:00:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a9de50 0x5635e8a9e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 -- 172.21.15.142:0/3691198761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a9de50 msgr2=0x5635e8a9e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a9de50 0x5635e8a9e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 -- 172.21.15.142:0/3691198761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 msgr2=0x5635e8a9d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 0x5635e8a9d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 0x7f039c0a2c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009fd0 tx=0x7f03ac00b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 -- 172.21.15.142:0/3691198761 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e8815d80 con 0x5635e8a990a0 2023-09-21T13:00:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.205+0000 7f03b3fff700 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f03a40098f0 tx=0x7f03a4005b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2d60bb5d9e09b4e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.206+0000 7f039a7fc700 1 -- 172.21.15.142:0/3691198761 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400fe70 con 0x5635e8a990a0 2023-09-21T13:00:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.206+0000 7f039a7fc700 1 -- 172.21.15.142:0/3691198761 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03a401d040 con 0x5635e8a990a0 2023-09-21T13:00:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.206+0000 7f039a7fc700 1 -- 172.21.15.142:0/3691198761 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a4005040 con 0x5635e8a990a0 2023-09-21T13:00:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.206+0000 7f03ce3beb80 1 -- 172.21.15.142:0/3691198761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 msgr2=0x5635e8a99480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.206+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f03a40098f0 tx=0x7f03a4005b80 comp rx=0 tx=0).stop 2023-09-21T13:00:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 -- 172.21.15.142:0/3691198761 shutdown_connections 2023-09-21T13:00:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a9de50 0x5635e8a9e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8a99480 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/3691198761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a999c0 0x5635e8a9d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 -- 172.21.15.142:0/3691198761 >> 172.21.15.142:0/3691198761 conn(0x5635e89c5fa0 msgr2=0x5635e8a940c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 -- 172.21.15.142:0/3691198761 shutdown_connections 2023-09-21T13:00:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 -- 172.21.15.142:0/3691198761 wait complete. 2023-09-21T13:00:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.207+0000 7f03ce3beb80 1 -- start start 2023-09-21T13:00:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.208+0000 7f03ce3beb80 1 Processor -- start 2023-09-21T13:00:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.208+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.208+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aa2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.208+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e89eae20 con 0x5635e8a9de50 2023-09-21T13:00:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e89876e0 con 0x5635e8a990a0 2023-09-21T13:00:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8987380 con 0x5635e8a999c0 2023-09-21T13:00:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03ce3beb80 10 client.0 _ll_register_callbacks cb 0x5635e88d1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35816/0 (socket says 172.21.15.142:35816) 2023-09-21T13:00:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 -- 172.21.15.142:0/51643950 learned_addr learned my addr 172.21.15.142:0/51643950 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b37fe700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aa2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 -- 172.21.15.142:0/51643950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 msgr2=0x5635e8aa2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aa2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 -- 172.21.15.142:0/51643950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 msgr2=0x5635e8aa2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 -- 172.21.15.142:0/51643950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b410e4e0 con 0x5635e8a990a0 2023-09-21T13:00:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03b3fff700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f03a40098c0 tx=0x7f03a400ff20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fe223922f9304ad server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.209+0000 7f03937fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400f660 con 0x5635e8a990a0 2023-09-21T13:00:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635e895bb50 con 0x5635e8a990a0 2023-09-21T13:00:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f03a400f7c0 con 0x5635e8a990a0 2023-09-21T13:00:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a4005050 con 0x5635e8a990a0 2023-09-21T13:00:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03ce3beb80 10 client.26627 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5635e87fec00 con 0x5635e8a990a0 2023-09-21T13:00:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5635e895bb50 con 0x5635e8a990a0 2023-09-21T13:00:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.210+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f03a4028030 con 0x5635e8a990a0 2023-09-21T13:00:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 10 client.26627 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 10 client.26627 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:30.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 20 client.26627 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:30.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8ab29c0 0x5635e8ab4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 4 client.26627 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:30.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635e8a67fc0 con 0x5635e8ab29c0 2023-09-21T13:00:30.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03b37fe700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8ab29c0 0x5635e8ab4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03937fe700 10 client.26627 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:30.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.211+0000 7f03b37fe700 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8ab29c0 0x5635e8ab4db0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e703813392a428 server_cookie=c955c87b98668535 in_seq=0 out_seq=0 2023-09-21T13:00:30.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03937fe700 1 -- 172.21.15.142:0/51643950 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5635e8a67fc0 con 0x5635e8ab29c0 2023-09-21T13:00:30.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03937fe700 10 client.26627 handle_command_reply: tid=0 2023-09-21T13:00:30.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 client.26627 shutdown 2023-09-21T13:00:30.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 msgr2=0x5635e8aa5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f03a40098c0 tx=0x7f03a400ff20 comp rx=0 tx=0).stop 2023-09-21T13:00:30.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 shutdown_connections 2023-09-21T13:00:30.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8ab29c0 0x5635e8ab4db0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa5610 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03937fe700 0 client.26627 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/51643950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aa2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.212+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 >> 172.21.15.142:0/51643950 conn(0x5635e89c5fa0 msgr2=0x5635e8a93cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.213+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 shutdown_connections 2023-09-21T13:00:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.213+0000 7f03ce3beb80 1 -- 172.21.15.142:0/51643950 wait complete. 2023-09-21T13:00:30.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.213+0000 7f03ce3beb80 20 client.26627 trim_cache size 0 max 16384 2023-09-21T13:00:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.230+0000 7f03ce3beb80 1 Processor -- start 2023-09-21T13:00:30.239 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 -- start start 2023-09-21T13:00:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8a9cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e886b8c0 con 0x5635e8a990a0 2023-09-21T13:00:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8aa3450 con 0x5635e8a9de50 2023-09-21T13:00:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8a8bba0 con 0x5635e8a999c0 2023-09-21T13:00:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35824/0 (socket says 172.21.15.142:35824) 2023-09-21T13:00:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b8f9c700 1 -- 172.21.15.142:0/1384220966 learned_addr learned my addr 172.21.15.142:0/1384220966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33204/0 (socket says 172.21.15.142:33204) 2023-09-21T13:00:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b37fe700 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8a9cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b8f9c700 1 -- 172.21.15.142:0/1384220966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 msgr2=0x5635e8a9cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.231+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8a9cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f03b8f9c700 1 -- 172.21.15.142:0/1384220966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 msgr2=0x5635e8aa5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f03b8f9c700 1 -- 172.21.15.142:0/1384220966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635e883c1f0 con 0x5635e8a9de50 2023-09-21T13:00:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f03b3fff700 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:30.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0198b0 tx=0x7f03ac004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3791d964326800da server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f039affd700 1 -- 172.21.15.142:0/1384220966 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac028070 con 0x5635e8a9de50 2023-09-21T13:00:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f039affd700 1 -- 172.21.15.142:0/1384220966 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03ac00f040 con 0x5635e8a9de50 2023-09-21T13:00:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.232+0000 7f039affd700 1 -- 172.21.15.142:0/1384220966 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03ac00e020 con 0x5635e8a9de50 2023-09-21T13:00:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1384220966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 msgr2=0x5635e8a9d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f03ac0198b0 tx=0x7f03ac004b40 comp rx=0 tx=0).stop 2023-09-21T13:00:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1384220966 shutdown_connections 2023-09-21T13:00:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a990a0 0x5635e8aa5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a9de50 0x5635e8a9d490 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1384220966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8a9cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1384220966 >> 172.21.15.142:0/1384220966 conn(0x5635e89c5fa0 msgr2=0x5635e8a9e230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1384220966 shutdown_connections 2023-09-21T13:00:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1384220966 wait complete. 2023-09-21T13:00:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.233+0000 7f03ce3beb80 1 -- start start 2023-09-21T13:00:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 Processor -- start 2023-09-21T13:00:30.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aaa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8aa8790 con 0x5635e8a9de50 2023-09-21T13:00:30.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8aa8900 con 0x5635e8a990a0 2023-09-21T13:00:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635e8aa8ac0 con 0x5635e8a999c0 2023-09-21T13:00:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03ce3beb80 10 client.0 _ll_register_callbacks cb 0x5635e88d1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03b37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aaa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35838/0 (socket says 172.21.15.142:35838) 2023-09-21T13:00:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.234+0000 7f03b3fff700 1 -- 172.21.15.142:0/1437676531 learned_addr learned my addr 172.21.15.142:0/1437676531 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b8f9c700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 -- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 msgr2=0x5635e8aa9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 -- 172.21.15.142:0/1437676531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 msgr2=0x5635e8aa8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 -- 172.21.15.142:0/1437676531 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635e87fec00 con 0x5635e8a999c0 2023-09-21T13:00:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b3fff700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03b37fe700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aaa0f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c9920 tx=0x7f03a800e8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45a4716f47cab8c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:30.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03937fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a8099d80 con 0x5635e8a999c0 2023-09-21T13:00:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f03a8099680 con 0x5635e8a999c0 2023-09-21T13:00:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.235+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f03a401d040 con 0x5635e8a999c0 2023-09-21T13:00:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a809d4b0 con 0x5635e8a999c0 2023-09-21T13:00:30.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 10 client.26590 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f03ac019560 con 0x5635e8a999c0 2023-09-21T13:00:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03a401d040 con 0x5635e8a999c0 2023-09-21T13:00:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f03a809d150 con 0x5635e8a999c0 2023-09-21T13:00:30.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 10 client.26590 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 10 client.26590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 20 client.26590 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8b07a00 0x5635e8b09e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 4 client.26590 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:00:30.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5635e89e3e00 con 0x5635e8b07a00 2023-09-21T13:00:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.236+0000 7f03b3fff700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8b07a00 0x5635e8b09e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.237+0000 7f03937fe700 10 client.26590 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:30.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.237+0000 7f03b3fff700 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8b07a00 0x5635e8b09e20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56118c365bd3ca23 server_cookie=3dbff2c012b56fc9 in_seq=0 out_seq=0 2023-09-21T13:00:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.309+0000 7f03937fe700 1 -- 172.21.15.142:0/1437676531 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5635e89e3e00 con 0x5635e8b07a00 2023-09-21T13:00:30.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.309+0000 7f03937fe700 10 client.26590 handle_command_reply: tid=0 2023-09-21T13:00:30.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.309+0000 7f03ce3beb80 1 client.26590 shutdown 2023-09-21T13:00:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 msgr2=0x5635e8aaa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aaa0f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c9920 tx=0x7f03a800e8f0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 shutdown_connections 2023-09-21T13:00:30.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5635e8b07a00 0x5635e8b09e20 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5635e8a9de50 0x5635e8aa8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5635e8a990a0 0x5635e8aa9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 --2- 172.21.15.142:0/1437676531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5635e8a999c0 0x5635e8aaa0f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 >> 172.21.15.142:0/1437676531 conn(0x5635e89c5fa0 msgr2=0x5635e8a9cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.312+0000 7f03937fe700 0 client.26590 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.313+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 shutdown_connections 2023-09-21T13:00:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.313+0000 7f03ce3beb80 1 -- 172.21.15.142:0/1437676531 wait complete. 2023-09-21T13:00:30.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.313+0000 7f03ce3beb80 20 client.26590 trim_cache size 0 max 16384 2023-09-21T13:00:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:00:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:00:30.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:00:30.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:00:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 msgr2=0x7f039c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 0x7f039c0a2c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f03ac009fd0 tx=0x7f03ac00b040 comp rx=0 tx=0).stop 2023-09-21T13:00:30.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 msgr2=0x7f03b4199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f03a800e970 tx=0x7f03a800ec80 comp rx=0 tx=0).stop 2023-09-21T13:00:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 shutdown_connections 2023-09-21T13:00:30.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f039c0a07b0 0x7f039c0a2c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f03b4100fd0 0x7f03b41990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03b419dc70 0x7f03b419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 --2- 172.21.15.142:0/35789894 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f03b41060f0 0x7f03b4199600 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 >> 172.21.15.142:0/35789894 conn(0x7f03b40fc830 msgr2=0x7f03b40fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.314+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 shutdown_connections 2023-09-21T13:00:30.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:30.315+0000 7f03ba9ff700 1 -- 172.21.15.142:0/35789894 wait complete. 2023-09-21T13:00:30.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 390365 10.41 MB/sec execute 71 sec latency 38.195 ms 2023-09-21T13:00:31.683 INFO:tasks.workunit.client.0.smithi142.stdout: 1 391671 10.36 MB/sec execute 72 sec latency 13.273 ms 2023-09-21T13:00:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:31 smithi156 ceph-mon[134078]: pgmap v131: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-09-21T13:00:31.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:31 smithi142 ceph-mon[97663]: pgmap v131: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-09-21T13:00:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:31 smithi160 ceph-mon[134450]: pgmap v131: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 425 op/s 2023-09-21T13:00:32.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 394042 10.40 MB/sec execute 73 sec latency 11.365 ms 2023-09-21T13:00:32.800 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:00:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/2439609310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d08103b90 msgr2=0x7f3d08107bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/2439609310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d08103b90 0x7f3d08107bd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009990 tx=0x7f3cfc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/2439609310 shutdown_connections 2023-09-21T13:00:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/2439609310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d08108300 0x7f3d0810fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/2439609310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d081031e0 0x7f3d081035c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/2439609310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d08103b90 0x7f3d08107bd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/2439609310 >> 172.21.15.142:0/2439609310 conn(0x7f3d080feaa0 msgr2=0x7f3d08100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.017+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/2439609310 shutdown_connections 2023-09-21T13:00:33.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.018+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/2439609310 wait complete. 2023-09-21T13:00:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.018+0000 7f3d0e7ff700 1 Processor -- start 2023-09-21T13:00:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 -- start start 2023-09-21T13:00:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d081031e0 0x7f3d08199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 0x7f3d0819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819e560 con 0x7f3d081031e0 2023-09-21T13:00:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819e6d0 con 0x7f3d0819dae0 2023-09-21T13:00:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0e7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0819e890 con 0x7f3d08108300 2023-09-21T13:00:33.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d081031e0 0x7f3d08199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45012/0 (socket says 172.21.15.142:45012) 2023-09-21T13:00:33.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d077fe700 1 -- 172.21.15.142:0/812764289 learned_addr learned my addr 172.21.15.142:0/812764289 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.019+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 0x7f3d0819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 -- 172.21.15.142:0/812764289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 msgr2=0x7f3d0819df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 0x7f3d0819df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 -- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d081031e0 msgr2=0x7f3d08199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d081031e0 0x7f3d08199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 -- 172.21.15.142:0/812764289 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf8009520 con 0x7f3d08108300 2023-09-21T13:00:33.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 0x7f3d0819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d077fe700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d057fa700 1 -- 172.21.15.142:0/812764289 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc01d070 con 0x7f3d08108300 2023-09-21T13:00:33.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d057fa700 1 -- 172.21.15.142:0/812764289 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cfc021410 con 0x7f3d08108300 2023-09-21T13:00:33.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cfc0095f0 con 0x7f3d08108300 2023-09-21T13:00:33.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.020+0000 7f3d057fa700 1 -- 172.21.15.142:0/812764289 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc017650 con 0x7f3d08108300 2023-09-21T13:00:33.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.021+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081a6020 con 0x7f3d08108300 2023-09-21T13:00:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.025+0000 7f3d057fa700 1 -- 172.21.15.142:0/812764289 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f3cfc021580 con 0x7f3d08108300 2023-09-21T13:00:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.026+0000 7f3d2216eb80 1 Processor -- start 2023-09-21T13:00:33.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 -- start start 2023-09-21T13:00:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d057fa700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 0x7f3cf00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d057fa700 1 -- 172.21.15.142:0/812764289 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3cfc0cd1b0 con 0x7f3d08108300 2023-09-21T13:00:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23932e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf238a2ca0 con 0x55cf23933360 2023-09-21T13:00:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf23886c70 con 0x55cf2392e610 2023-09-21T13:00:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf23884590 con 0x55cf2392ef30 2023-09-21T13:00:33.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 0x7f3cf00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35856/0 (socket says 172.21.15.142:35856) 2023-09-21T13:00:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d07fff700 1 -- 172.21.15.142:0/3592705250 learned_addr learned my addr 172.21.15.142:0/3592705250 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.027+0000 7f3d077fe700 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23932e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 -- 172.21.15.142:0/3592705250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 msgr2=0x55cf23932e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23932e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 -- 172.21.15.142:0/3592705250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 msgr2=0x55cf239337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 -- 172.21.15.142:0/3592705250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf236aade0 con 0x55cf2392e610 2023-09-21T13:00:33.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d07fff700 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f10 tx=0x7f3cf8011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef76896ae09f27a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 0x7f3cf00a2c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d00003ee0 tx=0x7f3d00009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3cee7fc700 1 -- 172.21.15.142:0/3592705250 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8019630 con 0x55cf2392e610 2023-09-21T13:00:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3cee7fc700 1 -- 172.21.15.142:0/3592705250 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cf8019c50 con 0x55cf2392e610 2023-09-21T13:00:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.028+0000 7f3cee7fc700 1 -- 172.21.15.142:0/3592705250 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800ecc0 con 0x55cf2392e610 2023-09-21T13:00:33.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 -- 172.21.15.142:0/3592705250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 msgr2=0x55cf2392e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8009f10 tx=0x7f3cf8011720 comp rx=0 tx=0).stop 2023-09-21T13:00:33.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 -- 172.21.15.142:0/3592705250 shutdown_connections 2023-09-21T13:00:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2392e9f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/3592705250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23932e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 -- 172.21.15.142:0/3592705250 >> 172.21.15.142:0/3592705250 conn(0x55cf2385b000 msgr2=0x55cf239296a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 -- 172.21.15.142:0/3592705250 shutdown_connections 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.029+0000 7f3d2216eb80 1 -- 172.21.15.142:0/3592705250 wait complete. 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.030+0000 7f3d2216eb80 1 -- start start 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.030+0000 7f3d2216eb80 1 Processor -- start 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23937ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2387fe80 con 0x55cf23933360 2023-09-21T13:00:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2381c740 con 0x55cf2392e610 2023-09-21T13:00:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2381c3e0 con 0x55cf2392ef30 2023-09-21T13:00:33.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d2216eb80 10 client.0 _ll_register_callbacks cb 0x55cf23766a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35860/0 (socket says 172.21.15.142:35860) 2023-09-21T13:00:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d07fff700 1 -- 172.21.15.142:0/1905222182 learned_addr learned my addr 172.21.15.142:0/1905222182 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d077fe700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23937ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.031+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 -- 172.21.15.142:0/1905222182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 msgr2=0x55cf23937ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23937ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 -- 172.21.15.142:0/1905222182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 msgr2=0x55cf239382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 -- 172.21.15.142:0/1905222182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf8009b70 con 0x55cf2392e610 2023-09-21T13:00:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d077fe700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23937ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d07fff700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8000c00 tx=0x7f3cf800eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70305c19ad1d6731 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3ce77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:33.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8019840 con 0x55cf2392e610 2023-09-21T13:00:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf237f0bb0 con 0x55cf2392e610 2023-09-21T13:00:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3cf80199a0 con 0x55cf2392e610 2023-09-21T13:00:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cf8005040 con 0x55cf2392e610 2023-09-21T13:00:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d2216eb80 10 client.26645 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:33.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.032+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cf23693c60 con 0x55cf2392e610 2023-09-21T13:00:33.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cf237f0bb0 con 0x55cf2392e610 2023-09-21T13:00:33.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3cf8028020 con 0x55cf2392e610 2023-09-21T13:00:33.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 10 client.26645 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:33.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 10 client.26645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:33.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 20 client.26645 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf23948240 0x55cf2394a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 4 client.26645 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf238fd020 con 0x55cf23948240 2023-09-21T13:00:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.033+0000 7f3d077fe700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf23948240 0x55cf2394a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.034+0000 7f3d077fe700 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf23948240 0x55cf2394a660 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144700d3b1f30fbc server_cookie=d5c9d9e016da0688 in_seq=0 out_seq=0 2023-09-21T13:00:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.034+0000 7f3ce77fe700 10 client.26645 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3ce77fe700 1 -- 172.21.15.142:0/1905222182 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cf238fd020 con 0x55cf23948240 2023-09-21T13:00:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3ce77fe700 10 client.26645 handle_command_reply: tid=0 2023-09-21T13:00:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 client.26645 shutdown 2023-09-21T13:00:33.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 msgr2=0x55cf2393aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3cf8000c00 tx=0x7f3cf800eec0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 shutdown_connections 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf23948240 0x55cf2394a660 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf239382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393aad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3ce77fe700 0 client.26645 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:33.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/1905222182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392ef30 0x55cf23937ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.035+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 >> 172.21.15.142:0/1905222182 conn(0x55cf2385b000 msgr2=0x55cf23929230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.036+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 shutdown_connections 2023-09-21T13:00:33.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.036+0000 7f3d2216eb80 1 -- 172.21.15.142:0/1905222182 wait complete. 2023-09-21T13:00:33.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.036+0000 7f3d2216eb80 20 client.26645 trim_cache size 0 max 16384 2023-09-21T13:00:33.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.053+0000 7f3d2216eb80 1 Processor -- start 2023-09-21T13:00:33.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.053+0000 7f3d2216eb80 1 -- start start 2023-09-21T13:00:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf23934750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf23700920 con 0x55cf23933360 2023-09-21T13:00:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2392f670 con 0x55cf2392ef30 2023-09-21T13:00:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2393b300 con 0x55cf2392e610 2023-09-21T13:00:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35876/0 (socket says 172.21.15.142:35876) 2023-09-21T13:00:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d077fe700 1 -- 172.21.15.142:0/2468752157 learned_addr learned my addr 172.21.15.142:0/2468752157 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45036/0 (socket says 172.21.15.142:45036) 2023-09-21T13:00:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf23934750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 -- 172.21.15.142:0/2468752157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 msgr2=0x55cf23935700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 -- 172.21.15.142:0/2468752157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 msgr2=0x55cf23934750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf23934750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d07fff700 1 -- 172.21.15.142:0/2468752157 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf2394f2d0 con 0x55cf2392e610 2023-09-21T13:00:33.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.054+0000 7f3d077fe700 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3d07fff700 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802a420 tx=0x7f3cf8011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6570640955af35e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3ceeffd700 1 -- 172.21.15.142:0/2468752157 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8011b20 con 0x55cf2392e610 2023-09-21T13:00:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3ceeffd700 1 -- 172.21.15.142:0/2468752157 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cf800e5f0 con 0x55cf2392e610 2023-09-21T13:00:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3ceeffd700 1 -- 172.21.15.142:0/2468752157 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8003680 con 0x55cf2392e610 2023-09-21T13:00:33.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3d2216eb80 1 -- 172.21.15.142:0/2468752157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 msgr2=0x55cf2393f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802a420 tx=0x7f3cf8011720 comp rx=0 tx=0).stop 2023-09-21T13:00:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.055+0000 7f3d2216eb80 1 -- 172.21.15.142:0/2468752157 shutdown_connections 2023-09-21T13:00:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf23933360 0x55cf23934750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf2392e610 0x55cf2393f540 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/2468752157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392ef30 0x55cf23935700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 -- 172.21.15.142:0/2468752157 >> 172.21.15.142:0/2468752157 conn(0x55cf2385b000 msgr2=0x55cf23934ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 -- 172.21.15.142:0/2468752157 shutdown_connections 2023-09-21T13:00:33.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 -- 172.21.15.142:0/2468752157 wait complete. 2023-09-21T13:00:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 -- start start 2023-09-21T13:00:33.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.056+0000 7f3d2216eb80 1 Processor -- start 2023-09-21T13:00:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf23933360 0x55cf2393bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2393c520 con 0x55cf2392ef30 2023-09-21T13:00:33.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2393c690 con 0x55cf2392e610 2023-09-21T13:00:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf2393c850 con 0x55cf23933360 2023-09-21T13:00:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d2216eb80 10 client.0 _ll_register_callbacks cb 0x55cf23766a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d077fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33270/0 (socket says 172.21.15.142:33270) 2023-09-21T13:00:33.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d077fe700 1 -- 172.21.15.142:0/925981523 learned_addr learned my addr 172.21.15.142:0/925981523 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d0cd9c700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf23933360 0x55cf2393bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 -- 172.21.15.142:0/925981523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf23933360 msgr2=0x55cf2393bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf23933360 0x55cf2393bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 -- 172.21.15.142:0/925981523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 msgr2=0x55cf2393b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d07fff700 1 -- 172.21.15.142:0/925981523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d081a6020 con 0x55cf2392e610 2023-09-21T13:00:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.057+0000 7f3d077fe700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3d07fff700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393f490 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802a420 tx=0x7f3cf8005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=257af88442b80be6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf8011b20 con 0x55cf2392e610 2023-09-21T13:00:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cf8019c50 con 0x55cf2392e610 2023-09-21T13:00:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f3cf8000e40 con 0x55cf2392e610 2023-09-21T13:00:33.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cf80055f0 con 0x55cf2392e610 2023-09-21T13:00:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3d2216eb80 10 client.26651 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cf23693c60 con 0x55cf2392e610 2023-09-21T13:00:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3cf8049020 con 0x55cf2392e610 2023-09-21T13:00:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.058+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3cf8039070 con 0x55cf2392e610 2023-09-21T13:00:33.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 10 client.26651 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:33.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 10 client.26651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:33.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 20 client.26651 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:33.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf2399d340 0x55cf2399f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 4 client.26651 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:00:33.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cf23878e60 con 0x55cf2399d340 2023-09-21T13:00:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d077fe700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf2399d340 0x55cf2399f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3ce77fe700 10 client.26651 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d077fe700 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf2399d340 0x55cf2399f730 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1237f5f3e70948df server_cookie=5abcb9ce4da3c4dd in_seq=0 out_seq=0 2023-09-21T13:00:33.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3ce77fe700 1 -- 172.21.15.142:0/925981523 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cf23878e60 con 0x55cf2399d340 2023-09-21T13:00:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3ce77fe700 10 client.26651 handle_command_reply: tid=0 2023-09-21T13:00:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 1 client.26651 shutdown 2023-09-21T13:00:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 msgr2=0x55cf2393f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.059+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393f490 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3cf802a420 tx=0x7f3cf8005a00 comp rx=0 tx=0).stop 2023-09-21T13:00:33.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 shutdown_connections 2023-09-21T13:00:33.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cf2399d340 0x55cf2399f730 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cf23933360 0x55cf2393bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cf2392e610 0x55cf2393f490 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 --2- 172.21.15.142:0/925981523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cf2392ef30 0x55cf2393b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3ce77fe700 0 client.26651 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 >> 172.21.15.142:0/925981523 conn(0x55cf2385b000 msgr2=0x55cf23936d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 shutdown_connections 2023-09-21T13:00:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 1 -- 172.21.15.142:0/925981523 wait complete. 2023-09-21T13:00:33.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d2216eb80 20 client.26651 trim_cache size 0 max 16384 2023-09-21T13:00:33.076 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:00:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T13:00:33.076 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T13:00:33.077 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:00:33.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 msgr2=0x7f3cf00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 0x7f3cf00a2c70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3d00003ee0 tx=0x7f3d00009920 comp rx=0 tx=0).stop 2023-09-21T13:00:33.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 msgr2=0x7f3d08199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc000c00 tx=0x7f3cfc005740 comp rx=0 tx=0).stop 2023-09-21T13:00:33.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 shutdown_connections 2023-09-21T13:00:33.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3cf00a07b0 0x7f3cf00a2c70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3d081031e0 0x7f3d08199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3d0819dae0 0x7f3d0819df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.060+0000 7f3d0e7ff700 1 --2- 172.21.15.142:0/812764289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3d08108300 0x7f3d08199680 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.061+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 >> 172.21.15.142:0/812764289 conn(0x7f3d080feaa0 msgr2=0x7f3d080ff5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.061+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 shutdown_connections 2023-09-21T13:00:33.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.061+0000 7f3d0e7ff700 1 -- 172.21.15.142:0/812764289 wait complete. 2023-09-21T13:00:33.081 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T13:00:33.081 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:00:33.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 -- 172.21.15.142:0/856106213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc0101980 msgr2=0x7f6bc01059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/856106213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc0101980 0x7f6bc01059c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00098f0 tx=0x7f6bb0009c00 comp rx=0 tx=0).stop 2023-09-21T13:00:33.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 -- 172.21.15.142:0/856106213 shutdown_connections 2023-09-21T13:00:33.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/856106213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc01060f0 0x7f6bc010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/856106213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc01013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/856106213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc0101980 0x7f6bc01059c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.296+0000 7f6bc77ff700 1 -- 172.21.15.142:0/856106213 >> 172.21.15.142:0/856106213 conn(0x7f6bc00fc890 msgr2=0x7f6bc00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.297+0000 7f6bc77ff700 1 -- 172.21.15.142:0/856106213 shutdown_connections 2023-09-21T13:00:33.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.297+0000 7f6bc77ff700 1 -- 172.21.15.142:0/856106213 wait complete. 2023-09-21T13:00:33.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.298+0000 7f6bc77ff700 1 Processor -- start 2023-09-21T13:00:33.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.298+0000 7f6bc77ff700 1 -- start start 2023-09-21T13:00:33.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.298+0000 7f6bc77ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.298+0000 7f6bc77ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 0x7f6bc0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc77ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc019b8a0 0x7f6bc019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc77ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019c320 con 0x7f6bc019b8a0 2023-09-21T13:00:33.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc77ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019c490 con 0x7f6bc0100fd0 2023-09-21T13:00:33.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc77ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc019c650 con 0x7f6bc01060f0 2023-09-21T13:00:33.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35898/0 (socket says 172.21.15.142:35898) 2023-09-21T13:00:33.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 -- 172.21.15.142:0/705577728 learned_addr learned my addr 172.21.15.142:0/705577728 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc4d9a700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 0x7f6bc0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc5d9c700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc019b8a0 0x7f6bc019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 -- 172.21.15.142:0/705577728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 msgr2=0x7f6bc0197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 0x7f6bc0197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 -- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc019b8a0 msgr2=0x7f6bc019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc019b8a0 0x7f6bc019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc559b700 1 -- 172.21.15.142:0/705577728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0095f0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.299+0000 7f6bc4d9a700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 0x7f6bc0197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bc559b700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00ec10 tx=0x7f6bbc00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00cc90 con 0x7f6bc0100fd0 2023-09-21T13:00:33.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bbc0044e0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb0009520 con 0x7f6bc0100fd0 2023-09-21T13:00:33.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc010430 con 0x7f6bc0100fd0 2023-09-21T13:00:33.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.300+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01a3f00 con 0x7f6bc0100fd0 2023-09-21T13:00:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.301+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0067bd0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.303+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f6bbc003fb0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.304+0000 7f6bb67fc700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 0x7f6bac0a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.304+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6bbc014070 con 0x7f6bc0100fd0 2023-09-21T13:00:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.305+0000 7f6bc4d9a700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 0x7f6bac0a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.305+0000 7f6bc4d9a700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 0x7f6bac0a2cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009fd0 tx=0x7f6bb0019040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.307+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6bbc096020 con 0x7f6bc0100fd0 2023-09-21T13:00:33.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.574+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc0101bd0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.574+0000 7f6bb67fc700 1 -- 172.21.15.142:0/705577728 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f6bc0101bd0 con 0x7f6bc0100fd0 2023-09-21T13:00:33.574 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:00:33.575 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:00:16.428735+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:00:33.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.577+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 msgr2=0x7f6bac0a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.577+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 0x7f6bac0a2cb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009fd0 tx=0x7f6bb0019040 comp rx=0 tx=0).stop 2023-09-21T13:00:33.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 msgr2=0x7f6bc0196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00ec10 tx=0x7f6bbc00ef20 comp rx=0 tx=0).stop 2023-09-21T13:00:33.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 shutdown_connections 2023-09-21T13:00:33.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6bac0a07f0 0x7f6bac0a2cb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6bc019b8a0 0x7f6bc019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6bc0100fd0 0x7f6bc0196f00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 --2- 172.21.15.142:0/705577728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc01060f0 0x7f6bc0197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 >> 172.21.15.142:0/705577728 conn(0x7f6bc00fc890 msgr2=0x7f6bc00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 shutdown_connections 2023-09-21T13:00:33.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.578+0000 7f6bc77ff700 1 -- 172.21.15.142:0/705577728 wait complete. 2023-09-21T13:00:33.580 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 26 2023-09-21T13:00:33.597 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:00:33.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 395453 10.34 MB/sec execute 74 sec latency 24.459 ms 2023-09-21T13:00:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 -- 172.21.15.142:0/1710059508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 msgr2=0x7f58c010dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 --2- 172.21.15.142:0/1710059508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c010dc60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b0a0 tx=0x7f58b800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 -- 172.21.15.142:0/1710059508 shutdown_connections 2023-09-21T13:00:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 --2- 172.21.15.142:0/1710059508 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c010dc60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 --2- 172.21.15.142:0/1710059508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 0x7f58c01013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 --2- 172.21.15.142:0/1710059508 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0101970 0x7f58c01059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 -- 172.21.15.142:0/1710059508 >> 172.21.15.142:0/1710059508 conn(0x7f58c00fc840 msgr2=0x7f58c00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 -- 172.21.15.142:0/1710059508 shutdown_connections 2023-09-21T13:00:33.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.819+0000 7f58c5fff700 1 -- 172.21.15.142:0/1710059508 wait complete. 2023-09-21T13:00:33.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.820+0000 7f58c5fff700 1 Processor -- start 2023-09-21T13:00:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 -- start start 2023-09-21T13:00:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 0x7f58c019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0199530 0x7f58c01999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019a050 con 0x7f58c0199530 2023-09-21T13:00:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019a1c0 con 0x7f58c01060e0 2023-09-21T13:00:33.824 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58c5fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019a380 con 0x7f58c0100fc0 2023-09-21T13:00:33.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.821+0000 7f58beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35904/0 (socket says 172.21.15.142:35904) 2023-09-21T13:00:33.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 -- 172.21.15.142:0/3631330150 learned_addr learned my addr 172.21.15.142:0/3631330150 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58bffff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0199530 0x7f58c01999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 0x7f58c019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 -- 172.21.15.142:0/3631330150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 msgr2=0x7f58c019dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 0x7f58c019dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 -- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0199530 msgr2=0x7f58c01999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0199530 0x7f58c01999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 -- 172.21.15.142:0/3631330150 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009d00 con 0x7f58c01060e0 2023-09-21T13:00:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58beffd700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f58b400e9f0 tx=0x7f58b400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58bcff9700 1 -- 172.21.15.142:0/3631330150 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4009750 con 0x7f58c01060e0 2023-09-21T13:00:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58bcff9700 1 -- 172.21.15.142:0/3631330150 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b400c7c0 con 0x7f58c01060e0 2023-09-21T13:00:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c01a5ce0 con 0x7f58c01060e0 2023-09-21T13:00:33.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.822+0000 7f58bcff9700 1 -- 172.21.15.142:0/3631330150 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40054d0 con 0x7f58c01060e0 2023-09-21T13:00:33.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.823+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c01a61a0 con 0x7f58c01060e0 2023-09-21T13:00:33.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.826+0000 7f58bcff9700 1 -- 172.21.15.142:0/3631330150 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f58b400c930 con 0x7f58c01060e0 2023-09-21T13:00:33.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.827+0000 7f58bcff9700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 0x7f58a80a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.827+0000 7f58d99d5b80 1 Processor -- start 2023-09-21T13:00:33.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.827+0000 7f58bcff9700 1 -- 172.21.15.142:0/3631330150 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58b4014070 con 0x7f58c01060e0 2023-09-21T13:00:33.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 -- start start 2023-09-21T13:00:33.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 0x7f58a80a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0969f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb00aca0 con 0x5648fb096f30 2023-09-21T13:00:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fafeec70 con 0x5648fb096610 2023-09-21T13:00:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.828+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fafec590 con 0x5648fb09b360 2023-09-21T13:00:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39510/0 (socket says 172.21.15.142:39510) 2023-09-21T13:00:33.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 -- 172.21.15.142:0/2545407839 learned_addr learned my addr 172.21.15.142:0/2545407839 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58beffd700 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 -- 172.21.15.142:0/2545407839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 msgr2=0x5648fb0969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 -- 172.21.15.142:0/2545407839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 msgr2=0x5648fb09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 -- 172.21.15.142:0/2545407839 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648fae12de0 con 0x5648fb09b360 2023-09-21T13:00:33.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:33.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 0x7f58a80a2c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f58b0011550 tx=0x7f58b0011910 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.829+0000 7f58bffff700 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f58b8015000 tx=0x7f58b8009450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=850e2fa5b87dca5d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.830+0000 7f58a5ffb700 1 -- 172.21.15.142:0/2545407839 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800e040 con 0x5648fb09b360 2023-09-21T13:00:33.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.830+0000 7f58a5ffb700 1 -- 172.21.15.142:0/2545407839 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b800bd30 con 0x5648fb09b360 2023-09-21T13:00:33.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.830+0000 7f58a5ffb700 1 -- 172.21.15.142:0/2545407839 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b801c6a0 con 0x5648fb09b360 2023-09-21T13:00:33.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.830+0000 7f58d99d5b80 1 -- 172.21.15.142:0/2545407839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 msgr2=0x5648fb09b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.830+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f58b8015000 tx=0x7f58b8009450 comp rx=0 tx=0).stop 2023-09-21T13:00:33.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 -- 172.21.15.142:0/2545407839 shutdown_connections 2023-09-21T13:00:33.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb09b7c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/2545407839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 -- 172.21.15.142:0/2545407839 >> 172.21.15.142:0/2545407839 conn(0x5648fafc3000 msgr2=0x5648fb0916a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 -- 172.21.15.142:0/2545407839 shutdown_connections 2023-09-21T13:00:33.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 -- 172.21.15.142:0/2545407839 wait complete. 2023-09-21T13:00:33.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.831+0000 7f58d99d5b80 1 -- start start 2023-09-21T13:00:33.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.832+0000 7f58d99d5b80 1 Processor -- start 2023-09-21T13:00:33.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.832+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.832+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.832+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 0x5648fb0a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fafe7e80 con 0x5648fb096f30 2023-09-21T13:00:33.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648faf84740 con 0x5648fb09b360 2023-09-21T13:00:33.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648faf843e0 con 0x5648fb096610 2023-09-21T13:00:33.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58d99d5b80 10 client.0 _ll_register_callbacks cb 0x5648faecea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:33.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39522/0 (socket says 172.21.15.142:39522) 2023-09-21T13:00:33.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bf7fe700 1 -- 172.21.15.142:0/463154486 learned_addr learned my addr 172.21.15.142:0/463154486 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 0x5648fb0a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58beffd700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 -- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 msgr2=0x5648fb0a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 -- 172.21.15.142:0/463154486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 msgr2=0x5648fb09fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 -- 172.21.15.142:0/463154486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c010e4d0 con 0x5648fb09b360 2023-09-21T13:00:33.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f58bffff700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 0x5648fb0a03b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009610 tx=0x7f58b800bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4640d875fd8442c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.833+0000 7f589effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:33.845 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800e040 con 0x5648fb09b360 2023-09-21T13:00:33.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648faf58bb0 con 0x5648fb09b360 2023-09-21T13:00:33.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58b80052d0 con 0x5648fb09b360 2023-09-21T13:00:33.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b8005490 con 0x5648fb09b360 2023-09-21T13:00:33.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 10 client.26669 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:33.846 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5648fadfbc60 con 0x5648fb09b360 2023-09-21T13:00:33.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5648faf58bb0 con 0x5648fb09b360 2023-09-21T13:00:33.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f58b8019030 con 0x5648fb09b360 2023-09-21T13:00:33.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 10 client.26669 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:33.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 10 client.26669 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:00:33.847 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 20 client.26669 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:33.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.834+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb0afec0 0x5648fb0b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.835+0000 7f58d99d5b80 4 client.26669 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:33.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.835+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648fb065020 con 0x5648fb0afec0 2023-09-21T13:00:33.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.835+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb0afec0 0x5648fb0b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.848 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.835+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb0afec0 0x5648fb0b22b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3baa5b50ebf998ea server_cookie=9b1403469178707e in_seq=0 out_seq=0 2023-09-21T13:00:33.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.835+0000 7f589effd700 10 client.26669 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:33.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f589effd700 1 -- 172.21.15.142:0/463154486 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648fb065020 con 0x5648fb0afec0 2023-09-21T13:00:33.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f589effd700 10 client.26669 handle_command_reply: tid=0 2023-09-21T13:00:33.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 client.26669 shutdown 2023-09-21T13:00:33.849 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 msgr2=0x5648fb0a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 0x5648fb0a03b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f58b8009610 tx=0x7f58b800bea0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 shutdown_connections 2023-09-21T13:00:33.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb0afec0 0x5648fb0b22b0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb09b360 0x5648fb0a03b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/463154486 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb09fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f589effd700 0 client.26669 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:33.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.836+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 >> 172.21.15.142:0/463154486 conn(0x5648fafc3000 msgr2=0x5648fb091290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.837+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 shutdown_connections 2023-09-21T13:00:33.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.837+0000 7f58d99d5b80 1 -- 172.21.15.142:0/463154486 wait complete. 2023-09-21T13:00:33.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.837+0000 7f58d99d5b80 20 client.26669 trim_cache size 0 max 16384 2023-09-21T13:00:33.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.850+0000 7f58d99d5b80 1 Processor -- start 2023-09-21T13:00:33.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.850+0000 7f58d99d5b80 1 -- start start 2023-09-21T13:00:33.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb09b360 0x5648fb09dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fae68920 con 0x5648fb09b360 2023-09-21T13:00:33.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb091890 con 0x5648fb096f30 2023-09-21T13:00:33.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb08b9c0 con 0x5648fb096610 2023-09-21T13:00:33.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58beffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36142/0 (socket says 172.21.15.142:36142) 2023-09-21T13:00:33.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58beffd700 1 -- 172.21.15.142:0/1712050887 learned_addr learned my addr 172.21.15.142:0/1712050887 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bffff700 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb09b360 0x5648fb09dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1712050887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 msgr2=0x5648fb09d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1712050887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb09b360 msgr2=0x5648fb09dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb09b360 0x5648fb09dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58bf7fe700 1 -- 172.21.15.142:0/1712050887 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648fb0900b0 con 0x5648fb096610 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.851+0000 7f58beffd700 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a7490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5648faf844f0 tx=0x7f58b001f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5517b6243b10b1ef server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58a67fc700 1 -- 172.21.15.142:0/1712050887 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0026070 con 0x5648fb096610 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58a67fc700 1 -- 172.21.15.142:0/1712050887 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b0028e20 con 0x5648fb096610 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58a67fc700 1 -- 172.21.15.142:0/1712050887 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0005110 con 0x5648fb096610 2023-09-21T13:00:33.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58d99d5b80 1 -- 172.21.15.142:0/1712050887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 msgr2=0x5648fb0a7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.852+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a7490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x5648faf844f0 tx=0x7f58b001f000 comp rx=0 tx=0).stop 2023-09-21T13:00:33.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 -- 172.21.15.142:0/1712050887 shutdown_connections 2023-09-21T13:00:33.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb09b360 0x5648fb09dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb096610 0x5648fb0a7490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/1712050887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096f30 0x5648fb09d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 -- 172.21.15.142:0/1712050887 >> 172.21.15.142:0/1712050887 conn(0x5648fafc3000 msgr2=0x5648fb0993b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 -- 172.21.15.142:0/1712050887 shutdown_connections 2023-09-21T13:00:33.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 -- 172.21.15.142:0/1712050887 wait complete. 2023-09-21T13:00:33.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 -- start start 2023-09-21T13:00:33.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.853+0000 7f58d99d5b80 1 Processor -- start 2023-09-21T13:00:33.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb0f8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb0fcdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb0fd300 con 0x5648fb096f30 2023-09-21T13:00:33.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb0fd440 con 0x5648fb096610 2023-09-21T13:00:33.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648fb0fd600 con 0x5648fb09b360 2023-09-21T13:00:33.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58d99d5b80 10 client.0 _ll_register_callbacks cb 0x5648faecea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:33.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58bf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36156/0 (socket says 172.21.15.142:36156) 2023-09-21T13:00:33.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58bf7fe700 1 -- 172.21.15.142:0/3333529188 learned_addr learned my addr 172.21.15.142:0/3333529188 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:33.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.854+0000 7f58beffd700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb0f8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bffff700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb0fcdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 -- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 msgr2=0x5648fb0fcdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb0fcdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 -- 172.21.15.142:0/3333529188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 msgr2=0x5648fb0f8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:33.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb0f8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 -- 172.21.15.142:0/3333529188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c01a61a0 con 0x5648fb096610 2023-09-21T13:00:33.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58bf7fe700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009d00 tx=0x7f58b0004410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f92bd572f4e95df7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:33.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f589effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:33.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b0026050 con 0x5648fb096610 2023-09-21T13:00:33.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58b800bd30 con 0x5648fb096610 2023-09-21T13:00:33.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.855+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f58b0004950 con 0x5648fb096610 2023-09-21T13:00:33.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b0004b30 con 0x5648fb096610 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 10 client.26675 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f58b00099e0 con 0x5648fb096610 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b800bd30 con 0x5648fb096610 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f58b00036a0 con 0x5648fb096610 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 10 client.26675 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:33.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 10 client.26675 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:00:33.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 20 client.26675 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:33.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb104dc0 0x5648fb1071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:33.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 4 client.26675 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:33.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5648fafe0e60 con 0x5648fb104dc0 2023-09-21T13:00:33.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.856+0000 7f58beffd700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb104dc0 0x5648fb1071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:33.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58beffd700 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb104dc0 0x5648fb1071e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2213bf63f4a5e383 server_cookie=6737e6ef715a15b in_seq=0 out_seq=0 2023-09-21T13:00:33.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f589effd700 10 client.26675 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:33.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f589effd700 1 -- 172.21.15.142:0/3333529188 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5648fafe0e60 con 0x5648fb104dc0 2023-09-21T13:00:33.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f589effd700 10 client.26675 handle_command_reply: tid=0 2023-09-21T13:00:33.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 client.26675 shutdown 2023-09-21T13:00:33.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 msgr2=0x5648fb0f7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f58b0009d00 tx=0x7f58b0004410 comp rx=0 tx=0).stop 2023-09-21T13:00:33.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 shutdown_connections 2023-09-21T13:00:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x5648fb104dc0 0x5648fb1071e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5648fb09b360 0x5648fb0fcdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5648fb096610 0x5648fb0f7e10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f589effd700 0 client.26675 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:00:33.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 --2- 172.21.15.142:0/3333529188 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5648fb096f30 0x5648fb0f8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.857+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 >> 172.21.15.142:0/3333529188 conn(0x5648fafc3000 msgr2=0x5648fb09d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.858+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 shutdown_connections 2023-09-21T13:00:33.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.858+0000 7f58d99d5b80 1 -- 172.21.15.142:0/3333529188 wait complete. 2023-09-21T13:00:33.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.858+0000 7f58d99d5b80 20 client.26675 trim_cache size 0 max 16384 2023-09-21T13:00:33.876 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:33.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 msgr2=0x7f58a80a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 0x7f58a80a2c70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f58b0011550 tx=0x7f58b0011910 comp rx=0 tx=0).stop 2023-09-21T13:00:33.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 msgr2=0x7f58c019e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:33.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f58b400e9f0 tx=0x7f58b400ed00 comp rx=0 tx=0).stop 2023-09-21T13:00:33.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 shutdown_connections 2023-09-21T13:00:33.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f58a80a07b0 0x7f58a80a2c70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f58c0199530 0x7f58c01999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f58c0100fc0 0x7f58c019dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 --2- 172.21.15.142:0/3631330150 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f58c01060e0 0x7f58c019e1e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:33.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 >> 172.21.15.142:0/3631330150 conn(0x7f58c00fc840 msgr2=0x7f58c0104990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:33.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 shutdown_connections 2023-09-21T13:00:33.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:33.859+0000 7f58c5fff700 1 -- 172.21.15.142:0/3631330150 wait complete. 2023-09-21T13:00:33.879 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:33 smithi142 ceph-mon[97663]: pgmap v132: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:33.880 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:00:33.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:33 smithi156 ceph-mon[134078]: pgmap v132: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:33.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:33 smithi160 ceph-mon[134450]: pgmap v132: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 -- 172.21.15.142:0/3620464040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4101f40 msgr2=0x7f39c4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 --2- 172.21.15.142:0/3620464040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4101f40 0x7f39c4102320 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009990 tx=0x7f39b4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 -- 172.21.15.142:0/3620464040 shutdown_connections 2023-09-21T13:00:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 --2- 172.21.15.142:0/3620464040 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c410d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 --2- 172.21.15.142:0/3620464040 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4101f40 0x7f39c4102320 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 --2- 172.21.15.142:0/3620464040 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4102860 0x7f39c410ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 -- 172.21.15.142:0/3620464040 >> 172.21.15.142:0/3620464040 conn(0x7f39c40fb740 msgr2=0x7f39c40fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 -- 172.21.15.142:0/3620464040 shutdown_connections 2023-09-21T13:00:34.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.106+0000 7f39c95ff700 1 -- 172.21.15.142:0/3620464040 wait complete. 2023-09-21T13:00:34.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 Processor -- start 2023-09-21T13:00:34.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 -- start start 2023-09-21T13:00:34.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 0x7f39c4199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c419e0f0 con 0x7f39c410b360 2023-09-21T13:00:34.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c419e260 con 0x7f39c4102860 2023-09-21T13:00:34.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c95ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c419e420 con 0x7f39c4101f40 2023-09-21T13:00:34.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 0x7f39c4199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39566/0 (socket says 172.21.15.142:39566) 2023-09-21T13:00:34.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.108+0000 7f39c2ffd700 1 -- 172.21.15.142:0/2422518591 learned_addr learned my addr 172.21.15.142:0/2422518591 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c37fe700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 -- 172.21.15.142:0/2422518591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 msgr2=0x7f39c4199110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 -- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 msgr2=0x7f39c419dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c419dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 -- 172.21.15.142:0/2422518591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc009c40 con 0x7f39c4102860 2023-09-21T13:00:34.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c37fe700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c419dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:34.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:34.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c27fc700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 0x7f39c4199650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39b800e9f0 tx=0x7f39b800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39abfff700 1 -- 172.21.15.142:0/2422518591 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80096d0 con 0x7f39c4102860 2023-09-21T13:00:34.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40095f0 con 0x7f39c4102860 2023-09-21T13:00:34.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39abfff700 1 -- 172.21.15.142:0/2422518591 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39b800cbd0 con 0x7f39c4102860 2023-09-21T13:00:34.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39abfff700 1 -- 172.21.15.142:0/2422518591 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8018680 con 0x7f39c4102860 2023-09-21T13:00:34.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.109+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c419e8f0 con 0x7f39c4102860 2023-09-21T13:00:34.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.113+0000 7f39abfff700 1 -- 172.21.15.142:0/2422518591 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f39b800cd40 con 0x7f39c4102860 2023-09-21T13:00:34.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.114+0000 7f39abfff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 0x7f39ac0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.114+0000 7f39dce56b80 1 Processor -- start 2023-09-21T13:00:34.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.114+0000 7f39abfff700 1 -- 172.21.15.142:0/2422518591 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f39b8014070 con 0x7f39c4102860 2023-09-21T13:00:34.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 -- start start 2023-09-21T13:00:34.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 0x7f39ac0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508b610 0x555a8508b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a8508fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a850907c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84fffca0 con 0x555a8508bf30 2023-09-21T13:00:34.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84fe3c70 con 0x555a8508b610 2023-09-21T13:00:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39dce56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84fe1590 con 0x555a85090360 2023-09-21T13:00:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a8508fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508b610 0x555a8508b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a8508fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37350/0 (socket says 172.21.15.142:37350) 2023-09-21T13:00:34.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c27fc700 1 -- 172.21.15.142:0/385879301 learned_addr learned my addr 172.21.15.142:0/385879301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.115+0000 7f39c37fe700 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a850907c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 0x7f39ac0a2cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098e0 tx=0x7f39b400b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 -- 172.21.15.142:0/385879301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508b610 msgr2=0x555a8508b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508b610 0x555a8508b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 -- 172.21.15.142:0/385879301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 msgr2=0x555a8508fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a8508fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 -- 172.21.15.142:0/385879301 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a84e07de0 con 0x555a85090360 2023-09-21T13:00:34.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39c37fe700 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a850907c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009500 tx=0x7f39bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f506f70b64978a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39a97fa700 1 -- 172.21.15.142:0/385879301 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00e070 con 0x555a85090360 2023-09-21T13:00:34.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39a97fa700 1 -- 172.21.15.142:0/385879301 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39bc00f040 con 0x555a85090360 2023-09-21T13:00:34.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.116+0000 7f39a97fa700 1 -- 172.21.15.142:0/385879301 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc014a20 con 0x555a85090360 2023-09-21T13:00:34.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 -- 172.21.15.142:0/385879301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 msgr2=0x555a850907c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a850907c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009500 tx=0x7f39bc009920 comp rx=0 tx=0).stop 2023-09-21T13:00:34.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 -- 172.21.15.142:0/385879301 shutdown_connections 2023-09-21T13:00:34.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a850907c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508b610 0x555a8508b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 --2- 172.21.15.142:0/385879301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a8508fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.117+0000 7f39dce56b80 1 -- 172.21.15.142:0/385879301 >> 172.21.15.142:0/385879301 conn(0x555a84fb8000 msgr2=0x555a850866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.118+0000 7f39dce56b80 1 -- 172.21.15.142:0/385879301 shutdown_connections 2023-09-21T13:00:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.118+0000 7f39dce56b80 1 -- 172.21.15.142:0/385879301 wait complete. 2023-09-21T13:00:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.118+0000 7f39dce56b80 1 -- start start 2023-09-21T13:00:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.118+0000 7f39dce56b80 1 Processor -- start 2023-09-21T13:00:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508b610 0x555a85094ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a85095950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84fdce80 con 0x555a8508bf30 2023-09-21T13:00:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84f79740 con 0x555a85090360 2023-09-21T13:00:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84f793e0 con 0x555a8508b610 2023-09-21T13:00:34.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39dce56b80 10 client.0 _ll_register_callbacks cb 0x555a84ec3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37358/0 (socket says 172.21.15.142:37358) 2023-09-21T13:00:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a85095950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39c27fc700 1 -- 172.21.15.142:0/1728496459 learned_addr learned my addr 172.21.15.142:0/1728496459 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.119+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508b610 0x555a85094ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 -- 172.21.15.142:0/1728496459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508b610 msgr2=0x555a85094ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508b610 0x555a85094ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 -- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 msgr2=0x555a85095410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 -- 172.21.15.142:0/1728496459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0091e0 con 0x555a85090360 2023-09-21T13:00:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a85095950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009500 tx=0x7f39bc015670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ffa4410af2d76e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:34.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc00e040 con 0x555a85090360 2023-09-21T13:00:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a84f4dbb0 con 0x555a85090360 2023-09-21T13:00:34.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f39bc015ce0 con 0x555a85090360 2023-09-21T13:00:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39bc003a00 con 0x555a85090360 2023-09-21T13:00:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39dce56b80 10 client.26687 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:34.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.120+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a84df0c60 con 0x555a85090360 2023-09-21T13:00:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555a84f4dbb0 con 0x555a85090360 2023-09-21T13:00:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39bc0145c0 con 0x555a85090360 2023-09-21T13:00:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 10 client.26687 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 10 client.26687 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:00:34.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 20 client.26687 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850a5360 0x555a850a7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 4 client.26687 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a8505a020 con 0x555a850a5360 2023-09-21T13:00:34.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.121+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850a5360 0x555a850a7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.122+0000 7f39a6ff5700 10 client.26687 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:34.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.122+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850a5360 0x555a850a7780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8ad168ffc945724a server_cookie=e08b6bbfc073dc51 in_seq=0 out_seq=0 2023-09-21T13:00:34.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.122+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1728496459 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555a8505a020 con 0x555a850a5360 2023-09-21T13:00:34.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.122+0000 7f39a6ff5700 10 client.26687 handle_command_reply: tid=0 2023-09-21T13:00:34.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.122+0000 7f39dce56b80 1 client.26687 shutdown 2023-09-21T13:00:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 msgr2=0x555a85095950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a85095950 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009500 tx=0x7f39bc015670 comp rx=0 tx=0).stop 2023-09-21T13:00:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 shutdown_connections 2023-09-21T13:00:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850a5360 0x555a850a7780 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a85095950 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508b610 0x555a85094ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39a6ff5700 0 client.26687 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1728496459 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508bf30 0x555a85095410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 >> 172.21.15.142:0/1728496459 conn(0x555a84fb8000 msgr2=0x555a85086290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 shutdown_connections 2023-09-21T13:00:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 1 -- 172.21.15.142:0/1728496459 wait complete. 2023-09-21T13:00:34.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.123+0000 7f39dce56b80 20 client.26687 trim_cache size 0 max 16384 2023-09-21T13:00:34.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 Processor -- start 2023-09-21T13:00:34.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 -- start start 2023-09-21T13:00:34.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a8508f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8508fce0 con 0x555a8508b610 2023-09-21T13:00:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a84e5d920 con 0x555a85090360 2023-09-21T13:00:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.137+0000 7f39dce56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8509ca20 con 0x555a8508bf30 2023-09-21T13:00:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39588/0 (socket says 172.21.15.142:39588) 2023-09-21T13:00:34.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 -- 172.21.15.142:0/1178653003 learned_addr learned my addr 172.21.15.142:0/1178653003 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a8508f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 -- 172.21.15.142:0/1178653003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 msgr2=0x555a8508f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a8508f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 -- 172.21.15.142:0/1178653003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 msgr2=0x555a8509c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 -- 172.21.15.142:0/1178653003 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a84e2e250 con 0x555a8508bf30 2023-09-21T13:00:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a8508f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39b8095b10 tx=0x7f39b801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=170c58b2faf59609 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39a9ffb700 1 -- 172.21.15.142:0/1178653003 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8099d10 con 0x555a8508bf30 2023-09-21T13:00:34.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39a9ffb700 1 -- 172.21.15.142:0/1178653003 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39b8099610 con 0x555a8508bf30 2023-09-21T13:00:34.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.138+0000 7f39a9ffb700 1 -- 172.21.15.142:0/1178653003 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8099ad0 con 0x555a8508bf30 2023-09-21T13:00:34.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 -- 172.21.15.142:0/1178653003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 msgr2=0x555a85092750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f39b8095b10 tx=0x7f39b801a040 comp rx=0 tx=0).stop 2023-09-21T13:00:34.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 -- 172.21.15.142:0/1178653003 shutdown_connections 2023-09-21T13:00:34.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a85090360 0x555a8508f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1178653003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a8508bf30 0x555a85092750 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 -- 172.21.15.142:0/1178653003 >> 172.21.15.142:0/1178653003 conn(0x555a84fb8000 msgr2=0x555a850a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 -- 172.21.15.142:0/1178653003 shutdown_connections 2023-09-21T13:00:34.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.139+0000 7f39dce56b80 1 -- 172.21.15.142:0/1178653003 wait complete. 2023-09-21T13:00:34.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 -- start start 2023-09-21T13:00:34.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 Processor -- start 2023-09-21T13:00:34.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a8509aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8509c8d0 con 0x555a8508b610 2023-09-21T13:00:34.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8509af50 con 0x555a8508bf30 2023-09-21T13:00:34.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a8509b110 con 0x555a85090360 2023-09-21T13:00:34.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.140+0000 7f39dce56b80 10 client.0 _ll_register_callbacks cb 0x555a84ec3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:34.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36196/0 (socket says 172.21.15.142:36196) 2023-09-21T13:00:34.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 -- 172.21.15.142:0/1238556519 learned_addr learned my addr 172.21.15.142:0/1238556519 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c37fe700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a8509aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 -- 172.21.15.142:0/1238556519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 msgr2=0x555a8509aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a8509aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 -- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 msgr2=0x555a8509bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 -- 172.21.15.142:0/1238556519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c419e8f0 con 0x555a8508bf30 2023-09-21T13:00:34.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:34.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39c27fc700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39b80995a0 tx=0x7f39b8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9227f06aafc181e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:34.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8099a70 con 0x555a8508bf30 2023-09-21T13:00:34.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39bc00f040 con 0x555a8508bf30 2023-09-21T13:00:34.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.141+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f39b8099d10 con 0x555a8508bf30 2023-09-21T13:00:34.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b80a11f0 con 0x555a8508bf30 2023-09-21T13:00:34.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 10 client.26693 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:34.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x555a84e062b0 con 0x555a8508bf30 2023-09-21T13:00:34.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39bc00f040 con 0x555a8508bf30 2023-09-21T13:00:34.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f39b809e180 con 0x555a8508bf30 2023-09-21T13:00:34.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 10 client.26693 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:34.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 10 client.26693 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:00:34.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 20 client.26693 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:34.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850fa170 0x555a850fc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 4 client.26693 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:34.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555a84fd5e60 con 0x555a850fa170 2023-09-21T13:00:34.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.142+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850fa170 0x555a850fc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39c2ffd700 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850fa170 0x555a850fc590 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d53b782011ac8476 server_cookie=9d2cd59160419d53 in_seq=0 out_seq=0 2023-09-21T13:00:34.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39a6ff5700 10 client.26693 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:34.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39a6ff5700 1 -- 172.21.15.142:0/1238556519 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555a84fd5e60 con 0x555a850fa170 2023-09-21T13:00:34.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39a6ff5700 10 client.26693 handle_command_reply: tid=0 2023-09-21T13:00:34.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 client.26693 shutdown 2023-09-21T13:00:34.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 msgr2=0x555a8509a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f39b80995a0 tx=0x7f39b8005d50 comp rx=0 tx=0).stop 2023-09-21T13:00:34.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 shutdown_connections 2023-09-21T13:00:34.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a8508b610 0x555a8509bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x555a850fa170 0x555a850fc590 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a85090360 0x555a8509aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39a6ff5700 0 client.26693 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:00:34.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 --2- 172.21.15.142:0/1238556519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a8508bf30 0x555a8509a4d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.143+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 >> 172.21.15.142:0/1238556519 conn(0x555a84fb8000 msgr2=0x555a85092750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 shutdown_connections 2023-09-21T13:00:34.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39dce56b80 1 -- 172.21.15.142:0/1238556519 wait complete. 2023-09-21T13:00:34.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39dce56b80 20 client.26693 trim_cache size 0 max 16384 2023-09-21T13:00:34.163 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:34.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 msgr2=0x7f39ac0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 0x7f39ac0a2cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f39b40098e0 tx=0x7f39b400b260 comp rx=0 tx=0).stop 2023-09-21T13:00:34.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 msgr2=0x7f39c4199650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 0x7f39c4199650 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f39b800e9f0 tx=0x7f39b800ed00 comp rx=0 tx=0).stop 2023-09-21T13:00:34.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 shutdown_connections 2023-09-21T13:00:34.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f39ac0a0830 0x7f39ac0a2cf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f39c410b360 0x7f39c419dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39c4101f40 0x7f39c4199110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 --2- 172.21.15.142:0/2422518591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f39c4102860 0x7f39c4199650 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.144+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 >> 172.21.15.142:0/2422518591 conn(0x7f39c40fb740 msgr2=0x7f39c410d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.145+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 shutdown_connections 2023-09-21T13:00:34.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.145+0000 7f39c95ff700 1 -- 172.21.15.142:0/2422518591 wait complete. 2023-09-21T13:00:34.167 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:00:34.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.385+0000 7fd686bff700 1 -- 172.21.15.142:0/3392933324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 msgr2=0x7fd68010dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.385+0000 7fd686bff700 1 --2- 172.21.15.142:0/3392933324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd68010dc60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd678009f90 tx=0x7fd67800b330 comp rx=0 tx=0).stop 2023-09-21T13:00:34.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 -- 172.21.15.142:0/3392933324 shutdown_connections 2023-09-21T13:00:34.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 --2- 172.21.15.142:0/3392933324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680100fc0 0x7fd6801013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 --2- 172.21.15.142:0/3392933324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd68010dc60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 --2- 172.21.15.142:0/3392933324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680101970 0x7fd6801059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 -- 172.21.15.142:0/3392933324 >> 172.21.15.142:0/3392933324 conn(0x7fd6800fc840 msgr2=0x7fd6800fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 -- 172.21.15.142:0/3392933324 shutdown_connections 2023-09-21T13:00:34.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.386+0000 7fd686bff700 1 -- 172.21.15.142:0/3392933324 wait complete. 2023-09-21T13:00:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 Processor -- start 2023-09-21T13:00:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 -- start start 2023-09-21T13:00:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd680073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 0x7fd6801a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801a5850 con 0x7fd680073b60 2023-09-21T13:00:34.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801a59c0 con 0x7fd680100fc0 2023-09-21T13:00:34.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.387+0000 7fd686bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801a5b80 con 0x7fd6801060e0 2023-09-21T13:00:34.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd680073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36212/0 (socket says 172.21.15.142:36212) 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 -- 172.21.15.142:0/955337684 learned_addr learned my addr 172.21.15.142:0/955337684 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68519c700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 0x7fd6801a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 -- 172.21.15.142:0/955337684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 msgr2=0x7fd680073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd680073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 -- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 msgr2=0x7fd6801a51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 0x7fd6801a51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 -- 172.21.15.142:0/955337684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd678009c40 con 0x7fd680100fc0 2023-09-21T13:00:34.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68519c700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 0x7fd6801a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:34.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd67ffff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd680073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd68499b700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e9a0 tx=0x7fd67400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd67dffb700 1 -- 172.21.15.142:0/955337684 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400eee0 con 0x7fd680100fc0 2023-09-21T13:00:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd67dffb700 1 -- 172.21.15.142:0/955337684 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd67400cbd0 con 0x7fd680100fc0 2023-09-21T13:00:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd67dffb700 1 -- 172.21.15.142:0/955337684 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674009790 con 0x7fd680100fc0 2023-09-21T13:00:34.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.388+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801a5e60 con 0x7fd680100fc0 2023-09-21T13:00:34.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.389+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801a6290 con 0x7fd680100fc0 2023-09-21T13:00:34.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.393+0000 7fd67dffb700 1 -- 172.21.15.142:0/955337684 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd67400cd40 con 0x7fd680100fc0 2023-09-21T13:00:34.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.394+0000 7fd69a4c5b80 1 Processor -- start 2023-09-21T13:00:34.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.394+0000 7fd67dffb700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 0x7fd6700a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.394+0000 7fd67dffb700 1 -- 172.21.15.142:0/955337684 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd674014070 con 0x7fd680100fc0 2023-09-21T13:00:34.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.394+0000 7fd69a4c5b80 1 -- start start 2023-09-21T13:00:34.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.394+0000 7fd68519c700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 0x7fd6700a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b129f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b16e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b177c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a86ca0 con 0x5607d5b12f30 2023-09-21T13:00:34.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a6ac70 con 0x5607d5b12610 2023-09-21T13:00:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a68590 con 0x5607d5b17360 2023-09-21T13:00:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd68519c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b177c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b129f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36228/0 (socket says 172.21.15.142:36228) 2023-09-21T13:00:34.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd68499b700 1 -- 172.21.15.142:0/1938450085 learned_addr learned my addr 172.21.15.142:0/1938450085 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd67ffff700 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b16e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.395+0000 7fd68519c700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 0x7fd6700a2c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd678009790 tx=0x7fd6780096c0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 -- 172.21.15.142:0/1938450085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 msgr2=0x5607d5b129f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b129f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 -- 172.21.15.142:0/1938450085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 msgr2=0x5607d5b16e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b16e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 -- 172.21.15.142:0/1938450085 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607d588ede0 con 0x5607d5b17360 2023-09-21T13:00:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd68519c700 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b177c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd67800b6c0 tx=0x7fd67801b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22340aa8047fb2f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd66affd700 1 -- 172.21.15.142:0/1938450085 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6780075e0 con 0x5607d5b17360 2023-09-21T13:00:34.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd66affd700 1 -- 172.21.15.142:0/1938450085 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd67800be50 con 0x5607d5b17360 2023-09-21T13:00:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.396+0000 7fd66affd700 1 -- 172.21.15.142:0/1938450085 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67801baf0 con 0x5607d5b17360 2023-09-21T13:00:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1938450085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 msgr2=0x5607d5b177c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b177c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd67800b6c0 tx=0x7fd67801b000 comp rx=0 tx=0).stop 2023-09-21T13:00:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1938450085 shutdown_connections 2023-09-21T13:00:34.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b177c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1938450085 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b16e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1938450085 >> 172.21.15.142:0/1938450085 conn(0x5607d5a3f000 msgr2=0x5607d5b0d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1938450085 shutdown_connections 2023-09-21T13:00:34.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.397+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1938450085 wait complete. 2023-09-21T13:00:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 -- start start 2023-09-21T13:00:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 Processor -- start 2023-09-21T13:00:34.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12f30 0x5607d5b1bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b17360 0x5607d5b1c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a63e80 con 0x5607d5b17360 2023-09-21T13:00:34.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a00740 con 0x5607d5b12610 2023-09-21T13:00:34.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5a003e0 con 0x5607d5b12f30 2023-09-21T13:00:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.398+0000 7fd69a4c5b80 10 client.0 _ll_register_callbacks cb 0x5607d594aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36244/0 (socket says 172.21.15.142:36244) 2023-09-21T13:00:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 -- 172.21.15.142:0/3273202956 learned_addr learned my addr 172.21.15.142:0/3273202956 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68519c700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b17360 0x5607d5b1c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd67ffff700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12f30 0x5607d5b1bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 -- 172.21.15.142:0/3273202956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12f30 msgr2=0x5607d5b1bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12f30 0x5607d5b1bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 -- 172.21.15.142:0/3273202956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b17360 msgr2=0x5607d5b1c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b17360 0x5607d5b1c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 -- 172.21.15.142:0/3273202956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68010e4d0 con 0x5607d5b12610 2023-09-21T13:00:34.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd68499b700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd674099380 tx=0x7fd674099e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50f3b5969c5fdaa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd65ffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:34.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674098d70 con 0x5607d5b12610 2023-09-21T13:00:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd67409d4b0 con 0x5607d5b12610 2023-09-21T13:00:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.399+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607d59d4bb0 con 0x5607d5b12610 2023-09-21T13:00:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6740a16f0 con 0x5607d5b12610 2023-09-21T13:00:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 10 client.26705 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:34.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5607d5877c60 con 0x5607d5b12610 2023-09-21T13:00:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd674063020 con 0x5607d5b12610 2023-09-21T13:00:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6740985e0 con 0x5607d5b12610 2023-09-21T13:00:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 10 client.26705 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 10 client.26705 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:34.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 20 client.26705 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:34.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b2c370 0x5607d5b2e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 4 client.26705 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:34.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607d5ae1020 con 0x5607d5b2c370 2023-09-21T13:00:34.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.400+0000 7fd67ffff700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b2c370 0x5607d5b2e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.401+0000 7fd65ffff700 10 client.26705 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.401+0000 7fd67ffff700 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b2c370 0x5607d5b2e790 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4b08fb1749413ee server_cookie=7f6cd76e87b5de0a in_seq=0 out_seq=0 2023-09-21T13:00:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.401+0000 7fd65ffff700 1 -- 172.21.15.142:0/3273202956 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607d5ae1020 con 0x5607d5b2c370 2023-09-21T13:00:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.401+0000 7fd65ffff700 10 client.26705 handle_command_reply: tid=0 2023-09-21T13:00:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.401+0000 7fd69a4c5b80 1 client.26705 shutdown 2023-09-21T13:00:34.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 msgr2=0x5607d5b1eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd674099380 tx=0x7fd674099e70 comp rx=0 tx=0).stop 2023-09-21T13:00:34.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 shutdown_connections 2023-09-21T13:00:34.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b2c370 0x5607d5b2e790 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b17360 0x5607d5b1c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12610 0x5607d5b1eb40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/3273202956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12f30 0x5607d5b1bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd65ffff700 0 client.26705 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:34.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 >> 172.21.15.142:0/3273202956 conn(0x5607d5a3f000 msgr2=0x5607d5b0d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 shutdown_connections 2023-09-21T13:00:34.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/3273202956 wait complete. 2023-09-21T13:00:34.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.402+0000 7fd69a4c5b80 20 client.26705 trim_cache size 0 max 16384 2023-09-21T13:00:34.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 Processor -- start 2023-09-21T13:00:34.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 -- start start 2023-09-21T13:00:34.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b27af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b17360 0x5607d5b1e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d58e4920 con 0x5607d5b12f30 2023-09-21T13:00:34.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5b136a0 con 0x5607d5b17360 2023-09-21T13:00:34.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.416+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5b19e50 con 0x5607d5b12610 2023-09-21T13:00:34.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b27af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39654/0 (socket says 172.21.15.142:39654) 2023-09-21T13:00:34.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 -- 172.21.15.142:0/1957000135 learned_addr learned my addr 172.21.15.142:0/1957000135 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68519c700 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b17360 0x5607d5b1e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 -- 172.21.15.142:0/1957000135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b17360 msgr2=0x5607d5b1e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b17360 0x5607d5b1e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 -- 172.21.15.142:0/1957000135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 msgr2=0x5607d5b27af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b27af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 -- 172.21.15.142:0/1957000135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68019afc0 con 0x5607d5b12610 2023-09-21T13:00:34.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd67ffff700 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b27af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:34.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.417+0000 7fd68499b700 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd6740c9f20 tx=0x7fd674010c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85661a71cf0f97a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd66b7fe700 1 -- 172.21.15.142:0/1957000135 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674099450 con 0x5607d5b12610 2023-09-21T13:00:34.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd66b7fe700 1 -- 172.21.15.142:0/1957000135 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd674063070 con 0x5607d5b12610 2023-09-21T13:00:34.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd66b7fe700 1 -- 172.21.15.142:0/1957000135 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6740987b0 con 0x5607d5b12610 2023-09-21T13:00:34.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1957000135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 msgr2=0x5607d5b14c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd6740c9f20 tx=0x7fd674010c70 comp rx=0 tx=0).stop 2023-09-21T13:00:34.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1957000135 shutdown_connections 2023-09-21T13:00:34.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b17360 0x5607d5b1e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b12610 0x5607d5b14c50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/1957000135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12f30 0x5607d5b27af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.418+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1957000135 >> 172.21.15.142:0/1957000135 conn(0x5607d5a3f000 msgr2=0x5607d5b15490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.419+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1957000135 shutdown_connections 2023-09-21T13:00:34.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.419+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/1957000135 wait complete. 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.419+0000 7fd69a4c5b80 1 -- start start 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.419+0000 7fd69a4c5b80 1 Processor -- start 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12610 0x5607d5b22fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5b21bd0 con 0x5607d5b12610 2023-09-21T13:00:34.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5b21d40 con 0x5607d5b12f30 2023-09-21T13:00:34.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5b21f00 con 0x5607d5b17360 2023-09-21T13:00:34.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd69a4c5b80 10 client.0 _ll_register_callbacks cb 0x5607d594aa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:34.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36272/0 (socket says 172.21.15.142:36272) 2023-09-21T13:00:34.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 -- 172.21.15.142:0/4168030623 learned_addr learned my addr 172.21.15.142:0/4168030623 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:34.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd68499b700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12610 0x5607d5b22fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd68519c700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 -- 172.21.15.142:0/4168030623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 msgr2=0x5607d5b214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 -- 172.21.15.142:0/4168030623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12610 msgr2=0x5607d5b22fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:34.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12610 0x5607d5b22fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.420+0000 7fd67ffff700 1 -- 172.21.15.142:0/4168030623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c012040 con 0x5607d5b12f30 2023-09-21T13:00:34.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd67ffff700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005d10 tx=0x7fd66c01e670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56bff38c4d1eabb2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:34.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd65ffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:34.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66c017030 con 0x5607d5b12f30 2023-09-21T13:00:34.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd67800be50 con 0x5607d5b12f30 2023-09-21T13:00:34.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fd66c01eb80 con 0x5607d5b12f30 2023-09-21T13:00:34.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd66c012ea0 con 0x5607d5b12f30 2023-09-21T13:00:34.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd69a4c5b80 10 client.26711 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:34.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5607d5877c60 con 0x5607d5b12f30 2023-09-21T13:00:34.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.421+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd67800be50 con 0x5607d5b12f30 2023-09-21T13:00:34.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd66c010430 con 0x5607d5b12f30 2023-09-21T13:00:34.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 10 client.26711 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:34.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 10 client.26711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:34.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 20 client.26711 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:34.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b813c0 0x5607d5b837e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:34.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 4 client.26711 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:00:34.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5607d5a5ce60 con 0x5607d5b813c0 2023-09-21T13:00:34.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd68499b700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b813c0 0x5607d5b837e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:34.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd68499b700 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b813c0 0x5607d5b837e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f065457dcfd95925 server_cookie=966ddc74b393feab in_seq=0 out_seq=0 2023-09-21T13:00:34.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.422+0000 7fd65ffff700 10 client.26711 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:34.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd65ffff700 1 -- 172.21.15.142:0/4168030623 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5607d5a5ce60 con 0x5607d5b813c0 2023-09-21T13:00:34.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd65ffff700 10 client.26711 handle_command_reply: tid=0 2023-09-21T13:00:34.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 client.26711 shutdown 2023-09-21T13:00:34.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 msgr2=0x5607d5b234e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd66c005d10 tx=0x7fd66c01e670 comp rx=0 tx=0).stop 2023-09-21T13:00:34.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 shutdown_connections 2023-09-21T13:00:34.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5607d5b813c0 0x5607d5b837e0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5607d5b12610 0x5607d5b22fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd65ffff700 0 client.26711 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:34.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5607d5b17360 0x5607d5b214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 --2- 172.21.15.142:0/4168030623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5607d5b12f30 0x5607d5b234e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.423+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 >> 172.21.15.142:0/4168030623 conn(0x5607d5a3f000 msgr2=0x5607d5b27af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 shutdown_connections 2023-09-21T13:00:34.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd69a4c5b80 1 -- 172.21.15.142:0/4168030623 wait complete. 2023-09-21T13:00:34.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd69a4c5b80 20 client.26711 trim_cache size 0 max 16384 2023-09-21T13:00:34.443 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:00:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 msgr2=0x7fd6700a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 0x7fd6700a2c70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd678009790 tx=0x7fd6780096c0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 msgr2=0x7fd6800730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:34.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd67400e9a0 tx=0x7fd67400ed60 comp rx=0 tx=0).stop 2023-09-21T13:00:34.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 shutdown_connections 2023-09-21T13:00:34.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6700a07b0 0x7fd6700a2c70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd680073b60 0x7fd6801a51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd680100fc0 0x7fd6800730e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 --2- 172.21.15.142:0/955337684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6801060e0 0x7fd680073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 >> 172.21.15.142:0/955337684 conn(0x7fd6800fc840 msgr2=0x7fd6800fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.424+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 shutdown_connections 2023-09-21T13:00:34.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:34.425+0000 7fd686bff700 1 -- 172.21.15.142:0/955337684 wait complete. 2023-09-21T13:00:34.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 397631 10.38 MB/sec execute 75 sec latency 30.981 ms 2023-09-21T13:00:34.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:34 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/705577728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:34.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:34 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/705577728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:34.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:34 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/705577728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:00:35.447 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T13:00:35.448 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T13:00:35.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 -- 172.21.15.142:0/2806166654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb848104ff0 msgr2=0x7fb84810cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/2806166654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb848104ff0 0x7fb84810cb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb840009f90 tx=0x7fb84000b330 comp rx=0 tx=0).stop 2023-09-21T13:00:35.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 -- 172.21.15.142:0/2806166654 shutdown_connections 2023-09-21T13:00:35.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/2806166654 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb848104ff0 0x7fb84810cb70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/2806166654 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8480ffed0 0x7fb8481002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/2806166654 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb848100880 0x7fb8481048c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 -- 172.21.15.142:0/2806166654 >> 172.21.15.142:0/2806166654 conn(0x7fb8480fb730 msgr2=0x7fb8480fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 -- 172.21.15.142:0/2806166654 shutdown_connections 2023-09-21T13:00:35.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.676+0000 7fb84f7ff700 1 -- 172.21.15.142:0/2806166654 wait complete. 2023-09-21T13:00:35.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.677+0000 7fb84f7ff700 1 Processor -- start 2023-09-21T13:00:35.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 -- start start 2023-09-21T13:00:35.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 0x7fb848196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb84819b800 0x7fb84819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819c280 con 0x7fb8480ffed0 2023-09-21T13:00:35.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819c3f0 con 0x7fb84819b800 2023-09-21T13:00:35.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84f7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84819c5b0 con 0x7fb848104ff0 2023-09-21T13:00:35.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 0x7fb848196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84cd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84cd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39692/0 (socket says 172.21.15.142:39692) 2023-09-21T13:00:35.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 0x7fb848196e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37440/0 (socket says 172.21.15.142:37440) 2023-09-21T13:00:35.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3091068794 learned_addr learned my addr 172.21.15.142:0/3091068794 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.678+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb84819b800 0x7fb84819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3091068794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb84819b800 msgr2=0x7fb84819bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb84819b800 0x7fb84819bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 msgr2=0x7fb848196e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 0x7fb848196e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3091068794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009c40 con 0x7fb848104ff0 2023-09-21T13:00:35.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d950 tx=0x7fb83800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb83e7fc700 1 -- 172.21.15.142:0/3091068794 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004220 con 0x7fb848104ff0 2023-09-21T13:00:35.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb83e7fc700 1 -- 172.21.15.142:0/3091068794 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb838007620 con 0x7fb848104ff0 2023-09-21T13:00:35.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb83e7fc700 1 -- 172.21.15.142:0/3091068794 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838005520 con 0x7fb848104ff0 2023-09-21T13:00:35.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8481018f0 con 0x7fb848104ff0 2023-09-21T13:00:35.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.679+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848101db0 con 0x7fb848104ff0 2023-09-21T13:00:35.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.683+0000 7fb83e7fc700 1 -- 172.21.15.142:0/3091068794 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fb838004750 con 0x7fb848104ff0 2023-09-21T13:00:35.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 399494 10.32 MB/sec execute 76 sec latency 23.065 ms 2023-09-21T13:00:35.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.685+0000 7fb83e7fc700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 0x7fb8340a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.685+0000 7fb86319fb80 1 Processor -- start 2023-09-21T13:00:35.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.685+0000 7fb83e7fc700 1 -- 172.21.15.142:0/3091068794 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb8380cbc60 con 0x7fb848104ff0 2023-09-21T13:00:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.685+0000 7fb86319fb80 1 -- start start 2023-09-21T13:00:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed33840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582feca2d20 con 0x5582fed333e0 2023-09-21T13:00:35.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fec86cf0 con 0x5582fed2efb0 2023-09-21T13:00:35.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb86319fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fec84610 con 0x5582fed2e690 2023-09-21T13:00:35.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 0x7fb8340a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed33840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed33840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37452/0 (socket says 172.21.15.142:37452) 2023-09-21T13:00:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84dd9c700 1 -- 172.21.15.142:0/3062229343 learned_addr learned my addr 172.21.15.142:0/3062229343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36300/0 (socket says 172.21.15.142:36300) 2023-09-21T13:00:35.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3062229343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 msgr2=0x5582fed2ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed2ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3062229343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 msgr2=0x5582fed33840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed33840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.686+0000 7fb84cd9a700 1 -- 172.21.15.142:0/3062229343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582feaaae60 con 0x5582fed2efb0 2023-09-21T13:00:35.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.687+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 0x7fb8340a2c70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb844005fd0 tx=0x7fb844010b90 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.687+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8380c9380 tx=0x7fb838098a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2514d15cdf278392 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.687+0000 7fb8337fe700 1 -- 172.21.15.142:0/3062229343 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380990e0 con 0x5582fed2efb0 2023-09-21T13:00:35.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.687+0000 7fb8337fe700 1 -- 172.21.15.142:0/3062229343 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb83809cf10 con 0x5582fed2efb0 2023-09-21T13:00:35.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.687+0000 7fb8337fe700 1 -- 172.21.15.142:0/3062229343 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380995a0 con 0x5582fed2efb0 2023-09-21T13:00:35.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- 172.21.15.142:0/3062229343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 msgr2=0x5582fed32ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb8380c9380 tx=0x7fb838098a40 comp rx=0 tx=0).stop 2023-09-21T13:00:35.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- 172.21.15.142:0/3062229343 shutdown_connections 2023-09-21T13:00:35.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed33840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3062229343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2efb0 0x5582fed32ea0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- 172.21.15.142:0/3062229343 >> 172.21.15.142:0/3062229343 conn(0x5582fec5b080 msgr2=0x5582fed29720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- 172.21.15.142:0/3062229343 shutdown_connections 2023-09-21T13:00:35.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- 172.21.15.142:0/3062229343 wait complete. 2023-09-21T13:00:35.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.688+0000 7fb86319fb80 1 -- start start 2023-09-21T13:00:35.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 Processor -- start 2023-09-21T13:00:35.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 0x5582fed38440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed38980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fec7ff00 con 0x5582fed2efb0 2023-09-21T13:00:35.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fec1c7c0 con 0x5582fed333e0 2023-09-21T13:00:35.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fec1c460 con 0x5582fed2e690 2023-09-21T13:00:35.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb86319fb80 10 client.0 _ll_register_callbacks cb 0x5582feb66b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:35.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb84cd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 0x5582fed38440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb84dd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed38980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed37f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39710/0 (socket says 172.21.15.142:39710) 2023-09-21T13:00:35.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.689+0000 7fb84d59b700 1 -- 172.21.15.142:0/3906204014 learned_addr learned my addr 172.21.15.142:0/3906204014 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 -- 172.21.15.142:0/3906204014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 msgr2=0x5582fed37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed37f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 -- 172.21.15.142:0/3906204014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 msgr2=0x5582fed38440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 0x5582fed38440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 -- 172.21.15.142:0/3906204014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848101db0 con 0x5582fed333e0 2023-09-21T13:00:35.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 0x5582fed38440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:35.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed38980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb840003d70 tx=0x7fb840003da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e00882a71d78966 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb830ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:35.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000e040 con 0x5582fed333e0 2023-09-21T13:00:35.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582febf0c30 con 0x5582fed333e0 2023-09-21T13:00:35.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.690+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb84000bbf0 con 0x5582fed333e0 2023-09-21T13:00:35.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84000bdb0 con 0x5582fed333e0 2023-09-21T13:00:35.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 10 client.26723 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:35.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5582fea93ce0 con 0x5582fed333e0 2023-09-21T13:00:35.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582febf0c30 con 0x5582fed333e0 2023-09-21T13:00:35.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb840019070 con 0x5582fed333e0 2023-09-21T13:00:35.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 10 client.26723 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:35.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 10 client.26723 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:35.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 20 client.26723 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:35.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582fed4a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 4 client.26723 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:35.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.691+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582fecfd0a0 con 0x5582fed484d0 2023-09-21T13:00:35.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.692+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582fed4a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.692+0000 7fb830ff9700 10 client.26723 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.692+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582fed4a8f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5719fac4f8d6abe3 server_cookie=cf0e99acd2df57e3 in_seq=0 out_seq=0 2023-09-21T13:00:35.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb830ff9700 1 -- 172.21.15.142:0/3906204014 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5582fecfd0a0 con 0x5582fed484d0 2023-09-21T13:00:35.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb830ff9700 10 client.26723 handle_command_reply: tid=0 2023-09-21T13:00:35.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 client.26723 shutdown 2023-09-21T13:00:35.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 msgr2=0x5582fed38980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed38980 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb840003d70 tx=0x7fb840003da0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 shutdown_connections 2023-09-21T13:00:35.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582fed4a8f0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb830ff9700 0 client.26723 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed38980 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2e690 0x5582fed37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3906204014 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2efb0 0x5582fed38440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 >> 172.21.15.142:0/3906204014 conn(0x5582fec5b080 msgr2=0x5582fed29310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 shutdown_connections 2023-09-21T13:00:35.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.693+0000 7fb86319fb80 1 -- 172.21.15.142:0/3906204014 wait complete. 2023-09-21T13:00:35.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.694+0000 7fb86319fb80 20 client.26723 trim_cache size 0 max 16384 2023-09-21T13:00:35.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 Processor -- start 2023-09-21T13:00:35.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 -- start start 2023-09-21T13:00:35.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed32d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed3f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582feb009a0 con 0x5582fed333e0 2023-09-21T13:00:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fecfd0a0 con 0x5582fed2e690 2023-09-21T13:00:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.713+0000 7fb86319fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fed2f390 con 0x5582fed2efb0 2023-09-21T13:00:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed3f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36310/0 (socket says 172.21.15.142:36310) 2023-09-21T13:00:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 -- 172.21.15.142:0/2103519445 learned_addr learned my addr 172.21.15.142:0/2103519445 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 -- 172.21.15.142:0/2103519445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 msgr2=0x5582fed32d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed32d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 -- 172.21.15.142:0/2103519445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 msgr2=0x5582fed3f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed3f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84d59b700 1 -- 172.21.15.142:0/2103519445 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582fead12d0 con 0x5582fed2e690 2023-09-21T13:00:35.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.714+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed3f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:35.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.715+0000 7fb84d59b700 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb84401e680 tx=0x7fb844025000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6395ba68e7ad0a19 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.715+0000 7fb833fff700 1 -- 172.21.15.142:0/2103519445 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844015040 con 0x5582fed2e690 2023-09-21T13:00:35.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.715+0000 7fb833fff700 1 -- 172.21.15.142:0/2103519445 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb844033070 con 0x5582fed2e690 2023-09-21T13:00:35.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.715+0000 7fb833fff700 1 -- 172.21.15.142:0/2103519445 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84402f3b0 con 0x5582fed2e690 2023-09-21T13:00:35.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- 172.21.15.142:0/2103519445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 msgr2=0x5582fed30cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb84401e680 tx=0x7fb844025000 comp rx=0 tx=0).stop 2023-09-21T13:00:35.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- 172.21.15.142:0/2103519445 shutdown_connections 2023-09-21T13:00:35.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed333e0 0x5582fed3f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed2e690 0x5582fed30cd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 --2- 172.21.15.142:0/2103519445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed32d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- 172.21.15.142:0/2103519445 >> 172.21.15.142:0/2103519445 conn(0x5582fec5b080 msgr2=0x5582fed2d490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- 172.21.15.142:0/2103519445 shutdown_connections 2023-09-21T13:00:35.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- 172.21.15.142:0/2103519445 wait complete. 2023-09-21T13:00:35.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.716+0000 7fb86319fb80 1 -- start start 2023-09-21T13:00:35.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 Processor -- start 2023-09-21T13:00:35.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed3f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed341a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fed348e0 con 0x5582fed2e690 2023-09-21T13:00:35.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fed34a50 con 0x5582fed333e0 2023-09-21T13:00:35.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582fed34c10 con 0x5582fed2efb0 2023-09-21T13:00:35.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb86319fb80 10 client.0 _ll_register_callbacks cb 0x5582feb66b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:35.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb84d59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:37474/0 (socket says 172.21.15.142:37474) 2023-09-21T13:00:35.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb84d59b700 1 -- 172.21.15.142:0/3160090546 learned_addr learned my addr 172.21.15.142:0/3160090546 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.717+0000 7fb84dd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 -- 172.21.15.142:0/3160090546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 msgr2=0x5582fed3f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed3f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 -- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 msgr2=0x5582fed341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 -- 172.21.15.142:0/3160090546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5582fea93ce0 con 0x5582fed2e690 2023-09-21T13:00:35.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84dd9c700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb84d59b700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb844012010 tx=0x7fb8440058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf5d59bb56269bb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb830ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb844015040 con 0x5582fed2e690 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb84402f3b0 con 0x5582fed2e690 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.718+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb83809cf10 con 0x5582fed2e690 2023-09-21T13:00:35.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84402f570 con 0x5582fed2e690 2023-09-21T13:00:35.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 10 client.16629 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:35.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7fb844029040 con 0x5582fed2e690 2023-09-21T13:00:35.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb84404d020 con 0x5582fed2e690 2023-09-21T13:00:35.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb844003680 con 0x5582fed2e690 2023-09-21T13:00:35.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 10 client.16629 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:35.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 10 client.16629 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:35.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 20 client.16629 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:35.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582feda05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 4 client.16629 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T13:00:35.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5582fec78ee0 con 0x5582fed484d0 2023-09-21T13:00:35.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.719+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582feda05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.720+0000 7fb830ff9700 10 client.16629 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.720+0000 7fb84cd9a700 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582feda05e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=488827a2a3a4ed78 server_cookie=cd55f19c557e4fda in_seq=0 out_seq=0 2023-09-21T13:00:35.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb830ff9700 1 -- 172.21.15.142:0/3160090546 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5582fec78ee0 con 0x5582fed484d0 2023-09-21T13:00:35.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb830ff9700 10 client.16629 handle_command_reply: tid=0 2023-09-21T13:00:35.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb86319fb80 1 client.16629 shutdown 2023-09-21T13:00:35.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 msgr2=0x5582fed3f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fb844012010 tx=0x7fb8440058e0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.721+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 shutdown_connections 2023-09-21T13:00:35.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5582fed484d0 0x5582feda05e0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5582fed2e690 0x5582fed3f1c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5582fed333e0 0x5582fed341a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb830ff9700 0 client.16629 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 --2- 172.21.15.142:0/3160090546 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5582fed2efb0 0x5582fed3f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 >> 172.21.15.142:0/3160090546 conn(0x5582fec5b080 msgr2=0x5582fed2dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 shutdown_connections 2023-09-21T13:00:35.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 1 -- 172.21.15.142:0/3160090546 wait complete. 2023-09-21T13:00:35.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb86319fb80 20 client.16629 trim_cache size 0 max 16384 2023-09-21T13:00:35.735 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:00:35.736 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T13:00:35.736 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "0701cc55-656b-4e91-aece-edf8552b5f10", 2023-09-21T13:00:35.736 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T13:00:35.736 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:00:35.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 msgr2=0x7fb8340a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 0x7fb8340a2c70 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb844005fd0 tx=0x7fb844010b90 comp rx=0 tx=0).stop 2023-09-21T13:00:35.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 msgr2=0x7fb8481973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.722+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb83800d950 tx=0x7fb83800dc60 comp rx=0 tx=0).stop 2023-09-21T13:00:35.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 shutdown_connections 2023-09-21T13:00:35.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb8340a07b0 0x7fb8340a2c70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8480ffed0 0x7fb848196e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb84819b800 0x7fb84819bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 --2- 172.21.15.142:0/3091068794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb848104ff0 0x7fb8481973a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 >> 172.21.15.142:0/3091068794 conn(0x7fb8480fb730 msgr2=0x7fb848068fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 shutdown_connections 2023-09-21T13:00:35.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.723+0000 7fb84f7ff700 1 -- 172.21.15.142:0/3091068794 wait complete. 2023-09-21T13:00:35.743 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:00:35.808 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:35 smithi142 ceph-mon[97663]: pgmap v133: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:35.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:35 smithi156 ceph-mon[134078]: pgmap v133: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:35.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:35 smithi160 ceph-mon[134450]: pgmap v133: 97 pgs: 97 active+clean; 97 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 273 op/s 2023-09-21T13:00:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 -- 172.21.15.142:0/443216215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c101970 msgr2=0x7fa58c1059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 --2- 172.21.15.142:0/443216215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c101970 0x7fa58c1059b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa57c0098f0 tx=0x7fa57c009c00 comp rx=0 tx=0).stop 2023-09-21T13:00:35.965 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 -- 172.21.15.142:0/443216215 shutdown_connections 2023-09-21T13:00:35.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 --2- 172.21.15.142:0/443216215 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c1060e0 0x7fa58c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 --2- 172.21.15.142:0/443216215 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c100fc0 0x7fa58c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 --2- 172.21.15.142:0/443216215 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c101970 0x7fa58c1059b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 -- 172.21.15.142:0/443216215 >> 172.21.15.142:0/443216215 conn(0x7fa58c0fc840 msgr2=0x7fa58c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 -- 172.21.15.142:0/443216215 shutdown_connections 2023-09-21T13:00:35.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.965+0000 7fa5937ff700 1 -- 172.21.15.142:0/443216215 wait complete. 2023-09-21T13:00:35.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.966+0000 7fa5937ff700 1 Processor -- start 2023-09-21T13:00:35.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.966+0000 7fa5937ff700 1 -- start start 2023-09-21T13:00:35.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 0x7fa58c197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 0x7fa58c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c19c370 con 0x7fa58c19b8f0 2023-09-21T13:00:35.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c19c4e0 con 0x7fa58c1060e0 2023-09-21T13:00:35.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa5937ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58c19c6a0 con 0x7fa58c100fc0 2023-09-21T13:00:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa590d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 0x7fa58c197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa591d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 0x7fa58c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39740/0 (socket says 172.21.15.142:39740) 2023-09-21T13:00:35.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa590d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 0x7fa58c197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36346/0 (socket says 172.21.15.142:36346) 2023-09-21T13:00:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 -- 172.21.15.142:0/245147433 learned_addr learned my addr 172.21.15.142:0/245147433 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 -- 172.21.15.142:0/245147433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 msgr2=0x7fa58c197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 0x7fa58c197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 -- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 msgr2=0x7fa58c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 0x7fa58c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa59159b700 1 -- 172.21.15.142:0/245147433 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880095f0 con 0x7fa58c100fc0 2023-09-21T13:00:35.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.967+0000 7fa591d9c700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 0x7fa58c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:35.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa59159b700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ec10 tx=0x7fa58800ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa5827fc700 1 -- 172.21.15.142:0/245147433 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58800cc90 con 0x7fa58c100fc0 2023-09-21T13:00:35.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa5827fc700 1 -- 172.21.15.142:0/245147433 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5880044e0 con 0x7fa58c100fc0 2023-09-21T13:00:35.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c009520 con 0x7fa58c100fc0 2023-09-21T13:00:35.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa5827fc700 1 -- 172.21.15.142:0/245147433 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588010430 con 0x7fa58c100fc0 2023-09-21T13:00:35.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.968+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c1a3f50 con 0x7fa58c100fc0 2023-09-21T13:00:35.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.971+0000 7fa5827fc700 1 -- 172.21.15.142:0/245147433 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa588003fb0 con 0x7fa58c100fc0 2023-09-21T13:00:35.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 Processor -- start 2023-09-21T13:00:35.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 -- start start 2023-09-21T13:00:35.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5827fc700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 0x7fa5780a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5827fc700 1 -- 172.21.15.142:0/245147433 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa588014070 con 0x7fa58c100fc0 2023-09-21T13:00:35.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa591d9c700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 0x7fa5780a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 0x55e7f3e15230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e15770 0x55e7f3e15bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3d80ca0 con 0x55e7f3e11340 2023-09-21T13:00:35.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3d64c70 con 0x55e7f3e10a20 2023-09-21T13:00:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.973+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3d62590 con 0x55e7f3e15770 2023-09-21T13:00:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36354/0 (socket says 172.21.15.142:36354) 2023-09-21T13:00:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 -- 172.21.15.142:0/4274145052 learned_addr learned my addr 172.21.15.142:0/4274145052 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa591d9c700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e15770 0x55e7f3e15bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 0x55e7f3e15230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 -- 172.21.15.142:0/4274145052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e15770 msgr2=0x55e7f3e15bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e15770 0x55e7f3e15bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 -- 172.21.15.142:0/4274145052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 msgr2=0x55e7f3e15230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 0x55e7f3e15230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 -- 172.21.15.142:0/4274145052 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f3b88de0 con 0x55e7f3e10a20 2023-09-21T13:00:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 0x55e7f3e15230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa591d9c700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 0x7fa5780a2c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa584004230 tx=0x7fa5840045f0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa59159b700 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa588005d70 tx=0x7fa588099550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2f1549fd83d39c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.974+0000 7fa5777fe700 1 -- 172.21.15.142:0/4274145052 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5880b9070 con 0x55e7f3e10a20 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5777fe700 1 -- 172.21.15.142:0/4274145052 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa58809a090 con 0x55e7f3e10a20 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5777fe700 1 -- 172.21.15.142:0/4274145052 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5880960a0 con 0x55e7f3e10a20 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4274145052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 msgr2=0x55e7f3e10e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa588005d70 tx=0x7fa588099550 comp rx=0 tx=0).stop 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4274145052 shutdown_connections 2023-09-21T13:00:35.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e15770 0x55e7f3e15bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e10e00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4274145052 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e11340 0x55e7f3e15230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4274145052 >> 172.21.15.142:0/4274145052 conn(0x55e7f3d39000 msgr2=0x55e7f3e076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4274145052 shutdown_connections 2023-09-21T13:00:35.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.975+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4274145052 wait complete. 2023-09-21T13:00:35.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.976+0000 7fa5a7027b80 1 -- start start 2023-09-21T13:00:35.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.976+0000 7fa5a7027b80 1 Processor -- start 2023-09-21T13:00:35.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e1a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e1ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3d5de80 con 0x55e7f3e15770 2023-09-21T13:00:35.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3cfa740 con 0x55e7f3e10a20 2023-09-21T13:00:35.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3cfa3e0 con 0x55e7f3e11340 2023-09-21T13:00:35.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa5a7027b80 10 client.0 _ll_register_callbacks cb 0x55e7f3c44a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:35.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa590d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa590d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39754/0 (socket says 172.21.15.142:39754) 2023-09-21T13:00:35.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa590d9a700 1 -- 172.21.15.142:0/75337798 learned_addr learned my addr 172.21.15.142:0/75337798 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:35.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa591d9c700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e1ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.977+0000 7fa59159b700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e1a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 -- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 msgr2=0x55e7f3e1a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e1a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 -- 172.21.15.142:0/75337798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 msgr2=0x55e7f3e1ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:35.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e1ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 -- 172.21.15.142:0/75337798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58c1a3f50 con 0x55e7f3e11340 2023-09-21T13:00:35.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa591d9c700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e1ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:35.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa590d9a700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa58c06a350 tx=0x7fa57c00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=270bb6dec7f7632a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:35.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa574ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:35.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c01c070 con 0x55e7f3e11340 2023-09-21T13:00:35.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7f3ccebb0 con 0x55e7f3e11340 2023-09-21T13:00:35.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa57c00b910 con 0x55e7f3e11340 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa57c00bad0 con 0x55e7f3e11340 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa5a7027b80 10 client.26698 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.978+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e7f3b71c60 con 0x55e7f3e11340 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7f3ccebb0 con 0x55e7f3e11340 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa57c015020 con 0x55e7f3e11340 2023-09-21T13:00:35.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 10 client.26698 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:35.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 10 client.26698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:35.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 20 client.26698 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:35.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e0eba0 0x55e7f3e0efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:35.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 4 client.26698 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:35.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7f3ddb020 con 0x55e7f3e0eba0 2023-09-21T13:00:35.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.979+0000 7fa59159b700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e0eba0 0x55e7f3e0efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:35.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa574ff9700 10 client.26698 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa59159b700 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e0eba0 0x55e7f3e0efb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdf5716e2201778c server_cookie=8ae10291495f168 in_seq=0 out_seq=0 2023-09-21T13:00:35.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa574ff9700 1 -- 172.21.15.142:0/75337798 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7f3ddb020 con 0x55e7f3e0eba0 2023-09-21T13:00:35.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa574ff9700 10 client.26698 handle_command_reply: tid=0 2023-09-21T13:00:35.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa5a7027b80 1 client.26698 shutdown 2023-09-21T13:00:35.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 msgr2=0x55e7f3e1a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:35.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.980+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa58c06a350 tx=0x7fa57c00f690 comp rx=0 tx=0).stop 2023-09-21T13:00:35.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 shutdown_connections 2023-09-21T13:00:35.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e0eba0 0x55e7f3e0efb0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e1ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e1a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa574ff9700 0 client.26698 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:35.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/75337798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e1a830 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:35.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 >> 172.21.15.142:0/75337798 conn(0x55e7f3d39000 msgr2=0x55e7f3e07290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:35.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 shutdown_connections 2023-09-21T13:00:35.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 1 -- 172.21.15.142:0/75337798 wait complete. 2023-09-21T13:00:35.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.981+0000 7fa5a7027b80 20 client.26698 trim_cache size 0 max 16384 2023-09-21T13:00:35.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 Processor -- start 2023-09-21T13:00:35.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 -- start start 2023-09-21T13:00:36.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e11340 0x55e7f3e2c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e10000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3bde920 con 0x55e7f3e15770 2023-09-21T13:00:36.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3e01c20 con 0x55e7f3e11340 2023-09-21T13:00:36.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:35.999+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3e11a80 con 0x55e7f3e10a20 2023-09-21T13:00:36.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39768/0 (socket says 172.21.15.142:39768) 2023-09-21T13:00:36.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 -- 172.21.15.142:0/2857885053 learned_addr learned my addr 172.21.15.142:0/2857885053 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:36.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa590d9a700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e11340 0x55e7f3e2c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa591d9c700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e10000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 -- 172.21.15.142:0/2857885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e11340 msgr2=0x55e7f3e2c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:36.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e11340 0x55e7f3e2c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 -- 172.21.15.142:0/2857885053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 msgr2=0x55e7f3e10000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e10000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 -- 172.21.15.142:0/2857885053 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7f3e060b0 con 0x55e7f3e10a20 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa591d9c700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e10000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa59159b700 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa588097ce0 tx=0x7fa5880b1f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4340c801973d29f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa577fff700 1 -- 172.21.15.142:0/2857885053 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588099990 con 0x55e7f3e10a20 2023-09-21T13:00:36.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa577fff700 1 -- 172.21.15.142:0/2857885053 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5880a1a00 con 0x55e7f3e10a20 2023-09-21T13:00:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.000+0000 7fa577fff700 1 -- 172.21.15.142:0/2857885053 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5880b7be0 con 0x55e7f3e10a20 2023-09-21T13:00:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 -- 172.21.15.142:0/2857885053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 msgr2=0x55e7f3e15150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa588097ce0 tx=0x7fa5880b1f90 comp rx=0 tx=0).stop 2023-09-21T13:00:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 -- 172.21.15.142:0/2857885053 shutdown_connections 2023-09-21T13:00:36.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e10000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e10a20 0x55e7f3e15150 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/2857885053 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e11340 0x55e7f3e2c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 -- 172.21.15.142:0/2857885053 >> 172.21.15.142:0/2857885053 conn(0x55e7f3d39000 msgr2=0x55e7f3e0f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:36.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 -- 172.21.15.142:0/2857885053 shutdown_connections 2023-09-21T13:00:36.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.001+0000 7fa5a7027b80 1 -- 172.21.15.142:0/2857885053 wait complete. 2023-09-21T13:00:36.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 -- start start 2023-09-21T13:00:36.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 Processor -- start 2023-09-21T13:00:36.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e29120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e29660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3e29ba0 con 0x55e7f3e15770 2023-09-21T13:00:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3e29d10 con 0x55e7f3e10a20 2023-09-21T13:00:36.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7f3e29ed0 con 0x55e7f3e11340 2023-09-21T13:00:36.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.002+0000 7fa5a7027b80 10 client.0 _ll_register_callbacks cb 0x55e7f3c44a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:36.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa59159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa59159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36372/0 (socket says 172.21.15.142:36372) 2023-09-21T13:00:36.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa59159b700 1 -- 172.21.15.142:0/4250293970 learned_addr learned my addr 172.21.15.142:0/4250293970 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:36.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e29120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa591d9c700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e29660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 -- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 msgr2=0x55e7f3e2be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:36.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 -- 172.21.15.142:0/4250293970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 msgr2=0x55e7f3e29660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:36.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e29660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 -- 172.21.15.142:0/4250293970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7f3b88de0 con 0x55e7f3e11340 2023-09-21T13:00:36.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa59159b700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:36.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa590d9a700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e29120 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a3a0 tx=0x7fa57c00f9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e450727da9db0d1b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:36.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa574ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:36.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa57c01c040 con 0x55e7f3e11340 2023-09-21T13:00:36.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.003+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa58809a090 con 0x55e7f3e11340 2023-09-21T13:00:36.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa57c00bb20 con 0x55e7f3e11340 2023-09-21T13:00:36.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa57c005920 con 0x55e7f3e11340 2023-09-21T13:00:36.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 10 client.26704 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:36.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e7f3baf250 con 0x55e7f3e11340 2023-09-21T13:00:36.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa58809a090 con 0x55e7f3e11340 2023-09-21T13:00:36.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa57c009c70 con 0x55e7f3e11340 2023-09-21T13:00:36.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 10 client.26704 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:36.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 10 client.26704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:36.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 20 client.26704 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:36.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e7b1f0 0x55e7f3e7d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:36.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 4 client.26704 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:00:36.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e7f3d56e60 con 0x55e7f3e7b1f0 2023-09-21T13:00:36.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.004+0000 7fa59159b700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e7b1f0 0x55e7f3e7d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:36.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa574ff9700 10 client.26704 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:36.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa59159b700 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e7b1f0 0x55e7f3e7d610 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba5e5cf128d93eab server_cookie=f88337357b322703 in_seq=0 out_seq=0 2023-09-21T13:00:36.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa574ff9700 1 -- 172.21.15.142:0/4250293970 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e7f3d56e60 con 0x55e7f3e7b1f0 2023-09-21T13:00:36.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa574ff9700 10 client.26704 handle_command_reply: tid=0 2023-09-21T13:00:36.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 client.26704 shutdown 2023-09-21T13:00:36.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 msgr2=0x55e7f3e29120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:36.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e29120 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa57c02a3a0 tx=0x7fa57c00f9e0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 shutdown_connections 2023-09-21T13:00:36.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7f3e7b1f0 0x55e7f3e7d610 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7f3e15770 0x55e7f3e29660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7f3e10a20 0x55e7f3e2be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 --2- 172.21.15.142:0/4250293970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7f3e11340 0x55e7f3e29120 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa574ff9700 0 client.26704 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:36.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.005+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 >> 172.21.15.142:0/4250293970 conn(0x55e7f3d39000 msgr2=0x55e7f3e100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:36.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 shutdown_connections 2023-09-21T13:00:36.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5a7027b80 1 -- 172.21.15.142:0/4250293970 wait complete. 2023-09-21T13:00:36.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5a7027b80 20 client.26704 trim_cache size 0 max 16384 2023-09-21T13:00:36.021 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:00:36.021 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T13:00:36.021 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:00:36.022 INFO:teuthology.orchestra.run.smithi142.stdout: "0701cc55-656b-4e91-aece-edf8552b5f10": { 2023-09-21T13:00:36.022 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:00:36.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "0701cc55-656b-4e91-aece-edf8552b5f10", 2023-09-21T13:00:36.022 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:00:36.022 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:00:36.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:00:36.023 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:00:36.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 msgr2=0x7fa5780a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:36.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 0x7fa5780a2c70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa584004230 tx=0x7fa5840045f0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 msgr2=0x7fa58c196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:36.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa58800ec10 tx=0x7fa58800ef20 comp rx=0 tx=0).stop 2023-09-21T13:00:36.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 shutdown_connections 2023-09-21T13:00:36.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5780a07b0 0x7fa5780a2c70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa58c19b8f0 0x7fa58c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa58c100fc0 0x7fa58c196f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 --2- 172.21.15.142:0/245147433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa58c1060e0 0x7fa58c197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:36.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 >> 172.21.15.142:0/245147433 conn(0x7fa58c0fc840 msgr2=0x7fa58c0fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:36.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 shutdown_connections 2023-09-21T13:00:36.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:00:36.006+0000 7fa5937ff700 1 -- 172.21.15.142:0/245147433 wait complete. 2023-09-21T13:00:36.027 INFO:tasks.cephfs.filesystem:scrub status for tag:0701cc55-656b-4e91-aece-edf8552b5f10 - {'path': '/', 'tag': '0701cc55-656b-4e91-aece-edf8552b5f10', 'options': 'recursive,force'} 2023-09-21T13:00:36.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 401285 10.36 MB/sec execute 77 sec latency 15.514 ms 2023-09-21T13:00:36.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T13:00:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:36.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:00:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:36 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T13:00:36.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:36.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:36.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:00:36.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:36 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T13:00:36.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:36.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:36.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:00:36.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:36.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:36 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:00:37.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 403313 10.32 MB/sec execute 78 sec latency 16.550 ms 2023-09-21T13:00:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:37 smithi156 ceph-mon[134078]: pgmap v134: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 376 op/s 2023-09-21T13:00:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:37 smithi142 ceph-mon[97663]: pgmap v134: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 376 op/s 2023-09-21T13:00:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:37 smithi160 ceph-mon[134450]: pgmap v134: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.1 MiB/s wr, 376 op/s 2023-09-21T13:00:38.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 404993 10.34 MB/sec execute 79 sec latency 23.597 ms 2023-09-21T13:00:39.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 407751 10.39 MB/sec execute 80 sec latency 17.983 ms 2023-09-21T13:00:39.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:39 smithi156 ceph-mon[134078]: pgmap v135: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 261 op/s 2023-09-21T13:00:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:39 smithi142 ceph-mon[97663]: pgmap v135: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 261 op/s 2023-09-21T13:00:39.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:39 smithi160 ceph-mon[134450]: pgmap v135: 97 pgs: 97 active+clean; 102 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.6 MiB/s wr, 261 op/s 2023-09-21T13:00:40.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 409018 10.35 MB/sec execute 81 sec latency 32.356 ms 2023-09-21T13:00:41.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 411719 10.43 MB/sec execute 82 sec latency 13.007 ms 2023-09-21T13:00:41.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:41 smithi156 ceph-mon[134078]: pgmap v136: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 373 op/s 2023-09-21T13:00:41.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:41 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:41 smithi142 ceph-mon[97663]: pgmap v136: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 373 op/s 2023-09-21T13:00:41.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:41 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:41 smithi160 ceph-mon[134450]: pgmap v136: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 373 op/s 2023-09-21T13:00:41.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:41 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:42.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 413021 10.37 MB/sec execute 83 sec latency 13.655 ms 2023-09-21T13:00:42.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:42 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:42.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:42 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:00:42.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:42 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:42.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:42 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:00:42.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:42 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:42.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:42 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:00:43.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 -- 172.21.15.142:0/331559392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc101980 msgr2=0x7f24dc1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 --2- 172.21.15.142:0/331559392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc101980 0x7f24dc1059c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009990 tx=0x7f24cc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 -- 172.21.15.142:0/331559392 shutdown_connections 2023-09-21T13:00:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 --2- 172.21.15.142:0/331559392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc100fd0 0x7f24dc1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 --2- 172.21.15.142:0/331559392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc1060f0 0x7f24dc10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 --2- 172.21.15.142:0/331559392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc101980 0x7f24dc1059c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 -- 172.21.15.142:0/331559392 >> 172.21.15.142:0/331559392 conn(0x7f24dc0fc830 msgr2=0x7f24dc0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 -- 172.21.15.142:0/331559392 shutdown_connections 2023-09-21T13:00:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.476+0000 7f24e3dff700 1 -- 172.21.15.142:0/331559392 wait complete. 2023-09-21T13:00:43.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.477+0000 7f24e3dff700 1 Processor -- start 2023-09-21T13:00:43.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.477+0000 7f24e3dff700 1 -- start start 2023-09-21T13:00:43.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc1060f0 0x7f24dc1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 0x7f24dc19e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc19e6c0 con 0x7f24dc1060f0 2023-09-21T13:00:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc19e830 con 0x7f24dc19dc40 2023-09-21T13:00:43.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e3dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24dc19e9f0 con 0x7f24dc100fd0 2023-09-21T13:00:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 0x7f24dc19e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39796/0 (socket says 172.21.15.142:39796) 2023-09-21T13:00:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e1b9b700 1 -- 172.21.15.142:0/2998059268 learned_addr learned my addr 172.21.15.142:0/2998059268 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:43.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.478+0000 7f24e139a700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc1060f0 0x7f24dc1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 -- 172.21.15.142:0/2998059268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 msgr2=0x7f24dc19e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 0x7f24dc19e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 -- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc1060f0 msgr2=0x7f24dc1995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc1060f0 0x7f24dc1995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 -- 172.21.15.142:0/2998059268 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8009520 con 0x7f24dc100fd0 2023-09-21T13:00:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e239c700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 0x7f24dc19e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24d800eb30 tx=0x7f24d800ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24d2ffd700 1 -- 172.21.15.142:0/2998059268 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8009880 con 0x7f24dc100fd0 2023-09-21T13:00:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24d2ffd700 1 -- 172.21.15.142:0/2998059268 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24d80044e0 con 0x7f24dc100fd0 2023-09-21T13:00:43.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24d2ffd700 1 -- 172.21.15.142:0/2998059268 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d8003d80 con 0x7f24dc100fd0 2023-09-21T13:00:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc0095f0 con 0x7f24dc100fd0 2023-09-21T13:00:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.479+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc107f20 con 0x7f24dc100fd0 2023-09-21T13:00:43.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.483+0000 7f24d2ffd700 1 -- 172.21.15.142:0/2998059268 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f24d8003f20 con 0x7f24dc100fd0 2023-09-21T13:00:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.484+0000 7f24f76a2b80 1 Processor -- start 2023-09-21T13:00:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.484+0000 7f24f76a2b80 1 -- start start 2023-09-21T13:00:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.484+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce600a0 0x562e5ce60480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce64e50 0x562e5ce652b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cdd4c40 con 0x562e5ce600a0 2023-09-21T13:00:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cdb8c10 con 0x562e5ce609c0 2023-09-21T13:00:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cdb6530 con 0x562e5ce64e50 2023-09-21T13:00:43.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e139a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce64e50 0x562e5ce652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36398/0 (socket says 172.21.15.142:36398) 2023-09-21T13:00:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3491806683 learned_addr learned my addr 172.21.15.142:0/3491806683 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e239c700 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce600a0 0x562e5ce60480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24d2ffd700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 0x7f24c80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24d2ffd700 1 -- 172.21.15.142:0/2998059268 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24d8014070 con 0x7f24dc100fd0 2023-09-21T13:00:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3491806683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce64e50 msgr2=0x562e5ce652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce64e50 0x562e5ce652b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3491806683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce600a0 msgr2=0x562e5ce60480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce600a0 0x562e5ce60480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e239c700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 0x7f24c80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.485+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3491806683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e5cbdcd80 con 0x562e5ce609c0 2023-09-21T13:00:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.486+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f24d8095e60 tx=0x7f24d8003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e49dcca0d55d2c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.486+0000 7f24c7fff700 1 -- 172.21.15.142:0/3491806683 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d80994a0 con 0x562e5ce609c0 2023-09-21T13:00:43.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.486+0000 7f24e239c700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 0x7f24c80a2cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24d40060b0 tx=0x7f24d4004b40 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.486+0000 7f24c7fff700 1 -- 172.21.15.142:0/3491806683 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24d80992c0 con 0x562e5ce609c0 2023-09-21T13:00:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.486+0000 7f24c7fff700 1 -- 172.21.15.142:0/3491806683 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d809d820 con 0x562e5ce609c0 2023-09-21T13:00:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3491806683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 msgr2=0x562e5ce64910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f24d8095e60 tx=0x7f24d8003680 comp rx=0 tx=0).stop 2023-09-21T13:00:43.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3491806683 shutdown_connections 2023-09-21T13:00:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce600a0 0x562e5ce60480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce64e50 0x562e5ce652b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3491806683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce64910 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3491806683 >> 172.21.15.142:0/3491806683 conn(0x562e5cd8cfa0 msgr2=0x562e5ce5b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3491806683 shutdown_connections 2023-09-21T13:00:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.487+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3491806683 wait complete. 2023-09-21T13:00:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 -- start start 2023-09-21T13:00:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 Processor -- start 2023-09-21T13:00:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce69eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cdb1e20 con 0x562e5ce64e50 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cd4e6e0 con 0x562e5ce609c0 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cd4e380 con 0x562e5ce600a0 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.488+0000 7f24f76a2b80 10 client.0 _ll_register_callbacks cb 0x562e5cc98a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:43.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39822/0 (socket says 172.21.15.142:39822) 2023-09-21T13:00:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36412/0 (socket says 172.21.15.142:36412) 2023-09-21T13:00:43.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3480037599 learned_addr learned my addr 172.21.15.142:0/3480037599 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e239c700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce69eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 msgr2=0x562e5ce69830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3480037599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 msgr2=0x562e5ce69eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce69eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3480037599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc107f20 con 0x562e5ce600a0 2023-09-21T13:00:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e139a700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e239c700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce69eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:43.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ca200 tx=0x7f24d8099860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f71d241857e8c832 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.489+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d809a060 con 0x562e5ce600a0 2023-09-21T13:00:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24d800cbd0 con 0x562e5ce600a0 2023-09-21T13:00:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e5cd22b50 con 0x562e5ce600a0 2023-09-21T13:00:43.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24d80a19d0 con 0x562e5ce600a0 2023-09-21T13:00:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 10 client.26716 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562e5cbc5c00 con 0x562e5ce600a0 2023-09-21T13:00:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e5cd22b50 con 0x562e5ce600a0 2023-09-21T13:00:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24d8098e50 con 0x562e5ce600a0 2023-09-21T13:00:43.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 10 client.26716 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 10 client.26716 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 20 client.26716 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5ce79be0 0x562e5ce7bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 4 client.26716 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:43.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.490+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e5ce2efc0 con 0x562e5ce79be0 2023-09-21T13:00:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.491+0000 7f24e139a700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5ce79be0 0x562e5ce7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.491+0000 7f24c57fa700 10 client.26716 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.491+0000 7f24e139a700 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5ce79be0 0x562e5ce7bfd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa685f1fcb04f51 server_cookie=e7497997f479ad51 in_seq=0 out_seq=0 2023-09-21T13:00:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24c57fa700 1 -- 172.21.15.142:0/3480037599 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e5ce2efc0 con 0x562e5ce79be0 2023-09-21T13:00:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24c57fa700 10 client.26716 handle_command_reply: tid=0 2023-09-21T13:00:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 client.26716 shutdown 2023-09-21T13:00:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 msgr2=0x562e5ce6c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f24d80ca200 tx=0x7f24d8099860 comp rx=0 tx=0).stop 2023-09-21T13:00:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 shutdown_connections 2023-09-21T13:00:43.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5ce79be0 0x562e5ce7bfd0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce69eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce600a0 0x562e5ce6c5b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3480037599 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce609c0 0x562e5ce69830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24c57fa700 0 client.26716 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 >> 172.21.15.142:0/3480037599 conn(0x562e5cd8cfa0 msgr2=0x562e5ce5a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 shutdown_connections 2023-09-21T13:00:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3480037599 wait complete. 2023-09-21T13:00:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.492+0000 7f24f76a2b80 20 client.26716 trim_cache size 0 max 16384 2023-09-21T13:00:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.508+0000 7f24f76a2b80 1 Processor -- start 2023-09-21T13:00:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.508+0000 7f24f76a2b80 1 -- start start 2023-09-21T13:00:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce67240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce67780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5cc328c0 con 0x562e5ce64e50 2023-09-21T13:00:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ce6ae10 con 0x562e5ce600a0 2023-09-21T13:00:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ce607f0 con 0x562e5ce609c0 2023-09-21T13:00:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36420/0 (socket says 172.21.15.142:36420) 2023-09-21T13:00:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce67240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3671322818 learned_addr learned my addr 172.21.15.142:0/3671322818 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e239c700 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce67780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 -- 172.21.15.142:0/3671322818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 msgr2=0x562e5ce6c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 -- 172.21.15.142:0/3671322818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 msgr2=0x562e5ce67780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce67780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.509+0000 7f24e139a700 1 -- 172.21.15.142:0/3671322818 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e5ce80b90 con 0x562e5ce609c0 2023-09-21T13:00:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24e139a700 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce67240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a65f9831029eea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24d0bff700 1 -- 172.21.15.142:0/3671322818 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc01d030 con 0x562e5ce609c0 2023-09-21T13:00:43.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24d0bff700 1 -- 172.21.15.142:0/3671322818 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24cc01e040 con 0x562e5ce609c0 2023-09-21T13:00:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24d0bff700 1 -- 172.21.15.142:0/3671322818 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00f6c0 con 0x562e5ce609c0 2023-09-21T13:00:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3671322818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 msgr2=0x562e5ce67240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.510+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce67240 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f24cc000c00 tx=0x7f24cc009310 comp rx=0 tx=0).stop 2023-09-21T13:00:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3671322818 shutdown_connections 2023-09-21T13:00:43.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5ce67780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3671322818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce67240 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3671322818 >> 172.21.15.142:0/3671322818 conn(0x562e5cd8cfa0 msgr2=0x562e5ce62ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3671322818 shutdown_connections 2023-09-21T13:00:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3671322818 wait complete. 2023-09-21T13:00:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 -- start start 2023-09-21T13:00:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.511+0000 7f24f76a2b80 1 Processor -- start 2023-09-21T13:00:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce6d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5cecc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ce6dd80 con 0x562e5ce64e50 2023-09-21T13:00:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ceccea0 con 0x562e5ce600a0 2023-09-21T13:00:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e5ceccfe0 con 0x562e5ce609c0 2023-09-21T13:00:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24f76a2b80 10 client.0 _ll_register_callbacks cb 0x562e5cc98a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e139a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce6d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e1b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36428/0 (socket says 172.21.15.142:36428) 2023-09-21T13:00:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e139a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce6d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39838/0 (socket says 172.21.15.142:39838) 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3767644198 learned_addr learned my addr 172.21.15.142:0/3767644198 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.512+0000 7f24e239c700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5cecc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3767644198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 msgr2=0x562e5ce6d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce6d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3767644198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 msgr2=0x562e5cecc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5cecc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 -- 172.21.15.142:0/3767644198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24dc10e4e0 con 0x562e5ce600a0 2023-09-21T13:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e239c700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5cecc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24e1b9b700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24d80998f0 tx=0x7f24d8095640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e18093cbfada5a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:43.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d800cbd0 con 0x562e5ce600a0 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24d80992c0 con 0x562e5ce600a0 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f24d809a060 con 0x562e5ce600a0 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24d80a19d0 con 0x562e5ce600a0 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24f76a2b80 10 client.26765 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:43.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x562e5cc031f0 con 0x562e5ce600a0 2023-09-21T13:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.513+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24d80992c0 con 0x562e5ce600a0 2023-09-21T13:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f24d8098e50 con 0x562e5ce600a0 2023-09-21T13:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 10 client.26765 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 10 client.26765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:43.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 20 client.26765 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5cece160 0x562e5ced0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 4 client.26765 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562e5cdaae00 con 0x562e5cece160 2023-09-21T13:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24e139a700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5cece160 0x562e5ced0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:43.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24c57fa700 10 client.26765 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:43.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.514+0000 7f24e139a700 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5cece160 0x562e5ced0550 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4147bdda94e6c5d server_cookie=195767170d04ed4b in_seq=0 out_seq=0 2023-09-21T13:00:43.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24c57fa700 1 -- 172.21.15.142:0/3767644198 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562e5cdaae00 con 0x562e5cece160 2023-09-21T13:00:43.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24c57fa700 10 client.26765 handle_command_reply: tid=0 2023-09-21T13:00:43.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 client.26765 shutdown 2023-09-21T13:00:43.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 msgr2=0x562e5ce6cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f24d80998f0 tx=0x7f24d8095640 comp rx=0 tx=0).stop 2023-09-21T13:00:43.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 shutdown_connections 2023-09-21T13:00:43.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562e5cece160 0x562e5ced0550 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.584+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562e5ce64e50 0x562e5cecc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562e5ce600a0 0x562e5ce6cf50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 1 --2- 172.21.15.142:0/3767644198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562e5ce609c0 0x562e5ce6d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24c57fa700 0 client.26765 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 >> 172.21.15.142:0/3767644198 conn(0x562e5cd8cfa0 msgr2=0x562e5ce67240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 shutdown_connections 2023-09-21T13:00:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 1 -- 172.21.15.142:0/3767644198 wait complete. 2023-09-21T13:00:43.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24f76a2b80 20 client.26765 trim_cache size 0 max 16384 2023-09-21T13:00:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:00:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:00:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:00:43.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:00:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 msgr2=0x7f24c80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 0x7f24c80a2cf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f24d40060b0 tx=0x7f24d4004b40 comp rx=0 tx=0).stop 2023-09-21T13:00:43.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 msgr2=0x7f24dc199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.585+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24d800eb30 tx=0x7f24d800ee40 comp rx=0 tx=0).stop 2023-09-21T13:00:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 shutdown_connections 2023-09-21T13:00:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24c80a0830 0x7f24c80a2cf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24dc19dc40 0x7f24dc19e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f24dc100fd0 0x7f24dc199090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 --2- 172.21.15.142:0/2998059268 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24dc1060f0 0x7f24dc1995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 >> 172.21.15.142:0/2998059268 conn(0x7f24dc0fc830 msgr2=0x7f24dc0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 shutdown_connections 2023-09-21T13:00:43.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:43.586+0000 7f24e3dff700 1 -- 172.21.15.142:0/2998059268 wait complete. 2023-09-21T13:00:43.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 415308 10.41 MB/sec execute 84 sec latency 45.401 ms 2023-09-21T13:00:43.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:43 smithi156 ceph-mon[134078]: pgmap v137: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:43.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:43 smithi142 ceph-mon[97663]: pgmap v137: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:43.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:43 smithi160 ceph-mon[134450]: pgmap v137: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:44.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 417007 10.35 MB/sec execute 85 sec latency 14.525 ms 2023-09-21T13:00:45.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 418966 10.39 MB/sec execute 86 sec latency 46.375 ms 2023-09-21T13:00:45.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:45 smithi156 ceph-mon[134078]: pgmap v138: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:45.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:45 smithi142 ceph-mon[97663]: pgmap v138: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:45.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:45 smithi160 ceph-mon[134450]: pgmap v138: 97 pgs: 97 active+clean; 109 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 215 op/s 2023-09-21T13:00:46.684 INFO:tasks.workunit.client.0.smithi142.stdout: 1 421061 10.36 MB/sec execute 87 sec latency 13.114 ms 2023-09-21T13:00:47.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 422842 10.37 MB/sec execute 88 sec latency 12.248 ms 2023-09-21T13:00:47.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:47 smithi156 ceph-mon[134078]: pgmap v139: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 378 op/s 2023-09-21T13:00:47.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:47 smithi142 ceph-mon[97663]: pgmap v139: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 378 op/s 2023-09-21T13:00:47.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:47 smithi160 ceph-mon[134450]: pgmap v139: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 378 op/s 2023-09-21T13:00:48.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 425467 10.42 MB/sec execute 89 sec latency 10.752 ms 2023-09-21T13:00:49.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 426852 10.38 MB/sec execute 90 sec latency 10.387 ms 2023-09-21T13:00:49.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:49 smithi156 ceph-mon[134078]: pgmap v140: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-21T13:00:49.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:49 smithi142 ceph-mon[97663]: pgmap v140: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-21T13:00:49.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:49 smithi160 ceph-mon[134450]: pgmap v140: 97 pgs: 97 active+clean; 106 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-21T13:00:50.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 429217 10.43 MB/sec execute 91 sec latency 103.306 ms 2023-09-21T13:00:51.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 430410 10.36 MB/sec execute 92 sec latency 19.819 ms 2023-09-21T13:00:51.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:51 smithi156 ceph-mon[134078]: pgmap v141: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 379 op/s 2023-09-21T13:00:51.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:51 smithi142 ceph-mon[97663]: pgmap v141: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 379 op/s 2023-09-21T13:00:51.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:51 smithi160 ceph-mon[134450]: pgmap v141: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.9 MiB/s wr, 379 op/s 2023-09-21T13:00:52.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 432987 10.43 MB/sec execute 93 sec latency 10.262 ms 2023-09-21T13:00:53.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 434289 10.37 MB/sec execute 94 sec latency 15.912 ms 2023-09-21T13:00:53.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:53 smithi156 ceph-mon[134078]: pgmap v142: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:53.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:53 smithi142 ceph-mon[97663]: pgmap v142: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:53.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:53 smithi160 ceph-mon[134450]: pgmap v142: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:54.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 436621 10.41 MB/sec execute 95 sec latency 13.725 ms 2023-09-21T13:00:55.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 438017 10.36 MB/sec execute 96 sec latency 48.269 ms 2023-09-21T13:00:55.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:55 smithi156 ceph-mon[134078]: pgmap v143: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:55.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:55 smithi142 ceph-mon[97663]: pgmap v143: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:55.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:55 smithi160 ceph-mon[134450]: pgmap v143: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 267 op/s 2023-09-21T13:00:56.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 440243 10.39 MB/sec execute 97 sec latency 14.320 ms 2023-09-21T13:00:56.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/7501130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f4100fd0 msgr2=0x7fe0f41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/7501130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f4100fd0 0x7fe0f41013b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009990 tx=0x7fe0e4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/7501130 shutdown_connections 2023-09-21T13:00:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/7501130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f41060f0 0x7fe0f410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/7501130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f4100fd0 0x7fe0f41013b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/7501130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f4101980 0x7fe0f41059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/7501130 >> 172.21.15.142:0/7501130 conn(0x7fe0f40fc830 msgr2=0x7fe0f40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/7501130 shutdown_connections 2023-09-21T13:00:56.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.742+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/7501130 wait complete. 2023-09-21T13:00:56.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.743+0000 7fe0fa9ff700 1 Processor -- start 2023-09-21T13:00:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 -- start start 2023-09-21T13:00:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f4100fd0 0x7fe0f40732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f41a2fe0 0x7fe0f41a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a5910 con 0x7fe0f4100fd0 2023-09-21T13:00:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a5a50 con 0x7fe0f41a2fe0 2023-09-21T13:00:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0fa9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f41a5bc0 con 0x7fe0f41060f0 2023-09-21T13:00:56.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f4100fd0 0x7fe0f40732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54520/0 (socket says 172.21.15.142:54520) 2023-09-21T13:00:56.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0ebfff700 1 -- 172.21.15.142:0/465670883 learned_addr learned my addr 172.21.15.142:0/465670883 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:56.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.744+0000 7fe0f8f9c700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f41a2fe0 0x7fe0f41a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 -- 172.21.15.142:0/465670883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f41a2fe0 msgr2=0x7fe0f41a53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f41a2fe0 0x7fe0f41a53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 -- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f4100fd0 msgr2=0x7fe0f40732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f4100fd0 0x7fe0f40732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 -- 172.21.15.142:0/465670883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc009520 con 0x7fe0f41060f0 2023-09-21T13:00:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00ea30 tx=0x7fe0dc00ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0f1ffb700 1 -- 172.21.15.142:0/465670883 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc009820 con 0x7fe0f41060f0 2023-09-21T13:00:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0f1ffb700 1 -- 172.21.15.142:0/465670883 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0dc0044e0 con 0x7fe0f41060f0 2023-09-21T13:00:56.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e40095f0 con 0x7fe0f41060f0 2023-09-21T13:00:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0f1ffb700 1 -- 172.21.15.142:0/465670883 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc003dc0 con 0x7fe0f41060f0 2023-09-21T13:00:56.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.745+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f41a61d0 con 0x7fe0f41060f0 2023-09-21T13:00:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.748+0000 7fe0f1ffb700 1 -- 172.21.15.142:0/465670883 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe0dc004000 con 0x7fe0f41060f0 2023-09-21T13:00:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.750+0000 7fe0f1ffb700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 0x7fe0e00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.750+0000 7fe0f1ffb700 1 -- 172.21.15.142:0/465670883 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe0dc014070 con 0x7fe0f41060f0 2023-09-21T13:00:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.750+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 0x7fe0e00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.750+0000 7fe10e2c0b80 1 Processor -- start 2023-09-21T13:00:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 -- start start 2023-09-21T13:00:56.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e305480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e279c40 con 0x563e4e3050a0 2023-09-21T13:00:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e25dc10 con 0x563e4e309e50 2023-09-21T13:00:56.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e25b530 con 0x563e4e3059c0 2023-09-21T13:00:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 0x7fe0e00a2c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b2e0 tx=0x7fe0e4005960 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38086/0 (socket says 172.21.15.142:38086) 2023-09-21T13:00:56.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54536/0 (socket says 172.21.15.142:54536) 2023-09-21T13:00:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e305480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.751+0000 7fe0ebfff700 1 -- 172.21.15.142:0/3609336613 learned_addr learned my addr 172.21.15.142:0/3609336613 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 -- 172.21.15.142:0/3609336613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 msgr2=0x563e4e30a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 -- 172.21.15.142:0/3609336613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 msgr2=0x563e4e305480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e305480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 -- 172.21.15.142:0/3609336613 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e4e081d80 con 0x563e4e3059c0 2023-09-21T13:00:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0a1340 tx=0x7fe0dc005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bae5554d610e045 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ea7fc700 1 -- 172.21.15.142:0/3609336613 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc099800 con 0x563e4e3059c0 2023-09-21T13:00:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ea7fc700 1 -- 172.21.15.142:0/3609336613 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0dc09d630 con 0x563e4e3059c0 2023-09-21T13:00:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.752+0000 7fe0ea7fc700 1 -- 172.21.15.142:0/3609336613 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc095f10 con 0x563e4e3059c0 2023-09-21T13:00:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/3609336613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 msgr2=0x563e4e309910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0a1340 tx=0x7fe0dc005760 comp rx=0 tx=0).stop 2023-09-21T13:00:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/3609336613 shutdown_connections 2023-09-21T13:00:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e305480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/3609336613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e309910 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/3609336613 >> 172.21.15.142:0/3609336613 conn(0x563e4e231fa0 msgr2=0x563e4e3000c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/3609336613 shutdown_connections 2023-09-21T13:00:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.753+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/3609336613 wait complete. 2023-09-21T13:00:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.754+0000 7fe10e2c0b80 1 -- start start 2023-09-21T13:00:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.754+0000 7fe10e2c0b80 1 Processor -- start 2023-09-21T13:00:56.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.754+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.754+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3059c0 0x563e4e30e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e256e20 con 0x563e4e3059c0 2023-09-21T13:00:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e1f36e0 con 0x563e4e309e50 2023-09-21T13:00:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e1f3380 con 0x563e4e3050a0 2023-09-21T13:00:56.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe10e2c0b80 10 client.0 _ll_register_callbacks cb 0x563e4e13da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54540/0 (socket says 172.21.15.142:54540) 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 -- 172.21.15.142:0/2810908113 learned_addr learned my addr 172.21.15.142:0/2810908113 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3059c0 0x563e4e30e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f8f9c700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 -- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 msgr2=0x563e4e30f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 -- 172.21.15.142:0/2810908113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3059c0 msgr2=0x563e4e30e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3059c0 0x563e4e30e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 -- 172.21.15.142:0/2810908113 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f41a61d0 con 0x563e4e3050a0 2023-09-21T13:00:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009990 tx=0x7fe0e4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ee76aa53a94cf9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.755+0000 7fe0d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4004e70 con 0x563e4e3050a0 2023-09-21T13:00:56.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe0e400f460 con 0x563e4e3050a0 2023-09-21T13:00:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563e4e1c7b50 con 0x563e4e3050a0 2023-09-21T13:00:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0e400f660 con 0x563e4e3050a0 2023-09-21T13:00:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe10e2c0b80 10 client.26734 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563e4e06ac00 con 0x563e4e3050a0 2023-09-21T13:00:56.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0e403d020 con 0x563e4e3050a0 2023-09-21T13:00:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.756+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe0e40399d0 con 0x563e4e3050a0 2023-09-21T13:00:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 10 client.26734 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 10 client.26734 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 20 client.26734 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:56.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e31efe0 0x563e4e321400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 4 client.26734 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:00:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563e4e2d3fc0 con 0x563e4e31efe0 2023-09-21T13:00:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e31efe0 0x563e4e321400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe0d37fe700 10 client.26734 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.757+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e31efe0 0x563e4e321400 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d580ff34b9ef91c server_cookie=494c9768619f8f7e in_seq=0 out_seq=0 2023-09-21T13:00:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe0d37fe700 1 -- 172.21.15.142:0/2810908113 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563e4e2d3fc0 con 0x563e4e31efe0 2023-09-21T13:00:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe0d37fe700 10 client.26734 handle_command_reply: tid=0 2023-09-21T13:00:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 client.26734 shutdown 2023-09-21T13:00:56.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 msgr2=0x563e4e311650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009990 tx=0x7fe0e4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 shutdown_connections 2023-09-21T13:00:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e31efe0 0x563e4e321400 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e30f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.758+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3050a0 0x563e4e311650 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/2810908113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3059c0 0x563e4e30e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe0d37fe700 0 client.26734 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 >> 172.21.15.142:0/2810908113 conn(0x563e4e231fa0 msgr2=0x563e4e2ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 shutdown_connections 2023-09-21T13:00:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/2810908113 wait complete. 2023-09-21T13:00:56.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.759+0000 7fe10e2c0b80 20 client.26734 trim_cache size 0 max 16384 2023-09-21T13:00:56.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.775+0000 7fe10e2c0b80 1 Processor -- start 2023-09-21T13:00:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.775+0000 7fe10e2c0b80 1 -- start start 2023-09-21T13:00:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e316030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e309e50 0x563e4e30e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e0d78c0 con 0x563e4e309e50 2023-09-21T13:00:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e31ba00 con 0x563e4e3050a0 2023-09-21T13:00:56.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e305e20 con 0x563e4e3059c0 2023-09-21T13:00:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38100/0 (socket says 172.21.15.142:38100) 2023-09-21T13:00:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e316030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 -- 172.21.15.142:0/728330443 learned_addr learned my addr 172.21.15.142:0/728330443 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f8f9c700 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e309e50 0x563e4e30e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 -- 172.21.15.142:0/728330443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 msgr2=0x563e4e316030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e316030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 -- 172.21.15.142:0/728330443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e309e50 msgr2=0x563e4e30e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e309e50 0x563e4e30e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0f3fff700 1 -- 172.21.15.142:0/728330443 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e4e0a81f0 con 0x563e4e3050a0 2023-09-21T13:00:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.776+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e316030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:56.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.777+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006010 tx=0x7fe0e4005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39047626c3c0da0f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.777+0000 7fe0eaffd700 1 -- 172.21.15.142:0/728330443 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4004d70 con 0x563e4e3050a0 2023-09-21T13:00:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.777+0000 7fe0eaffd700 1 -- 172.21.15.142:0/728330443 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0e403d070 con 0x563e4e3050a0 2023-09-21T13:00:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.777+0000 7fe0eaffd700 1 -- 172.21.15.142:0/728330443 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e402f910 con 0x563e4e3050a0 2023-09-21T13:00:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/728330443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 msgr2=0x563e4e307740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006010 tx=0x7fe0e4005f00 comp rx=0 tx=0).stop 2023-09-21T13:00:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/728330443 shutdown_connections 2023-09-21T13:00:56.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e309e50 0x563e4e30e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e3050a0 0x563e4e307740 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/728330443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e316030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/728330443 >> 172.21.15.142:0/728330443 conn(0x563e4e231fa0 msgr2=0x563e4e307f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/728330443 shutdown_connections 2023-09-21T13:00:56.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/728330443 wait complete. 2023-09-21T13:00:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.778+0000 7fe10e2c0b80 1 -- start start 2023-09-21T13:00:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 Processor -- start 2023-09-21T13:00:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e3115d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e3101e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e310e30 con 0x563e4e3050a0 2023-09-21T13:00:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e310fa0 con 0x563e4e309e50 2023-09-21T13:00:56.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e4e372e10 con 0x563e4e3059c0 2023-09-21T13:00:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe10e2c0b80 10 client.0 _ll_register_callbacks cb 0x563e4e13da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:00:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe0f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe0f8f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38116/0 (socket says 172.21.15.142:38116) 2023-09-21T13:00:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe0ebfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e3101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e3115d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.779+0000 7fe0f8f9c700 1 -- 172.21.15.142:0/1103450873 learned_addr learned my addr 172.21.15.142:0/1103450873 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:00:56.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 -- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 msgr2=0x563e4e310720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 -- 172.21.15.142:0/1103450873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 msgr2=0x563e4e3115d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:00:56.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e3115d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 -- 172.21.15.142:0/1103450873 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e4e081d80 con 0x563e4e3059c0 2023-09-21T13:00:56.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0f8f9c700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e3115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:00:56.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0ebfff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e3101e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009fd0 tx=0x7fe0dc095c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8cc2f84675a5b24 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:00:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0d37fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:00:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc063070 con 0x563e4e3059c0 2023-09-21T13:00:56.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe0dc09d630 con 0x563e4e3059c0 2023-09-21T13:00:56.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe0dc099800 con 0x563e4e3059c0 2023-09-21T13:00:56.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0dc00cdd0 con 0x563e4e3059c0 2023-09-21T13:00:56.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe10e2c0b80 10 client.26740 fetch_fsmap learned FSMap version 26 2023-09-21T13:00:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.780+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x563e4e06ac00 con 0x563e4e3059c0 2023-09-21T13:00:56.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe0dc09d630 con 0x563e4e3059c0 2023-09-21T13:00:56.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe0dc01f060 con 0x563e4e3059c0 2023-09-21T13:00:56.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 10 client.26740 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:00:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 10 client.26740 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:00:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 20 client.26740 populate_metadata read hostname 'smithi142' 2023-09-21T13:00:56.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e373fb0 0x563e4e3763a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:00:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 4 client.26740 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:00:56.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563e4e24fe00 con 0x563e4e373fb0 2023-09-21T13:00:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.781+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e373fb0 0x563e4e3763a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:00:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.782+0000 7fe0f3fff700 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e373fb0 0x563e4e3763a0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4311a97fecd888bf server_cookie=bc2c074cec795177 in_seq=0 out_seq=0 2023-09-21T13:00:56.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.782+0000 7fe0d37fe700 10 client.26740 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:56.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe0d37fe700 1 -- 172.21.15.142:0/1103450873 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563e4e24fe00 con 0x563e4e373fb0 2023-09-21T13:00:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe0d37fe700 10 client.26740 handle_command_reply: tid=0 2023-09-21T13:00:56.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 client.26740 shutdown 2023-09-21T13:00:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 msgr2=0x563e4e3101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e3101e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009fd0 tx=0x7fe0dc095c70 comp rx=0 tx=0).stop 2023-09-21T13:00:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 shutdown_connections 2023-09-21T13:00:56.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563e4e373fb0 0x563e4e3763a0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.848+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563e4e3050a0 0x563e4e3115d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe0d37fe700 0 client.26740 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:00:56.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563e4e309e50 0x563e4e310720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 1 --2- 172.21.15.142:0/1103450873 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563e4e3059c0 0x563e4e3101e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 >> 172.21.15.142:0/1103450873 conn(0x563e4e231fa0 msgr2=0x563e4e308ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 shutdown_connections 2023-09-21T13:00:56.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 1 -- 172.21.15.142:0/1103450873 wait complete. 2023-09-21T13:00:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.849+0000 7fe10e2c0b80 20 client.26740 trim_cache size 0 max 16384 2023-09-21T13:00:56.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:00:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:00:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:00:56.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:00:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 msgr2=0x7fe0e00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 0x7fe0e00a2c70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400b2e0 tx=0x7fe0e4005960 comp rx=0 tx=0).stop 2023-09-21T13:00:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 msgr2=0x7fe0f4073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:00:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc00ea30 tx=0x7fe0dc00ed40 comp rx=0 tx=0).stop 2023-09-21T13:00:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 shutdown_connections 2023-09-21T13:00:56.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe0e00a07b0 0x7fe0e00a2c70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe0f4100fd0 0x7fe0f40732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe0f41a2fe0 0x7fe0f41a53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 --2- 172.21.15.142:0/465670883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0f41060f0 0x7fe0f4073800 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:00:56.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 >> 172.21.15.142:0/465670883 conn(0x7fe0f40fc830 msgr2=0x7fe0f40fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:00:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 shutdown_connections 2023-09-21T13:00:56.860 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:00:56.850+0000 7fe0fa9ff700 1 -- 172.21.15.142:0/465670883 wait complete. 2023-09-21T13:00:57.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 441833 10.34 MB/sec execute 98 sec latency 49.424 ms 2023-09-21T13:00:57.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:57 smithi156 ceph-mon[134078]: pgmap v144: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 380 op/s 2023-09-21T13:00:57.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:57 smithi142 ceph-mon[97663]: pgmap v144: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 380 op/s 2023-09-21T13:00:57.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:57 smithi160 ceph-mon[134450]: pgmap v144: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.3 MiB/s wr, 380 op/s 2023-09-21T13:00:58.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 443867 10.38 MB/sec execute 99 sec latency 11.389 ms 2023-09-21T13:00:59.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 446166 10.38 MB/sec execute 100 sec latency 19.717 ms 2023-09-21T13:00:59.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:00:59 smithi156 ceph-mon[134078]: pgmap v145: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2023-09-21T13:00:59.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:00:59 smithi142 ceph-mon[97663]: pgmap v145: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2023-09-21T13:00:59.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:00:59 smithi160 ceph-mon[134450]: pgmap v145: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.9 MiB/s wr, 217 op/s 2023-09-21T13:01:00.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 447566 10.36 MB/sec execute 101 sec latency 41.291 ms 2023-09-21T13:01:01.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 449146 10.32 MB/sec execute 102 sec latency 36.786 ms 2023-09-21T13:01:01.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:01 smithi156 ceph-mon[134078]: pgmap v146: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 380 op/s 2023-09-21T13:01:01.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:01 smithi142 ceph-mon[97663]: pgmap v146: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 380 op/s 2023-09-21T13:01:01.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:01 smithi160 ceph-mon[134450]: pgmap v146: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 4.1 MiB/s wr, 380 op/s 2023-09-21T13:01:02.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 450951 10.35 MB/sec execute 103 sec latency 11.459 ms 2023-09-21T13:01:03.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 453242 10.35 MB/sec execute 104 sec latency 11.581 ms 2023-09-21T13:01:03.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:03 smithi156 ceph-mon[134078]: pgmap v147: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:03.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:03 smithi142 ceph-mon[97663]: pgmap v147: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:03.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:03 smithi160 ceph-mon[134450]: pgmap v147: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:04.685 INFO:tasks.workunit.client.0.smithi142.stdout: 1 454860 10.34 MB/sec execute 105 sec latency 10.733 ms 2023-09-21T13:01:05.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 457414 10.37 MB/sec execute 106 sec latency 57.327 ms 2023-09-21T13:01:05.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:05 smithi156 ceph-mon[134078]: pgmap v148: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:05.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:05 smithi142 ceph-mon[97663]: pgmap v148: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:05.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:05 smithi160 ceph-mon[134450]: pgmap v148: 97 pgs: 97 active+clean; 121 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 276 op/s 2023-09-21T13:01:06.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:01:06.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 -- 172.21.15.142:0/3427434363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c4100e40 msgr2=0x7fc4c4101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/3427434363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c4100e40 0x7fc4c4101220 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009990 tx=0x7fc4b4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 -- 172.21.15.142:0/3427434363 shutdown_connections 2023-09-21T13:01:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/3427434363 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/3427434363 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c4100e40 0x7fc4c4101220 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/3427434363 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c41017f0 0x7fc4c4105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 -- 172.21.15.142:0/3427434363 >> 172.21.15.142:0/3427434363 conn(0x7fc4c40fc6a0 msgr2=0x7fc4c40feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 -- 172.21.15.142:0/3427434363 shutdown_connections 2023-09-21T13:01:06.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.278+0000 7fc4c3fff700 1 -- 172.21.15.142:0/3427434363 wait complete. 2023-09-21T13:01:06.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.279+0000 7fc4c3fff700 1 Processor -- start 2023-09-21T13:01:06.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.279+0000 7fc4c3fff700 1 -- start start 2023-09-21T13:01:06.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.279+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c4100e40 0x7fc4c4198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.279+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c419d810 0x7fc4c419dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c3fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c419e290 con 0x7fc4c4100e40 2023-09-21T13:01:06.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c3fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c419e400 con 0x7fc4c419d810 2023-09-21T13:01:06.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c3fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c419e5c0 con 0x7fc4c4105f60 2023-09-21T13:01:06.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c4100e40 0x7fc4c4198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60202/0 (socket says 172.21.15.142:60202) 2023-09-21T13:01:06.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 -- 172.21.15.142:0/1767086220 learned_addr learned my addr 172.21.15.142:0/1767086220 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c419d810 0x7fc4c419dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 -- 172.21.15.142:0/1767086220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c419d810 msgr2=0x7fc4c419dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c419d810 0x7fc4c419dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 -- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c4100e40 msgr2=0x7fc4c4198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c4100e40 0x7fc4c4198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 -- 172.21.15.142:0/1767086220 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b40095f0 con 0x7fc4c4105f60 2023-09-21T13:01:06.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.280+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e970 tx=0x7fc4b800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.281+0000 7fc4c89fd700 1 -- 172.21.15.142:0/1767086220 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8009790 con 0x7fc4c4105f60 2023-09-21T13:01:06.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.281+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c41a5b20 con 0x7fc4c4105f60 2023-09-21T13:01:06.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.281+0000 7fc4c89fd700 1 -- 172.21.15.142:0/1767086220 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4b800c7e0 con 0x7fc4c4105f60 2023-09-21T13:01:06.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.281+0000 7fc4c89fd700 1 -- 172.21.15.142:0/1767086220 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80054e0 con 0x7fc4c4105f60 2023-09-21T13:01:06.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.281+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c41a6050 con 0x7fc4c4105f60 2023-09-21T13:01:06.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.284+0000 7fc4c89fd700 1 -- 172.21.15.142:0/1767086220 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc4b800c950 con 0x7fc4c4105f60 2023-09-21T13:01:06.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.285+0000 7fc4dd2f0b80 1 Processor -- start 2023-09-21T13:01:06.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 -- start start 2023-09-21T13:01:06.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c527a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c4c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4c89fd700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 0x7fc4ac0a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7bc0ca0 con 0x560fe7c52ce0 2023-09-21T13:01:06.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7ba4c70 con 0x560fe7c523c0 2023-09-21T13:01:06.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7ba2590 con 0x560fe7c4cbb0 2023-09-21T13:01:06.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.286+0000 7fc4c89fd700 1 -- 172.21.15.142:0/1767086220 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc4b8014070 con 0x7fc4c4105f60 2023-09-21T13:01:06.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 0x7fc4ac0a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60206/0 (socket says 172.21.15.142:60206) 2023-09-21T13:01:06.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 -- 172.21.15.142:0/1947200677 learned_addr learned my addr 172.21.15.142:0/1947200677 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c4c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 -- 172.21.15.142:0/1947200677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 msgr2=0x560fe7c527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 -- 172.21.15.142:0/1947200677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 msgr2=0x560fe7c4c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c4c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 -- 172.21.15.142:0/1947200677 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe79c8de0 con 0x560fe7c4cbb0 2023-09-21T13:01:06.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc008cd0 tx=0x7fc4bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47f49ce6f90cad server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.287+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 0x7fc4ac0a2d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b2e0 tx=0x7fc4b4005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4a9ffb700 1 -- 172.21.15.142:0/1947200677 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc00e050 con 0x560fe7c4cbb0 2023-09-21T13:01:06.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4a9ffb700 1 -- 172.21.15.142:0/1947200677 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4bc00f040 con 0x560fe7c4cbb0 2023-09-21T13:01:06.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4a9ffb700 1 -- 172.21.15.142:0/1947200677 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc004280 con 0x560fe7c4cbb0 2023-09-21T13:01:06.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/1947200677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 msgr2=0x560fe7c4d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc008cd0 tx=0x7fc4bc009920 comp rx=0 tx=0).stop 2023-09-21T13:01:06.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/1947200677 shutdown_connections 2023-09-21T13:01:06.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4d030 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/1947200677 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c4c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/1947200677 >> 172.21.15.142:0/1947200677 conn(0x560fe7b79000 msgr2=0x560fe7c47650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.288+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/1947200677 shutdown_connections 2023-09-21T13:01:06.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.289+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/1947200677 wait complete. 2023-09-21T13:01:06.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.289+0000 7fc4dd2f0b80 1 -- start start 2023-09-21T13:01:06.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.289+0000 7fc4dd2f0b80 1 Processor -- start 2023-09-21T13:01:06.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 0x560fe7c55f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7b9de80 con 0x560fe7c4cbb0 2023-09-21T13:01:06.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7b3a740 con 0x560fe7c52ce0 2023-09-21T13:01:06.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7b3a3e0 con 0x560fe7c523c0 2023-09-21T13:01:06.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4dd2f0b80 10 client.0 _ll_register_callbacks cb 0x560fe7a84a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:06.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60222/0 (socket says 172.21.15.142:60222) 2023-09-21T13:01:06.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 -- 172.21.15.142:0/3412119587 learned_addr learned my addr 172.21.15.142:0/3412119587 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58592/0 (socket says 172.21.15.142:58592) 2023-09-21T13:01:06.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 0x560fe7c55f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 -- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 msgr2=0x560fe7c569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 -- 172.21.15.142:0/3412119587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 msgr2=0x560fe7c55f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 0x560fe7c55f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c27fc700 1 -- 172.21.15.142:0/3412119587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0089b0 con 0x560fe7c523c0 2023-09-21T13:01:06.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.290+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:06.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 0x560fe7c55f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:06.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800cc00 tx=0x7fc4b8004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb29c816fb7b6f6a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:06.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b800cc50 con 0x560fe7c523c0 2023-09-21T13:01:06.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fe7b0ebb0 con 0x560fe7c523c0 2023-09-21T13:01:06.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc4b8099d60 con 0x560fe7c523c0 2023-09-21T13:01:06.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b8099660 con 0x560fe7c523c0 2023-09-21T13:01:06.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4dd2f0b80 10 client.26752 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:06.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560fe79b1c60 con 0x560fe7c523c0 2023-09-21T13:01:06.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560fe7b0ebb0 con 0x560fe7c523c0 2023-09-21T13:01:06.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.291+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc4b8004c10 con 0x560fe7c523c0 2023-09-21T13:01:06.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 10 client.26752 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:06.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 10 client.26752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:06.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 20 client.26752 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:06.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7c66660 0x560fe7c68a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 4 client.26752 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:06.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fe7c1b020 con 0x560fe7c66660 2023-09-21T13:01:06.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.292+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7c66660 0x560fe7c68a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.293+0000 7fc4a2ffd700 10 client.26752 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:06.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.293+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7c66660 0x560fe7c68a80 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b1fe574e9a3f2c4 server_cookie=bf52aa2d9afd8cbd in_seq=0 out_seq=0 2023-09-21T13:01:06.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.293+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/3412119587 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560fe7c1b020 con 0x560fe7c66660 2023-09-21T13:01:06.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.293+0000 7fc4a2ffd700 10 client.26752 handle_command_reply: tid=0 2023-09-21T13:01:06.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.293+0000 7fc4dd2f0b80 1 client.26752 shutdown 2023-09-21T13:01:06.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 msgr2=0x560fe7c564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800cc00 tx=0x7fc4b8004a30 comp rx=0 tx=0).stop 2023-09-21T13:01:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 shutdown_connections 2023-09-21T13:01:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7c66660 0x560fe7c68a80 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c4cbb0 0x560fe7c55f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c52ce0 0x560fe7c569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4a2ffd700 0 client.26752 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:06.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3412119587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c523c0 0x560fe7c564b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 >> 172.21.15.142:0/3412119587 conn(0x560fe7b79000 msgr2=0x560fe7c47360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 shutdown_connections 2023-09-21T13:01:06.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3412119587 wait complete. 2023-09-21T13:01:06.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.294+0000 7fc4dd2f0b80 20 client.26752 trim_cache size 0 max 16384 2023-09-21T13:01:06.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 Processor -- start 2023-09-21T13:01:06.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 -- start start 2023-09-21T13:01:06.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c5d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c51150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7a1e920 con 0x560fe7c52ce0 2023-09-21T13:01:06.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7c4d600 con 0x560fe7c523c0 2023-09-21T13:01:06.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.312+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7c630a0 con 0x560fe7c4cbb0 2023-09-21T13:01:06.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60232/0 (socket says 172.21.15.142:60232) 2023-09-21T13:01:06.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/3369485343 learned_addr learned my addr 172.21.15.142:0/3369485343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c51150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c5d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/3369485343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 msgr2=0x560fe7c5d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c5d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/3369485343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 msgr2=0x560fe7c51150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c51150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/3369485343 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fe79ef250 con 0x560fe7c4cbb0 2023-09-21T13:01:06.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009990 tx=0x7fc4b4020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57680aeb01aac92f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4aa7fc700 1 -- 172.21.15.142:0/3369485343 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4032980 con 0x560fe7c4cbb0 2023-09-21T13:01:06.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.313+0000 7fc4aa7fc700 1 -- 172.21.15.142:0/3369485343 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4b402c040 con 0x560fe7c4cbb0 2023-09-21T13:01:06.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4aa7fc700 1 -- 172.21.15.142:0/3369485343 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4004df0 con 0x560fe7c4cbb0 2023-09-21T13:01:06.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3369485343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 msgr2=0x560fe7c4c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009990 tx=0x7fc4b4020000 comp rx=0 tx=0).stop 2023-09-21T13:01:06.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3369485343 shutdown_connections 2023-09-21T13:01:06.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c52ce0 0x560fe7c51150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c4cbb0 0x560fe7c4c670 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/3369485343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c523c0 0x560fe7c5d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3369485343 >> 172.21.15.142:0/3369485343 conn(0x560fe7b79000 msgr2=0x560fe7c501b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3369485343 shutdown_connections 2023-09-21T13:01:06.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.314+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/3369485343 wait complete. 2023-09-21T13:01:06.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.315+0000 7fc4dd2f0b80 1 -- start start 2023-09-21T13:01:06.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.315+0000 7fc4dd2f0b80 1 Processor -- start 2023-09-21T13:01:06.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c523c0 0x560fe7c5b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c52ce0 0x560fe7cb34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7cb3a10 con 0x560fe7c523c0 2023-09-21T13:01:06.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7cb3b50 con 0x560fe7c4cbb0 2023-09-21T13:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fe7cb3d10 con 0x560fe7c52ce0 2023-09-21T13:01:06.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4dd2f0b80 10 client.0 _ll_register_callbacks cb 0x560fe7a84a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58608/0 (socket says 172.21.15.142:58608) 2023-09-21T13:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/357834440 learned_addr learned my addr 172.21.15.142:0/357834440 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c37fe700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c52ce0 0x560fe7cb34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c523c0 0x560fe7c5b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/357834440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c52ce0 msgr2=0x560fe7cb34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c52ce0 0x560fe7cb34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/357834440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c523c0 msgr2=0x560fe7c5b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:06.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c523c0 0x560fe7c5b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.316+0000 7fc4c2ffd700 1 -- 172.21.15.142:0/357834440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c410e350 con 0x560fe7c4cbb0 2023-09-21T13:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4c2ffd700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009ce0 tx=0x7fc4b400b420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6fdb7a89a560f48 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4029070 con 0x560fe7c4cbb0 2023-09-21T13:01:06.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4bc00f040 con 0x560fe7c4cbb0 2023-09-21T13:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc4b4004710 con 0x560fe7c4cbb0 2023-09-21T13:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4b40325b0 con 0x560fe7c4cbb0 2023-09-21T13:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4dd2f0b80 10 client.26801 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:06.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.317+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x560fe79c72b0 con 0x560fe7c4cbb0 2023-09-21T13:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4bc00f040 con 0x560fe7c4cbb0 2023-09-21T13:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc4b400f620 con 0x560fe7c4cbb0 2023-09-21T13:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 10 client.26801 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 10 client.26801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:06.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 20 client.26801 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:06.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7cbb0a0 0x560fe7cbd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 4 client.26801 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:01:06.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560fe7b96e60 con 0x560fe7cbb0a0 2023-09-21T13:01:06.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.318+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7cbb0a0 0x560fe7cbd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4a2ffd700 10 client.26801 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:06.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4c27fc700 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7cbb0a0 0x560fe7cbd4c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8575b71bd0f335b server_cookie=71ba668fc25f1287 in_seq=0 out_seq=0 2023-09-21T13:01:06.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4a2ffd700 1 -- 172.21.15.142:0/357834440 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560fe7b96e60 con 0x560fe7cbb0a0 2023-09-21T13:01:06.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4a2ffd700 10 client.26801 handle_command_reply: tid=0 2023-09-21T13:01:06.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 client.26801 shutdown 2023-09-21T13:01:06.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 msgr2=0x560fe7c5b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009ce0 tx=0x7fc4b400b420 comp rx=0 tx=0).stop 2023-09-21T13:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 shutdown_connections 2023-09-21T13:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fe7cbb0a0 0x560fe7cbd4c0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fe7c52ce0 0x560fe7cb34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fe7c4cbb0 0x560fe7c5b3f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4a2ffd700 0 client.26801 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 --2- 172.21.15.142:0/357834440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fe7c523c0 0x560fe7c5b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 >> 172.21.15.142:0/357834440 conn(0x560fe7b79000 msgr2=0x560fe7c564e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 shutdown_connections 2023-09-21T13:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 1 -- 172.21.15.142:0/357834440 wait complete. 2023-09-21T13:01:06.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.319+0000 7fc4dd2f0b80 20 client.26801 trim_cache size 0 max 16384 2023-09-21T13:01:06.346 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:06.346 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T13:01:06.347 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T13:01:06.347 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:06.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 msgr2=0x7fc4ac0a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 0x7fc4ac0a2d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b2e0 tx=0x7fc4b4005fd0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 msgr2=0x7fc4c41993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc4b800e970 tx=0x7fc4b800ec80 comp rx=0 tx=0).stop 2023-09-21T13:01:06.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 shutdown_connections 2023-09-21T13:01:06.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc4ac0a0850 0x7fc4ac0a2d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc4c4100e40 0x7fc4c4198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc4c419d810 0x7fc4c419dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 --2- 172.21.15.142:0/1767086220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4c4105f60 0x7fc4c41993b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 >> 172.21.15.142:0/1767086220 conn(0x7fc4c40fc6a0 msgr2=0x7fc4c410cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 shutdown_connections 2023-09-21T13:01:06.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.320+0000 7fc4c3fff700 1 -- 172.21.15.142:0/1767086220 wait complete. 2023-09-21T13:01:06.354 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T13:01:06.355 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:01:06.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1951297480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c4100fd0 msgr2=0x7f30c41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1951297480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c4100fd0 0x7f30c41013b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f30c0009990 tx=0x7f30c0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1951297480 shutdown_connections 2023-09-21T13:01:06.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1951297480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c41060f0 0x7f30c410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1951297480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c4100fd0 0x7f30c41013b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1951297480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c4101980 0x7f30c41059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1951297480 >> 172.21.15.142:0/1951297480 conn(0x7f30c40fc870 msgr2=0x7f30c40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1951297480 shutdown_connections 2023-09-21T13:01:06.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.572+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1951297480 wait complete. 2023-09-21T13:01:06.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.573+0000 7f30cc7ff700 1 Processor -- start 2023-09-21T13:01:06.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 -- start start 2023-09-21T13:01:06.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 0x7f30c4196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 0x7f30c4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 0x7f30c419bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c419c370 con 0x7f30c4100fd0 2023-09-21T13:01:06.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c419c4e0 con 0x7f30c41060f0 2023-09-21T13:01:06.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cc7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c419c6a0 con 0x7f30c419b8f0 2023-09-21T13:01:06.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30ca59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 0x7f30c4196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30cad9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 0x7f30c419bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30ca59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 0x7f30c4196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35234/0 (socket says 172.21.15.142:35234) 2023-09-21T13:01:06.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30ca59b700 1 -- 172.21.15.142:0/1732891409 learned_addr learned my addr 172.21.15.142:0/1732891409 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:06.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.574+0000 7f30c9d9a700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 0x7f30c4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 -- 172.21.15.142:0/1732891409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 msgr2=0x7f30c4197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 0x7f30c4197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 -- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 msgr2=0x7f30c4196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 0x7f30c4196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 -- 172.21.15.142:0/1732891409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c00095f0 con 0x7f30c419b8f0 2023-09-21T13:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30c9d9a700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 0x7f30c4197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cad9c700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 0x7f30c419bd70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30bc007f10 tx=0x7f30bc00d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00ddd0 con 0x7f30c419b8f0 2023-09-21T13:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30bc00f040 con 0x7f30c419b8f0 2023-09-21T13:01:06.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c41a3c00 con 0x7f30c419b8f0 2023-09-21T13:01:06.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc005a90 con 0x7f30c419b8f0 2023-09-21T13:01:06.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.575+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c41a4130 con 0x7f30c419b8f0 2023-09-21T13:01:06.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.576+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c4068020 con 0x7f30c419b8f0 2023-09-21T13:01:06.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.578+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f30bc004ad0 con 0x7f30c419b8f0 2023-09-21T13:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.580+0000 7f30bb7fe700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 0x7f30b00a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.580+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f30bc0cc130 con 0x7f30c419b8f0 2023-09-21T13:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.580+0000 7f30ca59b700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 0x7f30b00a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.580+0000 7f30ca59b700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 0x7f30b00a2d30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006010 tx=0x7f30c000b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:06.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.581+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f30bc095950 con 0x7f30c419b8f0 2023-09-21T13:01:06.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 458345 10.32 MB/sec execute 107 sec latency 30.516 ms 2023-09-21T13:01:06.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.868+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30c4101b90 con 0x7f30c419b8f0 2023-09-21T13:01:06.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.869+0000 7f30bb7fe700 1 -- 172.21.15.142:0/1732891409 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11332 (secure 0 0 0) 0x7f30bc098f70 con 0x7f30c419b8f0 2023-09-21T13:01:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:01:06.869 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:00:16.428735+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24535":{"gid":24535,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/39574793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":39574793},{"type":"v1","addr":"172.21.15.160:6839","nonce":39574793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:01:06.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 msgr2=0x7f30b00a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 0x7f30b00a2d30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30c0006010 tx=0x7f30c000b260 comp rx=0 tx=0).stop 2023-09-21T13:01:06.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 msgr2=0x7f30c419bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:06.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 0x7f30c419bd70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f30bc007f10 tx=0x7f30bc00d3b0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 shutdown_connections 2023-09-21T13:01:06.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30b00a0870 0x7f30b00a2d30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f30c4100fd0 0x7f30c4196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30c419b8f0 0x7f30c419bd70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 --2- 172.21.15.142:0/1732891409 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f30c41060f0 0x7f30c4197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:06.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 >> 172.21.15.142:0/1732891409 conn(0x7f30c40fc870 msgr2=0x7f30c41049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:06.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 shutdown_connections 2023-09-21T13:01:06.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:06.872+0000 7f30cc7ff700 1 -- 172.21.15.142:0/1732891409 wait complete. 2023-09-21T13:01:06.878 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 26 2023-09-21T13:01:06.892 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:01:07.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 -- 172.21.15.142:0/1955618340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8073aa0 msgr2=0x7f76c8111820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/1955618340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8073aa0 0x7f76c8111820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098f0 tx=0x7f76bc009c00 comp rx=0 tx=0).stop 2023-09-21T13:01:07.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 -- 172.21.15.142:0/1955618340 shutdown_connections 2023-09-21T13:01:07.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/1955618340 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8111d60 0x7f76c8114150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/1955618340 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c8073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/1955618340 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8073aa0 0x7f76c8111820 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 -- 172.21.15.142:0/1955618340 >> 172.21.15.142:0/1955618340 conn(0x7f76c80fc840 msgr2=0x7f76c80fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 -- 172.21.15.142:0/1955618340 shutdown_connections 2023-09-21T13:01:07.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.121+0000 7f76ce5ff700 1 -- 172.21.15.142:0/1955618340 wait complete. 2023-09-21T13:01:07.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.122+0000 7f76ce5ff700 1 Processor -- start 2023-09-21T13:01:07.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.122+0000 7f76ce5ff700 1 -- start start 2023-09-21T13:01:07.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8073aa0 0x7f76c819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8111d60 0x7f76c81a1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81a2510 con 0x7f76c8111d60 2023-09-21T13:01:07.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81a2680 con 0x7f76c8073180 2023-09-21T13:01:07.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ce5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c81a2840 con 0x7f76c8073aa0 2023-09-21T13:01:07.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58642/0 (socket says 172.21.15.142:58642) 2023-09-21T13:01:07.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76c7fff700 1 -- 172.21.15.142:0/709019250 learned_addr learned my addr 172.21.15.142:0/709019250 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76c77fe700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8073aa0 0x7f76c819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.123+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8111d60 0x7f76c81a1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 -- 172.21.15.142:0/709019250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8073aa0 msgr2=0x7f76c819da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8073aa0 0x7f76c819da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 -- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8111d60 msgr2=0x7f76c81a1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8111d60 0x7f76c81a1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 -- 172.21.15.142:0/709019250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80095f0 con 0x7f76c8073180 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c7fff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76b800ec10 tx=0x7f76b800ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c57fa700 1 -- 172.21.15.142:0/709019250 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b800cc90 con 0x7f76c8073180 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c57fa700 1 -- 172.21.15.142:0/709019250 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b80044e0 con 0x7f76c8073180 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76bc009520 con 0x7f76c8073180 2023-09-21T13:01:07.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76c57fa700 1 -- 172.21.15.142:0/709019250 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b8010430 con 0x7f76c8073180 2023-09-21T13:01:07.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.124+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c81aa180 con 0x7f76c8073180 2023-09-21T13:01:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.129+0000 7f76c57fa700 1 -- 172.21.15.142:0/709019250 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f76b8003fb0 con 0x7f76c8073180 2023-09-21T13:01:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.130+0000 7f76e1fb1b80 1 Processor -- start 2023-09-21T13:01:07.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 -- start start 2023-09-21T13:01:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76c57fa700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 0x7f76b00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae182e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae0f2ca0 con 0x55d5ae17ef30 2023-09-21T13:01:07.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76c57fa700 1 -- 172.21.15.142:0/709019250 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76b8014070 con 0x7f76c8073180 2023-09-21T13:01:07.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae0d6c70 con 0x55d5ae183360 2023-09-21T13:01:07.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.131+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae0d4590 con 0x55d5ae17e610 2023-09-21T13:01:07.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 0x7f76b00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60284/0 (socket says 172.21.15.142:60284) 2023-09-21T13:01:07.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 -- 172.21.15.142:0/1758525288 learned_addr learned my addr 172.21.15.142:0/1758525288 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c77fe700 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae182e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 -- 172.21.15.142:0/1758525288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 msgr2=0x55d5ae1837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1837c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 -- 172.21.15.142:0/1758525288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 msgr2=0x55d5ae182e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae182e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 -- 172.21.15.142:0/1758525288 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5adefade0 con 0x55d5ae17e610 2023-09-21T13:01:07.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.132+0000 7f76c7fff700 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76b8000c00 tx=0x7f76b8095d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb8fc9394bc973a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 0x7f76b00a2c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009ec0 tx=0x7f76c00092f0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76ae7fc700 1 -- 172.21.15.142:0/1758525288 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80b9110 con 0x55d5ae17e610 2023-09-21T13:01:07.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76ae7fc700 1 -- 172.21.15.142:0/1758525288 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b8099330 con 0x55d5ae17e610 2023-09-21T13:01:07.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76ae7fc700 1 -- 172.21.15.142:0/1758525288 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80a1a40 con 0x55d5ae17e610 2023-09-21T13:01:07.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/1758525288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 msgr2=0x55d5ae17e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.133+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f76b8000c00 tx=0x7f76b8095d90 comp rx=0 tx=0).stop 2023-09-21T13:01:07.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/1758525288 shutdown_connections 2023-09-21T13:01:07.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae17e9f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/1758525288 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae182e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/1758525288 >> 172.21.15.142:0/1758525288 conn(0x55d5ae0ab000 msgr2=0x55d5ae1796a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/1758525288 shutdown_connections 2023-09-21T13:01:07.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/1758525288 wait complete. 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.134+0000 7f76e1fb1b80 1 -- start start 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.135+0000 7f76e1fb1b80 1 Processor -- start 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.135+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.135+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae187d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1883a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae0cfe80 con 0x55d5ae17ef30 2023-09-21T13:01:07.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae06c740 con 0x55d5ae183360 2023-09-21T13:01:07.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae06c3e0 con 0x55d5ae17e610 2023-09-21T13:01:07.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76e1fb1b80 10 client.0 _ll_register_callbacks cb 0x55d5adfb6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60296/0 (socket says 172.21.15.142:60296) 2023-09-21T13:01:07.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 -- 172.21.15.142:0/154078259 learned_addr learned my addr 172.21.15.142:0/154078259 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c77fe700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae187d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1883a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 -- 172.21.15.142:0/154078259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 msgr2=0x55d5ae1883a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1883a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 -- 172.21.15.142:0/154078259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 msgr2=0x55d5ae187d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae187d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.136+0000 7f76c7fff700 1 -- 172.21.15.142:0/154078259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c81aa180 con 0x55d5ae17e610 2023-09-21T13:01:07.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76c7fff700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ca270 tx=0x7f76b80b9110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d3737eef3963a2d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80999d0 con 0x55d5ae17e610 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76b8016330 con 0x55d5ae17e610 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5ae040bb0 con 0x55d5ae17e610 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b809a0d0 con 0x55d5ae17e610 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 10 client.26776 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d5adee3c60 con 0x55d5ae17e610 2023-09-21T13:01:07.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b807c080 con 0x55d5ae17e610 2023-09-21T13:01:07.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76b8098ec0 con 0x55d5ae17e610 2023-09-21T13:01:07.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 10 client.26776 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 10 client.26776 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:01:07.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 20 client.26776 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.137+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae197f80 0x55d5ae19a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.138+0000 7f76e1fb1b80 4 client.26776 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:07.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.138+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5ae14d020 con 0x55d5ae197f80 2023-09-21T13:01:07.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.138+0000 7f76c77fe700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae197f80 0x55d5ae19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.138+0000 7f76c77fe700 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae197f80 0x55d5ae19a370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24838e66dfe645e1 server_cookie=c76d7725a99ffe64 in_seq=0 out_seq=0 2023-09-21T13:01:07.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.138+0000 7f76a77fe700 10 client.26776 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:07.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76a77fe700 1 -- 172.21.15.142:0/154078259 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d5ae14d020 con 0x55d5ae197f80 2023-09-21T13:01:07.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76a77fe700 10 client.26776 handle_command_reply: tid=0 2023-09-21T13:01:07.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 client.26776 shutdown 2023-09-21T13:01:07.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 msgr2=0x55d5ae18aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f76b80ca270 tx=0x7f76b80b9110 comp rx=0 tx=0).stop 2023-09-21T13:01:07.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 shutdown_connections 2023-09-21T13:01:07.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae197f80 0x55d5ae19a370 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae1883a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae18aaa0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/154078259 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae187d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76a77fe700 0 client.26776 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 >> 172.21.15.142:0/154078259 conn(0x55d5ae0ab000 msgr2=0x55d5ae179230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 shutdown_connections 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.139+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/154078259 wait complete. 2023-09-21T13:01:07.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.140+0000 7f76e1fb1b80 20 client.26776 trim_cache size 0 max 16384 2023-09-21T13:01:07.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.154+0000 7f76e1fb1b80 1 Processor -- start 2023-09-21T13:01:07.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.154+0000 7f76e1fb1b80 1 -- start start 2023-09-21T13:01:07.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae18f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae182a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5adf50920 con 0x55d5ae17ef30 2023-09-21T13:01:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae173990 con 0x55d5ae183360 2023-09-21T13:01:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae18fa20 con 0x55d5ae17e610 2023-09-21T13:01:07.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60306/0 (socket says 172.21.15.142:60306) 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 -- 172.21.15.142:0/4249637272 learned_addr learned my addr 172.21.15.142:0/4249637272 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae182a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c77fe700 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae18f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 -- 172.21.15.142:0/4249637272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 msgr2=0x55d5ae182a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae182a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 -- 172.21.15.142:0/4249637272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 msgr2=0x55d5ae18f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae18f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.155+0000 7f76c7fff700 1 -- 172.21.15.142:0/4249637272 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5ae1780b0 con 0x55d5ae17e610 2023-09-21T13:01:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76c7fff700 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c5b0 tx=0x7f76b8004470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5cd6eef2d296768 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76aeffd700 1 -- 172.21.15.142:0/4249637272 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b80a1650 con 0x55d5ae17e610 2023-09-21T13:01:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76aeffd700 1 -- 172.21.15.142:0/4249637272 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d5ae040bb0 con 0x55d5ae17e610 2023-09-21T13:01:07.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76aeffd700 1 -- 172.21.15.142:0/4249637272 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b809d800 con 0x55d5ae17e610 2023-09-21T13:01:07.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/4249637272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 msgr2=0x55d5ae185f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.156+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f76b800c5b0 tx=0x7f76b8004470 comp rx=0 tx=0).stop 2023-09-21T13:01:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/4249637272 shutdown_connections 2023-09-21T13:01:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae183360 0x55d5ae182a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae17e610 0x55d5ae185f70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/4249637272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17ef30 0x55d5ae18f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/4249637272 >> 172.21.15.142:0/4249637272 conn(0x55d5ae0ab000 msgr2=0x55d5ae182370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/4249637272 shutdown_connections 2023-09-21T13:01:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/4249637272 wait complete. 2023-09-21T13:01:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 -- start start 2023-09-21T13:01:07.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.157+0000 7f76e1fb1b80 1 Processor -- start 2023-09-21T13:01:07.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17e610 0x55d5ae1866d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae183360 0x55d5ae187150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae18f880 con 0x55d5ae17e610 2023-09-21T13:01:07.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae18f9f0 con 0x55d5ae17ef30 2023-09-21T13:01:07.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ae1ebd00 con 0x55d5ae183360 2023-09-21T13:01:07.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76e1fb1b80 10 client.0 _ll_register_callbacks cb 0x55d5adfb6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76c7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17e610 0x55d5ae1866d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76c77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58680/0 (socket says 172.21.15.142:58680) 2023-09-21T13:01:07.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.158+0000 7f76c77fe700 1 -- 172.21.15.142:0/2215981733 learned_addr learned my addr 172.21.15.142:0/2215981733 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76ccb9c700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae183360 0x55d5ae187150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 -- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae183360 msgr2=0x55d5ae187150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae183360 0x55d5ae187150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 -- 172.21.15.142:0/2215981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17e610 msgr2=0x55d5ae1866d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17e610 0x55d5ae1866d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 -- 172.21.15.142:0/2215981733 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5adee3c60 con 0x55d5ae17ef30 2023-09-21T13:01:07.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76c77fe700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098c0 tx=0x7f76bc00f780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b127d06d952d0b0f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:07.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc027c90 con 0x55d5ae17ef30 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f76bc027df0 con 0x55d5ae17ef30 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.159+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76b8099330 con 0x55d5ae17ef30 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76bc027040 con 0x55d5ae17ef30 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 10 client.26825 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d5adf21250 con 0x55d5ae17ef30 2023-09-21T13:01:07.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b8099330 con 0x55d5ae17ef30 2023-09-21T13:01:07.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76bc009920 con 0x55d5ae17ef30 2023-09-21T13:01:07.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 10 client.26825 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 10 client.26825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:01:07.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 20 client.26825 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae1ed510 0x55d5ae1ef930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 4 client.26825 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:07.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.160+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d5ae0c8e60 con 0x55d5ae1ed510 2023-09-21T13:01:07.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76c7fff700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae1ed510 0x55d5ae1ef930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76c7fff700 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae1ed510 0x55d5ae1ef930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=22f77b5e3fab6a56 server_cookie=cdec562e766e18a8 in_seq=0 out_seq=0 2023-09-21T13:01:07.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76a77fe700 10 client.26825 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:07.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76a77fe700 1 -- 172.21.15.142:0/2215981733 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d5ae0c8e60 con 0x55d5ae1ed510 2023-09-21T13:01:07.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76a77fe700 10 client.26825 handle_command_reply: tid=0 2023-09-21T13:01:07.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76e1fb1b80 1 client.26825 shutdown 2023-09-21T13:01:07.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 msgr2=0x55d5ae186c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0098c0 tx=0x7f76bc00f780 comp rx=0 tx=0).stop 2023-09-21T13:01:07.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 shutdown_connections 2023-09-21T13:01:07.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.161+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55d5ae1ed510 0x55d5ae1ef930 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d5ae17e610 0x55d5ae1866d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76a77fe700 0 client.26825 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:07.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d5ae183360 0x55d5ae187150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 --2- 172.21.15.142:0/2215981733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d5ae17ef30 0x55d5ae186c10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 >> 172.21.15.142:0/2215981733 conn(0x55d5ae0ab000 msgr2=0x55d5ae17d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 shutdown_connections 2023-09-21T13:01:07.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 1 -- 172.21.15.142:0/2215981733 wait complete. 2023-09-21T13:01:07.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.162+0000 7f76e1fb1b80 20 client.26825 trim_cache size 0 max 16384 2023-09-21T13:01:07.175 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:07.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 msgr2=0x7f76b00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 0x7f76b00a2c70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009ec0 tx=0x7f76c00092f0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 msgr2=0x7f76c819d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f76b800ec10 tx=0x7f76b800ef20 comp rx=0 tx=0).stop 2023-09-21T13:01:07.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 shutdown_connections 2023-09-21T13:01:07.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f76b00a07b0 0x7f76b00a2c70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76c8111d60 0x7f76c81a1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76c8073180 0x7f76c819d530 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 --2- 172.21.15.142:0/709019250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76c8073aa0 0x7f76c819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 >> 172.21.15.142:0/709019250 conn(0x7f76c80fc840 msgr2=0x7f76c80fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 shutdown_connections 2023-09-21T13:01:07.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.163+0000 7f76ce5ff700 1 -- 172.21.15.142:0/709019250 wait complete. 2023-09-21T13:01:07.181 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:01:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 -- 172.21.15.142:0/2988011871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 msgr2=0x7f31081035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 --2- 172.21.15.142:0/2988011871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f31081035d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3104009990 tx=0x7f3104009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 -- 172.21.15.142:0/2988011871 shutdown_connections 2023-09-21T13:01:07.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 --2- 172.21.15.142:0/2988011871 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3108108310 0x7f310810fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 --2- 172.21.15.142:0/2988011871 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f31081035d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 --2- 172.21.15.142:0/2988011871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108103ba0 0x7f3108107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 -- 172.21.15.142:0/2988011871 >> 172.21.15.142:0/2988011871 conn(0x7f31080fea30 msgr2=0x7f3108100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 -- 172.21.15.142:0/2988011871 shutdown_connections 2023-09-21T13:01:07.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.402+0000 7f310f3ff700 1 -- 172.21.15.142:0/2988011871 wait complete. 2023-09-21T13:01:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.403+0000 7f310f3ff700 1 Processor -- start 2023-09-21T13:01:07.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.403+0000 7f310f3ff700 1 -- start start 2023-09-21T13:01:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108108310 0x7f31081995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f310819da20 0x7f310819dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819e4a0 con 0x7f310819da20 2023-09-21T13:01:07.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819e610 con 0x7f31081031f0 2023-09-21T13:01:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310f3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310819e7d0 con 0x7f3108108310 2023-09-21T13:01:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58692/0 (socket says 172.21.15.142:58692) 2023-09-21T13:01:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 -- 172.21.15.142:0/3097262408 learned_addr learned my addr 172.21.15.142:0/3097262408 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310c99a700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108108310 0x7f31081995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d99c700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f310819da20 0x7f310819dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 -- 172.21.15.142:0/3097262408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108108310 msgr2=0x7f31081995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108108310 0x7f31081995c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 -- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f310819da20 msgr2=0x7f310819dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f310819da20 0x7f310819dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 -- 172.21.15.142:0/3097262408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040095f0 con 0x7f31081031f0 2023-09-21T13:01:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.404+0000 7f310d19b700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3104005910 tx=0x7f3104005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.405+0000 7f30fe7fc700 1 -- 172.21.15.142:0/3097262408 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310401d070 con 0x7f31081031f0 2023-09-21T13:01:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.405+0000 7f30fe7fc700 1 -- 172.21.15.142:0/3097262408 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3104022470 con 0x7f31081031f0 2023-09-21T13:01:07.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.405+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31081a5cd0 con 0x7f31081031f0 2023-09-21T13:01:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.405+0000 7f30fe7fc700 1 -- 172.21.15.142:0/3097262408 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104017650 con 0x7f31081031f0 2023-09-21T13:01:07.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.405+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31081a6150 con 0x7f31081031f0 2023-09-21T13:01:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.408+0000 7f30fe7fc700 1 -- 172.21.15.142:0/3097262408 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f31040225e0 con 0x7f31081031f0 2023-09-21T13:01:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.410+0000 7f3122db4b80 1 Processor -- start 2023-09-21T13:01:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.410+0000 7f30fe7fc700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 0x7f30f40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.410+0000 7f3122db4b80 1 -- start start 2023-09-21T13:01:07.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.410+0000 7f30fe7fc700 1 -- 172.21.15.142:0/3097262408 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f31040cd250 con 0x7f31081031f0 2023-09-21T13:01:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d99c700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 0x7f30f40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676bc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6762bca0 con 0x560f676b7610 2023-09-21T13:01:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6760fc70 con 0x560f676b7f30 2023-09-21T13:01:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f3122db4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f6760d590 con 0x560f676bc360 2023-09-21T13:01:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35318/0 (socket says 172.21.15.142:35318) 2023-09-21T13:01:07.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 -- 172.21.15.142:0/1891019442 learned_addr learned my addr 172.21.15.142:0/1891019442 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310c99a700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d99c700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676bc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 -- 172.21.15.142:0/1891019442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 msgr2=0x560f676bc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676bc7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 -- 172.21.15.142:0/1891019442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 msgr2=0x560f676bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.411+0000 7f310d19b700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f310d19b700 1 -- 172.21.15.142:0/1891019442 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f67433de0 con 0x560f676b7610 2023-09-21T13:01:07.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f310d99c700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 0x7f30f40a2c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f310000f590 tx=0x7f310000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f310c99a700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f310d19b700 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f31040972f0 tx=0x7f3104009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6846370192735e23 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f30f37fe700 1 -- 172.21.15.142:0/1891019442 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040cd070 con 0x560f676b7610 2023-09-21T13:01:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f30f37fe700 1 -- 172.21.15.142:0/1891019442 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f310409a1e0 con 0x560f676b7610 2023-09-21T13:01:07.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.412+0000 7f30f37fe700 1 -- 172.21.15.142:0/1891019442 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310409aae0 con 0x560f676b7610 2023-09-21T13:01:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 -- 172.21.15.142:0/1891019442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 msgr2=0x560f676b79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f31040972f0 tx=0x7f3104009310 comp rx=0 tx=0).stop 2023-09-21T13:01:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 -- 172.21.15.142:0/1891019442 shutdown_connections 2023-09-21T13:01:07.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676b79f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676bc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 --2- 172.21.15.142:0/1891019442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 -- 172.21.15.142:0/1891019442 >> 172.21.15.142:0/1891019442 conn(0x560f675e4000 msgr2=0x560f676b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 -- 172.21.15.142:0/1891019442 shutdown_connections 2023-09-21T13:01:07.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.413+0000 7f3122db4b80 1 -- 172.21.15.142:0/1891019442 wait complete. 2023-09-21T13:01:07.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 -- start start 2023-09-21T13:01:07.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 Processor -- start 2023-09-21T13:01:07.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676c18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f67608e80 con 0x560f676b7610 2023-09-21T13:01:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f675a5740 con 0x560f676b7f30 2023-09-21T13:01:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f675a53e0 con 0x560f676bc360 2023-09-21T13:01:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.414+0000 7f3122db4b80 10 client.0 _ll_register_callbacks cb 0x560f674efa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58700/0 (socket says 172.21.15.142:58700) 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 -- 172.21.15.142:0/2571294844 learned_addr learned my addr 172.21.15.142:0/2571294844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310d19b700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310d99c700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676c18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 -- 172.21.15.142:0/2571294844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 msgr2=0x560f676c18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676c18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 -- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 msgr2=0x560f676c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 -- 172.21.15.142:0/2571294844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f80098e0 con 0x560f676b7f30 2023-09-21T13:01:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310d19b700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f310c99a700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f30f8010960 tx=0x7f30f8010c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c2773ac1399765e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.415+0000 7f30f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:07.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f8004500 con 0x560f676b7f30 2023-09-21T13:01:07.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f30f8003680 con 0x560f676b7f30 2023-09-21T13:01:07.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f67579bb0 con 0x560f676b7f30 2023-09-21T13:01:07.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30f8003840 con 0x560f676b7f30 2023-09-21T13:01:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 10 client.26837 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f31081a6150 con 0x560f676b7f30 2023-09-21T13:01:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560f67579bb0 con 0x560f676b7f30 2023-09-21T13:01:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30f800fce0 con 0x560f676b7f30 2023-09-21T13:01:07.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 10 client.26837 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 10 client.26837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:01:07.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 20 client.26837 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f676d1230 0x560f676d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 4 client.26837 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:07.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.416+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f67686020 con 0x560f676d1230 2023-09-21T13:01:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.417+0000 7f310d19b700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f676d1230 0x560f676d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.417+0000 7f310d19b700 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f676d1230 0x560f676d3650 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=82f77cad0058e2e4 server_cookie=5ec751d2e47e07cf in_seq=0 out_seq=0 2023-09-21T13:01:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.417+0000 7f30f0ff9700 10 client.26837 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f30f0ff9700 1 -- 172.21.15.142:0/2571294844 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560f67686020 con 0x560f676d1230 2023-09-21T13:01:07.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f30f0ff9700 10 client.26837 handle_command_reply: tid=0 2023-09-21T13:01:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 client.26837 shutdown 2023-09-21T13:01:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 msgr2=0x560f676c1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f30f8010960 tx=0x7f30f8010c70 comp rx=0 tx=0).stop 2023-09-21T13:01:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 shutdown_connections 2023-09-21T13:01:07.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f676d1230 0x560f676d3650 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676bc360 0x560f676c18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 --2- 172.21.15.142:0/2571294844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676b7f30 0x560f676c1380 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f30f0ff9700 0 client.26837 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 >> 172.21.15.142:0/2571294844 conn(0x560f675e4000 msgr2=0x560f676b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 shutdown_connections 2023-09-21T13:01:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 1 -- 172.21.15.142:0/2571294844 wait complete. 2023-09-21T13:01:07.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.418+0000 7f3122db4b80 20 client.26837 trim_cache size 0 max 16384 2023-09-21T13:01:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.432+0000 7f3122db4b80 1 Processor -- start 2023-09-21T13:01:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.432+0000 7f3122db4b80 1 -- start start 2023-09-21T13:01:07.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7f30 0x560f676c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f67489920 con 0x560f676b7f30 2023-09-21T13:01:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f676b8430 con 0x560f676bc360 2023-09-21T13:01:07.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f3122db4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f676b1460 con 0x560f676b7610 2023-09-21T13:01:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60342/0 (socket says 172.21.15.142:60342) 2023-09-21T13:01:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d19b700 1 -- 172.21.15.142:0/3227656065 learned_addr learned my addr 172.21.15.142:0/3227656065 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58714/0 (socket says 172.21.15.142:58714) 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310c99a700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7f30 0x560f676c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 -- 172.21.15.142:0/3227656065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 msgr2=0x560f676b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 -- 172.21.15.142:0/3227656065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7f30 msgr2=0x560f676c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7f30 0x560f676c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d99c700 1 -- 172.21.15.142:0/3227656065 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f676d8280 con 0x560f676bc360 2023-09-21T13:01:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.433+0000 7f310d19b700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f310d99c700 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3100009fa0 tx=0x7f3100024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e6d783f302e5641 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f30f3fff700 1 -- 172.21.15.142:0/3227656065 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310000e040 con 0x560f676bc360 2023-09-21T13:01:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f30f3fff700 1 -- 172.21.15.142:0/3227656065 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f310000f040 con 0x560f676bc360 2023-09-21T13:01:07.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f30f3fff700 1 -- 172.21.15.142:0/3227656065 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3100017d20 con 0x560f676bc360 2023-09-21T13:01:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f3122db4b80 1 -- 172.21.15.142:0/3227656065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 msgr2=0x560f676ba4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.434+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3100009fa0 tx=0x7f3100024000 comp rx=0 tx=0).stop 2023-09-21T13:01:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 -- 172.21.15.142:0/3227656065 shutdown_connections 2023-09-21T13:01:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f676ba4f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7610 0x560f676b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3227656065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7f30 0x560f676c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 -- 172.21.15.142:0/3227656065 >> 172.21.15.142:0/3227656065 conn(0x560f675e4000 msgr2=0x560f676cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 -- 172.21.15.142:0/3227656065 shutdown_connections 2023-09-21T13:01:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 -- 172.21.15.142:0/3227656065 wait complete. 2023-09-21T13:01:07.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 -- start start 2023-09-21T13:01:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.435+0000 7f3122db4b80 1 Processor -- start 2023-09-21T13:01:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f67724060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f677245a0 con 0x560f676b7610 2023-09-21T13:01:07.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f677246e0 con 0x560f676bc360 2023-09-21T13:01:07.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f67724850 con 0x560f676b7f30 2023-09-21T13:01:07.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f3122db4b80 10 client.0 _ll_register_callbacks cb 0x560f674efa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310c99a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310d99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f67724060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310d19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310c99a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60346/0 (socket says 172.21.15.142:60346) 2023-09-21T13:01:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310d99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f67724060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58728/0 (socket says 172.21.15.142:58728) 2023-09-21T13:01:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.436+0000 7f310c99a700 1 -- 172.21.15.142:0/3569680770 learned_addr learned my addr 172.21.15.142:0/3569680770 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 -- 172.21.15.142:0/3569680770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 msgr2=0x560f676c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 -- 172.21.15.142:0/3569680770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 msgr2=0x560f67724060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f67724060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 -- 172.21.15.142:0/3569680770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f67433de0 con 0x560f676b7610 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310c99a700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f310d19b700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c5fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3104029000 tx=0x7f3104009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=762aa3a77a13c65f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f30f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:01:07.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040cd040 con 0x560f676b7610 2023-09-21T13:01:07.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f31040b8050 con 0x560f676b7610 2023-09-21T13:01:07.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f310409a1e0 con 0x560f676b7610 2023-09-21T13:01:07.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f310409af80 con 0x560f676b7610 2023-09-21T13:01:07.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f3122db4b80 10 client.16743 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.437+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f310001c040 con 0x560f676b7610 2023-09-21T13:01:07.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f310409a1e0 con 0x560f676b7610 2023-09-21T13:01:07.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f310409aae0 con 0x560f676b7610 2023-09-21T13:01:07.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 10 client.16743 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 10 client.16743 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:01:07.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 20 client.16743 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f67725b70 0x560f67727f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 4 client.16743 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:07.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560f67601e60 con 0x560f67725b70 2023-09-21T13:01:07.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.438+0000 7f310c99a700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f67725b70 0x560f67727f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f310c99a700 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f67725b70 0x560f67727f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1966bc3aea3ea8b server_cookie=e8cff7d9b7f5b250 in_seq=0 out_seq=0 2023-09-21T13:01:07.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f30f0ff9700 10 client.16743 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:07.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f30f0ff9700 1 -- 172.21.15.142:0/3569680770 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560f67601e60 con 0x560f67725b70 2023-09-21T13:01:07.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f30f0ff9700 10 client.16743 handle_command_reply: tid=0 2023-09-21T13:01:07.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 client.16743 shutdown 2023-09-21T13:01:07.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 msgr2=0x560f676c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c5fd0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3104029000 tx=0x7f3104009310 comp rx=0 tx=0).stop 2023-09-21T13:01:07.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 shutdown_connections 2023-09-21T13:01:07.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560f676b7610 0x560f676c5fd0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x560f67725b70 0x560f67727f60 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560f676bc360 0x560f67724060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 --2- 172.21.15.142:0/3569680770 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560f676b7f30 0x560f676c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f30f0ff9700 0 client.16743 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:07.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 >> 172.21.15.142:0/3569680770 conn(0x560f675e4000 msgr2=0x560f676c1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 shutdown_connections 2023-09-21T13:01:07.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.439+0000 7f3122db4b80 1 -- 172.21.15.142:0/3569680770 wait complete. 2023-09-21T13:01:07.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f3122db4b80 20 client.16743 trim_cache size 0 max 16384 2023-09-21T13:01:07.455 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:07.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 msgr2=0x7f30f40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 0x7f30f40a2c70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f310000f590 tx=0x7f310000b040 comp rx=0 tx=0).stop 2023-09-21T13:01:07.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 msgr2=0x7f3108199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3104005910 tx=0x7f3104005720 comp rx=0 tx=0).stop 2023-09-21T13:01:07.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 shutdown_connections 2023-09-21T13:01:07.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f30f40a07b0 0x7f30f40a2c70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f310819da20 0x7f310819dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f31081031f0 0x7f3108199080 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 --2- 172.21.15.142:0/3097262408 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3108108310 0x7f31081995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 >> 172.21.15.142:0/3097262408 conn(0x7f31080fea30 msgr2=0x7f3108106bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.440+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 shutdown_connections 2023-09-21T13:01:07.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.441+0000 7f310f3ff700 1 -- 172.21.15.142:0/3097262408 wait complete. 2023-09-21T13:01:07.460 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:01:07.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 460030 10.47 MB/sec execute 108 sec latency 65.276 ms 2023-09-21T13:01:07.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 -- 172.21.15.142:0/4258946082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04100e40 msgr2=0x7f5e04101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 --2- 172.21.15.142:0/4258946082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04100e40 0x7f5e04101220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009990 tx=0x7f5df4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 -- 172.21.15.142:0/4258946082 shutdown_connections 2023-09-21T13:01:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 --2- 172.21.15.142:0/4258946082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04105f60 0x7f5e0410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 --2- 172.21.15.142:0/4258946082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04100e40 0x7f5e04101220 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 --2- 172.21.15.142:0/4258946082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e041017f0 0x7f5e04105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 -- 172.21.15.142:0/4258946082 >> 172.21.15.142:0/4258946082 conn(0x7f5e040fc6a0 msgr2=0x7f5e040feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 -- 172.21.15.142:0/4258946082 shutdown_connections 2023-09-21T13:01:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.698+0000 7f5e0359e700 1 -- 172.21.15.142:0/4258946082 wait complete. 2023-09-21T13:01:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 Processor -- start 2023-09-21T13:01:07.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 -- start start 2023-09-21T13:01:07.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 0x7f5e040730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 0x7f5e04073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 0x7f5e041a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041a5520 con 0x7f5e04100e40 2023-09-21T13:01:07.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041a5690 con 0x7f5e04073b60 2023-09-21T13:01:07.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.699+0000 7f5e0359e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e041a5850 con 0x7f5e04105f60 2023-09-21T13:01:07.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 0x7f5e040730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 0x7f5e041a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 0x7f5e04073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 0x7f5e040730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35386/0 (socket says 172.21.15.142:35386) 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e0259c700 1 -- 172.21.15.142:0/1709869892 learned_addr learned my addr 172.21.15.142:0/1709869892 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 -- 172.21.15.142:0/1709869892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 msgr2=0x7f5e04073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 0x7f5e04073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 -- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 msgr2=0x7f5e040730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 0x7f5e040730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 -- 172.21.15.142:0/1709869892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df40095f0 con 0x7f5e04073b60 2023-09-21T13:01:07.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 0x7f5e04073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5e02d9d700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 0x7f5e041a4e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00efc0 tx=0x7f5dfc00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.700+0000 7f5df37fe700 1 -- 172.21.15.142:0/1709869892 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc018070 con 0x7f5e04073b60 2023-09-21T13:01:07.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.701+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e041a5ad0 con 0x7f5e04073b60 2023-09-21T13:01:07.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.701+0000 7f5df37fe700 1 -- 172.21.15.142:0/1709869892 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5dfc00f040 con 0x7f5e04073b60 2023-09-21T13:01:07.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.701+0000 7f5df37fe700 1 -- 172.21.15.142:0/1709869892 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc00cd40 con 0x7f5e04073b60 2023-09-21T13:01:07.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.701+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e041a5fe0 con 0x7f5e04073b60 2023-09-21T13:01:07.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.704+0000 7f5df37fe700 1 -- 172.21.15.142:0/1709869892 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5dfc003a00 con 0x7f5e04073b60 2023-09-21T13:01:07.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.706+0000 7f5e1c814b80 1 Processor -- start 2023-09-21T13:01:07.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.706+0000 7f5e1c814b80 1 -- start start 2023-09-21T13:01:07.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.706+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.706+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.706+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a52030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b819c5ca0 con 0x559b81a57ce0 2023-09-21T13:01:07.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b819a9c70 con 0x559b81a573c0 2023-09-21T13:01:07.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b819a7590 con 0x559b81a51bb0 2023-09-21T13:01:07.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5df37fe700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 0x7f5dec0a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58760/0 (socket says 172.21.15.142:58760) 2023-09-21T13:01:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 -- 172.21.15.142:0/1533516935 learned_addr learned my addr 172.21.15.142:0/1533516935 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a52030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e0259c700 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5df37fe700 1 -- 172.21.15.142:0/1709869892 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5dfc0cbb20 con 0x7f5e04073b60 2023-09-21T13:01:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 -- 172.21.15.142:0/1533516935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 msgr2=0x559b81a52030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e02d9d700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 0x7f5dec0a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a52030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 -- 172.21.15.142:0/1533516935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 msgr2=0x559b81a51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 -- 172.21.15.142:0/1533516935 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b817cdde0 con 0x559b81a573c0 2023-09-21T13:01:07.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.707+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5df8011c40 tx=0x7f5df80047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8afaec1b135c6ae8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5df0ff9700 1 -- 172.21.15.142:0/1533516935 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df8004030 con 0x559b81a573c0 2023-09-21T13:01:07.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5df0ff9700 1 -- 172.21.15.142:0/1533516935 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5df800f6d0 con 0x559b81a573c0 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5df0ff9700 1 -- 172.21.15.142:0/1533516935 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df80038e0 con 0x559b81a573c0 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5e1c814b80 1 -- 172.21.15.142:0/1533516935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 msgr2=0x559b81a577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5e02d9d700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 0x7f5dec0a2d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ef90 tx=0x7f5dfc0092e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.708+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5df8011c40 tx=0x7f5df80047c0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 -- 172.21.15.142:0/1533516935 shutdown_connections 2023-09-21T13:01:07.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a52030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a577a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/1533516935 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 -- 172.21.15.142:0/1533516935 >> 172.21.15.142:0/1533516935 conn(0x559b8197e000 msgr2=0x559b81a4c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 -- 172.21.15.142:0/1533516935 shutdown_connections 2023-09-21T13:01:07.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 -- 172.21.15.142:0/1533516935 wait complete. 2023-09-21T13:01:07.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.709+0000 7f5e1c814b80 1 -- start start 2023-09-21T13:01:07.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.710+0000 7f5e1c814b80 1 Processor -- start 2023-09-21T13:01:07.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.710+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a5b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.710+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a5b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a5bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b819a2e80 con 0x559b81a57ce0 2023-09-21T13:01:07.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b8193f740 con 0x559b81a573c0 2023-09-21T13:01:07.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b8193f3e0 con 0x559b81a51bb0 2023-09-21T13:01:07.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e1c814b80 10 client.0 _ll_register_callbacks cb 0x559b81889a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a5b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a5b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a5b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60388/0 (socket says 172.21.15.142:60388) 2023-09-21T13:01:07.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e01d9b700 1 -- 172.21.15.142:0/2542062978 learned_addr learned my addr 172.21.15.142:0/2542062978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a5bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 -- 172.21.15.142:0/2542062978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 msgr2=0x559b81a5b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a5b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 -- 172.21.15.142:0/2542062978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 msgr2=0x559b81a5bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a5bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e0259c700 1 -- 172.21.15.142:0/2542062978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df8019040 con 0x559b81a573c0 2023-09-21T13:01:07.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.711+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a5bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:07.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a5b580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x559b81a4e000 tx=0x7f5df4005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef6ed1cceb6c2cc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5de9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:07.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df401d070 con 0x559b81a573c0 2023-09-21T13:01:07.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5df4004500 con 0x559b81a573c0 2023-09-21T13:01:07.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b81913bb0 con 0x559b81a573c0 2023-09-21T13:01:07.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df40046c0 con 0x559b81a573c0 2023-09-21T13:01:07.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5e1c814b80 10 client.26855 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b817b6c60 con 0x559b81a573c0 2023-09-21T13:01:07.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.712+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559b81913bb0 con 0x559b81a573c0 2023-09-21T13:01:07.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5df40246f0 con 0x559b81a573c0 2023-09-21T13:01:07.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 10 client.26855 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 10 client.26855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:07.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 20 client.26855 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81a6b800 0x559b81a6dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 4 client.26855 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:07.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b81a20020 con 0x559b81a6b800 2023-09-21T13:01:07.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81a6b800 0x559b81a6dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81a6b800 0x559b81a6dc20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e3fc5c8a0a5ca41 server_cookie=3c93df2d2df38d17 in_seq=0 out_seq=0 2023-09-21T13:01:07.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.713+0000 7f5de9ffb700 10 client.26855 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:07.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5de9ffb700 1 -- 172.21.15.142:0/2542062978 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559b81a20020 con 0x559b81a6b800 2023-09-21T13:01:07.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5de9ffb700 10 client.26855 handle_command_reply: tid=0 2023-09-21T13:01:07.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 client.26855 shutdown 2023-09-21T13:01:07.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 msgr2=0x559b81a5b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a5b580 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x559b81a4e000 tx=0x7f5df4005730 comp rx=0 tx=0).stop 2023-09-21T13:01:07.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 shutdown_connections 2023-09-21T13:01:07.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81a6b800 0x559b81a6dc20 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a57ce0 0x559b81a5bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81a5b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2542062978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a5b580 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 >> 172.21.15.142:0/2542062978 conn(0x559b8197e000 msgr2=0x559b81a4c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.714+0000 7f5de9ffb700 0 client.26855 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:07.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.715+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 shutdown_connections 2023-09-21T13:01:07.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.715+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2542062978 wait complete. 2023-09-21T13:01:07.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.715+0000 7f5e1c814b80 20 client.26855 trim_cache size 0 max 16384 2023-09-21T13:01:07.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.729+0000 7f5e1c814b80 1 Processor -- start 2023-09-21T13:01:07.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.729+0000 7f5e1c814b80 1 -- start start 2023-09-21T13:01:07.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a626f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a57ce0 0x559b81a67a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81823920 con 0x559b81a51bb0 2023-09-21T13:01:07.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81a44360 con 0x559b81a573c0 2023-09-21T13:01:07.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81a4d5e0 con 0x559b81a57ce0 2023-09-21T13:01:07.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a626f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35408/0 (socket says 172.21.15.142:35408) 2023-09-21T13:01:07.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e01d9b700 1 -- 172.21.15.142:0/2668287966 learned_addr learned my addr 172.21.15.142:0/2668287966 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a57ce0 0x559b81a67a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 -- 172.21.15.142:0/2668287966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a57ce0 msgr2=0x559b81a67a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a57ce0 0x559b81a67a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 -- 172.21.15.142:0/2668287966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 msgr2=0x559b81a51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e0259c700 1 -- 172.21.15.142:0/2668287966 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b81a48800 con 0x559b81a573c0 2023-09-21T13:01:07.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.730+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:07.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5e0259c700 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a626f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5df4005850 tx=0x7f5df400b630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64d0a6a3e9988c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5df17fa700 1 -- 172.21.15.142:0/2668287966 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df401d040 con 0x559b81a573c0 2023-09-21T13:01:07.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5df17fa700 1 -- 172.21.15.142:0/2668287966 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5df401e040 con 0x559b81a573c0 2023-09-21T13:01:07.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5df17fa700 1 -- 172.21.15.142:0/2668287966 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400fab0 con 0x559b81a573c0 2023-09-21T13:01:07.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2668287966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 msgr2=0x559b81a626f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.731+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a626f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5df4005850 tx=0x7f5df400b630 comp rx=0 tx=0).stop 2023-09-21T13:01:07.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2668287966 shutdown_connections 2023-09-21T13:01:07.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a51bb0 0x559b81a51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a57ce0 0x559b81a67a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/2668287966 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a573c0 0x559b81a626f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2668287966 >> 172.21.15.142:0/2668287966 conn(0x559b8197e000 msgr2=0x559b81a51f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2668287966 shutdown_connections 2023-09-21T13:01:07.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 -- 172.21.15.142:0/2668287966 wait complete. 2023-09-21T13:01:07.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 -- start start 2023-09-21T13:01:07.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.732+0000 7f5e1c814b80 1 Processor -- start 2023-09-21T13:01:07.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81ab3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 0x559b81ab3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 0x559b81ab4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81abe600 con 0x559b81a573c0 2023-09-21T13:01:07.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81abe740 con 0x559b81a57ce0 2023-09-21T13:01:07.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b81abe900 con 0x559b81a51bb0 2023-09-21T13:01:07.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e1c814b80 10 client.0 _ll_register_callbacks cb 0x559b81889a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:07.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81ab3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 0x559b81ab3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e01d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81ab3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60408/0 (socket says 172.21.15.142:60408) 2023-09-21T13:01:07.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e01d9b700 1 -- 172.21.15.142:0/3704254537 learned_addr learned my addr 172.21.15.142:0/3704254537 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:07.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 0x559b81ab4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 -- 172.21.15.142:0/3704254537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 msgr2=0x559b81ab3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81ab3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 -- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 msgr2=0x559b81ab4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:07.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 0x559b81ab4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e0259c700 1 -- 172.21.15.142:0/3704254537 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df8029040 con 0x559b81a573c0 2023-09-21T13:01:07.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.733+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 0x559b81ab4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:07.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5e0259c700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 0x559b81ab3ac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x559b81a52710 tx=0x7f5df400bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cef04d94c946b5b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:07.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5de9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:01:07.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df4024890 con 0x559b81a573c0 2023-09-21T13:01:07.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5df800f6d0 con 0x559b81a573c0 2023-09-21T13:01:07.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5df4000e40 con 0x559b81a573c0 2023-09-21T13:01:07.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5df4004500 con 0x559b81a573c0 2023-09-21T13:01:07.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5e1c814b80 10 client.16761 fetch_fsmap learned FSMap version 26 2023-09-21T13:01:07.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559b817b6c60 con 0x559b81a573c0 2023-09-21T13:01:07.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.734+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5df404e020 con 0x559b81a573c0 2023-09-21T13:01:07.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5df404a7b0 con 0x559b81a573c0 2023-09-21T13:01:07.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 10 client.16761 fetch_fsmap finished waiting for FSMap version 26 2023-09-21T13:01:07.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 10 client.16761 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:07.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 20 client.16761 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:07.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81abfaf0 0x559b81ac1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:07.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 4 client.16761 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:07.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559b8199be60 con 0x559b81abfaf0 2023-09-21T13:01:07.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81abfaf0 0x559b81ac1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:07.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e01d9b700 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81abfaf0 0x559b81ac1ee0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e96f8ba7925175 server_cookie=1b4ec1033188f32d in_seq=0 out_seq=0 2023-09-21T13:01:07.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5de9ffb700 10 client.16761 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:07.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5de9ffb700 1 -- 172.21.15.142:0/3704254537 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559b8199be60 con 0x559b81abfaf0 2023-09-21T13:01:07.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5de9ffb700 10 client.16761 handle_command_reply: tid=0 2023-09-21T13:01:07.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.735+0000 7f5e1c814b80 1 client.16761 shutdown 2023-09-21T13:01:07.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 msgr2=0x559b81ab3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 0x559b81ab3ac0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x559b81a52710 tx=0x7f5df400bb40 comp rx=0 tx=0).stop 2023-09-21T13:01:07.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 shutdown_connections 2023-09-21T13:01:07.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x559b81abfaf0 0x559b81ac1ee0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x559b81a57ce0 0x559b81ab4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x559b81a51bb0 0x559b81ab3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 --2- 172.21.15.142:0/3704254537 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x559b81a573c0 0x559b81ab3ac0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 >> 172.21.15.142:0/3704254537 conn(0x559b8197e000 msgr2=0x559b81a66e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5de9ffb700 0 client.16761 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:07.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 shutdown_connections 2023-09-21T13:01:07.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 1 -- 172.21.15.142:0/3704254537 wait complete. 2023-09-21T13:01:07.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.736+0000 7f5e1c814b80 20 client.16761 trim_cache size 0 max 16384 2023-09-21T13:01:07.756 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:07.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 msgr2=0x7f5dec0a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 0x7f5dec0a2d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00ef90 tx=0x7f5dfc0092e0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 msgr2=0x7f5e041a4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:07.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 0x7f5e041a4e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc00efc0 tx=0x7f5dfc00c3a0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 shutdown_connections 2023-09-21T13:01:07.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5dec0a0850 0x7f5dec0a2d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e04100e40 0x7f5e040730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e04073b60 0x7f5e041a4e90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 --2- 172.21.15.142:0/1709869892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e04105f60 0x7f5e04073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:07.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 >> 172.21.15.142:0/1709869892 conn(0x7f5e040fc6a0 msgr2=0x7f5e04104810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:07.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 shutdown_connections 2023-09-21T13:01:07.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:07.737+0000 7f5e0359e700 1 -- 172.21.15.142:0/1709869892 wait complete. 2023-09-21T13:01:07.759 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:07 smithi142 ceph-mon[97663]: pgmap v149: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 401 op/s 2023-09-21T13:01:07.760 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:07 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1732891409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:07.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:07 smithi156 ceph-mon[134078]: pgmap v149: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 401 op/s 2023-09-21T13:01:07.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:07 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1732891409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:07 smithi160 ceph-mon[134450]: pgmap v149: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.2 MiB/s wr, 401 op/s 2023-09-21T13:01:07.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:07 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1732891409' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:08.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.50 MB/sec execute 109 sec latency 86.815 ms 2023-09-21T13:01:08.761 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T13:01:08.762 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T13:01:08.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 -- 172.21.15.142:0/3365239480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6104100fa0 msgr2=0x7f6104101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:08.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 --2- 172.21.15.142:0/3365239480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6104100fa0 0x7f6104101380 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6100009990 tx=0x7f6100009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 -- 172.21.15.142:0/3365239480 shutdown_connections 2023-09-21T13:01:08.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 --2- 172.21.15.142:0/3365239480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6104100fa0 0x7f6104101380 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 --2- 172.21.15.142:0/3365239480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61041060c0 0x7f610410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 --2- 172.21.15.142:0/3365239480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104101950 0x7f6104105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 -- 172.21.15.142:0/3365239480 >> 172.21.15.142:0/3365239480 conn(0x7f61040fc860 msgr2=0x7f61040fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:08.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 -- 172.21.15.142:0/3365239480 shutdown_connections 2023-09-21T13:01:08.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.966+0000 7f610bfff700 1 -- 172.21.15.142:0/3365239480 wait complete. 2023-09-21T13:01:08.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 Processor -- start 2023-09-21T13:01:08.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 -- start start 2023-09-21T13:01:08.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 0x7f6104199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e4b0 con 0x7f61041060c0 2023-09-21T13:01:08.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.967+0000 7f610bfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e620 con 0x7f6104100fa0 2023-09-21T13:01:08.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610bfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610419e7e0 con 0x7f610419da30 2023-09-21T13:01:08.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60416/0 (socket says 172.21.15.142:60416) 2023-09-21T13:01:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35440/0 (socket says 172.21.15.142:35440) 2023-09-21T13:01:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 -- 172.21.15.142:0/3569746012 learned_addr learned my addr 172.21.15.142:0/3569746012 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 0x7f6104199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 -- 172.21.15.142:0/3569746012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 msgr2=0x7f6104199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:08.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 0x7f6104199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 -- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 msgr2=0x7f6104199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 -- 172.21.15.142:0/3569746012 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61000095f0 con 0x7f610419da30 2023-09-21T13:01:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610959a700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:08.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 0x7f6104199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:08.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.968+0000 7f610a59c700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00ef30 tx=0x7f60fc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:08.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.969+0000 7f60faffd700 1 -- 172.21.15.142:0/3569746012 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc018070 con 0x7f610419da30 2023-09-21T13:01:08.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.969+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61041a5ce0 con 0x7f610419da30 2023-09-21T13:01:08.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.969+0000 7f60faffd700 1 -- 172.21.15.142:0/3569746012 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60fc00f040 con 0x7f610419da30 2023-09-21T13:01:08.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.969+0000 7f60faffd700 1 -- 172.21.15.142:0/3569746012 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00cd00 con 0x7f610419da30 2023-09-21T13:01:08.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.969+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61041a6210 con 0x7f610419da30 2023-09-21T13:01:08.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.972+0000 7f60faffd700 1 -- 172.21.15.142:0/3569746012 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f60fc003a00 con 0x7f610419da30 2023-09-21T13:01:08.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.973+0000 7f611f909b80 1 Processor -- start 2023-09-21T13:01:08.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 -- start start 2023-09-21T13:01:08.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709fb0 0x5577d570dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d570e3e0 0x5577d570e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d567dd20 con 0x5577d5709fb0 2023-09-21T13:01:08.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d5661cf0 con 0x5577d570e3e0 2023-09-21T13:01:08.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f611f909b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d565f610 con 0x5577d5709690 2023-09-21T13:01:08.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f60faffd700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 0x7f60f00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f610959a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60430/0 (socket says 172.21.15.142:60430) 2023-09-21T13:01:08.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.974+0000 7f60faffd700 1 -- 172.21.15.142:0/3569746012 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f60fc0cba20 con 0x7f610419da30 2023-09-21T13:01:08.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 -- 172.21.15.142:0/3458416554 learned_addr learned my addr 172.21.15.142:0/3458416554 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:08.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d570e3e0 0x5577d570e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610a59c700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 0x7f60f00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709fb0 0x5577d570dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 -- 172.21.15.142:0/3458416554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d570e3e0 msgr2=0x5577d570e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:08.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d570e3e0 0x5577d570e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 -- 172.21.15.142:0/3458416554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709fb0 msgr2=0x5577d570dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:08.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709fb0 0x5577d570dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 -- 172.21.15.142:0/3458416554 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577d5485e60 con 0x5577d5709690 2023-09-21T13:01:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610959a700 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60f4011c40 tx=0x7f60f40047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fcd750e144b0670 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f610a59c700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 0x7f60f00a2c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0c91a0 tx=0x7f60fc0092e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f60effff700 1 -- 172.21.15.142:0/3458416554 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4004030 con 0x5577d5709690 2023-09-21T13:01:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f60effff700 1 -- 172.21.15.142:0/3458416554 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60f400f6d0 con 0x5577d5709690 2023-09-21T13:01:08.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.975+0000 7f60effff700 1 -- 172.21.15.142:0/3458416554 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f40038e0 con 0x5577d5709690 2023-09-21T13:01:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 -- 172.21.15.142:0/3458416554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 msgr2=0x5577d5709a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f60f4011c40 tx=0x7f60f40047c0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 -- 172.21.15.142:0/3458416554 shutdown_connections 2023-09-21T13:01:08.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d570e3e0 0x5577d570e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d5709a70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 --2- 172.21.15.142:0/3458416554 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709fb0 0x5577d570dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 -- 172.21.15.142:0/3458416554 >> 172.21.15.142:0/3458416554 conn(0x5577d5636080 msgr2=0x5577d5704720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 -- 172.21.15.142:0/3458416554 shutdown_connections 2023-09-21T13:01:08.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.976+0000 7f611f909b80 1 -- 172.21.15.142:0/3458416554 wait complete. 2023-09-21T13:01:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 -- start start 2023-09-21T13:01:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 Processor -- start 2023-09-21T13:01:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709690 0x5577d5712ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709fb0 0x5577d5713430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d565af00 con 0x5577d570e3e0 2023-09-21T13:01:08.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d55f77c0 con 0x5577d5709690 2023-09-21T13:01:08.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d55f7460 con 0x5577d5709fb0 2023-09-21T13:01:08.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.977+0000 7f611f909b80 10 client.0 _ll_register_callbacks cb 0x5577d5541b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:08.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35462/0 (socket says 172.21.15.142:35462) 2023-09-21T13:01:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 -- 172.21.15.142:0/29535008 learned_addr learned my addr 172.21.15.142:0/29535008 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f6109d9b700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709fb0 0x5577d5713430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709690 0x5577d5712ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 -- 172.21.15.142:0/29535008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709fb0 msgr2=0x5577d5713430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709fb0 0x5577d5713430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 -- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709690 msgr2=0x5577d5712ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709690 0x5577d5712ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 -- 172.21.15.142:0/29535008 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f4019040 con 0x5577d570e3e0 2023-09-21T13:01:08.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f610959a700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60f400fea0 tx=0x7f60f4009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3d24e97d93fde4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.978+0000 7f60ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f402f440 con 0x5577d570e3e0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5577d55cbc30 con 0x5577d570e3e0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f60f401f3f0 con 0x5577d570e3e0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60f401f5b0 con 0x5577d570e3e0 2023-09-21T13:01:08.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 10 client.16773 fetch_fsmap learned FSMap version 27 2023-09-21T13:01:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5577d546ece0 con 0x5577d570e3e0 2023-09-21T13:01:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5577d55cbc30 con 0x5577d570e3e0 2023-09-21T13:01:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f60f402f740 con 0x5577d570e3e0 2023-09-21T13:01:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 10 client.16773 fetch_fsmap finished waiting for FSMap version 27 2023-09-21T13:01:08.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 10 client.16773 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:08.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 20 client.16773 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:08.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5723340 0x5577d5725760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:08.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 4 client.16773 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:08.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.979+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577d56d80a0 con 0x5577d5723340 2023-09-21T13:01:08.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.980+0000 7f6109d9b700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5723340 0x5577d5725760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:08.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.980+0000 7f60ed7fa700 10 client.16773 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:08.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.980+0000 7f6109d9b700 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5723340 0x5577d5725760 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c575003bf2f42060 server_cookie=ddee8c9838ea21b8 in_seq=0 out_seq=0 2023-09-21T13:01:08.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f60ed7fa700 1 -- 172.21.15.142:0/29535008 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5577d56d80a0 con 0x5577d5723340 2023-09-21T13:01:08.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f60ed7fa700 10 client.16773 handle_command_reply: tid=0 2023-09-21T13:01:08.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 client.16773 shutdown 2023-09-21T13:01:08.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 msgr2=0x5577d5713970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:08.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f60f400fea0 tx=0x7f60f4009be0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 shutdown_connections 2023-09-21T13:01:08.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5723340 0x5577d5725760 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5713970 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709690 0x5577d5712ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f60ed7fa700 0 client.16773 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:08.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 --2- 172.21.15.142:0/29535008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709fb0 0x5577d5713430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:08.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 >> 172.21.15.142:0/29535008 conn(0x5577d5636080 msgr2=0x5577d5704310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:08.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 shutdown_connections 2023-09-21T13:01:08.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 1 -- 172.21.15.142:0/29535008 wait complete. 2023-09-21T13:01:08.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.981+0000 7f611f909b80 20 client.16773 trim_cache size 0 max 16384 2023-09-21T13:01:09.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 Processor -- start 2023-09-21T13:01:09.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 -- start start 2023-09-21T13:01:09.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d570de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d570bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5708ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d54db9a0 con 0x5577d570e3e0 2023-09-21T13:01:09.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d57143c0 con 0x5577d5709fb0 2023-09-21T13:01:09.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f611f909b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d5705210 con 0x5577d5709690 2023-09-21T13:01:09.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f610959a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d570de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f6109d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d570bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f610959a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d570de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60440/0 (socket says 172.21.15.142:60440) 2023-09-21T13:01:09.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f610959a700 1 -- 172.21.15.142:0/3130701046 learned_addr learned my addr 172.21.15.142:0/3130701046 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f610959a700 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5708ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:08.999+0000 7f6109d9b700 1 -- 172.21.15.142:0/3130701046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 msgr2=0x5577d570de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d570de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f6109d9b700 1 -- 172.21.15.142:0/3130701046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 msgr2=0x5577d5708ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5708ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f6109d9b700 1 -- 172.21.15.142:0/3130701046 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577d5700630 con 0x5577d5709fb0 2023-09-21T13:01:09.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f6109d9b700 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d570bcd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610000b2e0 tx=0x7f6100005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae61b7cce94fc852 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f60f8ff9700 1 -- 172.21.15.142:0/3130701046 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610001d040 con 0x5577d5709fb0 2023-09-21T13:01:09.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f60f8ff9700 1 -- 172.21.15.142:0/3130701046 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f610001e040 con 0x5577d5709fb0 2023-09-21T13:01:09.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.000+0000 7f60f8ff9700 1 -- 172.21.15.142:0/3130701046 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100005430 con 0x5577d5709fb0 2023-09-21T13:01:09.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- 172.21.15.142:0/3130701046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 msgr2=0x5577d570bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d570bcd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f610000b2e0 tx=0x7f6100005fb0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- 172.21.15.142:0/3130701046 shutdown_connections 2023-09-21T13:01:09.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d570e3e0 0x5577d5708ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d5709690 0x5577d570de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 --2- 172.21.15.142:0/3130701046 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d570bcd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- 172.21.15.142:0/3130701046 >> 172.21.15.142:0/3130701046 conn(0x5577d5636080 msgr2=0x5577d5708490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- 172.21.15.142:0/3130701046 shutdown_connections 2023-09-21T13:01:09.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- 172.21.15.142:0/3130701046 wait complete. 2023-09-21T13:01:09.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 -- start start 2023-09-21T13:01:09.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.001+0000 7f611f909b80 1 Processor -- start 2023-09-21T13:01:09.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709690 0x5577d5719360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d570e3e0 0x5577d5777180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d57776c0 con 0x5577d5709690 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d5777800 con 0x5577d5709fb0 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577d5777970 con 0x5577d570e3e0 2023-09-21T13:01:09.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f611f909b80 10 client.0 _ll_register_callbacks cb 0x5577d5541b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:09.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f610959a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709690 0x5577d5719360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58832/0 (socket says 172.21.15.142:58832) 2023-09-21T13:01:09.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 -- 172.21.15.142:0/483350709 learned_addr learned my addr 172.21.15.142:0/483350709 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f610959a700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d570e3e0 0x5577d5777180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 -- 172.21.15.142:0/483350709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d570e3e0 msgr2=0x5577d5777180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d570e3e0 0x5577d5777180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 -- 172.21.15.142:0/483350709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709690 msgr2=0x5577d5719360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709690 0x5577d5719360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.002+0000 7f6109d9b700 1 -- 172.21.15.142:0/483350709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610410e4b0 con 0x5577d5709fb0 2023-09-21T13:01:09.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f6109d9b700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6100009ce0 tx=0x7f610000bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec16a4abd4f3702 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:09.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610001d040 con 0x5577d5709fb0 2023-09-21T13:01:09.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f60f400f6d0 con 0x5577d5709fb0 2023-09-21T13:01:09.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6100029350 con 0x5577d5709fb0 2023-09-21T13:01:09.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6100029510 con 0x5577d5709fb0 2023-09-21T13:01:09.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 10 client.26879 fetch_fsmap learned FSMap version 27 2023-09-21T13:01:09.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5577d54ac2d0 con 0x5577d5709fb0 2023-09-21T13:01:09.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60f400f6d0 con 0x5577d5709fb0 2023-09-21T13:01:09.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6100041080 con 0x5577d5709fb0 2023-09-21T13:01:09.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 10 client.26879 fetch_fsmap finished waiting for FSMap version 27 2023-09-21T13:01:09.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 10 client.26879 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:09.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 20 client.26879 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:09.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5778d20 0x5577d577b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 4 client.26879 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T13:01:09.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.003+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5577d5653ee0 con 0x5577d5778d20 2023-09-21T13:01:09.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.004+0000 7f610959a700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5778d20 0x5577d577b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.004+0000 7f60ed7fa700 10 client.26879 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.004+0000 7f610959a700 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5778d20 0x5577d577b140 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856b99e4a0dcbdf3 server_cookie=700a6caab8a063f4 in_seq=0 out_seq=0 2023-09-21T13:01:09.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f60ed7fa700 1 -- 172.21.15.142:0/483350709 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5577d5653ee0 con 0x5577d5778d20 2023-09-21T13:01:09.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f60ed7fa700 10 client.26879 handle_command_reply: tid=0 2023-09-21T13:01:09.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 client.26879 shutdown 2023-09-21T13:01:09.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 msgr2=0x5577d57198a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6100009ce0 tx=0x7f610000bf60 comp rx=0 tx=0).stop 2023-09-21T13:01:09.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 shutdown_connections 2023-09-21T13:01:09.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5577d5778d20 0x5577d577b140 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5577d5709690 0x5577d5719360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5577d570e3e0 0x5577d5777180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 --2- 172.21.15.142:0/483350709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5577d5709fb0 0x5577d57198a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f60ed7fa700 0 client.26879 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.005+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 >> 172.21.15.142:0/483350709 conn(0x5577d5636080 msgr2=0x5577d570dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 shutdown_connections 2023-09-21T13:01:09.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f611f909b80 1 -- 172.21.15.142:0/483350709 wait complete. 2023-09-21T13:01:09.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f611f909b80 20 client.26879 trim_cache size 0 max 16384 2023-09-21T13:01:09.023 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:09.023 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T13:01:09.023 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "ebc8e05c-cc60-4924-af76-9289cae0adf7", 2023-09-21T13:01:09.024 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T13:01:09.024 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:09.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 msgr2=0x7f60f00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 0x7f60f00a2c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0c91a0 tx=0x7f60fc0092e0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 msgr2=0x7f610419deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00ef30 tx=0x7f60fc00c3a0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 shutdown_connections 2023-09-21T13:01:09.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f60f00a07b0 0x7f60f00a2c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610419da30 0x7f610419deb0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6104100fa0 0x7f6104199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 --2- 172.21.15.142:0/3569746012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f61041060c0 0x7f6104199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 >> 172.21.15.142:0/3569746012 conn(0x7f61040fc860 msgr2=0x7f61040fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 shutdown_connections 2023-09-21T13:01:09.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.006+0000 7f610bfff700 1 -- 172.21.15.142:0/3569746012 wait complete. 2023-09-21T13:01:09.028 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:01:09.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 -- 172.21.15.142:0/912143615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c100f90 msgr2=0x7f031c101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 --2- 172.21.15.142:0/912143615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c100f90 0x7f031c101370 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f030c009990 tx=0x7f030c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 -- 172.21.15.142:0/912143615 shutdown_connections 2023-09-21T13:01:09.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 --2- 172.21.15.142:0/912143615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c1060b0 0x7f031c10dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 --2- 172.21.15.142:0/912143615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c100f90 0x7f031c101370 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 --2- 172.21.15.142:0/912143615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c101940 0x7f031c105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 -- 172.21.15.142:0/912143615 >> 172.21.15.142:0/912143615 conn(0x7f031c0fc850 msgr2=0x7f031c0fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 -- 172.21.15.142:0/912143615 shutdown_connections 2023-09-21T13:01:09.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.230+0000 7f03209ff700 1 -- 172.21.15.142:0/912143615 wait complete. 2023-09-21T13:01:09.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.231+0000 7f03209ff700 1 Processor -- start 2023-09-21T13:01:09.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 -- start start 2023-09-21T13:01:09.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c1060b0 0x7f031c073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 0x7f031c1a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1a5750 con 0x7f031c100f90 2023-09-21T13:01:09.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1a58c0 con 0x7f031c073b60 2023-09-21T13:01:09.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f03209ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c1a5a80 con 0x7f031c1060b0 2023-09-21T13:01:09.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f031a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f031a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35496/0 (socket says 172.21.15.142:35496) 2023-09-21T13:01:09.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f031a59c700 1 -- 172.21.15.142:0/2887532336 learned_addr learned my addr 172.21.15.142:0/2887532336 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f031ad9d700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 0x7f031c1a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.232+0000 7f0319d9b700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c1060b0 0x7f031c073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 -- 172.21.15.142:0/2887532336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c1060b0 msgr2=0x7f031c073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c1060b0 0x7f031c073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 -- 172.21.15.142:0/2887532336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 msgr2=0x7f031c1a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 0x7f031c1a50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 -- 172.21.15.142:0/2887532336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0095f0 con 0x7f031c100f90 2023-09-21T13:01:09.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031ad9d700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 0x7f031c1a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:09.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f031a59c700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c010 tx=0x7f030c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f030b7fe700 1 -- 172.21.15.142:0/2887532336 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c01d070 con 0x7f031c100f90 2023-09-21T13:01:09.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f030b7fe700 1 -- 172.21.15.142:0/2887532336 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f030c022470 con 0x7f031c100f90 2023-09-21T13:01:09.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c1a5d00 con 0x7f031c100f90 2023-09-21T13:01:09.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f030b7fe700 1 -- 172.21.15.142:0/2887532336 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c017650 con 0x7f031c100f90 2023-09-21T13:01:09.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.233+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c1a6120 con 0x7f031c100f90 2023-09-21T13:01:09.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.236+0000 7f030b7fe700 1 -- 172.21.15.142:0/2887532336 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f030c0225e0 con 0x7f031c100f90 2023-09-21T13:01:09.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 Processor -- start 2023-09-21T13:01:09.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f030b7fe700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 0x7f03040a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 -- start start 2023-09-21T13:01:09.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f030b7fe700 1 -- 172.21.15.142:0/2887532336 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f030c0cd160 con 0x7f031c100f90 2023-09-21T13:01:09.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f0319d9b700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 0x7f03040a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637638e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.245 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x5576376397c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576375a8ca0 con 0x557637639360 2023-09-21T13:01:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763758cc70 con 0x557637634f30 2023-09-21T13:01:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.238+0000 7f033424ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763758a590 con 0x557637634610 2023-09-21T13:01:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x5576376397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60476/0 (socket says 172.21.15.142:60476) 2023-09-21T13:01:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 -- 172.21.15.142:0/1648450263 learned_addr learned my addr 172.21.15.142:0/1648450263 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f0319d9b700 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637638e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 -- 172.21.15.142:0/1648450263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 msgr2=0x557637638e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637638e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 -- 172.21.15.142:0/1648450263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 msgr2=0x5576376397c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x5576376397c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 -- 172.21.15.142:0/1648450263 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576373b0de0 con 0x557637634610 2023-09-21T13:01:09.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f0319d9b700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 0x7f03040a2c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f031c0748d0 tx=0x7f0310009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f031a59c700 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f030c0a2120 tx=0x7f030c09a4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cefac2b82647398 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f0308ff9700 1 -- 172.21.15.142:0/1648450263 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c09ad70 con 0x557637634610 2023-09-21T13:01:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f0308ff9700 1 -- 172.21.15.142:0/1648450263 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f030c09a670 con 0x557637634610 2023-09-21T13:01:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.239+0000 7f0308ff9700 1 -- 172.21.15.142:0/1648450263 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c09e2d0 con 0x557637634610 2023-09-21T13:01:09.249 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 -- 172.21.15.142:0/1648450263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 msgr2=0x5576376349f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f030c0a2120 tx=0x7f030c09a4c0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 -- 172.21.15.142:0/1648450263 shutdown_connections 2023-09-21T13:01:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x5576376397c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376349f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.250 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 --2- 172.21.15.142:0/1648450263 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637638e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 -- 172.21.15.142:0/1648450263 >> 172.21.15.142:0/1648450263 conn(0x557637561000 msgr2=0x55763762f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 -- 172.21.15.142:0/1648450263 shutdown_connections 2023-09-21T13:01:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.240+0000 7f033424ab80 1 -- 172.21.15.142:0/1648450263 wait complete. 2023-09-21T13:01:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.241+0000 7f033424ab80 1 -- start start 2023-09-21T13:01:09.251 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.241+0000 7f033424ab80 1 Processor -- start 2023-09-21T13:01:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.241+0000 7f033424ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.241+0000 7f033424ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634f30 0x55763763de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f033424ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x55763763e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f033424ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557637585e80 con 0x557637634f30 2023-09-21T13:01:09.252 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f033424ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557637522740 con 0x557637639360 2023-09-21T13:01:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f033424ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576375223e0 con 0x557637634610 2023-09-21T13:01:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f033424ab80 10 client.0 _ll_register_callbacks cb 0x55763746ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60482/0 (socket says 172.21.15.142:60482) 2023-09-21T13:01:09.253 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634f30 0x55763763de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 -- 172.21.15.142:0/1781952511 learned_addr learned my addr 172.21.15.142:0/1781952511 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031ad9d700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x55763763e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 -- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 msgr2=0x55763763e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x55763763e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.254 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 -- 172.21.15.142:0/1781952511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634f30 msgr2=0x55763763de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634f30 0x55763763de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 -- 172.21.15.142:0/1781952511 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c1a6120 con 0x557637634610 2023-09-21T13:01:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031ad9d700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x55763763e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:09.255 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f031a59c700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f030c09a600 tx=0x7f030c0ca7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d6f5657fb606a78 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f0301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.242+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c0a2650 con 0x557637634610 2023-09-21T13:01:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f030c0850b0 con 0x557637634610 2023-09-21T13:01:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576374f6bb0 con 0x557637634610 2023-09-21T13:01:09.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f030c085270 con 0x557637634610 2023-09-21T13:01:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 10 client.26848 fetch_fsmap learned FSMap version 27 2023-09-21T13:01:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557637399c60 con 0x557637634610 2023-09-21T13:01:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576374f6bb0 con 0x557637634610 2023-09-21T13:01:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f030c0a21c0 con 0x557637634610 2023-09-21T13:01:09.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 10 client.26848 fetch_fsmap finished waiting for FSMap version 27 2023-09-21T13:01:09.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 10 client.26848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:09.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 20 client.26848 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:09.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55763764dba0 0x55763764ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 4 client.26848 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:09.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.243+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557637603020 con 0x55763764dba0 2023-09-21T13:01:09.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.244+0000 7f0319d9b700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55763764dba0 0x55763764ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.244+0000 7f0301ffb700 10 client.26848 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.244+0000 7f0319d9b700 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55763764dba0 0x55763764ffc0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54debc3a02b5746b server_cookie=5e2df257bc4c7ca4 in_seq=0 out_seq=0 2023-09-21T13:01:09.259 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f0301ffb700 1 -- 172.21.15.142:0/1781952511 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557637603020 con 0x55763764dba0 2023-09-21T13:01:09.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f0301ffb700 10 client.26848 handle_command_reply: tid=0 2023-09-21T13:01:09.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 client.26848 shutdown 2023-09-21T13:01:09.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 msgr2=0x557637640ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f030c09a600 tx=0x7f030c0ca7f0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 shutdown_connections 2023-09-21T13:01:09.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55763764dba0 0x55763764ffc0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x55763763e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f0301ffb700 0 client.26848 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x557637640ae0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 --2- 172.21.15.142:0/1781952511 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634f30 0x55763763de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 >> 172.21.15.142:0/1781952511 conn(0x557637561000 msgr2=0x55763762f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 shutdown_connections 2023-09-21T13:01:09.266 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 1 -- 172.21.15.142:0/1781952511 wait complete. 2023-09-21T13:01:09.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.245+0000 7f033424ab80 20 client.26848 trim_cache size 0 max 16384 2023-09-21T13:01:09.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.262+0000 7f033424ab80 1 Processor -- start 2023-09-21T13:01:09.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.262+0000 7f033424ab80 1 -- start start 2023-09-21T13:01:09.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x5576376405a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557637406920 con 0x557637634610 2023-09-21T13:01:09.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763764a140 con 0x557637639360 2023-09-21T13:01:09.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f033424ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55763763ea30 con 0x557637634f30 2023-09-21T13:01:09.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f031a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60496/0 (socket says 172.21.15.142:60496) 2023-09-21T13:01:09.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f031a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35530/0 (socket says 172.21.15.142:35530) 2023-09-21T13:01:09.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 -- 172.21.15.142:0/3504540808 learned_addr learned my addr 172.21.15.142:0/3504540808 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f031ad9d700 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x5576376405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 -- 172.21.15.142:0/3504540808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 msgr2=0x5576376405a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x5576376405a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 -- 172.21.15.142:0/3504540808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 msgr2=0x557637636c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f0319d9b700 1 -- 172.21.15.142:0/3504540808 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5576373d7250 con 0x557637634f30 2023-09-21T13:01:09.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.263+0000 7f031a59c700 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:09.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55763763f440 tx=0x7f031001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6631d1f50cc44 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f03097fa700 1 -- 172.21.15.142:0/3504540808 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310022040 con 0x557637634f30 2023-09-21T13:01:09.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f03097fa700 1 -- 172.21.15.142:0/3504540808 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f03100045e0 con 0x557637634f30 2023-09-21T13:01:09.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f03097fa700 1 -- 172.21.15.142:0/3504540808 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031001c440 con 0x557637634f30 2023-09-21T13:01:09.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 -- 172.21.15.142:0/3504540808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 msgr2=0x55763763ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55763763f440 tx=0x7f031001a000 comp rx=0 tx=0).stop 2023-09-21T13:01:09.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 -- 172.21.15.142:0/3504540808 shutdown_connections 2023-09-21T13:01:09.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637634610 0x557637636c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637639360 0x5576376405a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.264+0000 7f033424ab80 1 --2- 172.21.15.142:0/3504540808 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634f30 0x55763763ddb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.265+0000 7f033424ab80 1 -- 172.21.15.142:0/3504540808 >> 172.21.15.142:0/3504540808 conn(0x557637561000 msgr2=0x55763763d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.265+0000 7f033424ab80 1 -- 172.21.15.142:0/3504540808 shutdown_connections 2023-09-21T13:01:09.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.265+0000 7f033424ab80 1 -- 172.21.15.142:0/3504540808 wait complete. 2023-09-21T13:01:09.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.265+0000 7f033424ab80 1 -- start start 2023-09-21T13:01:09.275 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.265+0000 7f033424ab80 1 Processor -- start 2023-09-21T13:01:09.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637643d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x557637644240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576376a19a0 con 0x557637639360 2023-09-21T13:01:09.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576376a1ae0 con 0x557637634f30 2023-09-21T13:01:09.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576376a1c50 con 0x557637634610 2023-09-21T13:01:09.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f033424ab80 10 client.0 _ll_register_callbacks cb 0x55763746ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:09.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60502/0 (socket says 172.21.15.142:60502) 2023-09-21T13:01:09.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 -- 172.21.15.142:0/3905046242 learned_addr learned my addr 172.21.15.142:0/3905046242 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:09.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637643d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031ad9d700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x557637644240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 -- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 msgr2=0x557637643d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637643d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 -- 172.21.15.142:0/3905046242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 msgr2=0x557637644240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:09.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x557637644240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 -- 172.21.15.142:0/3905046242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557637399c60 con 0x557637634610 2023-09-21T13:01:09.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637643d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031ad9d700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x557637644240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f031a59c700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f030c006010 tx=0x7f030c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cacff7750c0ba3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.266+0000 7f0301ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c099d60 con 0x557637634610 2023-09-21T13:01:09.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f030c09ad70 con 0x557637634610 2023-09-21T13:01:09.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f030c09a670 con 0x557637634610 2023-09-21T13:01:09.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f030c0a2650 con 0x557637634610 2023-09-21T13:01:09.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 10 client.26854 fetch_fsmap learned FSMap version 27 2023-09-21T13:01:09.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0310017050 con 0x557637634610 2023-09-21T13:01:09.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f030c09a670 con 0x557637634610 2023-09-21T13:01:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f030c09a8d0 con 0x557637634610 2023-09-21T13:01:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 10 client.26854 fetch_fsmap finished waiting for FSMap version 27 2023-09-21T13:01:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 10 client.26854 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 20 client.26854 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:09.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576376a2ee0 0x5576376a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 4 client.26854 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:01:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.267+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55763757ee60 con 0x5576376a2ee0 2023-09-21T13:01:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576376a2ee0 0x5576376a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0319d9b700 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576376a2ee0 0x5576376a52d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53e8a490cd772195 server_cookie=794680e8225a015a in_seq=0 out_seq=0 2023-09-21T13:01:09.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0301ffb700 10 client.26854 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0301ffb700 1 -- 172.21.15.142:0/3905046242 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55763757ee60 con 0x5576376a2ee0 2023-09-21T13:01:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0301ffb700 10 client.26854 handle_command_reply: tid=0 2023-09-21T13:01:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 client.26854 shutdown 2023-09-21T13:01:09.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 msgr2=0x5576376437c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f030c006010 tx=0x7f030c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 shutdown_connections 2023-09-21T13:01:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576376a2ee0 0x5576376a52d0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557637639360 0x557637644240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557637634610 0x5576376437c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 --2- 172.21.15.142:0/3905046242 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557637634f30 0x557637643d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f0301ffb700 0 client.26854 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.268+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 >> 172.21.15.142:0/3905046242 conn(0x557637561000 msgr2=0x557637638410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 shutdown_connections 2023-09-21T13:01:09.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f033424ab80 1 -- 172.21.15.142:0/3905046242 wait complete. 2023-09-21T13:01:09.289 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f033424ab80 20 client.26854 trim_cache size 0 max 16384 2023-09-21T13:01:09.289 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:01:09.289 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:01:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "ebc8e05c-cc60-4924-af76-9289cae0adf7": { 2023-09-21T13:01:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:01:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "ebc8e05c-cc60-4924-af76-9289cae0adf7", 2023-09-21T13:01:09.290 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:01:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:01:09.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:01:09.291 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 msgr2=0x7f03040a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 0x7f03040a2c70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f031c0748d0 tx=0x7f0310009260 comp rx=0 tx=0).stop 2023-09-21T13:01:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 msgr2=0x7f031c0730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f030c00c010 tx=0x7f030c004730 comp rx=0 tx=0).stop 2023-09-21T13:01:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 shutdown_connections 2023-09-21T13:01:09.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f03040a07b0 0x7f03040a2c70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f031c100f90 0x7f031c0730e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f031c073b60 0x7f031c1a50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 --2- 172.21.15.142:0/2887532336 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f031c1060b0 0x7f031c073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 >> 172.21.15.142:0/2887532336 conn(0x7f031c0fc850 msgr2=0x7f031c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.269+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 shutdown_connections 2023-09-21T13:01:09.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:09.270+0000 7f03209ff700 1 -- 172.21.15.142:0/2887532336 wait complete. 2023-09-21T13:01:09.295 INFO:tasks.cephfs.filesystem:scrub status for tag:ebc8e05c-cc60-4924-af76-9289cae0adf7 - {'path': '/', 'tag': 'ebc8e05c-cc60-4924-af76-9289cae0adf7', 'options': 'recursive,force'} 2023-09-21T13:01:09.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.40 MB/sec execute 110 sec latency 1086.946 ms 2023-09-21T13:01:09.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: pgmap v150: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2023-09-21T13:01:09.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:09.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T13:01:09.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:09.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:09.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:09.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.907 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:09 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: pgmap v150: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2023-09-21T13:01:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:09.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T13:01:09.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:09.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:09.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:09.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.918 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:09 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: pgmap v150: 97 pgs: 97 active+clean; 129 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 288 op/s 2023-09-21T13:01:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:09.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T13:01:09.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:09.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:09.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:09.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.940 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:09 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 -- 172.21.15.142:0/1432568082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 msgr2=0x7f42681013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 --2- 172.21.15.142:0/1432568082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f42681013b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f42640098f0 tx=0x7f4264009c00 comp rx=0 tx=0).stop 2023-09-21T13:01:09.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 -- 172.21.15.142:0/1432568082 shutdown_connections 2023-09-21T13:01:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 --2- 172.21.15.142:0/1432568082 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 0x7f426810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 --2- 172.21.15.142:0/1432568082 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f42681013b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 --2- 172.21.15.142:0/1432568082 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4268101980 0x7f42681059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 -- 172.21.15.142:0/1432568082 >> 172.21.15.142:0/1432568082 conn(0x7f42680fc830 msgr2=0x7f42680fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:09.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 -- 172.21.15.142:0/1432568082 shutdown_connections 2023-09-21T13:01:10.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.998+0000 7f426f9ff700 1 -- 172.21.15.142:0/1432568082 wait complete. 2023-09-21T13:01:10.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.999+0000 7f426f9ff700 1 Processor -- start 2023-09-21T13:01:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:09.999+0000 7f426f9ff700 1 -- start start 2023-09-21T13:01:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 0x7f4268199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f426819dcf0 0x7f426819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819e770 con 0x7f426819dcf0 2023-09-21T13:01:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819e8e0 con 0x7f42681060f0 2023-09-21T13:01:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426f9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819eaa0 con 0x7f4268100fd0 2023-09-21T13:01:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60520/0 (socket says 172.21.15.142:60520) 2023-09-21T13:01:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 -- 172.21.15.142:0/3417828230 learned_addr learned my addr 172.21.15.142:0/3417828230 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426cf9a700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 0x7f4268199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426df9c700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f426819dcf0 0x7f426819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 -- 172.21.15.142:0/3417828230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 msgr2=0x7f4268199680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 0x7f4268199680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 -- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f426819dcf0 msgr2=0x7f426819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f426819dcf0 0x7f426819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.000+0000 7f426d79b700 1 -- 172.21.15.142:0/3417828230 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580095f0 con 0x7f4268100fd0 2023-09-21T13:01:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f426d79b700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4264009230 tx=0x7f426400bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f425e7fc700 1 -- 172.21.15.142:0/3417828230 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426401c070 con 0x7f4268100fd0 2023-09-21T13:01:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f425e7fc700 1 -- 172.21.15.142:0/3417828230 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42640058e0 con 0x7f4268100fd0 2023-09-21T13:01:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4264009520 con 0x7f4268100fd0 2023-09-21T13:01:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f425e7fc700 1 -- 172.21.15.142:0/3417828230 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640038e0 con 0x7f4268100fd0 2023-09-21T13:01:10.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.001+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42681a6230 con 0x7f4268100fd0 2023-09-21T13:01:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.004+0000 7f425e7fc700 1 -- 172.21.15.142:0/3417828230 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4264020030 con 0x7f4268100fd0 2023-09-21T13:01:10.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 Processor -- start 2023-09-21T13:01:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 -- start start 2023-09-21T13:01:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 0x5623dcd20480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd24910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd252b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc94c40 con 0x5623dcd200a0 2023-09-21T13:01:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc78c10 con 0x5623dcd24e50 2023-09-21T13:01:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.006+0000 7f42832e9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc76530 con 0x5623dcd209c0 2023-09-21T13:01:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426df9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 0x5623dcd20480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f425e7fc700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 0x7f42540a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426df9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 0x5623dcd20480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35566/0 (socket says 172.21.15.142:35566) 2023-09-21T13:01:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426df9c700 1 -- 172.21.15.142:0/3088986489 learned_addr learned my addr 172.21.15.142:0/3088986489 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd24910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426cf9a700 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd252b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f425e7fc700 1 -- 172.21.15.142:0/3417828230 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42640ccd50 con 0x7f4268100fd0 2023-09-21T13:01:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426df9c700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 0x7f42540a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 -- 172.21.15.142:0/3088986489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 msgr2=0x5623dcd252b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd252b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 -- 172.21.15.142:0/3088986489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 msgr2=0x5623dcd20480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 0x5623dcd20480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 -- 172.21.15.142:0/3088986489 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dca9cd80 con 0x5623dcd209c0 2023-09-21T13:01:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.007+0000 7f426d79b700 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd24910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f42640ca470 tx=0x7f426406d380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c3cb56bfa647ce6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42537fe700 1 -- 172.21.15.142:0/3088986489 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426409a960 con 0x5623dcd209c0 2023-09-21T13:01:10.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42537fe700 1 -- 172.21.15.142:0/3088986489 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4264021380 con 0x5623dcd209c0 2023-09-21T13:01:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42537fe700 1 -- 172.21.15.142:0/3088986489 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264007d70 con 0x5623dcd209c0 2023-09-21T13:01:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 -- 172.21.15.142:0/3088986489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 msgr2=0x5623dcd24910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd24910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f42640ca470 tx=0x7f426406d380 comp rx=0 tx=0).stop 2023-09-21T13:01:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f426df9c700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 0x7f42540a2c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f426000fb80 tx=0x7f4260004b40 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 -- 172.21.15.142:0/3088986489 shutdown_connections 2023-09-21T13:01:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd200a0 0x5623dcd20480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd252b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 --2- 172.21.15.142:0/3088986489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd24910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 -- 172.21.15.142:0/3088986489 >> 172.21.15.142:0/3088986489 conn(0x5623dcc4cfa0 msgr2=0x5623dcd1b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:10.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 -- 172.21.15.142:0/3088986489 shutdown_connections 2023-09-21T13:01:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.008+0000 7f42832e9b80 1 -- 172.21.15.142:0/3088986489 wait complete. 2023-09-21T13:01:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.009+0000 7f42832e9b80 1 -- start start 2023-09-21T13:01:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.009+0000 7f42832e9b80 1 Processor -- start 2023-09-21T13:01:10.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 0x5623dcd2c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd29830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc71e20 con 0x5623dcd24e50 2023-09-21T13:01:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc0e6e0 con 0x5623dcd200a0 2023-09-21T13:01:10.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcc0e380 con 0x5623dcd209c0 2023-09-21T13:01:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f42832e9b80 10 client.0 _ll_register_callbacks cb 0x5623dcb58a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426df9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426d79b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 0x5623dcd2c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426df9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35580/0 (socket says 172.21.15.142:35580) 2023-09-21T13:01:10.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426df9c700 1 -- 172.21.15.142:0/546595091 learned_addr learned my addr 172.21.15.142:0/546595091 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426cf9a700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd29830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426d79b700 1 -- 172.21.15.142:0/546595091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 msgr2=0x5623dcd29830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.010+0000 7f426d79b700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd29830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f426d79b700 1 -- 172.21.15.142:0/546595091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 msgr2=0x5623dcd29e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f426d79b700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f426d79b700 1 -- 172.21.15.142:0/546595091 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4264094e70 con 0x5623dcd200a0 2023-09-21T13:01:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f426df9c700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f426d79b700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 0x5623dcd2c5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42640985b0 tx=0x7f4264009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73b8c63300d722b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f4250ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426407a070 con 0x5623dcd200a0 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623dcbe2b50 con 0x5623dcd200a0 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42640a2240 con 0x5623dcd200a0 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426409e090 con 0x5623dcd200a0 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f42832e9b80 10 client.26906 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:10.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x5623dca85c00 con 0x5623dcd200a0 2023-09-21T13:01:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.011+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623dcbe2b50 con 0x5623dcd200a0 2023-09-21T13:01:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4264096970 con 0x5623dcd200a0 2023-09-21T13:01:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 10 client.26906 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 10 client.26906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:10.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 20 client.26906 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd39670 0x5623dcd3ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 4 client.26906 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623dcceefc0 con 0x5623dcd39670 2023-09-21T13:01:10.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f426cf9a700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd39670 0x5623dcd3ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f426cf9a700 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd39670 0x5623dcd3ba60 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29e557fcf8529468 server_cookie=cf01126de2c1029f in_seq=0 out_seq=0 2023-09-21T13:01:10.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.012+0000 7f4250ff9700 10 client.26906 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f4250ff9700 1 -- 172.21.15.142:0/546595091 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623dcceefc0 con 0x5623dcd39670 2023-09-21T13:01:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f4250ff9700 10 client.26906 handle_command_reply: tid=0 2023-09-21T13:01:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f42832e9b80 1 client.26906 shutdown 2023-09-21T13:01:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 msgr2=0x5623dcd2c5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 0x5623dcd2c5b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42640985b0 tx=0x7f4264009c00 comp rx=0 tx=0).stop 2023-09-21T13:01:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.013+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 shutdown_connections 2023-09-21T13:01:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd39670 0x5623dcd3ba60 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd29e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd200a0 0x5623dcd2c5b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 --2- 172.21.15.142:0/546595091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd209c0 0x5623dcd29830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 >> 172.21.15.142:0/546595091 conn(0x5623dcc4cfa0 msgr2=0x5623dcd1acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f4250ff9700 0 client.26906 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 shutdown_connections 2023-09-21T13:01:10.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 1 -- 172.21.15.142:0/546595091 wait complete. 2023-09-21T13:01:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.014+0000 7f42832e9b80 20 client.26906 trim_cache size 0 max 16384 2023-09-21T13:01:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 Processor -- start 2023-09-21T13:01:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 -- start start 2023-09-21T13:01:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.032 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 0x5623dcd23de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd24320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcaf28c0 con 0x5623dcd24e50 2023-09-21T13:01:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcd2a440 con 0x5623dcd209c0 2023-09-21T13:01:10.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f42832e9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcd1b350 con 0x5623dcd200a0 2023-09-21T13:01:10.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f426df9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd24320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f426d79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 0x5623dcd23de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f426d79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60550/0 (socket says 172.21.15.142:60550) 2023-09-21T13:01:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.029+0000 7f426d79b700 1 -- 172.21.15.142:0/2864888933 learned_addr learned my addr 172.21.15.142:0/2864888933 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:10.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 -- 172.21.15.142:0/2864888933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 msgr2=0x5623dcd23de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 0x5623dcd23de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 -- 172.21.15.142:0/2864888933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 msgr2=0x5623dcd24320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd24320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 -- 172.21.15.142:0/2864888933 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623dcac31f0 con 0x5623dcd200a0 2023-09-21T13:01:10.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426cf9a700 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 0x5623dcd23de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426df9c700 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd24320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f426d79b700 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4264096760 tx=0x7f4264098810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b7415bad6b60ef server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f4253fff700 1 -- 172.21.15.142:0/2864888933 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426407a030 con 0x5623dcd200a0 2023-09-21T13:01:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f4253fff700 1 -- 172.21.15.142:0/2864888933 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4264005770 con 0x5623dcd200a0 2023-09-21T13:01:10.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.030+0000 7f4253fff700 1 -- 172.21.15.142:0/2864888933 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264096970 con 0x5623dcd200a0 2023-09-21T13:01:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- 172.21.15.142:0/2864888933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 msgr2=0x5623dcd30be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4264096760 tx=0x7f4264098810 comp rx=0 tx=0).stop 2023-09-21T13:01:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- 172.21.15.142:0/2864888933 shutdown_connections 2023-09-21T13:01:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd24e50 0x5623dcd24320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd30be0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 --2- 172.21.15.142:0/2864888933 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd209c0 0x5623dcd23de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- 172.21.15.142:0/2864888933 >> 172.21.15.142:0/2864888933 conn(0x5623dcc4cfa0 msgr2=0x5623dcd19870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- 172.21.15.142:0/2864888933 shutdown_connections 2023-09-21T13:01:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- 172.21.15.142:0/2864888933 wait complete. 2023-09-21T13:01:10.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.031+0000 7f42832e9b80 1 -- start start 2023-09-21T13:01:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 Processor -- start 2023-09-21T13:01:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd2ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd2f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcd8c3b0 con 0x5623dcd209c0 2023-09-21T13:01:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcd8c4f0 con 0x5623dcd24e50 2023-09-21T13:01:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.032+0000 7f42832e9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623dcd8c660 con 0x5623dcd200a0 2023-09-21T13:01:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f42832e9b80 10 client.0 _ll_register_callbacks cb 0x5623dcb58a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:10.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:35596/0 (socket says 172.21.15.142:35596) 2023-09-21T13:01:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 -- 172.21.15.142:0/4162618166 learned_addr learned my addr 172.21.15.142:0/4162618166 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426d79b700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd2ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426df9c700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd2f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 -- 172.21.15.142:0/4162618166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 msgr2=0x5623dcd2ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd2ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 -- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 msgr2=0x5623dcd2f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd2f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 -- 172.21.15.142:0/4162618166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4258021a00 con 0x5623dcd209c0 2023-09-21T13:01:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f426cf9a700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f426806a360 tx=0x7f42580128b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd59756b834715 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.033+0000 7f4250ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:01:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258017040 con 0x5623dcd209c0 2023-09-21T13:01:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4264021380 con 0x5623dcd209c0 2023-09-21T13:01:10.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f42580210b0 con 0x5623dcd209c0 2023-09-21T13:01:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42580122d0 con 0x5623dcd209c0 2023-09-21T13:01:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 10 client.16815 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7f4260022040 con 0x5623dcd209c0 2023-09-21T13:01:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4264021380 con 0x5623dcd209c0 2023-09-21T13:01:10.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f42580038c0 con 0x5623dcd209c0 2023-09-21T13:01:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 10 client.16815 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 10 client.16815 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 20 client.16815 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd8de50 0x5623dcd90270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:10.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 4 client.16815 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:01:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.034+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623dcc6ae00 con 0x5623dcd8de50 2023-09-21T13:01:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.035+0000 7f426d79b700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd8de50 0x5623dcd90270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.035+0000 7f4250ff9700 10 client.16815 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:10.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.035+0000 7f426d79b700 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd8de50 0x5623dcd90270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c17836f7f0e3e0fb server_cookie=5cecc06082e2634f in_seq=0 out_seq=0 2023-09-21T13:01:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.115+0000 7f4250ff9700 1 -- 172.21.15.142:0/4162618166 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623dcc6ae00 con 0x5623dcd8de50 2023-09-21T13:01:10.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.115+0000 7f4250ff9700 10 client.16815 handle_command_reply: tid=0 2023-09-21T13:01:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.116+0000 7f42832e9b80 1 client.16815 shutdown 2023-09-21T13:01:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.116+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 msgr2=0x5623dcd2f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.116 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.116+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f426806a360 tx=0x7f42580128b0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 shutdown_connections 2023-09-21T13:01:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623dcd8de50 0x5623dcd90270 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623dcd24e50 0x5623dcd2f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623dcd200a0 0x5623dcd2ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 --2- 172.21.15.142:0/4162618166 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623dcd209c0 0x5623dcd2f110 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 >> 172.21.15.142:0/4162618166 conn(0x5623dcc4cfa0 msgr2=0x5623dcd1aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:10.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.122+0000 7f4250ff9700 0 client.16815 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.124+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 shutdown_connections 2023-09-21T13:01:10.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.125+0000 7f42832e9b80 1 -- 172.21.15.142:0/4162618166 wait complete. 2023-09-21T13:01:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.125+0000 7f42832e9b80 20 client.16815 trim_cache size 0 max 16384 2023-09-21T13:01:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:01:10.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:01:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:01:10.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:01:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 msgr2=0x7f42540a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 0x7f42540a2c70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f426000fb80 tx=0x7f4260004b40 comp rx=0 tx=0).stop 2023-09-21T13:01:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 msgr2=0x7f4268199140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:10.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4264009230 tx=0x7f426400bf20 comp rx=0 tx=0).stop 2023-09-21T13:01:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 shutdown_connections 2023-09-21T13:01:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f42540a07b0 0x7f42540a2c70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f426819dcf0 0x7f426819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4268100fd0 0x7f4268199140 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 --2- 172.21.15.142:0/3417828230 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f42681060f0 0x7f4268199680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.126+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 >> 172.21.15.142:0/3417828230 conn(0x7f42680fc830 msgr2=0x7f426810cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.127+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 shutdown_connections 2023-09-21T13:01:10.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:10.127+0000 7f426f9ff700 1 -- 172.21.15.142:0/3417828230 wait complete. 2023-09-21T13:01:10.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.31 MB/sec execute 111 sec latency 2087.041 ms 2023-09-21T13:01:10.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:10 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:10.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:10 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:10.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:10 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:11.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.22 MB/sec execute 112 sec latency 3087.119 ms 2023-09-21T13:01:11.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:11 smithi156 ceph-mon[134078]: pgmap v151: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 418 op/s 2023-09-21T13:01:11.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:11 smithi142 ceph-mon[97663]: pgmap v151: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 418 op/s 2023-09-21T13:01:11.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:11 smithi160 ceph-mon[134450]: pgmap v151: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.9 MiB/s wr, 418 op/s 2023-09-21T13:01:12.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.13 MB/sec execute 113 sec latency 4087.235 ms 2023-09-21T13:01:13.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 10.04 MB/sec execute 114 sec latency 5087.375 ms 2023-09-21T13:01:13.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:13 smithi156 ceph-mon[134078]: pgmap v152: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:13.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:13 smithi142 ceph-mon[97663]: pgmap v152: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:13.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:13 smithi160 ceph-mon[134450]: pgmap v152: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:14.687 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 9.95 MB/sec execute 115 sec latency 6087.468 ms 2023-09-21T13:01:15.686 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 9.86 MB/sec execute 116 sec latency 7087.586 ms 2023-09-21T13:01:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:15 smithi156 ceph-mon[134078]: pgmap v153: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:15 smithi142 ceph-mon[97663]: pgmap v153: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:15.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:15 smithi160 ceph-mon[134450]: pgmap v153: 97 pgs: 97 active+clean; 120 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 255 op/s 2023-09-21T13:01:16.687 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 9.78 MB/sec execute 117 sec latency 8087.701 ms 2023-09-21T13:01:17.687 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462259 9.70 MB/sec execute 118 sec latency 9087.824 ms 2023-09-21T13:01:17.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:17 smithi156 ceph-mon[134078]: pgmap v154: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 286 op/s 2023-09-21T13:01:17.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:17 smithi142 ceph-mon[97663]: pgmap v154: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 286 op/s 2023-09-21T13:01:17.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:17 smithi160 ceph-mon[134450]: pgmap v154: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.9 MiB/s wr, 286 op/s 2023-09-21T13:01:18.687 INFO:tasks.workunit.client.0.smithi142.stdout: 1 462499 9.62 MB/sec execute 119 sec latency 9659.634 ms 2023-09-21T13:01:18.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:18 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:18.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:18 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:18.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:18 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:19.687 INFO:tasks.workunit.client.0.smithi142.stdout: 1 463679 9.58 MB/sec execute 120 sec latency 573.113 ms 2023-09-21T13:01:19.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:19 smithi156 ceph-mon[134078]: pgmap v155: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-09-21T13:01:19.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:19 smithi142 ceph-mon[97663]: pgmap v155: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-09-21T13:01:19.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:19 smithi160 ceph-mon[134450]: pgmap v155: 97 pgs: 97 active+clean; 114 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 1.5 MiB/s wr, 160 op/s 2023-09-21T13:01:20.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 465685 9.61 MB/sec execute 121 sec latency 282.474 ms 2023-09-21T13:01:21.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 465689 9.53 MB/sec execute 122 sec latency 1035.179 ms 2023-09-21T13:01:21.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:21 smithi156 ceph-mon[134078]: pgmap v156: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.5 MiB/s wr, 217 op/s 2023-09-21T13:01:21.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:21 smithi142 ceph-mon[97663]: pgmap v156: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.5 MiB/s wr, 217 op/s 2023-09-21T13:01:21.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:21 smithi160 ceph-mon[134450]: pgmap v156: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.5 MiB/s wr, 217 op/s 2023-09-21T13:01:22.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 465689 9.46 MB/sec execute 123 sec latency 1245.043 ms 2023-09-21T13:01:23.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 -- 172.21.15.142:0/3387376623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70100fe0 msgr2=0x7f8e701013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 --2- 172.21.15.142:0/3387376623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70100fe0 0x7f8e701013c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c009990 tx=0x7f8e6c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 -- 172.21.15.142:0/3387376623 shutdown_connections 2023-09-21T13:01:23.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 --2- 172.21.15.142:0/3387376623 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70100fe0 0x7f8e701013c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 --2- 172.21.15.142:0/3387376623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70106100 0x7f8e7010dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 --2- 172.21.15.142:0/3387376623 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e70101990 0x7f8e701059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 -- 172.21.15.142:0/3387376623 >> 172.21.15.142:0/3387376623 conn(0x7f8e700fc840 msgr2=0x7f8e700fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 -- 172.21.15.142:0/3387376623 shutdown_connections 2023-09-21T13:01:23.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.283+0000 7f8e773ff700 1 -- 172.21.15.142:0/3387376623 wait complete. 2023-09-21T13:01:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 Processor -- start 2023-09-21T13:01:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 -- start start 2023-09-21T13:01:23.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 0x7f8e70073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 0x7f8e701a5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701a5aa0 con 0x7f8e70106100 2023-09-21T13:01:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701a5be0 con 0x7f8e701a3170 2023-09-21T13:01:23.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.284+0000 7f8e773ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e701a5d50 con 0x7f8e70100fe0 2023-09-21T13:01:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58046/0 (socket says 172.21.15.142:58046) 2023-09-21T13:01:23.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 -- 172.21.15.142:0/1134200900 learned_addr learned my addr 172.21.15.142:0/1134200900 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 0x7f8e70073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7599c700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 0x7f8e701a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 -- 172.21.15.142:0/1134200900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 msgr2=0x7f8e701a5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 0x7f8e701a5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 -- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 msgr2=0x7f8e70073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 0x7f8e70073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 -- 172.21.15.142:0/1134200900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c0095f0 con 0x7f8e70100fe0 2023-09-21T13:01:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7599c700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 0x7f8e701a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 0x7f8e70073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00c010 tx=0x7f8e6c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e667fc700 1 -- 172.21.15.142:0/1134200900 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c01d070 con 0x7f8e70100fe0 2023-09-21T13:01:23.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.285+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e701a5fd0 con 0x7f8e70100fe0 2023-09-21T13:01:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.286+0000 7f8e667fc700 1 -- 172.21.15.142:0/1134200900 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e6c022470 con 0x7f8e70100fe0 2023-09-21T13:01:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.286+0000 7f8e667fc700 1 -- 172.21.15.142:0/1134200900 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c017650 con 0x7f8e70100fe0 2023-09-21T13:01:23.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.286+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e701a63f0 con 0x7f8e70100fe0 2023-09-21T13:01:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.289+0000 7f8e667fc700 1 -- 172.21.15.142:0/1134200900 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8e6c0225e0 con 0x7f8e70100fe0 2023-09-21T13:01:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.290+0000 7f8e8ae1bb80 1 Processor -- start 2023-09-21T13:01:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.290+0000 7f8e8ae1bb80 1 -- start start 2023-09-21T13:01:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306ee1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 0x557306ee62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306e55c40 con 0x557306ee19c0 2023-09-21T13:01:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306e39c10 con 0x557306ee5e50 2023-09-21T13:01:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306e37530 con 0x557306ee10a0 2023-09-21T13:01:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306ee1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306ee1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58062/0 (socket says 172.21.15.142:58062) 2023-09-21T13:01:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e7599c700 1 -- 172.21.15.142:0/1607838684 learned_addr learned my addr 172.21.15.142:0/1607838684 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 0x557306ee62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.291+0000 7f8e667fc700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 0x7f8e5c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 -- 172.21.15.142:0/1607838684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 msgr2=0x557306ee1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306ee1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 -- 172.21.15.142:0/1607838684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 msgr2=0x557306ee5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e667fc700 1 -- 172.21.15.142:0/1134200900 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e6c0cd220 con 0x7f8e70100fe0 2023-09-21T13:01:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 -- 172.21.15.142:0/1607838684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557306c5dd80 con 0x557306ee5e50 2023-09-21T13:01:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7599c700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 0x7f8e5c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 0x557306ee62b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006a380 tx=0x7f8e600117a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3fbced7c1a5ccc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e5b7fe700 1 -- 172.21.15.142:0/1607838684 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60004230 con 0x557306ee5e50 2023-09-21T13:01:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e5b7fe700 1 -- 172.21.15.142:0/1607838684 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e60004390 con 0x557306ee5e50 2023-09-21T13:01:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.292+0000 7f8e5b7fe700 1 -- 172.21.15.142:0/1607838684 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6000e8b0 con 0x557306ee5e50 2023-09-21T13:01:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1607838684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 msgr2=0x557306ee62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e7599c700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 0x7f8e5c0a2c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e680076a0 tx=0x7f8e68009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 0x557306ee62b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006a380 tx=0x7f8e600117a0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1607838684 shutdown_connections 2023-09-21T13:01:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee5e50 0x557306ee62b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306ee1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1607838684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1607838684 >> 172.21.15.142:0/1607838684 conn(0x557306e0dfa0 msgr2=0x557306edc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1607838684 shutdown_connections 2023-09-21T13:01:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.293+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1607838684 wait complete. 2023-09-21T13:01:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 -- start start 2023-09-21T13:01:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 Processor -- start 2023-09-21T13:01:23.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306eed500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee19c0 0x557306eea780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306e32e20 con 0x557306ee5e50 2023-09-21T13:01:23.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306dcf6e0 con 0x557306ee10a0 2023-09-21T13:01:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306dcf380 con 0x557306ee19c0 2023-09-21T13:01:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e8ae1bb80 10 client.0 _ll_register_callbacks cb 0x557306d19a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.294+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306eed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58386/0 (socket says 172.21.15.142:58386) 2023-09-21T13:01:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7599c700 1 -- 172.21.15.142:0/1276984519 learned_addr learned my addr 172.21.15.142:0/1276984519 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee19c0 0x557306eea780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 -- 172.21.15.142:0/1276984519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee19c0 msgr2=0x557306eea780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee19c0 0x557306eea780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 -- 172.21.15.142:0/1276984519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 msgr2=0x557306eead20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 -- 172.21.15.142:0/1276984519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e60009c90 con 0x557306ee10a0 2023-09-21T13:01:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7599c700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e7519b700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306eed500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0ca940 tx=0x7f8e6c022ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c73eccb8baef429 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6c0cd030 con 0x557306ee10a0 2023-09-21T13:01:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557306da3b50 con 0x557306ee10a0 2023-09-21T13:01:23.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e6c09ae30 con 0x557306ee10a0 2023-09-21T13:01:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e6c096a70 con 0x557306ee10a0 2023-09-21T13:01:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.295+0000 7f8e8ae1bb80 10 client.26924 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557306c46c00 con 0x557306ee10a0 2023-09-21T13:01:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557306da3b50 con 0x557306ee10a0 2023-09-21T13:01:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e6c099c20 con 0x557306ee10a0 2023-09-21T13:01:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 10 client.26924 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 10 client.26924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 20 client.26924 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306efab80 0x557306efcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 4 client.26924 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557306eaffc0 con 0x557306efab80 2023-09-21T13:01:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.296+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306efab80 0x557306efcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.297+0000 7f8e58ff9700 10 client.26924 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.297+0000 7f8e7499a700 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306efab80 0x557306efcfa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fb19631093434d server_cookie=9291a9bae7f822f1 in_seq=0 out_seq=0 2023-09-21T13:01:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e58ff9700 1 -- 172.21.15.142:0/1276984519 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557306eaffc0 con 0x557306efab80 2023-09-21T13:01:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e58ff9700 10 client.26924 handle_command_reply: tid=0 2023-09-21T13:01:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 client.26924 shutdown 2023-09-21T13:01:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 msgr2=0x557306eed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306eed500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c0ca940 tx=0x7f8e6c022ba0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 shutdown_connections 2023-09-21T13:01:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306efab80 0x557306efcfa0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306eead20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e58ff9700 0 client.26924 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306eed500 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/1276984519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee19c0 0x557306eea780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 >> 172.21.15.142:0/1276984519 conn(0x557306e0dfa0 msgr2=0x557306edb310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 shutdown_connections 2023-09-21T13:01:23.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/1276984519 wait complete. 2023-09-21T13:01:23.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.298+0000 7f8e8ae1bb80 20 client.26924 trim_cache size 0 max 16384 2023-09-21T13:01:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.313+0000 7f8e8ae1bb80 1 Processor -- start 2023-09-21T13:01:23.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.313+0000 7f8e8ae1bb80 1 -- start start 2023-09-21T13:01:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.313+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306ef2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.313+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee5e50 0x557306ee05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306cb38c0 con 0x557306ee19c0 2023-09-21T13:01:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306ee5cd0 con 0x557306ee10a0 2023-09-21T13:01:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306eede40 con 0x557306ee5e50 2023-09-21T13:01:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58390/0 (socket says 172.21.15.142:58390) 2023-09-21T13:01:23.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 -- 172.21.15.142:0/2874600191 learned_addr learned my addr 172.21.15.142:0/2874600191 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7599c700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee5e50 0x557306ee05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7519b700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306ef2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 -- 172.21.15.142:0/2874600191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee5e50 msgr2=0x557306ee05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee5e50 0x557306ee05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 -- 172.21.15.142:0/2874600191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 msgr2=0x557306ef2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306ef2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 -- 172.21.15.142:0/2874600191 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557306f01bd0 con 0x557306ee19c0 2023-09-21T13:01:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7519b700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306ef2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.314+0000 7f8e7499a700 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006a380 tx=0x7f8e600117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8e9970a5bd8a8f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e5bfff700 1 -- 172.21.15.142:0/2874600191 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60029040 con 0x557306ee19c0 2023-09-21T13:01:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e5bfff700 1 -- 172.21.15.142:0/2874600191 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e60011250 con 0x557306ee19c0 2023-09-21T13:01:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e5bfff700 1 -- 172.21.15.142:0/2874600191 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6002a7a0 con 0x557306ee19c0 2023-09-21T13:01:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/2874600191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 msgr2=0x557306ee9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8e7006a380 tx=0x7f8e600117a0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/2874600191 shutdown_connections 2023-09-21T13:01:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee5e50 0x557306ee05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee10a0 0x557306ef2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/2874600191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee19c0 0x557306ee9f40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/2874600191 >> 172.21.15.142:0/2874600191 conn(0x557306e0dfa0 msgr2=0x557306edfea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/2874600191 shutdown_connections 2023-09-21T13:01:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.315+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/2874600191 wait complete. 2023-09-21T13:01:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 -- start start 2023-09-21T13:01:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 Processor -- start 2023-09-21T13:01:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306f42940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306f4da60 con 0x557306ee5e50 2023-09-21T13:01:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306f4dba0 con 0x557306ee19c0 2023-09-21T13:01:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557306f4dd60 con 0x557306ee10a0 2023-09-21T13:01:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.316+0000 7f8e8ae1bb80 10 client.0 _ll_register_callbacks cb 0x557306d19a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306f42940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43512/0 (socket says 172.21.15.142:43512) 2023-09-21T13:01:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 -- 172.21.15.142:0/361591625 learned_addr learned my addr 172.21.15.142:0/361591625 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306f42940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58078/0 (socket says 172.21.15.142:58078) 2023-09-21T13:01:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7599c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58400/0 (socket says 172.21.15.142:58400) 2023-09-21T13:01:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 -- 172.21.15.142:0/361591625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 msgr2=0x557306f42940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306f42940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 -- 172.21.15.142:0/361591625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 msgr2=0x557306f433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 -- 172.21.15.142:0/361591625 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557306c5dd80 con 0x557306ee19c0 2023-09-21T13:01:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7599c700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e7499a700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e600097c0 tx=0x7f8e60011140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27010602cc94418 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.317+0000 7f8e58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e60029040 con 0x557306ee19c0 2023-09-21T13:01:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e60004390 con 0x557306ee19c0 2023-09-21T13:01:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8e60005040 con 0x557306ee19c0 2023-09-21T13:01:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e60005d20 con 0x557306ee19c0 2023-09-21T13:01:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 10 client.26930 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x557306c841f0 con 0x557306ee19c0 2023-09-21T13:01:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e60004390 con 0x557306ee19c0 2023-09-21T13:01:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f8e600114c0 con 0x557306ee19c0 2023-09-21T13:01:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 10 client.26930 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 10 client.26930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 20 client.26930 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306f4f180 0x557306f515a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 4 client.26930 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:01:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.318+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557306e2be00 con 0x557306f4f180 2023-09-21T13:01:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.319+0000 7f8e7519b700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306f4f180 0x557306f515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.319+0000 7f8e58ff9700 10 client.26930 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.319+0000 7f8e7519b700 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306f4f180 0x557306f515a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=953999391c10da16 server_cookie=9171f1f259c16855 in_seq=0 out_seq=0 2023-09-21T13:01:23.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e58ff9700 1 -- 172.21.15.142:0/361591625 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557306e2be00 con 0x557306f4f180 2023-09-21T13:01:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e58ff9700 10 client.26930 handle_command_reply: tid=0 2023-09-21T13:01:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 client.26930 shutdown 2023-09-21T13:01:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 msgr2=0x557306f42e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8e600097c0 tx=0x7f8e60011140 comp rx=0 tx=0).stop 2023-09-21T13:01:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 shutdown_connections 2023-09-21T13:01:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557306f4f180 0x557306f515a0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557306ee5e50 0x557306f433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e58ff9700 0 client.26930 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557306ee10a0 0x557306f42940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 --2- 172.21.15.142:0/361591625 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557306ee19c0 0x557306f42e80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 >> 172.21.15.142:0/361591625 conn(0x557306e0dfa0 msgr2=0x557306ef6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 shutdown_connections 2023-09-21T13:01:23.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.391+0000 7f8e8ae1bb80 1 -- 172.21.15.142:0/361591625 wait complete. 2023-09-21T13:01:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e8ae1bb80 20 client.26930 trim_cache size 0 max 16384 2023-09-21T13:01:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:01:23.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:01:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:01:23.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 msgr2=0x7f8e5c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 0x7f8e5c0a2c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e680076a0 tx=0x7f8e68009040 comp rx=0 tx=0).stop 2023-09-21T13:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 msgr2=0x7f8e700732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:23.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c00c010 tx=0x7f8e6c004730 comp rx=0 tx=0).stop 2023-09-21T13:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 shutdown_connections 2023-09-21T13:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e5c0a07b0 0x7f8e5c0a2c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e701a3170 0x7f8e701a5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e70100fe0 0x7f8e700732c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 --2- 172.21.15.142:0/1134200900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e70106100 0x7f8e70073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 >> 172.21.15.142:0/1134200900 conn(0x7f8e700fc840 msgr2=0x7f8e700fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 shutdown_connections 2023-09-21T13:01:23.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:23.392+0000 7f8e773ff700 1 -- 172.21.15.142:0/1134200900 wait complete. 2023-09-21T13:01:23.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 465920 9.38 MB/sec execute 124 sec latency 1889.729 ms 2023-09-21T13:01:23.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:23 smithi156 ceph-mon[134078]: pgmap v157: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:23.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:23 smithi142 ceph-mon[97663]: pgmap v157: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:23.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:23 smithi160 ceph-mon[134450]: pgmap v157: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:24.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 468458 9.41 MB/sec execute 125 sec latency 10.554 ms 2023-09-21T13:01:25.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 470176 9.40 MB/sec execute 126 sec latency 13.530 ms 2023-09-21T13:01:25.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:25 smithi156 ceph-mon[134078]: pgmap v158: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:25.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:25 smithi142 ceph-mon[97663]: pgmap v158: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:25.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:25 smithi160 ceph-mon[134450]: pgmap v158: 97 pgs: 97 active+clean; 116 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 1.3 MiB/s wr, 87 op/s 2023-09-21T13:01:26.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 472686 9.45 MB/sec execute 127 sec latency 32.182 ms 2023-09-21T13:01:26.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:26 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:26.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:26 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:26.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:26 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:27.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 474314 9.43 MB/sec execute 128 sec latency 12.463 ms 2023-09-21T13:01:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:27 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:27.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:27 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:27.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:27 smithi156 ceph-mon[134078]: pgmap v159: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2023-09-21T13:01:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:27 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:27.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:27 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:27.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:27 smithi142 ceph-mon[97663]: pgmap v159: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2023-09-21T13:01:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:27 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:27 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:27.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:27 smithi160 ceph-mon[134450]: pgmap v159: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 542 KiB/s rd, 2.4 MiB/s wr, 167 op/s 2023-09-21T13:01:28.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 476466 9.46 MB/sec execute 129 sec latency 22.991 ms 2023-09-21T13:01:28.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:28 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:01:28.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:28 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:01:28.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:28 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:01:28.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:28 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:01:28.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:28 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:01:28.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:28 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:01:28.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:28 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:01:28.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:28 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:01:28.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:28 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:01:28.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:28 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:01:28.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:28 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:01:28.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:28 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:01:29.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 478893 9.47 MB/sec execute 130 sec latency 12.031 ms 2023-09-21T13:01:29.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:29 smithi156 ceph-mon[134078]: pgmap v160: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 2.1 MiB/s wr, 136 op/s 2023-09-21T13:01:29.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:29 smithi142 ceph-mon[97663]: pgmap v160: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 2.1 MiB/s wr, 136 op/s 2023-09-21T13:01:29.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:29 smithi160 ceph-mon[134450]: pgmap v160: 97 pgs: 97 active+clean; 118 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 2.1 MiB/s wr, 136 op/s 2023-09-21T13:01:30.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 480737 9.48 MB/sec execute 131 sec latency 15.988 ms 2023-09-21T13:01:31.688 INFO:tasks.workunit.client.0.smithi142.stdout: 1 483333 9.53 MB/sec execute 132 sec latency 34.552 ms 2023-09-21T13:01:31.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:31 smithi156 ceph-mon[134078]: pgmap v161: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 3.4 MiB/s wr, 241 op/s 2023-09-21T13:01:31.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:31 smithi142 ceph-mon[97663]: pgmap v161: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 3.4 MiB/s wr, 241 op/s 2023-09-21T13:01:31.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:31 smithi160 ceph-mon[134450]: pgmap v161: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 3.4 MiB/s wr, 241 op/s 2023-09-21T13:01:32.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 484995 9.51 MB/sec execute 133 sec latency 10.919 ms 2023-09-21T13:01:33.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 487346 9.54 MB/sec execute 134 sec latency 11.754 ms 2023-09-21T13:01:33.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:33 smithi142 ceph-mon[97663]: pgmap v162: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:33.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:33 smithi160 ceph-mon[134450]: pgmap v162: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:34.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:33 smithi156 ceph-mon[134078]: pgmap v162: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:34.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 489660 9.56 MB/sec execute 135 sec latency 56.329 ms 2023-09-21T13:01:35.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 491463 9.55 MB/sec execute 136 sec latency 13.257 ms 2023-09-21T13:01:35.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:35 smithi142 ceph-mon[97663]: pgmap v163: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:35.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:35 smithi160 ceph-mon[134450]: pgmap v163: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:36.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:35 smithi156 ceph-mon[134078]: pgmap v163: 97 pgs: 97 active+clean; 124 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 2.4 MiB/s wr, 184 op/s 2023-09-21T13:01:36.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.551+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/892413137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4103be0 msgr2=0x7ff0d4107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/892413137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4103be0 0x7ff0d4107c20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4009990 tx=0x7ff0c4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/892413137 shutdown_connections 2023-09-21T13:01:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/892413137 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 0x7ff0d4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/892413137 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d4108350 0x7ff0d410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/892413137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4103be0 0x7ff0d4107c20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/892413137 >> 172.21.15.142:0/892413137 conn(0x7ff0d40fea90 msgr2=0x7ff0d4100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/892413137 shutdown_connections 2023-09-21T13:01:36.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.552+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/892413137 wait complete. 2023-09-21T13:01:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 Processor -- start 2023-09-21T13:01:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 -- start start 2023-09-21T13:01:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 0x7ff0d4199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 0x7ff0d419e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d419e760 con 0x7ff0d4103230 2023-09-21T13:01:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d419e8d0 con 0x7ff0d419dce0 2023-09-21T13:01:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.553+0000 7ff0dc5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d419ea90 con 0x7ff0d4108350 2023-09-21T13:01:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0dab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 0x7ff0d419e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 0x7ff0d4199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43472/0 (socket says 172.21.15.142:43472) 2023-09-21T13:01:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 -- 172.21.15.142:0/3489076970 learned_addr learned my addr 172.21.15.142:0/3489076970 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 -- 172.21.15.142:0/3489076970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 msgr2=0x7ff0d419e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 0x7ff0d419e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 -- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 msgr2=0x7ff0d4199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 0x7ff0d4199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 -- 172.21.15.142:0/3489076970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40095f0 con 0x7ff0d4108350 2023-09-21T13:01:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 0x7ff0d419e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4000c00 tx=0x7ff0c4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0cb7fe700 1 -- 172.21.15.142:0/3489076970 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c401d070 con 0x7ff0d4108350 2023-09-21T13:01:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.554+0000 7ff0cb7fe700 1 -- 172.21.15.142:0/3489076970 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0c4022470 con 0x7ff0d4108350 2023-09-21T13:01:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.555+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d41a5f90 con 0x7ff0d4108350 2023-09-21T13:01:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.555+0000 7ff0cb7fe700 1 -- 172.21.15.142:0/3489076970 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c4017630 con 0x7ff0d4108350 2023-09-21T13:01:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.555+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d41a6300 con 0x7ff0d4108350 2023-09-21T13:01:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.558+0000 7ff0cb7fe700 1 -- 172.21.15.142:0/3489076970 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff0c400fad0 con 0x7ff0d4108350 2023-09-21T13:01:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.559+0000 7ff0cb7fe700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 0x7ff0c00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 Processor -- start 2023-09-21T13:01:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0cb7fe700 1 -- 172.21.15.142:0/3489076970 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff0c40cd300 con 0x7ff0d4108350 2023-09-21T13:01:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0da39b700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 0x7ff0c00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 -- start start 2023-09-21T13:01:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 0x563daa006480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9f7ac40 con 0x563daa0069c0 2023-09-21T13:01:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9f5ec10 con 0x563daa0060a0 2023-09-21T13:01:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.560+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9f5c530 con 0x563daa00ae50 2023-09-21T13:01:36.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43480/0 (socket says 172.21.15.142:43480) 2023-09-21T13:01:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 0x563daa006480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 -- 172.21.15.142:0/297799229 learned_addr learned my addr 172.21.15.142:0/297799229 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0da39b700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 0x7ff0c00a2c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c60 tx=0x7ff0d0009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 -- 172.21.15.142:0/297799229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 msgr2=0x563daa006480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 0x563daa006480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 -- 172.21.15.142:0/297799229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 msgr2=0x563daa00a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 -- 172.21.15.142:0/297799229 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da9d82d80 con 0x563daa00ae50 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0da39b700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 0x563daa006480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.561+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc003eb0 tx=0x7ff0cc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c5cbe6ea87f81d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.562+0000 7ff0c8bfe700 1 -- 172.21.15.142:0/297799229 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc0092d0 con 0x563daa00ae50 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.562+0000 7ff0c8bfe700 1 -- 172.21.15.142:0/297799229 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0cc00f040 con 0x563daa00ae50 2023-09-21T13:01:36.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.562+0000 7ff0c8bfe700 1 -- 172.21.15.142:0/297799229 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e850 con 0x563daa00ae50 2023-09-21T13:01:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.562+0000 7ff0eff61b80 1 -- 172.21.15.142:0/297799229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 msgr2=0x563daa00b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.562+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc003eb0 tx=0x7ff0cc009920 comp rx=0 tx=0).stop 2023-09-21T13:01:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 -- 172.21.15.142:0/297799229 shutdown_connections 2023-09-21T13:01:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa00ae50 0x563daa00b2b0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa0060a0 0x563daa006480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/297799229 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 -- 172.21.15.142:0/297799229 >> 172.21.15.142:0/297799229 conn(0x563da9f32fa0 msgr2=0x563daa0010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 -- 172.21.15.142:0/297799229 shutdown_connections 2023-09-21T13:01:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 -- 172.21.15.142:0/297799229 wait complete. 2023-09-21T13:01:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.563+0000 7ff0eff61b80 1 -- start start 2023-09-21T13:01:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 Processor -- start 2023-09-21T13:01:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9f57e20 con 0x563daa0069c0 2023-09-21T13:01:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9ef46e0 con 0x563daa00ae50 2023-09-21T13:01:36.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9ef4380 con 0x563daa0060a0 2023-09-21T13:01:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0eff61b80 10 client.0 _ll_register_callbacks cb 0x563da9e3ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43488/0 (socket says 172.21.15.142:43488) 2023-09-21T13:01:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0da39b700 1 -- 172.21.15.142:0/3387718986 learned_addr learned my addr 172.21.15.142:0/3387718986 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.564+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 -- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 msgr2=0x563daa00fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 -- 172.21.15.142:0/3387718986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 msgr2=0x563daa00f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 -- 172.21.15.142:0/3387718986 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d0017070 con 0x563daa0060a0 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0da39b700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0d001c900 tx=0x7ff0d0013040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb139242f78453a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:36.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0021040 con 0x563daa0060a0 2023-09-21T13:01:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff0d0004830 con 0x563daa0060a0 2023-09-21T13:01:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.565+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563da9ec8b50 con 0x563daa0060a0 2023-09-21T13:01:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d0004a30 con 0x563daa0060a0 2023-09-21T13:01:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 10 client.26902 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7ff0cc003b90 con 0x563daa0060a0 2023-09-21T13:01:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0d0033020 con 0x563daa0060a0 2023-09-21T13:01:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff0d00050b0 con 0x563daa0060a0 2023-09-21T13:01:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 10 client.26902 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 10 client.26902 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 20 client.26902 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa01ff70 0x563daa022390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 4 client.26902 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563da9fd4fc0 con 0x563daa01ff70 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.566+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa01ff70 0x563daa022390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.567+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa01ff70 0x563daa022390 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=466cfe8ba1c445a9 server_cookie=566bf9a23bf77b5 in_seq=0 out_seq=0 2023-09-21T13:01:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.567+0000 7ff0bdffb700 10 client.26902 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.567+0000 7ff0bdffb700 1 -- 172.21.15.142:0/3387718986 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563da9fd4fc0 con 0x563daa01ff70 2023-09-21T13:01:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.567+0000 7ff0bdffb700 10 client.26902 handle_command_reply: tid=0 2023-09-21T13:01:36.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.567+0000 7ff0eff61b80 1 client.26902 shutdown 2023-09-21T13:01:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 msgr2=0x563daa012590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff0d001c900 tx=0x7ff0d0013040 comp rx=0 tx=0).stop 2023-09-21T13:01:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 shutdown_connections 2023-09-21T13:01:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa01ff70 0x563daa022390 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa012590 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/3387718986 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa00f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0bdffb700 0 client.26902 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 >> 172.21.15.142:0/3387718986 conn(0x563da9f32fa0 msgr2=0x563daa000cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 shutdown_connections 2023-09-21T13:01:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 1 -- 172.21.15.142:0/3387718986 wait complete. 2023-09-21T13:01:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.568+0000 7ff0eff61b80 20 client.26902 trim_cache size 0 max 16384 2023-09-21T13:01:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 Processor -- start 2023-09-21T13:01:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 -- start start 2023-09-21T13:01:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa012130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da9dd88c0 con 0x563daa0069c0 2023-09-21T13:01:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563daa0026c0 con 0x563daa00ae50 2023-09-21T13:01:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.585+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563daa010df0 con 0x563daa0060a0 2023-09-21T13:01:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43498/0 (socket says 172.21.15.142:43498) 2023-09-21T13:01:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 -- 172.21.15.142:0/1933465375 learned_addr learned my addr 172.21.15.142:0/1933465375 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa012130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 -- 172.21.15.142:0/1933465375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 msgr2=0x563daa00d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 -- 172.21.15.142:0/1933465375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 msgr2=0x563daa012130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa012130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 -- 172.21.15.142:0/1933465375 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da9d6bc00 con 0x563daa0060a0 2023-09-21T13:01:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005e40 tx=0x7ff0d00093d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a107e4569622f6df server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0c93ff700 1 -- 172.21.15.142:0/1933465375 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0021070 con 0x563daa0060a0 2023-09-21T13:01:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.586+0000 7ff0c93ff700 1 -- 172.21.15.142:0/1933465375 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0d0033040 con 0x563daa0060a0 2023-09-21T13:01:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0c93ff700 1 -- 172.21.15.142:0/1933465375 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0003a80 con 0x563daa0060a0 2023-09-21T13:01:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1933465375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 msgr2=0x563daa00f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005e40 tx=0x7ff0d00093d0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1933465375 shutdown_connections 2023-09-21T13:01:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa00d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa00f030 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1933465375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa012130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1933465375 >> 172.21.15.142:0/1933465375 conn(0x563da9f32fa0 msgr2=0x563daa008ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1933465375 shutdown_connections 2023-09-21T13:01:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.587+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1933465375 wait complete. 2023-09-21T13:01:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 -- start start 2023-09-21T13:01:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 Processor -- start 2023-09-21T13:01:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa015750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563daa073300 con 0x563daa0069c0 2023-09-21T13:01:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563daa073440 con 0x563daa00ae50 2023-09-21T13:01:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.588+0000 7ff0eff61b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563daa073600 con 0x563daa0060a0 2023-09-21T13:01:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0eff61b80 10 client.0 _ll_register_callbacks cb 0x563da9e3ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0d9b9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa015750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43500/0 (socket says 172.21.15.142:43500) 2023-09-21T13:01:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 -- 172.21.15.142:0/1974165598 learned_addr learned my addr 172.21.15.142:0/1974165598 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 -- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 msgr2=0x563daa072dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa072dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 -- 172.21.15.142:0/1974165598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 msgr2=0x563daa015750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa015750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 -- 172.21.15.142:0/1974165598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0cc003b90 con 0x563daa0060a0 2023-09-21T13:01:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa015750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0dab9c700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0da39b700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005490 tx=0x7ff0d000ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a621b26444097481 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.589+0000 7ff0bdffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d0021040 con 0x563daa0060a0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8469+0+0 (secure 0 0 0) 0x7ff0d0034080 con 0x563daa0060a0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0cc00f040 con 0x563daa0060a0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d000ea30 con 0x563daa0060a0 2023-09-21T13:01:36.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 10 client.26908 fetch_fsmap learned FSMap version 28 2023-09-21T13:01:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x563da9da91f0 con 0x563daa0060a0 2023-09-21T13:01:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0cc00f040 con 0x563daa0060a0 2023-09-21T13:01:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 28) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff0d0026620 con 0x563daa0060a0 2023-09-21T13:01:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 10 client.26908 fetch_fsmap finished waiting for FSMap version 28 2023-09-21T13:01:36.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 10 client.26908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 20 client.26908 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.590+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa074910 0x563daa076d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.591+0000 7ff0eff61b80 4 client.26908 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:01:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.591+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563da9f50e00 con 0x563daa074910 2023-09-21T13:01:36.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.591+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa074910 0x563daa076d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.591+0000 7ff0d9b9a700 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa074910 0x563daa076d30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a6a2177d1d02c90 server_cookie=c85a87d53db0a092 in_seq=0 out_seq=0 2023-09-21T13:01:36.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.591+0000 7ff0bdffb700 10 client.26908 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:36.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 493941 9.60 MB/sec execute 137 sec latency 56.356 ms 2023-09-21T13:01:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.691+0000 7ff0bdffb700 1 -- 172.21.15.142:0/1974165598 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563da9f50e00 con 0x563daa074910 2023-09-21T13:01:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.691+0000 7ff0bdffb700 10 client.26908 handle_command_reply: tid=0 2023-09-21T13:01:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.691+0000 7ff0eff61b80 1 client.26908 shutdown 2023-09-21T13:01:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 msgr2=0x563daa015210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0005490 tx=0x7ff0d000ef70 comp rx=0 tx=0).stop 2023-09-21T13:01:36.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 shutdown_connections 2023-09-21T13:01:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563daa074910 0x563daa076d30 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563daa00ae50 0x563daa072dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563daa0060a0 0x563daa015210 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0bdffb700 0 client.26908 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 --2- 172.21.15.142:0/1974165598 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563daa0069c0 0x563daa015750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 >> 172.21.15.142:0/1974165598 conn(0x563da9f32fa0 msgr2=0x563daa00d240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 shutdown_connections 2023-09-21T13:01:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 1 -- 172.21.15.142:0/1974165598 wait complete. 2023-09-21T13:01:36.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.692+0000 7ff0eff61b80 20 client.26908 trim_cache size 0 max 16384 2023-09-21T13:01:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:01:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:01:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:01:36.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:01:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 msgr2=0x7ff0c00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 0x7ff0c00a2c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0009c60 tx=0x7ff0d0009260 comp rx=0 tx=0).stop 2023-09-21T13:01:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 msgr2=0x7ff0d4199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff0c4000c00 tx=0x7ff0c4005740 comp rx=0 tx=0).stop 2023-09-21T13:01:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 shutdown_connections 2023-09-21T13:01:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff0c00a07b0 0x7ff0c00a2c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff0d4103230 0x7ff0d4199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff0d419dce0 0x7ff0d419e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 --2- 172.21.15.142:0/3489076970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d4108350 0x7ff0d4199670 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.693+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 >> 172.21.15.142:0/3489076970 conn(0x7ff0d40fea90 msgr2=0x7ff0d40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.694+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 shutdown_connections 2023-09-21T13:01:36.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:36.694+0000 7ff0dc5ff700 1 -- 172.21.15.142:0/3489076970 wait complete. 2023-09-21T13:01:37.438 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:01:37.438 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:01:37.439 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/3971300946 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643a46771e0 con 0x5643a464cc00 2023-09-21T13:01:37.439 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:01:37.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 495262 9.58 MB/sec execute 138 sec latency 22.652 ms 2023-09-21T13:01:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-mon[134450]: pgmap v164: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2023-09-21T13:01:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:37 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:01:38.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:37 smithi156 ceph-mon[134078]: pgmap v164: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2023-09-21T13:01:38.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:37 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:01:38.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:37 smithi142 ceph-mon[97663]: pgmap v164: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.6 MiB/s wr, 287 op/s 2023-09-21T13:01:38.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:37 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:01:38.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 497691 9.61 MB/sec execute 139 sec latency 16.015 ms 2023-09-21T13:01:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:38 smithi160 ceph-mon[134450]: osdmap e88: 12 total, 12 up, 12 in 2023-09-21T13:01:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:38 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/1221820034,v1:172.21.15.160:6839/1221820034] up:boot 2023-09-21T13:01:38.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:38 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:01:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:01:38.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:38 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:38 smithi156 ceph-mon[134078]: osdmap e88: 12 total, 12 up, 12 in 2023-09-21T13:01:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:38 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/1221820034,v1:172.21.15.160:6839/1221820034] up:boot 2023-09-21T13:01:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:38 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:01:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:01:39.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:38 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:39.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:38 smithi142 ceph-mon[97663]: osdmap e88: 12 total, 12 up, 12 in 2023-09-21T13:01:39.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:38 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/1221820034,v1:172.21.15.160:6839/1221820034] up:boot 2023-09-21T13:01:39.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:38 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:01:39.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:01:39.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:38 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:39.296 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:01:39.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 -- 172.21.15.142:0/830129147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 msgr2=0x7f5e7410d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 --2- 172.21.15.142:0/830129147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7410d7d0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b0a0 tx=0x7f5e6c00b3b0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.530 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 -- 172.21.15.142:0/830129147 shutdown_connections 2023-09-21T13:01:39.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 --2- 172.21.15.142:0/830129147 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74101ef0 0x7f5e741022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 --2- 172.21.15.142:0/830129147 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7410d7d0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 --2- 172.21.15.142:0/830129147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74102810 0x7f5e7410acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 -- 172.21.15.142:0/830129147 >> 172.21.15.142:0/830129147 conn(0x7f5e740fb730 msgr2=0x7f5e740fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.531 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 -- 172.21.15.142:0/830129147 shutdown_connections 2023-09-21T13:01:39.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.530+0000 7f5e799ff700 1 -- 172.21.15.142:0/830129147 wait complete. 2023-09-21T13:01:39.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.531+0000 7f5e799ff700 1 Processor -- start 2023-09-21T13:01:39.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 -- start start 2023-09-21T13:01:39.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 0x7f5e74199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7419e1b0 con 0x7f5e74102810 2023-09-21T13:01:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7419e320 con 0x7f5e7410b310 2023-09-21T13:01:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e799ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7419e4e0 con 0x7f5e74101ef0 2023-09-21T13:01:39.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43516/0 (socket says 172.21.15.142:43516) 2023-09-21T13:01:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e72ffd700 1 -- 172.21.15.142:0/3874911970 learned_addr learned my addr 172.21.15.142:0/3874911970 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e737fe700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.532+0000 7f5e727fc700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 0x7f5e74199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 -- 172.21.15.142:0/3874911970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 msgr2=0x7f5e7419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 -- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 msgr2=0x7f5e74199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 0x7f5e74199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 -- 172.21.15.142:0/3874911970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009d00 con 0x7f5e74101ef0 2023-09-21T13:01:39.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e727fc700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 0x7f5e74199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e737fe700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400e9a0 tx=0x7f5e6400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e789fd700 1 -- 172.21.15.142:0/3874911970 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64009790 con 0x7f5e74101ef0 2023-09-21T13:01:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7419e7c0 con 0x7f5e74101ef0 2023-09-21T13:01:39.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e789fd700 1 -- 172.21.15.142:0/3874911970 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e6400cbd0 con 0x7f5e74101ef0 2023-09-21T13:01:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.533+0000 7f5e789fd700 1 -- 172.21.15.142:0/3874911970 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64018680 con 0x7f5e74101ef0 2023-09-21T13:01:39.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.534+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e741a6000 con 0x7f5e74101ef0 2023-09-21T13:01:39.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.537+0000 7f5e789fd700 1 -- 172.21.15.142:0/3874911970 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5e6400cd40 con 0x7f5e74101ef0 2023-09-21T13:01:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.538+0000 7f5e8d310b80 1 Processor -- start 2023-09-21T13:01:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 -- start start 2023-09-21T13:01:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568afaca0 con 0x555568b86f30 2023-09-21T13:01:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568adec70 con 0x555568b8b360 2023-09-21T13:01:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568adc590 con 0x555568b86610 2023-09-21T13:01:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e727fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b869f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43522/0 (socket says 172.21.15.142:43522) 2023-09-21T13:01:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.539+0000 7f5e737fe700 1 -- 172.21.15.142:0/2946792591 learned_addr learned my addr 172.21.15.142:0/2946792591 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 -- 172.21.15.142:0/2946792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 msgr2=0x555568b869f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b869f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 -- 172.21.15.142:0/2946792591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 msgr2=0x555568b8ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e789fd700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 0x7f5e5c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 -- 172.21.15.142:0/2946792591 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555568902de0 con 0x555568b8b360 2023-09-21T13:01:39.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e789fd700 1 -- 172.21.15.142:0/3874911970 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e64014070 con 0x7f5e74101ef0 2023-09-21T13:01:39.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e727fc700 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8b7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009c60 tx=0x7f5e68009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=335381529151514b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e737fe700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 0x7f5e5c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e59ffb700 1 -- 172.21.15.142:0/2946792591 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68010be0 con 0x555568b8b360 2023-09-21T13:01:39.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e59ffb700 1 -- 172.21.15.142:0/2946792591 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e68015070 con 0x555568b8b360 2023-09-21T13:01:39.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.540+0000 7f5e59ffb700 1 -- 172.21.15.142:0/2946792591 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68003d80 con 0x555568b8b360 2023-09-21T13:01:39.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e737fe700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 0x7f5e5c0a2c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0095c0 tx=0x7f5e6c00b720 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 -- 172.21.15.142:0/2946792591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 msgr2=0x555568b8b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8b7c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5e68009c60 tx=0x7f5e68009f70 comp rx=0 tx=0).stop 2023-09-21T13:01:39.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 -- 172.21.15.142:0/2946792591 shutdown_connections 2023-09-21T13:01:39.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8b7c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b869f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/2946792591 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 -- 172.21.15.142:0/2946792591 >> 172.21.15.142:0/2946792591 conn(0x555568ab3000 msgr2=0x555568b816a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 -- 172.21.15.142:0/2946792591 shutdown_connections 2023-09-21T13:01:39.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.541+0000 7f5e8d310b80 1 -- 172.21.15.142:0/2946792591 wait complete. 2023-09-21T13:01:39.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.542+0000 7f5e8d310b80 1 -- start start 2023-09-21T13:01:39.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.542+0000 7f5e8d310b80 1 Processor -- start 2023-09-21T13:01:39.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 0x555568b92b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b904e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568ad7e80 con 0x555568b86610 2023-09-21T13:01:39.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568a74740 con 0x555568b8b360 2023-09-21T13:01:39.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568a743e0 con 0x555568b86f30 2023-09-21T13:01:39.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e8d310b80 10 client.0 _ll_register_callbacks cb 0x5555689bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:39.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 0x555568b92b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e727fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43524/0 (socket says 172.21.15.142:43524) 2023-09-21T13:01:39.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.543+0000 7f5e727fc700 1 -- 172.21.15.142:0/1831445423 learned_addr learned my addr 172.21.15.142:0/1831445423 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e737fe700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b904e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 -- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 msgr2=0x555568b904e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b904e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 -- 172.21.15.142:0/1831445423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 msgr2=0x555568b92b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 0x555568b92b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 -- 172.21.15.142:0/1831445423 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e680098c0 con 0x555568b86f30 2023-09-21T13:01:39.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 0x555568b92b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:39.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e727fc700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5e680095f0 tx=0x7f5e68005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a90282992398774 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:39.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.544+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68020070 con 0x555568b86f30 2023-09-21T13:01:39.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e68017070 con 0x555568b86f30 2023-09-21T13:01:39.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555568a48bb0 con 0x555568b86f30 2023-09-21T13:01:39.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e68003720 con 0x555568b86f30 2023-09-21T13:01:39.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 10 client.26926 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:39.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5555688ebc60 con 0x555568b86f30 2023-09-21T13:01:39.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555568a48bb0 con 0x555568b86f30 2023-09-21T13:01:39.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5e68011740 con 0x555568b86f30 2023-09-21T13:01:39.557 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 10 client.26926 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:39.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 10 client.26926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:39.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 20 client.26926 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:39.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568ba0240 0x555568ba2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 4 client.26926 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:39.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.545+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555568b55020 con 0x555568ba0240 2023-09-21T13:01:39.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.546+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568ba0240 0x555568ba2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.546+0000 7f5e52ffd700 10 client.26926 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:39.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.546+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568ba0240 0x555568ba2660 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a79c85118e15fe server_cookie=dc3d05a36389be29 in_seq=0 out_seq=0 2023-09-21T13:01:39.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e52ffd700 1 -- 172.21.15.142:0/1831445423 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555568b55020 con 0x555568ba0240 2023-09-21T13:01:39.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e52ffd700 10 client.26926 handle_command_reply: tid=0 2023-09-21T13:01:39.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 client.26926 shutdown 2023-09-21T13:01:39.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 msgr2=0x555568b8fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5e680095f0 tx=0x7f5e68005270 comp rx=0 tx=0).stop 2023-09-21T13:01:39.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 shutdown_connections 2023-09-21T13:01:39.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568ba0240 0x555568ba2660 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86610 0x555568b92b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b904e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1831445423 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86f30 0x555568b8fda0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 >> 172.21.15.142:0/1831445423 conn(0x555568ab3000 msgr2=0x555568b81290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e52ffd700 0 client.26926 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:39.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 shutdown_connections 2023-09-21T13:01:39.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.547+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1831445423 wait complete. 2023-09-21T13:01:39.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.548+0000 7f5e8d310b80 20 client.26926 trim_cache size 0 max 16384 2023-09-21T13:01:39.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 Processor -- start 2023-09-21T13:01:39.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 -- start start 2023-09-21T13:01:39.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568958920 con 0x555568b86f30 2023-09-21T13:01:39.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568b87670 con 0x555568b8b360 2023-09-21T13:01:39.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.567+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568b81be0 con 0x555568b86610 2023-09-21T13:01:39.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e737fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43530/0 (socket says 172.21.15.142:43530) 2023-09-21T13:01:39.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 -- 172.21.15.142:0/1055194283 learned_addr learned my addr 172.21.15.142:0/1055194283 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e727fc700 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 -- 172.21.15.142:0/1055194283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 msgr2=0x555568b8aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 -- 172.21.15.142:0/1055194283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 msgr2=0x555568b8a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 -- 172.21.15.142:0/1055194283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555568929250 con 0x555568b86610 2023-09-21T13:01:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e64010bc0 tx=0x7f5e640ce480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d736750d13c1957 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e5a7fc700 1 -- 172.21.15.142:0/1055194283 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64099010 con 0x555568b86610 2023-09-21T13:01:39.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e5a7fc700 1 -- 172.21.15.142:0/1055194283 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e64099db0 con 0x555568b86610 2023-09-21T13:01:39.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.568+0000 7f5e5a7fc700 1 -- 172.21.15.142:0/1055194283 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64099b70 con 0x555568b86610 2023-09-21T13:01:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1055194283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 msgr2=0x555568b926c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5e64010bc0 tx=0x7f5e640ce480 comp rx=0 tx=0).stop 2023-09-21T13:01:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1055194283 shutdown_connections 2023-09-21T13:01:39.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b8aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b926c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/1055194283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b8a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.569+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1055194283 >> 172.21.15.142:0/1055194283 conn(0x555568ab3000 msgr2=0x555568b9c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.570+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1055194283 shutdown_connections 2023-09-21T13:01:39.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.570+0000 7f5e8d310b80 1 -- 172.21.15.142:0/1055194283 wait complete. 2023-09-21T13:01:39.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.570+0000 7f5e8d310b80 1 -- start start 2023-09-21T13:01:39.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.570+0000 7f5e8d310b80 1 Processor -- start 2023-09-21T13:01:39.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b955e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b95b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568b96060 con 0x555568b86f30 2023-09-21T13:01:39.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568b961d0 con 0x555568b8b360 2023-09-21T13:01:39.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568b96390 con 0x555568b86610 2023-09-21T13:01:39.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e8d310b80 10 client.0 _ll_register_callbacks cb 0x5555689bea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:39.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.571+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43536/0 (socket says 172.21.15.142:43536) 2023-09-21T13:01:39.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 -- 172.21.15.142:0/776751034 learned_addr learned my addr 172.21.15.142:0/776751034 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e727fc700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b955e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e737fe700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b95b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 -- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 msgr2=0x555568b95b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b95b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 -- 172.21.15.142:0/776751034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 msgr2=0x555568b955e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:39.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b955e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 -- 172.21.15.142:0/776751034 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e741a6000 con 0x555568b86610 2023-09-21T13:01:39.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e72ffd700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e6401a040 tx=0x7f5e640992f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f192caa472248afb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:39.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64098da0 con 0x555568b86610 2023-09-21T13:01:39.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e6409d4e0 con 0x555568b86610 2023-09-21T13:01:39.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.572+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e68015070 con 0x555568b86610 2023-09-21T13:01:39.582 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e640996b0 con 0x555568b86610 2023-09-21T13:01:39.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 10 client.26932 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:39.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5555689012b0 con 0x555568b86610 2023-09-21T13:01:39.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e68015070 con 0x555568b86610 2023-09-21T13:01:39.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5e640a1290 con 0x555568b86610 2023-09-21T13:01:39.583 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 10 client.26932 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:39.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 10 client.26932 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:39.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 20 client.26932 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:39.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568bf50a0 0x555568bf7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 4 client.26932 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:01:39.584 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555568ad0e60 con 0x555568bf50a0 2023-09-21T13:01:39.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.573+0000 7f5e727fc700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568bf50a0 0x555568bf7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e727fc700 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568bf50a0 0x555568bf7490 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5adcdb454b9e85 server_cookie=11644eb8db47bff8 in_seq=0 out_seq=0 2023-09-21T13:01:39.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e52ffd700 10 client.26932 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:39.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e52ffd700 1 -- 172.21.15.142:0/776751034 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555568ad0e60 con 0x555568bf50a0 2023-09-21T13:01:39.585 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e52ffd700 10 client.26932 handle_command_reply: tid=0 2023-09-21T13:01:39.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 client.26932 shutdown 2023-09-21T13:01:39.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 msgr2=0x555568b972b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5e6401a040 tx=0x7f5e640992f0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.586 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 shutdown_connections 2023-09-21T13:01:39.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555568bf50a0 0x555568bf7490 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555568b8b360 0x555568b95b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555568b86610 0x555568b972b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.587 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 --2- 172.21.15.142:0/776751034 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555568b86f30 0x555568b955e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 >> 172.21.15.142:0/776751034 conn(0x555568ab3000 msgr2=0x555568b8a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e52ffd700 0 client.26932 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 shutdown_connections 2023-09-21T13:01:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.574+0000 7f5e8d310b80 1 -- 172.21.15.142:0/776751034 wait complete. 2023-09-21T13:01:39.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e8d310b80 20 client.26932 trim_cache size 0 max 16384 2023-09-21T13:01:39.589 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:39.589 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T13:01:39.589 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T13:01:39.589 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:39.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 msgr2=0x7f5e5c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 0x7f5e5c0a2c70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c0095c0 tx=0x7f5e6c00b720 comp rx=0 tx=0).stop 2023-09-21T13:01:39.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 msgr2=0x7f5e741991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400e9a0 tx=0x7f5e6400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 shutdown_connections 2023-09-21T13:01:39.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e5c0a07b0 0x7f5e5c0a2c70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e7410b310 0x7f5e7419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e74101ef0 0x7f5e741991d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 --2- 172.21.15.142:0/3874911970 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e74102810 0x7f5e74199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.575+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 >> 172.21.15.142:0/3874911970 conn(0x7f5e740fb730 msgr2=0x7f5e7410d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.576+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 shutdown_connections 2023-09-21T13:01:39.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.576+0000 7f5e799ff700 1 -- 172.21.15.142:0/3874911970 wait complete. 2023-09-21T13:01:39.596 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T13:01:39.596 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:01:39.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 499208 9.58 MB/sec execute 140 sec latency 34.666 ms 2023-09-21T13:01:39.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/1372810472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073180 msgr2=0x7fe8d4073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/1372810472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073180 0x7fe8d4073560 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00098f0 tx=0x7fe8d0009c00 comp rx=0 tx=0).stop 2023-09-21T13:01:39.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/1372810472 shutdown_connections 2023-09-21T13:01:39.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/1372810472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4111d70 0x7fe8d4114160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/1372810472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073180 0x7fe8d4073560 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/1372810472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4073aa0 0x7fe8d4111830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/1372810472 >> 172.21.15.142:0/1372810472 conn(0x7fe8d40fc890 msgr2=0x7fe8d40fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:39.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/1372810472 shutdown_connections 2023-09-21T13:01:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.824+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/1372810472 wait complete. 2023-09-21T13:01:39.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 Processor -- start 2023-09-21T13:01:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 -- start start 2023-09-21T13:01:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 0x7fe8d419da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4111d70 0x7fe8d41a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41a2500 con 0x7fe8d4111d70 2023-09-21T13:01:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41a2670 con 0x7fe8d4073aa0 2023-09-21T13:01:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.825+0000 7fe8dc1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41a2830 con 0x7fe8d4073180 2023-09-21T13:01:39.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d979a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 0x7fe8d419da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43558/0 (socket says 172.21.15.142:43558) 2023-09-21T13:01:39.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 -- 172.21.15.142:0/2641939676 learned_addr learned my addr 172.21.15.142:0/2641939676 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:39.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8da79c700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4111d70 0x7fe8d41a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 -- 172.21.15.142:0/2641939676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 msgr2=0x7fe8d419da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 0x7fe8d419da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 -- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4111d70 msgr2=0x7fe8d41a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4111d70 0x7fe8d41a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 -- 172.21.15.142:0/2641939676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c40095f0 con 0x7fe8d4073180 2023-09-21T13:01:39.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d979a700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 0x7fe8d419da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8d9f9b700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009810 tx=0x7fe8d000fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.826+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d001c070 con 0x7fe8d4073180 2023-09-21T13:01:39.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.827+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8d000bb20 con 0x7fe8d4073180 2023-09-21T13:01:39.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.827+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0004930 con 0x7fe8d4073180 2023-09-21T13:01:39.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.827+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d0009520 con 0x7fe8d4073180 2023-09-21T13:01:39.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.827+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d41aa170 con 0x7fe8d4073180 2023-09-21T13:01:39.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.828+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d4104290 con 0x7fe8d4073180 2023-09-21T13:01:39.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.830+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe8d0020070 con 0x7fe8d4073180 2023-09-21T13:01:39.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.832+0000 7fe8caffd700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 0x7fe8c00a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:39.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.832+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe8d00ccc90 con 0x7fe8d4073180 2023-09-21T13:01:39.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.832+0000 7fe8d979a700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 0x7fe8c00a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:39.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.832+0000 7fe8d979a700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 0x7fe8c00a2cb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8d419eb30 tx=0x7fe8c4009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:39.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:39.835+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe8d00964e0 con 0x7fe8d4073180 2023-09-21T13:01:39.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:39 smithi142 ceph-mon[97663]: pgmap v166: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2023-09-21T13:01:39.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:39 smithi160 ceph-mon[134450]: pgmap v166: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2023-09-21T13:01:40.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.140+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8d4067bd0 con 0x7fe8d4073180 2023-09-21T13:01:40.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.141+0000 7fe8caffd700 1 -- 172.21.15.142:0/2641939676 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11340 (secure 0 0 0) 0x7fe8d0099b00 con 0x7fe8d4073180 2023-09-21T13:01:40.141 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:01:40.141 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:01:37.680237+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_26914":{"gid":26914,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/1221820034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1221820034},{"type":"v1","addr":"172.21.15.160:6839","nonce":1221820034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:01:40.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 msgr2=0x7fe8c00a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 0x7fe8c00a2cb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe8d419eb30 tx=0x7fe8c4009310 comp rx=0 tx=0).stop 2023-09-21T13:01:40.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 msgr2=0x7fe8d419d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0009810 tx=0x7fe8d000fa00 comp rx=0 tx=0).stop 2023-09-21T13:01:40.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 shutdown_connections 2023-09-21T13:01:40.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe8c00a07f0 0x7fe8c00a2cb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe8d4111d70 0x7fe8d41a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8d4073180 0x7fe8d419d520 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 --2- 172.21.15.142:0/2641939676 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe8d4073aa0 0x7fe8d419da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 >> 172.21.15.142:0/2641939676 conn(0x7fe8d40fc890 msgr2=0x7fe8d40fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 shutdown_connections 2023-09-21T13:01:40.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.144+0000 7fe8dc1ff700 1 -- 172.21.15.142:0/2641939676 wait complete. 2023-09-21T13:01:40.146 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 30 2023-09-21T13:01:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:39 smithi156 ceph-mon[134078]: pgmap v166: 97 pgs: 97 active+clean; 130 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 250 op/s 2023-09-21T13:01:40.164 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:01:40.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 -- 172.21.15.142:0/620939688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 msgr2=0x7f7fbc0ffc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/620939688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc0ffc00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7fac009990 tx=0x7f7fac009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 -- 172.21.15.142:0/620939688 shutdown_connections 2023-09-21T13:01:40.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/620939688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc10dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/620939688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc0ffc00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/620939688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1001d0 0x7f7fbc105a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 -- 172.21.15.142:0/620939688 >> 172.21.15.142:0/620939688 conn(0x7f7fbc075f20 msgr2=0x7f7fbc076330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 -- 172.21.15.142:0/620939688 shutdown_connections 2023-09-21T13:01:40.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.387+0000 7f7fc1bff700 1 -- 172.21.15.142:0/620939688 wait complete. 2023-09-21T13:01:40.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.388+0000 7f7fc1bff700 1 Processor -- start 2023-09-21T13:01:40.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 -- start start 2023-09-21T13:01:40.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc19dba0 0x7f7fbc19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc19e620 con 0x7f7fbc19dba0 2023-09-21T13:01:40.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc19e790 con 0x7f7fbc1060f0 2023-09-21T13:01:40.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fc1bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fbc19e950 con 0x7f7fbc0ff820 2023-09-21T13:01:40.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43586/0 (socket says 172.21.15.142:43586) 2023-09-21T13:01:40.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/1462100448 learned_addr learned my addr 172.21.15.142:0/1462100448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.389+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc19dba0 0x7f7fbc19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/1462100448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 msgr2=0x7f7fbc199740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc199740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc19dba0 msgr2=0x7f7fbc19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc19dba0 0x7f7fbc19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/1462100448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0095f0 con 0x7f7fbc0ff820 2023-09-21T13:01:40.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:40.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005910 tx=0x7f7fac004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fb97fa700 1 -- 172.21.15.142:0/1462100448 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac01d070 con 0x7f7fbc0ff820 2023-09-21T13:01:40.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fb97fa700 1 -- 172.21.15.142:0/1462100448 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fac022470 con 0x7f7fbc0ff820 2023-09-21T13:01:40.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fbc1a5e50 con 0x7f7fbc0ff820 2023-09-21T13:01:40.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fb97fa700 1 -- 172.21.15.142:0/1462100448 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac017650 con 0x7f7fbc0ff820 2023-09-21T13:01:40.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.390+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc1a6210 con 0x7f7fbc0ff820 2023-09-21T13:01:40.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.393+0000 7f7fb97fa700 1 -- 172.21.15.142:0/1462100448 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7fac00fad0 con 0x7f7fbc0ff820 2023-09-21T13:01:40.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 Processor -- start 2023-09-21T13:01:40.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 -- start start 2023-09-21T13:01:40.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b017399f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b0173e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b016adca0 con 0x555b01739610 2023-09-21T13:01:40.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b01691c70 con 0x555b01739f30 2023-09-21T13:01:40.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.395+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0168f590 con 0x555b0173e360 2023-09-21T13:01:40.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fb97fa700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 0x7f7fa80a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b0173e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37214/0 (socket says 172.21.15.142:37214) 2023-09-21T13:01:40.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b0173e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43600/0 (socket says 172.21.15.142:43600) 2023-09-21T13:01:40.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/3708261956 learned_addr learned my addr 172.21.15.142:0/3708261956 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b017399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fb97fa700 1 -- 172.21.15.142:0/1462100448 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7fac0cd460 con 0x7f7fbc0ff820 2023-09-21T13:01:40.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/3708261956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 msgr2=0x555b0173e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b0173e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/3708261956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 msgr2=0x555b017399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b017399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 0x7f7fa80a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.396+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/3708261956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b014b5de0 con 0x555b01739f30 2023-09-21T13:01:40.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.397+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7fac018020 tx=0x7f7fac06abd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc9fb1467de3c4ac server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.397+0000 7f7fb1ffb700 1 -- 172.21.15.142:0/3708261956 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac09a4b0 con 0x555b01739f30 2023-09-21T13:01:40.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.397+0000 7f7fb1ffb700 1 -- 172.21.15.142:0/3708261956 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fac09a2d0 con 0x555b01739f30 2023-09-21T13:01:40.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.397+0000 7f7fb1ffb700 1 -- 172.21.15.142:0/3708261956 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac09e830 con 0x555b01739f30 2023-09-21T13:01:40.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- 172.21.15.142:0/3708261956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 msgr2=0x555b0173de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 0x7f7fa80a2c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009790 tx=0x7f7fb4009130 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7fac018020 tx=0x7f7fac06abd0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- 172.21.15.142:0/3708261956 shutdown_connections 2023-09-21T13:01:40.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b017399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b0173e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/3708261956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b0173de20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- 172.21.15.142:0/3708261956 >> 172.21.15.142:0/3708261956 conn(0x555b01666000 msgr2=0x555b017346a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- 172.21.15.142:0/3708261956 shutdown_connections 2023-09-21T13:01:40.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- 172.21.15.142:0/3708261956 wait complete. 2023-09-21T13:01:40.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.398+0000 7f7fd5544b80 1 -- start start 2023-09-21T13:01:40.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 Processor -- start 2023-09-21T13:01:40.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b01745a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01742ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b017432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0168ae80 con 0x555b01739610 2023-09-21T13:01:40.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b01627740 con 0x555b01739f30 2023-09-21T13:01:40.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b016273e0 con 0x555b0173e360 2023-09-21T13:01:40.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fd5544b80 10 client.0 _ll_register_callbacks cb 0x555b01571a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:40.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01742ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.399+0000 7f7fbbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b017432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b01745a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fbbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b017432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43616/0 (socket says 172.21.15.142:43616) 2023-09-21T13:01:40.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fbbfff700 1 -- 172.21.15.142:0/82307475 learned_addr learned my addr 172.21.15.142:0/82307475 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 -- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 msgr2=0x555b017432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b017432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 -- 172.21.15.142:0/82307475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 msgr2=0x555b01745a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b01745a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 -- 172.21.15.142:0/82307475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fbc1a6210 con 0x555b01739f30 2023-09-21T13:01:40.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01742ce0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc073430 tx=0x7f7fa4012f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f739b1967c9128bb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7f9affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:40.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4017070 con 0x555b01739f30 2023-09-21T13:01:40.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.400+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b015fbbb0 con 0x555b01739f30 2023-09-21T13:01:40.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7fa4004050 con 0x555b01739f30 2023-09-21T13:01:40.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa4004210 con 0x555b01739f30 2023-09-21T13:01:40.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7fd5544b80 10 client.26987 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:40.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555b0149ec60 con 0x555b01739f30 2023-09-21T13:01:40.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555b015fbbb0 con 0x555b01739f30 2023-09-21T13:01:40.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7fa4003840 con 0x555b01739f30 2023-09-21T13:01:40.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7fd5544b80 10 client.26987 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:40.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.401+0000 7f7fd5544b80 10 client.26987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:01:40.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fd5544b80 20 client.26987 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b01753060 0x555b01755480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fd5544b80 4 client.26987 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b01708020 con 0x555b01753060 2023-09-21T13:01:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b01753060 0x555b01755480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b01753060 0x555b01755480 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3d08d54329ddd90 server_cookie=21a8ea442ab5297b in_seq=0 out_seq=0 2023-09-21T13:01:40.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.402+0000 7f7f9affd700 10 client.26987 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:40.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7f9affd700 1 -- 172.21.15.142:0/82307475 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555b01708020 con 0x555b01753060 2023-09-21T13:01:40.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7f9affd700 10 client.26987 handle_command_reply: tid=0 2023-09-21T13:01:40.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7fd5544b80 1 client.26987 shutdown 2023-09-21T13:01:40.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 msgr2=0x555b01742ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01742ce0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc073430 tx=0x7f7fa4012f20 comp rx=0 tx=0).stop 2023-09-21T13:01:40.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 shutdown_connections 2023-09-21T13:01:40.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.403+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b01753060 0x555b01755480 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b01745a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7f9affd700 0 client.26987 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:40.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b0173e360 0x555b017432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/82307475 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01742ce0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 >> 172.21.15.142:0/82307475 conn(0x555b01666000 msgr2=0x555b01733880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 shutdown_connections 2023-09-21T13:01:40.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 1 -- 172.21.15.142:0/82307475 wait complete. 2023-09-21T13:01:40.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.404+0000 7f7fd5544b80 20 client.26987 trim_cache size 0 max 16384 2023-09-21T13:01:40.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.419+0000 7f7fd5544b80 1 Processor -- start 2023-09-21T13:01:40.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.419+0000 7f7fd5544b80 1 -- start start 2023-09-21T13:01:40.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739f30 0x555b01740460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 0x555b01745600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0150b920 con 0x555b01739610 2023-09-21T13:01:40.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b0174a820 con 0x555b0173e360 2023-09-21T13:01:40.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b017412c0 con 0x555b01739f30 2023-09-21T13:01:40.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fbbfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 0x555b01745600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59342/0 (socket says 172.21.15.142:59342) 2023-09-21T13:01:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/785950551 learned_addr learned my addr 172.21.15.142:0/785950551 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.420+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739f30 0x555b01740460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/785950551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739f30 msgr2=0x555b01740460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739f30 0x555b01740460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/785950551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 msgr2=0x555b01745600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 0x555b01745600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 -- 172.21.15.142:0/785950551 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b014dc250 con 0x555b01739610 2023-09-21T13:01:40.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 0x555b01745600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:40.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005cb0 tx=0x7f7fac084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78be0a2aa624b587 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fb27fc700 1 -- 172.21.15.142:0/785950551 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac09b070 con 0x555b01739610 2023-09-21T13:01:40.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fb27fc700 1 -- 172.21.15.142:0/785950551 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fac0a2950 con 0x555b01739610 2023-09-21T13:01:40.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.421+0000 7f7fb27fc700 1 -- 172.21.15.142:0/785950551 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac022700 con 0x555b01739610 2023-09-21T13:01:40.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- 172.21.15.142:0/785950551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 msgr2=0x555b0174a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005cb0 tx=0x7f7fac084040 comp rx=0 tx=0).stop 2023-09-21T13:01:40.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- 172.21.15.142:0/785950551 shutdown_connections 2023-09-21T13:01:40.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b01739610 0x555b0174a260 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b0173e360 0x555b01745600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/785950551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739f30 0x555b01740460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- 172.21.15.142:0/785950551 >> 172.21.15.142:0/785950551 conn(0x555b01666000 msgr2=0x555b0173fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- 172.21.15.142:0/785950551 shutdown_connections 2023-09-21T13:01:40.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- 172.21.15.142:0/785950551 wait complete. 2023-09-21T13:01:40.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.422+0000 7f7fd5544b80 1 -- start start 2023-09-21T13:01:40.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 Processor -- start 2023-09-21T13:01:40.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739610 0x555b017499d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 0x555b017461e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b01746880 con 0x555b0173e360 2023-09-21T13:01:40.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b017469f0 con 0x555b01739f30 2023-09-21T13:01:40.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b01746bb0 con 0x555b01739610 2023-09-21T13:01:40.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fd5544b80 10 client.0 _ll_register_callbacks cb 0x555b01571a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:40.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fbb7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739610 0x555b017499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fb3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37240/0 (socket says 172.21.15.142:37240) 2023-09-21T13:01:40.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.423+0000 7f7fb3fff700 1 -- 172.21.15.142:0/1683813934 learned_addr learned my addr 172.21.15.142:0/1683813934 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 0x555b017461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 -- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739610 msgr2=0x555b017499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739610 0x555b017499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 -- 172.21.15.142:0/1683813934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 msgr2=0x555b017461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 0x555b017461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 -- 172.21.15.142:0/1683813934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb4011040 con 0x555b01739f30 2023-09-21T13:01:40.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fbbfff700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 0x555b017461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:40.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fb3fff700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4012850 tx=0x7f7fa400f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad25a41ecfe00cc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7f9affd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4017040 con 0x555b01739f30 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7fa400f880 con 0x555b01739f30 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.424+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7fac09a2d0 con 0x555b01739f30 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa400fa40 con 0x555b01739f30 2023-09-21T13:01:40.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 10 client.26993 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x555b014b5de0 con 0x555b01739f30 2023-09-21T13:01:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fac09a2d0 con 0x555b01739f30 2023-09-21T13:01:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7fa4010620 con 0x555b01739f30 2023-09-21T13:01:40.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 10 client.26993 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 10 client.26993 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:01:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 20 client.26993 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b017a7fb0 0x555b017aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 4 client.26993 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:40.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555b01683e60 con 0x555b017a7fb0 2023-09-21T13:01:40.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.425+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b017a7fb0 0x555b017aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fbb7fe700 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b017a7fb0 0x555b017aa3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=faa3bc073c9003e6 server_cookie=b656ed1e3079ee8b in_seq=0 out_seq=0 2023-09-21T13:01:40.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7f9affd700 10 client.26993 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:40.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7f9affd700 1 -- 172.21.15.142:0/1683813934 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555b01683e60 con 0x555b017a7fb0 2023-09-21T13:01:40.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7f9affd700 10 client.26993 handle_command_reply: tid=0 2023-09-21T13:01:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 client.26993 shutdown 2023-09-21T13:01:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 msgr2=0x555b01749f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4012850 tx=0x7f7fa400f6a0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 shutdown_connections 2023-09-21T13:01:40.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x555b017a7fb0 0x555b017aa3d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555b0173e360 0x555b017461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b01739610 0x555b017499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 --2- 172.21.15.142:0/1683813934 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555b01739f30 0x555b01749f10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.426+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 >> 172.21.15.142:0/1683813934 conn(0x555b01666000 msgr2=0x555b01738ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7f9affd700 0 client.26993 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:01:40.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 shutdown_connections 2023-09-21T13:01:40.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fd5544b80 1 -- 172.21.15.142:0/1683813934 wait complete. 2023-09-21T13:01:40.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fd5544b80 20 client.26993 trim_cache size 0 max 16384 2023-09-21T13:01:40.442 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:40.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 msgr2=0x7f7fa80a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 0x7f7fa80a2c70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7fb4009790 tx=0x7f7fb4009130 comp rx=0 tx=0).stop 2023-09-21T13:01:40.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 msgr2=0x7f7fbc199200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7fac005910 tx=0x7f7fac004730 comp rx=0 tx=0).stop 2023-09-21T13:01:40.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 shutdown_connections 2023-09-21T13:01:40.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7fa80a07b0 0x7f7fa80a2c70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fbc19dba0 0x7f7fbc19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fbc0ff820 0x7f7fbc199200 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 --2- 172.21.15.142:0/1462100448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fbc1060f0 0x7f7fbc199740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.427+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 >> 172.21.15.142:0/1462100448 conn(0x7f7fbc075f20 msgr2=0x7f7fbc0fd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.428+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 shutdown_connections 2023-09-21T13:01:40.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.428+0000 7f7fc1bff700 1 -- 172.21.15.142:0/1462100448 wait complete. 2023-09-21T13:01:40.447 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:01:40.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 -- 172.21.15.142:0/1186633056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee0073210 msgr2=0x7feee00735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.675 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 --2- 172.21.15.142:0/1186633056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee0073210 0x7feee00735f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7feed40098f0 tx=0x7feed4009c00 comp rx=0 tx=0).stop 2023-09-21T13:01:40.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 -- 172.21.15.142:0/1186633056 shutdown_connections 2023-09-21T13:01:40.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 --2- 172.21.15.142:0/1186633056 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee010d410 0x7feee010f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 --2- 172.21.15.142:0/1186633056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee0073210 0x7feee00735f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 --2- 172.21.15.142:0/1186633056 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 0x7feee010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 -- 172.21.15.142:0/1186633056 >> 172.21.15.142:0/1186633056 conn(0x7feee00fc6a0 msgr2=0x7feee00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 -- 172.21.15.142:0/1186633056 shutdown_connections 2023-09-21T13:01:40.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.674+0000 7feee5b9d700 1 -- 172.21.15.142:0/1186633056 wait complete. 2023-09-21T13:01:40.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.676+0000 7feee5b9d700 1 Processor -- start 2023-09-21T13:01:40.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.676+0000 7feee5b9d700 1 -- start start 2023-09-21T13:01:40.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.676+0000 7feee5b9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.676+0000 7feee5b9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 0x7feee01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee5b9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee010d410 0x7feee019d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee5b9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019de80 con 0x7feee0073b30 2023-09-21T13:01:40.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee5b9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019dff0 con 0x7feee0073210 2023-09-21T13:01:40.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee5b9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee019e1b0 con 0x7feee010d410 2023-09-21T13:01:40.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feedffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 0x7feee01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37272/0 (socket says 172.21.15.142:37272) 2023-09-21T13:01:40.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 -- 172.21.15.142:0/59447502 learned_addr learned my addr 172.21.15.142:0/59447502 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee539c700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee010d410 0x7feee019d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 -- 172.21.15.142:0/59447502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee010d410 msgr2=0x7feee019d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee010d410 0x7feee019d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 -- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 msgr2=0x7feee01993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 0x7feee01993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 -- 172.21.15.142:0/59447502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8009d00 con 0x7feee0073210 2023-09-21T13:01:40.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.677+0000 7feee4b9b700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feed4009230 tx=0x7feed400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.678+0000 7feeddffb700 1 -- 172.21.15.142:0/59447502 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed401c070 con 0x7feee0073210 2023-09-21T13:01:40.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.678+0000 7feeddffb700 1 -- 172.21.15.142:0/59447502 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feed400bba0 con 0x7feee0073210 2023-09-21T13:01:40.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.678+0000 7feeddffb700 1 -- 172.21.15.142:0/59447502 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40038e0 con 0x7feee0073210 2023-09-21T13:01:40.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.678+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed4009520 con 0x7feee0073210 2023-09-21T13:01:40.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.678+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee01a5af0 con 0x7feee0073210 2023-09-21T13:01:40.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.681+0000 7feeddffb700 1 -- 172.21.15.142:0/59447502 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7feed4020030 con 0x7feee0073210 2023-09-21T13:01:40.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.682+0000 7feefa816b80 1 Processor -- start 2023-09-21T13:01:40.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.682+0000 7feefa816b80 1 -- start start 2023-09-21T13:01:40.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.682+0000 7feeddffb700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 0x7feed00a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feeddffb700 1 -- 172.21.15.142:0/59447502 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feed40cce30 con 0x7feee0073210 2023-09-21T13:01:40.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feee539c700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 0x7feed00a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea345ca0 con 0x55e5ea3d73c0 2023-09-21T13:01:40.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea329c70 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feefa816b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea327590 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feedffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feedffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43676/0 (socket says 172.21.15.142:43676) 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feedffff700 1 -- 172.21.15.142:0/12863154 learned_addr learned my addr 172.21.15.142:0/12863154 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feee539c700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.683+0000 7feee4b9b700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 -- 172.21.15.142:0/12863154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 msgr2=0x55e5ea3d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 -- 172.21.15.142:0/12863154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 msgr2=0x55e5ea3d77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3d77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 -- 172.21.15.142:0/12863154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5ea14dde0 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feee4b9b700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3d77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:40.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feee539c700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 0x7feed00a2d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feed8009fd0 tx=0x7feed8007b80 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feedffff700 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feecc0092d0 tx=0x7feecc011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99cef648dddcf56a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feecaffd700 1 -- 172.21.15.142:0/12863154 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc011d80 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feecaffd700 1 -- 172.21.15.142:0/12863154 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feecc01ad10 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.684+0000 7feecaffd700 1 -- 172.21.15.142:0/12863154 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc022ce0 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 -- 172.21.15.142:0/12863154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 msgr2=0x55e5ea3d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7feecc0092d0 tx=0x7feecc011440 comp rx=0 tx=0).stop 2023-09-21T13:01:40.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 -- 172.21.15.142:0/12863154 shutdown_connections 2023-09-21T13:01:40.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3d77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 --2- 172.21.15.142:0/12863154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3d1670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 -- 172.21.15.142:0/12863154 >> 172.21.15.142:0/12863154 conn(0x55e5ea2fe000 msgr2=0x55e5ea3cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 -- 172.21.15.142:0/12863154 shutdown_connections 2023-09-21T13:01:40.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.685+0000 7feefa816b80 1 -- 172.21.15.142:0/12863154 wait complete. 2023-09-21T13:01:40.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.686+0000 7feefa816b80 1 -- start start 2023-09-21T13:01:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.686+0000 7feefa816b80 1 Processor -- start 2023-09-21T13:01:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea322e80 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea2bf740 con 0x55e5ea3d73c0 2023-09-21T13:01:40.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea2bf3e0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feefa816b80 10 client.0 _ll_register_callbacks cb 0x55e5ea209a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:40.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feedffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43686/0 (socket says 172.21.15.142:43686) 2023-09-21T13:01:40.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 -- 172.21.15.142:0/3864923276 learned_addr learned my addr 172.21.15.142:0/3864923276 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee539c700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 -- 172.21.15.142:0/3864923276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 msgr2=0x55e5ea3db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3db4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 -- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d7ce0 msgr2=0x55e5ea3db9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.687+0000 7feee4b9b700 1 -- 172.21.15.142:0/3864923276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc009980 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feee4b9b700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feed409a040 tx=0x7feed4005480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a0a642278404e7d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feebffff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed409a340 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feed409e170 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5ea293bb0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed40a2320 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feefa816b80 10 client.26968 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.688+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e5ea136c60 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5ea293bb0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feed40b8140 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 10 client.26968 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:40.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 10 client.26968 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:01:40.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 20 client.26968 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:40.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea3eb150 0x55e5ea3ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 4 client.26968 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:40.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5ea3a0020 con 0x55e5ea3eb150 2023-09-21T13:01:40.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.689+0000 7feedffff700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea3eb150 0x55e5ea3ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 501318 9.61 MB/sec execute 141 sec latency 24.376 ms 2023-09-21T13:01:40.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.690+0000 7feedffff700 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea3eb150 0x55e5ea3ed540 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6ce6133a3659f4b6 server_cookie=5325fda379c757a6 in_seq=0 out_seq=0 2023-09-21T13:01:40.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.690+0000 7feebffff700 10 client.26968 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:40.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.690+0000 7feebffff700 1 -- 172.21.15.142:0/3864923276 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e5ea3a0020 con 0x55e5ea3eb150 2023-09-21T13:01:40.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.690+0000 7feebffff700 10 client.26968 handle_command_reply: tid=0 2023-09-21T13:01:40.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 client.26968 shutdown 2023-09-21T13:01:40.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 msgr2=0x55e5ea3daf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7feed409a040 tx=0x7feed4005480 comp rx=0 tx=0).stop 2023-09-21T13:01:40.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 shutdown_connections 2023-09-21T13:01:40.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea3eb150 0x55e5ea3ed540 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3daf70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 --2- 172.21.15.142:0/3864923276 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feebffff700 0 client.26968 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:40.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 >> 172.21.15.142:0/3864923276 conn(0x55e5ea2fe000 msgr2=0x55e5ea3cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 shutdown_connections 2023-09-21T13:01:40.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 1 -- 172.21.15.142:0/3864923276 wait complete. 2023-09-21T13:01:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.691+0000 7feefa816b80 20 client.26968 trim_cache size 0 max 16384 2023-09-21T13:01:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.706+0000 7feefa816b80 1 Processor -- start 2023-09-21T13:01:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.706+0000 7feefa816b80 1 -- start start 2023-09-21T13:01:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.706+0000 7feefa816b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.706+0000 7feefa816b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.706+0000 7feefa816b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feefa816b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea1a3920 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feefa816b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3de1d0 con 0x55e5ea3d73c0 2023-09-21T13:01:40.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feefa816b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3dc550 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37298/0 (socket says 172.21.15.142:37298) 2023-09-21T13:01:40.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 -- 172.21.15.142:0/4052266213 learned_addr learned my addr 172.21.15.142:0/4052266213 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feee539c700 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 -- 172.21.15.142:0/4052266213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 msgr2=0x55e5ea3db750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 -- 172.21.15.142:0/4052266213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d1bb0 msgr2=0x55e5ea3d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 -- 172.21.15.142:0/4052266213 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5ea3f2100 con 0x55e5ea3d73c0 2023-09-21T13:01:40.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.707+0000 7feedffff700 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feecc009340 tx=0x7feecc0227a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7500278f664b9e3d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feecb7fe700 1 -- 172.21.15.142:0/4052266213 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0225d0 con 0x55e5ea3d73c0 2023-09-21T13:01:40.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feecb7fe700 1 -- 172.21.15.142:0/4052266213 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feecc01be90 con 0x55e5ea3d73c0 2023-09-21T13:01:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feecb7fe700 1 -- 172.21.15.142:0/4052266213 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc022810 con 0x55e5ea3d73c0 2023-09-21T13:01:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 -- 172.21.15.142:0/4052266213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 msgr2=0x55e5ea3e26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feecc009340 tx=0x7feecc0227a0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 -- 172.21.15.142:0/4052266213 shutdown_connections 2023-09-21T13:01:40.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea3d1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea3db750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 --2- 172.21.15.142:0/4052266213 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d73c0 0x55e5ea3e26f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.708+0000 7feefa816b80 1 -- 172.21.15.142:0/4052266213 >> 172.21.15.142:0/4052266213 conn(0x55e5ea2fe000 msgr2=0x55e5ea3e7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.709+0000 7feefa816b80 1 -- 172.21.15.142:0/4052266213 shutdown_connections 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.709+0000 7feefa816b80 1 -- 172.21.15.142:0/4052266213 wait complete. 2023-09-21T13:01:40.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.709+0000 7feefa816b80 1 -- start start 2023-09-21T13:01:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.709+0000 7feefa816b80 1 Processor -- start 2023-09-21T13:01:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea4335a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea43def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea43e430 con 0x55e5ea3d73c0 2023-09-21T13:01:40.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea43e570 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea43e6b0 con 0x55e5ea3d7ce0 2023-09-21T13:01:40.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feefa816b80 10 client.0 _ll_register_callbacks cb 0x55e5ea209a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:40.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37312/0 (socket says 172.21.15.142:37312) 2023-09-21T13:01:40.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 -- 172.21.15.142:0/964369563 learned_addr learned my addr 172.21.15.142:0/964369563 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feedffff700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea4335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee539c700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea43def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 -- 172.21.15.142:0/964369563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 msgr2=0x55e5ea43def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea43def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 -- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 msgr2=0x55e5ea4335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea4335a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.710+0000 7feee4b9b700 1 -- 172.21.15.142:0/964369563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5ea14dde0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feee4b9b700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feed4096840 tx=0x7feed4009810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a7a208065efe5ed server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:40.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed40a02c0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7feed40b2260 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feecc01ad10 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed40214c0 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 10 client.27011 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e5ea174250 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feecc01ad10 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7feed4099830 con 0x55e5ea3d1bb0 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 10 client.27011 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 10 client.27011 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:01:40.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 20 client.27011 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:40.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea43f900 0x55e5ea441cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 4 client.27011 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:40.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.711+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e5ea31be60 con 0x55e5ea43f900 2023-09-21T13:01:40.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feedffff700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea43f900 0x55e5ea441cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feedffff700 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea43f900 0x55e5ea441cf0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88db8ab06770c072 server_cookie=61c1821bc7855af7 in_seq=0 out_seq=0 2023-09-21T13:01:40.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feebffff700 10 client.27011 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:40.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feebffff700 1 -- 172.21.15.142:0/964369563 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e5ea31be60 con 0x55e5ea43f900 2023-09-21T13:01:40.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feebffff700 10 client.27011 handle_command_reply: tid=0 2023-09-21T13:01:40.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feefa816b80 1 client.27011 shutdown 2023-09-21T13:01:40.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 msgr2=0x55e5ea433060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.712+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feed4096840 tx=0x7feed4009810 comp rx=0 tx=0).stop 2023-09-21T13:01:40.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 shutdown_connections 2023-09-21T13:01:40.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55e5ea43f900 0x55e5ea441cf0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e5ea3d7ce0 0x55e5ea43def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e5ea3d1bb0 0x55e5ea433060 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feebffff700 0 client.27011 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:01:40.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 --2- 172.21.15.142:0/964369563 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e5ea3d73c0 0x55e5ea4335a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 >> 172.21.15.142:0/964369563 conn(0x55e5ea2fe000 msgr2=0x55e5ea3db750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 shutdown_connections 2023-09-21T13:01:40.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 1 -- 172.21.15.142:0/964369563 wait complete. 2023-09-21T13:01:40.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feefa816b80 20 client.27011 trim_cache size 0 max 16384 2023-09-21T13:01:40.735 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:40.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 msgr2=0x7feed00a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 0x7feed00a2d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feed8009fd0 tx=0x7feed8007b80 comp rx=0 tx=0).stop 2023-09-21T13:01:40.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 msgr2=0x7feee0198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.713+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feed4009230 tx=0x7feed400fa00 comp rx=0 tx=0).stop 2023-09-21T13:01:40.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 shutdown_connections 2023-09-21T13:01:40.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feed00a08d0 0x7feed00a2d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feee010d410 0x7feee019d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7feee0073210 0x7feee0198ea0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 --2- 172.21.15.142:0/59447502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7feee0073b30 0x7feee01993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 >> 172.21.15.142:0/59447502 conn(0x7feee00fc6a0 msgr2=0x7feee010f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 shutdown_connections 2023-09-21T13:01:40.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.714+0000 7feee5b9d700 1 -- 172.21.15.142:0/59447502 wait complete. 2023-09-21T13:01:40.739 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:40 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2641939676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:40.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:01:40.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.962+0000 7fea513ff700 1 -- 172.21.15.142:0/893213670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c101970 msgr2=0x7fea4c1059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.962+0000 7fea513ff700 1 --2- 172.21.15.142:0/893213670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c101970 0x7fea4c1059b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fea34009990 tx=0x7fea34009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 -- 172.21.15.142:0/893213670 shutdown_connections 2023-09-21T13:01:40.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 --2- 172.21.15.142:0/893213670 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c1060e0 0x7fea4c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 --2- 172.21.15.142:0/893213670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c100fc0 0x7fea4c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 --2- 172.21.15.142:0/893213670 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c101970 0x7fea4c1059b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 -- 172.21.15.142:0/893213670 >> 172.21.15.142:0/893213670 conn(0x7fea4c0fc840 msgr2=0x7fea4c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 -- 172.21.15.142:0/893213670 shutdown_connections 2023-09-21T13:01:40.964 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.963+0000 7fea513ff700 1 -- 172.21.15.142:0/893213670 wait complete. 2023-09-21T13:01:40.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 Processor -- start 2023-09-21T13:01:40.966 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 -- start start 2023-09-21T13:01:40.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c100fc0 0x7fea4c199010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c19d9b0 0x7fea4c19de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c19e430 con 0x7fea4c100fc0 2023-09-21T13:01:40.967 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c19e5a0 con 0x7fea4c1060e0 2023-09-21T13:01:40.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.964+0000 7fea513ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c19e760 con 0x7fea4c19d9b0 2023-09-21T13:01:40.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea4affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c100fc0 0x7fea4c199010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37324/0 (socket says 172.21.15.142:37324) 2023-09-21T13:01:40.968 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 -- 172.21.15.142:0/2381366503 learned_addr learned my addr 172.21.15.142:0/2381366503 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c19d9b0 0x7fea4c19de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 -- 172.21.15.142:0/2381366503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c19d9b0 msgr2=0x7fea4c19de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c19d9b0 0x7fea4c19de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 -- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c100fc0 msgr2=0x7fea4c199010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.969 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c100fc0 0x7fea4c199010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 -- 172.21.15.142:0/2381366503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea340095f0 con 0x7fea4c1060e0 2023-09-21T13:01:40.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.965+0000 7fea43fff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea34000c00 tx=0x7fea34004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.970 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.966+0000 7fea48ff9700 1 -- 172.21.15.142:0/2381366503 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3401d070 con 0x7fea4c1060e0 2023-09-21T13:01:40.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.966+0000 7fea48ff9700 1 -- 172.21.15.142:0/2381366503 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea34021410 con 0x7fea4c1060e0 2023-09-21T13:01:40.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.966+0000 7fea48ff9700 1 -- 172.21.15.142:0/2381366503 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea34017650 con 0x7fea4c1060e0 2023-09-21T13:01:40.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.966+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea4c1a5c60 con 0x7fea4c1060e0 2023-09-21T13:01:40.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.966+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c1a60f0 con 0x7fea4c1060e0 2023-09-21T13:01:40.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.971+0000 7fea48ff9700 1 -- 172.21.15.142:0/2381366503 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fea34021580 con 0x7fea4c1060e0 2023-09-21T13:01:40.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.971+0000 7fea64c3eb80 1 Processor -- start 2023-09-21T13:01:40.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 -- start start 2023-09-21T13:01:40.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb45e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb462e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb3d2ca0 con 0x55f4eb45e610 2023-09-21T13:01:40.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb3b6c70 con 0x55f4eb45ef30 2023-09-21T13:01:40.974 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.972+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb3b4590 con 0x55f4eb463360 2023-09-21T13:01:40.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.973+0000 7fea4affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb462e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.973+0000 7fea43fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.973+0000 7fea4affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb462e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37326/0 (socket says 172.21.15.142:37326) 2023-09-21T13:01:40.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.973+0000 7fea4affd700 1 -- 172.21.15.142:0/2825912235 learned_addr learned my addr 172.21.15.142:0/2825912235 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.973+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb45e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 -- 172.21.15.142:0/2825912235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 msgr2=0x55f4eb462e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb462e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 -- 172.21.15.142:0/2825912235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 msgr2=0x55f4eb45e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb45e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 -- 172.21.15.142:0/2825912235 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4eb1dade0 con 0x55f4eb463360 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea43fff700 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4637c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea340ca8a0 tx=0x7fea340d5490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=669ccffae7c3410e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea417fa700 1 -- 172.21.15.142:0/2825912235 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340d5b20 con 0x55f4eb463360 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea417fa700 1 -- 172.21.15.142:0/2825912235 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea340d0d00 con 0x55f4eb463360 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea48ff9700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 0x7fea380a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.974+0000 7fea417fa700 1 -- 172.21.15.142:0/2825912235 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340db660 con 0x55f4eb463360 2023-09-21T13:01:40.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.975+0000 7fea48ff9700 1 -- 172.21.15.142:0/2381366503 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea340cd180 con 0x7fea4c1060e0 2023-09-21T13:01:40.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.975+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 0x7fea380a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.975+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2825912235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 msgr2=0x55f4eb4637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.975+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4637c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fea340ca8a0 tx=0x7fea340d5490 comp rx=0 tx=0).stop 2023-09-21T13:01:40.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2825912235 shutdown_connections 2023-09-21T13:01:40.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb45e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4637c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2825912235 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb462e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2825912235 >> 172.21.15.142:0/2825912235 conn(0x55f4eb38b000 msgr2=0x55f4eb4596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2825912235 shutdown_connections 2023-09-21T13:01:40.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2825912235 wait complete. 2023-09-21T13:01:40.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.976+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 0x7fea380a2cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea44007500 tx=0x7fea4400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.977+0000 7fea64c3eb80 1 -- start start 2023-09-21T13:01:40.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.977+0000 7fea64c3eb80 1 Processor -- start 2023-09-21T13:01:40.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45ef30 0x55f4eb467d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb3afe80 con 0x55f4eb45ef30 2023-09-21T13:01:40.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb34c740 con 0x55f4eb45e610 2023-09-21T13:01:40.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb34c3e0 con 0x55f4eb463360 2023-09-21T13:01:40.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.978+0000 7fea64c3eb80 10 client.0 _ll_register_callbacks cb 0x55f4eb296a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:40.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37334/0 (socket says 172.21.15.142:37334) 2023-09-21T13:01:40.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4affd700 1 -- 172.21.15.142:0/3291714900 learned_addr learned my addr 172.21.15.142:0/3291714900 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:40.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea43fff700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45ef30 0x55f4eb467d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 -- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 msgr2=0x55f4eb46aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 -- 172.21.15.142:0/3291714900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45ef30 msgr2=0x55f4eb467d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:40.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45ef30 0x55f4eb467d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4b7fe700 1 -- 172.21.15.142:0/3291714900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea4c1a60f0 con 0x55f4eb463360 2023-09-21T13:01:40.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.979+0000 7fea4affd700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:40.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4682e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fea44007970 tx=0x7fea44004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f8ff86aebbd4404 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:40.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea327fc700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:40.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4400e040 con 0x55f4eb463360 2023-09-21T13:01:40.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4eb42d020 con 0x55f4eb463360 2023-09-21T13:01:40.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea440157d0 con 0x55f4eb463360 2023-09-21T13:01:40.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea44015990 con 0x55f4eb463360 2023-09-21T13:01:40.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea64c3eb80 10 client.26986 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:40.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.980+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f4eb1c3c60 con 0x55f4eb463360 2023-09-21T13:01:40.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f4eb42d020 con 0x55f4eb463360 2023-09-21T13:01:40.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fea44023bd0 con 0x55f4eb463360 2023-09-21T13:01:40.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 10 client.26986 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:40.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 10 client.26986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:40.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 20 client.26986 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:40.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4808c0 0x55f4eb482ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 4 client.26986 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:40.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4eb3a8e60 con 0x55f4eb4808c0 2023-09-21T13:01:40.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.981+0000 7fea4affd700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4808c0 0x55f4eb482ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:40.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.982+0000 7fea4affd700 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4808c0 0x55f4eb482ce0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c9304937dd832b1 server_cookie=6aa0d2cf1e61e7f in_seq=0 out_seq=0 2023-09-21T13:01:40.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.982+0000 7fea327fc700 10 client.26986 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:40.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea327fc700 1 -- 172.21.15.142:0/3291714900 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f4eb3a8e60 con 0x55f4eb4808c0 2023-09-21T13:01:40.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea327fc700 10 client.26986 handle_command_reply: tid=0 2023-09-21T13:01:40.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 client.26986 shutdown 2023-09-21T13:01:40.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 msgr2=0x55f4eb4682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:40.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4682e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fea44007970 tx=0x7fea44004b40 comp rx=0 tx=0).stop 2023-09-21T13:01:40.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 shutdown_connections 2023-09-21T13:01:40.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4808c0 0x55f4eb482ce0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb463360 0x55f4eb4682e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45e610 0x55f4eb46aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/3291714900 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45ef30 0x55f4eb467d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:40.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea327fc700 0 client.26986 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:40.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 >> 172.21.15.142:0/3291714900 conn(0x55f4eb38b000 msgr2=0x55f4eb459290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:40.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.983+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 shutdown_connections 2023-09-21T13:01:40.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.984+0000 7fea64c3eb80 1 -- 172.21.15.142:0/3291714900 wait complete. 2023-09-21T13:01:40.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.984+0000 7fea64c3eb80 20 client.26986 trim_cache size 0 max 16384 2023-09-21T13:01:40.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 Processor -- start 2023-09-21T13:01:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 -- start start 2023-09-21T13:01:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 0x55f4eb477a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 0x55f4eb468220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:40.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb230920 con 0x55f4eb463360 2023-09-21T13:01:41.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb45f6a0 con 0x55f4eb45ef30 2023-09-21T13:01:41.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb468eb0 con 0x55f4eb45e610 2023-09-21T13:01:41.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea4affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 0x55f4eb477a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37350/0 (socket says 172.21.15.142:37350) 2023-09-21T13:01:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea43fff700 1 -- 172.21.15.142:0/2313872703 learned_addr learned my addr 172.21.15.142:0/2313872703 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 0x55f4eb468220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.998+0000 7fea43fff700 1 -- 172.21.15.142:0/2313872703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 msgr2=0x55f4eb477a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:41.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea43fff700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 0x55f4eb477a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea43fff700 1 -- 172.21.15.142:0/2313872703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 msgr2=0x55f4eb468220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea43fff700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 0x55f4eb468220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea43fff700 1 -- 172.21.15.142:0/2313872703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4eb201250 con 0x55f4eb45ef30 2023-09-21T13:01:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 0x55f4eb468220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:41.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea4affd700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 0x55f4eb477a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea43fff700 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea34097100 tx=0x7fea340cdd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=418ec92b04387146 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea41ffb700 1 -- 172.21.15.142:0/2313872703 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340969d0 con 0x55f4eb45ef30 2023-09-21T13:01:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea41ffb700 1 -- 172.21.15.142:0/2313872703 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea34083e90 con 0x55f4eb45ef30 2023-09-21T13:01:41.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:40.999+0000 7fea41ffb700 1 -- 172.21.15.142:0/2313872703 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea3409a1d0 con 0x55f4eb45ef30 2023-09-21T13:01:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2313872703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 msgr2=0x55f4eb467ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fea34097100 tx=0x7fea340cdd80 comp rx=0 tx=0).stop 2023-09-21T13:01:41.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2313872703 shutdown_connections 2023-09-21T13:01:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb463360 0x55f4eb468220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45e610 0x55f4eb477a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2313872703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb45ef30 0x55f4eb467ce0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2313872703 >> 172.21.15.142:0/2313872703 conn(0x55f4eb38b000 msgr2=0x55f4eb47cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:41.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2313872703 shutdown_connections 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2313872703 wait complete. 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.000+0000 7fea64c3eb80 1 -- start start 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.001+0000 7fea64c3eb80 1 Processor -- start 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb465a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:41.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb463360 0x55f4eb469b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb465fa0 con 0x55f4eb45e610 2023-09-21T13:01:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb466110 con 0x55f4eb463360 2023-09-21T13:01:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4eb4662d0 con 0x55f4eb45ef30 2023-09-21T13:01:41.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea64c3eb80 10 client.0 _ll_register_callbacks cb 0x55f4eb296a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:41.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43766/0 (socket says 172.21.15.142:43766) 2023-09-21T13:01:41.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 -- 172.21.15.142:0/2667169099 learned_addr learned my addr 172.21.15.142:0/2667169099 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:41.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea4b7fe700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb463360 0x55f4eb469b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea4affd700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb465a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 -- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb463360 msgr2=0x55f4eb469b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:41.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb463360 0x55f4eb469b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 -- 172.21.15.142:0/2667169099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 msgr2=0x55f4eb465a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:41.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb465a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 -- 172.21.15.142:0/2667169099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3c012090 con 0x55f4eb45ef30 2023-09-21T13:01:41.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea43fff700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea3409a390 tx=0x7fea34009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10806d61fd1916e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:41.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.002+0000 7fea327fc700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:41.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea340969d0 con 0x55f4eb45ef30 2023-09-21T13:01:41.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4eb320bb0 con 0x55f4eb45ef30 2023-09-21T13:01:41.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fea3409ad90 con 0x55f4eb45ef30 2023-09-21T13:01:41.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea340d0720 con 0x55f4eb45ef30 2023-09-21T13:01:41.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 10 client.26992 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:41.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f4eb1dade0 con 0x55f4eb45ef30 2023-09-21T13:01:41.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f4eb320bb0 con 0x55f4eb45ef30 2023-09-21T13:01:41.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fea34096da0 con 0x55f4eb45ef30 2023-09-21T13:01:41.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 10 client.26992 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:41.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 10 client.26992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:41.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 20 client.26992 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:41.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4d5190 0x55f4eb4d7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:41.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 4 client.26992 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:01:41.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.003+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f4eb3a8b80 con 0x55f4eb4d5190 2023-09-21T13:01:41.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea4affd700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4d5190 0x55f4eb4d7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea327fc700 10 client.26992 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea4affd700 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4d5190 0x55f4eb4d7580 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a1ccdfc29bcd176 server_cookie=e78f578b493f2ed6 in_seq=0 out_seq=0 2023-09-21T13:01:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea327fc700 1 -- 172.21.15.142:0/2667169099 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f4eb3a8b80 con 0x55f4eb4d5190 2023-09-21T13:01:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea327fc700 10 client.26992 handle_command_reply: tid=0 2023-09-21T13:01:41.017 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea64c3eb80 1 client.26992 shutdown 2023-09-21T13:01:41.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 msgr2=0x55f4eb4695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:41.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.004+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fea3409a390 tx=0x7fea34009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 shutdown_connections 2023-09-21T13:01:41.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f4eb4d5190 0x55f4eb4d7580 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f4eb45e610 0x55f4eb465a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f4eb463360 0x55f4eb469b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 --2- 172.21.15.142:0/2667169099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f4eb45ef30 0x55f4eb4695c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea327fc700 0 client.26992 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:41.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 >> 172.21.15.142:0/2667169099 conn(0x55f4eb38b000 msgr2=0x55f4eb467cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 shutdown_connections 2023-09-21T13:01:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 1 -- 172.21.15.142:0/2667169099 wait complete. 2023-09-21T13:01:41.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.005+0000 7fea64c3eb80 20 client.26992 trim_cache size 0 max 16384 2023-09-21T13:01:41.020 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:01:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 msgr2=0x7fea380a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:41.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 0x7fea380a2cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fea44007500 tx=0x7fea4400b040 comp rx=0 tx=0).stop 2023-09-21T13:01:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 msgr2=0x7fea4c199550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fea34000c00 tx=0x7fea34004790 comp rx=0 tx=0).stop 2023-09-21T13:01:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 shutdown_connections 2023-09-21T13:01:41.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fea380a0830 0x7fea380a2cf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fea4c100fc0 0x7fea4c199010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea4c19d9b0 0x7fea4c19de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 --2- 172.21.15.142:0/2381366503 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fea4c1060e0 0x7fea4c199550 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:41.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 >> 172.21.15.142:0/2381366503 conn(0x7fea4c0fc840 msgr2=0x7fea4c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:41.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 shutdown_connections 2023-09-21T13:01:41.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:41.006+0000 7fea513ff700 1 -- 172.21.15.142:0/2381366503 wait complete. 2023-09-21T13:01:41.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:40 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2641939676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:41.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:40 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2641939676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:01:41.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 503082 9.58 MB/sec execute 142 sec latency 83.360 ms 2023-09-21T13:01:42.025 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T13:01:42.026 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T13:01:42.102 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:41 smithi142 ceph-mon[97663]: pgmap v167: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:41 smithi156 ceph-mon[134078]: pgmap v167: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:42.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:41 smithi160 ceph-mon[134450]: pgmap v167: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 -- 172.21.15.142:0/2044328645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 msgr2=0x7fabb0101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 --2- 172.21.15.142:0/2044328645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb0101220 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7faba0009990 tx=0x7faba0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.256 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 -- 172.21.15.142:0/2044328645 shutdown_connections 2023-09-21T13:01:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 --2- 172.21.15.142:0/2044328645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb0101220 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 --2- 172.21.15.142:0/2044328645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0105f60 0x7fabb010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 --2- 172.21.15.142:0/2044328645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb01017f0 0x7fabb0105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 -- 172.21.15.142:0/2044328645 >> 172.21.15.142:0/2044328645 conn(0x7fabb00fc6a0 msgr2=0x7fabb00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.257 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 -- 172.21.15.142:0/2044328645 shutdown_connections 2023-09-21T13:01:42.258 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.256+0000 7fabb499d700 1 -- 172.21.15.142:0/2044328645 wait complete. 2023-09-21T13:01:42.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.257+0000 7fabb499d700 1 Processor -- start 2023-09-21T13:01:42.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.257+0000 7fabb499d700 1 -- start start 2023-09-21T13:01:42.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.260 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 0x7fabb0196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0197530 con 0x7fabb0100e40 2023-09-21T13:01:42.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0197670 con 0x7fabb0105f60 2023-09-21T13:01:42.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabb499d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb0197830 con 0x7fabb0196ab0 2023-09-21T13:01:42.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.261 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37368/0 (socket says 172.21.15.142:37368) 2023-09-21T13:01:42.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 -- 172.21.15.142:0/2600484021 learned_addr learned my addr 172.21.15.142:0/2600484021 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaffff700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 0x7fabb0196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.262 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 -- 172.21.15.142:0/2600484021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 msgr2=0x7fabb0196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 0x7fabb0196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 -- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 msgr2=0x7fabb019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.263 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaeffd700 1 -- 172.21.15.142:0/2600484021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00095f0 con 0x7fabb0105f60 2023-09-21T13:01:42.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.258+0000 7fabaffff700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 0x7fabb0196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabaeffd700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faba400e970 tx=0x7faba400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabacff9700 1 -- 172.21.15.142:0/2600484021 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4009790 con 0x7fabb0105f60 2023-09-21T13:01:42.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabacff9700 1 -- 172.21.15.142:0/2600484021 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faba400c7e0 con 0x7fabb0105f60 2023-09-21T13:01:42.264 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabacff9700 1 -- 172.21.15.142:0/2600484021 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba40054e0 con 0x7fabb0105f60 2023-09-21T13:01:42.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb01a38b0 con 0x7fabb0105f60 2023-09-21T13:01:42.265 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.259+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb01a3d70 con 0x7fabb0105f60 2023-09-21T13:01:42.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.264+0000 7fabacff9700 1 -- 172.21.15.142:0/2600484021 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7faba400c950 con 0x7fabb0105f60 2023-09-21T13:01:42.267 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 Processor -- start 2023-09-21T13:01:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 -- start start 2023-09-21T13:01:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b938130 0x55d49b931b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b932480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.268 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b8a1d20 con 0x55d49b938130 2023-09-21T13:01:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b885cf0 con 0x55d49b932040 2023-09-21T13:01:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.265+0000 7fabc95eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b883610 con 0x55d49b937810 2023-09-21T13:01:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43788/0 (socket says 172.21.15.142:43788) 2023-09-21T13:01:42.269 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 -- 172.21.15.142:0/290708543 learned_addr learned my addr 172.21.15.142:0/290708543 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaeffd700 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b932480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b938130 0x55d49b931b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabacff9700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 0x7fab980a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.270 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 -- 172.21.15.142:0/290708543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 msgr2=0x55d49b932480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b932480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 -- 172.21.15.142:0/290708543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b938130 msgr2=0x55d49b931b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabacff9700 1 -- 172.21.15.142:0/2600484021 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faba4014070 con 0x7fabb0105f60 2023-09-21T13:01:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b938130 0x55d49b931b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.271 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 -- 172.21.15.142:0/290708543 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d49b6a9e60 con 0x55d49b937810 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.266+0000 7fabaffff700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 0x7fab980a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.267+0000 7fabaffff700 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faba8009520 tx=0x7faba8004320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a71e08aead47325 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.267+0000 7fab95ffb700 1 -- 172.21.15.142:0/290708543 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba800e6f0 con 0x55d49b937810 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.267+0000 7fab95ffb700 1 -- 172.21.15.142:0/290708543 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faba8027070 con 0x55d49b937810 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.267+0000 7fab95ffb700 1 -- 172.21.15.142:0/290708543 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba80187a0 con 0x55d49b937810 2023-09-21T13:01:42.272 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.267+0000 7fabaffff700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 0x7fab980a2d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faba8022000 tx=0x7faba801f000 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- 172.21.15.142:0/290708543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 msgr2=0x55d49b937bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7faba8009520 tx=0x7faba8004320 comp rx=0 tx=0).stop 2023-09-21T13:01:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- 172.21.15.142:0/290708543 shutdown_connections 2023-09-21T13:01:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b932480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.273 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b937810 0x55d49b937bf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 --2- 172.21.15.142:0/290708543 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b938130 0x55d49b931b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- 172.21.15.142:0/290708543 >> 172.21.15.142:0/290708543 conn(0x55d49b85a080 msgr2=0x55d49b9286d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- 172.21.15.142:0/290708543 shutdown_connections 2023-09-21T13:01:42.274 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- 172.21.15.142:0/290708543 wait complete. 2023-09-21T13:01:42.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.268+0000 7fabc95eab80 1 -- start start 2023-09-21T13:01:42.277 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 Processor -- start 2023-09-21T13:01:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b93e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b93ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b87ef00 con 0x55d49b932040 2023-09-21T13:01:42.278 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b81b7c0 con 0x55d49b937810 2023-09-21T13:01:42.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b81b460 con 0x55d49b938130 2023-09-21T13:01:42.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.269+0000 7fabc95eab80 10 client.0 _ll_register_callbacks cb 0x55d49b765b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:42.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.279 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37376/0 (socket says 172.21.15.142:37376) 2023-09-21T13:01:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 -- 172.21.15.142:0/1545950202 learned_addr learned my addr 172.21.15.142:0/1545950202 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaffff700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b93ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b93e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.280 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 -- 172.21.15.142:0/1545950202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 msgr2=0x55d49b93ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b93ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 -- 172.21.15.142:0/1545950202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 msgr2=0x55d49b93e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b93e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 -- 172.21.15.142:0/1545950202 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba8003be0 con 0x55d49b937810 2023-09-21T13:01:42.281 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b93e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabaeffd700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faba4096180 tx=0x7faba4095410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30210df1d3b1929f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fab8effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4095700 con 0x55d49b937810 2023-09-21T13:01:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d49b7efc30 con 0x55d49b937810 2023-09-21T13:01:42.282 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faba400cc50 con 0x55d49b937810 2023-09-21T13:01:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faba4099e10 con 0x55d49b937810 2023-09-21T13:01:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.270+0000 7fabc95eab80 10 client.27041 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d49b692ce0 con 0x55d49b937810 2023-09-21T13:01:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d49b7efc30 con 0x55d49b937810 2023-09-21T13:01:42.283 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faba4016330 con 0x55d49b937810 2023-09-21T13:01:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 10 client.27041 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 10 client.27041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 20 client.27041 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b94ba90 0x55d49b94deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.284 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 4 client.27041 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d49b8fc0a0 con 0x55d49b94ba90 2023-09-21T13:01:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.271+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b94ba90 0x55d49b94deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.272+0000 7fab8effd700 10 client.27041 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.272+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b94ba90 0x55d49b94deb0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a889c8c139a47ee server_cookie=4e9998c7d195d909 in_seq=0 out_seq=0 2023-09-21T13:01:42.285 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fab8effd700 1 -- 172.21.15.142:0/1545950202 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d49b8fc0a0 con 0x55d49b94ba90 2023-09-21T13:01:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fab8effd700 10 client.27041 handle_command_reply: tid=0 2023-09-21T13:01:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 client.27041 shutdown 2023-09-21T13:01:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 msgr2=0x55d49b93b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7faba4096180 tx=0x7faba4095410 comp rx=0 tx=0).stop 2023-09-21T13:01:42.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 shutdown_connections 2023-09-21T13:01:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b94ba90 0x55d49b94deb0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b93e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b93ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1545950202 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b93b360 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fab8effd700 0 client.27041 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 >> 172.21.15.142:0/1545950202 conn(0x55d49b85a080 msgr2=0x55d49b9283e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 shutdown_connections 2023-09-21T13:01:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 1 -- 172.21.15.142:0/1545950202 wait complete. 2023-09-21T13:01:42.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.273+0000 7fabc95eab80 20 client.27041 trim_cache size 0 max 16384 2023-09-21T13:01:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.292+0000 7fabc95eab80 1 Processor -- start 2023-09-21T13:01:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.292+0000 7fabc95eab80 1 -- start start 2023-09-21T13:01:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.292+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.292+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b937810 0x55d49b93dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.292+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabc95eab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b6ff9a0 con 0x55d49b937810 2023-09-21T13:01:42.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabc95eab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b92a1d0 con 0x55d49b932040 2023-09-21T13:01:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabc95eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b932aa0 con 0x55d49b938130 2023-09-21T13:01:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaf7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43808/0 (socket says 172.21.15.142:43808) 2023-09-21T13:01:42.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 -- 172.21.15.142:0/2079786500 learned_addr learned my addr 172.21.15.142:0/2079786500 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37384/0 (socket says 172.21.15.142:37384) 2023-09-21T13:01:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaeffd700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b937810 0x55d49b93dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.297 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 -- 172.21.15.142:0/2079786500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 msgr2=0x55d49b93ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 -- 172.21.15.142:0/2079786500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b937810 msgr2=0x55d49b93dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b937810 0x55d49b93dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaffff700 1 -- 172.21.15.142:0/2079786500 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d49b924880 con 0x55d49b938130 2023-09-21T13:01:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.293+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.294+0000 7fabaffff700 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faba8009c10 tx=0x7faba8000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2bee02c97e6362 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.294+0000 7fab967fc700 1 -- 172.21.15.142:0/2079786500 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8006000 con 0x55d49b938130 2023-09-21T13:01:42.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.294+0000 7fab967fc700 1 -- 172.21.15.142:0/2079786500 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faba800f040 con 0x55d49b938130 2023-09-21T13:01:42.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.294+0000 7fab967fc700 1 -- 172.21.15.142:0/2079786500 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8004d10 con 0x55d49b938130 2023-09-21T13:01:42.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- 172.21.15.142:0/2079786500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 msgr2=0x55d49b928380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7faba8009c10 tx=0x7faba8000f40 comp rx=0 tx=0).stop 2023-09-21T13:01:42.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- 172.21.15.142:0/2079786500 shutdown_connections 2023-09-21T13:01:42.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b928380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b932040 0x55d49b93ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 --2- 172.21.15.142:0/2079786500 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b937810 0x55d49b93dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- 172.21.15.142:0/2079786500 >> 172.21.15.142:0/2079786500 conn(0x55d49b85a080 msgr2=0x55d49b935520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- 172.21.15.142:0/2079786500 shutdown_connections 2023-09-21T13:01:42.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- 172.21.15.142:0/2079786500 wait complete. 2023-09-21T13:01:42.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 -- start start 2023-09-21T13:01:42.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.295+0000 7fabc95eab80 1 Processor -- start 2023-09-21T13:01:42.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b942b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b940b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b9416d0 con 0x55d49b932040 2023-09-21T13:01:42.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b941840 con 0x55d49b937810 2023-09-21T13:01:42.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d49b941a00 con 0x55d49b938130 2023-09-21T13:01:42.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabc95eab80 10 client.0 _ll_register_callbacks cb 0x55d49b765b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:42.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b940b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43820/0 (socket says 172.21.15.142:43820) 2023-09-21T13:01:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 -- 172.21.15.142:0/1923605351 learned_addr learned my addr 172.21.15.142:0/1923605351 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b942b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 -- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 msgr2=0x55d49b940b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b940b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 -- 172.21.15.142:0/1923605351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 msgr2=0x55d49b942b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b942b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.296+0000 7fabaffff700 1 -- 172.21.15.142:0/1923605351 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb010e350 con 0x55d49b938130 2023-09-21T13:01:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fabaffff700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faba80060b0 tx=0x7faba80060e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1d42c5efa14ec2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fab8effd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:42.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba8004920 con 0x55d49b938130 2023-09-21T13:01:42.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7faba8004a80 con 0x55d49b938130 2023-09-21T13:01:42.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faba8027070 con 0x55d49b938130 2023-09-21T13:01:42.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7faba800e4f0 con 0x55d49b938130 2023-09-21T13:01:42.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fabc95eab80 10 client.27010 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:42.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.297+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55d49b6a9e60 con 0x55d49b938130 2023-09-21T13:01:42.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faba8027070 con 0x55d49b938130 2023-09-21T13:01:42.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faba802d7e0 con 0x55d49b938130 2023-09-21T13:01:42.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 10 client.27010 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 10 client.27010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 20 client.27010 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:42.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b9a1a90 0x55d49b9a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 4 client.27010 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T13:01:42.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d49b877ee0 con 0x55d49b9a1a90 2023-09-21T13:01:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.298+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b9a1a90 0x55d49b9a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.299+0000 7fab8effd700 10 client.27010 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.299+0000 7fabaf7fe700 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b9a1a90 0x55d49b9a3e80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d881b8a2f713c13 server_cookie=c6a4378773e5bfea in_seq=0 out_seq=0 2023-09-21T13:01:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fab8effd700 1 -- 172.21.15.142:0/1923605351 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d49b877ee0 con 0x55d49b9a1a90 2023-09-21T13:01:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fab8effd700 10 client.27010 handle_command_reply: tid=0 2023-09-21T13:01:42.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 client.27010 shutdown 2023-09-21T13:01:42.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 msgr2=0x55d49b9410b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7faba80060b0 tx=0x7faba80060e0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 shutdown_connections 2023-09-21T13:01:42.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d49b9a1a90 0x55d49b9a3e80 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d49b932040 0x55d49b942b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d49b938130 0x55d49b9410b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 --2- 172.21.15.142:0/1923605351 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d49b937810 0x55d49b940b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 >> 172.21.15.142:0/1923605351 conn(0x55d49b85a080 msgr2=0x55d49b928380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fab8effd700 0 client.27010 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 shutdown_connections 2023-09-21T13:01:42.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 1 -- 172.21.15.142:0/1923605351 wait complete. 2023-09-21T13:01:42.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.300+0000 7fabc95eab80 20 client.27010 trim_cache size 0 max 16384 2023-09-21T13:01:42.324 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:42.324 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T13:01:42.324 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "5527a32d-d319-41a0-8227-44020ae86a1a", 2023-09-21T13:01:42.325 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T13:01:42.325 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:42.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 msgr2=0x7fab980a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 0x7fab980a2d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7faba8022000 tx=0x7faba801f000 comp rx=0 tx=0).stop 2023-09-21T13:01:42.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 msgr2=0x7fabb019cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7faba400e970 tx=0x7faba400ec80 comp rx=0 tx=0).stop 2023-09-21T13:01:42.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 shutdown_connections 2023-09-21T13:01:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fab980a0850 0x7fab980a2d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fabb0100e40 0x7fabb019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabb0196ab0 0x7fabb0196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 --2- 172.21.15.142:0/2600484021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fabb0105f60 0x7fabb019cf80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 >> 172.21.15.142:0/2600484021 conn(0x7fabb00fc6a0 msgr2=0x7fabb00fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 shutdown_connections 2023-09-21T13:01:42.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.301+0000 7fabb499d700 1 -- 172.21.15.142:0/2600484021 wait complete. 2023-09-21T13:01:42.333 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:01:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 -- 172.21.15.142:0/2170522256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 msgr2=0x7f9d881013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/2170522256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d881013a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9d84009990 tx=0x7f9d84009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 -- 172.21.15.142:0/2170522256 shutdown_connections 2023-09-21T13:01:42.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/2170522256 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d881013a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/2170522256 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d8810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/2170522256 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88101970 0x7f9d881059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 -- 172.21.15.142:0/2170522256 >> 172.21.15.142:0/2170522256 conn(0x7f9d880fc840 msgr2=0x7f9d880fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 -- 172.21.15.142:0/2170522256 shutdown_connections 2023-09-21T13:01:42.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.546+0000 7f9d8fdff700 1 -- 172.21.15.142:0/2170522256 wait complete. 2023-09-21T13:01:42.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.547+0000 7f9d8fdff700 1 Processor -- start 2023-09-21T13:01:42.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.547+0000 7f9d8fdff700 1 -- start start 2023-09-21T13:01:42.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d88073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 0x7f9d881a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881a5720 con 0x7f9d88100fc0 2023-09-21T13:01:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881a5890 con 0x7f9d88073b60 2023-09-21T13:01:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8fdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881a5a50 con 0x7f9d881060e0 2023-09-21T13:01:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59566/0 (socket says 172.21.15.142:59566) 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8db9b700 1 -- 172.21.15.142:0/1314276776 learned_addr learned my addr 172.21.15.142:0/1314276776 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d88073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.548+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 0x7f9d881a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 -- 172.21.15.142:0/1314276776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 msgr2=0x7f9d88073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d88073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 -- 172.21.15.142:0/1314276776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 msgr2=0x7f9d881a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 0x7f9d881a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 -- 172.21.15.142:0/1314276776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d840095f0 con 0x7f9d88100fc0 2023-09-21T13:01:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d88073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 0x7f9d881a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400c010 tx=0x7f9d84005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d7effd700 1 -- 172.21.15.142:0/1314276776 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8401d070 con 0x7f9d88100fc0 2023-09-21T13:01:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d881a5cd0 con 0x7f9d88100fc0 2023-09-21T13:01:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d7effd700 1 -- 172.21.15.142:0/1314276776 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d84022470 con 0x7f9d88100fc0 2023-09-21T13:01:42.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d7effd700 1 -- 172.21.15.142:0/1314276776 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84017650 con 0x7f9d88100fc0 2023-09-21T13:01:42.555 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.549+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d881a6150 con 0x7f9d88100fc0 2023-09-21T13:01:42.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.553+0000 7f9d7effd700 1 -- 172.21.15.142:0/1314276776 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f9d840225e0 con 0x7f9d88100fc0 2023-09-21T13:01:42.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.554+0000 7f9da36f6b80 1 Processor -- start 2023-09-21T13:01:42.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.554+0000 7f9d7effd700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 0x7f9d740a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.554+0000 7f9da36f6b80 1 -- start start 2023-09-21T13:01:42.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.554+0000 7f9d7effd700 1 -- 172.21.15.142:0/1314276776 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d840cd430 con 0x7f9d88100fc0 2023-09-21T13:01:42.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 0x7f9d740a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8a407c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b89afca0 con 0x55e7b8a3b610 2023-09-21T13:01:42.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8993c70 con 0x55e7b8a3bf30 2023-09-21T13:01:42.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8991590 con 0x55e7b8a40360 2023-09-21T13:01:42.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37434/0 (socket says 172.21.15.142:37434) 2023-09-21T13:01:42.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 -- 172.21.15.142:0/3780811335 learned_addr learned my addr 172.21.15.142:0/3780811335 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8a407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 -- 172.21.15.142:0/3780811335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 msgr2=0x55e7b8a407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8a407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 -- 172.21.15.142:0/3780811335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 msgr2=0x55e7b8a3b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8d39a700 1 -- 172.21.15.142:0/3780811335 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b87b7de0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8a407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:01:42.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.555+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.556+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 0x7f9d740a2cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d80007610 tx=0x7f9d80009100 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.556+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d78011540 tx=0x7f9d78011850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44f36f8f8075fb4e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.556+0000 7f9d73fff700 1 -- 172.21.15.142:0/3780811335 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78004a30 con 0x55e7b8a3bf30 2023-09-21T13:01:42.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.556+0000 7f9d73fff700 1 -- 172.21.15.142:0/3780811335 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d780054e0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.556+0000 7f9d73fff700 1 -- 172.21.15.142:0/3780811335 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800e810 con 0x55e7b8a3bf30 2023-09-21T13:01:42.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3780811335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 msgr2=0x55e7b8a3fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9d78011540 tx=0x7f9d78011850 comp rx=0 tx=0).stop 2023-09-21T13:01:42.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3780811335 shutdown_connections 2023-09-21T13:01:42.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8a407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3780811335 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a3fe20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3780811335 >> 172.21.15.142:0/3780811335 conn(0x55e7b8968000 msgr2=0x55e7b8a366a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3780811335 shutdown_connections 2023-09-21T13:01:42.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3780811335 wait complete. 2023-09-21T13:01:42.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.557+0000 7f9da36f6b80 1 -- start start 2023-09-21T13:01:42.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 Processor -- start 2023-09-21T13:01:42.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a47b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a455c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b898ce80 con 0x55e7b8a3b610 2023-09-21T13:01:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8929740 con 0x55e7b8a40360 2023-09-21T13:01:42.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b89293e0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9da36f6b80 10 client.0 _ll_register_callbacks cb 0x55e7b8873a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:42.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a47b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43856/0 (socket says 172.21.15.142:43856) 2023-09-21T13:01:42.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9d8d39a700 1 -- 172.21.15.142:0/2274251725 learned_addr learned my addr 172.21.15.142:0/2274251725 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.558+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 -- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 msgr2=0x55e7b8a455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a455c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 -- 172.21.15.142:0/2274251725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 msgr2=0x55e7b8a47b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a47b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 -- 172.21.15.142:0/2274251725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d881a6150 con 0x55e7b8a3bf30 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d7801b040 tx=0x7f9d78005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=556b3fb8129cf167 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78004960 con 0x55e7b8a3bf30 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7b88fdbb0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d78004ac0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.559+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d78004c80 con 0x55e7b8a3bf30 2023-09-21T13:01:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 10 client.27019 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f9d78009d10 con 0x55e7b8a3bf30 2023-09-21T13:01:42.578 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e7b88fdbb0 con 0x55e7b8a3bf30 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9d7800e610 con 0x55e7b8a3bf30 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 10 client.27019 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 10 client.27019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 20 client.27019 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8a55350 0x55e7b8a57770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 4 client.27019 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:42.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7b8a0a020 con 0x55e7b8a55350 2023-09-21T13:01:42.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.560+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8a55350 0x55e7b8a57770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.561+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8a55350 0x55e7b8a57770 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f260057e3294db2c server_cookie=320d30c6b7c66384 in_seq=0 out_seq=0 2023-09-21T13:01:42.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.561+0000 7f9d717fa700 10 client.27019 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9d717fa700 1 -- 172.21.15.142:0/2274251725 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7b8a0a020 con 0x55e7b8a55350 2023-09-21T13:01:42.588 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9d717fa700 10 client.27019 handle_command_reply: tid=0 2023-09-21T13:01:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 client.27019 shutdown 2023-09-21T13:01:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 msgr2=0x55e7b8a44e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d7801b040 tx=0x7f9d78005dc0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 shutdown_connections 2023-09-21T13:01:42.589 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8a55350 0x55e7b8a57770 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3b610 0x55e7b8a47b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.590 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9d717fa700 0 client.27019 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/2274251725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a44e80 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.591 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 >> 172.21.15.142:0/2274251725 conn(0x55e7b8968000 msgr2=0x55e7b8a36290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 shutdown_connections 2023-09-21T13:01:42.592 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.562+0000 7f9da36f6b80 1 -- 172.21.15.142:0/2274251725 wait complete. 2023-09-21T13:01:42.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.563+0000 7f9da36f6b80 20 client.27019 trim_cache size 0 max 16384 2023-09-21T13:01:42.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.580+0000 7f9da36f6b80 1 Processor -- start 2023-09-21T13:01:42.593 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 -- start start 2023-09-21T13:01:42.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.594 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a50c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b880d920 con 0x55e7b8a3bf30 2023-09-21T13:01:42.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8a4ca30 con 0x55e7b8a40360 2023-09-21T13:01:42.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8a37c60 con 0x55e7b8a3b610 2023-09-21T13:01:42.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43868/0 (socket says 172.21.15.142:43868) 2023-09-21T13:01:42.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59606/0 (socket says 172.21.15.142:59606) 2023-09-21T13:01:42.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8db9b700 1 -- 172.21.15.142:0/235313875 learned_addr learned my addr 172.21.15.142:0/235313875 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.581+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a50c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 -- 172.21.15.142:0/235313875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 msgr2=0x55e7b8a50c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a50c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 -- 172.21.15.142:0/235313875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 msgr2=0x55e7b8a4c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 -- 172.21.15.142:0/235313875 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b8a5c360 con 0x55e7b8a3b610 2023-09-21T13:01:42.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:42.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d84005f50 tx=0x7f9d8401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ba2ce634cacf143 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d7cbff700 1 -- 172.21.15.142:0/235313875 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840b6070 con 0x55e7b8a3b610 2023-09-21T13:01:42.599 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d7cbff700 1 -- 172.21.15.142:0/235313875 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d8409aa00 con 0x55e7b8a3b610 2023-09-21T13:01:42.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.582+0000 7f9d7cbff700 1 -- 172.21.15.142:0/235313875 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840cadd0 con 0x55e7b8a3b610 2023-09-21T13:01:42.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- 172.21.15.142:0/235313875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 msgr2=0x55e7b8a3dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f9d84005f50 tx=0x7f9d8401a040 comp rx=0 tx=0).stop 2023-09-21T13:01:42.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- 172.21.15.142:0/235313875 shutdown_connections 2023-09-21T13:01:42.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a40360 0x55e7b8a50c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a3b610 0x55e7b8a3dc50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/235313875 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- 172.21.15.142:0/235313875 >> 172.21.15.142:0/235313875 conn(0x55e7b8968000 msgr2=0x55e7b8a35880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- 172.21.15.142:0/235313875 shutdown_connections 2023-09-21T13:01:42.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- 172.21.15.142:0/235313875 wait complete. 2023-09-21T13:01:42.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 -- start start 2023-09-21T13:01:42.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.583+0000 7f9da36f6b80 1 Processor -- start 2023-09-21T13:01:42.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8aa8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8a4b390 con 0x55e7b8a3bf30 2023-09-21T13:01:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8aa86b0 con 0x55e7b8a3b610 2023-09-21T13:01:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b8aa8870 con 0x55e7b8a40360 2023-09-21T13:01:42.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9da36f6b80 10 client.0 _ll_register_callbacks cb 0x55e7b8873a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:42.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8db9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37456/0 (socket says 172.21.15.142:37456) 2023-09-21T13:01:42.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8db9b700 1 -- 172.21.15.142:0/3871279177 learned_addr learned my addr 172.21.15.142:0/3871279177 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:42.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8d39a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8e39c700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8aa8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.584+0000 7f9d8db9b700 1 -- 172.21.15.142:0/3871279177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 msgr2=0x55e7b8aa8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8aa8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d8db9b700 1 -- 172.21.15.142:0/3871279177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 msgr2=0x55e7b8a4ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:42.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d8db9b700 1 -- 172.21.15.142:0/3871279177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d78009d10 con 0x55e7b8a3b610 2023-09-21T13:01:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d8db9b700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d840a24b0 tx=0x7f9d840cab30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7577e2364d6e9f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d717fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:42.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d840b6070 con 0x55e7b8a3b610 2023-09-21T13:01:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9d840a29e0 con 0x55e7b8a3b610 2023-09-21T13:01:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9d780054e0 con 0x55e7b8a3b610 2023-09-21T13:01:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d840228c0 con 0x55e7b8a3b610 2023-09-21T13:01:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9da36f6b80 10 client.27065 fetch_fsmap learned FSMap version 30 2023-09-21T13:01:42.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f9d881a5cd0 con 0x55e7b8a3b610 2023-09-21T13:01:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.585+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d780054e0 con 0x55e7b8a3b610 2023-09-21T13:01:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 30) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9d84099ef0 con 0x55e7b8a3b610 2023-09-21T13:01:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 10 client.27065 fetch_fsmap finished waiting for FSMap version 30 2023-09-21T13:01:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 10 client.27065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:42.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 20 client.27065 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:42.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8aa9dd0 0x55e7b8aac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:42.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 4 client.27065 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:01:42.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e7b8985e60 con 0x55e7b8aa9dd0 2023-09-21T13:01:42.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8aa9dd0 0x55e7b8aac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:42.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9d717fa700 10 client.27065 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.586+0000 7f9d8d39a700 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8aa9dd0 0x55e7b8aac1f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89b754801f3e45ce server_cookie=9e629a1ebd60d7f8 in_seq=0 out_seq=0 2023-09-21T13:01:42.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9d717fa700 1 -- 172.21.15.142:0/3871279177 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e7b8985e60 con 0x55e7b8aa9dd0 2023-09-21T13:01:42.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9d717fa700 10 client.27065 handle_command_reply: tid=0 2023-09-21T13:01:42.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 client.27065 shutdown 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 msgr2=0x55e7b8a4a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9d840a24b0 tx=0x7f9d840cab30 comp rx=0 tx=0).stop 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 shutdown_connections 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e7b8aa9dd0 0x55e7b8aac1f0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e7b8a40360 0x55e7b8aa8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e7b8a3b610 0x55e7b8a4a6c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 --2- 172.21.15.142:0/3871279177 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e7b8a3bf30 0x55e7b8a4ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9d717fa700 0 client.27065 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:42.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 >> 172.21.15.142:0/3871279177 conn(0x55e7b8968000 msgr2=0x55e7b8a50c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 shutdown_connections 2023-09-21T13:01:42.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 1 -- 172.21.15.142:0/3871279177 wait complete. 2023-09-21T13:01:42.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.588+0000 7f9da36f6b80 20 client.27065 trim_cache size 0 max 16384 2023-09-21T13:01:42.613 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:01:42.613 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-21T13:01:42.614 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:01:42.614 INFO:teuthology.orchestra.run.smithi142.stdout: "5527a32d-d319-41a0-8227-44020ae86a1a": { 2023-09-21T13:01:42.614 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:01:42.614 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "5527a32d-d319-41a0-8227-44020ae86a1a", 2023-09-21T13:01:42.615 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:01:42.615 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:01:42.615 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:01:42.615 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:01:42.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 msgr2=0x7f9d740a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 0x7f9d740a2cf0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9d80007610 tx=0x7f9d80009100 comp rx=0 tx=0).stop 2023-09-21T13:01:42.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 msgr2=0x7f9d880730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:42.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400c010 tx=0x7f9d84005740 comp rx=0 tx=0).stop 2023-09-21T13:01:42.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 shutdown_connections 2023-09-21T13:01:42.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9d740a0830 0x7f9d740a2cf0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9d88100fc0 0x7f9d880730e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9d88073b60 0x7f9d881a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 --2- 172.21.15.142:0/1314276776 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d881060e0 0x7f9d88073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:42.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 >> 172.21.15.142:0/1314276776 conn(0x7f9d880fc840 msgr2=0x7f9d880fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:42.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 shutdown_connections 2023-09-21T13:01:42.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:01:42.589+0000 7f9d8fdff700 1 -- 172.21.15.142:0/1314276776 wait complete. 2023-09-21T13:01:42.620 INFO:tasks.cephfs.filesystem:scrub status for tag:5527a32d-d319-41a0-8227-44020ae86a1a - {'path': '/', 'tag': '5527a32d-d319-41a0-8227-44020ae86a1a', 'options': 'recursive,force'} 2023-09-21T13:01:42.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 504997 9.61 MB/sec execute 143 sec latency 17.061 ms 2023-09-21T13:01:43.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:42 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T13:01:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:42 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:42 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:43.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:42 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:42 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T13:01:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:42 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:42 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:43.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:42 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:42 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T13:01:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:42 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:42 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:43.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:42 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:43.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 507418 9.63 MB/sec execute 144 sec latency 10.390 ms 2023-09-21T13:01:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:43 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:44.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:43 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:01:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:43 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:43 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:43 smithi156 ceph-mon[134078]: pgmap v168: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:43 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:43 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:01:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:43 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:43 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:43 smithi142 ceph-mon[97663]: pgmap v168: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:43 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:43 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:01:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:43 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:43 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:01:44.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:43 smithi160 ceph-mon[134450]: pgmap v168: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:44.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 509082 9.62 MB/sec execute 145 sec latency 11.350 ms 2023-09-21T13:01:45.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 511686 9.66 MB/sec execute 146 sec latency 10.736 ms 2023-09-21T13:01:46.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:45 smithi156 ceph-mon[134078]: pgmap v169: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:46.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:45 smithi142 ceph-mon[97663]: pgmap v169: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:46.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:45 smithi160 ceph-mon[134450]: pgmap v169: 97 pgs: 97 active+clean; 120 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.3 MiB/s wr, 329 op/s 2023-09-21T13:01:46.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 513229 9.64 MB/sec execute 147 sec latency 22.607 ms 2023-09-21T13:01:47.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 514956 9.64 MB/sec execute 148 sec latency 437.235 ms 2023-09-21T13:01:48.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:47 smithi156 ceph-mon[134078]: pgmap v170: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 318 op/s 2023-09-21T13:01:48.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:47 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:48.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:47 smithi142 ceph-mon[97663]: pgmap v170: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 318 op/s 2023-09-21T13:01:48.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:47 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:47 smithi160 ceph-mon[134450]: pgmap v170: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 318 op/s 2023-09-21T13:01:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:47 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:48.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 514956 9.57 MB/sec execute 149 sec latency 1437.297 ms 2023-09-21T13:01:49.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 515716 9.54 MB/sec execute 150 sec latency 1835.705 ms 2023-09-21T13:01:49.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.847+0000 7f17265ff700 1 -- 172.21.15.142:0/388892054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073b30 msgr2=0x7f172010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.847+0000 7f17265ff700 1 --2- 172.21.15.142:0/388892054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073b30 0x7f172010d060 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1714009990 tx=0x7f1714009ca0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 -- 172.21.15.142:0/388892054 shutdown_connections 2023-09-21T13:01:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 --2- 172.21.15.142:0/388892054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073210 0x7f17200735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 --2- 172.21.15.142:0/388892054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 0x7f172010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 --2- 172.21.15.142:0/388892054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073b30 0x7f172010d060 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 -- 172.21.15.142:0/388892054 >> 172.21.15.142:0/388892054 conn(0x7f17200fc830 msgr2=0x7f17200fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 -- 172.21.15.142:0/388892054 shutdown_connections 2023-09-21T13:01:49.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.848+0000 7f17265ff700 1 -- 172.21.15.142:0/388892054 wait complete. 2023-09-21T13:01:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.849+0000 7f17265ff700 1 Processor -- start 2023-09-21T13:01:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.849+0000 7f17265ff700 1 -- start start 2023-09-21T13:01:49.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.849+0000 7f17265ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f17265ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 0x7f17201995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f17265ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 0x7f172019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f17265ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172019e280 con 0x7f1720073b30 2023-09-21T13:01:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f17265ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172019e3f0 con 0x7f1720073210 2023-09-21T13:01:49.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f17265ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172019e5b0 con 0x7f172010d5a0 2023-09-21T13:01:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51432/0 (socket says 172.21.15.142:51432) 2023-09-21T13:01:49.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 -- 172.21.15.142:0/13213348 learned_addr learned my addr 172.21.15.142:0/13213348 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f1724b9c700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 0x7f172019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171f7fe700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 0x7f17201995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 -- 172.21.15.142:0/13213348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 msgr2=0x7f172019dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 0x7f172019dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 -- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 msgr2=0x7f17201995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 0x7f17201995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 -- 172.21.15.142:0/13213348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140095f0 con 0x7f1720073210 2023-09-21T13:01:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171f7fe700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 0x7f17201995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:49.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.850+0000 7f171ffff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f171000e9a0 tx=0x7f171000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.851+0000 7f171d7fa700 1 -- 172.21.15.142:0/13213348 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710009790 con 0x7f1720073210 2023-09-21T13:01:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.851+0000 7f171d7fa700 1 -- 172.21.15.142:0/13213348 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f171000cbd0 con 0x7f1720073210 2023-09-21T13:01:49.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.851+0000 7f171d7fa700 1 -- 172.21.15.142:0/13213348 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710018680 con 0x7f1720073210 2023-09-21T13:01:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.851+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172019e890 con 0x7f1720073210 2023-09-21T13:01:49.858 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.851+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17201a60d0 con 0x7f1720073210 2023-09-21T13:01:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.854+0000 7f171d7fa700 1 -- 172.21.15.142:0/13213348 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f171000cd40 con 0x7f1720073210 2023-09-21T13:01:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.855+0000 7f1739e66b80 1 Processor -- start 2023-09-21T13:01:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.855+0000 7f1739e66b80 1 -- start start 2023-09-21T13:01:49.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093b5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093b62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f09325c40 con 0x564f093b10a0 2023-09-21T13:01:49.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f09309c10 con 0x564f093b19c0 2023-09-21T13:01:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1739e66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f09307530 con 0x564f093b5e50 2023-09-21T13:01:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171d7fa700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 0x7f17080a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093b62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51438/0 (socket says 172.21.15.142:51438) 2023-09-21T13:01:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171ffff700 1 -- 172.21.15.142:0/1535799284 learned_addr learned my addr 172.21.15.142:0/1535799284 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1724b9c700 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171d7fa700 1 -- 172.21.15.142:0/13213348 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1710014070 con 0x7f1720073210 2023-09-21T13:01:49.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f1724b9c700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 0x7f17080a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 -- 172.21.15.142:0/1535799284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 msgr2=0x564f093b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093b5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 -- 172.21.15.142:0/1535799284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 msgr2=0x564f093b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.856+0000 7f171f7fe700 1 -- 172.21.15.142:0/1535799284 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f0912dd80 con 0x564f093b5e50 2023-09-21T13:01:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.857+0000 7f171f7fe700 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093b62b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7612afaf314f5897 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.857+0000 7f1724b9c700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 0x7f17080a2c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1718009ec0 tx=0x7f171800b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.857+0000 7f17067fc700 1 -- 172.21.15.142:0/1535799284 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171400beb0 con 0x564f093b5e50 2023-09-21T13:01:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.857+0000 7f17067fc700 1 -- 172.21.15.142:0/1535799284 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f171401e040 con 0x564f093b5e50 2023-09-21T13:01:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.857+0000 7f17067fc700 1 -- 172.21.15.142:0/1535799284 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714004ae0 con 0x564f093b5e50 2023-09-21T13:01:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 -- 172.21.15.142:0/1535799284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 msgr2=0x564f093b62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093b62b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005c00 comp rx=0 tx=0).stop 2023-09-21T13:01:49.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 -- 172.21.15.142:0/1535799284 shutdown_connections 2023-09-21T13:01:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093b62b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 --2- 172.21.15.142:0/1535799284 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 -- 172.21.15.142:0/1535799284 >> 172.21.15.142:0/1535799284 conn(0x564f092ddfa0 msgr2=0x564f093ac0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 -- 172.21.15.142:0/1535799284 shutdown_connections 2023-09-21T13:01:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.858+0000 7f1739e66b80 1 -- 172.21.15.142:0/1535799284 wait complete. 2023-09-21T13:01:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 -- start start 2023-09-21T13:01:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 Processor -- start 2023-09-21T13:01:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 0x564f093ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b5e50 0x564f093baff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f09302e20 con 0x564f093b19c0 2023-09-21T13:01:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0929f6e0 con 0x564f093b5e50 2023-09-21T13:01:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f0929f380 con 0x564f093b10a0 2023-09-21T13:01:49.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.859+0000 7f1739e66b80 10 client.0 _ll_register_callbacks cb 0x564f091e9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49300/0 (socket says 172.21.15.142:49300) 2023-09-21T13:01:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 -- 172.21.15.142:0/2797120427 learned_addr learned my addr 172.21.15.142:0/2797120427 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171f7fe700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 0x564f093ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f1724b9c700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b5e50 0x564f093baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 -- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b5e50 msgr2=0x564f093baff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b5e50 0x564f093baff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 -- 172.21.15.142:0/2797120427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 msgr2=0x564f093ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 0x564f093ba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 -- 172.21.15.142:0/2797120427 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17201106d0 con 0x564f093b10a0 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171f7fe700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 0x564f093ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f171ffff700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1710096120 tx=0x7f17100c9eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b0ab1c26a0e992c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f16ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171009d320 con 0x564f093b10a0 2023-09-21T13:01:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f09273b50 con 0x564f093b10a0 2023-09-21T13:01:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.860+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f171009d4e0 con 0x564f093b10a0 2023-09-21T13:01:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17100a1720 con 0x564f093b10a0 2023-09-21T13:01:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 10 client.27037 fetch_fsmap learned FSMap version 31 2023-09-21T13:01:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564f09116c00 con 0x564f093b10a0 2023-09-21T13:01:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17100c7080 con 0x564f093b10a0 2023-09-21T13:01:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f17100a1290 con 0x564f093b10a0 2023-09-21T13:01:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 10 client.27037 fetch_fsmap finished waiting for FSMap version 31 2023-09-21T13:01:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 10 client.27037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 20 client.27037 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:49.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f093cafe0 0x564f093cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 4 client.27037 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:01:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f0937ffc0 con 0x564f093cafe0 2023-09-21T13:01:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.861+0000 7f171f7fe700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f093cafe0 0x564f093cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.862+0000 7f171f7fe700 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f093cafe0 0x564f093cd400 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d557f7c9af3d69b8 server_cookie=177a8fb200f5f930 in_seq=0 out_seq=0 2023-09-21T13:01:49.882 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.862+0000 7f16ff7fe700 10 client.27037 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.863+0000 7f16ff7fe700 1 -- 172.21.15.142:0/2797120427 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f0937ffc0 con 0x564f093cafe0 2023-09-21T13:01:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.863+0000 7f16ff7fe700 10 client.27037 handle_command_reply: tid=0 2023-09-21T13:01:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 client.27037 shutdown 2023-09-21T13:01:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 msgr2=0x564f093bd630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.883 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1710096120 tx=0x7f17100c9eb0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 shutdown_connections 2023-09-21T13:01:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f093cafe0 0x564f093cd400 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b5e50 0x564f093baff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b10a0 0x564f093bd630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.884 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f16ff7fe700 0 client.27037 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2797120427 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b19c0 0x564f093ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 >> 172.21.15.142:0/2797120427 conn(0x564f092ddfa0 msgr2=0x564f093abcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 shutdown_connections 2023-09-21T13:01:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 1 -- 172.21.15.142:0/2797120427 wait complete. 2023-09-21T13:01:49.885 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.864+0000 7f1739e66b80 20 client.27037 trim_cache size 0 max 16384 2023-09-21T13:01:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 Processor -- start 2023-09-21T13:01:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 -- start start 2023-09-21T13:01:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 0x564f093ba150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 0x564f093ba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f091838c0 con 0x564f093b5e50 2023-09-21T13:01:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f093a3c70 con 0x564f093b10a0 2023-09-21T13:01:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.881+0000 7f1739e66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f093b2160 con 0x564f093b19c0 2023-09-21T13:01:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f1724b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 0x564f093ba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 0x564f093ba150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51450/0 (socket says 172.21.15.142:51450) 2023-09-21T13:01:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 -- 172.21.15.142:0/2469574798 learned_addr learned my addr 172.21.15.142:0/2469574798 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 -- 172.21.15.142:0/2469574798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 msgr2=0x564f093ba150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 0x564f093ba150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 -- 172.21.15.142:0/2469574798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 msgr2=0x564f093ba690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 0x564f093ba690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 -- 172.21.15.142:0/2469574798 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f091541f0 con 0x564f093b10a0 2023-09-21T13:01:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171f7fe700 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 0x564f093ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f1724b9c700 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 0x564f093ba690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:01:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.882+0000 7f171ffff700 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17100960d0 tx=0x7f1710099770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11bd00afd7fc96b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1706ffd700 1 -- 172.21.15.142:0/2469574798 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1710084370 con 0x564f093b10a0 2023-09-21T13:01:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1706ffd700 1 -- 172.21.15.142:0/2469574798 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564f09273b50 con 0x564f093b10a0 2023-09-21T13:01:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1706ffd700 1 -- 172.21.15.142:0/2469574798 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17100a1290 con 0x564f093b10a0 2023-09-21T13:01:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 -- 172.21.15.142:0/2469574798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 msgr2=0x564f093bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f17100960d0 tx=0x7f1710099770 comp rx=0 tx=0).stop 2023-09-21T13:01:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 -- 172.21.15.142:0/2469574798 shutdown_connections 2023-09-21T13:01:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b5e50 0x564f093ba690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b10a0 0x564f093bd160 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 --2- 172.21.15.142:0/2469574798 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b19c0 0x564f093ba150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.883+0000 7f1739e66b80 1 -- 172.21.15.142:0/2469574798 >> 172.21.15.142:0/2469574798 conn(0x564f092ddfa0 msgr2=0x564f093c71f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.884+0000 7f1739e66b80 1 -- 172.21.15.142:0/2469574798 shutdown_connections 2023-09-21T13:01:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.884+0000 7f1739e66b80 1 -- 172.21.15.142:0/2469574798 wait complete. 2023-09-21T13:01:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.884+0000 7f1739e66b80 1 -- start start 2023-09-21T13:01:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.884+0000 7f1739e66b80 1 Processor -- start 2023-09-21T13:01:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093c1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093c0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f093c25c0 con 0x564f093b10a0 2023-09-21T13:01:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f093c0a80 con 0x564f093b19c0 2023-09-21T13:01:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f093c0bf0 con 0x564f093b5e50 2023-09-21T13:01:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1739e66b80 10 client.0 _ll_register_callbacks cb 0x564f091e9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:01:49.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51460/0 (socket says 172.21.15.142:51460) 2023-09-21T13:01:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 -- 172.21.15.142:0/546393980 learned_addr learned my addr 172.21.15.142:0/546393980 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:01:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f1724b9c700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093c0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171ffff700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093c1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 -- 172.21.15.142:0/546393980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 msgr2=0x564f093c0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093c0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 -- 172.21.15.142:0/546393980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 msgr2=0x564f093c1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:01:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093c1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.885+0000 7f171f7fe700 1 -- 172.21.15.142:0/546393980 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f0912dd80 con 0x564f093b19c0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f171f7fe700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f9613902d6edad server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f16ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714035060 con 0x564f093b19c0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f171401e040 con 0x564f093b19c0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17140310b0 con 0x564f093b19c0 2023-09-21T13:01:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f171401b040 con 0x564f093b19c0 2023-09-21T13:01:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f1739e66b80 10 client.27083 fetch_fsmap learned FSMap version 31 2023-09-21T13:01:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f1718020040 con 0x564f093b19c0 2023-09-21T13:01:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.886+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f171403e020 con 0x564f093b19c0 2023-09-21T13:01:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 31) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1714004500 con 0x564f093b19c0 2023-09-21T13:01:49.905 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 10 client.27083 fetch_fsmap finished waiting for FSMap version 31 2023-09-21T13:01:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 10 client.27083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:01:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 20 client.27083 populate_metadata read hostname 'smithi142' 2023-09-21T13:01:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f0941ff20 0x564f09422340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:01:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 4 client.27083 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:01:49.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564f092fbe00 con 0x564f0941ff20 2023-09-21T13:01:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f171ffff700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f0941ff20 0x564f09422340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:01:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f16ff7fe700 10 client.27083 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:49.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.887+0000 7f171ffff700 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f0941ff20 0x564f09422340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e44422315934b171 server_cookie=f9c6d8faf486fbe6 in_seq=0 out_seq=0 2023-09-21T13:01:49.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f16ff7fe700 1 -- 172.21.15.142:0/546393980 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564f092fbe00 con 0x564f0941ff20 2023-09-21T13:01:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f16ff7fe700 10 client.27083 handle_command_reply: tid=0 2023-09-21T13:01:49.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 client.27083 shutdown 2023-09-21T13:01:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 msgr2=0x564f093c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f1714005c90 comp rx=0 tx=0).stop 2023-09-21T13:01:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 shutdown_connections 2023-09-21T13:01:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564f0941ff20 0x564f09422340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564f093b10a0 0x564f093c1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564f093b5e50 0x564f093c0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 --2- 172.21.15.142:0/546393980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564f093b19c0 0x564f093c0000 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 >> 172.21.15.142:0/546393980 conn(0x564f092ddfa0 msgr2=0x564f093ba150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f16ff7fe700 0 client.27083 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:01:49.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 shutdown_connections 2023-09-21T13:01:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.958+0000 7f1739e66b80 1 -- 172.21.15.142:0/546393980 wait complete. 2023-09-21T13:01:49.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.959+0000 7f1739e66b80 20 client.27083 trim_cache size 0 max 16384 2023-09-21T13:01:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:01:49.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:01:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:01:49.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:01:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 msgr2=0x7f17080a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 0x7f17080a2c70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1718009ec0 tx=0x7f171800b040 comp rx=0 tx=0).stop 2023-09-21T13:01:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 msgr2=0x7f1720199090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:01:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f171000e9a0 tx=0x7f171000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 shutdown_connections 2023-09-21T13:01:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f17080a07b0 0x7f17080a2c70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172010d5a0 0x7f172019dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1720073210 0x7f1720199090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 --2- 172.21.15.142:0/13213348 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1720073b30 0x7f17201995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:01:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 >> 172.21.15.142:0/13213348 conn(0x7f17200fc830 msgr2=0x7f172010f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:01:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 shutdown_connections 2023-09-21T13:01:49.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:01:49.960+0000 7f17265ff700 1 -- 172.21.15.142:0/13213348 wait complete. 2023-09-21T13:01:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:49 smithi156 ceph-mon[134078]: pgmap v171: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 293 op/s 2023-09-21T13:01:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:49 smithi142 ceph-mon[97663]: pgmap v171: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 293 op/s 2023-09-21T13:01:50.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:49 smithi160 ceph-mon[134450]: pgmap v171: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 4.5 MiB/s wr, 293 op/s 2023-09-21T13:01:50.689 INFO:tasks.workunit.client.0.smithi142.stdout: 1 517705 9.53 MB/sec execute 151 sec latency 99.057 ms 2023-09-21T13:01:51.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518472 9.51 MB/sec execute 152 sec latency 675.692 ms 2023-09-21T13:01:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:51 smithi156 ceph-mon[134078]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 369 op/s 2023-09-21T13:01:52.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:51 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:51 smithi142 ceph-mon[97663]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 369 op/s 2023-09-21T13:01:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:51 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:51 smithi160 ceph-mon[134450]: pgmap v172: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.5 MiB/s wr, 369 op/s 2023-09-21T13:01:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:51 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:52.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518472 9.45 MB/sec execute 153 sec latency 1675.830 ms 2023-09-21T13:01:53.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:52 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:52 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:01:53.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:52 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:53.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:52 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:53.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:52 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:01:53.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:52 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:53.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:52 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:53.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:52 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:01:53.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:52 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:01:53.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518472 9.39 MB/sec execute 154 sec latency 2675.882 ms 2023-09-21T13:01:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:53 smithi156 ceph-mon[134078]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:54.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:53 smithi142 ceph-mon[97663]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:53 smithi160 ceph-mon[134450]: pgmap v173: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:54.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518908 9.35 MB/sec execute 155 sec latency 3077.708 ms 2023-09-21T13:01:55.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518908 9.29 MB/sec execute 156 sec latency 1303.363 ms 2023-09-21T13:01:56.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:55 smithi156 ceph-mon[134078]: pgmap v174: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:56.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:55 smithi142 ceph-mon[97663]: pgmap v174: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:56.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:55 smithi160 ceph-mon[134450]: pgmap v174: 97 pgs: 97 active+clean; 143 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 837 KiB/s rd, 3.1 MiB/s wr, 198 op/s 2023-09-21T13:01:56.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518908 9.23 MB/sec execute 157 sec latency 2303.482 ms 2023-09-21T13:01:57.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 518908 9.18 MB/sec execute 158 sec latency 3303.639 ms 2023-09-21T13:01:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:57 smithi156 ceph-mon[134078]: pgmap v175: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 225 op/s 2023-09-21T13:01:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:57 smithi142 ceph-mon[97663]: pgmap v175: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 225 op/s 2023-09-21T13:01:58.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:57 smithi160 ceph-mon[134450]: pgmap v175: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 225 op/s 2023-09-21T13:01:58.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 519056 9.12 MB/sec execute 159 sec latency 3854.586 ms 2023-09-21T13:01:59.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 519056 9.06 MB/sec execute 160 sec latency 1228.534 ms 2023-09-21T13:02:00.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:01:59 smithi156 ceph-mon[134078]: pgmap v176: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 876 KiB/s wr, 131 op/s 2023-09-21T13:02:00.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:01:59 smithi142 ceph-mon[97663]: pgmap v176: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 876 KiB/s wr, 131 op/s 2023-09-21T13:02:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:01:59 smithi160 ceph-mon[134450]: pgmap v176: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 553 KiB/s rd, 876 KiB/s wr, 131 op/s 2023-09-21T13:02:00.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 519278 9.01 MB/sec execute 161 sec latency 1979.288 ms 2023-09-21T13:02:01.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 520652 8.99 MB/sec execute 162 sec latency 28.581 ms 2023-09-21T13:02:02.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:01 smithi156 ceph-mon[134078]: pgmap v177: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2023-09-21T13:02:02.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:01 smithi142 ceph-mon[97663]: pgmap v177: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2023-09-21T13:02:02.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:01 smithi160 ceph-mon[134450]: pgmap v177: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 613 KiB/s rd, 1.4 MiB/s wr, 163 op/s 2023-09-21T13:02:02.690 INFO:tasks.workunit.client.0.smithi142.stdout: 1 522577 9.01 MB/sec execute 163 sec latency 27.420 ms 2023-09-21T13:02:03.118 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.118+0000 7fcacc5ff700 1 -- 172.21.15.142:0/3883770249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 msgr2=0x7fcac41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.118+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/3883770249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac41013b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009f90 tx=0x7fcac000b330 comp rx=0 tx=0).stop 2023-09-21T13:02:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 -- 172.21.15.142:0/3883770249 shutdown_connections 2023-09-21T13:02:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/3883770249 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac41013b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.119 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/3883770249 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac41060f0 0x7fcac410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/3883770249 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac4101980 0x7fcac41059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 -- 172.21.15.142:0/3883770249 >> 172.21.15.142:0/3883770249 conn(0x7fcac40fc830 msgr2=0x7fcac40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 -- 172.21.15.142:0/3883770249 shutdown_connections 2023-09-21T13:02:03.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.119+0000 7fcacc5ff700 1 -- 172.21.15.142:0/3883770249 wait complete. 2023-09-21T13:02:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 Processor -- start 2023-09-21T13:02:03.122 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 -- start start 2023-09-21T13:02:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac41060f0 0x7fcac41997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac419e890 con 0x7fcac4100fd0 2023-09-21T13:02:03.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac419ea00 con 0x7fcac419de10 2023-09-21T13:02:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacc5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac419ebc0 con 0x7fcac41060f0 2023-09-21T13:02:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcac9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac41060f0 0x7fcac41997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.120+0000 7fcacab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34500/0 (socket says 172.21.15.142:34500) 2023-09-21T13:02:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 -- 172.21.15.142:0/972997557 learned_addr learned my addr 172.21.15.142:0/972997557 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 -- 172.21.15.142:0/972997557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac41060f0 msgr2=0x7fcac41997a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac41060f0 0x7fcac41997a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 -- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 msgr2=0x7fcac4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 -- 172.21.15.142:0/972997557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009c40 con 0x7fcac419de10 2023-09-21T13:02:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacab9c700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e940 tx=0x7fcabc00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcabb7fe700 1 -- 172.21.15.142:0/972997557 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0097b0 con 0x7fcac419de10 2023-09-21T13:02:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcabb7fe700 1 -- 172.21.15.142:0/972997557 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcabc005020 con 0x7fcac419de10 2023-09-21T13:02:03.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac41a6120 con 0x7fcac419de10 2023-09-21T13:02:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.121+0000 7fcabb7fe700 1 -- 172.21.15.142:0/972997557 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00cc30 con 0x7fcac419de10 2023-09-21T13:02:03.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.122+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac41a6650 con 0x7fcac419de10 2023-09-21T13:02:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.125+0000 7fcabb7fe700 1 -- 172.21.15.142:0/972997557 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcabc005470 con 0x7fcac419de10 2023-09-21T13:02:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.126+0000 7fcadfe63b80 1 Processor -- start 2023-09-21T13:02:03.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 -- start start 2023-09-21T13:02:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2d8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcabb7fe700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 0x7fcab00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf24cc40 con 0x55efdf2d89c0 2023-09-21T13:02:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf230c10 con 0x55efdf2dce50 2023-09-21T13:02:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf22e530 con 0x55efdf2d80a0 2023-09-21T13:02:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcabb7fe700 1 -- 172.21.15.142:0/972997557 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcabc014070 con 0x7fcac419de10 2023-09-21T13:02:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcacab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcac9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2d8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcacab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34512/0 (socket says 172.21.15.142:34512) 2023-09-21T13:02:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcacab9c700 1 -- 172.21.15.142:0/391239757 learned_addr learned my addr 172.21.15.142:0/391239757 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.127+0000 7fcaca39b700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 0x7fcab00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 -- 172.21.15.142:0/391239757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 msgr2=0x55efdf2d8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2d8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 -- 172.21.15.142:0/391239757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 msgr2=0x55efdf2dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 -- 172.21.15.142:0/391239757 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdf054d80 con 0x55efdf2dce50 2023-09-21T13:02:03.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcacab9c700 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0a0fc0 tx=0x7fcabc098de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df2f541dbbbfb0a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcaca39b700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 0x7fcab00a2cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009790 tx=0x7fcac00096c0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcab8bfe700 1 -- 172.21.15.142:0/391239757 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0ab5a0 con 0x55efdf2dce50 2023-09-21T13:02:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcab8bfe700 1 -- 172.21.15.142:0/391239757 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcabc0ab3c0 con 0x55efdf2dce50 2023-09-21T13:02:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.128+0000 7fcab8bfe700 1 -- 172.21.15.142:0/391239757 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc09d340 con 0x55efdf2dce50 2023-09-21T13:02:03.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 -- 172.21.15.142:0/391239757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 msgr2=0x55efdf2dd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcabc0a0fc0 tx=0x7fcabc098de0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 -- 172.21.15.142:0/391239757 shutdown_connections 2023-09-21T13:02:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2dd2b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2d8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/391239757 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 -- 172.21.15.142:0/391239757 >> 172.21.15.142:0/391239757 conn(0x55efdf204fa0 msgr2=0x55efdf2d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 -- 172.21.15.142:0/391239757 shutdown_connections 2023-09-21T13:02:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.129+0000 7fcadfe63b80 1 -- 172.21.15.142:0/391239757 wait complete. 2023-09-21T13:02:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.130+0000 7fcadfe63b80 1 -- start start 2023-09-21T13:02:03.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.130+0000 7fcadfe63b80 1 Processor -- start 2023-09-21T13:02:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 0x55efdf2e1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf229e20 con 0x55efdf2dce50 2023-09-21T13:02:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf1c66e0 con 0x55efdf2d89c0 2023-09-21T13:02:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf1c6380 con 0x55efdf2d80a0 2023-09-21T13:02:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcadfe63b80 10 client.0 _ll_register_callbacks cb 0x55efdf110a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:03.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38430/0 (socket says 172.21.15.142:38430) 2023-09-21T13:02:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcac9b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 0x55efdf2e1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcaca39b700 1 -- 172.21.15.142:0/2287106589 learned_addr learned my addr 172.21.15.142:0/2287106589 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:03.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.131+0000 7fcacab9c700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 -- 172.21.15.142:0/2287106589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 msgr2=0x55efdf2e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 -- 172.21.15.142:0/2287106589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 msgr2=0x55efdf2e1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 -- 172.21.15.142:0/2287106589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac41a6650 con 0x55efdf2d89c0 2023-09-21T13:02:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 0x55efdf2e1950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcac419aa80 tx=0x7fcab4003960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=921af8c7091c1fef server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcaadffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab4016070 con 0x55efdf2d89c0 2023-09-21T13:02:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efdf19ab50 con 0x55efdf2d89c0 2023-09-21T13:02:03.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcab4004830 con 0x55efdf2d89c0 2023-09-21T13:02:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab40049f0 con 0x55efdf2d89c0 2023-09-21T13:02:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcadfe63b80 10 client.27095 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.132+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efdf03dc00 con 0x55efdf2d89c0 2023-09-21T13:02:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55efdf19ab50 con 0x55efdf2d89c0 2023-09-21T13:02:03.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcab40115b0 con 0x55efdf2d89c0 2023-09-21T13:02:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 10 client.27095 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 10 client.27095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 20 client.27095 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf2f1fc0 0x55efdf2f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 4 client.27095 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efdf2a6fc0 con 0x55efdf2f1fc0 2023-09-21T13:02:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.133+0000 7fcaca39b700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf2f1fc0 0x55efdf2f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.134+0000 7fcaadffb700 10 client.27095 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:03.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.134+0000 7fcaca39b700 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf2f1fc0 0x55efdf2f43e0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2327b74d7c484c43 server_cookie=1f7155c215a5b3a1 in_seq=0 out_seq=0 2023-09-21T13:02:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.135+0000 7fcaadffb700 1 -- 172.21.15.142:0/2287106589 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55efdf2a6fc0 con 0x55efdf2f1fc0 2023-09-21T13:02:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.135+0000 7fcaadffb700 10 client.27095 handle_command_reply: tid=0 2023-09-21T13:02:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.135+0000 7fcadfe63b80 1 client.27095 shutdown 2023-09-21T13:02:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 msgr2=0x55efdf2e1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 0x55efdf2e1950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcac419aa80 tx=0x7fcab4003960 comp rx=0 tx=0).stop 2023-09-21T13:02:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 shutdown_connections 2023-09-21T13:02:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf2f1fc0 0x55efdf2f43e0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcaadffb700 0 client.27095 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2287106589 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d89c0 0x55efdf2e1950 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 >> 172.21.15.142:0/2287106589 conn(0x55efdf204fa0 msgr2=0x55efdf2d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 shutdown_connections 2023-09-21T13:02:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2287106589 wait complete. 2023-09-21T13:02:03.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.136+0000 7fcadfe63b80 20 client.27095 trim_cache size 0 max 16384 2023-09-21T13:02:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.151+0000 7fcadfe63b80 1 Processor -- start 2023-09-21T13:02:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 -- start start 2023-09-21T13:02:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d89c0 0x55efdf2e8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf0aa8c0 con 0x55efdf2dce50 2023-09-21T13:02:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf2e2ec0 con 0x55efdf2d80a0 2023-09-21T13:02:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf2e9510 con 0x55efdf2d89c0 2023-09-21T13:02:03.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34518/0 (socket says 172.21.15.142:34518) 2023-09-21T13:02:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcac9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d89c0 0x55efdf2e8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcaca39b700 1 -- 172.21.15.142:0/1688976965 learned_addr learned my addr 172.21.15.142:0/1688976965 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.152+0000 7fcacab9c700 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 -- 172.21.15.142:0/1688976965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d89c0 msgr2=0x55efdf2e8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d89c0 0x55efdf2e8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 -- 172.21.15.142:0/1688976965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 msgr2=0x55efdf2e1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 -- 172.21.15.142:0/1688976965 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efdf07b1f0 con 0x55efdf2d80a0 2023-09-21T13:02:03.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcaca39b700 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000f80 tx=0x7fcac0013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32a9a05ef219afba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcab93ff700 1 -- 172.21.15.142:0/1688976965 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e040 con 0x55efdf2d80a0 2023-09-21T13:02:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcab93ff700 1 -- 172.21.15.142:0/1688976965 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcac000b990 con 0x55efdf2d80a0 2023-09-21T13:02:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.153+0000 7fcab93ff700 1 -- 172.21.15.142:0/1688976965 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac002fc70 con 0x55efdf2d80a0 2023-09-21T13:02:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- 172.21.15.142:0/1688976965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 msgr2=0x55efdf2da740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcac0000f80 tx=0x7fcac0013000 comp rx=0 tx=0).stop 2023-09-21T13:02:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- 172.21.15.142:0/1688976965 shutdown_connections 2023-09-21T13:02:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2dce50 0x55efdf2e1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2d80a0 0x55efdf2da740 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/1688976965 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d89c0 0x55efdf2e8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- 172.21.15.142:0/1688976965 >> 172.21.15.142:0/1688976965 conn(0x55efdf204fa0 msgr2=0x55efdf2dafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- 172.21.15.142:0/1688976965 shutdown_connections 2023-09-21T13:02:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- 172.21.15.142:0/1688976965 wait complete. 2023-09-21T13:02:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.154+0000 7fcadfe63b80 1 -- start start 2023-09-21T13:02:03.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 Processor -- start 2023-09-21T13:02:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2e3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2e3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf2e43c0 con 0x55efdf2d89c0 2023-09-21T13:02:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf2e4530 con 0x55efdf2dce50 2023-09-21T13:02:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efdf2e46f0 con 0x55efdf2d80a0 2023-09-21T13:02:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcadfe63b80 10 client.0 _ll_register_callbacks cb 0x55efdf110a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcaca39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38446/0 (socket says 172.21.15.142:38446) 2023-09-21T13:02:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcaca39b700 1 -- 172.21.15.142:0/2663609549 learned_addr learned my addr 172.21.15.142:0/2663609549 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcacab9c700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2e3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.155+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2e3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 -- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 msgr2=0x55efdf2e3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2e3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 -- 172.21.15.142:0/2663609549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 msgr2=0x55efdf2e3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:03.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2e3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 -- 172.21.15.142:0/2663609549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac410e4e0 con 0x55efdf2d80a0 2023-09-21T13:02:03.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaca39b700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcac0032040 tx=0x7fcac000bb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30615b014db6c7dc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:03.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaadffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:03.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e040 con 0x55efdf2d80a0 2023-09-21T13:02:03.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcac002f450 con 0x55efdf2d80a0 2023-09-21T13:02:03.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.156+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcabc0ab3c0 con 0x55efdf2d80a0 2023-09-21T13:02:03.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcac002f610 con 0x55efdf2d80a0 2023-09-21T13:02:03.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 10 client.27061 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efdf053250 con 0x55efdf2d80a0 2023-09-21T13:02:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcabc0ab3c0 con 0x55efdf2d80a0 2023-09-21T13:02:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcac00298a0 con 0x55efdf2d80a0 2023-09-21T13:02:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 10 client.27061 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:03.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 10 client.27061 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 20 client.27061 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf346d30 0x55efdf349150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 4 client.27061 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:02:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55efdf222e00 con 0x55efdf346d30 2023-09-21T13:02:03.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.157+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf346d30 0x55efdf349150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.158+0000 7fcaadffb700 10 client.27061 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:03.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.158+0000 7fcac9b9a700 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf346d30 0x55efdf349150 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7ab8896de7e90d5 server_cookie=d2d7d514e470bfd5 in_seq=0 out_seq=0 2023-09-21T13:02:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcaadffb700 1 -- 172.21.15.142:0/2663609549 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55efdf222e00 con 0x55efdf346d30 2023-09-21T13:02:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcaadffb700 10 client.27061 handle_command_reply: tid=0 2023-09-21T13:02:03.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 client.27061 shutdown 2023-09-21T13:02:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 msgr2=0x55efdf2e31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcac0032040 tx=0x7fcac000bb80 comp rx=0 tx=0).stop 2023-09-21T13:02:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 shutdown_connections 2023-09-21T13:02:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efdf346d30 0x55efdf349150 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efdf2dce50 0x55efdf2e3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efdf2d80a0 0x55efdf2e31f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcaadffb700 0 client.27061 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 --2- 172.21.15.142:0/2663609549 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efdf2d89c0 0x55efdf2e3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 >> 172.21.15.142:0/2663609549 conn(0x55efdf204fa0 msgr2=0x55efdf2dbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 shutdown_connections 2023-09-21T13:02:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 1 -- 172.21.15.142:0/2663609549 wait complete. 2023-09-21T13:02:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.203+0000 7fcadfe63b80 20 client.27061 trim_cache size 0 max 16384 2023-09-21T13:02:03.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:02:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:02:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:02:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:02:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 msgr2=0x7fcab00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 0x7fcab00a2cf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fcac0009790 tx=0x7fcac00096c0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 msgr2=0x7fcac419e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e940 tx=0x7fcabc00ec50 comp rx=0 tx=0).stop 2023-09-21T13:02:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 shutdown_connections 2023-09-21T13:02:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcab00a0830 0x7fcab00a2cf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcac4100fd0 0x7fcac4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcac419de10 0x7fcac419e290 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 --2- 172.21.15.142:0/972997557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac41060f0 0x7fcac41997a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 >> 172.21.15.142:0/972997557 conn(0x7fcac40fc830 msgr2=0x7fcac40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 shutdown_connections 2023-09-21T13:02:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:03.204+0000 7fcacc5ff700 1 -- 172.21.15.142:0/972997557 wait complete. 2023-09-21T13:02:03.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 524384 8.99 MB/sec execute 164 sec latency 16.745 ms 2023-09-21T13:02:04.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:03 smithi156 ceph-mon[134078]: pgmap v178: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:04.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:03 smithi142 ceph-mon[97663]: pgmap v178: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:04.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:03 smithi160 ceph-mon[134450]: pgmap v178: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:04.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 526152 9.02 MB/sec execute 165 sec latency 12.058 ms 2023-09-21T13:02:05.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 528254 9.01 MB/sec execute 166 sec latency 11.605 ms 2023-09-21T13:02:06.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:05 smithi156 ceph-mon[134078]: pgmap v179: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:06.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:05 smithi142 ceph-mon[97663]: pgmap v179: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:06.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:05 smithi160 ceph-mon[134450]: pgmap v179: 97 pgs: 97 active+clean; 144 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 268 KiB/s rd, 938 KiB/s wr, 59 op/s 2023-09-21T13:02:06.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529859 9.03 MB/sec execute 167 sec latency 11.812 ms 2023-09-21T13:02:07.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.97 MB/sec execute 168 sec latency 906.171 ms 2023-09-21T13:02:08.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:07 smithi156 ceph-mon[134078]: pgmap v180: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.4 MiB/s wr, 209 op/s 2023-09-21T13:02:08.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:07 smithi142 ceph-mon[97663]: pgmap v180: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.4 MiB/s wr, 209 op/s 2023-09-21T13:02:08.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:07 smithi160 ceph-mon[134450]: pgmap v180: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 862 KiB/s rd, 2.4 MiB/s wr, 209 op/s 2023-09-21T13:02:08.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.92 MB/sec execute 169 sec latency 1906.312 ms 2023-09-21T13:02:09.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.87 MB/sec execute 170 sec latency 2906.387 ms 2023-09-21T13:02:10.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:09 smithi156 ceph-mon[134078]: pgmap v181: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.1 MiB/s wr, 182 op/s 2023-09-21T13:02:10.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:09 smithi142 ceph-mon[97663]: pgmap v181: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.1 MiB/s wr, 182 op/s 2023-09-21T13:02:10.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:09 smithi160 ceph-mon[134450]: pgmap v181: 97 pgs: 97 active+clean; 146 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.1 MiB/s wr, 182 op/s 2023-09-21T13:02:10.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.82 MB/sec execute 171 sec latency 3906.508 ms 2023-09-21T13:02:11.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.76 MB/sec execute 172 sec latency 4906.641 ms 2023-09-21T13:02:12.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:11 smithi156 ceph-mon[134078]: pgmap v182: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-09-21T13:02:12.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:11 smithi142 ceph-mon[97663]: pgmap v182: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-09-21T13:02:12.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:11 smithi160 ceph-mon[134450]: pgmap v182: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 3.0 MiB/s wr, 237 op/s 2023-09-21T13:02:12.621 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:02:12.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.71 MB/sec execute 173 sec latency 5906.713 ms 2023-09-21T13:02:12.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 -- 172.21.15.142:0/1560627405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920101950 msgr2=0x7fb920105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 --2- 172.21.15.142:0/1560627405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920101950 0x7fb920105990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb910009990 tx=0x7fb910009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 -- 172.21.15.142:0/1560627405 shutdown_connections 2023-09-21T13:02:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 --2- 172.21.15.142:0/1560627405 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9201060c0 0x7fb92010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 --2- 172.21.15.142:0/1560627405 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb920100fa0 0x7fb920101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 --2- 172.21.15.142:0/1560627405 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920101950 0x7fb920105990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 -- 172.21.15.142:0/1560627405 >> 172.21.15.142:0/1560627405 conn(0x7fb9200fc860 msgr2=0x7fb9200fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 -- 172.21.15.142:0/1560627405 shutdown_connections 2023-09-21T13:02:12.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.834+0000 7fb9273ff700 1 -- 172.21.15.142:0/1560627405 wait complete. 2023-09-21T13:02:12.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.835+0000 7fb9273ff700 1 Processor -- start 2023-09-21T13:02:12.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.835+0000 7fb9273ff700 1 -- start start 2023-09-21T13:02:12.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 0x7fb920199650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92019dab0 0x7fb92019df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92019e530 con 0x7fb920100fa0 2023-09-21T13:02:12.839 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92019e6a0 con 0x7fb9201060c0 2023-09-21T13:02:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb9273ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92019e860 con 0x7fb92019dab0 2023-09-21T13:02:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50278/0 (socket says 172.21.15.142:50278) 2023-09-21T13:02:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 -- 172.21.15.142:0/3538605681 learned_addr learned my addr 172.21.15.142:0/3538605681 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:12.840 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92599c700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92019dab0 0x7fb92019df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92499a700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 0x7fb920199650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 -- 172.21.15.142:0/3538605681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92019dab0 msgr2=0x7fb92019df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92019dab0 0x7fb92019df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 -- 172.21.15.142:0/3538605681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 msgr2=0x7fb920199650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 0x7fb920199650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92519b700 1 -- 172.21.15.142:0/3538605681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c009520 con 0x7fb920100fa0 2023-09-21T13:02:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.836+0000 7fb92499a700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 0x7fb920199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:12.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb92519b700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00eb30 tx=0x7fb91c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb9167fc700 1 -- 172.21.15.142:0/3538605681 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009880 con 0x7fb920100fa0 2023-09-21T13:02:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb9167fc700 1 -- 172.21.15.142:0/3538605681 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91c0044e0 con 0x7fb920100fa0 2023-09-21T13:02:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9100095f0 con 0x7fb920100fa0 2023-09-21T13:02:12.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb9167fc700 1 -- 172.21.15.142:0/3538605681 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003e90 con 0x7fb920100fa0 2023-09-21T13:02:12.844 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.837+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9201a6160 con 0x7fb920100fa0 2023-09-21T13:02:12.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.840+0000 7fb9167fc700 1 -- 172.21.15.142:0/3538605681 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fb91c004000 con 0x7fb920100fa0 2023-09-21T13:02:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 Processor -- start 2023-09-21T13:02:12.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 -- start start 2023-09-21T13:02:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb9167fc700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 0x7fb90c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd39e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.841+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bca9ca0 con 0x56135bd35610 2023-09-21T13:02:12.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bc8dc70 con 0x56135bd3a360 2023-09-21T13:02:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bc8b590 con 0x56135bd35f30 2023-09-21T13:02:12.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb9167fc700 1 -- 172.21.15.142:0/3538605681 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb91c014070 con 0x7fb920100fa0 2023-09-21T13:02:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92599c700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 0x7fb90c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.855 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50294/0 (socket says 172.21.15.142:50294) 2023-09-21T13:02:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 -- 172.21.15.142:0/3235660618 learned_addr learned my addr 172.21.15.142:0/3235660618 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd39e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.856 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92599c700 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 -- 172.21.15.142:0/3235660618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 msgr2=0x56135bd39e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd39e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.857 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 -- 172.21.15.142:0/3235660618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 msgr2=0x56135bd3a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92519b700 1 -- 172.21.15.142:0/3235660618 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56135bab1de0 con 0x56135bd35610 2023-09-21T13:02:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.842+0000 7fb92599c700 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb92519b700 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0962e0 tx=0x7fb91c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d530e452a4fba284 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb92599c700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 0x7fb90c0a2cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ec0 tx=0x7fb918009920 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb90b7fe700 1 -- 172.21.15.142:0/3235660618 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0980c0 con 0x56135bd35610 2023-09-21T13:02:12.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb90b7fe700 1 -- 172.21.15.142:0/3235660618 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91c097ed0 con 0x56135bd35610 2023-09-21T13:02:12.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb90b7fe700 1 -- 172.21.15.142:0/3235660618 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c0998e0 con 0x56135bd35610 2023-09-21T13:02:12.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3235660618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 msgr2=0x56135bd359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.843+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fb91c0962e0 tx=0x7fb91c00cf70 comp rx=0 tx=0).stop 2023-09-21T13:02:12.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3235660618 shutdown_connections 2023-09-21T13:02:12.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd359f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3235660618 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd39e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3235660618 >> 172.21.15.142:0/3235660618 conn(0x56135bc62000 msgr2=0x56135bd306a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3235660618 shutdown_connections 2023-09-21T13:02:12.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3235660618 wait complete. 2023-09-21T13:02:12.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 -- start start 2023-09-21T13:02:12.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.844+0000 7fb93ad33b80 1 Processor -- start 2023-09-21T13:02:12.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35610 0x56135bd3ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 0x56135bd3f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bc86e80 con 0x56135bd35f30 2023-09-21T13:02:12.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bc23740 con 0x56135bd35610 2023-09-21T13:02:12.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bc233e0 con 0x56135bd3a360 2023-09-21T13:02:12.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb93ad33b80 10 client.0 _ll_register_callbacks cb 0x56135bb6da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:12.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb92499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb92499a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50298/0 (socket says 172.21.15.142:50298) 2023-09-21T13:02:12.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb92499a700 1 -- 172.21.15.142:0/3244535038 learned_addr learned my addr 172.21.15.142:0/3244535038 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:12.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb92519b700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35610 0x56135bd3ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.845+0000 7fb92599c700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 0x56135bd3f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 -- 172.21.15.142:0/3244535038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 msgr2=0x56135bd3f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 0x56135bd3f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 -- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35610 msgr2=0x56135bd3ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35610 0x56135bd3ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 -- 172.21.15.142:0/3244535038 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9201a6160 con 0x56135bd35f30 2023-09-21T13:02:12.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92599c700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 0x56135bd3f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:12.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb92499a700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb92006a370 tx=0x7fb910005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ccdedf9148215c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb908ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910004700 con 0x56135bd35f30 2023-09-21T13:02:12.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56135bbf7bb0 con 0x56135bd35f30 2023-09-21T13:02:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb91000be60 con 0x56135bd35f30 2023-09-21T13:02:12.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb910004860 con 0x56135bd35f30 2023-09-21T13:02:12.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb93ad33b80 10 client.17019 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:12.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.846+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56135ba9ac60 con 0x56135bd35f30 2023-09-21T13:02:12.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56135bbf7bb0 con 0x56135bd35f30 2023-09-21T13:02:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb91000f9b0 con 0x56135bd35f30 2023-09-21T13:02:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:12.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 10 client.17019 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 20 client.17019 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bd4f530 0x56135bd51950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 4 client.17019 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56135bd04020 con 0x56135bd4f530 2023-09-21T13:02:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.847+0000 7fb92519b700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bd4f530 0x56135bd51950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.848+0000 7fb92519b700 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bd4f530 0x56135bd51950 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=368975d89b0a9552 server_cookie=3107882786da4782 in_seq=0 out_seq=0 2023-09-21T13:02:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.848+0000 7fb908ff9700 10 client.17019 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:12.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.848+0000 7fb908ff9700 1 -- 172.21.15.142:0/3244535038 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56135bd04020 con 0x56135bd4f530 2023-09-21T13:02:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.848+0000 7fb908ff9700 10 client.17019 handle_command_reply: tid=0 2023-09-21T13:02:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.848+0000 7fb93ad33b80 1 client.17019 shutdown 2023-09-21T13:02:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 msgr2=0x56135bd3f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb92006a370 tx=0x7fb910005750 comp rx=0 tx=0).stop 2023-09-21T13:02:12.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 shutdown_connections 2023-09-21T13:02:12.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bd4f530 0x56135bd51950 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd3a360 0x56135bd3f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35610 0x56135bd3ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/3244535038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35f30 0x56135bd3f380 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb908ff9700 0 client.17019 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:12.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 >> 172.21.15.142:0/3244535038 conn(0x56135bc62000 msgr2=0x56135bd30290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 shutdown_connections 2023-09-21T13:02:12.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 1 -- 172.21.15.142:0/3244535038 wait complete. 2023-09-21T13:02:12.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.849+0000 7fb93ad33b80 20 client.17019 trim_cache size 0 max 16384 2023-09-21T13:02:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.866+0000 7fb93ad33b80 1 Processor -- start 2023-09-21T13:02:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.866+0000 7fb93ad33b80 1 -- start start 2023-09-21T13:02:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35f30 0x56135bd39450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 0x56135bd39990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bb07920 con 0x56135bd3a360 2023-09-21T13:02:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bd30be0 con 0x56135bd35f30 2023-09-21T13:02:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bd4be40 con 0x56135bd35610 2023-09-21T13:02:12.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33856/0 (socket says 172.21.15.142:33856) 2023-09-21T13:02:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 -- 172.21.15.142:0/1061390376 learned_addr learned my addr 172.21.15.142:0/1061390376 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92599c700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 0x56135bd39990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92499a700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35f30 0x56135bd39450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 -- 172.21.15.142:0/1061390376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35f30 msgr2=0x56135bd39450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35f30 0x56135bd39450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 -- 172.21.15.142:0/1061390376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 msgr2=0x56135bd39990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 0x56135bd39990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 -- 172.21.15.142:0/1061390376 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56135bd3e9b0 con 0x56135bd35610 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92599c700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 0x56135bd39990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.867+0000 7fb92519b700 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb91c099800 tx=0x7fb91c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2c946564d2faf26 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb90bfff700 1 -- 172.21.15.142:0/1061390376 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c07d070 con 0x56135bd35610 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb90bfff700 1 -- 172.21.15.142:0/1061390376 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb91c099f70 con 0x56135bd35610 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb90bfff700 1 -- 172.21.15.142:0/1061390376 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c097c70 con 0x56135bd35610 2023-09-21T13:02:12.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 -- 172.21.15.142:0/1061390376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 msgr2=0x56135bd464e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb91c099800 tx=0x7fb91c004750 comp rx=0 tx=0).stop 2023-09-21T13:02:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 -- 172.21.15.142:0/1061390376 shutdown_connections 2023-09-21T13:02:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd3a360 0x56135bd39990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35610 0x56135bd464e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/1061390376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd35f30 0x56135bd39450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 -- 172.21.15.142:0/1061390376 >> 172.21.15.142:0/1061390376 conn(0x56135bc62000 msgr2=0x56135bd384d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 -- 172.21.15.142:0/1061390376 shutdown_connections 2023-09-21T13:02:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.868+0000 7fb93ad33b80 1 -- 172.21.15.142:0/1061390376 wait complete. 2023-09-21T13:02:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 -- start start 2023-09-21T13:02:12.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 Processor -- start 2023-09-21T13:02:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd37860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bd37f70 con 0x56135bd35610 2023-09-21T13:02:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bd3b1c0 con 0x56135bd3a360 2023-09-21T13:02:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56135bd3b380 con 0x56135bd35f30 2023-09-21T13:02:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.869+0000 7fb93ad33b80 10 client.0 _ll_register_callbacks cb 0x56135bb6da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92519b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd37860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33866/0 (socket says 172.21.15.142:33866) 2023-09-21T13:02:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 -- 172.21.15.142:0/2741439273 learned_addr learned my addr 172.21.15.142:0/2741439273 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92599c700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 -- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 msgr2=0x56135bd3ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 -- 172.21.15.142:0/2741439273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 msgr2=0x56135bd37860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd37860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 -- 172.21.15.142:0/2741439273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56135bab1de0 con 0x56135bd35f30 2023-09-21T13:02:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92599c700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb92499a700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb910001eb0 tx=0x7fb91000fb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb67bb2820c5552a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:12.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.870+0000 7fb908ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb910017950 con 0x56135bd35f30 2023-09-21T13:02:12.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fb91000be60 con 0x56135bd35f30 2023-09-21T13:02:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb91c097ed0 con 0x56135bd35f30 2023-09-21T13:02:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb91000bad0 con 0x56135bd35f30 2023-09-21T13:02:12.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 10 client.27079 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56135bad8250 con 0x56135bd35f30 2023-09-21T13:02:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb910045020 con 0x56135bd35f30 2023-09-21T13:02:12.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb910004830 con 0x56135bd35f30 2023-09-21T13:02:12.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 10 client.27079 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:12.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 10 client.27079 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:12.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 20 client.27079 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:12.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bda4150 0x56135bda6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:12.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 4 client.27079 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:02:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.871+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56135bc7fe60 con 0x56135bda4150 2023-09-21T13:02:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb92519b700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bda4150 0x56135bda6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:12.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb908ff9700 10 client.27079 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb92519b700 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bda4150 0x56135bda6570 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57f0ead7b3d1cb3e server_cookie=f407a38bf2e9b6eb in_seq=0 out_seq=0 2023-09-21T13:02:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb908ff9700 1 -- 172.21.15.142:0/2741439273 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56135bc7fe60 con 0x56135bda4150 2023-09-21T13:02:12.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb908ff9700 10 client.27079 handle_command_reply: tid=0 2023-09-21T13:02:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb93ad33b80 1 client.27079 shutdown 2023-09-21T13:02:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 msgr2=0x56135bd3a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.872+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb910001eb0 tx=0x7fb91000fb40 comp rx=0 tx=0).stop 2023-09-21T13:02:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 shutdown_connections 2023-09-21T13:02:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56135bda4150 0x56135bda6570 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56135bd35610 0x56135bd37860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56135bd3a360 0x56135bd3ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 --2- 172.21.15.142:0/2741439273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56135bd35f30 0x56135bd3a740 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb908ff9700 0 client.27079 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:12.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 >> 172.21.15.142:0/2741439273 conn(0x56135bc62000 msgr2=0x56135bd39450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 shutdown_connections 2023-09-21T13:02:12.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 1 -- 172.21.15.142:0/2741439273 wait complete. 2023-09-21T13:02:12.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb93ad33b80 20 client.27079 trim_cache size 0 max 16384 2023-09-21T13:02:12.905 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:02:12.905 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T13:02:12.906 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T13:02:12.906 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:02:12.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 msgr2=0x7fb90c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.907 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 0x7fb90c0a2cf0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb918009ec0 tx=0x7fb918009920 comp rx=0 tx=0).stop 2023-09-21T13:02:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 msgr2=0x7fb920199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00eb30 tx=0x7fb91c00ee40 comp rx=0 tx=0).stop 2023-09-21T13:02:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 shutdown_connections 2023-09-21T13:02:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb90c0a0830 0x7fb90c0a2cf0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.908 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb920100fa0 0x7fb920199110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb92019dab0 0x7fb92019df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 --2- 172.21.15.142:0/3538605681 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb9201060c0 0x7fb920199650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.873+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 >> 172.21.15.142:0/3538605681 conn(0x7fb9200fc860 msgr2=0x7fb9200fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:12.909 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.874+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 shutdown_connections 2023-09-21T13:02:12.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:12.874+0000 7fb9273ff700 1 -- 172.21.15.142:0/3538605681 wait complete. 2023-09-21T13:02:12.910 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T13:02:12.910 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:02:13.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 -- 172.21.15.142:0/3864766701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b0101970 msgr2=0x7fa6b01059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/3864766701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b0101970 0x7fa6b01059b0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa69c009990 tx=0x7fa69c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 -- 172.21.15.142:0/3864766701 shutdown_connections 2023-09-21T13:02:13.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/3864766701 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b01060e0 0x7fa6b010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/3864766701 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 0x7fa6b01013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/3864766701 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b0101970 0x7fa6b01059b0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 -- 172.21.15.142:0/3864766701 >> 172.21.15.142:0/3864766701 conn(0x7fa6b00fc800 msgr2=0x7fa6b00fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.110+0000 7fa6b71ff700 1 -- 172.21.15.142:0/3864766701 shutdown_connections 2023-09-21T13:02:13.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.111+0000 7fa6b71ff700 1 -- 172.21.15.142:0/3864766701 wait complete. 2023-09-21T13:02:13.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.111+0000 7fa6b71ff700 1 Processor -- start 2023-09-21T13:02:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 -- start start 2023-09-21T13:02:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 0x7fa6b0196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b019b830 0x7fa6b019bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b019c2b0 con 0x7fa6b01060e0 2023-09-21T13:02:13.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b019c420 con 0x7fa6b019b830 2023-09-21T13:02:13.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b71ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b019c5e0 con 0x7fa6b0100fc0 2023-09-21T13:02:13.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6affff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6affff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50334/0 (socket says 172.21.15.142:50334) 2023-09-21T13:02:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6affff700 1 -- 172.21.15.142:0/61210566 learned_addr learned my addr 172.21.15.142:0/61210566 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b579c700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b019b830 0x7fa6b019bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.112+0000 7fa6b4f9b700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 0x7fa6b0196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 -- 172.21.15.142:0/61210566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 msgr2=0x7fa6b0196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 0x7fa6b0196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 -- 172.21.15.142:0/61210566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b019b830 msgr2=0x7fa6b019bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b019b830 0x7fa6b019bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 -- 172.21.15.142:0/61210566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a8009c40 con 0x7fa6b01060e0 2023-09-21T13:02:13.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6affff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0059d0 tx=0x7fa69c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c01d070 con 0x7fa6b01060e0 2023-09-21T13:02:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa69c022470 con 0x7fa6b01060e0 2023-09-21T13:02:13.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c0095f0 con 0x7fa6b01060e0 2023-09-21T13:02:13.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69c017650 con 0x7fa6b01060e0 2023-09-21T13:02:13.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.113+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b01a3dd0 con 0x7fa6b01060e0 2023-09-21T13:02:13.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.114+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b0067bd0 con 0x7fa6b01060e0 2023-09-21T13:02:13.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.116+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa69c0225e0 con 0x7fa6b01060e0 2023-09-21T13:02:13.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.118+0000 7fa6adffb700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 0x7fa6a00a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.119+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fa69c0cd310 con 0x7fa6b01060e0 2023-09-21T13:02:13.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.119+0000 7fa6b4f9b700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 0x7fa6a00a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.119+0000 7fa6b4f9b700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 0x7fa6a00a2d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009bf0 tx=0x7fa6a4009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.123+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa69c096c80 con 0x7fa6b01060e0 2023-09-21T13:02:13.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.377+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6b01981e0 con 0x7fa6b01060e0 2023-09-21T13:02:13.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.378+0000 7fa6adffb700 1 -- 172.21.15.142:0/61210566 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+11343 (secure 0 0 0) 0x7fa69c09a2a0 con 0x7fa6b01060e0 2023-09-21T13:02:13.378 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:02:13.378 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:01:51.430191+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[0],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_26914":{"gid":26914,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/1221820034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":1221820034},{"type":"v1","addr":"172.21.15.160:6839","nonce":1221820034}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:02:13.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 msgr2=0x7fa6a00a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 0x7fa6a00a2d30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009bf0 tx=0x7fa6a4009260 comp rx=0 tx=0).stop 2023-09-21T13:02:13.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 msgr2=0x7fa6b01973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa69c0059d0 tx=0x7fa69c0057f0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 shutdown_connections 2023-09-21T13:02:13.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa6a00a0870 0x7fa6a00a2d30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa6b019b830 0x7fa6b019bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6b0100fc0 0x7fa6b0196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 --2- 172.21.15.142:0/61210566 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa6b01060e0 0x7fa6b01973d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 >> 172.21.15.142:0/61210566 conn(0x7fa6b00fc800 msgr2=0x7fa6b00fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 shutdown_connections 2023-09-21T13:02:13.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.381+0000 7fa6b71ff700 1 -- 172.21.15.142:0/61210566 wait complete. 2023-09-21T13:02:13.383 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 32 2023-09-21T13:02:13.399 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:02:13.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1189553129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073aa0 msgr2=0x7f18e8111800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1189553129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073aa0 0x7f18e8111800 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009990 tx=0x7f18d8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1189553129 shutdown_connections 2023-09-21T13:02:13.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1189553129 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8111d40 0x7f18e8114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1189553129 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8073180 0x7f18e8073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1189553129 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073aa0 0x7f18e8111800 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1189553129 >> 172.21.15.142:0/1189553129 conn(0x7f18e80fc860 msgr2=0x7f18e80fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1189553129 shutdown_connections 2023-09-21T13:02:13.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.604+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1189553129 wait complete. 2023-09-21T13:02:13.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.605+0000 7f18ef7ff700 1 Processor -- start 2023-09-21T13:02:13.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.605+0000 7f18ef7ff700 1 -- start start 2023-09-21T13:02:13.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8073aa0 0x7f18e819dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8111d40 0x7f18e81a1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81a2550 con 0x7f18e8073180 2023-09-21T13:02:13.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81a26c0 con 0x7f18e8111d40 2023-09-21T13:02:13.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ef7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e81a2880 con 0x7f18e8073aa0 2023-09-21T13:02:13.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50350/0 (socket says 172.21.15.142:50350) 2023-09-21T13:02:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 -- 172.21.15.142:0/1610831152 learned_addr learned my addr 172.21.15.142:0/1610831152 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ecd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8073aa0 0x7f18e819dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18edd9c700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8111d40 0x7f18e81a1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 -- 172.21.15.142:0/1610831152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8073aa0 msgr2=0x7f18e819dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8073aa0 0x7f18e819dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 -- 172.21.15.142:0/1610831152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8111d40 msgr2=0x7f18e81a1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8111d40 0x7f18e81a1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.606+0000 7f18ed59b700 1 -- 172.21.15.142:0/1610831152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80095f0 con 0x7f18e8073180 2023-09-21T13:02:13.611 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ef10 tx=0x7f18e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18de7fc700 1 -- 172.21.15.142:0/1610831152 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e400c9c0 con 0x7f18e8073180 2023-09-21T13:02:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18de7fc700 1 -- 172.21.15.142:0/1610831152 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18e400f040 con 0x7f18e8073180 2023-09-21T13:02:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e81a2b00 con 0x7f18e8073180 2023-09-21T13:02:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18de7fc700 1 -- 172.21.15.142:0/1610831152 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4014480 con 0x7f18e8073180 2023-09-21T13:02:13.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.607+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e81aa3a0 con 0x7f18e8073180 2023-09-21T13:02:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.612+0000 7f18de7fc700 1 -- 172.21.15.142:0/1610831152 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f18e4007690 con 0x7f18e8073180 2023-09-21T13:02:13.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.612+0000 7f190313cb80 1 Processor -- start 2023-09-21T13:02:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 -- start start 2023-09-21T13:02:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.616 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdc04ca0 con 0x558ffdc90f30 2023-09-21T13:02:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdbe8c70 con 0x558ffdc90610 2023-09-21T13:02:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f190313cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdbe6590 con 0x558ffdc95360 2023-09-21T13:02:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18edd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18edd9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:57266/0 (socket says 172.21.15.142:57266) 2023-09-21T13:02:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50358/0 (socket says 172.21.15.142:50358) 2023-09-21T13:02:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18edd9c700 1 -- 172.21.15.142:0/1799176914 learned_addr learned my addr 172.21.15.142:0/1799176914 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.613+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18de7fc700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 0x7f18d40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 -- 172.21.15.142:0/1799176914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 msgr2=0x558ffdc909f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18de7fc700 1 -- 172.21.15.142:0/1610831152 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18e40cc210 con 0x7f18e8073180 2023-09-21T13:02:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 -- 172.21.15.142:0/1799176914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 msgr2=0x558ffdc94e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 -- 172.21.15.142:0/1799176914 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ffda0cde0 con 0x558ffdc95360 2023-09-21T13:02:13.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18edd9c700 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:13.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18edd9c700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 0x7f18d40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.614+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc957c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b2e0 tx=0x7f18d8005ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da191997635d5c7f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f18edd9c700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 0x7f18d40a2c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18e00104f0 tx=0x7f18e0004750 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f18d37fe700 1 -- 172.21.15.142:0/1799176914 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d801d070 con 0x558ffdc95360 2023-09-21T13:02:13.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f18d37fe700 1 -- 172.21.15.142:0/1799176914 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18d801e040 con 0x558ffdc95360 2023-09-21T13:02:13.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f18d37fe700 1 -- 172.21.15.142:0/1799176914 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004890 con 0x558ffdc95360 2023-09-21T13:02:13.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 -- 172.21.15.142:0/1799176914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 msgr2=0x558ffdc957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc957c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f18d800b2e0 tx=0x7f18d8005ea0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 -- 172.21.15.142:0/1799176914 shutdown_connections 2023-09-21T13:02:13.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc957c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc909f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 --2- 172.21.15.142:0/1799176914 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 -- 172.21.15.142:0/1799176914 >> 172.21.15.142:0/1799176914 conn(0x558ffdbbd000 msgr2=0x558ffdc8b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 -- 172.21.15.142:0/1799176914 shutdown_connections 2023-09-21T13:02:13.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.615+0000 7f190313cb80 1 -- 172.21.15.142:0/1799176914 wait complete. 2023-09-21T13:02:13.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.616+0000 7f190313cb80 1 -- start start 2023-09-21T13:02:13.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.616+0000 7f190313cb80 1 Processor -- start 2023-09-21T13:02:13.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc99d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc95360 0x558ffdc9a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdbe1e80 con 0x558ffdc95360 2023-09-21T13:02:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdb7e740 con 0x558ffdc90f30 2023-09-21T13:02:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdb7e3e0 con 0x558ffdc90610 2023-09-21T13:02:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f190313cb80 10 client.0 _ll_register_callbacks cb 0x558ffdac8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:13.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33926/0 (socket says 172.21.15.142:33926) 2023-09-21T13:02:13.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 -- 172.21.15.142:0/451746979 learned_addr learned my addr 172.21.15.142:0/451746979 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18edd9c700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc95360 0x558ffdc9a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.628 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc99d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 -- 172.21.15.142:0/451746979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 msgr2=0x558ffdc99d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc99d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 -- 172.21.15.142:0/451746979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc95360 msgr2=0x558ffdc9a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc95360 0x558ffdc9a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.617+0000 7f18ed59b700 1 -- 172.21.15.142:0/451746979 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e0009930 con 0x558ffdc90610 2023-09-21T13:02:13.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18ed59b700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c6f0 tx=0x7f18e40cf910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ce4f38c22d0c269 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:13.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e409d350 con 0x558ffdc90610 2023-09-21T13:02:13.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18e4099df0 con 0x558ffdc90610 2023-09-21T13:02:13.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ffdb52bb0 con 0x558ffdc90610 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18e40994c0 con 0x558ffdc90610 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 10 client.27097 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x7f18e8114ae0 con 0x558ffdc90610 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558ffdb52bb0 con 0x558ffdc90610 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f18e4098be0 con 0x558ffdc90610 2023-09-21T13:02:13.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 10 client.27097 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 10 client.27097 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:02:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.618+0000 7f190313cb80 20 client.27097 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcaa400 0x558ffdcac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f190313cb80 4 client.27097 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:13.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ffdc5f020 con 0x558ffdcaa400 2023-09-21T13:02:13.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcaa400 0x558ffdcac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcaa400 0x558ffdcac7f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aad772ce220955fa server_cookie=74728896c5028057 in_seq=0 out_seq=0 2023-09-21T13:02:13.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.619+0000 7f18d0ff9700 10 client.27097 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:02:13.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f18d0ff9700 1 -- 172.21.15.142:0/451746979 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558ffdc5f020 con 0x558ffdcaa400 2023-09-21T13:02:13.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f18d0ff9700 10 client.27097 handle_command_reply: tid=0 2023-09-21T13:02:13.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 client.27097 shutdown 2023-09-21T13:02:13.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 msgr2=0x558ffdc9cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c6f0 tx=0x7f18e40cf910 comp rx=0 tx=0).stop 2023-09-21T13:02:13.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 shutdown_connections 2023-09-21T13:02:13.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcaa400 0x558ffdcac7f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc95360 0x558ffdc9a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f18d0ff9700 0 client.27097 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:02:13.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc90610 0x558ffdc9cb70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 --2- 172.21.15.142:0/451746979 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc99d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 >> 172.21.15.142:0/451746979 conn(0x558ffdbbd000 msgr2=0x558ffdc8b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.620+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 shutdown_connections 2023-09-21T13:02:13.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.621+0000 7f190313cb80 1 -- 172.21.15.142:0/451746979 wait complete. 2023-09-21T13:02:13.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.621+0000 7f190313cb80 20 client.27097 trim_cache size 0 max 16384 2023-09-21T13:02:13.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 Processor -- start 2023-09-21T13:02:13.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 -- start start 2023-09-21T13:02:13.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc9c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc94a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffda62920 con 0x558ffdc90f30 2023-09-21T13:02:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdc83110 con 0x558ffdc90610 2023-09-21T13:02:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.634+0000 7f190313cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdcaa1d0 con 0x558ffdc95360 2023-09-21T13:02:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50368/0 (socket says 172.21.15.142:50368) 2023-09-21T13:02:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 -- 172.21.15.142:0/2328507892 learned_addr learned my addr 172.21.15.142:0/2328507892 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ed59b700 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc9c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18edd9c700 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc94a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 -- 172.21.15.142:0/2328507892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 msgr2=0x558ffdc94a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc94a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 -- 172.21.15.142:0/2328507892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 msgr2=0x558ffdc9c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc9c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 -- 172.21.15.142:0/2328507892 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ffd9f5c60 con 0x558ffdc90f30 2023-09-21T13:02:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009990 tx=0x7f18d800b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6ccf43b986862d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18d3fff700 1 -- 172.21.15.142:0/2328507892 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8031040 con 0x558ffdc90f30 2023-09-21T13:02:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18d3fff700 1 -- 172.21.15.142:0/2328507892 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18d8005bc0 con 0x558ffdc90f30 2023-09-21T13:02:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.635+0000 7f18d3fff700 1 -- 172.21.15.142:0/2328507892 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d801d040 con 0x558ffdc90f30 2023-09-21T13:02:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- 172.21.15.142:0/2328507892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 msgr2=0x558ffdc94500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009990 tx=0x7f18d800b630 comp rx=0 tx=0).stop 2023-09-21T13:02:13.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- 172.21.15.142:0/2328507892 shutdown_connections 2023-09-21T13:02:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdc94a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90610 0x558ffdc9c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 --2- 172.21.15.142:0/2328507892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90f30 0x558ffdc94500 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- 172.21.15.142:0/2328507892 >> 172.21.15.142:0/2328507892 conn(0x558ffdbbd000 msgr2=0x558ffdca65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- 172.21.15.142:0/2328507892 shutdown_connections 2023-09-21T13:02:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- 172.21.15.142:0/2328507892 wait complete. 2023-09-21T13:02:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.636+0000 7f190313cb80 1 -- start start 2023-09-21T13:02:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 Processor -- start 2023-09-21T13:02:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc9fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdcfd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdca0340 con 0x558ffdc90610 2023-09-21T13:02:13.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdcfd790 con 0x558ffdc90f30 2023-09-21T13:02:13.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ffdcfd950 con 0x558ffdc95360 2023-09-21T13:02:13.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f190313cb80 10 client.0 _ll_register_callbacks cb 0x558ffdac8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.637+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50382/0 (socket says 172.21.15.142:50382) 2023-09-21T13:02:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 -- 172.21.15.142:0/1362058267 learned_addr learned my addr 172.21.15.142:0/1362058267 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc9fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18edd9c700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdcfd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 -- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 msgr2=0x558ffdcfd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdcfd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 -- 172.21.15.142:0/1362058267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 msgr2=0x558ffdc9fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc9fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 -- 172.21.15.142:0/1362058267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ffda0cde0 con 0x558ffdc90610 2023-09-21T13:02:13.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18ed59b700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009c10 tx=0x7f18e40a13f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1df1e4676ff4576 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:13.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40994c0 con 0x558ffdc90610 2023-09-21T13:02:13.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f18e40a1530 con 0x558ffdc90610 2023-09-21T13:02:13.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ffdbdae60 con 0x558ffdc90610 2023-09-21T13:02:13.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18e4099230 con 0x558ffdc90610 2023-09-21T13:02:13.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f190313cb80 10 client.17049 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:13.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.638+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558ffda33250 con 0x558ffdc90610 2023-09-21T13:02:13.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18e4063080 con 0x558ffdc90610 2023-09-21T13:02:13.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f18e40954e0 con 0x558ffdc90610 2023-09-21T13:02:13.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 10 client.17049 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:13.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 10 client.17049 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:02:13.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 20 client.17049 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:13.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcfeb80 0x558ffdd00f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 4 client.17049 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:02:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558ffdbdab80 con 0x558ffdcfeb80 2023-09-21T13:02:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.639+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcfeb80 0x558ffdd00f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f18ecd9a700 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcfeb80 0x558ffdd00f70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d2e74025ccaf65cf server_cookie=f6946b8839f1be06 in_seq=0 out_seq=0 2023-09-21T13:02:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f18d0ff9700 10 client.17049 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:02:13.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f18d0ff9700 1 -- 172.21.15.142:0/1362058267 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558ffdbdab80 con 0x558ffdcfeb80 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f18d0ff9700 10 client.17049 handle_command_reply: tid=0 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 client.17049 shutdown 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 msgr2=0x558ffdc9f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009c10 tx=0x7f18e40a13f0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 shutdown_connections 2023-09-21T13:02:13.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x558ffdcfeb80 0x558ffdd00f70 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558ffdc90610 0x558ffdc9f660 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558ffdc95360 0x558ffdcfd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f18d0ff9700 0 client.17049 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:02:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 --2- 172.21.15.142:0/1362058267 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558ffdc90f30 0x558ffdc9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 >> 172.21.15.142:0/1362058267 conn(0x558ffdbbd000 msgr2=0x558ffdc94500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 shutdown_connections 2023-09-21T13:02:13.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.640+0000 7f190313cb80 1 -- 172.21.15.142:0/1362058267 wait complete. 2023-09-21T13:02:13.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f190313cb80 20 client.17049 trim_cache size 0 max 16384 2023-09-21T13:02:13.659 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:02:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 msgr2=0x7f18d40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 0x7f18d40a2c70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f18e00104f0 tx=0x7f18e0004750 comp rx=0 tx=0).stop 2023-09-21T13:02:13.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 msgr2=0x7f18e819d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f18e400ef10 tx=0x7f18e400c3a0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 shutdown_connections 2023-09-21T13:02:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f18d40a07b0 0x7f18d40a2c70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f18e8073180 0x7f18e819d570 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f18e8111d40 0x7f18e81a1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 --2- 172.21.15.142:0/1610831152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e8073aa0 0x7f18e819dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 >> 172.21.15.142:0/1610831152 conn(0x7f18e80fc860 msgr2=0x7f18e80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 shutdown_connections 2023-09-21T13:02:13.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.641+0000 7f18ef7ff700 1 -- 172.21.15.142:0/1610831152 wait complete. 2023-09-21T13:02:13.663 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:02:13.691 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.66 MB/sec execute 174 sec latency 6906.783 ms 2023-09-21T13:02:13.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 -- 172.21.15.142:0/3557011106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 msgr2=0x7fc6701013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3557011106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701013a0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fc66c009990 tx=0x7fc66c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 -- 172.21.15.142:0/3557011106 shutdown_connections 2023-09-21T13:02:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3557011106 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701013a0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3557011106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 0x7fc67010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3557011106 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc670101970 0x7fc6701059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 -- 172.21.15.142:0/3557011106 >> 172.21.15.142:0/3557011106 conn(0x7fc6700fc840 msgr2=0x7fc6700fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 -- 172.21.15.142:0/3557011106 shutdown_connections 2023-09-21T13:02:13.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.868+0000 7fc6777ff700 1 -- 172.21.15.142:0/3557011106 wait complete. 2023-09-21T13:02:13.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.869+0000 7fc6777ff700 1 Processor -- start 2023-09-21T13:02:13.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.869+0000 7fc6777ff700 1 -- start start 2023-09-21T13:02:13.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 0x7fc6701995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc67019da40 0x7fc67019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019e4c0 con 0x7fc670100fc0 2023-09-21T13:02:13.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019e630 con 0x7fc67019da40 2023-09-21T13:02:13.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc6777ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67019e7f0 con 0x7fc6701060e0 2023-09-21T13:02:13.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc67559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc67559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50104/0 (socket says 172.21.15.142:50104) 2023-09-21T13:02:13.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc67559b700 1 -- 172.21.15.142:0/3673821254 learned_addr learned my addr 172.21.15.142:0/3673821254 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc674d9a700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 0x7fc6701995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc675d9c700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc67019da40 0x7fc67019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc67559b700 1 -- 172.21.15.142:0/3673821254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 msgr2=0x7fc6701995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.870+0000 7fc67559b700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 0x7fc6701995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc67559b700 1 -- 172.21.15.142:0/3673821254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc67019da40 msgr2=0x7fc67019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc67559b700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc67019da40 0x7fc67019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc67559b700 1 -- 172.21.15.142:0/3673821254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c0095f0 con 0x7fc670100fc0 2023-09-21T13:02:13.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc67559b700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc66c004730 tx=0x7fc66c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc6667fc700 1 -- 172.21.15.142:0/3673821254 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c01d070 con 0x7fc670100fc0 2023-09-21T13:02:13.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc6667fc700 1 -- 172.21.15.142:0/3673821254 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66c005a00 con 0x7fc670100fc0 2023-09-21T13:02:13.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6701a5cf0 con 0x7fc670100fc0 2023-09-21T13:02:13.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc6667fc700 1 -- 172.21.15.142:0/3673821254 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c005300 con 0x7fc670100fc0 2023-09-21T13:02:13.877 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.871+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6701a6160 con 0x7fc670100fc0 2023-09-21T13:02:13.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.875+0000 7fc6667fc700 1 -- 172.21.15.142:0/3673821254 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc66c0049d0 con 0x7fc670100fc0 2023-09-21T13:02:13.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.876+0000 7fc68b085b80 1 Processor -- start 2023-09-21T13:02:13.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.876+0000 7fc68b085b80 1 -- start start 2023-09-21T13:02:13.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 0x55f31550f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315513e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f315514360 0x55f3155147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315483ca0 con 0x55f31550ff30 2023-09-21T13:02:13.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315467c70 con 0x55f315514360 2023-09-21T13:02:13.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc68b085b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315465590 con 0x55f31550f610 2023-09-21T13:02:13.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc6667fc700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 0x7fc65c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 0x55f31550f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 0x55f31550f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57724/0 (socket says 172.21.15.142:57724) 2023-09-21T13:02:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc675d9c700 1 -- 172.21.15.142:0/2467883328 learned_addr learned my addr 172.21.15.142:0/2467883328 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc6667fc700 1 -- 172.21.15.142:0/3673821254 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc66c0ccf10 con 0x7fc670100fc0 2023-09-21T13:02:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.877+0000 7fc67559b700 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315513e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc675d9c700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 0x7fc65c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc674d9a700 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f315514360 0x55f3155147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 -- 172.21.15.142:0/2467883328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 msgr2=0x55f31550f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 0x55f31550f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 -- 172.21.15.142:0/2467883328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f315514360 msgr2=0x55f3155147c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f315514360 0x55f3155147c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 -- 172.21.15.142:0/2467883328 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f31528bde0 con 0x55f31550ff30 2023-09-21T13:02:13.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc67559b700 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315513e20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0ca690 tx=0x7fc66c09a490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763690e597ed1457 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.878+0000 7fc675d9c700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 0x7fc65c0a2cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc668009fd0 tx=0x7fc66800b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.879+0000 7fc65b7fe700 1 -- 172.21.15.142:0/2467883328 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0047d0 con 0x55f31550ff30 2023-09-21T13:02:13.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.879+0000 7fc65b7fe700 1 -- 172.21.15.142:0/2467883328 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66c09a5a0 con 0x55f31550ff30 2023-09-21T13:02:13.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.879+0000 7fc65b7fe700 1 -- 172.21.15.142:0/2467883328 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c099a90 con 0x55f31550ff30 2023-09-21T13:02:13.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 -- 172.21.15.142:0/2467883328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 msgr2=0x55f315513e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315513e20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc66c0ca690 tx=0x7fc66c09a490 comp rx=0 tx=0).stop 2023-09-21T13:02:13.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 -- 172.21.15.142:0/2467883328 shutdown_connections 2023-09-21T13:02:13.886 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f315514360 0x55f3155147c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550f610 0x55f31550f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2467883328 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315513e20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 -- 172.21.15.142:0/2467883328 >> 172.21.15.142:0/2467883328 conn(0x55f31543c000 msgr2=0x55f31550a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 -- 172.21.15.142:0/2467883328 shutdown_connections 2023-09-21T13:02:13.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.880+0000 7fc68b085b80 1 -- 172.21.15.142:0/2467883328 wait complete. 2023-09-21T13:02:13.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.881+0000 7fc68b085b80 1 -- start start 2023-09-21T13:02:13.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.881+0000 7fc68b085b80 1 Processor -- start 2023-09-21T13:02:13.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315518d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f3155192e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315460e80 con 0x55f31550ff30 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3153fd740 con 0x55f31550f610 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3153fd3e0 con 0x55f315514360 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.882+0000 7fc68b085b80 10 client.0 _ll_register_callbacks cb 0x55f315347a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.889 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f3155192e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40818/0 (socket says 172.21.15.142:40818) 2023-09-21T13:02:13.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f3155192e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57736/0 (socket says 172.21.15.142:57736) 2023-09-21T13:02:13.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 -- 172.21.15.142:0/1844926901 learned_addr learned my addr 172.21.15.142:0/1844926901 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.890 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc674d9a700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315518d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 -- 172.21.15.142:0/1844926901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 msgr2=0x55f3155192e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f3155192e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 -- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 msgr2=0x55f315518d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315518d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.891 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.883+0000 7fc67559b700 1 -- 172.21.15.142:0/1844926901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6701a6160 con 0x55f31550f610 2023-09-21T13:02:13.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.884+0000 7fc67559b700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc66c09a2a0 tx=0x7fc66c005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1590989d3a122ff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.884+0000 7fc658ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:13.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.885+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0a2580 con 0x55f31550f610 2023-09-21T13:02:13.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.885+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc66c0b82c0 con 0x55f31550f610 2023-09-21T13:02:13.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.885+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3153d1bb0 con 0x55f31550f610 2023-09-21T13:02:13.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66c0b8480 con 0x55f31550f610 2023-09-21T13:02:13.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc68b085b80 10 client.27155 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:13.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f315274c60 con 0x55f31550f610 2023-09-21T13:02:13.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f3153d1bb0 con 0x55f31550f610 2023-09-21T13:02:13.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc66c005460 con 0x55f31550f610 2023-09-21T13:02:13.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc68b085b80 10 client.27155 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:13.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc68b085b80 10 client.27155 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:02:13.894 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.886+0000 7fc68b085b80 20 client.27155 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:13.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f3155313e0 0x55f315533800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc68b085b80 4 client.27155 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:13.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3154de020 con 0x55f3155313e0 2023-09-21T13:02:13.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc674d9a700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f3155313e0 0x55f315533800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc674d9a700 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f3155313e0 0x55f315533800 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9a7aea758d845077 server_cookie=6dc2dbab70bdfae8 in_seq=0 out_seq=0 2023-09-21T13:02:13.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.887+0000 7fc658ff9700 10 client.27155 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:02:13.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc658ff9700 1 -- 172.21.15.142:0/1844926901 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f3154de020 con 0x55f3155313e0 2023-09-21T13:02:13.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc658ff9700 10 client.27155 handle_command_reply: tid=0 2023-09-21T13:02:13.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 client.27155 shutdown 2023-09-21T13:02:13.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 msgr2=0x55f31551baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fc66c09a2a0 tx=0x7fc66c005c00 comp rx=0 tx=0).stop 2023-09-21T13:02:13.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 shutdown_connections 2023-09-21T13:02:13.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f3155313e0 0x55f315533800 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f3155192e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f31551baa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 --2- 172.21.15.142:0/1844926901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550ff30 0x55f315518d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc658ff9700 0 client.27155 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:02:13.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.888+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 >> 172.21.15.142:0/1844926901 conn(0x55f31543c000 msgr2=0x55f31550a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.889+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 shutdown_connections 2023-09-21T13:02:13.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.889+0000 7fc68b085b80 1 -- 172.21.15.142:0/1844926901 wait complete. 2023-09-21T13:02:13.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.889+0000 7fc68b085b80 20 client.27155 trim_cache size 0 max 16384 2023-09-21T13:02:13.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.902+0000 7fc68b085b80 1 Processor -- start 2023-09-21T13:02:13.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.902+0000 7fc68b085b80 1 -- start start 2023-09-21T13:02:13.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.902+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 0x55f31552db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f31551b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc68b085b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3152e1920 con 0x55f31550f610 2023-09-21T13:02:13.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc68b085b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3155021e0 con 0x55f31550ff30 2023-09-21T13:02:13.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc68b085b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315510670 con 0x55f315514360 2023-09-21T13:02:13.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50136/0 (socket says 172.21.15.142:50136) 2023-09-21T13:02:13.904 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 -- 172.21.15.142:0/2506439663 learned_addr learned my addr 172.21.15.142:0/2506439663 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc674d9a700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 0x55f31552db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc675d9c700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f31551b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 -- 172.21.15.142:0/2506439663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 msgr2=0x55f31551b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f31551b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.905 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 -- 172.21.15.142:0/2506439663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 msgr2=0x55f31552db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 0x55f31552db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 -- 172.21.15.142:0/2506439663 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3152b2250 con 0x55f31550f610 2023-09-21T13:02:13.906 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc674d9a700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 0x55f31552db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:13.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.903+0000 7fc67559b700 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc66c09a530 tx=0x7fc66c0ca740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87db5c5005a7f606 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc65bfff700 1 -- 172.21.15.142:0/2506439663 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0a2350 con 0x55f31550f610 2023-09-21T13:02:13.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc65bfff700 1 -- 172.21.15.142:0/2506439663 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66c0a2580 con 0x55f31550f610 2023-09-21T13:02:13.910 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc65bfff700 1 -- 172.21.15.142:0/2506439663 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0b82c0 con 0x55f31550f610 2023-09-21T13:02:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 -- 172.21.15.142:0/2506439663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 msgr2=0x55f315517fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc66c09a530 tx=0x7fc66c0ca740 comp rx=0 tx=0).stop 2023-09-21T13:02:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 -- 172.21.15.142:0/2506439663 shutdown_connections 2023-09-21T13:02:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f31550f610 0x55f315517fb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.911 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f315514360 0x55f31551b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 --2- 172.21.15.142:0/2506439663 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550ff30 0x55f31552db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.904+0000 7fc68b085b80 1 -- 172.21.15.142:0/2506439663 >> 172.21.15.142:0/2506439663 conn(0x55f31543c000 msgr2=0x55f315514740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.905+0000 7fc68b085b80 1 -- 172.21.15.142:0/2506439663 shutdown_connections 2023-09-21T13:02:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.905+0000 7fc68b085b80 1 -- 172.21.15.142:0/2506439663 wait complete. 2023-09-21T13:02:13.912 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.905+0000 7fc68b085b80 1 -- start start 2023-09-21T13:02:13.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.905+0000 7fc68b085b80 1 Processor -- start 2023-09-21T13:02:13.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f315528440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 0x55f315528980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.913 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315527060 con 0x55f315514360 2023-09-21T13:02:13.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3155271d0 con 0x55f31550f610 2023-09-21T13:02:13.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f315527390 con 0x55f31550ff30 2023-09-21T13:02:13.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc68b085b80 10 client.0 _ll_register_callbacks cb 0x55f315347a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:13.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.914 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 0x55f315528980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc675d9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50146/0 (socket says 172.21.15.142:50146) 2023-09-21T13:02:13.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc675d9c700 1 -- 172.21.15.142:0/3317971752 learned_addr learned my addr 172.21.15.142:0/3317971752 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:13.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc67559b700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f315528440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 -- 172.21.15.142:0/3317971752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 msgr2=0x55f315528440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.915 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f315528440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 -- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 msgr2=0x55f315526a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:13.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc674d9a700 1 -- 172.21.15.142:0/3317971752 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc660009df0 con 0x55f31550ff30 2023-09-21T13:02:13.916 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc67559b700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f315528440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:13.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.906+0000 7fc675d9c700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:13.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc674d9a700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 0x55f315528980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55f3155340e0 tx=0x7fc66001fcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f02a893530aa3c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:13.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc658ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:13.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660004a30 con 0x55f31550ff30 2023-09-21T13:02:13.917 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc66c09a5a0 con 0x55f31550ff30 2023-09-21T13:02:13.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc660004b90 con 0x55f31550ff30 2023-09-21T13:02:13.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc660004d50 con 0x55f31550ff30 2023-09-21T13:02:13.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc68b085b80 10 client.27121 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:13.918 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.907+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f315274c60 con 0x55f31550ff30 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc66c09a5a0 con 0x55f31550ff30 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc660010bd0 con 0x55f31550ff30 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 10 client.27121 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 10 client.27121 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 20 client.27121 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:13.919 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f315586460 0x55f315588880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 4 client.27121 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:02:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f315459e60 con 0x55f315586460 2023-09-21T13:02:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.908+0000 7fc67559b700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f315586460 0x55f315588880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc67559b700 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f315586460 0x55f315588880 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=41515517800ee8e4 server_cookie=1216c40e60e86be6 in_seq=0 out_seq=0 2023-09-21T13:02:13.920 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc658ff9700 10 client.27121 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:02:13.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc658ff9700 1 -- 172.21.15.142:0/3317971752 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f315459e60 con 0x55f315586460 2023-09-21T13:02:13.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc658ff9700 10 client.27121 handle_command_reply: tid=0 2023-09-21T13:02:13.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 client.27121 shutdown 2023-09-21T13:02:13.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 msgr2=0x55f315528980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.921 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 0x55f315528980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55f3155340e0 tx=0x7fc66001fcd0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 shutdown_connections 2023-09-21T13:02:13.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f315514360 0x55f315526a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x55f315586460 0x55f315588880 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f31550f610 0x55f315528440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.922 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc658ff9700 0 client.27121 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:02:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 --2- 172.21.15.142:0/3317971752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f31550ff30 0x55f315528980 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 >> 172.21.15.142:0/3317971752 conn(0x55f31543c000 msgr2=0x55f315513400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 shutdown_connections 2023-09-21T13:02:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 1 -- 172.21.15.142:0/3317971752 wait complete. 2023-09-21T13:02:13.923 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.909+0000 7fc68b085b80 20 client.27121 trim_cache size 0 max 16384 2023-09-21T13:02:13.924 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:02:13.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 msgr2=0x7fc65c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 0x7fc65c0a2cf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc668009fd0 tx=0x7fc66800b040 comp rx=0 tx=0).stop 2023-09-21T13:02:13.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 msgr2=0x7fc6701990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:13.925 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc66c004730 tx=0x7fc66c004760 comp rx=0 tx=0).stop 2023-09-21T13:02:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 shutdown_connections 2023-09-21T13:02:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc65c0a0830 0x7fc65c0a2cf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc670100fc0 0x7fc6701990a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc67019da40 0x7fc67019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.926 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 --2- 172.21.15.142:0/3673821254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6701060e0 0x7fc6701995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:13.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 >> 172.21.15.142:0/3673821254 conn(0x7fc6700fc840 msgr2=0x7fc6700fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:13.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 shutdown_connections 2023-09-21T13:02:13.927 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:13.910+0000 7fc6777ff700 1 -- 172.21.15.142:0/3673821254 wait complete. 2023-09-21T13:02:13.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:13 smithi142 ceph-mon[97663]: pgmap v183: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:13.928 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:13 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/61210566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:02:13.929 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:02:14.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:13 smithi156 ceph-mon[134078]: pgmap v183: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:14.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:13 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/61210566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:02:14.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:13 smithi160 ceph-mon[134450]: pgmap v183: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:14.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:13 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/61210566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:02:14.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3365343672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f4100fa0 msgr2=0x7f40f4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3365343672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f4100fa0 0x7f40f4101380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f40e800b0a0 tx=0x7f40e800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3365343672 shutdown_connections 2023-09-21T13:02:14.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3365343672 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f41060c0 0x7f40f410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3365343672 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f4100fa0 0x7f40f4101380 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3365343672 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f4101950 0x7f40f4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3365343672 >> 172.21.15.142:0/3365343672 conn(0x7f40f40fc860 msgr2=0x7f40f40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3365343672 shutdown_connections 2023-09-21T13:02:14.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.191+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3365343672 wait complete. 2023-09-21T13:02:14.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 Processor -- start 2023-09-21T13:02:14.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 -- start start 2023-09-21T13:02:14.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 0x7f40f41991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f419db80 0x7f40f419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419e600 con 0x7f40f41060c0 2023-09-21T13:02:14.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419e770 con 0x7f40f4100fa0 2023-09-21T13:02:14.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.192+0000 7f40fb1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f419e930 con 0x7f40f419db80 2023-09-21T13:02:14.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50164/0 (socket says 172.21.15.142:50164) 2023-09-21T13:02:14.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 -- 172.21.15.142:0/3245518570 learned_addr learned my addr 172.21.15.142:0/3245518570 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:14.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 0x7f40f41991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f979c700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f419db80 0x7f40f419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 -- 172.21.15.142:0/3245518570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f419db80 msgr2=0x7f40f419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f419db80 0x7f40f419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 -- 172.21.15.142:0/3245518570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 msgr2=0x7f40f41991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 0x7f40f41991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 -- 172.21.15.142:0/3245518570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e8009d00 con 0x7f40f41060c0 2023-09-21T13:02:14.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 0x7f40f41991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:14.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.193+0000 7f40f3fff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f40e000e970 tx=0x7f40e000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.194+0000 7f40f1ffb700 1 -- 172.21.15.142:0/3245518570 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0009790 con 0x7f40f41060c0 2023-09-21T13:02:14.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.194+0000 7f40f1ffb700 1 -- 172.21.15.142:0/3245518570 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e000c7e0 con 0x7f40f41060c0 2023-09-21T13:02:14.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.194+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f41a5e90 con 0x7f40f41060c0 2023-09-21T13:02:14.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.194+0000 7f40f1ffb700 1 -- 172.21.15.142:0/3245518570 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e00054e0 con 0x7f40f41060c0 2023-09-21T13:02:14.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.194+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f41a6310 con 0x7f40f41060c0 2023-09-21T13:02:14.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.198+0000 7f40f1ffb700 1 -- 172.21.15.142:0/3245518570 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f40e000c950 con 0x7f40f41060c0 2023-09-21T13:02:14.200 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.199+0000 7f410ec07b80 1 Processor -- start 2023-09-21T13:02:14.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.199+0000 7f410ec07b80 1 -- start start 2023-09-21T13:02:14.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.201 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6662ca0 con 0x55f9b66ee610 2023-09-21T13:02:14.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6646c70 con 0x55f9b66f3360 2023-09-21T13:02:14.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f410ec07b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b6644590 con 0x55f9b66eef30 2023-09-21T13:02:14.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f1ffb700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 0x7f40e40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.202 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f979c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57790/0 (socket says 172.21.15.142:57790) 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f979c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50166/0 (socket says 172.21.15.142:50166) 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 -- 172.21.15.142:0/2080557523 learned_addr learned my addr 172.21.15.142:0/2080557523 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f3fff700 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.203 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 -- 172.21.15.142:0/2080557523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 msgr2=0x55f9b66f37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 -- 172.21.15.142:0/2080557523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 msgr2=0x55f9b66ee9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f8f9b700 1 -- 172.21.15.142:0/2080557523 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b646ade0 con 0x55f9b66eef30 2023-09-21T13:02:14.204 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f1ffb700 1 -- 172.21.15.142:0/3245518570 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40e0014070 con 0x7f40f41060c0 2023-09-21T13:02:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.200+0000 7f40f979c700 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.201+0000 7f40f979c700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 0x7f40e40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.201+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f40e8015000 tx=0x7f40e8009c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4e7e8f0b740138b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.201+0000 7f40deffd700 1 -- 172.21.15.142:0/2080557523 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e040 con 0x55f9b66eef30 2023-09-21T13:02:14.205 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.201+0000 7f40deffd700 1 -- 172.21.15.142:0/2080557523 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e8006020 con 0x55f9b66eef30 2023-09-21T13:02:14.206 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.201+0000 7f40deffd700 1 -- 172.21.15.142:0/2080557523 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e801c440 con 0x55f9b66eef30 2023-09-21T13:02:14.209 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- 172.21.15.142:0/2080557523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 msgr2=0x55f9b66f2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f40e8015000 tx=0x7f40e8009c80 comp rx=0 tx=0).stop 2023-09-21T13:02:14.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f40f979c700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 0x7f40e40a2c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0045e0 tx=0x7f40ec014040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- 172.21.15.142:0/2080557523 shutdown_connections 2023-09-21T13:02:14.210 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ee9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 --2- 172.21.15.142:0/2080557523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f2e20 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- 172.21.15.142:0/2080557523 >> 172.21.15.142:0/2080557523 conn(0x55f9b661b000 msgr2=0x55f9b66e96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- 172.21.15.142:0/2080557523 shutdown_connections 2023-09-21T13:02:14.211 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- 172.21.15.142:0/2080557523 wait complete. 2023-09-21T13:02:14.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 -- start start 2023-09-21T13:02:14.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.202+0000 7f410ec07b80 1 Processor -- start 2023-09-21T13:02:14.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66fab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.212 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b663fe80 con 0x55f9b66ee610 2023-09-21T13:02:14.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65dc740 con 0x55f9b66f3360 2023-09-21T13:02:14.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b65dc3e0 con 0x55f9b66eef30 2023-09-21T13:02:14.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f410ec07b80 10 client.0 _ll_register_callbacks cb 0x55f9b6526a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:14.213 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66fab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50176/0 (socket says 172.21.15.142:50176) 2023-09-21T13:02:14.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57794/0 (socket says 172.21.15.142:57794) 2023-09-21T13:02:14.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f8f9b700 1 -- 172.21.15.142:0/4199752237 learned_addr learned my addr 172.21.15.142:0/4199752237 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:14.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.203+0000 7f40f979c700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 -- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 msgr2=0x55f9b66f8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 -- 172.21.15.142:0/4199752237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 msgr2=0x55f9b66fab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66fab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.215 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 -- 172.21.15.142:0/4199752237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f410e4b0 con 0x55f9b66eef30 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40f3fff700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f40e00c9900 tx=0x7f40e00697a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2260bd5b70dcf3dd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e000cc50 con 0x55f9b66eef30 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9b65b0bb0 con 0x55f9b66eef30 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40e0099d60 con 0x55f9b66eef30 2023-09-21T13:02:14.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e00653a0 con 0x55f9b66eef30 2023-09-21T13:02:14.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f410ec07b80 10 client.27133 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:14.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f9b6453c60 con 0x55f9b66eef30 2023-09-21T13:02:14.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.204+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f9b65b0bb0 con 0x55f9b66eef30 2023-09-21T13:02:14.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f40e00840b0 con 0x55f9b66eef30 2023-09-21T13:02:14.217 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 10 client.27133 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:14.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 10 client.27133 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:14.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 20 client.27133 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:14.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b6708340 0x55f9b670a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 4 client.27133 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:14.218 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9b66bd020 con 0x55f9b6708340 2023-09-21T13:02:14.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.205+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b6708340 0x55f9b670a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.206+0000 7f40d3fff700 10 client.27133 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:14.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.206+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b6708340 0x55f9b670a760 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1df19debcba7ca96 server_cookie=f1c5cf709c585227 in_seq=0 out_seq=0 2023-09-21T13:02:14.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f40d3fff700 1 -- 172.21.15.142:0/4199752237 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f9b66bd020 con 0x55f9b6708340 2023-09-21T13:02:14.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f40d3fff700 10 client.27133 handle_command_reply: tid=0 2023-09-21T13:02:14.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 client.27133 shutdown 2023-09-21T13:02:14.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 msgr2=0x55f9b66f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f40e00c9900 tx=0x7f40e00697a0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 shutdown_connections 2023-09-21T13:02:14.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b6708340 0x55f9b670a760 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66fab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f40d3fff700 0 client.27133 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:14.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66f3360 0x55f9b66f8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 --2- 172.21.15.142:0/4199752237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66eef30 0x55f9b66f7dc0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 >> 172.21.15.142:0/4199752237 conn(0x55f9b661b000 msgr2=0x55f9b66e9290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 shutdown_connections 2023-09-21T13:02:14.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 1 -- 172.21.15.142:0/4199752237 wait complete. 2023-09-21T13:02:14.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.207+0000 7f410ec07b80 20 client.27133 trim_cache size 0 max 16384 2023-09-21T13:02:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.220+0000 7f410ec07b80 1 Processor -- start 2023-09-21T13:02:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.220+0000 7f410ec07b80 1 -- start start 2023-09-21T13:02:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.220+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.227 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.220+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66eef30 0x55f9b66f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f410ec07b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b64c0920 con 0x55f9b66ee610 2023-09-21T13:02:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f410ec07b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b66e9ba0 con 0x55f9b66eef30 2023-09-21T13:02:14.228 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f410ec07b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b66f6340 con 0x55f9b66f3360 2023-09-21T13:02:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50178/0 (socket says 172.21.15.142:50178) 2023-09-21T13:02:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 -- 172.21.15.142:0/333451081 learned_addr learned my addr 172.21.15.142:0/333451081 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f979c700 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.229 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f3fff700 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66eef30 0x55f9b66f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 -- 172.21.15.142:0/333451081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 msgr2=0x55f9b66f4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 -- 172.21.15.142:0/333451081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66eef30 msgr2=0x55f9b66f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.230 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66eef30 0x55f9b66f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 -- 172.21.15.142:0/333451081 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9b670f390 con 0x55f9b66ee610 2023-09-21T13:02:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.221+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f40e8003a70 tx=0x7f40e801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02a6bd6c175451b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f40df7fe700 1 -- 172.21.15.142:0/333451081 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e040 con 0x55f9b66ee610 2023-09-21T13:02:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f40df7fe700 1 -- 172.21.15.142:0/333451081 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e800f040 con 0x55f9b66ee610 2023-09-21T13:02:14.231 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f40df7fe700 1 -- 172.21.15.142:0/333451081 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e802d880 con 0x55f9b66ee610 2023-09-21T13:02:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 -- 172.21.15.142:0/333451081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 msgr2=0x55f9b66ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f40e8003a70 tx=0x7f40e801e040 comp rx=0 tx=0).stop 2023-09-21T13:02:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 -- 172.21.15.142:0/333451081 shutdown_connections 2023-09-21T13:02:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66ee610 0x55f9b66ff480 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.232 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 --2- 172.21.15.142:0/333451081 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66eef30 0x55f9b66f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 -- 172.21.15.142:0/333451081 >> 172.21.15.142:0/333451081 conn(0x55f9b661b000 msgr2=0x55f9b66f2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 -- 172.21.15.142:0/333451081 shutdown_connections 2023-09-21T13:02:14.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.222+0000 7f410ec07b80 1 -- 172.21.15.142:0/333451081 wait complete. 2023-09-21T13:02:14.233 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 -- start start 2023-09-21T13:02:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 Processor -- start 2023-09-21T13:02:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66eef30 0x55f9b66f6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.234 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.223+0000 7f410ec07b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b66f8140 con 0x55f9b66eef30 2023-09-21T13:02:14.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f410ec07b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b66f82b0 con 0x55f9b66ee610 2023-09-21T13:02:14.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f410ec07b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9b66f7010 con 0x55f9b66f3360 2023-09-21T13:02:14.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f410ec07b80 10 client.0 _ll_register_callbacks cb 0x55f9b6526a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:14.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66eef30 0x55f9b66f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.235 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f979c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40882/0 (socket says 172.21.15.142:40882) 2023-09-21T13:02:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 -- 172.21.15.142:0/1540305220 learned_addr learned my addr 172.21.15.142:0/1540305220 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 -- 172.21.15.142:0/1540305220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 msgr2=0x55f9b66f6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.236 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 -- 172.21.15.142:0/1540305220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66eef30 msgr2=0x55f9b66f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66eef30 0x55f9b66f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 -- 172.21.15.142:0/1540305220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9b646ade0 con 0x55f9b66ee610 2023-09-21T13:02:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40f8f9b700 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40e8003a40 tx=0x7f40e80079d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b87fa525a66af96d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:14.237 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.224+0000 7f40d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:14.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e800e040 con 0x55f9b66ee610 2023-09-21T13:02:14.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f40e8006020 con 0x55f9b66ee610 2023-09-21T13:02:14.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f40e802a070 con 0x55f9b66ee610 2023-09-21T13:02:14.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40e802d550 con 0x55f9b66ee610 2023-09-21T13:02:14.238 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 10 client.27179 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55f9b6491250 con 0x55f9b66ee610 2023-09-21T13:02:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40e8044020 con 0x55f9b66ee610 2023-09-21T13:02:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f40e8019070 con 0x55f9b66ee610 2023-09-21T13:02:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 10 client.27179 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:14.239 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 10 client.27179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 20 client.27179 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b675cfa0 0x55f9b675f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 4 client.27179 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:02:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.225+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f9b6638e60 con 0x55f9b675cfa0 2023-09-21T13:02:14.240 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40f3fff700 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b675cfa0 0x55f9b675f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40f3fff700 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b675cfa0 0x55f9b675f3c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfc3c2a11b31b914 server_cookie=5c196de72298a07d in_seq=0 out_seq=0 2023-09-21T13:02:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40d3fff700 10 client.27179 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40d3fff700 1 -- 172.21.15.142:0/1540305220 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f9b6638e60 con 0x55f9b675cfa0 2023-09-21T13:02:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40d3fff700 10 client.27179 handle_command_reply: tid=0 2023-09-21T13:02:14.241 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 client.27179 shutdown 2023-09-21T13:02:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 msgr2=0x55f9b66f7a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f40e8003a40 tx=0x7f40e80079d0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 shutdown_connections 2023-09-21T13:02:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f9b675cfa0 0x55f9b675f3c0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.242 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f9b66f3360 0x55f9b66f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f9b66ee610 0x55f9b66f7a00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 --2- 172.21.15.142:0/1540305220 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f9b66eef30 0x55f9b66f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f40d3fff700 0 client.27179 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:14.243 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.226+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 >> 172.21.15.142:0/1540305220 conn(0x55f9b661b000 msgr2=0x55f9b66f2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 shutdown_connections 2023-09-21T13:02:14.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f410ec07b80 1 -- 172.21.15.142:0/1540305220 wait complete. 2023-09-21T13:02:14.244 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f410ec07b80 20 client.27179 trim_cache size 0 max 16384 2023-09-21T13:02:14.244 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:02:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 msgr2=0x7f40e40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 0x7f40e40a2c70 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f40ec0045e0 tx=0x7f40ec014040 comp rx=0 tx=0).stop 2023-09-21T13:02:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 msgr2=0x7f40f4199720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:14.246 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f40e000e970 tx=0x7f40e000ec80 comp rx=0 tx=0).stop 2023-09-21T13:02:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 shutdown_connections 2023-09-21T13:02:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f40e40a07b0 0x7f40e40a2c70 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40f419db80 0x7f40f419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f40f4100fa0 0x7f40f41991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.247 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 --2- 172.21.15.142:0/3245518570 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f40f41060c0 0x7f40f4199720 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:14.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 >> 172.21.15.142:0/3245518570 conn(0x7f40f40fc860 msgr2=0x7f40f410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:14.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.227+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 shutdown_connections 2023-09-21T13:02:14.248 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:14.228+0000 7f40fb1ff700 1 -- 172.21.15.142:0/3245518570 wait complete. 2023-09-21T13:02:14.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 529902 8.61 MB/sec execute 175 sec latency 7906.899 ms 2023-09-21T13:02:15.249 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-21T13:02:15.250 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-21T13:02:15.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 -- 172.21.15.142:0/2024649615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f564010b340 msgr2=0x7f564010d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 --2- 172.21.15.142:0/2024649615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f564010b340 0x7f564010d7c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f563800b0a0 tx=0x7f563800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 -- 172.21.15.142:0/2024649615 shutdown_connections 2023-09-21T13:02:15.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 --2- 172.21.15.142:0/2024649615 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5640101f70 0x7f5640102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 --2- 172.21.15.142:0/2024649615 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f564010b340 0x7f564010d7c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 --2- 172.21.15.142:0/2024649615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640102890 0x7f564010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 -- 172.21.15.142:0/2024649615 >> 172.21.15.142:0/2024649615 conn(0x7f56400fb730 msgr2=0x7f56400fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 -- 172.21.15.142:0/2024649615 shutdown_connections 2023-09-21T13:02:15.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.464+0000 7f56459ff700 1 -- 172.21.15.142:0/2024649615 wait complete. 2023-09-21T13:02:15.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.465+0000 7f56459ff700 1 Processor -- start 2023-09-21T13:02:15.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.465+0000 7f56459ff700 1 -- start start 2023-09-21T13:02:15.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640101f70 0x7f56400ffbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f564010b340 0x7f56401a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5640100930 con 0x7f564010b340 2023-09-21T13:02:15.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56401a5650 con 0x7f5640102890 2023-09-21T13:02:15.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f56459ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56401a5790 con 0x7f5640101f70 2023-09-21T13:02:15.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f564010b340 0x7f56401a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f563effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640101f70 0x7f56400ffbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40912/0 (socket says 172.21.15.142:40912) 2023-09-21T13:02:15.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 -- 172.21.15.142:0/205407816 learned_addr learned my addr 172.21.15.142:0/205407816 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 -- 172.21.15.142:0/205407816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640101f70 msgr2=0x7f56400ffbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640101f70 0x7f56400ffbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 -- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f564010b340 msgr2=0x7f56401a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f564010b340 0x7f56401a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.466+0000 7f5637fff700 1 -- 172.21.15.142:0/205407816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5638009d00 con 0x7f5640102890 2023-09-21T13:02:15.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f5637fff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f562800e9a0 tx=0x7f562800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f56449fd700 1 -- 172.21.15.142:0/205407816 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628009790 con 0x7f5640102890 2023-09-21T13:02:15.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56401a59f0 con 0x7f5640102890 2023-09-21T13:02:15.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f56449fd700 1 -- 172.21.15.142:0/205407816 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5628010430 con 0x7f5640102890 2023-09-21T13:02:15.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f56449fd700 1 -- 172.21.15.142:0/205407816 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5628018680 con 0x7f5640102890 2023-09-21T13:02:15.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.467+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56401a5f20 con 0x7f5640102890 2023-09-21T13:02:15.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.471+0000 7f56449fd700 1 -- 172.21.15.142:0/205407816 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f56280105a0 con 0x7f5640102890 2023-09-21T13:02:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.471+0000 7f5659355b80 1 Processor -- start 2023-09-21T13:02:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 -- start start 2023-09-21T13:02:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439690 0x555c71439a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439fb0 0x555c7143dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f56449fd700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 0x7f562c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c713add20 con 0x555c7143e3e0 2023-09-21T13:02:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71391cf0 con 0x555c71439fb0 2023-09-21T13:02:15.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.472+0000 7f5659355b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7138f610 con 0x555c71439690 2023-09-21T13:02:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f56449fd700 1 -- 172.21.15.142:0/205407816 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5628014070 con 0x7f5640102890 2023-09-21T13:02:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439690 0x555c71439a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f5637fff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 0x7f562c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50230/0 (socket says 172.21.15.142:50230) 2023-09-21T13:02:15.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 -- 172.21.15.142:0/1811327414 learned_addr learned my addr 172.21.15.142:0/1811327414 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563effd700 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439fb0 0x555c7143dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 -- 172.21.15.142:0/1811327414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439690 msgr2=0x555c71439a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439690 0x555c71439a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 -- 172.21.15.142:0/1811327414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439fb0 msgr2=0x555c7143dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439fb0 0x555c7143dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f5637fff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 0x7f562c0a2c70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5628095a50 tx=0x7f5628095890 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 -- 172.21.15.142:0/1811327414 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c711b5e60 con 0x555c7143e3e0 2023-09-21T13:02:15.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.473+0000 7f563f7fe700 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5638008ff0 tx=0x7f563800b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4531369aaf2c25bb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5635ffb700 1 -- 172.21.15.142:0/1811327414 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563800e040 con 0x555c7143e3e0 2023-09-21T13:02:15.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5635ffb700 1 -- 172.21.15.142:0/1811327414 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f563800bcb0 con 0x555c7143e3e0 2023-09-21T13:02:15.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5635ffb700 1 -- 172.21.15.142:0/1811327414 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563801e460 con 0x555c7143e3e0 2023-09-21T13:02:15.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 -- 172.21.15.142:0/1811327414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 msgr2=0x555c7143e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5638008ff0 tx=0x7f563800b720 comp rx=0 tx=0).stop 2023-09-21T13:02:15.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 -- 172.21.15.142:0/1811327414 shutdown_connections 2023-09-21T13:02:15.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c7143e840 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439690 0x555c71439a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.474+0000 7f5659355b80 1 --2- 172.21.15.142:0/1811327414 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439fb0 0x555c7143dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.475+0000 7f5659355b80 1 -- 172.21.15.142:0/1811327414 >> 172.21.15.142:0/1811327414 conn(0x555c71366080 msgr2=0x555c71434720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.475+0000 7f5659355b80 1 -- 172.21.15.142:0/1811327414 shutdown_connections 2023-09-21T13:02:15.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.475+0000 7f5659355b80 1 -- 172.21.15.142:0/1811327414 wait complete. 2023-09-21T13:02:15.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.475+0000 7f5659355b80 1 -- start start 2023-09-21T13:02:15.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.475+0000 7f5659355b80 1 Processor -- start 2023-09-21T13:02:15.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c71442eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c71443930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7138af00 con 0x555c7143e3e0 2023-09-21T13:02:15.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c713277c0 con 0x555c71439690 2023-09-21T13:02:15.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71327460 con 0x555c71439fb0 2023-09-21T13:02:15.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f5659355b80 10 client.0 _ll_register_callbacks cb 0x555c71271b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:15.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c71442eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f563effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c71443930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f563effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57836/0 (socket says 172.21.15.142:57836) 2023-09-21T13:02:15.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.476+0000 7f563effd700 1 -- 172.21.15.142:0/4272097401 learned_addr learned my addr 172.21.15.142:0/4272097401 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 -- 172.21.15.142:0/4272097401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 msgr2=0x555c714433f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 -- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 msgr2=0x555c71442eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c71442eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 -- 172.21.15.142:0/4272097401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564010e480 con 0x555c7143e3e0 2023-09-21T13:02:15.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563effd700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:15.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f563f7fe700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c71443930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5638009610 tx=0x7f56380099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2166c3ad3f15c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f561effd700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638026030 con 0x555c7143e3e0 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c712fbc30 con 0x555c7143e3e0 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5638027070 con 0x555c7143e3e0 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f563800e070 con 0x555c7143e3e0 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f5659355b80 10 client.17097 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:15.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.477+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555c7119ece0 con 0x555c7143e3e0 2023-09-21T13:02:15.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555c712fbc30 con 0x555c7143e3e0 2023-09-21T13:02:15.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5638019050 con 0x555c7143e3e0 2023-09-21T13:02:15.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 10 client.17097 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:15.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 10 client.17097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:15.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 20 client.17097 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:15.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c71452f80 0x555c71455370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 4 client.17097 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:15.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c714080a0 con 0x555c71452f80 2023-09-21T13:02:15.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.478+0000 7f563effd700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c71452f80 0x555c71455370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.479+0000 7f561effd700 10 client.17097 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.479+0000 7f563effd700 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c71452f80 0x555c71455370 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aed89347ddfb2b5a server_cookie=733e8339cd3a5b39 in_seq=0 out_seq=0 2023-09-21T13:02:15.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.479+0000 7f561effd700 1 -- 172.21.15.142:0/4272097401 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c714080a0 con 0x555c71452f80 2023-09-21T13:02:15.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.479+0000 7f561effd700 10 client.17097 handle_command_reply: tid=0 2023-09-21T13:02:15.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 client.17097 shutdown 2023-09-21T13:02:15.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 msgr2=0x555c71443930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c71443930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5638009610 tx=0x7f56380099e0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 shutdown_connections 2023-09-21T13:02:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c71452f80 0x555c71455370 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c7143e3e0 0x555c71443930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c71442eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f561effd700 0 client.17097 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 --2- 172.21.15.142:0/4272097401 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c714433f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 >> 172.21.15.142:0/4272097401 conn(0x555c71366080 msgr2=0x555c71434310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 shutdown_connections 2023-09-21T13:02:15.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 1 -- 172.21.15.142:0/4272097401 wait complete. 2023-09-21T13:02:15.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.480+0000 7f5659355b80 20 client.17097 trim_cache size 0 max 16384 2023-09-21T13:02:15.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.497+0000 7f5659355b80 1 Processor -- start 2023-09-21T13:02:15.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.497+0000 7f5659355b80 1 -- start start 2023-09-21T13:02:15.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439690 0x555c7143bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 0x555c71438ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7120b9a0 con 0x555c71439690 2023-09-21T13:02:15.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71435d50 con 0x555c7143e3e0 2023-09-21T13:02:15.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f5659355b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c7143a6f0 con 0x555c71439fb0 2023-09-21T13:02:15.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439690 0x555c7143bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57844/0 (socket says 172.21.15.142:57844) 2023-09-21T13:02:15.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 -- 172.21.15.142:0/2332868378 learned_addr learned my addr 172.21.15.142:0/2332868378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563f7fe700 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 0x555c71438ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 -- 172.21.15.142:0/2332868378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 msgr2=0x555c71438ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 0x555c71438ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 -- 172.21.15.142:0/2332868378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439690 msgr2=0x555c7143bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439690 0x555c7143bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 -- 172.21.15.142:0/2332868378 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c71459f70 con 0x555c71439fb0 2023-09-21T13:02:15.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563f7fe700 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 0x555c71438ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:02:15.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.498+0000 7f563effd700 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x555c71444560 tx=0x7f5630009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b288946f823add server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f56367fc700 1 -- 172.21.15.142:0/2332868378 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630004420 con 0x555c71439fb0 2023-09-21T13:02:15.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f56367fc700 1 -- 172.21.15.142:0/2332868378 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5630023030 con 0x555c71439fb0 2023-09-21T13:02:15.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f56367fc700 1 -- 172.21.15.142:0/2332868378 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630010a50 con 0x555c71439fb0 2023-09-21T13:02:15.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 -- 172.21.15.142:0/2332868378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 msgr2=0x555c7143dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x555c71444560 tx=0x7f5630009fd0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 -- 172.21.15.142:0/2332868378 shutdown_connections 2023-09-21T13:02:15.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439690 0x555c7143bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c7143e3e0 0x555c71438ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 --2- 172.21.15.142:0/2332868378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c71439fb0 0x555c7143dcf0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 -- 172.21.15.142:0/2332868378 >> 172.21.15.142:0/2332868378 conn(0x555c71366080 msgr2=0x555c71438490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.499+0000 7f5659355b80 1 -- 172.21.15.142:0/2332868378 shutdown_connections 2023-09-21T13:02:15.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.500+0000 7f5659355b80 1 -- 172.21.15.142:0/2332868378 wait complete. 2023-09-21T13:02:15.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.500+0000 7f5659355b80 1 -- start start 2023-09-21T13:02:15.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.500+0000 7f5659355b80 1 Processor -- start 2023-09-21T13:02:15.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c714a1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439fb0 0x555c714a1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71449a20 con 0x555c71439fb0 2023-09-21T13:02:15.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71449b90 con 0x555c71439690 2023-09-21T13:02:15.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c71449d50 con 0x555c7143e3e0 2023-09-21T13:02:15.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f5659355b80 10 client.0 _ll_register_callbacks cb 0x555c71271b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:15.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57858/0 (socket says 172.21.15.142:57858) 2023-09-21T13:02:15.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 -- 172.21.15.142:0/183901963 learned_addr learned my addr 172.21.15.142:0/183901963 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439fb0 0x555c714a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c714a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 -- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 msgr2=0x555c714a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c714a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 -- 172.21.15.142:0/183901963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439fb0 msgr2=0x555c714a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439fb0 0x555c714a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.501+0000 7f563f7fe700 1 -- 172.21.15.142:0/183901963 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5630009e40 con 0x555c7143e3e0 2023-09-21T13:02:15.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f563f7fe700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f563801ee10 tx=0x7f5638008df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06d2c70fd4fbfe3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:15.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5638026040 con 0x555c7143e3e0 2023-09-21T13:02:15.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f563800bcb0 con 0x555c7143e3e0 2023-09-21T13:02:15.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f563800bab0 con 0x555c7143e3e0 2023-09-21T13:02:15.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f563800e040 con 0x555c7143e3e0 2023-09-21T13:02:15.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f5659355b80 10 client.27157 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:15.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x555c711dc2d0 con 0x555c7143e3e0 2023-09-21T13:02:15.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f563800bcb0 con 0x555c7143e3e0 2023-09-21T13:02:15.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.502+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f563800b420 con 0x555c7143e3e0 2023-09-21T13:02:15.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 10 client.27157 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:15.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 10 client.27157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:15.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 20 client.27157 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:15.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c714a8d50 0x555c714ab170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 4 client.27157 mds_command: new command op to 24578 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-21T13:02:15.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x555c71383ee0 con 0x555c714a8d50 2023-09-21T13:02:15.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.503+0000 7f563effd700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c714a8d50 0x555c714ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.504+0000 7f561effd700 10 client.27157 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.504+0000 7f563effd700 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c714a8d50 0x555c714ab170 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c101863592462e3 server_cookie=23895d1710585566 in_seq=0 out_seq=0 2023-09-21T13:02:15.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.504+0000 7f561effd700 1 -- 172.21.15.142:0/183901963 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555c71383ee0 con 0x555c714a8d50 2023-09-21T13:02:15.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.504+0000 7f561effd700 10 client.27157 handle_command_reply: tid=0 2023-09-21T13:02:15.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.504+0000 7f5659355b80 1 client.27157 shutdown 2023-09-21T13:02:15.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 msgr2=0x555c71449400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f563801ee10 tx=0x7f5638008df0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 shutdown_connections 2023-09-21T13:02:15.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555c714a8d50 0x555c714ab170 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555c7143e3e0 0x555c71449400 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555c71439690 0x555c714a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.518 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f561effd700 0 client.27157 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 --2- 172.21.15.142:0/183901963 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555c71439fb0 0x555c714a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 >> 172.21.15.142:0/183901963 conn(0x555c71366080 msgr2=0x555c7143db60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 shutdown_connections 2023-09-21T13:02:15.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 1 -- 172.21.15.142:0/183901963 wait complete. 2023-09-21T13:02:15.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f5659355b80 20 client.27157 trim_cache size 0 max 16384 2023-09-21T13:02:15.520 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:02:15.520 INFO:teuthology.orchestra.run.smithi142.stdout: "return_code": 0, 2023-09-21T13:02:15.520 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:02:15.520 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": "asynchronous" 2023-09-21T13:02:15.521 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:02:15.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 msgr2=0x7f562c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.505+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 0x7f562c0a2c70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5628095a50 tx=0x7f5628095890 comp rx=0 tx=0).stop 2023-09-21T13:02:15.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 msgr2=0x7f5640100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f562800e9a0 tx=0x7f562800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 shutdown_connections 2023-09-21T13:02:15.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f562c0a07b0 0x7f562c0a2c70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f564010b340 0x7f56401a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5640101f70 0x7f56400ffbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 --2- 172.21.15.142:0/205407816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5640102890 0x7f5640100100 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 >> 172.21.15.142:0/205407816 conn(0x7f56400fb730 msgr2=0x7f564010d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 shutdown_connections 2023-09-21T13:02:15.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.506+0000 7f56459ff700 1 -- 172.21.15.142:0/205407816 wait complete. 2023-09-21T13:02:15.525 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:02:15.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 530190 8.57 MB/sec execute 176 sec latency 8775.477 ms 2023-09-21T13:02:15.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.774+0000 7f714b59e700 1 -- 172.21.15.142:0/2057947719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073aa0 msgr2=0x7f714c1116a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.774+0000 7f714b59e700 1 --2- 172.21.15.142:0/2057947719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073aa0 0x7f714c1116a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7140009990 tx=0x7f7140009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 -- 172.21.15.142:0/2057947719 shutdown_connections 2023-09-21T13:02:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 --2- 172.21.15.142:0/2057947719 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073180 0x7f714c073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 --2- 172.21.15.142:0/2057947719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c113fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 --2- 172.21.15.142:0/2057947719 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073aa0 0x7f714c1116a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 -- 172.21.15.142:0/2057947719 >> 172.21.15.142:0/2057947719 conn(0x7f714c0fc6c0 msgr2=0x7f714c0feae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 -- 172.21.15.142:0/2057947719 shutdown_connections 2023-09-21T13:02:15.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.775+0000 7f714b59e700 1 -- 172.21.15.142:0/2057947719 wait complete. 2023-09-21T13:02:15.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.776+0000 7f714b59e700 1 Processor -- start 2023-09-21T13:02:15.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.776+0000 7f714b59e700 1 -- start start 2023-09-21T13:02:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 0x7f714c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c1a1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1a2230 con 0x7f714c073aa0 2023-09-21T13:02:15.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1a23a0 con 0x7f714c073180 2023-09-21T13:02:15.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714b59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c1a2560 con 0x7f714c111be0 2023-09-21T13:02:15.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c1a1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40960/0 (socket says 172.21.15.142:40960) 2023-09-21T13:02:15.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 -- 172.21.15.142:0/4265528417 learned_addr learned my addr 172.21.15.142:0/4265528417 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f7149d9b700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 0x7f714c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 -- 172.21.15.142:0/4265528417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 msgr2=0x7f714c1a1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c1a1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 -- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 msgr2=0x7f714c19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 0x7f714c19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714a59c700 1 -- 172.21.15.142:0/4265528417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71400095f0 con 0x7f714c073180 2023-09-21T13:02:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f7149d9b700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 0x7f714c19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:15.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.777+0000 7f714ad9d700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c1a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:15.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f714a59c700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f713c00e9a0 tx=0x7f713c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f713b7fe700 1 -- 172.21.15.142:0/4265528417 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c009790 con 0x7f714c073180 2023-09-21T13:02:15.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c1a2840 con 0x7f714c073180 2023-09-21T13:02:15.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f713b7fe700 1 -- 172.21.15.142:0/4265528417 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f713c00cbd0 con 0x7f714c073180 2023-09-21T13:02:15.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f713b7fe700 1 -- 172.21.15.142:0/4265528417 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c018680 con 0x7f714c073180 2023-09-21T13:02:15.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.778+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c1aa080 con 0x7f714c073180 2023-09-21T13:02:15.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.782+0000 7f713b7fe700 1 -- 172.21.15.142:0/4265528417 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f713c00cd40 con 0x7f714c073180 2023-09-21T13:02:15.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.783+0000 7f71648d6b80 1 Processor -- start 2023-09-21T13:02:15.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.783+0000 7f713b7fe700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 0x7f71340a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.783+0000 7f71648d6b80 1 -- start start 2023-09-21T13:02:15.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.783+0000 7f713b7fe700 1 -- 172.21.15.142:0/4265528417 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f713c014070 con 0x7f714c073180 2023-09-21T13:02:15.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.783+0000 7f714ad9d700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 0x7f71340a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x5622331cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 0x5622331cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56223313fca0 con 0x5622331d1ce0 2023-09-21T13:02:15.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562233123c70 con 0x5622331d13c0 2023-09-21T13:02:15.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f71648d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562233121590 con 0x5622331cbbb0 2023-09-21T13:02:15.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40966/0 (socket says 172.21.15.142:40966) 2023-09-21T13:02:15.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 -- 172.21.15.142:0/2526469515 learned_addr learned my addr 172.21.15.142:0/2526469515 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f7149d9b700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x5622331cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714ad9d700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 0x5622331cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 -- 172.21.15.142:0/2526469515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 msgr2=0x5622331cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 0x5622331cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 -- 172.21.15.142:0/2526469515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 msgr2=0x5622331cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x5622331cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714a59c700 1 -- 172.21.15.142:0/2526469515 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562232f47de0 con 0x5622331d13c0 2023-09-21T13:02:15.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f714ad9d700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 0x5622331cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.784+0000 7f7149d9b700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x5622331cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.785+0000 7f714ad9d700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 0x7f71340a2d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714c06a240 tx=0x7f714400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.785+0000 7f714a59c700 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f713c095bb0 tx=0x7f713c0995b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56cadc02e57998 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.785+0000 7f7138ff9700 1 -- 172.21.15.142:0/2526469515 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c09d4e0 con 0x5622331d13c0 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.785+0000 7f7138ff9700 1 -- 172.21.15.142:0/2526469515 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f713c0a1720 con 0x5622331d13c0 2023-09-21T13:02:15.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.785+0000 7f7138ff9700 1 -- 172.21.15.142:0/2526469515 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a1290 con 0x5622331d13c0 2023-09-21T13:02:15.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 -- 172.21.15.142:0/2526469515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 msgr2=0x5622331d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f713c095bb0 tx=0x7f713c0995b0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 -- 172.21.15.142:0/2526469515 shutdown_connections 2023-09-21T13:02:15.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331cbbb0 0x5622331cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d13c0 0x5622331d17a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2526469515 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x5622331cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 -- 172.21.15.142:0/2526469515 >> 172.21.15.142:0/2526469515 conn(0x5622330f8000 msgr2=0x5622331c6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 -- 172.21.15.142:0/2526469515 shutdown_connections 2023-09-21T13:02:15.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.786+0000 7f71648d6b80 1 -- 172.21.15.142:0/2526469515 wait complete. 2023-09-21T13:02:15.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.787+0000 7f71648d6b80 1 -- start start 2023-09-21T13:02:15.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.787+0000 7f71648d6b80 1 Processor -- start 2023-09-21T13:02:15.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.787+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56223311ce80 con 0x5622331cbbb0 2023-09-21T13:02:15.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622330b9740 con 0x5622331d1ce0 2023-09-21T13:02:15.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622330b93e0 con 0x5622331d13c0 2023-09-21T13:02:15.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f71648d6b80 10 client.0 _ll_register_callbacks cb 0x562233003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:15.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50306/0 (socket says 172.21.15.142:50306) 2023-09-21T13:02:15.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 -- 172.21.15.142:0/685111327 learned_addr learned my addr 172.21.15.142:0/685111327 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f7149d9b700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714ad9d700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 -- 172.21.15.142:0/685111327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 msgr2=0x5622331d54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 -- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 msgr2=0x5622331d5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 -- 172.21.15.142:0/685111327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c1aa080 con 0x5622331cbbb0 2023-09-21T13:02:15.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f714a59c700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c5b0 tx=0x7f713c099ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcc42456ef71388 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.788+0000 7f7131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:15.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c09d4e0 con 0x5622331cbbb0 2023-09-21T13:02:15.801 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f713c0a1290 con 0x5622331cbbb0 2023-09-21T13:02:15.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56223308dbb0 con 0x5622331cbbb0 2023-09-21T13:02:15.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f713c0a1450 con 0x5622331cbbb0 2023-09-21T13:02:15.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f71648d6b80 10 client.17115 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:15.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562232f30c60 con 0x5622331cbbb0 2023-09-21T13:02:15.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.789+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56223308dbb0 con 0x5622331cbbb0 2023-09-21T13:02:15.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f713c065140 con 0x5622331cbbb0 2023-09-21T13:02:15.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 10 client.17115 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:15.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 10 client.17115 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:15.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 20 client.17115 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:15.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622331e52b0 0x5622331e76d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 4 client.17115 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56223319a020 con 0x5622331e52b0 2023-09-21T13:02:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.790+0000 7f7149d9b700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622331e52b0 0x5622331e76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.791+0000 7f7149d9b700 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622331e52b0 0x5622331e76d0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eac7b5c80fd5589 server_cookie=d0fe0d836a5d9960 in_seq=0 out_seq=0 2023-09-21T13:02:15.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.791+0000 7f7131ffb700 10 client.17115 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f7131ffb700 1 -- 172.21.15.142:0/685111327 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56223319a020 con 0x5622331e52b0 2023-09-21T13:02:15.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f7131ffb700 10 client.17115 handle_command_reply: tid=0 2023-09-21T13:02:15.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 client.17115 shutdown 2023-09-21T13:02:15.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 msgr2=0x5622331d4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f713c00c5b0 tx=0x7f713c099ba0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 shutdown_connections 2023-09-21T13:02:15.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5622331e52b0 0x5622331e76d0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331d4fb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 --2- 172.21.15.142:0/685111327 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 >> 172.21.15.142:0/685111327 conn(0x5622330f8000 msgr2=0x5622331c6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f7131ffb700 0 client.17115 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 shutdown_connections 2023-09-21T13:02:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.792+0000 7f71648d6b80 1 -- 172.21.15.142:0/685111327 wait complete. 2023-09-21T13:02:15.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.793+0000 7f71648d6b80 20 client.17115 trim_cache size 0 max 16384 2023-09-21T13:02:15.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.813+0000 7f71648d6b80 1 Processor -- start 2023-09-21T13:02:15.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.813+0000 7f71648d6b80 1 -- start start 2023-09-21T13:02:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562232f9d920 con 0x5622331cbbb0 2023-09-21T13:02:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622331d65c0 con 0x5622331d1ce0 2023-09-21T13:02:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f71648d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622331c5730 con 0x5622331d13c0 2023-09-21T13:02:15.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f7149d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f714a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f714ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f7149d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57896/0 (socket says 172.21.15.142:57896) 2023-09-21T13:02:15.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f7149d9b700 1 -- 172.21.15.142:0/3162831243 learned_addr learned my addr 172.21.15.142:0/3162831243 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.814+0000 7f714ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40984/0 (socket says 172.21.15.142:40984) 2023-09-21T13:02:15.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 -- 172.21.15.142:0/3162831243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 msgr2=0x5622331d5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 -- 172.21.15.142:0/3162831243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 msgr2=0x5622331cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 -- 172.21.15.142:0/3162831243 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562232f6e250 con 0x5622331d13c0 2023-09-21T13:02:15.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f7149d9b700 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f714000b650 tx=0x7f7140009290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef69e3d864376dcc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f71397fa700 1 -- 172.21.15.142:0/3162831243 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7140028c00 con 0x5622331d13c0 2023-09-21T13:02:15.825 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f71397fa700 1 -- 172.21.15.142:0/3162831243 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7140020030 con 0x5622331d13c0 2023-09-21T13:02:15.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.815+0000 7f71397fa700 1 -- 172.21.15.142:0/3162831243 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000bbd0 con 0x5622331d13c0 2023-09-21T13:02:15.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 -- 172.21.15.142:0/3162831243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 msgr2=0x5622331d5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f714000b650 tx=0x7f7140009290 comp rx=0 tx=0).stop 2023-09-21T13:02:15.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 -- 172.21.15.142:0/3162831243 shutdown_connections 2023-09-21T13:02:15.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331cbbb0 0x5622331cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331d1ce0 0x5622331d5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 --2- 172.21.15.142:0/3162831243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x5622331d5520 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 -- 172.21.15.142:0/3162831243 >> 172.21.15.142:0/3162831243 conn(0x5622330f8000 msgr2=0x5622331cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 -- 172.21.15.142:0/3162831243 shutdown_connections 2023-09-21T13:02:15.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.816+0000 7f71648d6b80 1 -- 172.21.15.142:0/3162831243 wait complete. 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 -- start start 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 Processor -- start 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x562233232b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x56223322d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56223322d610 con 0x5622331d1ce0 2023-09-21T13:02:15.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56223322d780 con 0x5622331cbbb0 2023-09-21T13:02:15.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56223322d940 con 0x5622331d13c0 2023-09-21T13:02:15.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.817+0000 7f71648d6b80 10 client.0 _ll_register_callbacks cb 0x562233003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:15.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f7149d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x562233232b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40994/0 (socket says 172.21.15.142:40994) 2023-09-21T13:02:15.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 -- 172.21.15.142:0/2895384696 learned_addr learned my addr 172.21.15.142:0/2895384696 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:15.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f7149d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x562233232b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57910/0 (socket says 172.21.15.142:57910) 2023-09-21T13:02:15.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714ad9d700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x56223322d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.830 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 -- 172.21.15.142:0/2895384696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 msgr2=0x562233232b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x562233232b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 -- 172.21.15.142:0/2895384696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 msgr2=0x56223322d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:15.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x56223322d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 -- 172.21.15.142:0/2895384696 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c114980 con 0x5622331cbbb0 2023-09-21T13:02:15.831 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f714a59c700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f713c00f010 tx=0x7f713c0995b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66e29605b045dfde server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:15.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f7131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:15.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0987f0 con 0x5622331cbbb0 2023-09-21T13:02:15.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f713c09d4e0 con 0x5622331cbbb0 2023-09-21T13:02:15.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.818+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f713c0a1720 con 0x5622331cbbb0 2023-09-21T13:02:15.832 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f713c098610 con 0x5622331cbbb0 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 10 client.27212 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x562232f462b0 con 0x5622331cbbb0 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f713c0a1720 con 0x5622331cbbb0 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f713c09e320 con 0x5622331cbbb0 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 10 client.27212 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:15.833 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 10 client.27212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 20 client.27212 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56223323a070 0x56223323c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 4 client.27212 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:02:15.834 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562233115e60 con 0x56223323a070 2023-09-21T13:02:15.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.819+0000 7f7149d9b700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56223323a070 0x56223323c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:15.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f7131ffb700 10 client.27212 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f7149d9b700 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56223323a070 0x56223323c460 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a650d71b71950cf server_cookie=12ef1e4a559f361c in_seq=0 out_seq=0 2023-09-21T13:02:15.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f7131ffb700 1 -- 172.21.15.142:0/2895384696 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562233115e60 con 0x56223323a070 2023-09-21T13:02:15.835 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f7131ffb700 10 client.27212 handle_command_reply: tid=0 2023-09-21T13:02:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 client.27212 shutdown 2023-09-21T13:02:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 msgr2=0x5622332325f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f713c00f010 tx=0x7f713c0995b0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 shutdown_connections 2023-09-21T13:02:15.836 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56223323a070 0x56223323c460 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5622331d1ce0 0x56223322d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f7131ffb700 0 client.27212 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5622331cbbb0 0x5622332325f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 --2- 172.21.15.142:0/2895384696 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5622331d13c0 0x562233232b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.820+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 >> 172.21.15.142:0/2895384696 conn(0x5622330f8000 msgr2=0x5622331d5520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.837 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.821+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 shutdown_connections 2023-09-21T13:02:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.821+0000 7f71648d6b80 1 -- 172.21.15.142:0/2895384696 wait complete. 2023-09-21T13:02:15.838 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.821+0000 7f71648d6b80 20 client.27212 trim_cache size 0 max 16384 2023-09-21T13:02:15.838 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:02:15.839 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:02:15.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:02:15.840 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:02:15.840 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:02:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 msgr2=0x7f71340a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 0x7f71340a2d10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f714c06a240 tx=0x7f714400b040 comp rx=0 tx=0).stop 2023-09-21T13:02:15.841 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 msgr2=0x7f714c19d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f713c00e9a0 tx=0x7f713c00ecb0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 shutdown_connections 2023-09-21T13:02:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f71340a0850 0x7f71340a2d10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f714c111be0 0x7f714c1a1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.842 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f714c073180 0x7f714c19d250 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 --2- 172.21.15.142:0/4265528417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f714c073aa0 0x7f714c19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 >> 172.21.15.142:0/4265528417 conn(0x7f714c0fc6c0 msgr2=0x7f714c113dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 shutdown_connections 2023-09-21T13:02:15.843 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:15.822+0000 7f714b59e700 1 -- 172.21.15.142:0/4265528417 wait complete. 2023-09-21T13:02:15.844 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:02:15.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:15 smithi142 ceph-mon[97663]: pgmap v184: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:16.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:15 smithi156 ceph-mon[134078]: pgmap v184: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:16.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:15 smithi160 ceph-mon[134450]: pgmap v184: 97 pgs: 97 active+clean; 147 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 2.5 MiB/s wr, 205 op/s 2023-09-21T13:02:16.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 -- 172.21.15.142:0/3239039370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c100fd0 msgr2=0x7f270c1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 --2- 172.21.15.142:0/3239039370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c100fd0 0x7f270c1013b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009990 tx=0x7f26fc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 -- 172.21.15.142:0/3239039370 shutdown_connections 2023-09-21T13:02:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 --2- 172.21.15.142:0/3239039370 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c1060f0 0x7f270c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 --2- 172.21.15.142:0/3239039370 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c100fd0 0x7f270c1013b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 --2- 172.21.15.142:0/3239039370 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c101980 0x7f270c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.377+0000 7f27127ff700 1 -- 172.21.15.142:0/3239039370 >> 172.21.15.142:0/3239039370 conn(0x7f270c0fc890 msgr2=0x7f270c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.378+0000 7f27127ff700 1 -- 172.21.15.142:0/3239039370 shutdown_connections 2023-09-21T13:02:16.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.378+0000 7f27127ff700 1 -- 172.21.15.142:0/3239039370 wait complete. 2023-09-21T13:02:16.381 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.379+0000 7f27127ff700 1 Processor -- start 2023-09-21T13:02:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.379+0000 7f27127ff700 1 -- start start 2023-09-21T13:02:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 0x7f270c0732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.382 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 0x7f270c1a5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c1a5970 con 0x7f270c100fd0 2023-09-21T13:02:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c1a5ab0 con 0x7f270c1060f0 2023-09-21T13:02:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f27127ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c1a5c20 con 0x7f270c1a3040 2023-09-21T13:02:16.383 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41020/0 (socket says 172.21.15.142:41020) 2023-09-21T13:02:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 0x7f270c0732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270b7fe700 1 -- 172.21.15.142:0/3182592650 learned_addr learned my addr 172.21.15.142:0/3182592650 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:16.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 0x7f270c1a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 -- 172.21.15.142:0/3182592650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 msgr2=0x7f270c073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 -- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 msgr2=0x7f270c0732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 0x7f270c0732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f2710d9c700 1 -- 172.21.15.142:0/3182592650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0095f0 con 0x7f270c1a3040 2023-09-21T13:02:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270b7fe700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.380+0000 7f270bfff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 0x7f270c0732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:16.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 0x7f270c1a5430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f270400efc0 tx=0x7f270400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f27097fa700 1 -- 172.21.15.142:0/3182592650 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704018070 con 0x7f270c1a3040 2023-09-21T13:02:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f27097fa700 1 -- 172.21.15.142:0/3182592650 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f270400f040 con 0x7f270c1a3040 2023-09-21T13:02:16.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c1a5ea0 con 0x7f270c1a3040 2023-09-21T13:02:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f27097fa700 1 -- 172.21.15.142:0/3182592650 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270400cd40 con 0x7f270c1a3040 2023-09-21T13:02:16.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.381+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c1a6380 con 0x7f270c1a3040 2023-09-21T13:02:16.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.385+0000 7f27097fa700 1 -- 172.21.15.142:0/3182592650 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2704003a00 con 0x7f270c1a3040 2023-09-21T13:02:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.386+0000 7f27261d0b80 1 Processor -- start 2023-09-21T13:02:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.386+0000 7f27261d0b80 1 -- start start 2023-09-21T13:02:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36e92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a3658c40 con 0x5561a36e49c0 2023-09-21T13:02:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a363cc10 con 0x5561a36e40a0 2023-09-21T13:02:16.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27261d0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a363a530 con 0x5561a36e8e50 2023-09-21T13:02:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27097fa700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 0x7f26f40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41034/0 (socket says 172.21.15.142:41034) 2023-09-21T13:02:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 -- 172.21.15.142:0/3557607343 learned_addr learned my addr 172.21.15.142:0/3557607343 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:16.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f27097fa700 1 -- 172.21.15.142:0/3182592650 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f27040cbac0 con 0x7f270c1a3040 2023-09-21T13:02:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36e92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270bfff700 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 0x7f26f40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 -- 172.21.15.142:0/3557607343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 msgr2=0x5561a36e92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36e92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 -- 172.21.15.142:0/3557607343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 msgr2=0x5561a36e8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36e8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.387+0000 7f270b7fe700 1 -- 172.21.15.142:0/3557607343 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a3460d80 con 0x5561a36e40a0 2023-09-21T13:02:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.388+0000 7f270b7fe700 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2700013d40 tx=0x7f2700009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f8c1828cf189c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.388+0000 7f26f27fc700 1 -- 172.21.15.142:0/3557607343 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700013d70 con 0x5561a36e40a0 2023-09-21T13:02:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.388+0000 7f26f27fc700 1 -- 172.21.15.142:0/3557607343 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f270000fe70 con 0x5561a36e40a0 2023-09-21T13:02:16.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.388+0000 7f26f27fc700 1 -- 172.21.15.142:0/3557607343 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700004830 con 0x5561a36e40a0 2023-09-21T13:02:16.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f2710d9c700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 0x7f26f40a2c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27040c9840 tx=0x7f27040092e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- 172.21.15.142:0/3557607343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 msgr2=0x5561a36e4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f2700013d40 tx=0x7f2700009260 comp rx=0 tx=0).stop 2023-09-21T13:02:16.401 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- 172.21.15.142:0/3557607343 shutdown_connections 2023-09-21T13:02:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36e92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36e4480 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 --2- 172.21.15.142:0/3557607343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36e8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- 172.21.15.142:0/3557607343 >> 172.21.15.142:0/3557607343 conn(0x5561a3610fa0 msgr2=0x5561a36df0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- 172.21.15.142:0/3557607343 shutdown_connections 2023-09-21T13:02:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- 172.21.15.142:0/3557607343 wait complete. 2023-09-21T13:02:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.389+0000 7f27261d0b80 1 -- start start 2023-09-21T13:02:16.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 Processor -- start 2023-09-21T13:02:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e40a0 0x5561a36f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 0x5561a36eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a3635e20 con 0x5561a36e8e50 2023-09-21T13:02:16.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a35d26e0 con 0x5561a36e49c0 2023-09-21T13:02:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a35d2380 con 0x5561a36e40a0 2023-09-21T13:02:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.390+0000 7f27261d0b80 10 client.0 _ll_register_callbacks cb 0x5561a351ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e40a0 0x5561a36f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41048/0 (socket says 172.21.15.142:41048) 2023-09-21T13:02:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 -- 172.21.15.142:0/824880942 learned_addr learned my addr 172.21.15.142:0/824880942 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270b7fe700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 0x5561a36eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 -- 172.21.15.142:0/824880942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e40a0 msgr2=0x5561a36f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e40a0 0x5561a36f05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 -- 172.21.15.142:0/824880942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 msgr2=0x5561a36eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 0x5561a36eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 -- 172.21.15.142:0/824880942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270001b040 con 0x5561a36e49c0 2023-09-21T13:02:16.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270b7fe700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 0x5561a36eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f270bfff700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f26fc015000 tx=0x7f26fc005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9edac4935dd6bba0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.391+0000 7f26eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc01d070 con 0x5561a36e49c0 2023-09-21T13:02:16.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561a35a6b50 con 0x5561a36e49c0 2023-09-21T13:02:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f26fc004910 con 0x5561a36e49c0 2023-09-21T13:02:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26fc004ad0 con 0x5561a36e49c0 2023-09-21T13:02:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f27261d0b80 10 client.27224 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:16.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5561a3449c00 con 0x5561a36e49c0 2023-09-21T13:02:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5561a35a6b50 con 0x5561a36e49c0 2023-09-21T13:02:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.392+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f26fc024450 con 0x5561a36e49c0 2023-09-21T13:02:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 10 client.27224 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:16.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 10 client.27224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 20 client.27224 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a36fdf60 0x5561a3700380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 4 client.27224 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:16.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561a36b2fc0 con 0x5561a36fdf60 2023-09-21T13:02:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f270b7fe700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a36fdf60 0x5561a3700380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f270b7fe700 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a36fdf60 0x5561a3700380 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff10cf79d50b3f09 server_cookie=af693b958deed05 in_seq=0 out_seq=0 2023-09-21T13:02:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.393+0000 7f26eb7fe700 10 client.27224 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:16.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.394+0000 7f26eb7fe700 1 -- 172.21.15.142:0/824880942 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561a36b2fc0 con 0x5561a36fdf60 2023-09-21T13:02:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.394+0000 7f26eb7fe700 10 client.27224 handle_command_reply: tid=0 2023-09-21T13:02:16.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.394+0000 7f27261d0b80 1 client.27224 shutdown 2023-09-21T13:02:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.394+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 msgr2=0x5561a36ed7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.394+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f26fc015000 tx=0x7f26fc005270 comp rx=0 tx=0).stop 2023-09-21T13:02:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 shutdown_connections 2023-09-21T13:02:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a36fdf60 0x5561a3700380 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e8e50 0x5561a36eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e40a0 0x5561a36f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 --2- 172.21.15.142:0/824880942 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e49c0 0x5561a36ed7e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 >> 172.21.15.142:0/824880942 conn(0x5561a3610fa0 msgr2=0x5561a36dec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f26eb7fe700 0 client.27224 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 shutdown_connections 2023-09-21T13:02:16.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 1 -- 172.21.15.142:0/824880942 wait complete. 2023-09-21T13:02:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.395+0000 7f27261d0b80 20 client.27224 trim_cache size 0 max 16384 2023-09-21T13:02:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 Processor -- start 2023-09-21T13:02:16.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 -- start start 2023-09-21T13:02:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e40a0 0x5561a36ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 0x5561a36e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a34b68c0 con 0x5561a36e40a0 2023-09-21T13:02:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a36dff20 con 0x5561a36e8e50 2023-09-21T13:02:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.415+0000 7f27261d0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a36e5160 con 0x5561a36e49c0 2023-09-21T13:02:16.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57950/0 (socket says 172.21.15.142:57950) 2023-09-21T13:02:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e40a0 0x5561a36ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 -- 172.21.15.142:0/947559706 learned_addr learned my addr 172.21.15.142:0/947559706 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270b7fe700 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 0x5561a36e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 -- 172.21.15.142:0/947559706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 msgr2=0x5561a36e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 0x5561a36e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 -- 172.21.15.142:0/947559706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e40a0 msgr2=0x5561a36ecfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e40a0 0x5561a36ecfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 -- 172.21.15.142:0/947559706 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561a3704f70 con 0x5561a36e49c0 2023-09-21T13:02:16.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270b7fe700 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 0x5561a36e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:02:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.416+0000 7f270bfff700 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f26fc024860 tx=0x7f26fc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee298b241a38a5f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f26f2ffd700 1 -- 172.21.15.142:0/947559706 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc01d070 con 0x5561a36e49c0 2023-09-21T13:02:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f26f2ffd700 1 -- 172.21.15.142:0/947559706 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26fc01e040 con 0x5561a36e49c0 2023-09-21T13:02:16.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f26f2ffd700 1 -- 172.21.15.142:0/947559706 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc030480 con 0x5561a36e49c0 2023-09-21T13:02:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 -- 172.21.15.142:0/947559706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 msgr2=0x5561a36f0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f26fc024860 tx=0x7f26fc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 -- 172.21.15.142:0/947559706 shutdown_connections 2023-09-21T13:02:16.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e40a0 0x5561a36ecfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e8e50 0x5561a36e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 --2- 172.21.15.142:0/947559706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e49c0 0x5561a36f0100 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.417+0000 7f27261d0b80 1 -- 172.21.15.142:0/947559706 >> 172.21.15.142:0/947559706 conn(0x5561a3610fa0 msgr2=0x5561a36eb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.418+0000 7f27261d0b80 1 -- 172.21.15.142:0/947559706 shutdown_connections 2023-09-21T13:02:16.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.418+0000 7f27261d0b80 1 -- 172.21.15.142:0/947559706 wait complete. 2023-09-21T13:02:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.418+0000 7f27261d0b80 1 -- start start 2023-09-21T13:02:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.418+0000 7f27261d0b80 1 Processor -- start 2023-09-21T13:02:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a3750eb0 con 0x5561a36e49c0 2023-09-21T13:02:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a3751020 con 0x5561a36e40a0 2023-09-21T13:02:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561a37511e0 con 0x5561a36e8e50 2023-09-21T13:02:16.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f27261d0b80 10 client.0 _ll_register_callbacks cb 0x5561a351ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50406/0 (socket says 172.21.15.142:50406) 2023-09-21T13:02:16.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 -- 172.21.15.142:0/944786117 learned_addr learned my addr 172.21.15.142:0/944786117 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270b7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41064/0 (socket says 172.21.15.142:41064) 2023-09-21T13:02:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270b7fe700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 -- 172.21.15.142:0/944786117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 msgr2=0x5561a36f3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36f3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 -- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 msgr2=0x5561a36f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270bfff700 1 -- 172.21.15.142:0/944786117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561a3449c00 con 0x5561a36e49c0 2023-09-21T13:02:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.419+0000 7f270b7fe700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:16.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f270bfff700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26fc029040 tx=0x7f26fc004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f928bb0fe0e200 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f26eb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc01d070 con 0x5561a36e49c0 2023-09-21T13:02:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f270000fe70 con 0x5561a36e49c0 2023-09-21T13:02:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f26fc000e40 con 0x5561a36e49c0 2023-09-21T13:02:16.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26fc00b2f0 con 0x5561a36e49c0 2023-09-21T13:02:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f27261d0b80 10 client.17139 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:16.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.420+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x5561a34871f0 con 0x5561a36e49c0 2023-09-21T13:02:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26fc046020 con 0x5561a36e49c0 2023-09-21T13:02:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f26fc030c70 con 0x5561a36e49c0 2023-09-21T13:02:16.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 10 client.17139 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 10 client.17139 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 20 client.17139 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a3752430 0x5561a3754820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 4 client.17139 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:02:16.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561a362ee00 con 0x5561a3752430 2023-09-21T13:02:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.421+0000 7f270b7fe700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a3752430 0x5561a3754820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.422+0000 7f270b7fe700 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a3752430 0x5561a3754820 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def4b3dc2ac9486d server_cookie=5882dac80bc8f733 in_seq=0 out_seq=0 2023-09-21T13:02:16.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.422+0000 7f26eb7fe700 10 client.17139 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f26eb7fe700 1 -- 172.21.15.142:0/944786117 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561a362ee00 con 0x5561a3752430 2023-09-21T13:02:16.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f26eb7fe700 10 client.17139 handle_command_reply: tid=0 2023-09-21T13:02:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 client.17139 shutdown 2023-09-21T13:02:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 msgr2=0x5561a36f3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f26fc029040 tx=0x7f26fc004da0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 shutdown_connections 2023-09-21T13:02:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561a3752430 0x5561a3754820 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561a36e8e50 0x5561a36f3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561a36e40a0 0x5561a36f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 --2- 172.21.15.142:0/944786117 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561a36e49c0 0x5561a36f3500 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 >> 172.21.15.142:0/944786117 conn(0x5561a3610fa0 msgr2=0x5561a36eb240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f26eb7fe700 0 client.17139 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.461+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 shutdown_connections 2023-09-21T13:02:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27261d0b80 1 -- 172.21.15.142:0/944786117 wait complete. 2023-09-21T13:02:16.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27261d0b80 20 client.17139 trim_cache size 0 max 16384 2023-09-21T13:02:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:02:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:02:16.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:02:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:02:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 msgr2=0x7f26f40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 0x7f26f40a2c70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27040c9840 tx=0x7f27040092e0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 msgr2=0x7f270c1a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 0x7f270c1a5430 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f270400efc0 tx=0x7f270400c3a0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 shutdown_connections 2023-09-21T13:02:16.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f26f40a07b0 0x7f26f40a2c70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.462+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f270c100fd0 0x7f270c0732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.463+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270c1a3040 0x7f270c1a5430 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.463+0000 7f27127ff700 1 --2- 172.21.15.142:0/3182592650 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f270c1060f0 0x7f270c073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.463+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 >> 172.21.15.142:0/3182592650 conn(0x7f270c0fc890 msgr2=0x7f270c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:16.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.463+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 shutdown_connections 2023-09-21T13:02:16.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:16.463+0000 7f27127ff700 1 -- 172.21.15.142:0/3182592650 wait complete. 2023-09-21T13:02:16.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 532312 8.59 MB/sec execute 177 sec latency 18.212 ms 2023-09-21T13:02:17.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub queued for path: / 2023-09-21T13:02:17.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:02:17.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:02:17.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:02:17.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:02:17.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:02:17.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:16 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub queued for path: / 2023-09-21T13:02:17.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:02:17.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:02:17.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:02:17.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:02:17.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:02:17.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.168 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:16 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub queued for path: / 2023-09-21T13:02:17.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:02:17.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:02:17.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:02:17.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:02:17.189 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:02:17.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.190 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:16 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:02:17.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 533677 8.58 MB/sec execute 178 sec latency 41.121 ms 2023-09-21T13:02:18.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:17 smithi156 ceph-mon[134078]: pgmap v185: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 3.4 MiB/s wr, 239 op/s 2023-09-21T13:02:18.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:17 smithi142 ceph-mon[97663]: pgmap v185: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 3.4 MiB/s wr, 239 op/s 2023-09-21T13:02:18.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:17 smithi160 ceph-mon[134450]: pgmap v185: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 965 KiB/s rd, 3.4 MiB/s wr, 239 op/s 2023-09-21T13:02:18.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 535804 8.60 MB/sec execute 179 sec latency 36.398 ms 2023-09-21T13:02:19.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 537285 8.59 MB/sec execute 180 sec latency 15.412 ms 2023-09-21T13:02:20.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:19 smithi156 ceph-mon[134078]: pgmap v186: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2023-09-21T13:02:20.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:19 smithi142 ceph-mon[97663]: pgmap v186: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2023-09-21T13:02:20.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:19 smithi160 ceph-mon[134450]: pgmap v186: 97 pgs: 97 active+clean; 149 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 1.9 MiB/s wr, 88 op/s 2023-09-21T13:02:20.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 539420 8.61 MB/sec execute 181 sec latency 16.749 ms 2023-09-21T13:02:21.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 540724 8.60 MB/sec execute 182 sec latency 70.518 ms 2023-09-21T13:02:22.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:21 smithi156 ceph-mon[134078]: pgmap v187: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 224 op/s 2023-09-21T13:02:22.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:21 smithi142 ceph-mon[97663]: pgmap v187: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 224 op/s 2023-09-21T13:02:22.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:21 smithi160 ceph-mon[134450]: pgmap v187: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 224 op/s 2023-09-21T13:02:22.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 542872 8.62 MB/sec execute 183 sec latency 26.033 ms 2023-09-21T13:02:23.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 544138 8.61 MB/sec execute 184 sec latency 25.418 ms 2023-09-21T13:02:24.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:23 smithi156 ceph-mon[134078]: pgmap v188: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:24.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:23 smithi142 ceph-mon[97663]: pgmap v188: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:24.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:23 smithi160 ceph-mon[134450]: pgmap v188: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 745 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:24.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 546436 8.63 MB/sec execute 185 sec latency 19.830 ms 2023-09-21T13:02:25.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 547850 8.62 MB/sec execute 186 sec latency 39.440 ms 2023-09-21T13:02:26.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:25 smithi156 ceph-mon[134078]: pgmap v189: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:26.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:25 smithi142 ceph-mon[97663]: pgmap v189: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:26.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:25 smithi160 ceph-mon[134450]: pgmap v189: 97 pgs: 97 active+clean; 153 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 746 KiB/s rd, 2.4 MiB/s wr, 169 op/s 2023-09-21T13:02:26.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 549989 8.64 MB/sec execute 187 sec latency 74.124 ms 2023-09-21T13:02:27.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 551421 8.63 MB/sec execute 188 sec latency 10.994 ms 2023-09-21T13:02:28.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:27 smithi156 ceph-mon[134078]: pgmap v190: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2023-09-21T13:02:28.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:27 smithi142 ceph-mon[97663]: pgmap v190: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2023-09-21T13:02:28.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:27 smithi160 ceph-mon[134450]: pgmap v190: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 262 op/s 2023-09-21T13:02:28.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 553550 8.65 MB/sec execute 189 sec latency 22.618 ms 2023-09-21T13:02:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 -- 172.21.15.142:0/2717755682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4102800 msgr2=0x7f73f4102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 --2- 172.21.15.142:0/2717755682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4102800 0x7f73f4102c80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009990 tx=0x7f73e4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 -- 172.21.15.142:0/2717755682 shutdown_connections 2023-09-21T13:02:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 --2- 172.21.15.142:0/2717755682 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4100f20 0x7f73f4101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 --2- 172.21.15.142:0/2717755682 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f410dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 --2- 172.21.15.142:0/2717755682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4102800 0x7f73f4102c80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 -- 172.21.15.142:0/2717755682 >> 172.21.15.142:0/2717755682 conn(0x7f73f40fc6a0 msgr2=0x7f73f40feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 -- 172.21.15.142:0/2717755682 shutdown_connections 2023-09-21T13:02:29.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.636+0000 7f73fb39d700 1 -- 172.21.15.142:0/2717755682 wait complete. 2023-09-21T13:02:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.637+0000 7f73fb39d700 1 Processor -- start 2023-09-21T13:02:29.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.637+0000 7f73fb39d700 1 -- start start 2023-09-21T13:02:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 0x7f73f410cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f41a1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41a2300 con 0x7f73f4102800 2023-09-21T13:02:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41a2470 con 0x7f73f41031c0 2023-09-21T13:02:29.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fb39d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f41a2630 con 0x7f73f4100f20 2023-09-21T13:02:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34166/0 (socket says 172.21.15.142:34166) 2023-09-21T13:02:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 -- 172.21.15.142:0/1277390712 learned_addr learned my addr 172.21.15.142:0/1277390712 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f41a1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 0x7f73f410cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 -- 172.21.15.142:0/1277390712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 msgr2=0x7f73f41a1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f41a1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 -- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 msgr2=0x7f73f410cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 0x7f73f410cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fa39b700 1 -- 172.21.15.142:0/1277390712 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e40095f0 con 0x7f73f4100f20 2023-09-21T13:02:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f41a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.638+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 0x7f73f410cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:29.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73fa39b700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f73f000e9a0 tx=0x7f73f000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73eb7fe700 1 -- 172.21.15.142:0/1277390712 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0009790 con 0x7f73f4100f20 2023-09-21T13:02:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73eb7fe700 1 -- 172.21.15.142:0/1277390712 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73f000cbd0 con 0x7f73f4100f20 2023-09-21T13:02:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f41a2910 con 0x7f73f4100f20 2023-09-21T13:02:29.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73eb7fe700 1 -- 172.21.15.142:0/1277390712 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0018680 con 0x7f73f4100f20 2023-09-21T13:02:29.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.639+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f41aa180 con 0x7f73f4100f20 2023-09-21T13:02:29.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 Processor -- start 2023-09-21T13:02:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 -- start start 2023-09-21T13:02:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945dda1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dd15c40 con 0x55945dda17a0 2023-09-21T13:02:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dcf9c10 con 0x55945dda7780 2023-09-21T13:02:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f740ff78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dcf7530 con 0x55945dda6e60 2023-09-21T13:02:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.644+0000 7f73eb7fe700 1 -- 172.21.15.142:0/1277390712 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f73f000cd40 con 0x7f73f4100f20 2023-09-21T13:02:29.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34172/0 (socket says 172.21.15.142:34172) 2023-09-21T13:02:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 -- 172.21.15.142:0/3884450428 learned_addr learned my addr 172.21.15.142:0/3884450428 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fa39b700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945dda1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 -- 172.21.15.142:0/3884450428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 msgr2=0x55945dda1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945dda1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 -- 172.21.15.142:0/3884450428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 msgr2=0x55945dda1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 -- 172.21.15.142:0/3884450428 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945db1dd80 con 0x55945dda6e60 2023-09-21T13:02:29.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:02:29.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.645+0000 7f73fab9c700 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f73ec003eb0 tx=0x7f73ec009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc37f18ba8c996ca server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f73e8bfe700 1 -- 172.21.15.142:0/3884450428 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec0092d0 con 0x55945dda6e60 2023-09-21T13:02:29.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f73e8bfe700 1 -- 172.21.15.142:0/3884450428 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73ec00f040 con 0x55945dda6e60 2023-09-21T13:02:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f73e8bfe700 1 -- 172.21.15.142:0/3884450428 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00e8b0 con 0x55945dda6e60 2023-09-21T13:02:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f73eb7fe700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 0x7f73e00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f73eb7fe700 1 -- 172.21.15.142:0/1277390712 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f73f0014070 con 0x7f73f4100f20 2023-09-21T13:02:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f740ff78b80 1 -- 172.21.15.142:0/3884450428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 msgr2=0x55945dda7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.646+0000 7f740ff78b80 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f73ec003eb0 tx=0x7f73ec009920 comp rx=0 tx=0).stop 2023-09-21T13:02:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 -- 172.21.15.142:0/3884450428 shutdown_connections 2023-09-21T13:02:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda7240 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 --2- 172.21.15.142:0/3884450428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945dda1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 -- 172.21.15.142:0/3884450428 >> 172.21.15.142:0/3884450428 conn(0x55945dccdfa0 msgr2=0x55945dd9c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f73fa39b700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 0x7f73e00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 -- 172.21.15.142:0/3884450428 shutdown_connections 2023-09-21T13:02:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 -- 172.21.15.142:0/3884450428 wait complete. 2023-09-21T13:02:29.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f73fa39b700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 0x7f73e00a2cf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55945dda7c00 tx=0x7f73f00cf7a0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.647+0000 7f740ff78b80 1 -- start start 2023-09-21T13:02:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.648+0000 7f740ff78b80 1 Processor -- start 2023-09-21T13:02:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945ddad790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddaafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dcf2e20 con 0x55945dda17a0 2023-09-21T13:02:29.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dc8f6e0 con 0x55945dda6e60 2023-09-21T13:02:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dc8f380 con 0x55945dda7780 2023-09-21T13:02:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f740ff78b80 10 client.0 _ll_register_callbacks cb 0x55945dbd9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:29.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:57354/0 (socket says 172.21.15.142:57354) 2023-09-21T13:02:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1954934819 learned_addr learned my addr 172.21.15.142:0/1954934819 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:29.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddaafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945ddad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1954934819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 msgr2=0x55945ddaafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddaafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1954934819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 msgr2=0x55945ddad790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945ddad790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.649+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1954934819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ec003b90 con 0x55945dda6e60 2023-09-21T13:02:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f73e4015000 tx=0x7f73e400bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc19ec3c238a02 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f73ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:29.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4004700 con 0x55945dda6e60 2023-09-21T13:02:29.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55945dc63b50 con 0x55945dda6e60 2023-09-21T13:02:29.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f73e4004860 con 0x55945dda6e60 2023-09-21T13:02:29.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e40056e0 con 0x55945dda6e60 2023-09-21T13:02:29.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f740ff78b80 10 client.27239 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:29.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.650+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55945db06c00 con 0x55945dda6e60 2023-09-21T13:02:29.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73e4030020 con 0x55945dda6e60 2023-09-21T13:02:29.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f73e400f910 con 0x55945dda6e60 2023-09-21T13:02:29.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 10 client.27239 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:29.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 10 client.27239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:29.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 20 client.27239 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945ddbb190 0x55945ddbd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 4 client.27239 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55945dd6ffc0 con 0x55945ddbb190 2023-09-21T13:02:29.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.651+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945ddbb190 0x55945ddbd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.652+0000 7f73ddffb700 10 client.27239 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:29.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.652+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945ddbb190 0x55945ddbd5b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d8c8166b0d5df35 server_cookie=1b3253eb9d7e63c5 in_seq=0 out_seq=0 2023-09-21T13:02:29.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.652+0000 7f73ddffb700 1 -- 172.21.15.142:0/1954934819 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55945dd6ffc0 con 0x55945ddbb190 2023-09-21T13:02:29.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.652+0000 7f73ddffb700 10 client.27239 handle_command_reply: tid=0 2023-09-21T13:02:29.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.652+0000 7f740ff78b80 1 client.27239 shutdown 2023-09-21T13:02:29.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 msgr2=0x55945ddaa9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f73e4015000 tx=0x7f73e400bf60 comp rx=0 tx=0).stop 2023-09-21T13:02:29.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 shutdown_connections 2023-09-21T13:02:29.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945ddbb190 0x55945ddbd5b0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945ddad790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddaafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1954934819 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda6e60 0x55945ddaa9a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f73ddffb700 0 client.27239 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:29.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 >> 172.21.15.142:0/1954934819 conn(0x55945dccdfa0 msgr2=0x55945dd9bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 shutdown_connections 2023-09-21T13:02:29.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 1 -- 172.21.15.142:0/1954934819 wait complete. 2023-09-21T13:02:29.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.653+0000 7f740ff78b80 20 client.27239 trim_cache size 0 max 16384 2023-09-21T13:02:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 Processor -- start 2023-09-21T13:02:29.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 -- start start 2023-09-21T13:02:29.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 0x55945ddaa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945db738c0 con 0x55945dda6e60 2023-09-21T13:02:29.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dda6b10 con 0x55945dda17a0 2023-09-21T13:02:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.677+0000 7f740ff78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945ddb27f0 con 0x55945dda7780 2023-09-21T13:02:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:57362/0 (socket says 172.21.15.142:57362) 2023-09-21T13:02:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 -- 172.21.15.142:0/1103737874 learned_addr learned my addr 172.21.15.142:0/1103737874 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 0x55945ddaa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 -- 172.21.15.142:0/1103737874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 msgr2=0x55945ddad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 -- 172.21.15.142:0/1103737874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 msgr2=0x55945ddaa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 0x55945ddaa160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 -- 172.21.15.142:0/1103737874 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55945db441f0 con 0x55945dda17a0 2023-09-21T13:02:29.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 0x55945ddaa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:29.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b010 tx=0x7f73ec017040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6cd3cc99d721b91 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.678+0000 7f73e93ff700 1 -- 172.21.15.142:0/1103737874 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec02a4c0 con 0x55945dda17a0 2023-09-21T13:02:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f73e93ff700 1 -- 172.21.15.142:0/1103737874 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73ec030030 con 0x55945dda17a0 2023-09-21T13:02:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f73e93ff700 1 -- 172.21.15.142:0/1103737874 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73ec007980 con 0x55945dda17a0 2023-09-21T13:02:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 -- 172.21.15.142:0/1103737874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 msgr2=0x55945ddb2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00b010 tx=0x7f73ec017040 comp rx=0 tx=0).stop 2023-09-21T13:02:29.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 -- 172.21.15.142:0/1103737874 shutdown_connections 2023-09-21T13:02:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda7780 0x55945ddad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda17a0 0x55945ddb2230 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1103737874 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda6e60 0x55945ddaa160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.679+0000 7f740ff78b80 1 -- 172.21.15.142:0/1103737874 >> 172.21.15.142:0/1103737874 conn(0x55945dccdfa0 msgr2=0x55945ddb6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.680+0000 7f740ff78b80 1 -- 172.21.15.142:0/1103737874 shutdown_connections 2023-09-21T13:02:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.680+0000 7f740ff78b80 1 -- 172.21.15.142:0/1103737874 wait complete. 2023-09-21T13:02:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.680+0000 7f740ff78b80 1 -- start start 2023-09-21T13:02:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.680+0000 7f740ff78b80 1 Processor -- start 2023-09-21T13:02:29.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945de0efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945dda3fe0 con 0x55945dda17a0 2023-09-21T13:02:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945de0f4e0 con 0x55945dda7780 2023-09-21T13:02:29.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55945de0f6a0 con 0x55945dda6e60 2023-09-21T13:02:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f740ff78b80 10 client.0 _ll_register_callbacks cb 0x55945dbd9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f73f9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f73fab9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f73f9b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34200/0 (socket says 172.21.15.142:34200) 2023-09-21T13:02:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.681+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1365402367 learned_addr learned my addr 172.21.15.142:0/1365402367 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945de0efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 msgr2=0x55945de0efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945de0efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1365402367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 msgr2=0x55945dda3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 -- 172.21.15.142:0/1365402367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55945db1dd80 con 0x55945dda6e60 2023-09-21T13:02:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945de0efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73f9b9a700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f73e40098e0 tx=0x7f73e400fee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdd5896ac50e9be8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:29.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73ddffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400f870 con 0x55945dda6e60 2023-09-21T13:02:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f73e4031080 con 0x55945dda6e60 2023-09-21T13:02:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.682+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73ec00f040 con 0x55945dda6e60 2023-09-21T13:02:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73e4005c00 con 0x55945dda6e60 2023-09-21T13:02:29.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 10 client.27208 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55945db1c250 con 0x55945dda6e60 2023-09-21T13:02:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73ec00f040 con 0x55945dda6e60 2023-09-21T13:02:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f73e4004500 con 0x55945dda6e60 2023-09-21T13:02:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 10 client.27208 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:29.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 10 client.27208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 20 client.27208 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945de10b10 0x55945de12f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 4 client.27208 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:02:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55945dcebe00 con 0x55945de10b10 2023-09-21T13:02:29.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.683+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945de10b10 0x55945de12f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.684+0000 7f73fab9c700 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945de10b10 0x55945de12f30 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac50582cec5b41f3 server_cookie=3a4e7a6f0356f031 in_seq=0 out_seq=0 2023-09-21T13:02:29.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.684+0000 7f73ddffb700 10 client.27208 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:29.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 554756 8.64 MB/sec execute 190 sec latency 30.693 ms 2023-09-21T13:02:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.736+0000 7f73ddffb700 1 -- 172.21.15.142:0/1365402367 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55945dcebe00 con 0x55945de10b10 2023-09-21T13:02:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.736+0000 7f73ddffb700 10 client.27208 handle_command_reply: tid=0 2023-09-21T13:02:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.736+0000 7f740ff78b80 1 client.27208 shutdown 2023-09-21T13:02:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.737+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 msgr2=0x55945dda3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.737+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f73e40098e0 tx=0x7f73e400fee0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 shutdown_connections 2023-09-21T13:02:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55945de10b10 0x55945de12f30 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55945dda17a0 0x55945dda3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55945dda7780 0x55945de0efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 --2- 172.21.15.142:0/1365402367 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55945dda6e60 0x55945dda3870 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 >> 172.21.15.142:0/1365402367 conn(0x55945dccdfa0 msgr2=0x55945dda4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.741+0000 7f73ddffb700 0 client.27208 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.742+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 shutdown_connections 2023-09-21T13:02:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.742+0000 7f740ff78b80 1 -- 172.21.15.142:0/1365402367 wait complete. 2023-09-21T13:02:29.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.742+0000 7f740ff78b80 20 client.27208 trim_cache size 0 max 16384 2023-09-21T13:02:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:02:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:02:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:02:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:02:29.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.744+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 msgr2=0x7f73e00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.744+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 0x7f73e00a2cf0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55945dda7c00 tx=0x7f73f00cf7a0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.744+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 msgr2=0x7f73f410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.744+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f73f000e9a0 tx=0x7f73f000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 shutdown_connections 2023-09-21T13:02:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f73e00a0830 0x7f73e00a2cf0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f73f41031c0 0x7f73f41a1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73f4100f20 0x7f73f410c9d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 --2- 172.21.15.142:0/1277390712 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f73f4102800 0x7f73f410cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 >> 172.21.15.142:0/1277390712 conn(0x7f73f40fc6a0 msgr2=0x7f73f40fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 shutdown_connections 2023-09-21T13:02:29.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:29.746+0000 7f73fb39d700 1 -- 172.21.15.142:0/1277390712 wait complete. 2023-09-21T13:02:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:29 smithi156 ceph-mon[134078]: pgmap v191: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-09-21T13:02:30.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:29 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:02:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:29 smithi142 ceph-mon[97663]: pgmap v191: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-09-21T13:02:30.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:29 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:02:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:29 smithi160 ceph-mon[134450]: pgmap v191: 97 pgs: 97 active+clean; 159 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.4 MiB/s wr, 228 op/s 2023-09-21T13:02:30.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:29 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:02:30.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 556731 8.64 MB/sec execute 191 sec latency 48.877 ms 2023-09-21T13:02:31.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:30 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:02:31.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:30 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:02:31.156 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:30 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:02:31.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:30 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:02:31.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:30 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:02:31.167 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:30 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:02:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:30 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:02:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:30 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:02:31.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:30 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:02:31.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 558297 8.65 MB/sec execute 192 sec latency 49.032 ms 2023-09-21T13:02:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:31 smithi156 ceph-mon[134078]: pgmap v192: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 337 op/s 2023-09-21T13:02:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:31 smithi142 ceph-mon[97663]: pgmap v192: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 337 op/s 2023-09-21T13:02:32.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:31 smithi160 ceph-mon[134450]: pgmap v192: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.2 MiB/s wr, 337 op/s 2023-09-21T13:02:32.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 560581 8.66 MB/sec execute 193 sec latency 29.007 ms 2023-09-21T13:02:33.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 561852 8.66 MB/sec execute 194 sec latency 92.023 ms 2023-09-21T13:02:34.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:33 smithi156 ceph-mon[134078]: pgmap v193: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:34.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:33 smithi142 ceph-mon[97663]: pgmap v193: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:34.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:33 smithi160 ceph-mon[134450]: pgmap v193: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:34.692 INFO:tasks.workunit.client.0.smithi142.stdout: 1 563837 8.65 MB/sec execute 195 sec latency 44.791 ms 2023-09-21T13:02:35.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 565253 8.67 MB/sec execute 196 sec latency 50.562 ms 2023-09-21T13:02:36.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:35 smithi156 ceph-mon[134078]: pgmap v194: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:36.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:35 smithi142 ceph-mon[97663]: pgmap v194: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:36.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:35 smithi160 ceph-mon[134450]: pgmap v194: 97 pgs: 97 active+clean; 155 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 201 op/s 2023-09-21T13:02:36.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 567385 8.66 MB/sec execute 197 sec latency 15.852 ms 2023-09-21T13:02:37.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 568897 8.68 MB/sec execute 198 sec latency 41.936 ms 2023-09-21T13:02:38.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:37 smithi156 ceph-mon[134078]: pgmap v195: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-21T13:02:38.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:37 smithi142 ceph-mon[97663]: pgmap v195: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-21T13:02:38.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:37 smithi160 ceph-mon[134450]: pgmap v195: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-21T13:02:38.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 570829 8.67 MB/sec execute 199 sec latency 21.653 ms 2023-09-21T13:02:39.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 572571 8.69 MB/sec execute 200 sec latency 11.090 ms 2023-09-21T13:02:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:39 smithi156 ceph-mon[134078]: pgmap v196: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 202 op/s 2023-09-21T13:02:40.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:39 smithi142 ceph-mon[97663]: pgmap v196: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 202 op/s 2023-09-21T13:02:40.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:39 smithi160 ceph-mon[134450]: pgmap v196: 97 pgs: 97 active+clean; 162 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 202 op/s 2023-09-21T13:02:40.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 574815 8.70 MB/sec execute 201 sec latency 41.056 ms 2023-09-21T13:02:41.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 576423 8.70 MB/sec execute 202 sec latency 13.464 ms 2023-09-21T13:02:42.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:41 smithi156 ceph-mon[134078]: pgmap v197: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 307 op/s 2023-09-21T13:02:42.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:41 smithi142 ceph-mon[97663]: pgmap v197: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 307 op/s 2023-09-21T13:02:42.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:41 smithi160 ceph-mon[134450]: pgmap v197: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 307 op/s 2023-09-21T13:02:42.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 578810 8.72 MB/sec execute 203 sec latency 19.297 ms 2023-09-21T13:02:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 -- 172.21.15.142:0/4112328186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5010d440 msgr2=0x7fef5010f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 --2- 172.21.15.142:0/4112328186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5010d440 0x7fef5010f870 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fef4800b0a0 tx=0x7fef4800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 -- 172.21.15.142:0/4112328186 shutdown_connections 2023-09-21T13:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 --2- 172.21.15.142:0/4112328186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef5010d440 0x7fef5010f870 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 --2- 172.21.15.142:0/4112328186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef500731b0 0x7fef50073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 --2- 172.21.15.142:0/4112328186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef50073ad0 0x7fef5010cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 -- 172.21.15.142:0/4112328186 >> 172.21.15.142:0/4112328186 conn(0x7fef500fc6d0 msgr2=0x7fef500feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 -- 172.21.15.142:0/4112328186 shutdown_connections 2023-09-21T13:02:42.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.944+0000 7fef4ffff700 1 -- 172.21.15.142:0/4112328186 wait complete. 2023-09-21T13:02:42.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.945+0000 7fef4ffff700 1 Processor -- start 2023-09-21T13:02:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 -- start start 2023-09-21T13:02:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef500731b0 0x7fef50199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 0x7fef5019d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.949 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019e010 con 0x7fef500731b0 2023-09-21T13:02:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019e180 con 0x7fef50073ad0 2023-09-21T13:02:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4ffff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef5019e340 con 0x7fef5010d440 2023-09-21T13:02:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 0x7fef5019d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37276/0 (socket says 172.21.15.142:37276) 2023-09-21T13:02:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef500731b0 0x7fef50199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.946+0000 7fef4e7fc700 1 -- 172.21.15.142:0/1379947197 learned_addr learned my addr 172.21.15.142:0/1379947197 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 -- 172.21.15.142:0/1379947197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 msgr2=0x7fef5019d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 0x7fef5019d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 -- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef500731b0 msgr2=0x7fef50199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef500731b0 0x7fef50199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 -- 172.21.15.142:0/1379947197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef48009d00 con 0x7fef50073ad0 2023-09-21T13:02:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 0x7fef5019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:42.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e9a0 tx=0x7fef4400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef37fff700 1 -- 172.21.15.142:0/1379947197 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44009790 con 0x7fef50073ad0 2023-09-21T13:02:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef37fff700 1 -- 172.21.15.142:0/1379947197 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef44010430 con 0x7fef50073ad0 2023-09-21T13:02:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef37fff700 1 -- 172.21.15.142:0/1379947197 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef44018680 con 0x7fef50073ad0 2023-09-21T13:02:42.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.947+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef5019e620 con 0x7fef50073ad0 2023-09-21T13:02:42.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.948+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef501a5e60 con 0x7fef50073ad0 2023-09-21T13:02:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.951+0000 7fef37fff700 1 -- 172.21.15.142:0/1379947197 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fef440105a0 con 0x7fef50073ad0 2023-09-21T13:02:42.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.953+0000 7fef37fff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 0x7fef380a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.953+0000 7fef37fff700 1 -- 172.21.15.142:0/1379947197 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef44014070 con 0x7fef50073ad0 2023-09-21T13:02:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.953+0000 7fef4effd700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 0x7fef380a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.953+0000 7fef68d94b80 1 Processor -- start 2023-09-21T13:02:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.953+0000 7fef68d94b80 1 -- start start 2023-09-21T13:02:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d41240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4effd700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 0x7fef380a2cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef40009c60 tx=0x7fef40009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 0x55b609d3bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609cafc40 con 0x55b609d3b7a0 2023-09-21T13:02:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609c93c10 con 0x55b609d40e60 2023-09-21T13:02:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef68d94b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609c91530 con 0x55b609d41780 2023-09-21T13:02:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d41240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38368/0 (socket says 172.21.15.142:38368) 2023-09-21T13:02:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4e7fc700 1 -- 172.21.15.142:0/3541434444 learned_addr learned my addr 172.21.15.142:0/3541434444 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.954+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 0x55b609d3bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 -- 172.21.15.142:0/3541434444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 msgr2=0x55b609d41240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d41240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 -- 172.21.15.142:0/3541434444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 msgr2=0x55b609d3bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 0x55b609d3bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 -- 172.21.15.142:0/3541434444 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b609ab7d80 con 0x55b609d41780 2023-09-21T13:02:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 0x55b609d3bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef44095f80 tx=0x7fef44098f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7626a4356d349967 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef357fa700 1 -- 172.21.15.142:0/3541434444 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4409d120 con 0x55b609d41780 2023-09-21T13:02:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef357fa700 1 -- 172.21.15.142:0/3541434444 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef4409d340 con 0x55b609d41780 2023-09-21T13:02:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.955+0000 7fef357fa700 1 -- 172.21.15.142:0/3541434444 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440999d0 con 0x55b609d41780 2023-09-21T13:02:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 -- 172.21.15.142:0/3541434444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 msgr2=0x55b609d3b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef44095f80 tx=0x7fef44098f60 comp rx=0 tx=0).stop 2023-09-21T13:02:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 -- 172.21.15.142:0/3541434444 shutdown_connections 2023-09-21T13:02:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d3b7a0 0x55b609d3bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d41240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3541434444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d3b260 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 -- 172.21.15.142:0/3541434444 >> 172.21.15.142:0/3541434444 conn(0x55b609c67fa0 msgr2=0x55b609d36180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 -- 172.21.15.142:0/3541434444 shutdown_connections 2023-09-21T13:02:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.956+0000 7fef68d94b80 1 -- 172.21.15.142:0/3541434444 wait complete. 2023-09-21T13:02:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.957+0000 7fef68d94b80 1 -- start start 2023-09-21T13:02:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.957+0000 7fef68d94b80 1 Processor -- start 2023-09-21T13:02:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d45020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d45560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609c8ce20 con 0x55b609d40e60 2023-09-21T13:02:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609c296e0 con 0x55b609d3b7a0 2023-09-21T13:02:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609c29380 con 0x55b609d41780 2023-09-21T13:02:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef68d94b80 10 client.0 _ll_register_callbacks cb 0x55b609b73a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37296/0 (socket says 172.21.15.142:37296) 2023-09-21T13:02:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef4effd700 1 -- 172.21.15.142:0/2308786636 learned_addr learned my addr 172.21.15.142:0/2308786636 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d45020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.958+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d45560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 -- 172.21.15.142:0/2308786636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 msgr2=0x55b609d45560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d45560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 -- 172.21.15.142:0/2308786636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 msgr2=0x55b609d45020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d45020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 -- 172.21.15.142:0/2308786636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef501a5e60 con 0x55b609d3b7a0 2023-09-21T13:02:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef4effd700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef40003900 tx=0x7fef400047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93442d5cf4ee167c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef32ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:42.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40022070 con 0x55b609d3b7a0 2023-09-21T13:02:42.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b609bfdb50 con 0x55b609d3b7a0 2023-09-21T13:02:42.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.959+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef4001d620 con 0x55b609d3b7a0 2023-09-21T13:02:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef4001d7e0 con 0x55b609d3b7a0 2023-09-21T13:02:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 10 client.27257 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b609aa0c00 con 0x55b609d3b7a0 2023-09-21T13:02:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b609bfdb50 con 0x55b609d3b7a0 2023-09-21T13:02:42.974 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fef400279c0 con 0x55b609d3b7a0 2023-09-21T13:02:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 10 client.27257 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 10 client.27257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 20 client.27257 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:42.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609d55300 0x55b609d57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 4 client.27257 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.960+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b609d09fc0 con 0x55b609d55300 2023-09-21T13:02:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.961+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609d55300 0x55b609d57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.961+0000 7fef32ff5700 10 client.27257 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:42.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.961+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609d55300 0x55b609d57720 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c936c3682fd612f2 server_cookie=58e78fb0b1787df5 in_seq=0 out_seq=0 2023-09-21T13:02:42.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef32ff5700 1 -- 172.21.15.142:0/2308786636 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b609d09fc0 con 0x55b609d55300 2023-09-21T13:02:42.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef32ff5700 10 client.27257 handle_command_reply: tid=0 2023-09-21T13:02:42.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 client.27257 shutdown 2023-09-21T13:02:42.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 msgr2=0x55b609d44ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef40003900 tx=0x7fef400047c0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 shutdown_connections 2023-09-21T13:02:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609d55300 0x55b609d57720 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d45560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d44ae0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef32ff5700 0 client.27257 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 --2- 172.21.15.142:0/2308786636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d45020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 >> 172.21.15.142:0/2308786636 conn(0x55b609c67fa0 msgr2=0x55b609d35f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:42.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 shutdown_connections 2023-09-21T13:02:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.963+0000 7fef68d94b80 1 -- 172.21.15.142:0/2308786636 wait complete. 2023-09-21T13:02:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.964+0000 7fef68d94b80 20 client.27257 trim_cache size 0 max 16384 2023-09-21T13:02:42.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.981+0000 7fef68d94b80 1 Processor -- start 2023-09-21T13:02:42.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.981+0000 7fef68d94b80 1 -- start start 2023-09-21T13:02:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d41780 0x55b609d3fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609b0d8c0 con 0x55b609d41780 2023-09-21T13:02:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609d30a90 con 0x55b609d40e60 2023-09-21T13:02:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef68d94b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609d4c710 con 0x55b609d3b7a0 2023-09-21T13:02:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef4effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef4effd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38398/0 (socket says 172.21.15.142:38398) 2023-09-21T13:02:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef4effd700 1 -- 172.21.15.142:0/3045805433 learned_addr learned my addr 172.21.15.142:0/3045805433 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.982+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d41780 0x55b609d3fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 -- 172.21.15.142:0/3045805433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 msgr2=0x55b609d442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 -- 172.21.15.142:0/3045805433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d41780 msgr2=0x55b609d3fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d41780 0x55b609d3fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 -- 172.21.15.142:0/3045805433 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b609d5c350 con 0x55b609d3b7a0 2023-09-21T13:02:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef4effd700 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef40009fd0 tx=0x7fef40011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a696d35155e1a40 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.983+0000 7fef35ffb700 1 -- 172.21.15.142:0/3045805433 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40022070 con 0x55b609d3b7a0 2023-09-21T13:02:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef35ffb700 1 -- 172.21.15.142:0/3045805433 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef40004560 con 0x55b609d3b7a0 2023-09-21T13:02:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef35ffb700 1 -- 172.21.15.142:0/3045805433 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4002f800 con 0x55b609d3b7a0 2023-09-21T13:02:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 -- 172.21.15.142:0/3045805433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 msgr2=0x55b609d4c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef40009fd0 tx=0x7fef40011b90 comp rx=0 tx=0).stop 2023-09-21T13:02:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 -- 172.21.15.142:0/3045805433 shutdown_connections 2023-09-21T13:02:42.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d41780 0x55b609d3fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d3b7a0 0x55b609d4c1d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 --2- 172.21.15.142:0/3045805433 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d40e60 0x55b609d442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 -- 172.21.15.142:0/3045805433 >> 172.21.15.142:0/3045805433 conn(0x55b609c67fa0 msgr2=0x55b609d3ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:42.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 -- 172.21.15.142:0/3045805433 shutdown_connections 2023-09-21T13:02:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.984+0000 7fef68d94b80 1 -- 172.21.15.142:0/3045805433 wait complete. 2023-09-21T13:02:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.985+0000 7fef68d94b80 1 -- start start 2023-09-21T13:02:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.985+0000 7fef68d94b80 1 Processor -- start 2023-09-21T13:02:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d4a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d4a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609d4aa80 con 0x55b609d40e60 2023-09-21T13:02:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609d4abf0 con 0x55b609d3b7a0 2023-09-21T13:02:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b609d4adb0 con 0x55b609d41780 2023-09-21T13:02:42.994 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef68d94b80 10 client.0 _ll_register_callbacks cb 0x55b609b73a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef4e7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d4a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef4f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d4a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:42.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef4effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37304/0 (socket says 172.21.15.142:37304) 2023-09-21T13:02:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.986+0000 7fef4effd700 1 -- 172.21.15.142:0/73308747 learned_addr learned my addr 172.21.15.142:0/73308747 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 -- 172.21.15.142:0/73308747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 msgr2=0x55b609d4a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d4a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 -- 172.21.15.142:0/73308747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 msgr2=0x55b609d4a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:42.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d4a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 -- 172.21.15.142:0/73308747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b609aa0c00 con 0x55b609d3b7a0 2023-09-21T13:02:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4f7fe700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef4effd700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef400276d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=881c5e65dc830dc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:42.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef32ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef40022070 con 0x55b609d3b7a0 2023-09-21T13:02:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef4409d340 con 0x55b609d3b7a0 2023-09-21T13:02:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fef40005050 con 0x55b609d3b7a0 2023-09-21T13:02:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef40027ad0 con 0x55b609d3b7a0 2023-09-21T13:02:42.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef68d94b80 10 client.27263 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.987+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b609ade1f0 con 0x55b609d3b7a0 2023-09-21T13:02:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef4409d340 con 0x55b609d3b7a0 2023-09-21T13:02:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fef40041030 con 0x55b609d3b7a0 2023-09-21T13:02:42.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 10 client.27263 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 10 client.27263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 20 client.27263 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609daa1b0 0x55b609dac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 4 client.27263 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:02:43.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b609c85e00 con 0x55b609daa1b0 2023-09-21T13:02:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.988+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609daa1b0 0x55b609dac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.989+0000 7fef4e7fc700 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609daa1b0 0x55b609dac5a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5c3c16f9698471 server_cookie=cf7519e4e420245 in_seq=0 out_seq=0 2023-09-21T13:02:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:42.989+0000 7fef32ff5700 10 client.27263 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef32ff5700 1 -- 172.21.15.142:0/73308747 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b609c85e00 con 0x55b609daa1b0 2023-09-21T13:02:43.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef32ff5700 10 client.27263 handle_command_reply: tid=0 2023-09-21T13:02:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 client.27263 shutdown 2023-09-21T13:02:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 msgr2=0x55b609d4bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fef40009ac0 tx=0x7fef400276d0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 shutdown_connections 2023-09-21T13:02:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b609daa1b0 0x55b609dac5a0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b609d41780 0x55b609d4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b609d3b7a0 0x55b609d4bd10 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef32ff5700 0 client.27263 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 --2- 172.21.15.142:0/73308747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b609d40e60 0x55b609d4a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 >> 172.21.15.142:0/73308747 conn(0x55b609c67fa0 msgr2=0x55b609d452c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 shutdown_connections 2023-09-21T13:02:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 1 -- 172.21.15.142:0/73308747 wait complete. 2023-09-21T13:02:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.039+0000 7fef68d94b80 20 client.27263 trim_cache size 0 max 16384 2023-09-21T13:02:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:02:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:02:43.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:02:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:02:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 msgr2=0x7fef380a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 0x7fef380a2cf0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fef40009c60 tx=0x7fef40009260 comp rx=0 tx=0).stop 2023-09-21T13:02:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 msgr2=0x7fef50199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fef4400e9a0 tx=0x7fef4400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 shutdown_connections 2023-09-21T13:02:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fef380a0830 0x7fef380a2cf0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fef500731b0 0x7fef50199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef5010d440 0x7fef5019d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 --2- 172.21.15.142:0/1379947197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fef50073ad0 0x7fef50199570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 >> 172.21.15.142:0/1379947197 conn(0x7fef500fc6d0 msgr2=0x7fef50104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 shutdown_connections 2023-09-21T13:02:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:43.040+0000 7fef4ffff700 1 -- 172.21.15.142:0/1379947197 wait complete. 2023-09-21T13:02:43.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 580113 8.71 MB/sec execute 204 sec latency 42.776 ms 2023-09-21T13:02:44.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:43 smithi156 ceph-mon[134078]: pgmap v198: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:44.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:43 smithi142 ceph-mon[97663]: pgmap v198: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:44.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:43 smithi160 ceph-mon[134450]: pgmap v198: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:44.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 582486 8.74 MB/sec execute 205 sec latency 17.053 ms 2023-09-21T13:02:45.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 583765 8.72 MB/sec execute 206 sec latency 22.435 ms 2023-09-21T13:02:45.845 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:02:46.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 -- 172.21.15.142:0/173040103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde8108310 msgr2=0x7fcde810fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 --2- 172.21.15.142:0/173040103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde8108310 0x7fcde810fe90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009f90 tx=0x7fcde000b330 comp rx=0 tx=0).stop 2023-09-21T13:02:46.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 -- 172.21.15.142:0/173040103 shutdown_connections 2023-09-21T13:02:46.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 --2- 172.21.15.142:0/173040103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde8108310 0x7fcde810fe90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 --2- 172.21.15.142:0/173040103 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde81031f0 0x7fcde81035d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 --2- 172.21.15.142:0/173040103 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde8103ba0 0x7fcde8107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.110+0000 7fcdeedff700 1 -- 172.21.15.142:0/173040103 >> 172.21.15.142:0/173040103 conn(0x7fcde80fea30 msgr2=0x7fcde8100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.111+0000 7fcdeedff700 1 -- 172.21.15.142:0/173040103 shutdown_connections 2023-09-21T13:02:46.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.111+0000 7fcdeedff700 1 -- 172.21.15.142:0/173040103 wait complete. 2023-09-21T13:02:46.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 Processor -- start 2023-09-21T13:02:46.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 -- start start 2023-09-21T13:02:46.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde81031f0 0x7fcde81991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 0x7fcde819dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819e5f0 con 0x7fcde819db70 2023-09-21T13:02:46.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819e760 con 0x7fcde8108310 2023-09-21T13:02:46.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdeedff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde819e920 con 0x7fcde81031f0 2023-09-21T13:02:46.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41036/0 (socket says 172.21.15.142:41036) 2023-09-21T13:02:46.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde81031f0 0x7fcde81991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcde7fff700 1 -- 172.21.15.142:0/480872093 learned_addr learned my addr 172.21.15.142:0/480872093 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:46.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.112+0000 7fcded39c700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 0x7fcde819dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 -- 172.21.15.142:0/480872093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde81031f0 msgr2=0x7fcde81991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde81031f0 0x7fcde81991d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 -- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 msgr2=0x7fcde819dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 0x7fcde819dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 -- 172.21.15.142:0/480872093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde0009c40 con 0x7fcde8108310 2023-09-21T13:02:46.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcded39c700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 0x7fcde819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:02:46.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde7fff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9f0 tx=0x7fcdd400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde5ffb700 1 -- 172.21.15.142:0/480872093 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4009690 con 0x7fcde8108310 2023-09-21T13:02:46.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde5ffb700 1 -- 172.21.15.142:0/480872093 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcdd400ce80 con 0x7fcde8108310 2023-09-21T13:02:46.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde81a5e80 con 0x7fcde8108310 2023-09-21T13:02:46.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.114+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde81a62b0 con 0x7fcde8108310 2023-09-21T13:02:46.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.113+0000 7fcde5ffb700 1 -- 172.21.15.142:0/480872093 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4018680 con 0x7fcde8108310 2023-09-21T13:02:46.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.119+0000 7fcde5ffb700 1 -- 172.21.15.142:0/480872093 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcdd4010430 con 0x7fcde8108310 2023-09-21T13:02:46.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.120+0000 7fce026c5b80 1 Processor -- start 2023-09-21T13:02:46.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.122+0000 7fce026c5b80 1 -- start start 2023-09-21T13:02:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb7b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb7ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabae6ca0 con 0x564eabb7ae20 2023-09-21T13:02:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabacac70 con 0x564eabb7fb70 2023-09-21T13:02:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fce026c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabac8590 con 0x564eabb7b740 2023-09-21T13:02:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fcde5ffb700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 0x7fcdd80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.123+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39524/0 (socket says 172.21.15.142:39524) 2023-09-21T13:02:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 -- 172.21.15.142:0/879866346 learned_addr learned my addr 172.21.15.142:0/879866346 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:46.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcde5ffb700 1 -- 172.21.15.142:0/480872093 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdd4014070 con 0x7fcde8108310 2023-09-21T13:02:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcde7fff700 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb7ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 -- 172.21.15.142:0/879866346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 msgr2=0x564eabb7ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb7ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 -- 172.21.15.142:0/879866346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 msgr2=0x564eabb7b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb7b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcdecb9b700 1 -- 172.21.15.142:0/879866346 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eab8eede0 con 0x564eabb7b740 2023-09-21T13:02:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcded39c700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 0x7fcdd80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.124+0000 7fcde7fff700 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb7ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:02:46.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.125+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009d80 tx=0x7fcddc011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fc0d5b93b30069 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.125+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/879866346 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc004230 con 0x564eabb7b740 2023-09-21T13:02:46.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.126+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/879866346 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcddc004390 con 0x564eabb7b740 2023-09-21T13:02:46.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.126+0000 7fcdd2ffd700 1 -- 172.21.15.142:0/879866346 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc019880 con 0x564eabb7b740 2023-09-21T13:02:46.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.126+0000 7fce026c5b80 1 -- 172.21.15.142:0/879866346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 msgr2=0x564eabb7f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.126+0000 7fce026c5b80 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009d80 tx=0x7fcddc011720 comp rx=0 tx=0).stop 2023-09-21T13:02:46.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.126+0000 7fcded39c700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 0x7fcdd80a2cf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009c10 tx=0x7fcde0009ac0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.127+0000 7fce026c5b80 1 -- 172.21.15.142:0/879866346 shutdown_connections 2023-09-21T13:02:46.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.127+0000 7fce026c5b80 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb7b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.127+0000 7fce026c5b80 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb7ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.127+0000 7fce026c5b80 1 --2- 172.21.15.142:0/879866346 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f630 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.127+0000 7fce026c5b80 1 -- 172.21.15.142:0/879866346 >> 172.21.15.142:0/879866346 conn(0x564eaba9f000 msgr2=0x564eabb6d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.128+0000 7fce026c5b80 1 -- 172.21.15.142:0/879866346 shutdown_connections 2023-09-21T13:02:46.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.128+0000 7fce026c5b80 1 -- 172.21.15.142:0/879866346 wait complete. 2023-09-21T13:02:46.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.128+0000 7fce026c5b80 1 -- start start 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.129+0000 7fce026c5b80 1 Processor -- start 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7ae20 0x564eabb84690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb85110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabac3e80 con 0x564eabb7fb70 2023-09-21T13:02:46.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eaba60740 con 0x564eabb7b740 2023-09-21T13:02:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eaba603e0 con 0x564eabb7ae20 2023-09-21T13:02:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fce026c5b80 10 client.0 _ll_register_callbacks cb 0x564eab9aaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41052/0 (socket says 172.21.15.142:41052) 2023-09-21T13:02:46.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fcde7fff700 1 -- 172.21.15.142:0/544937741 learned_addr learned my addr 172.21.15.142:0/544937741 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:46.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.130+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7ae20 0x564eabb84690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 -- 172.21.15.142:0/544937741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7ae20 msgr2=0x564eabb84690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7ae20 0x564eabb84690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 -- 172.21.15.142:0/544937741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 msgr2=0x564eabb85110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb85110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 -- 172.21.15.142:0/544937741 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcddc0099e0 con 0x564eabb7b740 2023-09-21T13:02:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcde7fff700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4099200 tx=0x7fcdd4099d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5065d80c5b00322e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcdc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:02:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd409d120 con 0x564eabb7b740 2023-09-21T13:02:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564eaba34bb0 con 0x564eabb7b740 2023-09-21T13:02:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdd40a1570 con 0x564eabb7b740 2023-09-21T13:02:46.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdd40989f0 con 0x564eabb7b740 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fce026c5b80 10 client.27272 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.131+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564eab8d7c60 con 0x564eabb7b740 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564eaba34bb0 con 0x564eabb7b740 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcdd40952f0 con 0x564eabb7b740 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 10 client.27272 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:46.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 10 client.27272 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 20 client.27272 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabb94d60 0x564eabb97180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 4 client.27272 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.132+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564eabb41020 con 0x564eabb94d60 2023-09-21T13:02:46.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.133+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabb94d60 0x564eabb97180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.133+0000 7fcdc7fff700 10 client.27272 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.133+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabb94d60 0x564eabb97180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2781b882cced17f server_cookie=eaf01c1047c80fbf in_seq=0 out_seq=0 2023-09-21T13:02:46.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fcdc7fff700 1 -- 172.21.15.142:0/544937741 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564eabb41020 con 0x564eabb94d60 2023-09-21T13:02:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fcdc7fff700 10 client.27272 handle_command_reply: tid=0 2023-09-21T13:02:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 client.27272 shutdown 2023-09-21T13:02:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 msgr2=0x564eabb84bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4099200 tx=0x7fcdd4099d50 comp rx=0 tx=0).stop 2023-09-21T13:02:46.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 shutdown_connections 2023-09-21T13:02:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabb94d60 0x564eabb97180 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb85110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7ae20 0x564eabb84690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 --2- 172.21.15.142:0/544937741 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7b740 0x564eabb84bd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 >> 172.21.15.142:0/544937741 conn(0x564eaba9f000 msgr2=0x564eabb6d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.134+0000 7fcdc7fff700 0 client.27272 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.135+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 shutdown_connections 2023-09-21T13:02:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.135+0000 7fce026c5b80 1 -- 172.21.15.142:0/544937741 wait complete. 2023-09-21T13:02:46.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.135+0000 7fce026c5b80 20 client.27272 trim_cache size 0 max 16384 2023-09-21T13:02:46.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.155+0000 7fce026c5b80 1 Processor -- start 2023-09-21T13:02:46.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 -- start start 2023-09-21T13:02:46.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb81800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eab944920 con 0x564eabb7fb70 2023-09-21T13:02:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabb6e280 con 0x564eabb7ae20 2023-09-21T13:02:46.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fce026c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabb6db70 con 0x564eabb7b740 2023-09-21T13:02:46.157 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:45 smithi156 ceph-mon[134078]: pgmap v199: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:46.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:41056/0 (socket says 172.21.15.142:41056) 2023-09-21T13:02:46.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fcdecb9b700 1 -- 172.21.15.142:0/1688059711 learned_addr learned my addr 172.21.15.142:0/1688059711 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:46.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fcde7fff700 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.156+0000 7fcded39c700 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb81800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 -- 172.21.15.142:0/1688059711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 msgr2=0x564eabb7f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 -- 172.21.15.142:0/1688059711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 msgr2=0x564eabb81800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb81800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 -- 172.21.15.142:0/1688059711 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564eab915250 con 0x564eabb7ae20 2023-09-21T13:02:46.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01b040 tx=0x7fcddc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8905277f3eb5bfcd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdd37fe700 1 -- 172.21.15.142:0/1688059711 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc029040 con 0x564eabb7ae20 2023-09-21T13:02:46.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdd37fe700 1 -- 172.21.15.142:0/1688059711 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcddc0040f0 con 0x564eabb7ae20 2023-09-21T13:02:46.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.157+0000 7fcdd37fe700 1 -- 172.21.15.142:0/1688059711 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc005330 con 0x564eabb7ae20 2023-09-21T13:02:46.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 -- 172.21.15.142:0/1688059711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 msgr2=0x564eabb8bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01b040 tx=0x7fcddc011720 comp rx=0 tx=0).stop 2023-09-21T13:02:46.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 -- 172.21.15.142:0/1688059711 shutdown_connections 2023-09-21T13:02:46.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7fb70 0x564eabb81800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7ae20 0x564eabb8bcf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 --2- 172.21.15.142:0/1688059711 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 -- 172.21.15.142:0/1688059711 >> 172.21.15.142:0/1688059711 conn(0x564eaba9f000 msgr2=0x564eabb7ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 -- 172.21.15.142:0/1688059711 shutdown_connections 2023-09-21T13:02:46.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.158+0000 7fce026c5b80 1 -- 172.21.15.142:0/1688059711 wait complete. 2023-09-21T13:02:46.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.159+0000 7fce026c5b80 1 -- start start 2023-09-21T13:02:46.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.159+0000 7fce026c5b80 1 Processor -- start 2023-09-21T13:02:46.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.159+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb8bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.159+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fce026c5b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb80490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fce026c5b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabb809d0 con 0x564eabb7ae20 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fce026c5b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabb80b40 con 0x564eabb7fb70 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fce026c5b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564eabb80d00 con 0x564eabb7b740 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fce026c5b80 10 client.0 _ll_register_callbacks cb 0x564eab9aaa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:46.165 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcdecb9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb8bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39548/0 (socket says 172.21.15.142:39548) 2023-09-21T13:02:46.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 -- 172.21.15.142:0/2799028110 learned_addr learned my addr 172.21.15.142:0/2799028110 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:46.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcded39c700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb80490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 -- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 msgr2=0x564eabb80490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb80490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 -- 172.21.15.142:0/2799028110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 msgr2=0x564eabb8bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:46.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb8bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.160+0000 7fcde7fff700 1 -- 172.21.15.142:0/2799028110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564eab8eede0 con 0x564eabb7b740 2023-09-21T13:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcde7fff700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4095f70 tx=0x7fcdd4010940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1f6797af16b803b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd409d120 con 0x564eabb7b740 2023-09-21T13:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcdd40a1570 con 0x564eabb7b740 2023-09-21T13:02:46.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcddc004390 con 0x564eabb7b740 2023-09-21T13:02:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcdd4099040 con 0x564eabb7b740 2023-09-21T13:02:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fce026c5b80 10 client.27244 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x564eab8ed2b0 con 0x564eabb7b740 2023-09-21T13:02:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcddc004390 con 0x564eabb7b740 2023-09-21T13:02:46.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.161+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcdd4098460 con 0x564eabb7b740 2023-09-21T13:02:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 10 client.27244 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 10 client.27244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 20 client.27244 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabbe9df0 0x564eabbec210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:46.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 4 client.27244 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564eababce60 con 0x564eabbe9df0 2023-09-21T13:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabbe9df0 0x564eabbec210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fcdc7fff700 10 client.27244 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fcdecb9b700 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabbe9df0 0x564eabbec210 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb76092396fc01 server_cookie=d49f5d3b02c98eb in_seq=0 out_seq=0 2023-09-21T13:02:46.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fcdc7fff700 1 -- 172.21.15.142:0/2799028110 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564eababce60 con 0x564eabbe9df0 2023-09-21T13:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fcdc7fff700 10 client.27244 handle_command_reply: tid=0 2023-09-21T13:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.162+0000 7fce026c5b80 1 client.27244 shutdown 2023-09-21T13:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 msgr2=0x564eabb7ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4095f70 tx=0x7fcdd4010940 comp rx=0 tx=0).stop 2023-09-21T13:02:46.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 shutdown_connections 2023-09-21T13:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564eabbe9df0 0x564eabbec210 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564eabb7ae20 0x564eabb8bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564eabb7fb70 0x564eabb80490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 --2- 172.21.15.142:0/2799028110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564eabb7b740 0x564eabb7ff50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fcdc7fff700 0 client.27244 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 >> 172.21.15.142:0/2799028110 conn(0x564eaba9f000 msgr2=0x564eabb81800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 shutdown_connections 2023-09-21T13:02:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 1 -- 172.21.15.142:0/2799028110 wait complete. 2023-09-21T13:02:46.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.163+0000 7fce026c5b80 20 client.27244 trim_cache size 0 max 16384 2023-09-21T13:02:46.177 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:02:46.177 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:02:46.177 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:02:46.177 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:02:46.177 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:02:46.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:02:46.178 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:02:46.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:02:46.178 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:02:46.178 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:02:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 msgr2=0x7fcdd80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 0x7fcdd80a2cf0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcde0009c10 tx=0x7fcde0009ac0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 msgr2=0x7fcde8199710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9f0 tx=0x7fcdd400ed00 comp rx=0 tx=0).stop 2023-09-21T13:02:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 shutdown_connections 2023-09-21T13:02:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcdd80a0830 0x7fcdd80a2cf0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcde819db70 0x7fcde819dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcde81031f0 0x7fcde81991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 --2- 172.21.15.142:0/480872093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcde8108310 0x7fcde8199710 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 >> 172.21.15.142:0/480872093 conn(0x7fcde80fea30 msgr2=0x7fcde80ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 shutdown_connections 2023-09-21T13:02:46.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:02:46.164+0000 7fcdeedff700 1 -- 172.21.15.142:0/480872093 wait complete. 2023-09-21T13:02:46.182 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:45 smithi142 ceph-mon[97663]: pgmap v199: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:46.183 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:02:46.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:45 smithi160 ceph-mon[134450]: pgmap v199: 97 pgs: 97 active+clean; 169 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 199 op/s 2023-09-21T13:02:46.693 INFO:tasks.workunit.client.0.smithi142.stdout: 1 586080 8.75 MB/sec execute 207 sec latency 20.993 ms 2023-09-21T13:02:47.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 587331 8.73 MB/sec execute 208 sec latency 14.837 ms 2023-09-21T13:02:48.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:47 smithi156 ceph-mon[134078]: pgmap v200: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 315 op/s 2023-09-21T13:02:48.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:47 smithi142 ceph-mon[97663]: pgmap v200: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 315 op/s 2023-09-21T13:02:48.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:47 smithi160 ceph-mon[134450]: pgmap v200: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.1 MiB/s wr, 315 op/s 2023-09-21T13:02:48.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 589680 8.76 MB/sec execute 209 sec latency 21.212 ms 2023-09-21T13:02:49.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 591046 8.75 MB/sec execute 210 sec latency 14.940 ms 2023-09-21T13:02:50.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:49 smithi156 ceph-mon[134078]: pgmap v201: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:02:50.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:49 smithi142 ceph-mon[97663]: pgmap v201: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:02:50.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:49 smithi160 ceph-mon[134450]: pgmap v201: 97 pgs: 97 active+clean; 170 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:02:50.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 593281 8.77 MB/sec execute 211 sec latency 15.077 ms 2023-09-21T13:02:51.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 593965 8.74 MB/sec execute 212 sec latency 270.483 ms 2023-09-21T13:02:52.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:51 smithi156 ceph-mon[134078]: pgmap v202: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 318 op/s 2023-09-21T13:02:52.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:51 smithi142 ceph-mon[97663]: pgmap v202: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 318 op/s 2023-09-21T13:02:52.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:51 smithi160 ceph-mon[134450]: pgmap v202: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 318 op/s 2023-09-21T13:02:52.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 594233 8.70 MB/sec execute 213 sec latency 877.592 ms 2023-09-21T13:02:53.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 594856 8.68 MB/sec execute 214 sec latency 1465.763 ms 2023-09-21T13:02:54.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:53 smithi156 ceph-mon[134078]: pgmap v203: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:54.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:53 smithi142 ceph-mon[97663]: pgmap v203: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:54.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:53 smithi160 ceph-mon[134450]: pgmap v203: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:54.694 INFO:tasks.workunit.client.0.smithi142.stdout: 1 596842 8.70 MB/sec execute 215 sec latency 74.084 ms 2023-09-21T13:02:55.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 597780 8.67 MB/sec execute 216 sec latency 230.846 ms 2023-09-21T13:02:56.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:55 smithi156 ceph-mon[134078]: pgmap v204: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:56.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:55 smithi142 ceph-mon[97663]: pgmap v204: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:56.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:55 smithi160 ceph-mon[134450]: pgmap v204: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 213 op/s 2023-09-21T13:02:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 -- 172.21.15.142:0/3639382747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798068b90 msgr2=0x7f579810dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 --2- 172.21.15.142:0/3639382747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798068b90 0x7f579810dc30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f579000b0d0 tx=0x7f579000b3e0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 -- 172.21.15.142:0/3639382747 shutdown_connections 2023-09-21T13:02:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 --2- 172.21.15.142:0/3639382747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798105d60 0x7f5798106140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 --2- 172.21.15.142:0/3639382747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5798068b90 0x7f579810dc30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 --2- 172.21.15.142:0/3639382747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57980681d0 0x7f5798068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.209+0000 7f57a03ff700 1 -- 172.21.15.142:0/3639382747 >> 172.21.15.142:0/3639382747 conn(0x7f5798076800 msgr2=0x7f5798076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.210+0000 7f57a03ff700 1 -- 172.21.15.142:0/3639382747 shutdown_connections 2023-09-21T13:02:56.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.210+0000 7f57a03ff700 1 -- 172.21.15.142:0/3639382747 wait complete. 2023-09-21T13:02:56.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.210+0000 7f57a03ff700 1 Processor -- start 2023-09-21T13:02:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 -- start start 2023-09-21T13:02:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798068b90 0x7f57981006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798105d60 0x7f57981a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a5650 con 0x7f5798068b90 2023-09-21T13:02:56.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a57c0 con 0x7f57980681d0 2023-09-21T13:02:56.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f57a03ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981a5980 con 0x7f5798105d60 2023-09-21T13:02:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f579e19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f579e19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34182/0 (socket says 172.21.15.142:34182) 2023-09-21T13:02:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f579e19b700 1 -- 172.21.15.142:0/1870810737 learned_addr learned my addr 172.21.15.142:0/1870810737 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.211+0000 7f579d99a700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798068b90 0x7f57981006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e99c700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798105d60 0x7f57981a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 -- 172.21.15.142:0/1870810737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798105d60 msgr2=0x7f57981a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798105d60 0x7f57981a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 -- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798068b90 msgr2=0x7f57981006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798068b90 0x7f57981006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 -- 172.21.15.142:0/1870810737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009d00 con 0x7f57980681d0 2023-09-21T13:02:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f579e19b700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9a0 tx=0x7f579400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f578f7fe700 1 -- 172.21.15.142:0/1870810737 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794009790 con 0x7f57980681d0 2023-09-21T13:02:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f578f7fe700 1 -- 172.21.15.142:0/1870810737 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579400cbd0 con 0x7f57980681d0 2023-09-21T13:02:56.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f578f7fe700 1 -- 172.21.15.142:0/1870810737 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794018680 con 0x7f57980681d0 2023-09-21T13:02:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.212+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57981a5c60 con 0x7f57980681d0 2023-09-21T13:02:56.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.213+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57981a6170 con 0x7f57980681d0 2023-09-21T13:02:56.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.217+0000 7f578f7fe700 1 -- 172.21.15.142:0/1870810737 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f579400cd40 con 0x7f57980681d0 2023-09-21T13:02:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.218+0000 7f57b3cb7b80 1 Processor -- start 2023-09-21T13:02:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.218+0000 7f57b3cb7b80 1 -- start start 2023-09-21T13:02:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd293d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2941910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd28b1c40 con 0x55efd293d0a0 2023-09-21T13:02:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd2895c10 con 0x55efd2941e50 2023-09-21T13:02:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd2893530 con 0x55efd293d9c0 2023-09-21T13:02:56.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34196/0 (socket says 172.21.15.142:34196) 2023-09-21T13:02:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 -- 172.21.15.142:0/421698410 learned_addr learned my addr 172.21.15.142:0/421698410 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579e99c700 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd293d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579e19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2941910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f578f7fe700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 0x7f57840a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 -- 172.21.15.142:0/421698410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 msgr2=0x55efd2941910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2941910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 -- 172.21.15.142:0/421698410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 msgr2=0x55efd293d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd293d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f579d99a700 1 -- 172.21.15.142:0/421698410 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efd26b9d80 con 0x55efd2941e50 2023-09-21T13:02:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.219+0000 7f578f7fe700 1 -- 172.21.15.142:0/1870810737 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5794014070 con 0x7f57980681d0 2023-09-21T13:02:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.220+0000 7f579e99c700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 0x7f57840a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.220+0000 7f579d99a700 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5788009cf0 tx=0x7f5788011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a9369efbde8259 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.220+0000 7f578cbfe700 1 -- 172.21.15.142:0/421698410 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788011d80 con 0x55efd2941e50 2023-09-21T13:02:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.220+0000 7f578cbfe700 1 -- 172.21.15.142:0/421698410 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5788004510 con 0x55efd2941e50 2023-09-21T13:02:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.220+0000 7f578cbfe700 1 -- 172.21.15.142:0/421698410 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5788005280 con 0x55efd2941e50 2023-09-21T13:02:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/421698410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 msgr2=0x55efd29422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f579e99c700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 0x7f57840a2cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f579000b770 tx=0x7f57900099e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5788009cf0 tx=0x7f5788011440 comp rx=0 tx=0).stop 2023-09-21T13:02:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/421698410 shutdown_connections 2023-09-21T13:02:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd293d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29422b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/421698410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2941910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/421698410 >> 172.21.15.142:0/421698410 conn(0x55efd2869fa0 msgr2=0x55efd29380c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/421698410 shutdown_connections 2023-09-21T13:02:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/421698410 wait complete. 2023-09-21T13:02:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.221+0000 7f57b3cb7b80 1 -- start start 2023-09-21T13:02:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 Processor -- start 2023-09-21T13:02:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2946eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29473f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd288ee20 con 0x55efd293d0a0 2023-09-21T13:02:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd282b6e0 con 0x55efd2941e50 2023-09-21T13:02:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd282b380 con 0x55efd293d9c0 2023-09-21T13:02:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f57b3cb7b80 10 client.0 _ll_register_callbacks cb 0x55efd2775a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f579e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f579e99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f579e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47060/0 (socket says 172.21.15.142:47060) 2023-09-21T13:02:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.222+0000 7f579e19b700 1 -- 172.21.15.142:0/983682698 learned_addr learned my addr 172.21.15.142:0/983682698 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579d99a700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2946eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 -- 172.21.15.142:0/983682698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 msgr2=0x55efd2946eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2946eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 -- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 msgr2=0x55efd29473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 -- 172.21.15.142:0/983682698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5788009920 con 0x55efd293d0a0 2023-09-21T13:02:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e99c700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f579e19b700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f579401e000 tx=0x7f5794099130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d4c56a1c86a4a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f5781ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794099cf0 con 0x55efd293d0a0 2023-09-21T13:02:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55efd27ffb50 con 0x55efd293d0a0 2023-09-21T13:02:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.223+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f57940995f0 con 0x55efd293d0a0 2023-09-21T13:02:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579409d420 con 0x55efd293d0a0 2023-09-21T13:02:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 10 client.17196 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efd26a2c00 con 0x55efd293d0a0 2023-09-21T13:02:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55efd27ffb50 con 0x55efd293d0a0 2023-09-21T13:02:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5794098c00 con 0x55efd293d0a0 2023-09-21T13:02:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 10 client.17196 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 10 client.17196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 20 client.17196 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2956fc0 0x55efd29593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 4 client.17196 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:02:56.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.224+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55efd290bfc0 con 0x55efd2956fc0 2023-09-21T13:02:56.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.225+0000 7f579d99a700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2956fc0 0x55efd29593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.225+0000 7f5781ffb700 10 client.17196 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:56.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.225+0000 7f579d99a700 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2956fc0 0x55efd29593e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=629738f061daf2bf server_cookie=39725ac09f7fbd04 in_seq=0 out_seq=0 2023-09-21T13:02:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f5781ffb700 1 -- 172.21.15.142:0/983682698 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55efd290bfc0 con 0x55efd2956fc0 2023-09-21T13:02:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f5781ffb700 10 client.17196 handle_command_reply: tid=0 2023-09-21T13:02:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 client.17196 shutdown 2023-09-21T13:02:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 msgr2=0x55efd2946970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f579401e000 tx=0x7f5794099130 comp rx=0 tx=0).stop 2023-09-21T13:02:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 shutdown_connections 2023-09-21T13:02:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2956fc0 0x55efd29593e0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d0a0 0x55efd2946970 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2941e50 0x55efd29473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/983682698 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d9c0 0x55efd2946eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 >> 172.21.15.142:0/983682698 conn(0x55efd2869fa0 msgr2=0x55efd2937cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f5781ffb700 0 client.17196 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 shutdown_connections 2023-09-21T13:02:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/983682698 wait complete. 2023-09-21T13:02:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.226+0000 7f57b3cb7b80 20 client.17196 trim_cache size 0 max 16384 2023-09-21T13:02:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 Processor -- start 2023-09-21T13:02:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 -- start start 2023-09-21T13:02:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd2947220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 0x55efd2940f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd270f8c0 con 0x55efd293d9c0 2023-09-21T13:02:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd2949dc0 con 0x55efd2869fa0 2023-09-21T13:02:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.245+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd2936ef0 con 0x55efd293d0a0 2023-09-21T13:02:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 0x55efd2940f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34206/0 (socket says 172.21.15.142:34206) 2023-09-21T13:02:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 -- 172.21.15.142:0/438868888 learned_addr learned my addr 172.21.15.142:0/438868888 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579d99a700 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd2947220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 -- 172.21.15.142:0/438868888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 msgr2=0x55efd2947220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd2947220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 -- 172.21.15.142:0/438868888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 msgr2=0x55efd2940f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 0x55efd2940f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 -- 172.21.15.142:0/438868888 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55efd295e010 con 0x55efd2869fa0 2023-09-21T13:02:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e99c700 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 0x55efd2940f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:02:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f579e19b700 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f579400c5b0 tx=0x7f57940c9980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=392d8740535fd818 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f578d3ff700 1 -- 172.21.15.142:0/438868888 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940a12c0 con 0x55efd2869fa0 2023-09-21T13:02:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f578d3ff700 1 -- 172.21.15.142:0/438868888 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5794099cf0 con 0x55efd2869fa0 2023-09-21T13:02:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.246+0000 7f578d3ff700 1 -- 172.21.15.142:0/438868888 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794098ae0 con 0x55efd2869fa0 2023-09-21T13:02:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/438868888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 msgr2=0x55efd293f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f579400c5b0 tx=0x7f57940c9980 comp rx=0 tx=0).stop 2023-09-21T13:02:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/438868888 shutdown_connections 2023-09-21T13:02:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd293d9c0 0x55efd2940f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd2869fa0 0x55efd293f740 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/438868888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd2947220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/438868888 >> 172.21.15.142:0/438868888 conn(0x55efd2942590 msgr2=0x55efd293ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/438868888 shutdown_connections 2023-09-21T13:02:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.247+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/438868888 wait complete. 2023-09-21T13:02:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.248+0000 7f57b3cb7b80 1 -- start start 2023-09-21T13:02:56.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.248+0000 7f57b3cb7b80 1 Processor -- start 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.248+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 0x55efd294b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd294bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 0x55efd294c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd29a9e20 con 0x55efd2869fa0 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd29a9f90 con 0x55efd293d9c0 2023-09-21T13:02:56.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55efd29aa150 con 0x55efd293d0a0 2023-09-21T13:02:56.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f57b3cb7b80 10 client.0 _ll_register_callbacks cb 0x55efd2775a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:02:56.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 0x55efd294c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 0x55efd294b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e99c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 0x55efd294c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34208/0 (socket says 172.21.15.142:34208) 2023-09-21T13:02:56.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e99c700 1 -- 172.21.15.142:0/4166422024 learned_addr learned my addr 172.21.15.142:0/4166422024 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:02:56.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579d99a700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd294bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 -- 172.21.15.142:0/4166422024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 msgr2=0x55efd294bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd294bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 -- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 msgr2=0x55efd294c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 0x55efd294c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 -- 172.21.15.142:0/4166422024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579810e530 con 0x55efd2869fa0 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f579e19b700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 0x55efd294b6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f57940c9e90 tx=0x7f579400e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa55e740522ead10 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.249+0000 7f5781ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57940995f0 con 0x55efd2869fa0 2023-09-21T13:02:56.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f579409d420 con 0x55efd2869fa0 2023-09-21T13:02:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5788004510 con 0x55efd2869fa0 2023-09-21T13:02:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57940a1270 con 0x55efd2869fa0 2023-09-21T13:02:56.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 10 client.17202 fetch_fsmap learned FSMap version 32 2023-09-21T13:02:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55efd26a2c00 con 0x55efd2869fa0 2023-09-21T13:02:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5788004510 con 0x55efd2869fa0 2023-09-21T13:02:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 32) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f57940cf210 con 0x55efd2869fa0 2023-09-21T13:02:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 10 client.17202 fetch_fsmap finished waiting for FSMap version 32 2023-09-21T13:02:56.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 10 client.17202 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:02:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.250+0000 7f57b3cb7b80 20 client.17202 populate_metadata read hostname 'smithi142' 2023-09-21T13:02:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2941e50 0x55efd29ad440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:02:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f57b3cb7b80 4 client.17202 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:02:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55efd2887e00 con 0x55efd2941e50 2023-09-21T13:02:56.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f579d99a700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2941e50 0x55efd29ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:02:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f579d99a700 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2941e50 0x55efd29ad440 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5930d6b545fe530d server_cookie=12ff7993b91035ec in_seq=0 out_seq=0 2023-09-21T13:02:56.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.251+0000 7f5781ffb700 10 client.17202 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f5781ffb700 1 -- 172.21.15.142:0/4166422024 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55efd2887e00 con 0x55efd2941e50 2023-09-21T13:02:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f5781ffb700 10 client.17202 handle_command_reply: tid=0 2023-09-21T13:02:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 client.17202 shutdown 2023-09-21T13:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 msgr2=0x55efd294b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 0x55efd294b6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f57940c9e90 tx=0x7f579400e8f0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 shutdown_connections 2023-09-21T13:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55efd2941e50 0x55efd29ad440 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55efd2869fa0 0x55efd294b6e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55efd293d9c0 0x55efd294c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 --2- 172.21.15.142:0/4166422024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55efd293d0a0 0x55efd294bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 >> 172.21.15.142:0/4166422024 conn(0x55efd2942590 msgr2=0x55efd2947260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.295+0000 7f5781ffb700 0 client.17202 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.296+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 shutdown_connections 2023-09-21T13:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.296+0000 7f57b3cb7b80 1 -- 172.21.15.142:0/4166422024 wait complete. 2023-09-21T13:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.296+0000 7f57b3cb7b80 20 client.17202 trim_cache size 0 max 16384 2023-09-21T13:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 msgr2=0x7f57840a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 0x7f57840a2cf0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f579000b770 tx=0x7f57900099e0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 msgr2=0x7f5798100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f579400e9a0 tx=0x7f579400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 shutdown_connections 2023-09-21T13:02:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57840a0830 0x7f57840a2cf0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5798105d60 0x7f57981a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f57980681d0 0x7f5798100160 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 --2- 172.21.15.142:0/1870810737 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5798068b90 0x7f57981006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:02:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 >> 172.21.15.142:0/1870810737 conn(0x7f5798076800 msgr2=0x7f57980fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:02:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 shutdown_connections 2023-09-21T13:02:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:02:56.297+0000 7f57a03ff700 1 -- 172.21.15.142:0/1870810737 wait complete. 2023-09-21T13:02:56.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 598487 8.65 MB/sec execute 217 sec latency 803.913 ms 2023-09-21T13:02:57.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 600542 8.67 MB/sec execute 218 sec latency 19.415 ms 2023-09-21T13:02:58.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:57 smithi156 ceph-mon[134078]: pgmap v205: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 417 op/s 2023-09-21T13:02:58.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:57 smithi142 ceph-mon[97663]: pgmap v205: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 417 op/s 2023-09-21T13:02:58.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:57 smithi160 ceph-mon[134450]: pgmap v205: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.6 MiB/s wr, 417 op/s 2023-09-21T13:02:58.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 602081 8.65 MB/sec execute 219 sec latency 16.981 ms 2023-09-21T13:02:59.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 604113 8.68 MB/sec execute 220 sec latency 13.025 ms 2023-09-21T13:03:00.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:02:59 smithi142 ceph-mon[97663]: pgmap v206: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 301 op/s 2023-09-21T13:03:00.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:02:59 smithi160 ceph-mon[134450]: pgmap v206: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 301 op/s 2023-09-21T13:03:00.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:02:59 smithi156 ceph-mon[134078]: pgmap v206: 97 pgs: 97 active+clean; 175 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 5.8 MiB/s wr, 301 op/s 2023-09-21T13:03:00.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 604987 8.65 MB/sec execute 221 sec latency 262.759 ms 2023-09-21T13:03:01.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:00 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:03:01.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:00 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:03:01.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:00 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:03:01.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 605362 8.62 MB/sec execute 222 sec latency 881.166 ms 2023-09-21T13:03:02.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:01 smithi160 ceph-mon[134450]: pgmap v207: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 386 op/s 2023-09-21T13:03:02.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:01 smithi156 ceph-mon[134078]: pgmap v207: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 386 op/s 2023-09-21T13:03:02.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:01 smithi142 ceph-mon[97663]: pgmap v207: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 386 op/s 2023-09-21T13:03:02.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 606816 8.62 MB/sec execute 223 sec latency 30.092 ms 2023-09-21T13:03:03.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 608216 8.61 MB/sec execute 224 sec latency 21.752 ms 2023-09-21T13:03:04.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:03 smithi160 ceph-mon[134450]: pgmap v208: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:04.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:03 smithi156 ceph-mon[134078]: pgmap v208: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:04.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:03 smithi142 ceph-mon[97663]: pgmap v208: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:04.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 609699 8.60 MB/sec execute 225 sec latency 299.006 ms 2023-09-21T13:03:05.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 611310 8.62 MB/sec execute 226 sec latency 13.095 ms 2023-09-21T13:03:06.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:05 smithi160 ceph-mon[134450]: pgmap v209: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:06.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:05 smithi156 ceph-mon[134078]: pgmap v209: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:06.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:05 smithi142 ceph-mon[97663]: pgmap v209: 97 pgs: 97 active+clean; 169 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 5.3 MiB/s wr, 288 op/s 2023-09-21T13:03:06.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 613283 8.61 MB/sec execute 227 sec latency 18.490 ms 2023-09-21T13:03:07.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 614436 8.62 MB/sec execute 228 sec latency 41.277 ms 2023-09-21T13:03:08.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:07 smithi160 ceph-mon[134450]: pgmap v210: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 383 op/s 2023-09-21T13:03:08.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:07 smithi160 ceph-mon[134450]: osdmap e89: 12 total, 12 up, 12 in 2023-09-21T13:03:08.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:07 smithi156 ceph-mon[134078]: pgmap v210: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 383 op/s 2023-09-21T13:03:08.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:07 smithi156 ceph-mon[134078]: osdmap e89: 12 total, 12 up, 12 in 2023-09-21T13:03:08.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:07 smithi142 ceph-mon[97663]: pgmap v210: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 383 op/s 2023-09-21T13:03:08.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:07 smithi142 ceph-mon[97663]: osdmap e89: 12 total, 12 up, 12 in 2023-09-21T13:03:08.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 615847 8.61 MB/sec execute 229 sec latency 19.448 ms 2023-09-21T13:03:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.466+0000 7f3eb7bff700 1 -- 172.21.15.142:0/2972133120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb0073b30 msgr2=0x7f3eb010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.466+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/2972133120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb0073b30 0x7f3eb010d060 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009990 tx=0x7f3ea0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 -- 172.21.15.142:0/2972133120 shutdown_connections 2023-09-21T13:03:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/2972133120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073210 0x7f3eb00735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/2972133120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb010d5a0 0x7f3eb010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/2972133120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb0073b30 0x7f3eb010d060 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 -- 172.21.15.142:0/2972133120 >> 172.21.15.142:0/2972133120 conn(0x7f3eb00fc830 msgr2=0x7f3eb00fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 -- 172.21.15.142:0/2972133120 shutdown_connections 2023-09-21T13:03:09.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.467+0000 7f3eb7bff700 1 -- 172.21.15.142:0/2972133120 wait complete. 2023-09-21T13:03:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 Processor -- start 2023-09-21T13:03:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 -- start start 2023-09-21T13:03:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 0x7f3eb0199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb010d5a0 0x7f3eb019dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb019e2c0 con 0x7f3eb0073b30 2023-09-21T13:03:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb019e430 con 0x7f3eb0073210 2023-09-21T13:03:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.468+0000 7f3eb7bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb019e5f0 con 0x7f3eb010d5a0 2023-09-21T13:03:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 0x7f3eb0199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51832/0 (socket says 172.21.15.142:51832) 2023-09-21T13:03:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 -- 172.21.15.142:0/880574644 learned_addr learned my addr 172.21.15.142:0/880574644 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb619c700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb010d5a0 0x7f3eb019dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 -- 172.21.15.142:0/880574644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb010d5a0 msgr2=0x7f3eb019dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb010d5a0 0x7f3eb019dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 -- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 msgr2=0x7f3eb0199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 0x7f3eb0199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 -- 172.21.15.142:0/880574644 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009520 con 0x7f3eb0073210 2023-09-21T13:03:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb519a700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 0x7f3eb0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.469+0000 7f3eb599b700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00eb30 tx=0x7f3eac00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.470+0000 7f3ea6ffd700 1 -- 172.21.15.142:0/880574644 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac009880 con 0x7f3eb0073210 2023-09-21T13:03:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.470+0000 7f3ea6ffd700 1 -- 172.21.15.142:0/880574644 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3eac0044e0 con 0x7f3eb0073210 2023-09-21T13:03:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.470+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea00095f0 con 0x7f3eb0073210 2023-09-21T13:03:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.470+0000 7f3ea6ffd700 1 -- 172.21.15.142:0/880574644 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac003d80 con 0x7f3eb0073210 2023-09-21T13:03:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.470+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb01a5f30 con 0x7f3eb0073210 2023-09-21T13:03:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.474+0000 7f3ea6ffd700 1 -- 172.21.15.142:0/880574644 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f3eac003f20 con 0x7f3eb0073210 2023-09-21T13:03:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.475+0000 7f3ea6ffd700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 0x7f3e9c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.475+0000 7f3ecb57cb80 1 Processor -- start 2023-09-21T13:03:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.475+0000 7f3ea6ffd700 1 -- 172.21.15.142:0/880574644 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3eac014070 con 0x7f3eb0073210 2023-09-21T13:03:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3eb519a700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 0x7f3e9c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 -- start start 2023-09-21T13:03:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f33c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f33ce50 0x55e87f33d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f2acc40 con 0x55e87f33ce50 2023-09-21T13:03:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f290c10 con 0x55e87f3380a0 2023-09-21T13:03:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f28e530 con 0x55e87f3389c0 2023-09-21T13:03:09.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3eb599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3eb599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51840/0 (socket says 172.21.15.142:51840) 2023-09-21T13:03:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.476+0000 7f3eb599b700 1 -- 172.21.15.142:0/1575300183 learned_addr learned my addr 172.21.15.142:0/1575300183 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb519a700 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f33c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb619c700 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f33ce50 0x55e87f33d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 -- 172.21.15.142:0/1575300183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 msgr2=0x55e87f33c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f33c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb519a700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 0x7f3e9c0a2c70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3eb019a8f0 tx=0x7f3ea0005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 -- 172.21.15.142:0/1575300183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f33ce50 msgr2=0x55e87f33d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f33ce50 0x55e87f33d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 -- 172.21.15.142:0/1575300183 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e87f0b4d80 con 0x55e87f3380a0 2023-09-21T13:03:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3eb599b700 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3eac014040 tx=0x7f3eac099370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3db1fbf86963c1ea server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3e9bfff700 1 -- 172.21.15.142:0/1575300183 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0b9070 con 0x55e87f3380a0 2023-09-21T13:03:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3e9bfff700 1 -- 172.21.15.142:0/1575300183 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3eac099990 con 0x55e87f3380a0 2023-09-21T13:03:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.477+0000 7f3e9bfff700 1 -- 172.21.15.142:0/1575300183 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0b7be0 con 0x55e87f3380a0 2023-09-21T13:03:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/1575300183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 msgr2=0x55e87f338480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3eac014040 tx=0x7f3eac099370 comp rx=0 tx=0).stop 2023-09-21T13:03:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/1575300183 shutdown_connections 2023-09-21T13:03:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f33ce50 0x55e87f33d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3380a0 0x55e87f338480 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/1575300183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f33c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/1575300183 >> 172.21.15.142:0/1575300183 conn(0x55e87f264fa0 msgr2=0x55e87f3330c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/1575300183 shutdown_connections 2023-09-21T13:03:09.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.478+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/1575300183 wait complete. 2023-09-21T13:03:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.479+0000 7f3ecb57cb80 1 -- start start 2023-09-21T13:03:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.479+0000 7f3ecb57cb80 1 Processor -- start 2023-09-21T13:03:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f3445d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f33ce50 0x55e87f341e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f289e20 con 0x55e87f3380a0 2023-09-21T13:03:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f2266e0 con 0x55e87f3389c0 2023-09-21T13:03:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f226380 con 0x55e87f33ce50 2023-09-21T13:03:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3ecb57cb80 10 client.0 _ll_register_callbacks cb 0x55e87f170a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51842/0 (socket says 172.21.15.142:51842) 2023-09-21T13:03:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 -- 172.21.15.142:0/535962665 learned_addr learned my addr 172.21.15.142:0/535962665 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb619c700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f33ce50 0x55e87f341e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb599b700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f3445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 -- 172.21.15.142:0/535962665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f33ce50 msgr2=0x55e87f341e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f33ce50 0x55e87f341e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 -- 172.21.15.142:0/535962665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 msgr2=0x55e87f3445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f3445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.480+0000 7f3eb519a700 1 -- 172.21.15.142:0/535962665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb01a5f30 con 0x55e87f3389c0 2023-09-21T13:03:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3eb519a700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0015000 tx=0x7f3ea0009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603bd6b8f02e25c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3e997fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000f660 con 0x55e87f3389c0 2023-09-21T13:03:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e87f1fab50 con 0x55e87f3389c0 2023-09-21T13:03:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3ea000f7c0 con 0x55e87f3389c0 2023-09-21T13:03:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea000f980 con 0x55e87f3389c0 2023-09-21T13:03:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3ecb57cb80 10 client.27308 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e87f09dc00 con 0x55e87f3389c0 2023-09-21T13:03:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.481+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ea003c020 con 0x55e87f3389c0 2023-09-21T13:03:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3ea002fc10 con 0x55e87f3389c0 2023-09-21T13:03:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 10 client.27308 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 10 client.27308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 20 client.27308 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f351f70 0x55e87f354390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 4 client.27308 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e87f306fc0 con 0x55e87f351f70 2023-09-21T13:03:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.482+0000 7f3eb599b700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f351f70 0x55e87f354390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.483+0000 7f3e997fa700 10 client.27308 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.483+0000 7f3eb599b700 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f351f70 0x55e87f354390 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2fa8ecf9384cef8 server_cookie=e7c032f057a3493a in_seq=0 out_seq=0 2023-09-21T13:03:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.483+0000 7f3e997fa700 1 -- 172.21.15.142:0/535962665 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e87f306fc0 con 0x55e87f351f70 2023-09-21T13:03:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.483+0000 7f3e997fa700 10 client.27308 handle_command_reply: tid=0 2023-09-21T13:03:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.483+0000 7f3ecb57cb80 1 client.27308 shutdown 2023-09-21T13:03:09.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 msgr2=0x55e87f341850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0015000 tx=0x7f3ea0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 shutdown_connections 2023-09-21T13:03:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f351f70 0x55e87f354390 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f3445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f33ce50 0x55e87f341e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/535962665 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f3389c0 0x55e87f341850 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 >> 172.21.15.142:0/535962665 conn(0x55e87f264fa0 msgr2=0x55e87f332310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3e997fa700 0 client.27308 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 shutdown_connections 2023-09-21T13:03:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/535962665 wait complete. 2023-09-21T13:03:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.484+0000 7f3ecb57cb80 20 client.27308 trim_cache size 0 max 16384 2023-09-21T13:03:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.501+0000 7f3ecb57cb80 1 Processor -- start 2023-09-21T13:03:09.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.501+0000 7f3ecb57cb80 1 -- start start 2023-09-21T13:03:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 0x55e87f349000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f10a8c0 con 0x55e87f3389c0 2023-09-21T13:03:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f338810 con 0x55e87f33ce50 2023-09-21T13:03:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f32ac50 con 0x55e87f3380a0 2023-09-21T13:03:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb599b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 0x55e87f349000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb619c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb619c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51844/0 (socket says 172.21.15.142:51844) 2023-09-21T13:03:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48830/0 (socket says 172.21.15.142:48830) 2023-09-21T13:03:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb619c700 1 -- 172.21.15.142:0/3984326662 learned_addr learned my addr 172.21.15.142:0/3984326662 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:09.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb519a700 1 -- 172.21.15.142:0/3984326662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 msgr2=0x55e87f349000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb519a700 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 0x55e87f349000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.502+0000 7f3eb519a700 1 -- 172.21.15.142:0/3984326662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 msgr2=0x55e87f33af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3eb519a700 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3eb519a700 1 -- 172.21.15.142:0/3984326662 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e87f0db1f0 con 0x55e87f3389c0 2023-09-21T13:03:09.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3eb599b700 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 0x55e87f349000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3eb619c700 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3eb519a700 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009990 tx=0x7f3ea0024550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50f3e562350cdc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3ea4bff700 1 -- 172.21.15.142:0/3984326662 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0024b50 con 0x55e87f3389c0 2023-09-21T13:03:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3ea4bff700 1 -- 172.21.15.142:0/3984326662 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ea003c040 con 0x55e87f3389c0 2023-09-21T13:03:09.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.503+0000 7f3ea4bff700 1 -- 172.21.15.142:0/3984326662 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea002fb60 con 0x55e87f3389c0 2023-09-21T13:03:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/3984326662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 msgr2=0x55e87f34d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009990 tx=0x7f3ea0024550 comp rx=0 tx=0).stop 2023-09-21T13:03:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/3984326662 shutdown_connections 2023-09-21T13:03:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f33af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3380a0 0x55e87f349000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/3984326662 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3389c0 0x55e87f34d760 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/3984326662 >> 172.21.15.142:0/3984326662 conn(0x55e87f264fa0 msgr2=0x55e87f344200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/3984326662 shutdown_connections 2023-09-21T13:03:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.504+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/3984326662 wait complete. 2023-09-21T13:03:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 -- start start 2023-09-21T13:03:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 Processor -- start 2023-09-21T13:03:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f33f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f339c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f349550 con 0x55e87f3380a0 2023-09-21T13:03:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f33a1b0 con 0x55e87f33ce50 2023-09-21T13:03:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.505+0000 7f3ecb57cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87f33a370 con 0x55e87f3389c0 2023-09-21T13:03:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3ecb57cb80 10 client.0 _ll_register_callbacks cb 0x55e87f170a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39332/0 (socket says 172.21.15.142:39332) 2023-09-21T13:03:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 -- 172.21.15.142:0/318579121 learned_addr learned my addr 172.21.15.142:0/318579121 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb619c700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f339c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb599b700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f33f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 -- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 msgr2=0x55e87f339c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f339c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 -- 172.21.15.142:0/318579121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 msgr2=0x55e87f33f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f33f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb519a700 1 -- 172.21.15.142:0/318579121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e87f0b4d80 con 0x55e87f3389c0 2023-09-21T13:03:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.506+0000 7f3eb619c700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f339c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3eb519a700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009350 tx=0x7f3ea0025960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=637356a544af28f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3e997fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:03:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea002f440 con 0x55e87f3389c0 2023-09-21T13:03:09.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3eac099990 con 0x55e87f3389c0 2023-09-21T13:03:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3ea003d080 con 0x55e87f3389c0 2023-09-21T13:03:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ea002f5a0 con 0x55e87f3389c0 2023-09-21T13:03:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3ecb57cb80 10 client.27280 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e87f09dc00 con 0x55e87f3389c0 2023-09-21T13:03:09.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.507+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3eac099990 con 0x55e87f3389c0 2023-09-21T13:03:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3ea0042b00 con 0x55e87f3389c0 2023-09-21T13:03:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 10 client.27280 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 10 client.27280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 20 client.27280 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f3a6c40 0x55e87f3a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 4 client.27280 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:03:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e87f282e00 con 0x55e87f3a6c40 2023-09-21T13:03:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3eb599b700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f3a6c40 0x55e87f3a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3eb599b700 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f3a6c40 0x55e87f3a9030 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2f4acb80f1f6da7 server_cookie=c3580eae872220 in_seq=0 out_seq=0 2023-09-21T13:03:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.508+0000 7f3e997fa700 10 client.27280 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:09.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3e997fa700 1 -- 172.21.15.142:0/318579121 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e87f282e00 con 0x55e87f3a6c40 2023-09-21T13:03:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3e997fa700 10 client.27280 handle_command_reply: tid=0 2023-09-21T13:03:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 client.27280 shutdown 2023-09-21T13:03:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 msgr2=0x55e87f339730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009350 tx=0x7f3ea0025960 comp rx=0 tx=0).stop 2023-09-21T13:03:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 shutdown_connections 2023-09-21T13:03:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55e87f3a6c40 0x55e87f3a9030 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55e87f3380a0 0x55e87f33f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55e87f33ce50 0x55e87f339c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 --2- 172.21.15.142:0/318579121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55e87f3389c0 0x55e87f339730 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 >> 172.21.15.142:0/318579121 conn(0x55e87f264fa0 msgr2=0x55e87f34d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3e997fa700 0 client.27280 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.566+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 shutdown_connections 2023-09-21T13:03:09.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.567+0000 7f3ecb57cb80 1 -- 172.21.15.142:0/318579121 wait complete. 2023-09-21T13:03:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.567+0000 7f3ecb57cb80 20 client.27280 trim_cache size 0 max 16384 2023-09-21T13:03:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:03:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:03:09.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:03:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:03:09.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 msgr2=0x7f3e9c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 0x7f3e9c0a2c70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3eb019a8f0 tx=0x7f3ea0005fd0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 msgr2=0x7f3eb01990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3eac00eb30 tx=0x7f3eac00ee40 comp rx=0 tx=0).stop 2023-09-21T13:03:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 shutdown_connections 2023-09-21T13:03:09.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3e9c0a07b0 0x7f3e9c0a2c70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3eb010d5a0 0x7f3eb019dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3eb0073210 0x7f3eb01990d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 --2- 172.21.15.142:0/880574644 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3eb0073b30 0x7f3eb0199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 >> 172.21.15.142:0/880574644 conn(0x7f3eb00fc830 msgr2=0x7f3eb010f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:09.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 shutdown_connections 2023-09-21T13:03:09.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:09.568+0000 7f3eb7bff700 1 -- 172.21.15.142:0/880574644 wait complete. 2023-09-21T13:03:09.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 617989 8.63 MB/sec execute 230 sec latency 47.874 ms 2023-09-21T13:03:10.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:09 smithi160 ceph-mon[134450]: pgmap v212: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2023-09-21T13:03:10.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:09 smithi156 ceph-mon[134078]: pgmap v212: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2023-09-21T13:03:10.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:09 smithi142 ceph-mon[97663]: pgmap v212: 97 pgs: 97 active+clean; 175 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 215 op/s 2023-09-21T13:03:10.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 619476 8.62 MB/sec execute 231 sec latency 15.429 ms 2023-09-21T13:03:11.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 621739 8.64 MB/sec execute 232 sec latency 16.501 ms 2023-09-21T13:03:12.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:11 smithi160 ceph-mon[134450]: pgmap v213: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-09-21T13:03:12.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:11 smithi160 ceph-mon[134450]: osdmap e90: 12 total, 12 up, 12 in 2023-09-21T13:03:12.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:11 smithi156 ceph-mon[134078]: pgmap v213: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-09-21T13:03:12.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:11 smithi156 ceph-mon[134078]: osdmap e90: 12 total, 12 up, 12 in 2023-09-21T13:03:12.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:11 smithi142 ceph-mon[97663]: pgmap v213: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 241 op/s 2023-09-21T13:03:12.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:11 smithi142 ceph-mon[97663]: osdmap e90: 12 total, 12 up, 12 in 2023-09-21T13:03:12.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 623086 8.63 MB/sec execute 233 sec latency 26.451 ms 2023-09-21T13:03:13.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 625335 8.65 MB/sec execute 234 sec latency 17.353 ms 2023-09-21T13:03:14.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:13 smithi156 ceph-mon[134078]: pgmap v215: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 301 op/s 2023-09-21T13:03:14.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:13 smithi142 ceph-mon[97663]: pgmap v215: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 301 op/s 2023-09-21T13:03:14.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:13 smithi160 ceph-mon[134450]: pgmap v215: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 301 op/s 2023-09-21T13:03:14.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 626735 8.63 MB/sec execute 235 sec latency 68.760 ms 2023-09-21T13:03:15.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 628913 8.66 MB/sec execute 236 sec latency 16.094 ms 2023-09-21T13:03:16.185 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:03:16.254 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:15 smithi142 ceph-mon[97663]: pgmap v216: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 159 op/s 2023-09-21T13:03:16.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:15 smithi156 ceph-mon[134078]: pgmap v216: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 159 op/s 2023-09-21T13:03:16.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 -- 172.21.15.142:0/2687571653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5981017d0 msgr2=0x7fa598105810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 --2- 172.21.15.142:0/2687571653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5981017d0 0x7fa598105810 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009990 tx=0x7fa58c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 -- 172.21.15.142:0/2687571653 shutdown_connections 2023-09-21T13:03:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 --2- 172.21.15.142:0/2687571653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598100e20 0x7fa598101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 --2- 172.21.15.142:0/2687571653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 0x7fa59810dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 --2- 172.21.15.142:0/2687571653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5981017d0 0x7fa598105810 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 -- 172.21.15.142:0/2687571653 >> 172.21.15.142:0/2687571653 conn(0x7fa5980fc680 msgr2=0x7fa5980feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 -- 172.21.15.142:0/2687571653 shutdown_connections 2023-09-21T13:03:16.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.426+0000 7fa597fff700 1 -- 172.21.15.142:0/2687571653 wait complete. 2023-09-21T13:03:16.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.427+0000 7fa597fff700 1 Processor -- start 2023-09-21T13:03:16.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 -- start start 2023-09-21T13:03:16.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 0x7fa598073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 0x7fa5981a4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981a5500 con 0x7fa598073b60 2023-09-21T13:03:16.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981a5670 con 0x7fa598100e20 2023-09-21T13:03:16.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa597fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5981a5830 con 0x7fa598105f40 2023-09-21T13:03:16.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59788/0 (socket says 172.21.15.142:59788) 2023-09-21T13:03:16.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa596ffd700 1 -- 172.21.15.142:0/544754552 learned_addr learned my addr 172.21.15.142:0/544754552 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:16.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.428+0000 7fa5967fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 0x7fa598073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa5977fe700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 0x7fa5981a4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 -- 172.21.15.142:0/544754552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 msgr2=0x7fa598073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 0x7fa598073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 -- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 msgr2=0x7fa5981a4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 0x7fa5981a4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 -- 172.21.15.142:0/544754552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590009c40 con 0x7fa598100e20 2023-09-21T13:03:16.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa5977fe700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 0x7fa5981a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:03:16.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa596ffd700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e9a0 tx=0x7fa58800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa57ffff700 1 -- 172.21.15.142:0/544754552 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588009790 con 0x7fa598100e20 2023-09-21T13:03:16.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa57ffff700 1 -- 172.21.15.142:0/544754552 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa58800cbd0 con 0x7fa598100e20 2023-09-21T13:03:16.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58c0095f0 con 0x7fa598100e20 2023-09-21T13:03:16.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa57ffff700 1 -- 172.21.15.142:0/544754552 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588018680 con 0x7fa598100e20 2023-09-21T13:03:16.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.429+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5981a5e60 con 0x7fa598100e20 2023-09-21T13:03:16.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.434+0000 7fa57ffff700 1 -- 172.21.15.142:0/544754552 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa58800cd40 con 0x7fa598100e20 2023-09-21T13:03:16.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.434+0000 7fa5b1030b80 1 Processor -- start 2023-09-21T13:03:16.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 -- start start 2023-09-21T13:03:16.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9aece0 0x55fafa9a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa91cca0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa900c70 con 0x55fafa9aece0 2023-09-21T13:03:16.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.435+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa8fe590 con 0x55fafa9ae3c0 2023-09-21T13:03:16.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5977fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9aece0 0x55fafa9a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5977fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9ae7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52010/0 (socket says 172.21.15.142:52010) 2023-09-21T13:03:16.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5977fe700 1 -- 172.21.15.142:0/304922049 learned_addr learned my addr 172.21.15.142:0/304922049 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:16.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 -- 172.21.15.142:0/304922049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 msgr2=0x55fafa9ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 -- 172.21.15.142:0/304922049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9aece0 msgr2=0x55fafa9a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9aece0 0x55fafa9a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.436+0000 7fa5967fc700 1 -- 172.21.15.142:0/304922049 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fafa724de0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.437+0000 7fa5967fc700 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a9030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa58c000c00 tx=0x7fa58c005ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885c061681b99d6b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.437+0000 7fa57d7fa700 1 -- 172.21.15.142:0/304922049 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c01d070 con 0x55fafa9a8bb0 2023-09-21T13:03:16.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.437+0000 7fa57d7fa700 1 -- 172.21.15.142:0/304922049 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa58c01e040 con 0x55fafa9a8bb0 2023-09-21T13:03:16.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.437+0000 7fa57d7fa700 1 -- 172.21.15.142:0/304922049 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c0048d0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa57ffff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 0x7fa5800a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa57ffff700 1 -- 172.21.15.142:0/544754552 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa588014070 con 0x7fa598100e20 2023-09-21T13:03:16.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5977fe700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 0x7fa5800a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 -- 172.21.15.142:0/304922049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 msgr2=0x55fafa9a9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a9030 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fa58c000c00 tx=0x7fa58c005ea0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 -- 172.21.15.142:0/304922049 shutdown_connections 2023-09-21T13:03:16.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a9030 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/304922049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9aece0 0x55fafa9a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.438+0000 7fa5b1030b80 1 -- 172.21.15.142:0/304922049 >> 172.21.15.142:0/304922049 conn(0x55fafa8d5000 msgr2=0x55fafa9a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.439+0000 7fa5b1030b80 1 -- 172.21.15.142:0/304922049 shutdown_connections 2023-09-21T13:03:16.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.439+0000 7fa5b1030b80 1 -- 172.21.15.142:0/304922049 wait complete. 2023-09-21T13:03:16.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.439+0000 7fa5977fe700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 0x7fa5800a2d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa590009fd0 tx=0x7fa590009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.439+0000 7fa5b1030b80 1 -- start start 2023-09-21T13:03:16.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 Processor -- start 2023-09-21T13:03:16.447 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:15 smithi160 ceph-mon[134450]: pgmap v216: 97 pgs: 97 active+clean; 175 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 159 op/s 2023-09-21T13:03:16.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa8f9e80 con 0x55fafa9aece0 2023-09-21T13:03:16.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa896740 con 0x55fafa9a8bb0 2023-09-21T13:03:16.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa8963e0 con 0x55fafa9ae3c0 2023-09-21T13:03:16.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.440+0000 7fa5b1030b80 10 client.0 _ll_register_callbacks cb 0x55fafa7e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:16.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59810/0 (socket says 172.21.15.142:59810) 2023-09-21T13:03:16.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa5967fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 -- 172.21.15.142:0/1301919752 learned_addr learned my addr 172.21.15.142:0/1301919752 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:16.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa5977fe700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 -- 172.21.15.142:0/1301919752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 msgr2=0x55fafa9b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 -- 172.21.15.142:0/1301919752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 msgr2=0x55fafa9b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 -- 172.21.15.142:0/1301919752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59810e330 con 0x55fafa9a8bb0 2023-09-21T13:03:16.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa596ffd700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e970 tx=0x7fa588099480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64ff1e61be86d46 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.441+0000 7fa57aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:16.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588099010 con 0x55fafa9a8bb0 2023-09-21T13:03:16.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fafa86abb0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa588099db0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5880996b0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa5b1030b80 10 client.27326 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:16.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fafa70dc60 con 0x55fafa9a8bb0 2023-09-21T13:03:16.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fafa86abb0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.442+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa588098ba0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 10 client.27326 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:16.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 10 client.27326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:16.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 20 client.27326 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:16.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafa9c2600 0x55fafa9c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 4 client.27326 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:16.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fafa977020 con 0x55fafa9c2600 2023-09-21T13:03:16.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5967fc700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafa9c2600 0x55fafa9c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa57aff5700 10 client.27326 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:16.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.443+0000 7fa5967fc700 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafa9c2600 0x55fafa9c4a20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf8e570235ae3fe7 server_cookie=380c53108212310f in_seq=0 out_seq=0 2023-09-21T13:03:16.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.444+0000 7fa57aff5700 1 -- 172.21.15.142:0/1301919752 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fafa977020 con 0x55fafa9c2600 2023-09-21T13:03:16.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.444+0000 7fa57aff5700 10 client.27326 handle_command_reply: tid=0 2023-09-21T13:03:16.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.444+0000 7fa5b1030b80 1 client.27326 shutdown 2023-09-21T13:03:16.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 msgr2=0x55fafa9b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e970 tx=0x7fa588099480 comp rx=0 tx=0).stop 2023-09-21T13:03:16.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 shutdown_connections 2023-09-21T13:03:16.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafa9c2600 0x55fafa9c4a20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b1fd0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/1301919752 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa57aff5700 0 client.27326 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:16.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 >> 172.21.15.142:0/1301919752 conn(0x55fafa8d5000 msgr2=0x55fafa9a3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 shutdown_connections 2023-09-21T13:03:16.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 1 -- 172.21.15.142:0/1301919752 wait complete. 2023-09-21T13:03:16.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.445+0000 7fa5b1030b80 20 client.27326 trim_cache size 0 max 16384 2023-09-21T13:03:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.471+0000 7fa5b1030b80 1 Processor -- start 2023-09-21T13:03:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.471+0000 7fa5b1030b80 1 -- start start 2023-09-21T13:03:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa77a920 con 0x55fafa9aece0 2023-09-21T13:03:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa99de20 con 0x55fafa9ae3c0 2023-09-21T13:03:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafa99b430 con 0x55fafa9a8bb0 2023-09-21T13:03:16.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52032/0 (socket says 172.21.15.142:52032) 2023-09-21T13:03:16.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5967fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59818/0 (socket says 172.21.15.142:59818) 2023-09-21T13:03:16.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 -- 172.21.15.142:0/2462380239 learned_addr learned my addr 172.21.15.142:0/2462380239 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:16.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5977fe700 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 -- 172.21.15.142:0/2462380239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 msgr2=0x55fafa9b9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 -- 172.21.15.142:0/2462380239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 msgr2=0x55fafa9af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa596ffd700 1 -- 172.21.15.142:0/2462380239 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fafa99f800 con 0x55fafa9a8bb0 2023-09-21T13:03:16.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.472+0000 7fa5977fe700 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:03:16.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.473+0000 7fa596ffd700 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5880c9f50 tx=0x7fa588098f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5eb38a353fc7f7f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.473+0000 7fa57dffb700 1 -- 172.21.15.142:0/2462380239 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588099010 con 0x55fafa9a8bb0 2023-09-21T13:03:16.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.473+0000 7fa57dffb700 1 -- 172.21.15.142:0/2462380239 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa588099db0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.473+0000 7fa57dffb700 1 -- 172.21.15.142:0/2462380239 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58809d150 con 0x55fafa9a8bb0 2023-09-21T13:03:16.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 -- 172.21.15.142:0/2462380239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 msgr2=0x55fafa9a8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5880c9f50 tx=0x7fa588098f20 comp rx=0 tx=0).stop 2023-09-21T13:03:16.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 -- 172.21.15.142:0/2462380239 shutdown_connections 2023-09-21T13:03:16.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9aece0 0x55fafa9af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9a8bb0 0x55fafa9a8670 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/2462380239 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 -- 172.21.15.142:0/2462380239 >> 172.21.15.142:0/2462380239 conn(0x55fafa8d5000 msgr2=0x55fafa9ac250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 -- 172.21.15.142:0/2462380239 shutdown_connections 2023-09-21T13:03:16.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.474+0000 7fa5b1030b80 1 -- 172.21.15.142:0/2462380239 wait complete. 2023-09-21T13:03:16.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.475+0000 7fa5b1030b80 1 -- start start 2023-09-21T13:03:16.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.475+0000 7fa5b1030b80 1 Processor -- start 2023-09-21T13:03:16.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.475+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.475+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5b1030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 0x55fafaa15430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafaa15970 con 0x55fafa9ae3c0 2023-09-21T13:03:16.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafaa15ab0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5b1030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fafaa15bf0 con 0x55fafa9aece0 2023-09-21T13:03:16.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5b1030b80 10 client.0 _ll_register_callbacks cb 0x55fafa7e0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:16.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5977fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 0x55fafaa15430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59832/0 (socket says 172.21.15.142:59832) 2023-09-21T13:03:16.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 -- 172.21.15.142:0/692876988 learned_addr learned my addr 172.21.15.142:0/692876988 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5967fc700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 -- 172.21.15.142:0/692876988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 msgr2=0x55fafaa15430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 0x55fafaa15430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 -- 172.21.15.142:0/692876988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9ae3c0 msgr2=0x55fafa9b7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa596ffd700 1 -- 172.21.15.142:0/692876988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fafa70dc60 con 0x55fafa9a8bb0 2023-09-21T13:03:16.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.476+0000 7fa5977fe700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 0x55fafaa15430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:16.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa596ffd700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c5b0 tx=0x7fa588095aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c66028968c97707 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:16.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa57aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:16.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa588099010 con 0x55fafa9a8bb0 2023-09-21T13:03:16.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa58c01e040 con 0x55fafa9a8bb0 2023-09-21T13:03:16.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5880996b0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5880a1720 con 0x55fafa9a8bb0 2023-09-21T13:03:16.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa5b1030b80 10 client.27332 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:16.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fafa74b250 con 0x55fafa9a8bb0 2023-09-21T13:03:16.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.477+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa58c01e040 con 0x55fafa9a8bb0 2023-09-21T13:03:16.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fa5880954a0 con 0x55fafa9a8bb0 2023-09-21T13:03:16.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 10 client.27332 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:16.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 10 client.27332 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:16.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 20 client.27332 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:16.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafaa16e90 0x55fafaa19280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:16.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 4 client.27332 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:03:16.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fafa8f2e60 con 0x55fafaa16e90 2023-09-21T13:03:16.493 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.478+0000 7fa5967fc700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafaa16e90 0x55fafaa19280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:16.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5967fc700 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafaa16e90 0x55fafaa19280 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9086099bddabfae2 server_cookie=a61e576c0b8440ce in_seq=0 out_seq=0 2023-09-21T13:03:16.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa57aff5700 10 client.27332 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:16.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa57aff5700 1 -- 172.21.15.142:0/692876988 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55fafa8f2e60 con 0x55fafaa16e90 2023-09-21T13:03:16.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa57aff5700 10 client.27332 handle_command_reply: tid=0 2023-09-21T13:03:16.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 client.27332 shutdown 2023-09-21T13:03:16.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 msgr2=0x55fafa9b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa58800c5b0 tx=0x7fa588095aa0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 shutdown_connections 2023-09-21T13:03:16.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fafaa16e90 0x55fafaa19280 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fafa9aece0 0x55fafaa15430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fafa9a8bb0 0x55fafa9b73f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 --2- 172.21.15.142:0/692876988 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fafa9ae3c0 0x55fafa9b7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 >> 172.21.15.142:0/692876988 conn(0x55fafa8d5000 msgr2=0x55fafa9b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.479+0000 7fa57aff5700 0 client.27332 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:16.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.480+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 shutdown_connections 2023-09-21T13:03:16.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.480+0000 7fa5b1030b80 1 -- 172.21.15.142:0/692876988 wait complete. 2023-09-21T13:03:16.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.480+0000 7fa5b1030b80 20 client.27332 trim_cache size 0 max 16384 2023-09-21T13:03:16.497 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:03:16.497 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:03:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:03:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:03:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:03:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:03:16.498 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:03:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:03:16.499 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:03:16.499 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:03:16.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 msgr2=0x7fa5800a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 0x7fa5800a2d10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa590009fd0 tx=0x7fa590009040 comp rx=0 tx=0).stop 2023-09-21T13:03:16.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 msgr2=0x7fa5980730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:16.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa58800e9a0 tx=0x7fa58800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 shutdown_connections 2023-09-21T13:03:16.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5800a0850 0x7fa5800a2d10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa598073b60 0x7fa5981a4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa598100e20 0x7fa5980730e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 --2- 172.21.15.142:0/544754552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa598105f40 0x7fa598073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:16.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 >> 172.21.15.142:0/544754552 conn(0x7fa5980fc680 msgr2=0x7fa5980fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:16.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 shutdown_connections 2023-09-21T13:03:16.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:16.481+0000 7fa597fff700 1 -- 172.21.15.142:0/544754552 wait complete. 2023-09-21T13:03:16.503 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:03:16.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 630478 8.64 MB/sec execute 237 sec latency 18.539 ms 2023-09-21T13:03:17.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 632546 8.66 MB/sec execute 238 sec latency 13.309 ms 2023-09-21T13:03:18.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:17 smithi156 ceph-mon[134078]: pgmap v217: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2023-09-21T13:03:18.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:17 smithi142 ceph-mon[97663]: pgmap v217: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2023-09-21T13:03:18.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:17 smithi160 ceph-mon[134450]: pgmap v217: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 240 op/s 2023-09-21T13:03:18.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 634462 8.66 MB/sec execute 239 sec latency 16.131 ms 2023-09-21T13:03:19.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 636035 8.67 MB/sec execute 240 sec latency 46.830 ms 2023-09-21T13:03:20.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:19 smithi156 ceph-mon[134078]: pgmap v218: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-09-21T13:03:20.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:19 smithi142 ceph-mon[97663]: pgmap v218: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-09-21T13:03:20.439 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:19 smithi160 ceph-mon[134450]: pgmap v218: 97 pgs: 97 active+clean; 183 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 230 op/s 2023-09-21T13:03:20.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 637689 8.66 MB/sec execute 241 sec latency 15.436 ms 2023-09-21T13:03:21.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 639673 8.68 MB/sec execute 242 sec latency 14.519 ms 2023-09-21T13:03:22.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:21 smithi156 ceph-mon[134078]: pgmap v219: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2023-09-21T13:03:22.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:21 smithi142 ceph-mon[97663]: pgmap v219: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2023-09-21T13:03:22.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:21 smithi160 ceph-mon[134450]: pgmap v219: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 204 op/s 2023-09-21T13:03:22.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 641735 8.68 MB/sec execute 243 sec latency 14.667 ms 2023-09-21T13:03:22.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.733+0000 7f1dabbff700 1 -- 172.21.15.142:0/2238415393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 msgr2=0x7f1da41013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.733+0000 7f1dabbff700 1 --2- 172.21.15.142:0/2238415393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da41013c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1da0009990 tx=0x7f1da0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 -- 172.21.15.142:0/2238415393 shutdown_connections 2023-09-21T13:03:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 --2- 172.21.15.142:0/2238415393 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da410dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 --2- 172.21.15.142:0/2238415393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da41013c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 --2- 172.21.15.142:0/2238415393 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da4101990 0x7f1da41059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 -- 172.21.15.142:0/2238415393 >> 172.21.15.142:0/2238415393 conn(0x7f1da40fc840 msgr2=0x7f1da40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 -- 172.21.15.142:0/2238415393 shutdown_connections 2023-09-21T13:03:22.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.734+0000 7f1dabbff700 1 -- 172.21.15.142:0/2238415393 wait complete. 2023-09-21T13:03:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 Processor -- start 2023-09-21T13:03:22.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 -- start start 2023-09-21T13:03:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da4199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da419dd40 0x7f1da419e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419e7c0 con 0x7f1da419dd40 2023-09-21T13:03:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419e930 con 0x7f1da4106100 2023-09-21T13:03:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1dabbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da419eaf0 con 0x7f1da4100fe0 2023-09-21T13:03:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.735+0000 7f1da919a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59850/0 (socket says 172.21.15.142:59850) 2023-09-21T13:03:22.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 -- 172.21.15.142:0/4128383519 learned_addr learned my addr 172.21.15.142:0/4128383519 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1daa19c700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da419dd40 0x7f1da419e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da999b700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da4199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 -- 172.21.15.142:0/4128383519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 msgr2=0x7f1da4199190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da4199190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 -- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da419dd40 msgr2=0x7f1da419e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da419dd40 0x7f1da419e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 -- 172.21.15.142:0/4128383519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00095f0 con 0x7f1da4106100 2023-09-21T13:03:22.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1da919a700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e970 tx=0x7f1d9400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1d9affd700 1 -- 172.21.15.142:0/4128383519 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94009790 con 0x7f1da4106100 2023-09-21T13:03:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1d9affd700 1 -- 172.21.15.142:0/4128383519 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d9400c7e0 con 0x7f1da4106100 2023-09-21T13:03:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.736+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da41a5ff0 con 0x7f1da4106100 2023-09-21T13:03:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.737+0000 7f1d9affd700 1 -- 172.21.15.142:0/4128383519 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d940054e0 con 0x7f1da4106100 2023-09-21T13:03:22.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.737+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da41a64d0 con 0x7f1da4106100 2023-09-21T13:03:22.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.740+0000 7f1d9affd700 1 -- 172.21.15.142:0/4128383519 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f1d9400c950 con 0x7f1da4106100 2023-09-21T13:03:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.741+0000 7f1dbf54db80 1 Processor -- start 2023-09-21T13:03:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.741+0000 7f1dbf54db80 1 -- start start 2023-09-21T13:03:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b26b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b26f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b1dfc40 con 0x55856b26b0a0 2023-09-21T13:03:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b1c3c10 con 0x55856b26fe50 2023-09-21T13:03:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b1c1530 con 0x55856b26b9c0 2023-09-21T13:03:22.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1d9affd700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 0x7f1d900a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59864/0 (socket says 172.21.15.142:59864) 2023-09-21T13:03:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 -- 172.21.15.142:0/1166822209 learned_addr learned my addr 172.21.15.142:0/1166822209 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da999b700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b26f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1daa19c700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b26b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1d9affd700 1 -- 172.21.15.142:0/4128383519 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1d94014070 con 0x7f1da4106100 2023-09-21T13:03:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1daa19c700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 0x7f1d900a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 -- 172.21.15.142:0/1166822209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 msgr2=0x55856b26f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b26f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 -- 172.21.15.142:0/1166822209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 msgr2=0x55856b26b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b26b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.742+0000 7f1da919a700 1 -- 172.21.15.142:0/1166822209 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55856afe7d80 con 0x55856b26fe50 2023-09-21T13:03:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.743+0000 7f1daa19c700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b26b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:03:22.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.743+0000 7f1da919a700 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1d94095b60 tx=0x7f1d940994b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2ca2633fffe5b34 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.743+0000 7f1d8ffff700 1 -- 172.21.15.142:0/1166822209 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400cc50 con 0x55856b26fe50 2023-09-21T13:03:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.743+0000 7f1d8ffff700 1 -- 172.21.15.142:0/1166822209 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d94099d60 con 0x55856b26fe50 2023-09-21T13:03:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.743+0000 7f1d8ffff700 1 -- 172.21.15.142:0/1166822209 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94095d70 con 0x55856b26fe50 2023-09-21T13:03:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- 172.21.15.142:0/1166822209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 msgr2=0x55856b2702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1daa19c700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 0x7f1d900a2c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ec0 tx=0x7f1d9c00b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1d94095b60 tx=0x7f1d940994b0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- 172.21.15.142:0/1166822209 shutdown_connections 2023-09-21T13:03:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b26b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b2702b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/1166822209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b26f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- 172.21.15.142:0/1166822209 >> 172.21.15.142:0/1166822209 conn(0x55856b197fa0 msgr2=0x55856b2660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- 172.21.15.142:0/1166822209 shutdown_connections 2023-09-21T13:03:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- 172.21.15.142:0/1166822209 wait complete. 2023-09-21T13:03:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.744+0000 7f1dbf54db80 1 -- start start 2023-09-21T13:03:22.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.745+0000 7f1dbf54db80 1 Processor -- start 2023-09-21T13:03:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b274df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b275330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b1bce20 con 0x55856b26b0a0 2023-09-21T13:03:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b1596e0 con 0x55856b26fe50 2023-09-21T13:03:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b159380 con 0x55856b26b9c0 2023-09-21T13:03:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1dbf54db80 10 client.0 _ll_register_callbacks cb 0x55856b0a3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da919a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b274df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:55972/0 (socket says 172.21.15.142:55972) 2023-09-21T13:03:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 -- 172.21.15.142:0/3478305428 learned_addr learned my addr 172.21.15.142:0/3478305428 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1daa19c700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b275330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 -- 172.21.15.142:0/3478305428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 msgr2=0x55856b274df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b274df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 -- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 msgr2=0x55856b275330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b275330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da999b700 1 -- 172.21.15.142:0/3478305428 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da41a64d0 con 0x55856b26b0a0 2023-09-21T13:03:22.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.746+0000 7f1da919a700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b274df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1da999b700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1da0005800 tx=0x7f1da0005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f5ef49088b35e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1d8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:03:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da001d070 con 0x55856b26b0a0 2023-09-21T13:03:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55856b12db50 con 0x55856b26b0a0 2023-09-21T13:03:22.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1da0004500 con 0x55856b26b0a0 2023-09-21T13:03:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1da00046c0 con 0x55856b26b0a0 2023-09-21T13:03:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1dbf54db80 10 client.17247 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:22.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55856afd0c00 con 0x55856b26b0a0 2023-09-21T13:03:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.747+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55856b12db50 con 0x55856b26b0a0 2023-09-21T13:03:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1da000f870 con 0x55856b26b0a0 2023-09-21T13:03:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 10 client.17247 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:22.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 10 client.17247 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 20 client.17247 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b285070 0x55856b287490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 4 client.17247 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:22.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55856b239fc0 con 0x55856b285070 2023-09-21T13:03:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1da919a700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b285070 0x55856b287490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1d8d7fa700 10 client.17247 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.748+0000 7f1da919a700 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b285070 0x55856b287490 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e84ff99c13ec602 server_cookie=f10c7f3112b6a08e in_seq=0 out_seq=0 2023-09-21T13:03:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/3478305428 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55856b239fc0 con 0x55856b285070 2023-09-21T13:03:22.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1d8d7fa700 10 client.17247 handle_command_reply: tid=0 2023-09-21T13:03:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 client.17247 shutdown 2023-09-21T13:03:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 msgr2=0x55856b2748b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1da0005800 tx=0x7f1da0005ad0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 shutdown_connections 2023-09-21T13:03:22.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b285070 0x55856b287490 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b0a0 0x55856b2748b0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26fe50 0x55856b275330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3478305428 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b274df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 >> 172.21.15.142:0/3478305428 conn(0x55856b197fa0 msgr2=0x55856b265cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1d8d7fa700 0 client.17247 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 shutdown_connections 2023-09-21T13:03:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.750+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3478305428 wait complete. 2023-09-21T13:03:22.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.751+0000 7f1dbf54db80 20 client.17247 trim_cache size 0 max 16384 2023-09-21T13:03:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.768+0000 7f1dbf54db80 1 Processor -- start 2023-09-21T13:03:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.768+0000 7f1dbf54db80 1 -- start start 2023-09-21T13:03:22.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b27bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b9c0 0x55856b26f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b03d8c0 con 0x55856b26b9c0 2023-09-21T13:03:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b266f20 con 0x55856b26b0a0 2023-09-21T13:03:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b262210 con 0x55856b26fe50 2023-09-21T13:03:22.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1da999b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b27bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.769+0000 7f1daa19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52100/0 (socket says 172.21.15.142:52100) 2023-09-21T13:03:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1da999b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b27bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59880/0 (socket says 172.21.15.142:59880) 2023-09-21T13:03:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 -- 172.21.15.142:0/3779150990 learned_addr learned my addr 172.21.15.142:0/3779150990 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:22.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1da919a700 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b9c0 0x55856b26f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 -- 172.21.15.142:0/3779150990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 msgr2=0x55856b27bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b27bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 -- 172.21.15.142:0/3779150990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b9c0 msgr2=0x55856b26f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b9c0 0x55856b26f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 -- 172.21.15.142:0/3779150990 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55856b28c100 con 0x55856b26fe50 2023-09-21T13:03:22.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1daa19c700 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c018680 tx=0x7f1d9c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e589462618977691 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.770+0000 7f1d98bff700 1 -- 172.21.15.142:0/3779150990 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c028070 con 0x55856b26fe50 2023-09-21T13:03:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1d98bff700 1 -- 172.21.15.142:0/3779150990 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d9c00f040 con 0x55856b26fe50 2023-09-21T13:03:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1d98bff700 1 -- 172.21.15.142:0/3779150990 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9c00e070 con 0x55856b26fe50 2023-09-21T13:03:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3779150990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 msgr2=0x55856b265310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c018680 tx=0x7f1d9c009920 comp rx=0 tx=0).stop 2023-09-21T13:03:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3779150990 shutdown_connections 2023-09-21T13:03:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26fe50 0x55856b265310 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b27bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/3779150990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26b9c0 0x55856b26f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3779150990 >> 172.21.15.142:0/3779150990 conn(0x55856b197fa0 msgr2=0x55856b26eea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.771+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3779150990 shutdown_connections 2023-09-21T13:03:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.772+0000 7f1dbf54db80 1 -- 172.21.15.142:0/3779150990 wait complete. 2023-09-21T13:03:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.772+0000 7f1dbf54db80 1 -- start start 2023-09-21T13:03:22.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.772+0000 7f1dbf54db80 1 Processor -- start 2023-09-21T13:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b2786e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 0x55856b2d7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b2d8440 con 0x55856b26fe50 2023-09-21T13:03:22.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b2d85b0 con 0x55856b26b0a0 2023-09-21T13:03:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55856b2d8770 con 0x55856b26b9c0 2023-09-21T13:03:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1dbf54db80 10 client.0 _ll_register_callbacks cb 0x55856b0a3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59892/0 (socket says 172.21.15.142:59892) 2023-09-21T13:03:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da919a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b2786e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 -- 172.21.15.142:0/2958773378 learned_addr learned my addr 172.21.15.142:0/2958773378 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1daa19c700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 0x55856b2d7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 -- 172.21.15.142:0/2958773378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 msgr2=0x55856b2786e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b2786e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 -- 172.21.15.142:0/2958773378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 msgr2=0x55856b2d7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 0x55856b2d7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.773+0000 7f1da999b700 1 -- 172.21.15.142:0/2958773378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c020040 con 0x55856b26b0a0 2023-09-21T13:03:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1daa19c700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 0x55856b2d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:03:22.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1da999b700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1da000fc20 tx=0x7f1da0024450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=198c0a348bb42c88 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1d8d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da001d070 con 0x55856b26b0a0 2023-09-21T13:03:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d94099d60 con 0x55856b26b0a0 2023-09-21T13:03:22.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1da0000e40 con 0x55856b26b0a0 2023-09-21T13:03:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1da00058e0 con 0x55856b26b0a0 2023-09-21T13:03:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1dbf54db80 10 client.27350 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.774+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55856b00e1f0 con 0x55856b26b0a0 2023-09-21T13:03:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d94099d60 con 0x55856b26b0a0 2023-09-21T13:03:22.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1da0024bf0 con 0x55856b26b0a0 2023-09-21T13:03:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 10 client.27350 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 10 client.27350 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 20 client.27350 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b2d9b00 0x55856b2dbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:22.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 4 client.27350 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:03:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55856b1b5e00 con 0x55856b2d9b00 2023-09-21T13:03:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.775+0000 7f1da919a700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b2d9b00 0x55856b2dbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.776+0000 7f1da919a700 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b2d9b00 0x55856b2dbf20 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a7173b713036adb server_cookie=8f2937f77990326f in_seq=0 out_seq=0 2023-09-21T13:03:22.785 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.776+0000 7f1d8d7fa700 10 client.27350 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.847+0000 7f1d8d7fa700 1 -- 172.21.15.142:0/2958773378 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55856b1b5e00 con 0x55856b2d9b00 2023-09-21T13:03:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.847+0000 7f1d8d7fa700 10 client.27350 handle_command_reply: tid=0 2023-09-21T13:03:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.847+0000 7f1dbf54db80 1 client.27350 shutdown 2023-09-21T13:03:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 msgr2=0x55856b2781a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f1da000fc20 tx=0x7f1da0024450 comp rx=0 tx=0).stop 2023-09-21T13:03:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 shutdown_connections 2023-09-21T13:03:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55856b2d9b00 0x55856b2dbf20 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55856b26fe50 0x55856b2d7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55856b26b0a0 0x55856b2781a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 --2- 172.21.15.142:0/2958773378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55856b26b9c0 0x55856b2786e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 >> 172.21.15.142:0/2958773378 conn(0x55856b197fa0 msgr2=0x55856b26f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1d8d7fa700 0 client.27350 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 shutdown_connections 2023-09-21T13:03:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 1 -- 172.21.15.142:0/2958773378 wait complete. 2023-09-21T13:03:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.848+0000 7f1dbf54db80 20 client.27350 trim_cache size 0 max 16384 2023-09-21T13:03:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:03:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:03:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:03:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:03:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 msgr2=0x7f1d900a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 0x7f1d900a2c70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c009ec0 tx=0x7f1d9c00b040 comp rx=0 tx=0).stop 2023-09-21T13:03:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 msgr2=0x7f1da41996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1d9400e970 tx=0x7f1d9400ec80 comp rx=0 tx=0).stop 2023-09-21T13:03:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 shutdown_connections 2023-09-21T13:03:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1d900a07b0 0x7f1d900a2c70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1da419dd40 0x7f1da419e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1da4100fe0 0x7f1da4199190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 --2- 172.21.15.142:0/4128383519 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1da4106100 0x7f1da41996d0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.852+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 >> 172.21.15.142:0/4128383519 conn(0x7f1da40fc840 msgr2=0x7f1da410cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.853+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 shutdown_connections 2023-09-21T13:03:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:22.853+0000 7f1dabbff700 1 -- 172.21.15.142:0/4128383519 wait complete. 2023-09-21T13:03:23.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 643234 8.69 MB/sec execute 244 sec latency 24.068 ms 2023-09-21T13:03:24.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:23 smithi156 ceph-mon[134078]: pgmap v220: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-09-21T13:03:24.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:23 smithi142 ceph-mon[97663]: pgmap v220: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-09-21T13:03:24.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:23 smithi160 ceph-mon[134450]: pgmap v220: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 186 op/s 2023-09-21T13:03:24.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 644368 8.67 MB/sec execute 245 sec latency 155.351 ms 2023-09-21T13:03:25.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 646353 8.69 MB/sec execute 246 sec latency 75.742 ms 2023-09-21T13:03:26.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:25 smithi156 ceph-mon[134078]: pgmap v221: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:03:26.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:25 smithi142 ceph-mon[97663]: pgmap v221: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:03:26.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:25 smithi160 ceph-mon[134450]: pgmap v221: 97 pgs: 97 active+clean; 191 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:03:26.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 647491 8.67 MB/sec execute 247 sec latency 99.741 ms 2023-09-21T13:03:27.695 INFO:tasks.workunit.client.0.smithi142.stdout: 1 649837 8.69 MB/sec execute 248 sec latency 17.096 ms 2023-09-21T13:03:28.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:27 smithi156 ceph-mon[134078]: pgmap v222: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 398 op/s 2023-09-21T13:03:28.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:27 smithi142 ceph-mon[97663]: pgmap v222: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 398 op/s 2023-09-21T13:03:28.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:27 smithi160 ceph-mon[134450]: pgmap v222: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 398 op/s 2023-09-21T13:03:28.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 651276 8.69 MB/sec execute 249 sec latency 9.905 ms 2023-09-21T13:03:29.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 653526 8.70 MB/sec execute 250 sec latency 15.923 ms 2023-09-21T13:03:30.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:29 smithi156 ceph-mon[134078]: pgmap v223: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 313 op/s 2023-09-21T13:03:30.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:29 smithi142 ceph-mon[97663]: pgmap v223: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 313 op/s 2023-09-21T13:03:30.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:29 smithi160 ceph-mon[134450]: pgmap v223: 97 pgs: 97 active+clean; 201 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.1 MiB/s wr, 313 op/s 2023-09-21T13:03:30.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 654672 8.68 MB/sec execute 251 sec latency 27.751 ms 2023-09-21T13:03:31.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:30 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:03:31.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:30 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:03:31.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:30 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:03:31.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 656794 8.70 MB/sec execute 252 sec latency 48.164 ms 2023-09-21T13:03:32.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:31 smithi156 ceph-mon[134078]: pgmap v224: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 402 op/s 2023-09-21T13:03:32.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:31 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:03:32.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:31 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:03:32.405 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:31 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:03:32.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:31 smithi142 ceph-mon[97663]: pgmap v224: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 402 op/s 2023-09-21T13:03:32.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:31 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:03:32.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:31 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:03:32.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:31 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:03:32.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:31 smithi160 ceph-mon[134450]: pgmap v224: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.8 MiB/s wr, 402 op/s 2023-09-21T13:03:32.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:31 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:03:32.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:31 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:03:32.438 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:31 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:03:32.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 658126 8.69 MB/sec execute 253 sec latency 64.818 ms 2023-09-21T13:03:33.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 660517 8.71 MB/sec execute 254 sec latency 16.104 ms 2023-09-21T13:03:34.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:33 smithi156 ceph-mon[134078]: pgmap v225: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:34.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:33 smithi142 ceph-mon[97663]: pgmap v225: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:34.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:33 smithi160 ceph-mon[134450]: pgmap v225: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:34.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 661821 8.70 MB/sec execute 255 sec latency 27.443 ms 2023-09-21T13:03:35.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 664163 8.72 MB/sec execute 256 sec latency 16.260 ms 2023-09-21T13:03:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 -- 172.21.15.142:0/4053074130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae94100fd0 msgr2=0x7fae941013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 --2- 172.21.15.142:0/4053074130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae94100fd0 0x7fae941013b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fae84009990 tx=0x7fae84009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 -- 172.21.15.142:0/4053074130 shutdown_connections 2023-09-21T13:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 --2- 172.21.15.142:0/4053074130 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae941060f0 0x7fae9410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 --2- 172.21.15.142:0/4053074130 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae94100fd0 0x7fae941013b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 --2- 172.21.15.142:0/4053074130 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94101980 0x7fae941059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.023+0000 7fae995ff700 1 -- 172.21.15.142:0/4053074130 >> 172.21.15.142:0/4053074130 conn(0x7fae940fc830 msgr2=0x7fae940fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.024+0000 7fae995ff700 1 -- 172.21.15.142:0/4053074130 shutdown_connections 2023-09-21T13:03:36.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.024+0000 7fae995ff700 1 -- 172.21.15.142:0/4053074130 wait complete. 2023-09-21T13:03:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.025+0000 7fae995ff700 1 Processor -- start 2023-09-21T13:03:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.025+0000 7fae995ff700 1 -- start start 2023-09-21T13:03:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.025+0000 7fae995ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 0x7fae94196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.025+0000 7fae995ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.025+0000 7fae995ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9419ba70 0x7fae9419bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae995ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9419c4f0 con 0x7fae94100fd0 2023-09-21T13:03:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae995ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9419c660 con 0x7fae9419ba70 2023-09-21T13:03:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae995ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9419c820 con 0x7fae941060f0 2023-09-21T13:03:36.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 0x7fae94196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57042/0 (socket says 172.21.15.142:57042) 2023-09-21T13:03:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 -- 172.21.15.142:0/1218365075 learned_addr learned my addr 172.21.15.142:0/1218365075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 0x7fae94196ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42344/0 (socket says 172.21.15.142:42344) 2023-09-21T13:03:36.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae937fe700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9419ba70 0x7fae9419bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 -- 172.21.15.142:0/1218365075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9419ba70 msgr2=0x7fae9419bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9419ba70 0x7fae9419bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 -- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 msgr2=0x7fae94196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 0x7fae94196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 -- 172.21.15.142:0/1218365075 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae840095f0 con 0x7fae941060f0 2023-09-21T13:03:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.026+0000 7fae927fc700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e970 tx=0x7fae8800ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.027+0000 7fae7bfff700 1 -- 172.21.15.142:0/1218365075 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88009790 con 0x7fae941060f0 2023-09-21T13:03:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.027+0000 7fae7bfff700 1 -- 172.21.15.142:0/1218365075 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8800c7e0 con 0x7fae941060f0 2023-09-21T13:03:36.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.027+0000 7fae7bfff700 1 -- 172.21.15.142:0/1218365075 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880054e0 con 0x7fae941060f0 2023-09-21T13:03:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.027+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae941a3d80 con 0x7fae941060f0 2023-09-21T13:03:36.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.027+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae941a41b0 con 0x7fae941060f0 2023-09-21T13:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.031+0000 7fae7bfff700 1 -- 172.21.15.142:0/1218365075 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fae8800c950 con 0x7fae941060f0 2023-09-21T13:03:36.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.032+0000 7fae7bfff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 0x7fae7c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.032+0000 7fae7bfff700 1 -- 172.21.15.142:0/1218365075 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae88014070 con 0x7fae941060f0 2023-09-21T13:03:36.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.032+0000 7fae92ffd700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 0x7fae7c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.033+0000 7faeacf10b80 1 Processor -- start 2023-09-21T13:03:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.033+0000 7fae92ffd700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 0x7fae7c0a2cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae8400b2e0 tx=0x7fae84005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.033+0000 7faeacf10b80 1 -- start start 2023-09-21T13:03:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea77d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea786c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe9e3c40 con 0x560fbea73dd0 2023-09-21T13:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe9c7c10 con 0x560fbea78260 2023-09-21T13:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7faeacf10b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe9c5530 con 0x560fbea734b0 2023-09-21T13:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57048/0 (socket says 172.21.15.142:57048) 2023-09-21T13:03:36.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 -- 172.21.15.142:0/2278504825 learned_addr learned my addr 172.21.15.142:0/2278504825 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae937fe700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae927fc700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea77d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 -- 172.21.15.142:0/2278504825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 msgr2=0x560fbea786c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea786c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 -- 172.21.15.142:0/2278504825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 msgr2=0x560fbea77d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea77d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae92ffd700 1 -- 172.21.15.142:0/2278504825 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbe7ebd80 con 0x560fbea734b0 2023-09-21T13:03:36.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.034+0000 7fae927fc700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea77d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.035+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fae84015000 tx=0x7fae84020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1b5927948b1146 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.035+0000 7fae797fa700 1 -- 172.21.15.142:0/2278504825 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84004500 con 0x560fbea734b0 2023-09-21T13:03:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.035+0000 7fae797fa700 1 -- 172.21.15.142:0/2278504825 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8401e040 con 0x560fbea734b0 2023-09-21T13:03:36.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.035+0000 7fae797fa700 1 -- 172.21.15.142:0/2278504825 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400f8d0 con 0x560fbea734b0 2023-09-21T13:03:36.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- 172.21.15.142:0/2278504825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 msgr2=0x560fbea73890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fae84015000 tx=0x7fae84020000 comp rx=0 tx=0).stop 2023-09-21T13:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- 172.21.15.142:0/2278504825 shutdown_connections 2023-09-21T13:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea786c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea734b0 0x560fbea73890 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2278504825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea77d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- 172.21.15.142:0/2278504825 >> 172.21.15.142:0/2278504825 conn(0x560fbe99bfa0 msgr2=0x560fbea6a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- 172.21.15.142:0/2278504825 shutdown_connections 2023-09-21T13:03:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- 172.21.15.142:0/2278504825 wait complete. 2023-09-21T13:03:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.036+0000 7faeacf10b80 1 -- start start 2023-09-21T13:03:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 Processor -- start 2023-09-21T13:03:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea7cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe9c0e20 con 0x560fbea734b0 2023-09-21T13:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe95d6e0 con 0x560fbea73dd0 2023-09-21T13:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe95d380 con 0x560fbea78260 2023-09-21T13:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7faeacf10b80 10 client.0 _ll_register_callbacks cb 0x560fbe8a7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7fae937fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7fae927fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7fae927fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35796/0 (socket says 172.21.15.142:35796) 2023-09-21T13:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7fae927fc700 1 -- 172.21.15.142:0/2325688224 learned_addr learned my addr 172.21.15.142:0/2325688224 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.037+0000 7fae937fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57060/0 (socket says 172.21.15.142:57060) 2023-09-21T13:03:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea7cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 -- 172.21.15.142:0/2325688224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 msgr2=0x560fbea7d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 -- 172.21.15.142:0/2325688224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 msgr2=0x560fbea7cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea7cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 -- 172.21.15.142:0/2325688224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae941a41b0 con 0x560fbea73dd0 2023-09-21T13:03:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae937fe700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:36.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae927fc700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fae8800cc00 tx=0x7fae8800ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ab57c1bb6f9a826 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8809d430 con 0x560fbea73dd0 2023-09-21T13:03:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae880a1670 con 0x560fbea73dd0 2023-09-21T13:03:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.038+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560fbe931b50 con 0x560fbea73dd0 2023-09-21T13:03:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae880979a0 con 0x560fbea73dd0 2023-09-21T13:03:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 10 client.27362 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fae9410e4e0 con 0x560fbea73dd0 2023-09-21T13:03:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8807c020 con 0x560fbea73dd0 2023-09-21T13:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fae88098af0 con 0x560fbea73dd0 2023-09-21T13:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 10 client.27362 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 10 client.27362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 20 client.27362 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.039+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbea8d450 0x560fbea8f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.040+0000 7faeacf10b80 4 client.27362 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.040+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560fbea3dfc0 con 0x560fbea8d450 2023-09-21T13:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.040+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbea8d450 0x560fbea8f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.040+0000 7fae92ffd700 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbea8d450 0x560fbea8f870 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94704713dcd62b96 server_cookie=dc266ff94e6c7cee in_seq=0 out_seq=0 2023-09-21T13:03:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.040+0000 7fae76ff5700 10 client.27362 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7fae76ff5700 1 -- 172.21.15.142:0/2325688224 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560fbea3dfc0 con 0x560fbea8d450 2023-09-21T13:03:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7fae76ff5700 10 client.27362 handle_command_reply: tid=0 2023-09-21T13:03:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 client.27362 shutdown 2023-09-21T13:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 msgr2=0x560fbea7d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fae8800cc00 tx=0x7fae8800ccd0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 shutdown_connections 2023-09-21T13:03:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbea8d450 0x560fbea8f870 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea7cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea7d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7fae76ff5700 0 client.27362 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 --2- 172.21.15.142:0/2325688224 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea73dd0 0x560fbea7d290 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.041+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 >> 172.21.15.142:0/2325688224 conn(0x560fbe99bfa0 msgr2=0x560fbea69cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.042+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 shutdown_connections 2023-09-21T13:03:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.042+0000 7faeacf10b80 1 -- 172.21.15.142:0/2325688224 wait complete. 2023-09-21T13:03:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.042+0000 7faeacf10b80 20 client.27362 trim_cache size 0 max 16384 2023-09-21T13:03:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.062+0000 7faeacf10b80 1 Processor -- start 2023-09-21T13:03:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.062+0000 7faeacf10b80 1 -- start start 2023-09-21T13:03:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea843e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea773b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbe8418c0 con 0x560fbea73dd0 2023-09-21T13:03:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbea84920 con 0x560fbea734b0 2023-09-21T13:03:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7faeacf10b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbea891c0 con 0x560fbea78260 2023-09-21T13:03:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35810/0 (socket says 172.21.15.142:35810) 2023-09-21T13:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 -- 172.21.15.142:0/1554247448 learned_addr learned my addr 172.21.15.142:0/1554247448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae937fe700 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea773b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae927fc700 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea843e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 -- 172.21.15.142:0/1554247448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 msgr2=0x560fbea773b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea773b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 -- 172.21.15.142:0/1554247448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 msgr2=0x560fbea843e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea843e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.063+0000 7fae92ffd700 1 -- 172.21.15.142:0/1554247448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560fbe7d4c00 con 0x560fbea734b0 2023-09-21T13:03:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.064+0000 7fae92ffd700 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fae8400b690 tx=0x7fae8401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=314f0fe2b5fc34d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.064+0000 7fae79ffb700 1 -- 172.21.15.142:0/1554247448 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84004700 con 0x560fbea734b0 2023-09-21T13:03:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.064+0000 7fae79ffb700 1 -- 172.21.15.142:0/1554247448 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae84004d20 con 0x560fbea734b0 2023-09-21T13:03:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.064+0000 7fae79ffb700 1 -- 172.21.15.142:0/1554247448 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8400fc90 con 0x560fbea734b0 2023-09-21T13:03:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- 172.21.15.142:0/1554247448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 msgr2=0x560fbea75b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fae8400b690 tx=0x7fae8401a040 comp rx=0 tx=0).stop 2023-09-21T13:03:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- 172.21.15.142:0/1554247448 shutdown_connections 2023-09-21T13:03:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea78260 0x560fbea773b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea734b0 0x560fbea75b50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 --2- 172.21.15.142:0/1554247448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea73dd0 0x560fbea843e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- 172.21.15.142:0/1554247448 >> 172.21.15.142:0/1554247448 conn(0x560fbe99bfa0 msgr2=0x560fbea76430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- 172.21.15.142:0/1554247448 shutdown_connections 2023-09-21T13:03:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- 172.21.15.142:0/1554247448 wait complete. 2023-09-21T13:03:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.065+0000 7faeacf10b80 1 -- start start 2023-09-21T13:03:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 Processor -- start 2023-09-21T13:03:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea83d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea823d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbea82ae0 con 0x560fbea734b0 2023-09-21T13:03:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbea82c50 con 0x560fbea78260 2023-09-21T13:03:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.066+0000 7faeacf10b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560fbea82e10 con 0x560fbea73dd0 2023-09-21T13:03:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7faeacf10b80 10 client.0 _ll_register_callbacks cb 0x560fbe8a7a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae937fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea823d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae92ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea83d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57082/0 (socket says 172.21.15.142:57082) 2023-09-21T13:03:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 -- 172.21.15.142:0/441603191 learned_addr learned my addr 172.21.15.142:0/441603191 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 -- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 msgr2=0x560fbea823d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea823d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 -- 172.21.15.142:0/441603191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 msgr2=0x560fbea83d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea83d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 -- 172.21.15.142:0/441603191 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560fbe7ebd80 con 0x560fbea73dd0 2023-09-21T13:03:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae927fc700 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fae88005950 tx=0x7fae88004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac3fa9295df9e05f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:03:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae88095940 con 0x560fbea73dd0 2023-09-21T13:03:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.067+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae8401e040 con 0x560fbea73dd0 2023-09-21T13:03:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fae8807d080 con 0x560fbea73dd0 2023-09-21T13:03:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae880a1670 con 0x560fbea73dd0 2023-09-21T13:03:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 10 client.27334 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x560fbe8121f0 con 0x560fbea73dd0 2023-09-21T13:03:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae8401e040 con 0x560fbea73dd0 2023-09-21T13:03:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fae880a1300 con 0x560fbea73dd0 2023-09-21T13:03:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 10 client.27334 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 10 client.27334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 20 client.27334 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:36.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbeae21c0 0x560fbeae45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 4 client.27334 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:03:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560fbe9b9e00 con 0x560fbeae21c0 2023-09-21T13:03:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.068+0000 7fae92ffd700 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbeae21c0 0x560fbeae45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:36.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.069+0000 7fae76ff5700 10 client.27334 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:36.083 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.069+0000 7fae92ffd700 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbeae21c0 0x560fbeae45e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a56d142d22dd92e2 server_cookie=551a28f4fc8693b6 in_seq=0 out_seq=0 2023-09-21T13:03:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7fae76ff5700 1 -- 172.21.15.142:0/441603191 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560fbe9b9e00 con 0x560fbeae21c0 2023-09-21T13:03:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7fae76ff5700 10 client.27334 handle_command_reply: tid=0 2023-09-21T13:03:36.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 client.27334 shutdown 2023-09-21T13:03:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 msgr2=0x560fbea84280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fae88005950 tx=0x7fae88004750 comp rx=0 tx=0).stop 2023-09-21T13:03:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 shutdown_connections 2023-09-21T13:03:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560fbeae21c0 0x560fbeae45e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560fbea734b0 0x560fbea83d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7fae76ff5700 0 client.27334 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560fbea78260 0x560fbea823d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 --2- 172.21.15.142:0/441603191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560fbea73dd0 0x560fbea84280 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 >> 172.21.15.142:0/441603191 conn(0x560fbe99bfa0 msgr2=0x560fbea773b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 shutdown_connections 2023-09-21T13:03:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.143+0000 7faeacf10b80 1 -- 172.21.15.142:0/441603191 wait complete. 2023-09-21T13:03:36.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.144+0000 7faeacf10b80 20 client.27334 trim_cache size 0 max 16384 2023-09-21T13:03:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:03:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:03:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:03:36.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:03:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.144+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 msgr2=0x7fae7c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.144+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 0x7fae7c0a2cf0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fae8400b2e0 tx=0x7fae84005fd0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 msgr2=0x7fae94197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fae8800e970 tx=0x7fae8800ec80 comp rx=0 tx=0).stop 2023-09-21T13:03:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 shutdown_connections 2023-09-21T13:03:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fae7c0a0830 0x7fae7c0a2cf0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fae94100fd0 0x7fae94196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fae9419ba70 0x7fae9419bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 --2- 172.21.15.142:0/1218365075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae941060f0 0x7fae94197400 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 >> 172.21.15.142:0/1218365075 conn(0x7fae940fc830 msgr2=0x7fae941049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 shutdown_connections 2023-09-21T13:03:36.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:36.145+0000 7fae995ff700 1 -- 172.21.15.142:0/1218365075 wait complete. 2023-09-21T13:03:36.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:35 smithi156 ceph-mon[134078]: pgmap v226: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:36.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:35 smithi142 ceph-mon[97663]: pgmap v226: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:36.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:35 smithi160 ceph-mon[134450]: pgmap v226: 97 pgs: 97 active+clean; 190 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 317 op/s 2023-09-21T13:03:36.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 665348 8.70 MB/sec execute 257 sec latency 54.366 ms 2023-09-21T13:03:37.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 667716 8.73 MB/sec execute 258 sec latency 15.763 ms 2023-09-21T13:03:38.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:37 smithi156 ceph-mon[134078]: pgmap v227: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2023-09-21T13:03:38.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:37 smithi142 ceph-mon[97663]: pgmap v227: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2023-09-21T13:03:38.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:37 smithi160 ceph-mon[134450]: pgmap v227: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 5.7 MiB/s wr, 400 op/s 2023-09-21T13:03:38.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 669128 8.72 MB/sec execute 259 sec latency 15.360 ms 2023-09-21T13:03:39.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 671304 8.73 MB/sec execute 260 sec latency 16.252 ms 2023-09-21T13:03:40.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:39 smithi156 ceph-mon[134078]: pgmap v228: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-09-21T13:03:40.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:39 smithi142 ceph-mon[97663]: pgmap v228: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-09-21T13:03:40.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:39 smithi160 ceph-mon[134450]: pgmap v228: 97 pgs: 97 active+clean; 199 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 171 op/s 2023-09-21T13:03:40.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 672633 8.73 MB/sec execute 261 sec latency 23.871 ms 2023-09-21T13:03:41.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 674513 8.73 MB/sec execute 262 sec latency 111.163 ms 2023-09-21T13:03:42.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:41 smithi156 ceph-mon[134078]: pgmap v229: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 289 op/s 2023-09-21T13:03:42.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:41 smithi142 ceph-mon[97663]: pgmap v229: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 289 op/s 2023-09-21T13:03:42.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:41 smithi160 ceph-mon[134450]: pgmap v229: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 289 op/s 2023-09-21T13:03:42.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 675900 8.72 MB/sec execute 263 sec latency 12.354 ms 2023-09-21T13:03:43.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 678128 8.74 MB/sec execute 264 sec latency 17.341 ms 2023-09-21T13:03:44.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:43 smithi156 ceph-mon[134078]: pgmap v230: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:44.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:43 smithi142 ceph-mon[97663]: pgmap v230: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:44.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:43 smithi160 ceph-mon[134450]: pgmap v230: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:44.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 679378 8.73 MB/sec execute 265 sec latency 70.114 ms 2023-09-21T13:03:45.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 681647 8.74 MB/sec execute 266 sec latency 17.479 ms 2023-09-21T13:03:46.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:45 smithi156 ceph-mon[134078]: pgmap v231: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:46.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:45 smithi142 ceph-mon[97663]: pgmap v231: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:46.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:45 smithi160 ceph-mon[134450]: pgmap v231: 97 pgs: 97 active+clean; 195 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 199 op/s 2023-09-21T13:03:46.505 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:03:46.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 682770 8.73 MB/sec execute 267 sec latency 51.762 ms 2023-09-21T13:03:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 -- 172.21.15.142:0/1239898389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d58101980 msgr2=0x7f7d581059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/1239898389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d58101980 0x7f7d581059c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c009990 tx=0x7f7d4c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 -- 172.21.15.142:0/1239898389 shutdown_connections 2023-09-21T13:03:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/1239898389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d581060f0 0x7f7d5810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/1239898389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d58100fd0 0x7f7d581013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/1239898389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d58101980 0x7f7d581059c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 -- 172.21.15.142:0/1239898389 >> 172.21.15.142:0/1239898389 conn(0x7f7d580fc850 msgr2=0x7f7d580fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 -- 172.21.15.142:0/1239898389 shutdown_connections 2023-09-21T13:03:46.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.762+0000 7f7d5dfff700 1 -- 172.21.15.142:0/1239898389 wait complete. 2023-09-21T13:03:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.764+0000 7f7d5dfff700 1 Processor -- start 2023-09-21T13:03:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.764+0000 7f7d5dfff700 1 -- start start 2023-09-21T13:03:46.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.764+0000 7f7d5dfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d58100fd0 0x7f7d58199070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d5dfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 0x7f7d581995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d5dfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d5dfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5819e490 con 0x7f7d58100fd0 2023-09-21T13:03:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d5dfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5819e600 con 0x7f7d581060f0 2023-09-21T13:03:46.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d5dfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5819e7c0 con 0x7f7d5819da10 2023-09-21T13:03:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d57fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d57fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47112/0 (socket says 172.21.15.142:47112) 2023-09-21T13:03:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 0x7f7d581995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d57fff700 1 -- 172.21.15.142:0/2953579882 learned_addr learned my addr 172.21.15.142:0/2953579882 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:46.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d577fe700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d58100fd0 0x7f7d58199070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.765+0000 7f7d57fff700 1 -- 172.21.15.142:0/2953579882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 msgr2=0x7f7d581995b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d57fff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 0x7f7d581995b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d57fff700 1 -- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d58100fd0 msgr2=0x7f7d58199070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d57fff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d58100fd0 0x7f7d58199070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d57fff700 1 -- 172.21.15.142:0/2953579882 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0095f0 con 0x7f7d5819da10 2023-09-21T13:03:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 0x7f7d581995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d57fff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000ef30 tx=0x7f7d5000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d54ff9700 1 -- 172.21.15.142:0/2953579882 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d50018070 con 0x7f7d5819da10 2023-09-21T13:03:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d581a5cc0 con 0x7f7d5819da10 2023-09-21T13:03:46.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d54ff9700 1 -- 172.21.15.142:0/2953579882 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d5000f040 con 0x7f7d5819da10 2023-09-21T13:03:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d54ff9700 1 -- 172.21.15.142:0/2953579882 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5000cd00 con 0x7f7d5819da10 2023-09-21T13:03:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.766+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d581a61a0 con 0x7f7d5819da10 2023-09-21T13:03:46.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.771+0000 7f7d54ff9700 1 -- 172.21.15.142:0/2953579882 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7d50003a00 con 0x7f7d5819da10 2023-09-21T13:03:46.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 Processor -- start 2023-09-21T13:03:46.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 -- start start 2023-09-21T13:03:46.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9afd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9afdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9a64ca0 con 0x55ddd9afdb70 2023-09-21T13:03:46.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9a48c70 con 0x55ddd9af8e20 2023-09-21T13:03:46.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.773+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9a46590 con 0x55ddd9af9740 2023-09-21T13:03:46.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d54ff9700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 0x7f7d400a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9afd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9afd630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47118/0 (socket says 172.21.15.142:47118) 2023-09-21T13:03:46.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54654/0 (socket says 172.21.15.142:54654) 2023-09-21T13:03:46.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d577fe700 1 -- 172.21.15.142:0/1768696173 learned_addr learned my addr 172.21.15.142:0/1768696173 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:46.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d54ff9700 1 -- 172.21.15.142:0/2953579882 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d500cbae0 con 0x7f7d5819da10 2023-09-21T13:03:46.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9afdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d57fff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 0x7f7d400a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 -- 172.21.15.142:0/1768696173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 msgr2=0x55ddd9afd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9afd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 -- 172.21.15.142:0/1768696173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 msgr2=0x55ddd9afdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9afdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.774+0000 7f7d56ffd700 1 -- 172.21.15.142:0/1768696173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddd986cde0 con 0x55ddd9af8e20 2023-09-21T13:03:46.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.775+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00b650 tx=0x7f7d4c01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e047a0d57c18707 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.775+0000 7f7d57fff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 0x7f7d400a2cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009f40 tx=0x7f7d50009ed0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.775+0000 7f7d3dffb700 1 -- 172.21.15.142:0/1768696173 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c005040 con 0x55ddd9af8e20 2023-09-21T13:03:46.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.775+0000 7f7d3dffb700 1 -- 172.21.15.142:0/1768696173 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4c005660 con 0x55ddd9af8e20 2023-09-21T13:03:46.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.775+0000 7f7d3dffb700 1 -- 172.21.15.142:0/1768696173 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c004dd0 con 0x55ddd9af8e20 2023-09-21T13:03:46.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1768696173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 msgr2=0x55ddd9af9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c00b650 tx=0x7f7d4c01a040 comp rx=0 tx=0).stop 2023-09-21T13:03:46.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1768696173 shutdown_connections 2023-09-21T13:03:46.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9afdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9af9200 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1768696173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9afd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1768696173 >> 172.21.15.142:0/1768696173 conn(0x55ddd9a1d000 msgr2=0x55ddd9aeb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1768696173 shutdown_connections 2023-09-21T13:03:46.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.776+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1768696173 wait complete. 2023-09-21T13:03:46.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.777+0000 7f7d719f2b80 1 -- start start 2023-09-21T13:03:46.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.777+0000 7f7d719f2b80 1 Processor -- start 2023-09-21T13:03:46.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b05370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b02d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9a41e80 con 0x55ddd9afdb70 2023-09-21T13:03:46.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd99de740 con 0x55ddd9af8e20 2023-09-21T13:03:46.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd99de3e0 con 0x55ddd9af9740 2023-09-21T13:03:46.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d719f2b80 10 client.0 _ll_register_callbacks cb 0x55ddd9928a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:46.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b05370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b05370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54664/0 (socket says 172.21.15.142:54664) 2023-09-21T13:03:46.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d56ffd700 1 -- 172.21.15.142:0/4051787584 learned_addr learned my addr 172.21.15.142:0/4051787584 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:46.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47134/0 (socket says 172.21.15.142:47134) 2023-09-21T13:03:46.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.778+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b02d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 -- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 msgr2=0x55ddd9b05370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b05370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 -- 172.21.15.142:0/4051787584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 msgr2=0x55ddd9b02d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b02d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 -- 172.21.15.142:0/4051787584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c020040 con 0x55ddd9af9740 2023-09-21T13:03:46.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b02d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:03:46.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d577fe700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d480126d0 tx=0x7f7d480129e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7beb3bca3199af64 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:03:46.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48017070 con 0x55ddd9af9740 2023-09-21T13:03:46.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddd99b2bb0 con 0x55ddd9af9740 2023-09-21T13:03:46.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d48004050 con 0x55ddd9af9740 2023-09-21T13:03:46.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d48004210 con 0x55ddd9af9740 2023-09-21T13:03:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d719f2b80 10 client.27346 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.779+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ddd9855c60 con 0x55ddd9af9740 2023-09-21T13:03:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ddd99b2bb0 con 0x55ddd9af9740 2023-09-21T13:03:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7d48025510 con 0x55ddd9af9740 2023-09-21T13:03:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 10 client.27346 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:46.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 10 client.27346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:46.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 20 client.27346 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:46.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b12c40 0x55ddd9b15060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 4 client.27346 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:46.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddd9abf020 con 0x55ddd9b12c40 2023-09-21T13:03:46.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.780+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b12c40 0x55ddd9b15060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.781+0000 7f7d36ffd700 10 client.27346 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:46.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.781+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b12c40 0x55ddd9b15060 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a8fc2f9de55ffd1 server_cookie=1f916a69897d62ad in_seq=0 out_seq=0 2023-09-21T13:03:46.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d36ffd700 1 -- 172.21.15.142:0/4051787584 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ddd9abf020 con 0x55ddd9b12c40 2023-09-21T13:03:46.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d36ffd700 10 client.27346 handle_command_reply: tid=0 2023-09-21T13:03:46.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 client.27346 shutdown 2023-09-21T13:03:46.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 msgr2=0x55ddd9b025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7d480126d0 tx=0x7f7d480129e0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 shutdown_connections 2023-09-21T13:03:46.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b12c40 0x55ddd9b15060 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b02d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b05370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/4051787584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b025f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d36ffd700 0 client.27346 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:46.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 >> 172.21.15.142:0/4051787584 conn(0x55ddd9a1d000 msgr2=0x55ddd9aeb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.782+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 shutdown_connections 2023-09-21T13:03:46.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.783+0000 7f7d719f2b80 1 -- 172.21.15.142:0/4051787584 wait complete. 2023-09-21T13:03:46.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.783+0000 7f7d719f2b80 20 client.27346 trim_cache size 0 max 16384 2023-09-21T13:03:46.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.802+0000 7f7d719f2b80 1 Processor -- start 2023-09-21T13:03:46.802 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.802+0000 7f7d719f2b80 1 -- start start 2023-09-21T13:03:46.803 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 0x55ddd9b09c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9afdb70 0x55ddd9afcbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd98c2920 con 0x55ddd9af8e20 2023-09-21T13:03:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9ae5990 con 0x55ddd9afdb70 2023-09-21T13:03:46.804 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9aeb890 con 0x55ddd9af9740 2023-09-21T13:03:46.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 0x55ddd9b09c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d577fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47148/0 (socket says 172.21.15.142:47148) 2023-09-21T13:03:46.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 0x55ddd9b09c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32916/0 (socket says 172.21.15.142:32916) 2023-09-21T13:03:46.805 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d577fe700 1 -- 172.21.15.142:0/1732786075 learned_addr learned my addr 172.21.15.142:0/1732786075 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:46.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.803+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9afdb70 0x55ddd9afcbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 -- 172.21.15.142:0/1732786075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9afdb70 msgr2=0x55ddd9afcbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9afdb70 0x55ddd9afcbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 -- 172.21.15.142:0/1732786075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 msgr2=0x55ddd9b09c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 0x55ddd9b09c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 -- 172.21.15.142:0/1732786075 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddd9893250 con 0x55ddd9af9740 2023-09-21T13:03:46.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d577fe700 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005c40 tx=0x7f7d480098e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29005318849e3bf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d3e7fc700 1 -- 172.21.15.142:0/1732786075 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48017040 con 0x55ddd9af9740 2023-09-21T13:03:46.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d3e7fc700 1 -- 172.21.15.142:0/1732786075 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d48025680 con 0x55ddd9af9740 2023-09-21T13:03:46.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.804+0000 7f7d3e7fc700 1 -- 172.21.15.142:0/1732786075 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d480038e0 con 0x55ddd9af9740 2023-09-21T13:03:46.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1732786075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 msgr2=0x55ddd9b01dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7d48005c40 tx=0x7f7d480098e0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1732786075 shutdown_connections 2023-09-21T13:03:46.811 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9af8e20 0x55ddd9b09c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9afdb70 0x55ddd9afcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/1732786075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b01dd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1732786075 >> 172.21.15.142:0/1732786075 conn(0x55ddd9a1d000 msgr2=0x55ddd9afbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1732786075 shutdown_connections 2023-09-21T13:03:46.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.805+0000 7f7d719f2b80 1 -- 172.21.15.142:0/1732786075 wait complete. 2023-09-21T13:03:46.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.806+0000 7f7d719f2b80 1 -- start start 2023-09-21T13:03:46.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.806+0000 7f7d719f2b80 1 Processor -- start 2023-09-21T13:03:46.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b049e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9b66bf0 con 0x55ddd9afdb70 2023-09-21T13:03:46.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9b66d60 con 0x55ddd9af8e20 2023-09-21T13:03:46.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddd9b66f20 con 0x55ddd9af9740 2023-09-21T13:03:46.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d719f2b80 10 client.0 _ll_register_callbacks cb 0x55ddd9928a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:46.814 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54676/0 (socket says 172.21.15.142:54676) 2023-09-21T13:03:46.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 -- 172.21.15.142:0/2017322071 learned_addr learned my addr 172.21.15.142:0/2017322071 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:46.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b049e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d577fe700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.815 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 -- 172.21.15.142:0/2017322071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 msgr2=0x55ddd9b044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.807+0000 7f7d56ffd700 1 -- 172.21.15.142:0/2017322071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 msgr2=0x55ddd9b049e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:46.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b049e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d56ffd700 1 -- 172.21.15.142:0/2017322071 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddd9855c60 con 0x55ddd9af8e20 2023-09-21T13:03:46.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d577fe700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:03:46.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d56ffd700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c004670 tx=0x7f7d4c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26e3165472125d1d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:46.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d36ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:46.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4c004c10 con 0x55ddd9af8e20 2023-09-21T13:03:46.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d4c004d70 con 0x55ddd9af8e20 2023-09-21T13:03:46.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.808+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d4c005660 con 0x55ddd9af8e20 2023-09-21T13:03:46.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d4c004f30 con 0x55ddd9af8e20 2023-09-21T13:03:46.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 10 client.27386 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:46.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55ddd986b2b0 con 0x55ddd9af8e20 2023-09-21T13:03:46.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d4c005660 con 0x55ddd9af8e20 2023-09-21T13:03:46.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f7d4c00fad0 con 0x55ddd9af8e20 2023-09-21T13:03:46.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 10 client.27386 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:46.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 10 client.27386 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:46.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 20 client.27386 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:46.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b68140 0x55ddd9b6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:46.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 4 client.27386 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:03:46.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ddd9a3ae60 con 0x55ddd9b68140 2023-09-21T13:03:46.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.809+0000 7f7d577fe700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b68140 0x55ddd9b6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:46.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.810+0000 7f7d36ffd700 10 client.27386 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:46.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.810+0000 7f7d577fe700 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b68140 0x55ddd9b6a530 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5126c4f44c554f server_cookie=fbe9e9d1844822f in_seq=0 out_seq=0 2023-09-21T13:03:46.820 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d36ffd700 1 -- 172.21.15.142:0/2017322071 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ddd9a3ae60 con 0x55ddd9b68140 2023-09-21T13:03:46.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d36ffd700 10 client.27386 handle_command_reply: tid=0 2023-09-21T13:03:46.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 client.27386 shutdown 2023-09-21T13:03:46.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 msgr2=0x55ddd9b03f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c004670 tx=0x7f7d4c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.821 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 shutdown_connections 2023-09-21T13:03:46.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ddd9b68140 0x55ddd9b6a530 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ddd9afdb70 0x55ddd9b049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ddd9af8e20 0x55ddd9b03f60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 --2- 172.21.15.142:0/2017322071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ddd9af9740 0x55ddd9b044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.822 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d36ffd700 0 client.27386 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:46.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 >> 172.21.15.142:0/2017322071 conn(0x55ddd9a1d000 msgr2=0x55ddd9aff800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 shutdown_connections 2023-09-21T13:03:46.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 1 -- 172.21.15.142:0/2017322071 wait complete. 2023-09-21T13:03:46.823 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.811+0000 7f7d719f2b80 20 client.27386 trim_cache size 0 max 16384 2023-09-21T13:03:46.824 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:03:46.824 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:03:46.824 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:03:46.824 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:03:46.825 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:03:46.825 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:03:46.825 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:03:46.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:03:46.825 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:03:46.826 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:03:46.826 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 msgr2=0x7f7d400a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 0x7f7d400a2cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7d50009f40 tx=0x7f7d50009ed0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 msgr2=0x7f7d5819de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000ef30 tx=0x7f7d5000c3a0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 shutdown_connections 2023-09-21T13:03:46.827 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d400a0830 0x7f7d400a2cf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d58100fd0 0x7f7d58199070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5819da10 0x7f7d5819de90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 --2- 172.21.15.142:0/2953579882 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d581060f0 0x7f7d581995b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:46.828 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 >> 172.21.15.142:0/2953579882 conn(0x7f7d580fc850 msgr2=0x7f7d580fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 shutdown_connections 2023-09-21T13:03:46.829 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:03:46.812+0000 7f7d5dfff700 1 -- 172.21.15.142:0/2953579882 wait complete. 2023-09-21T13:03:46.834 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:03:47.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 684867 8.74 MB/sec execute 268 sec latency 19.245 ms 2023-09-21T13:03:48.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:47 smithi156 ceph-mon[134078]: pgmap v232: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 278 op/s 2023-09-21T13:03:48.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:47 smithi142 ceph-mon[97663]: pgmap v232: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 278 op/s 2023-09-21T13:03:48.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:47 smithi160 ceph-mon[134450]: pgmap v232: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.4 MiB/s wr, 278 op/s 2023-09-21T13:03:48.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 686379 8.74 MB/sec execute 269 sec latency 9.908 ms 2023-09-21T13:03:49.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 -- 172.21.15.142:0/2872766636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff890100fd0 msgr2=0x7ff8901013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 --2- 172.21.15.142:0/2872766636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff890100fd0 0x7ff8901013b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7ff888009990 tx=0x7ff888009ca0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 -- 172.21.15.142:0/2872766636 shutdown_connections 2023-09-21T13:03:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 --2- 172.21.15.142:0/2872766636 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff89010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 --2- 172.21.15.142:0/2872766636 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff890100fd0 0x7ff8901013b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 --2- 172.21.15.142:0/2872766636 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890101980 0x7ff8901059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 -- 172.21.15.142:0/2872766636 >> 172.21.15.142:0/2872766636 conn(0x7ff8900fc890 msgr2=0x7ff8900fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 -- 172.21.15.142:0/2872766636 shutdown_connections 2023-09-21T13:03:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.317+0000 7ff897fff700 1 -- 172.21.15.142:0/2872766636 wait complete. 2023-09-21T13:03:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 Processor -- start 2023-09-21T13:03:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 -- start start 2023-09-21T13:03:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 0x7ff890199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff890199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 0x7ff89019e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89019e730 con 0x7ff890100fd0 2023-09-21T13:03:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89019e8a0 con 0x7ff89019dcb0 2023-09-21T13:03:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.319+0000 7ff897fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89019ea60 con 0x7ff8901060f0 2023-09-21T13:03:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 0x7ff890199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 0x7ff890199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:32944/0 (socket says 172.21.15.142:32944) 2023-09-21T13:03:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff890199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff895d9b700 1 -- 172.21.15.142:0/64142167 learned_addr learned my addr 172.21.15.142:0/64142167 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89659c700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 0x7ff89019e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 -- 172.21.15.142:0/64142167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 msgr2=0x7ff89019e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 0x7ff89019e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 -- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 msgr2=0x7ff890199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 0x7ff890199100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 -- 172.21.15.142:0/64142167 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880095f0 con 0x7ff8901060f0 2023-09-21T13:03:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89659c700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 0x7ff89019e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff89559a700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff890199640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff884007e90 tx=0x7ff88400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff882ffd700 1 -- 172.21.15.142:0/64142167 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884004db0 con 0x7ff8901060f0 2023-09-21T13:03:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff882ffd700 1 -- 172.21.15.142:0/64142167 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff88400f040 con 0x7ff8901060f0 2023-09-21T13:03:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8901a5fc0 con 0x7ff8901060f0 2023-09-21T13:03:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.320+0000 7ff882ffd700 1 -- 172.21.15.142:0/64142167 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884005950 con 0x7ff8901060f0 2023-09-21T13:03:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.321+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8901a6440 con 0x7ff8901060f0 2023-09-21T13:03:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.324+0000 7ff882ffd700 1 -- 172.21.15.142:0/64142167 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff884005000 con 0x7ff8901060f0 2023-09-21T13:03:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.325+0000 7ff8ab8d1b80 1 Processor -- start 2023-09-21T13:03:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff882ffd700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 0x7ff87c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 -- start start 2023-09-21T13:03:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff882ffd700 1 -- 172.21.15.142:0/64142167 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff8840cb860 con 0x7ff8901060f0 2023-09-21T13:03:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb63480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff89659c700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 0x7ff87c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb682b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ead7c40 con 0x55929eb630a0 2023-09-21T13:03:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eabbc10 con 0x55929eb639c0 2023-09-21T13:03:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eab9530 con 0x55929eb67e50 2023-09-21T13:03:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54696/0 (socket says 172.21.15.142:54696) 2023-09-21T13:03:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.326+0000 7ff89559a700 1 -- 172.21.15.142:0/940260739 learned_addr learned my addr 172.21.15.142:0/940260739 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff895d9b700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb63480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 -- 172.21.15.142:0/940260739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 msgr2=0x55929eb682b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89659c700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb682b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb682b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 -- 172.21.15.142:0/940260739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 msgr2=0x55929eb63480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb63480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 -- 172.21.15.142:0/940260739 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929e8dfd80 con 0x55929eb639c0 2023-09-21T13:03:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89659c700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:03:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89659c700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 0x7ff87c0a2c70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009f90 tx=0x7ff88c0117d0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff89559a700 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8840951b0 tx=0x7ff884098870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22e034174f777ab8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff87bfff700 1 -- 172.21.15.142:0/940260739 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884098cb0 con 0x55929eb639c0 2023-09-21T13:03:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff87bfff700 1 -- 172.21.15.142:0/940260739 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff88409cae0 con 0x55929eb639c0 2023-09-21T13:03:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.327+0000 7ff87bfff700 1 -- 172.21.15.142:0/940260739 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840981a0 con 0x55929eb639c0 2023-09-21T13:03:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/940260739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 msgr2=0x55929eb67910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff8840951b0 tx=0x7ff884098870 comp rx=0 tx=0).stop 2023-09-21T13:03:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/940260739 shutdown_connections 2023-09-21T13:03:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb63480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb682b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/940260739 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb67910 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/940260739 >> 172.21.15.142:0/940260739 conn(0x55929ea8ffa0 msgr2=0x55929eb5e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/940260739 shutdown_connections 2023-09-21T13:03:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.328+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/940260739 wait complete. 2023-09-21T13:03:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.329+0000 7ff8ab8d1b80 1 -- start start 2023-09-21T13:03:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.329+0000 7ff8ab8d1b80 1 Processor -- start 2023-09-21T13:03:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb6f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb6cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eab4e20 con 0x55929eb630a0 2023-09-21T13:03:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ea516e0 con 0x55929eb639c0 2023-09-21T13:03:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ea51380 con 0x55929eb67e50 2023-09-21T13:03:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff8ab8d1b80 10 client.0 _ll_register_callbacks cb 0x55929e99ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb6f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54698/0 (socket says 172.21.15.142:54698) 2023-09-21T13:03:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.330+0000 7ff89559a700 1 -- 172.21.15.142:0/3369937742 learned_addr learned my addr 172.21.15.142:0/3369937742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89659c700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb6cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 -- 172.21.15.142:0/3369937742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 msgr2=0x55929eb6cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb6cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 -- 172.21.15.142:0/3369937742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 msgr2=0x55929eb6f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb6f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 -- 172.21.15.142:0/3369937742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8901a6440 con 0x55929eb639c0 2023-09-21T13:03:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff89559a700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff88400d700 tx=0x7ff884005360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb80c3f917a63b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff8797fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8840a0d20 con 0x55929eb639c0 2023-09-21T13:03:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55929ea25b50 con 0x55929eb639c0 2023-09-21T13:03:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff884098cb0 con 0x55929eb639c0 2023-09-21T13:03:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.331+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff884099120 con 0x55929eb639c0 2023-09-21T13:03:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 10 client.27398 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55929e8c8c00 con 0x55929eb639c0 2023-09-21T13:03:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55929ea25b50 con 0x55929eb639c0 2023-09-21T13:03:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff8840b2070 con 0x55929eb639c0 2023-09-21T13:03:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 10 client.27398 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 10 client.27398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 20 client.27398 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929eb7caf0 0x55929eb7ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 4 client.27398 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:03:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55929eb31fc0 con 0x55929eb7caf0 2023-09-21T13:03:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.332+0000 7ff895d9b700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929eb7caf0 0x55929eb7ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.333+0000 7ff895d9b700 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929eb7caf0 0x55929eb7ef10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf9399b5e855624f server_cookie=bcb8044437631812 in_seq=0 out_seq=0 2023-09-21T13:03:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.333+0000 7ff8797fa700 10 client.27398 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8797fa700 1 -- 172.21.15.142:0/3369937742 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55929eb31fc0 con 0x55929eb7caf0 2023-09-21T13:03:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8797fa700 10 client.27398 handle_command_reply: tid=0 2023-09-21T13:03:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 client.27398 shutdown 2023-09-21T13:03:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 msgr2=0x55929eb6c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7ff88400d700 tx=0x7ff884005360 comp rx=0 tx=0).stop 2023-09-21T13:03:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 shutdown_connections 2023-09-21T13:03:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929eb7caf0 0x55929eb7ef10 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb6f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb6cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/3369937742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb6c870 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 >> 172.21.15.142:0/3369937742 conn(0x55929ea8ffa0 msgr2=0x55929eb5dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.334+0000 7ff8797fa700 0 client.27398 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.335+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 shutdown_connections 2023-09-21T13:03:49.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.335+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/3369937742 wait complete. 2023-09-21T13:03:49.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.335+0000 7ff8ab8d1b80 20 client.27398 trim_cache size 0 max 16384 2023-09-21T13:03:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.352+0000 7ff8ab8d1b80 1 Processor -- start 2023-09-21T13:03:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 -- start start 2023-09-21T13:03:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb74000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb639c0 0x55929eb6c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929e9358c0 con 0x55929eb630a0 2023-09-21T13:03:49.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eb641c0 con 0x55929eb67e50 2023-09-21T13:03:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eb5f9b0 con 0x55929eb639c0 2023-09-21T13:03:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff89659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb74000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff89659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54700/0 (socket says 172.21.15.142:54700) 2023-09-21T13:03:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff89659c700 1 -- 172.21.15.142:0/2692619999 learned_addr learned my addr 172.21.15.142:0/2692619999 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.353+0000 7ff89559a700 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb639c0 0x55929eb6c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 -- 172.21.15.142:0/2692619999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb639c0 msgr2=0x55929eb6c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb639c0 0x55929eb6c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 -- 172.21.15.142:0/2692619999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 msgr2=0x55929eb74000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb74000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 -- 172.21.15.142:0/2692619999 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929e9061f0 con 0x55929eb67e50 2023-09-21T13:03:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff895d9b700 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb74000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff89659c700 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0045d0 tx=0x7ff88c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c5b608f74d5c3e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff880ff9700 1 -- 172.21.15.142:0/2692619999 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c004120 con 0x55929eb67e50 2023-09-21T13:03:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff880ff9700 1 -- 172.21.15.142:0/2692619999 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff88c003d70 con 0x55929eb67e50 2023-09-21T13:03:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.354+0000 7ff880ff9700 1 -- 172.21.15.142:0/2692619999 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c0276a0 con 0x55929eb67e50 2023-09-21T13:03:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2692619999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 msgr2=0x55929eb67520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0045d0 tx=0x7ff88c01a000 comp rx=0 tx=0).stop 2023-09-21T13:03:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2692619999 shutdown_connections 2023-09-21T13:03:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb74000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb67e50 0x55929eb67520 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2692619999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb639c0 0x55929eb6c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2692619999 >> 172.21.15.142:0/2692619999 conn(0x55929ea8ffa0 msgr2=0x55929eb66e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2692619999 shutdown_connections 2023-09-21T13:03:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.355+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2692619999 wait complete. 2023-09-21T13:03:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.356+0000 7ff8ab8d1b80 1 -- start start 2023-09-21T13:03:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.356+0000 7ff8ab8d1b80 1 Processor -- start 2023-09-21T13:03:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.356+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb70430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.356+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8ab8d1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb70eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929eb743a0 con 0x55929eb630a0 2023-09-21T13:03:49.373 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ebd0900 con 0x55929eb639c0 2023-09-21T13:03:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8ab8d1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ebd0a40 con 0x55929eb67e50 2023-09-21T13:03:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8ab8d1b80 10 client.0 _ll_register_callbacks cb 0x55929e99ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:03:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff895d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb70430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54702/0 (socket says 172.21.15.142:54702) 2023-09-21T13:03:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 -- 172.21.15.142:0/2871468730 learned_addr learned my addr 172.21.15.142:0/2871468730 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:03:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89659c700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb70eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.375 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 -- 172.21.15.142:0/2871468730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 msgr2=0x55929eb70eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb70eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 -- 172.21.15.142:0/2871468730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 msgr2=0x55929eb70430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:03:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb70430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 -- 172.21.15.142:0/2871468730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89010e4e0 con 0x55929eb639c0 2023-09-21T13:03:49.376 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff895d9b700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb70430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:03:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff89559a700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8840060b0 tx=0x7ff884004f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2e62ea5c06bd6ce server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:03:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.357+0000 7ff8797fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:03:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff884098cb0 con 0x55929eb639c0 2023-09-21T13:03:49.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff8840a0d20 con 0x55929eb639c0 2023-09-21T13:03:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff88409cae0 con 0x55929eb639c0 2023-09-21T13:03:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff884094bf0 con 0x55929eb639c0 2023-09-21T13:03:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 10 client.27404 fetch_fsmap learned FSMap version 33 2023-09-21T13:03:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7ff88c004280 con 0x55929eb639c0 2023-09-21T13:03:49.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff88409cae0 con 0x55929eb639c0 2023-09-21T13:03:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 33) v1 ==== 7894+0+0 (secure 0 0 0) 0x7ff8840b2070 con 0x55929eb639c0 2023-09-21T13:03:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 10 client.27404 fetch_fsmap finished waiting for FSMap version 33 2023-09-21T13:03:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 10 client.27404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:03:49.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 20 client.27404 populate_metadata read hostname 'smithi142' 2023-09-21T13:03:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929ebd1e70 0x55929ebd4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:03:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 4 client.27404 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:03:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.358+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55929eaade00 con 0x55929ebd1e70 2023-09-21T13:03:49.380 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.359+0000 7ff895d9b700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929ebd1e70 0x55929ebd4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:03:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.359+0000 7ff8797fa700 10 client.27404 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:49.381 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.359+0000 7ff895d9b700 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929ebd1e70 0x55929ebd4290 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=268b85e909db9b30 server_cookie=6948a8961d473199 in_seq=0 out_seq=0 2023-09-21T13:03:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.435+0000 7ff8797fa700 1 -- 172.21.15.142:0/2871468730 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55929eaade00 con 0x55929ebd1e70 2023-09-21T13:03:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.435+0000 7ff8797fa700 10 client.27404 handle_command_reply: tid=0 2023-09-21T13:03:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.435+0000 7ff8ab8d1b80 1 client.27404 shutdown 2023-09-21T13:03:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 msgr2=0x55929eb70970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff8840060b0 tx=0x7ff884004f10 comp rx=0 tx=0).stop 2023-09-21T13:03:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 shutdown_connections 2023-09-21T13:03:49.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55929ebd1e70 0x55929ebd4290 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55929eb630a0 0x55929eb70430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55929eb67e50 0x55929eb70eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 --2- 172.21.15.142:0/2871468730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55929eb639c0 0x55929eb70970 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8797fa700 0 client.27404 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:03:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 >> 172.21.15.142:0/2871468730 conn(0x55929ea8ffa0 msgr2=0x55929eb62730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 shutdown_connections 2023-09-21T13:03:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.436+0000 7ff8ab8d1b80 1 -- 172.21.15.142:0/2871468730 wait complete. 2023-09-21T13:03:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.437+0000 7ff8ab8d1b80 20 client.27404 trim_cache size 0 max 16384 2023-09-21T13:03:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:03:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:03:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:03:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:03:49.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 msgr2=0x7ff87c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 0x7ff87c0a2c70 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009f90 tx=0x7ff88c0117d0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 msgr2=0x7ff890199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:03:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff890199640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff884007e90 tx=0x7ff88400d3b0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 shutdown_connections 2023-09-21T13:03:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff87c0a07b0 0x7ff87c0a2c70 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff890100fd0 0x7ff890199100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff89019dcb0 0x7ff89019e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 --2- 172.21.15.142:0/64142167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8901060f0 0x7ff890199640 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff884007e90 tx=0x7ff88400d3b0 comp rx=0 tx=0).stop 2023-09-21T13:03:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.438+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 >> 172.21.15.142:0/64142167 conn(0x7ff8900fc890 msgr2=0x7ff890102990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:03:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.440+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 shutdown_connections 2023-09-21T13:03:49.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:03:49.440+0000 7ff897fff700 1 -- 172.21.15.142:0/64142167 wait complete. 2023-09-21T13:03:49.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 688572 8.75 MB/sec execute 270 sec latency 45.868 ms 2023-09-21T13:03:50.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:49 smithi156 ceph-mon[134078]: pgmap v233: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 195 op/s 2023-09-21T13:03:50.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:49 smithi142 ceph-mon[97663]: pgmap v233: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 195 op/s 2023-09-21T13:03:50.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:49 smithi160 ceph-mon[134450]: pgmap v233: 97 pgs: 97 active+clean; 203 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 195 op/s 2023-09-21T13:03:50.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 689987 8.75 MB/sec execute 271 sec latency 12.380 ms 2023-09-21T13:03:51.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 692307 8.76 MB/sec execute 272 sec latency 16.924 ms 2023-09-21T13:03:52.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:51 smithi156 ceph-mon[134078]: pgmap v234: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-09-21T13:03:52.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:51 smithi142 ceph-mon[97663]: pgmap v234: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-09-21T13:03:52.437 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:51 smithi160 ceph-mon[134450]: pgmap v234: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2023-09-21T13:03:52.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 693670 8.75 MB/sec execute 273 sec latency 25.369 ms 2023-09-21T13:03:53.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 695861 8.77 MB/sec execute 274 sec latency 18.474 ms 2023-09-21T13:03:54.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:53 smithi156 ceph-mon[134078]: pgmap v235: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:54.415 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:53 smithi142 ceph-mon[97663]: pgmap v235: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:54.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:53 smithi160 ceph-mon[134450]: pgmap v235: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:54.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 697261 8.76 MB/sec execute 275 sec latency 10.863 ms 2023-09-21T13:03:55.404 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:55 smithi156 ceph-mon[134078]: pgmap v236: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:55.417 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:55 smithi142 ceph-mon[97663]: pgmap v236: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:55.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:55 smithi160 ceph-mon[134450]: pgmap v236: 97 pgs: 97 active+clean; 199 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 197 op/s 2023-09-21T13:03:55.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 699414 8.77 MB/sec execute 276 sec latency 18.882 ms 2023-09-21T13:03:56.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 700690 8.76 MB/sec execute 277 sec latency 24.661 ms 2023-09-21T13:03:57.696 INFO:tasks.workunit.client.0.smithi142.stdout: 1 703073 8.79 MB/sec execute 278 sec latency 15.479 ms 2023-09-21T13:03:57.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:57 smithi156 ceph-mon[134078]: pgmap v237: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 285 op/s 2023-09-21T13:03:57.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:57 smithi142 ceph-mon[97663]: pgmap v237: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 285 op/s 2023-09-21T13:03:57.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:57 smithi160 ceph-mon[134450]: pgmap v237: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 285 op/s 2023-09-21T13:03:58.697 INFO:tasks.workunit.client.0.smithi142.stdout: 1 704556 8.78 MB/sec execute 279 sec latency 14.779 ms 2023-09-21T13:03:59.697 INFO:tasks.workunit.client.0.smithi142.stdout: 1 706834 8.79 MB/sec execute 280 sec latency 13.881 ms 2023-09-21T13:03:59.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:03:59 smithi156 ceph-mon[134078]: pgmap v238: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2023-09-21T13:03:59.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:03:59 smithi142 ceph-mon[97663]: pgmap v238: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2023-09-21T13:03:59.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:03:59 smithi160 ceph-mon[134450]: pgmap v238: 97 pgs: 97 active+clean; 208 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 207 op/s 2023-09-21T13:04:00.697 INFO:tasks.workunit.client.0.smithi142.stdout: 1 707285 8.77 MB/sec execute 281 sec latency 378.628 ms 2023-09-21T13:04:01.697 INFO:tasks.workunit.client.0.smithi142.stdout: 1 708368 8.76 MB/sec execute 282 sec latency 173.301 ms 2023-09-21T13:04:01.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:01 smithi156 ceph-mon[134078]: pgmap v239: 97 pgs: 97 active+clean; 222 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 287 op/s 2023-09-21T13:04:01.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:01 smithi142 ceph-mon[97663]: pgmap v239: 97 pgs: 97 active+clean; 222 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 287 op/s 2023-09-21T13:04:01.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:01 smithi160 ceph-mon[134450]: pgmap v239: 97 pgs: 97 active+clean; 222 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 287 op/s 2023-09-21T13:04:02.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 -- 172.21.15.142:0/3339863110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5788073af0 msgr2=0x7f578810d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 --2- 172.21.15.142:0/3339863110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5788073af0 0x7f578810d0e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5778009990 tx=0x7f5778009ca0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 -- 172.21.15.142:0/3339863110 shutdown_connections 2023-09-21T13:04:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 --2- 172.21.15.142:0/3339863110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 0x7f57880735b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 --2- 172.21.15.142:0/3339863110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f578810d620 0x7f578810fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 --2- 172.21.15.142:0/3339863110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5788073af0 0x7f578810d0e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 -- 172.21.15.142:0/3339863110 >> 172.21.15.142:0/3339863110 conn(0x7f57880fc8b0 msgr2=0x7f57880fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 -- 172.21.15.142:0/3339863110 shutdown_connections 2023-09-21T13:04:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.622+0000 7f57901ff700 1 -- 172.21.15.142:0/3339863110 wait complete. 2023-09-21T13:04:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.623+0000 7f57901ff700 1 Processor -- start 2023-09-21T13:04:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.623+0000 7f57901ff700 1 -- start start 2023-09-21T13:04:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 0x7f5788199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 0x7f5788199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578819e310 con 0x7f57880731d0 2023-09-21T13:04:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578819e480 con 0x7f578810d620 2023-09-21T13:04:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f57901ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578819e640 con 0x7f5788073af0 2023-09-21T13:04:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 0x7f5788199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 0x7f5788199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:53352/0 (socket says 172.21.15.142:53352) 2023-09-21T13:04:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 0x7f5788199660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45180/0 (socket says 172.21.15.142:45180) 2023-09-21T13:04:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578e79c700 1 -- 172.21.15.142:0/4262273722 learned_addr learned my addr 172.21.15.142:0/4262273722 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.624+0000 7f578e79c700 1 -- 172.21.15.142:0/4262273722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 msgr2=0x7f5788199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f578e79c700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 0x7f5788199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f578e79c700 1 -- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 msgr2=0x7f5788199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f578e79c700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 0x7f5788199120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f578e79c700 1 -- 172.21.15.142:0/4262273722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5780009c40 con 0x7f578810d620 2023-09-21T13:04:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f578e79c700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f578000c370 tx=0x7f578000c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f577effd700 1 -- 172.21.15.142:0/4262273722 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5780017070 con 0x7f578810d620 2023-09-21T13:04:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f577effd700 1 -- 172.21.15.142:0/4262273722 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f578000f040 con 0x7f578810d620 2023-09-21T13:04:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57780095f0 con 0x7f578810d620 2023-09-21T13:04:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f577effd700 1 -- 172.21.15.142:0/4262273722 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578000e050 con 0x7f578810d620 2023-09-21T13:04:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.625+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57881a5f80 con 0x7f578810d620 2023-09-21T13:04:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.629+0000 7f577effd700 1 -- 172.21.15.142:0/4262273722 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f578000cb60 con 0x7f578810d620 2023-09-21T13:04:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.631+0000 7f577effd700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 0x7f57740a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.631+0000 7f577effd700 1 -- 172.21.15.142:0/4262273722 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f57800cb800 con 0x7f578810d620 2023-09-21T13:04:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.631+0000 7f57a3babb80 1 Processor -- start 2023-09-21T13:04:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.631+0000 7f578df9b700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 0x7f57740a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 -- start start 2023-09-21T13:04:02.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f578df9b700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 0x7f57740a2cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5784009c60 tx=0x7f5784009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 0x55c0b75cc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75d0e50 0x55c0b75d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b7540c40 con 0x55c0b75d0e50 2023-09-21T13:04:02.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b7524c10 con 0x55c0b75cc0a0 2023-09-21T13:04:02.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.632+0000 7f57a3babb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b7522530 con 0x55c0b75cc9c0 2023-09-21T13:04:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578e79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75d0e50 0x55c0b75d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 0x55c0b75cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45192/0 (socket says 172.21.15.142:45192) 2023-09-21T13:04:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578d79a700 1 -- 172.21.15.142:0/3691759072 learned_addr learned my addr 172.21.15.142:0/3691759072 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 -- 172.21.15.142:0/3691759072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 msgr2=0x55c0b75d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 -- 172.21.15.142:0/3691759072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75d0e50 msgr2=0x55c0b75d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75d0e50 0x55c0b75d12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 -- 172.21.15.142:0/3691759072 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0b7348d80 con 0x55c0b75cc0a0 2023-09-21T13:04:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578d79a700 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.633+0000 7f578df9b700 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 0x55c0b75cc480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f578400e3b0 tx=0x7f5784014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fde13e8c2621d0ab server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.634+0000 7f5773fff700 1 -- 172.21.15.142:0/3691759072 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400ed50 con 0x55c0b75cc0a0 2023-09-21T13:04:02.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.634+0000 7f5773fff700 1 -- 172.21.15.142:0/3691759072 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5784021070 con 0x55c0b75cc0a0 2023-09-21T13:04:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.634+0000 7f5773fff700 1 -- 172.21.15.142:0/3691759072 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784003e30 con 0x55c0b75cc0a0 2023-09-21T13:04:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.634+0000 7f57a3babb80 1 -- 172.21.15.142:0/3691759072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 msgr2=0x55c0b75cc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.634+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 0x55c0b75cc480 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f578400e3b0 tx=0x7f5784014000 comp rx=0 tx=0).stop 2023-09-21T13:04:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 -- 172.21.15.142:0/3691759072 shutdown_connections 2023-09-21T13:04:02.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75d0e50 0x55c0b75d12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75cc0a0 0x55c0b75cc480 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3691759072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 -- 172.21.15.142:0/3691759072 >> 172.21.15.142:0/3691759072 conn(0x55c0b74f8fa0 msgr2=0x55c0b75c70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 -- 172.21.15.142:0/3691759072 shutdown_connections 2023-09-21T13:04:02.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 -- 172.21.15.142:0/3691759072 wait complete. 2023-09-21T13:04:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.635+0000 7f57a3babb80 1 -- start start 2023-09-21T13:04:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 Processor -- start 2023-09-21T13:04:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b751de20 con 0x55c0b75cc9c0 2023-09-21T13:04:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b74ba6e0 con 0x55c0b75d0e50 2023-09-21T13:04:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b74ba380 con 0x55c0b75cc0a0 2023-09-21T13:04:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.636+0000 7f57a3babb80 10 client.0 _ll_register_callbacks cb 0x55c0b7404a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:02.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578d79a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:53368/0 (socket says 172.21.15.142:53368) 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 -- 172.21.15.142:0/3240431824 learned_addr learned my addr 172.21.15.142:0/3240431824 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578df9b700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 -- 172.21.15.142:0/3240431824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc0a0 msgr2=0x55c0b75d86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 -- 172.21.15.142:0/3240431824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc9c0 msgr2=0x55c0b75d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 -- 172.21.15.142:0/3240431824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5788110710 con 0x55c0b75d0e50 2023-09-21T13:04:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f578e79c700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5780095190 tx=0x7f5780098850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9970b80108c1e7d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f57717fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57800092e0 con 0x55c0b75d0e50 2023-09-21T13:04:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0b748eb50 con 0x55c0b75d0e50 2023-09-21T13:04:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.637+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f57800192c0 con 0x55c0b75d0e50 2023-09-21T13:04:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5780099390 con 0x55c0b75d0e50 2023-09-21T13:04:02.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 10 client.27416 fetch_fsmap learned FSMap version 34 2023-09-21T13:04:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f5784017070 con 0x55c0b75d0e50 2023-09-21T13:04:02.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c0b748eb50 con 0x55c0b75d0e50 2023-09-21T13:04:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f57800a0870 con 0x55c0b75d0e50 2023-09-21T13:04:02.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 10 client.27416 fetch_fsmap finished waiting for FSMap version 34 2023-09-21T13:04:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 10 client.27416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 20 client.27416 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b75e6020 0x55c0b75e8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 4 client.27416 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:02.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0b759afc0 con 0x55c0b75e6020 2023-09-21T13:04:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.638+0000 7f578df9b700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b75e6020 0x55c0b75e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.639+0000 7f578df9b700 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b75e6020 0x55c0b75e8440 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a2d5b0cc6c6071 server_cookie=546e71c1ec248548 in_seq=0 out_seq=0 2023-09-21T13:04:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.639+0000 7f57717fa700 10 client.27416 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.639+0000 7f57717fa700 1 -- 172.21.15.142:0/3240431824 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0b759afc0 con 0x55c0b75e6020 2023-09-21T13:04:02.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.639+0000 7f57717fa700 10 client.27416 handle_command_reply: tid=0 2023-09-21T13:04:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 client.27416 shutdown 2023-09-21T13:04:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 msgr2=0x55c0b75d6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5780095190 tx=0x7f5780098850 comp rx=0 tx=0).stop 2023-09-21T13:04:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 shutdown_connections 2023-09-21T13:04:02.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b75e6020 0x55c0b75e8440 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d6070 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 --2- 172.21.15.142:0/3240431824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 >> 172.21.15.142:0/3240431824 conn(0x55c0b74f8fa0 msgr2=0x55c0b75c6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57717fa700 0 client.27416 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 shutdown_connections 2023-09-21T13:04:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.640+0000 7f57a3babb80 1 -- 172.21.15.142:0/3240431824 wait complete. 2023-09-21T13:04:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.641+0000 7f57a3babb80 20 client.27416 trim_cache size 0 max 16384 2023-09-21T13:04:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.663+0000 7f57a3babb80 1 Processor -- start 2023-09-21T13:04:02.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.663+0000 7f57a3babb80 1 -- start start 2023-09-21T13:04:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.663+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.663+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75c5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f57a3babb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b739e8c0 con 0x55c0b75cc0a0 2023-09-21T13:04:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f57a3babb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b75c7d00 con 0x55c0b75d0e50 2023-09-21T13:04:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f57a3babb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b75d8e40 con 0x55c0b75cc9c0 2023-09-21T13:04:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45218/0 (socket says 172.21.15.142:45218) 2023-09-21T13:04:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 -- 172.21.15.142:0/2866620198 learned_addr learned my addr 172.21.15.142:0/2866620198 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578e79c700 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 -- 172.21.15.142:0/2866620198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 msgr2=0x55c0b75c5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75c5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 -- 172.21.15.142:0/2866620198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 msgr2=0x55c0b75ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.664+0000 7f578d79a700 1 -- 172.21.15.142:0/2866620198 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0b7331c00 con 0x55c0b75cc9c0 2023-09-21T13:04:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.665+0000 7f578d79a700 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5778015000 tx=0x7f577800b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8755dbfe0ea2a7e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.665+0000 7f577cff9700 1 -- 172.21.15.142:0/2866620198 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577801d030 con 0x55c0b75cc9c0 2023-09-21T13:04:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.665+0000 7f577cff9700 1 -- 172.21.15.142:0/2866620198 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f577801e040 con 0x55c0b75cc9c0 2023-09-21T13:04:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.665+0000 7f577cff9700 1 -- 172.21.15.142:0/2866620198 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778004950 con 0x55c0b75cc9c0 2023-09-21T13:04:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- 172.21.15.142:0/2866620198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 msgr2=0x55c0b75dd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5778015000 tx=0x7f577800b260 comp rx=0 tx=0).stop 2023-09-21T13:04:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- 172.21.15.142:0/2866620198 shutdown_connections 2023-09-21T13:04:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75c5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 --2- 172.21.15.142:0/2866620198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75dd030 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- 172.21.15.142:0/2866620198 >> 172.21.15.142:0/2866620198 conn(0x55c0b74f8fa0 msgr2=0x55c0b75c2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- 172.21.15.142:0/2866620198 shutdown_connections 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- 172.21.15.142:0/2866620198 wait complete. 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.666+0000 7f57a3babb80 1 -- start start 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 Processor -- start 2023-09-21T13:04:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b75d8560 con 0x55c0b75cc0a0 2023-09-21T13:04:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b75d86d0 con 0x55c0b75d0e50 2023-09-21T13:04:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0b75d8890 con 0x55c0b75cc9c0 2023-09-21T13:04:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.667+0000 7f57a3babb80 10 client.0 _ll_register_callbacks cb 0x55c0b7404a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:53390/0 (socket says 172.21.15.142:53390) 2023-09-21T13:04:02.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578e79c700 1 -- 172.21.15.142:0/67307921 learned_addr learned my addr 172.21.15.142:0/67307921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 -- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 msgr2=0x55c0b75d7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 -- 172.21.15.142:0/67307921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 msgr2=0x55c0b75d71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:02.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.668+0000 7f578d79a700 1 -- 172.21.15.142:0/67307921 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577800b850 con 0x55c0b75cc9c0 2023-09-21T13:04:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f578d79a700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d7710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55c0b75c1770 tx=0x7f5778005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a05c64d7a265dd7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57717fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577801d070 con 0x55c0b75cc9c0 2023-09-21T13:04:02.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f5778004910 con 0x55c0b75cc9c0 2023-09-21T13:04:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5784021070 con 0x55c0b75cc9c0 2023-09-21T13:04:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5778005650 con 0x55c0b75cc9c0 2023-09-21T13:04:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57a3babb80 10 client.27382 fetch_fsmap learned FSMap version 34 2023-09-21T13:04:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c0b736f1f0 con 0x55c0b75cc9c0 2023-09-21T13:04:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.669+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5778042080 con 0x55c0b75cc9c0 2023-09-21T13:04:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 34) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f577800fae0 con 0x55c0b75cc9c0 2023-09-21T13:04:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 10 client.27382 fetch_fsmap finished waiting for FSMap version 34 2023-09-21T13:04:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 10 client.27382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 20 client.27382 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b763ad00 0x55c0b763d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 4 client.27382 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:04:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c0b7516e00 con 0x55c0b763ad00 2023-09-21T13:04:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.670+0000 7f578df9b700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b763ad00 0x55c0b763d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.671+0000 7f578df9b700 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b763ad00 0x55c0b763d120 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8edf4e25118be3ca server_cookie=d8f61c5aa7aa3258 in_seq=0 out_seq=0 2023-09-21T13:04:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.671+0000 7f57717fa700 10 client.27382 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:02.697 INFO:tasks.workunit.client.0.smithi142.stdout: 1 709689 8.75 MB/sec execute 283 sec latency 61.369 ms 2023-09-21T13:04:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57717fa700 1 -- 172.21.15.142:0/67307921 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c0b7516e00 con 0x55c0b763ad00 2023-09-21T13:04:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57717fa700 10 client.27382 handle_command_reply: tid=0 2023-09-21T13:04:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 client.27382 shutdown 2023-09-21T13:04:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 msgr2=0x55c0b75d7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d7710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55c0b75c1770 tx=0x7f5778005270 comp rx=0 tx=0).stop 2023-09-21T13:04:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 shutdown_connections 2023-09-21T13:04:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c0b763ad00 0x55c0b763d120 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c0b75cc0a0 0x55c0b75d71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c0b75d0e50 0x55c0b75d7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 --2- 172.21.15.142:0/67307921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c0b75cc9c0 0x55c0b75d7710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57717fa700 0 client.27382 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 >> 172.21.15.142:0/67307921 conn(0x55c0b74f8fa0 msgr2=0x55c0b75c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 shutdown_connections 2023-09-21T13:04:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.712+0000 7f57a3babb80 1 -- 172.21.15.142:0/67307921 wait complete. 2023-09-21T13:04:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.713+0000 7f57a3babb80 20 client.27382 trim_cache size 0 max 16384 2023-09-21T13:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:04:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.713+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 msgr2=0x7f57740a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.713+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 0x7f57740a2cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5784009c60 tx=0x7f5784009260 comp rx=0 tx=0).stop 2023-09-21T13:04:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.713+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 msgr2=0x7f578819dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.713+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f578000c370 tx=0x7f578000c680 comp rx=0 tx=0).stop 2023-09-21T13:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 shutdown_connections 2023-09-21T13:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f57740a0830 0x7f57740a2cf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f57880731d0 0x7f5788199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f578810d620 0x7f578819dcd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 --2- 172.21.15.142:0/4262273722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5788073af0 0x7f5788199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 >> 172.21.15.142:0/4262273722 conn(0x7f57880fc8b0 msgr2=0x7f578810f760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 shutdown_connections 2023-09-21T13:04:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:02.714+0000 7f57901ff700 1 -- 172.21.15.142:0/4262273722 wait complete. 2023-09-21T13:04:02.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:02 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:02.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:02 smithi156 ceph-mon[134078]: osdmap e91: 12 total, 12 up, 12 in 2023-09-21T13:04:02.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:02 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:02.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:02 smithi142 ceph-mon[97663]: osdmap e91: 12 total, 12 up, 12 in 2023-09-21T13:04:02.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:02 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:02.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:02 smithi160 ceph-mon[134450]: osdmap e91: 12 total, 12 up, 12 in 2023-09-21T13:04:03.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 711050 8.74 MB/sec execute 284 sec latency 29.377 ms 2023-09-21T13:04:03.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:03 smithi156 ceph-mon[134078]: pgmap v241: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:03.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:03 smithi142 ceph-mon[97663]: pgmap v241: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:03.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:03 smithi160 ceph-mon[134450]: pgmap v241: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:04.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 713410 8.76 MB/sec execute 285 sec latency 19.235 ms 2023-09-21T13:04:05.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 714837 8.75 MB/sec execute 286 sec latency 11.588 ms 2023-09-21T13:04:05.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:05 smithi156 ceph-mon[134078]: pgmap v242: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:05.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:05 smithi142 ceph-mon[97663]: pgmap v242: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:05.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:05 smithi160 ceph-mon[134450]: pgmap v242: 97 pgs: 97 active+clean; 231 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.7 MiB/s wr, 241 op/s 2023-09-21T13:04:06.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 717137 8.77 MB/sec execute 287 sec latency 15.749 ms 2023-09-21T13:04:07.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 718497 8.76 MB/sec execute 288 sec latency 12.294 ms 2023-09-21T13:04:07.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:07 smithi156 ceph-mon[134078]: pgmap v243: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:07.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:07 smithi142 ceph-mon[97663]: pgmap v243: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:07.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:07 smithi160 ceph-mon[134450]: pgmap v243: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:08.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 720523 8.77 MB/sec execute 289 sec latency 40.266 ms 2023-09-21T13:04:09.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 721992 8.77 MB/sec execute 290 sec latency 12.875 ms 2023-09-21T13:04:09.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:09 smithi156 ceph-mon[134078]: pgmap v244: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:09.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:09 smithi142 ceph-mon[97663]: pgmap v244: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:09.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:09 smithi160 ceph-mon[134450]: pgmap v244: 97 pgs: 97 active+clean; 199 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 7.0 MiB/s wr, 402 op/s 2023-09-21T13:04:10.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 724206 8.78 MB/sec execute 291 sec latency 16.269 ms 2023-09-21T13:04:11.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 725560 8.77 MB/sec execute 292 sec latency 11.247 ms 2023-09-21T13:04:11.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:11 smithi156 ceph-mon[134078]: pgmap v245: 97 pgs: 97 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.1 MiB/s wr, 364 op/s 2023-09-21T13:04:11.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:11 smithi156 ceph-mon[134078]: osdmap e92: 12 total, 12 up, 12 in 2023-09-21T13:04:11.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:11 smithi142 ceph-mon[97663]: pgmap v245: 97 pgs: 97 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.1 MiB/s wr, 364 op/s 2023-09-21T13:04:11.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:11 smithi142 ceph-mon[97663]: osdmap e92: 12 total, 12 up, 12 in 2023-09-21T13:04:11.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:11 smithi160 ceph-mon[134450]: pgmap v245: 97 pgs: 97 active+clean; 204 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.1 MiB/s wr, 364 op/s 2023-09-21T13:04:11.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:11 smithi160 ceph-mon[134450]: osdmap e92: 12 total, 12 up, 12 in 2023-09-21T13:04:12.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 727753 8.78 MB/sec execute 293 sec latency 17.139 ms 2023-09-21T13:04:13.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 728884 8.77 MB/sec execute 294 sec latency 29.117 ms 2023-09-21T13:04:13.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:13 smithi156 ceph-mon[134078]: pgmap v247: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:13.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:13 smithi142 ceph-mon[97663]: pgmap v247: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:13.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:13 smithi160 ceph-mon[134450]: pgmap v247: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:14.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 731120 8.78 MB/sec execute 295 sec latency 19.017 ms 2023-09-21T13:04:15.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 732379 8.78 MB/sec execute 296 sec latency 11.950 ms 2023-09-21T13:04:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 -- 172.21.15.142:0/3418491018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab4100fd0 msgr2=0x7f0ab41013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/3418491018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab4100fd0 0x7f0ab41013b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009990 tx=0x7f0ab0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 -- 172.21.15.142:0/3418491018 shutdown_connections 2023-09-21T13:04:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/3418491018 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab4100fd0 0x7f0ab41013b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/3418491018 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab41060f0 0x7f0ab410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/3418491018 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab4101980 0x7f0ab41059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.892 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 -- 172.21.15.142:0/3418491018 >> 172.21.15.142:0/3418491018 conn(0x7f0ab40fc830 msgr2=0x7f0ab40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.892+0000 7f0abc1ff700 1 -- 172.21.15.142:0/3418491018 shutdown_connections 2023-09-21T13:04:15.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.893+0000 7f0abc1ff700 1 -- 172.21.15.142:0/3418491018 wait complete. 2023-09-21T13:04:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.894+0000 7f0abc1ff700 1 Processor -- start 2023-09-21T13:04:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.894+0000 7f0abc1ff700 1 -- start start 2023-09-21T13:04:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab41060f0 0x7f0ab4073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab41a3090 0x7f0ab41a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41a59c0 con 0x7f0ab41060f0 2023-09-21T13:04:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41a5b00 con 0x7f0ab41a3090 2023-09-21T13:04:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0abc1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab41a5c70 con 0x7f0ab4100fd0 2023-09-21T13:04:15.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0ab9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0ab9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33414/0 (socket says 172.21.15.142:33414) 2023-09-21T13:04:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0ab9f9b700 1 -- 172.21.15.142:0/2215933732 learned_addr learned my addr 172.21.15.142:0/2215933732 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0ab979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab41060f0 0x7f0ab4073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.895+0000 7f0aba79c700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab41a3090 0x7f0ab41a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.897 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 -- 172.21.15.142:0/2215933732 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab41a3090 msgr2=0x7f0ab41a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab41a3090 0x7f0ab41a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 -- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab41060f0 msgr2=0x7f0ab4073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab41060f0 0x7f0ab4073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.898 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 -- 172.21.15.142:0/2215933732 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00095f0 con 0x7f0ab4100fd0 2023-09-21T13:04:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0ab9f9b700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0005910 tx=0x7f0ab0005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0aaaffd700 1 -- 172.21.15.142:0/2215933732 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab001d070 con 0x7f0ab4100fd0 2023-09-21T13:04:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0aaaffd700 1 -- 172.21.15.142:0/2215933732 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ab0022470 con 0x7f0ab4100fd0 2023-09-21T13:04:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab41a5ef0 con 0x7f0ab4100fd0 2023-09-21T13:04:15.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.896+0000 7f0aaaffd700 1 -- 172.21.15.142:0/2215933732 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0017650 con 0x7f0ab4100fd0 2023-09-21T13:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.897+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab41a6310 con 0x7f0ab4100fd0 2023-09-21T13:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.902+0000 7f0aaaffd700 1 -- 172.21.15.142:0/2215933732 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f0ab00225e0 con 0x7f0ab4100fd0 2023-09-21T13:04:15.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.902+0000 7f0acfad4b80 1 Processor -- start 2023-09-21T13:04:15.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 -- start start 2023-09-21T13:04:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654dc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560065443c40 con 0x5600654dc660 2023-09-21T13:04:15.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560065427c10 con 0x5600654d78b0 2023-09-21T13:04:15.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.903+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560065425530 con 0x5600654d81d0 2023-09-21T13:04:15.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0ab9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654dc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48138/0 (socket says 172.21.15.142:48138) 2023-09-21T13:04:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 -- 172.21.15.142:0/4209747743 learned_addr learned my addr 172.21.15.142:0/4209747743 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:15.904 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0ab979a700 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:15 smithi156 ceph-mon[134078]: pgmap v248: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:15.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 -- 172.21.15.142:0/4209747743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 msgr2=0x5600654dc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654dc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 -- 172.21.15.142:0/4209747743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 msgr2=0x5600654dcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654dcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 -- 172.21.15.142:0/4209747743 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56006524bd80 con 0x5600654d78b0 2023-09-21T13:04:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aaaffd700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 0x7f0aa00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.904+0000 7f0aba79c700 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0aac011680 tx=0x7f0aac009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dd380c69a09d13e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.905+0000 7f0aaaffd700 1 -- 172.21.15.142:0/2215933732 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0ab00cd350 con 0x7f0ab4100fd0 2023-09-21T13:04:15.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.905+0000 7f0ab9f9b700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 0x7f0aa00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.905+0000 7f0a9ffff700 1 -- 172.21.15.142:0/4209747743 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00e040 con 0x5600654d78b0 2023-09-21T13:04:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.905+0000 7f0a9ffff700 1 -- 172.21.15.142:0/4209747743 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac00f040 con 0x5600654d78b0 2023-09-21T13:04:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.905+0000 7f0a9ffff700 1 -- 172.21.15.142:0/4209747743 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0048c0 con 0x5600654d78b0 2023-09-21T13:04:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4209747743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 msgr2=0x5600654d7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0aac011680 tx=0x7f0aac009920 comp rx=0 tx=0).stop 2023-09-21T13:04:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0ab9f9b700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 0x7f0aa00a2cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00cab50 tx=0x7f0ab0022f90 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4209747743 shutdown_connections 2023-09-21T13:04:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654dcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654d7c90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4209747743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654dc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4209747743 >> 172.21.15.142:0/4209747743 conn(0x5600653fbfa0 msgr2=0x5600654ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4209747743 shutdown_connections 2023-09-21T13:04:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.906+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4209747743 wait complete. 2023-09-21T13:04:15.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.907+0000 7f0acfad4b80 1 -- start start 2023-09-21T13:04:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.907+0000 7f0acfad4b80 1 Processor -- start 2023-09-21T13:04:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654e1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560065420e20 con 0x5600654dc660 2023-09-21T13:04:15.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600653bd6e0 con 0x5600654d78b0 2023-09-21T13:04:15.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600653bd380 con 0x5600654d81d0 2023-09-21T13:04:15.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0acfad4b80 10 client.0 _ll_register_callbacks cb 0x560065307a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:15.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0ab979a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0ab979a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33430/0 (socket says 172.21.15.142:33430) 2023-09-21T13:04:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0ab979a700 1 -- 172.21.15.142:0/3478158545 learned_addr learned my addr 172.21.15.142:0/3478158545 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654e1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 -- 172.21.15.142:0/3478158545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 msgr2=0x5600654e10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 -- 172.21.15.142:0/3478158545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 msgr2=0x5600654e1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654e1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0aba79c700 1 -- 172.21.15.142:0/3478158545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aac011330 con 0x5600654d78b0 2023-09-21T13:04:15.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.908+0000 7f0ab979a700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:15.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0aba79c700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654e3eb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0aac011680 tx=0x7f0aac004380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4418a27e4a7d1c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0a9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:15.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00e040 con 0x5600654d78b0 2023-09-21T13:04:15.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560065391b50 con 0x5600654d78b0 2023-09-21T13:04:15.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0aac003c10 con 0x5600654d78b0 2023-09-21T13:04:15.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aac004920 con 0x5600654d78b0 2023-09-21T13:04:15.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0acfad4b80 10 client.27434 fetch_fsmap learned FSMap version 34 2023-09-21T13:04:15.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560065234c00 con 0x5600654d78b0 2023-09-21T13:04:15.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.909+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac030020 con 0x5600654d78b0 2023-09-21T13:04:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0aac007a50 con 0x5600654d78b0 2023-09-21T13:04:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 10 client.27434 fetch_fsmap finished waiting for FSMap version 34 2023-09-21T13:04:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 10 client.27434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 20 client.27434 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:15.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5600654f17f0 0x5600654f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 4 client.27434 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56006549dfc0 con 0x5600654f17f0 2023-09-21T13:04:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0ab979a700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5600654f17f0 0x5600654f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0ab979a700 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5600654f17f0 0x5600654f3c10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a517dd95ef4c85e5 server_cookie=703e777ce9353c83 in_seq=0 out_seq=0 2023-09-21T13:04:15.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.910+0000 7f0a9d7fa700 10 client.27434 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.912+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/3478158545 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56006549dfc0 con 0x5600654f17f0 2023-09-21T13:04:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.912+0000 7f0a9d7fa700 10 client.27434 handle_command_reply: tid=0 2023-09-21T13:04:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.912+0000 7f0acfad4b80 1 client.27434 shutdown 2023-09-21T13:04:15.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.912+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 msgr2=0x5600654e3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.912+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654e3eb0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0aac011680 tx=0x7f0aac004380 comp rx=0 tx=0).stop 2023-09-21T13:04:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 shutdown_connections 2023-09-21T13:04:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5600654f17f0 0x5600654f3c10 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654dc660 0x5600654e1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654d78b0 0x5600654e3eb0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0a9d7fa700 0 client.27434 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/3478158545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 >> 172.21.15.142:0/3478158545 conn(0x5600653fbfa0 msgr2=0x5600654c9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:15.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 shutdown_connections 2023-09-21T13:04:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 1 -- 172.21.15.142:0/3478158545 wait complete. 2023-09-21T13:04:15.927 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.913+0000 7f0acfad4b80 20 client.27434 trim_cache size 0 max 16384 2023-09-21T13:04:15.927 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:15 smithi142 ceph-mon[97663]: pgmap v248: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.930+0000 7f0acfad4b80 1 Processor -- start 2023-09-21T13:04:15.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.930+0000 7f0acfad4b80 1 -- start start 2023-09-21T13:04:15.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 0x5600654e0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600654e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600652a18c0 con 0x5600654d78b0 2023-09-21T13:04:15.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600654df190 con 0x5600654dc660 2023-09-21T13:04:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600654d8720 con 0x5600654d81d0 2023-09-21T13:04:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 0x5600654e0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 0x5600654e0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50528/0 (socket says 172.21.15.142:50528) 2023-09-21T13:04:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0aba79c700 1 -- 172.21.15.142:0/4188554806 learned_addr learned my addr 172.21.15.142:0/4188554806 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:15.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0aba79c700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600654e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 -- 172.21.15.142:0/4188554806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 msgr2=0x5600654e3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600654e3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 -- 172.21.15.142:0/4188554806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 msgr2=0x5600654e0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 0x5600654e0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.931+0000 7f0ab979a700 1 -- 172.21.15.142:0/4188554806 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600652721f0 con 0x5600654d81d0 2023-09-21T13:04:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.932+0000 7f0aba79c700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600654e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:04:15.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.932+0000 7f0ab979a700 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e39e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5600654f1bd0 tx=0x7f0aa4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1c541315380eaa server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.932+0000 7f0aa8ff9700 1 -- 172.21.15.142:0/4188554806 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4016030 con 0x5600654d81d0 2023-09-21T13:04:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.932+0000 7f0aa8ff9700 1 -- 172.21.15.142:0/4188554806 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aa4017040 con 0x5600654d81d0 2023-09-21T13:04:15.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.932+0000 7f0aa8ff9700 1 -- 172.21.15.142:0/4188554806 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4004a90 con 0x5600654d81d0 2023-09-21T13:04:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4188554806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 msgr2=0x5600654e39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:15.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e39e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x5600654f1bd0 tx=0x7f0aa4009260 comp rx=0 tx=0).stop 2023-09-21T13:04:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4188554806 shutdown_connections 2023-09-21T13:04:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d78b0 0x5600654e0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600654e3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/4188554806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d81d0 0x5600654e39e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4188554806 >> 172.21.15.142:0/4188554806 conn(0x5600653fbfa0 msgr2=0x5600654dea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4188554806 shutdown_connections 2023-09-21T13:04:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.933+0000 7f0acfad4b80 1 -- 172.21.15.142:0/4188554806 wait complete. 2023-09-21T13:04:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.934+0000 7f0acfad4b80 1 -- start start 2023-09-21T13:04:15.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.934+0000 7f0acfad4b80 1 Processor -- start 2023-09-21T13:04:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d78b0 0x5600654e6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d81d0 0x5600654e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600654e7530 con 0x5600654d81d0 2023-09-21T13:04:15.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600654e76a0 con 0x5600654dc660 2023-09-21T13:04:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560065544b20 con 0x5600654d78b0 2023-09-21T13:04:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0acfad4b80 10 client.0 _ll_register_callbacks cb 0x560065307a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0ab979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d81d0 0x5600654e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0aba79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48170/0 (socket says 172.21.15.142:48170) 2023-09-21T13:04:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0aba79c700 1 -- 172.21.15.142:0/923305526 learned_addr learned my addr 172.21.15.142:0/923305526 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.935+0000 7f0aba79c700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d78b0 0x5600654e6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 -- 172.21.15.142:0/923305526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d78b0 msgr2=0x5600654e6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d78b0 0x5600654e6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 -- 172.21.15.142:0/923305526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d81d0 msgr2=0x5600654e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d81d0 0x5600654e6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 -- 172.21.15.142:0/923305526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa4004040 con 0x5600654dc660 2023-09-21T13:04:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0aba79c700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0aac004350 tx=0x7f0aac000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5054986e0275b2cb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0a9d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:15.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac00e040 con 0x5600654dc660 2023-09-21T13:04:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0aac00f040 con 0x5600654dc660 2023-09-21T13:04:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.936+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0aac031080 con 0x5600654dc660 2023-09-21T13:04:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0aac0048b0 con 0x5600654dc660 2023-09-21T13:04:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 10 client.27440 fetch_fsmap learned FSMap version 34 2023-09-21T13:04:15.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56006524a250 con 0x5600654dc660 2023-09-21T13:04:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0aac00f040 con 0x5600654dc660 2023-09-21T13:04:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 34) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0aac011990 con 0x5600654dc660 2023-09-21T13:04:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 10 client.27440 fetch_fsmap finished waiting for FSMap version 34 2023-09-21T13:04:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 10 client.27440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:15.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 20 client.27440 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560065546020 0x560065548440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 4 client.27440 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:04:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560065419e00 con 0x560065546020 2023-09-21T13:04:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.937+0000 7f0ab979a700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560065546020 0x560065548440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:15.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.938+0000 7f0ab979a700 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560065546020 0x560065548440 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1451869d9773d885 server_cookie=e0591b8972dcc8dc in_seq=0 out_seq=0 2023-09-21T13:04:15.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:15.938+0000 7f0a9d7fa700 10 client.27440 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:15.948 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:15 smithi160 ceph-mon[134450]: pgmap v248: 97 pgs: 97 active+clean; 208 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 362 op/s 2023-09-21T13:04:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.005+0000 7f0a9d7fa700 1 -- 172.21.15.142:0/923305526 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560065419e00 con 0x560065546020 2023-09-21T13:04:16.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.005+0000 7f0a9d7fa700 10 client.27440 handle_command_reply: tid=0 2023-09-21T13:04:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.005+0000 7f0acfad4b80 1 client.27440 shutdown 2023-09-21T13:04:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.005+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 msgr2=0x5600655445e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:16.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.005+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0aac004350 tx=0x7f0aac000f40 comp rx=0 tx=0).stop 2023-09-21T13:04:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 shutdown_connections 2023-09-21T13:04:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560065546020 0x560065548440 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5600654dc660 0x5600655445e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5600654d78b0 0x5600654e6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 --2- 172.21.15.142:0/923305526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5600654d81d0 0x5600654e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 >> 172.21.15.142:0/923305526 conn(0x5600653fbfa0 msgr2=0x5600654da750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0a9d7fa700 0 client.27440 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:16.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 shutdown_connections 2023-09-21T13:04:16.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.006+0000 7f0acfad4b80 1 -- 172.21.15.142:0/923305526 wait complete. 2023-09-21T13:04:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.011+0000 7f0acfad4b80 20 client.27440 trim_cache size 0 max 16384 2023-09-21T13:04:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:04:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:04:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:04:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:04:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 msgr2=0x7f0aa00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 0x7f0aa00a2cf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00cab50 tx=0x7f0ab0022f90 comp rx=0 tx=0).stop 2023-09-21T13:04:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 msgr2=0x7f0ab40732c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0005910 tx=0x7f0ab0005740 comp rx=0 tx=0).stop 2023-09-21T13:04:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 shutdown_connections 2023-09-21T13:04:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0aa00a0830 0x7f0aa00a2cf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ab41a3090 0x7f0ab41a5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ab4100fd0 0x7f0ab40732c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 --2- 172.21.15.142:0/2215933732 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ab41060f0 0x7f0ab4073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 >> 172.21.15.142:0/2215933732 conn(0x7f0ab40fc830 msgr2=0x7f0ab40fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 shutdown_connections 2023-09-21T13:04:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:16.012+0000 7f0abc1ff700 1 -- 172.21.15.142:0/2215933732 wait complete. 2023-09-21T13:04:16.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 734409 8.79 MB/sec execute 297 sec latency 67.451 ms 2023-09-21T13:04:16.835 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:04:17.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 -- 172.21.15.142:0/4250053705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 msgr2=0x7fa5ec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/4250053705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec101200 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009990 tx=0x7fa5dc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 -- 172.21.15.142:0/4250053705 shutdown_connections 2023-09-21T13:04:17.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/4250053705 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/4250053705 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec101200 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/4250053705 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec1017d0 0x7fa5ec105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 -- 172.21.15.142:0/4250053705 >> 172.21.15.142:0/4250053705 conn(0x7fa5ec0fc680 msgr2=0x7fa5ec0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 -- 172.21.15.142:0/4250053705 shutdown_connections 2023-09-21T13:04:17.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.090+0000 7fa5eb59e700 1 -- 172.21.15.142:0/4250053705 wait complete. 2023-09-21T13:04:17.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.091+0000 7fa5eb59e700 1 Processor -- start 2023-09-21T13:04:17.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.091+0000 7fa5eb59e700 1 -- start start 2023-09-21T13:04:17.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec19ea90 0x7fa5ec19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec19f4e0 con 0x7fa5ec19ea90 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec19f650 con 0x7fa5ec100e20 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5eb59e700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec19f810 con 0x7fa5ec105f40 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5ea59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48190/0 (socket says 172.21.15.142:48190) 2023-09-21T13:04:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33482/0 (socket says 172.21.15.142:33482) 2023-09-21T13:04:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5ea59c700 1 -- 172.21.15.142:0/2245099316 learned_addr learned my addr 172.21.15.142:0/2245099316 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec19ea90 0x7fa5ec19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2245099316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 msgr2=0x7fa5ec199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec19ea90 msgr2=0x7fa5ec19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec19ea90 0x7fa5ec19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2245099316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5dc0095f0 con 0x7fa5ec105f40 2023-09-21T13:04:17.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.092+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.093+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e9c0 tx=0x7fa5e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.093+0000 7fa5db7fe700 1 -- 172.21.15.142:0/2245099316 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e000c9c0 con 0x7fa5ec105f40 2023-09-21T13:04:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.093+0000 7fa5db7fe700 1 -- 172.21.15.142:0/2245099316 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e0010430 con 0x7fa5ec105f40 2023-09-21T13:04:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.093+0000 7fa5db7fe700 1 -- 172.21.15.142:0/2245099316 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0018680 con 0x7fa5ec105f40 2023-09-21T13:04:17.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.094+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec1a5af0 con 0x7fa5ec105f40 2023-09-21T13:04:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.094+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1a5fb0 con 0x7fa5ec105f40 2023-09-21T13:04:17.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.098+0000 7fa5db7fe700 1 -- 172.21.15.142:0/2245099316 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa5e000cb20 con 0x7fa5ec105f40 2023-09-21T13:04:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.100+0000 7fa604279b80 1 Processor -- start 2023-09-21T13:04:17.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.100+0000 7fa604279b80 1 -- start start 2023-09-21T13:04:17.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5db7fe700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 0x7fa5d40a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca427a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5db7fe700 1 -- 172.21.15.142:0/2245099316 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5e0014070 con 0x7fa5ec105f40 2023-09-21T13:04:17.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca3d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c9b0ca0 con 0x55968ca423c0 2023-09-21T13:04:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c994c70 con 0x55968ca3cbb0 2023-09-21T13:04:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa604279b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c992590 con 0x55968ca42ce0 2023-09-21T13:04:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 0x7fa5d40a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33486/0 (socket says 172.21.15.142:33486) 2023-09-21T13:04:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/19328709 learned_addr learned my addr 172.21.15.142:0/19328709 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca3d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.101+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/19328709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 msgr2=0x55968ca3d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca3d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/19328709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 msgr2=0x55968ca427a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca427a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/19328709 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55968c7b8de0 con 0x55968ca42ce0 2023-09-21T13:04:17.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0095fe0 tx=0x7fa5e00990b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee439ce478d80e16 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 0x7fa5d40a2d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009ec0 tx=0x7fa5e40134a0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5d8ff9700 1 -- 172.21.15.142:0/19328709 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0099570 con 0x55968ca42ce0 2023-09-21T13:04:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5d8ff9700 1 -- 172.21.15.142:0/19328709 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e00ace90 con 0x55968ca42ce0 2023-09-21T13:04:17.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.102+0000 7fa5d8ff9700 1 -- 172.21.15.142:0/19328709 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00979a0 con 0x55968ca42ce0 2023-09-21T13:04:17.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 -- 172.21.15.142:0/19328709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 msgr2=0x55968ca3c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0095fe0 tx=0x7fa5e00990b0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 -- 172.21.15.142:0/19328709 shutdown_connections 2023-09-21T13:04:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca427a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca3d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 --2- 172.21.15.142:0/19328709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca3c670 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 -- 172.21.15.142:0/19328709 >> 172.21.15.142:0/19328709 conn(0x55968c969000 msgr2=0x55968ca37650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 -- 172.21.15.142:0/19328709 shutdown_connections 2023-09-21T13:04:17.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.103+0000 7fa604279b80 1 -- 172.21.15.142:0/19328709 wait complete. 2023-09-21T13:04:17.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.104+0000 7fa604279b80 1 -- start start 2023-09-21T13:04:17.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.104+0000 7fa604279b80 1 Processor -- start 2023-09-21T13:04:17.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.104+0000 7fa604279b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca3cbb0 0x55968ca48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca45f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c98de80 con 0x55968ca423c0 2023-09-21T13:04:17.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c92a740 con 0x55968ca42ce0 2023-09-21T13:04:17.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c92a3e0 con 0x55968ca3cbb0 2023-09-21T13:04:17.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa604279b80 10 client.0 _ll_register_callbacks cb 0x55968c874a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:17.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48220/0 (socket says 172.21.15.142:48220) 2023-09-21T13:04:17.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 -- 172.21.15.142:0/4038017434 learned_addr learned my addr 172.21.15.142:0/4038017434 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:17.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca3cbb0 0x55968ca48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 -- 172.21.15.142:0/4038017434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca3cbb0 msgr2=0x55968ca48ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca3cbb0 0x55968ca48ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 -- 172.21.15.142:0/4038017434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 msgr2=0x55968ca45f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca45f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca45f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5ead9d700 1 -- 172.21.15.142:0/4038017434 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1a5fb0 con 0x55968ca42ce0 2023-09-21T13:04:17.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.105+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca45f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:04:17.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4006130 tx=0x7fa5e4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5255a3cd9fbc193 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:17.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400e040 con 0x55968ca42ce0 2023-09-21T13:04:17.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55968c8febb0 con 0x55968ca42ce0 2023-09-21T13:04:17.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5e4004bb0 con 0x55968ca42ce0 2023-09-21T13:04:17.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e401aee0 con 0x55968ca42ce0 2023-09-21T13:04:17.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa604279b80 10 client.27452 fetch_fsmap learned FSMap version 35 2023-09-21T13:04:17.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55968c7a1c60 con 0x55968ca42ce0 2023-09-21T13:04:17.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55968c8febb0 con 0x55968ca42ce0 2023-09-21T13:04:17.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.106+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa5e402e070 con 0x55968ca42ce0 2023-09-21T13:04:17.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 10 client.27452 fetch_fsmap finished waiting for FSMap version 35 2023-09-21T13:04:17.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 10 client.27452 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:17.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 20 client.27452 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:17.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968ca565f0 0x55968ca58a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 4 client.27452 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:17.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55968ca0b020 con 0x55968ca565f0 2023-09-21T13:04:17.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.107+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968ca565f0 0x55968ca58a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa5d1ffb700 10 client.27452 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:17.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968ca565f0 0x55968ca58a10 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a06697a3dd43317b server_cookie=d66e5cc975655b30 in_seq=0 out_seq=0 2023-09-21T13:04:17.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/4038017434 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55968ca0b020 con 0x55968ca565f0 2023-09-21T13:04:17.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa5d1ffb700 10 client.27452 handle_command_reply: tid=0 2023-09-21T13:04:17.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa604279b80 1 client.27452 shutdown 2023-09-21T13:04:17.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 msgr2=0x55968ca46680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.108+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4006130 tx=0x7fa5e4004b40 comp rx=0 tx=0).stop 2023-09-21T13:04:17.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 shutdown_connections 2023-09-21T13:04:17.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968ca565f0 0x55968ca58a10 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca42ce0 0x55968ca46680 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca3cbb0 0x55968ca48ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa5d1ffb700 0 client.27452 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:17.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 --2- 172.21.15.142:0/4038017434 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca45f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 >> 172.21.15.142:0/4038017434 conn(0x55968c969000 msgr2=0x55968ca37360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 shutdown_connections 2023-09-21T13:04:17.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 1 -- 172.21.15.142:0/4038017434 wait complete. 2023-09-21T13:04:17.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.109+0000 7fa604279b80 20 client.27452 trim_cache size 0 max 16384 2023-09-21T13:04:17.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.129+0000 7fa604279b80 1 Processor -- start 2023-09-21T13:04:17.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.129+0000 7fa604279b80 1 -- start start 2023-09-21T13:04:17.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca3cbb0 0x55968ca3c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca48840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c80e920 con 0x55968ca3cbb0 2023-09-21T13:04:17.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968c8febb0 con 0x55968ca423c0 2023-09-21T13:04:17.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa604279b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968ca391a0 con 0x55968ca42ce0 2023-09-21T13:04:17.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:48236/0 (socket says 172.21.15.142:48236) 2023-09-21T13:04:17.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5ea59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca3cbb0 0x55968ca3c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2056202851 learned_addr learned my addr 172.21.15.142:0/2056202851 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:17.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca48840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2056202851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 msgr2=0x55968ca48840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca48840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2056202851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca3cbb0 msgr2=0x55968ca3c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca3cbb0 0x55968ca3c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.130+0000 7fa5e9d9b700 1 -- 172.21.15.142:0/2056202851 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55968ca33800 con 0x55968ca423c0 2023-09-21T13:04:17.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.131+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0095a20 tx=0x7fa5e0010b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3219678cfb55cc72 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.131+0000 7fa5d97fa700 1 -- 172.21.15.142:0/2056202851 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0099570 con 0x55968ca423c0 2023-09-21T13:04:17.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.131+0000 7fa5d97fa700 1 -- 172.21.15.142:0/2056202851 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e00a15e0 con 0x55968ca423c0 2023-09-21T13:04:17.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.131+0000 7fa5d97fa700 1 -- 172.21.15.142:0/2056202851 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e0010860 con 0x55968ca423c0 2023-09-21T13:04:17.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- 172.21.15.142:0/2056202851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 msgr2=0x55968ca4d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa5e0095a20 tx=0x7fa5e0010b90 comp rx=0 tx=0).stop 2023-09-21T13:04:17.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- 172.21.15.142:0/2056202851 shutdown_connections 2023-09-21T13:04:17.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca3cbb0 0x55968ca3c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca48840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 --2- 172.21.15.142:0/2056202851 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca423c0 0x55968ca4d680 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- 172.21.15.142:0/2056202851 >> 172.21.15.142:0/2056202851 conn(0x55968c969000 msgr2=0x55968ca40250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- 172.21.15.142:0/2056202851 shutdown_connections 2023-09-21T13:04:17.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- 172.21.15.142:0/2056202851 wait complete. 2023-09-21T13:04:17.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.132+0000 7fa604279b80 1 -- start start 2023-09-21T13:04:17.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 Processor -- start 2023-09-21T13:04:17.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca4d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca4b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968ca4c190 con 0x55968ca423c0 2023-09-21T13:04:17.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968ca4c300 con 0x55968ca3cbb0 2023-09-21T13:04:17.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55968ca4c4c0 con 0x55968ca42ce0 2023-09-21T13:04:17.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.133+0000 7fa604279b80 10 client.0 _ll_register_callbacks cb 0x7fa5e4009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33510/0 (socket says 172.21.15.142:33510) 2023-09-21T13:04:17.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 -- 172.21.15.142:0/417833688 learned_addr learned my addr 172.21.15.142:0/417833688 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca4b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca4d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 -- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 msgr2=0x55968ca4d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca4d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 -- 172.21.15.142:0/417833688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 msgr2=0x55968ca4b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:17.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca4b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5ead9d700 1 -- 172.21.15.142:0/417833688 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55968c7b8de0 con 0x55968ca42ce0 2023-09-21T13:04:17.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.134+0000 7fa5e9d9b700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca4b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:17.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa5ead9d700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4014010 tx=0x7fa5e401af40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=820aead6ad55f670 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:17.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa5d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:17.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4004bb0 con 0x55968ca42ce0 2023-09-21T13:04:17.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa5e4004d10 con 0x55968ca42ce0 2023-09-21T13:04:17.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5e00ace90 con 0x55968ca42ce0 2023-09-21T13:04:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.135+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e4003a00 con 0x55968ca42ce0 2023-09-21T13:04:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 10 client.27418 fetch_fsmap learned FSMap version 35 2023-09-21T13:04:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55968ca3d650 con 0x55968ca42ce0 2023-09-21T13:04:17.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5e00ace90 con 0x55968ca42ce0 2023-09-21T13:04:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 35) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa5e4036070 con 0x55968ca42ce0 2023-09-21T13:04:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 10 client.27418 fetch_fsmap finished waiting for FSMap version 35 2023-09-21T13:04:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 10 client.27418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 20 client.27418 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:17.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968caab790 0x55968caadbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:17.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 4 client.27418 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:04:17.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55968c986e60 con 0x55968caab790 2023-09-21T13:04:17.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.136+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968caab790 0x55968caadbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:17.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa5ea59c700 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968caab790 0x55968caadbb0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a59d340b53d592 server_cookie=9827295205794f51 in_seq=0 out_seq=0 2023-09-21T13:04:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa5d1ffb700 10 client.27418 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa5d1ffb700 1 -- 172.21.15.142:0/417833688 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55968c986e60 con 0x55968caab790 2023-09-21T13:04:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa5d1ffb700 10 client.27418 handle_command_reply: tid=0 2023-09-21T13:04:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 client.27418 shutdown 2023-09-21T13:04:17.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 msgr2=0x55968ca4bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4014010 tx=0x7fa5e401af40 comp rx=0 tx=0).stop 2023-09-21T13:04:17.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 shutdown_connections 2023-09-21T13:04:17.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55968caab790 0x55968caadbb0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55968ca42ce0 0x55968ca4bc50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55968ca3cbb0 0x55968ca4d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa5d1ffb700 0 client.27418 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:17.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 --2- 172.21.15.142:0/417833688 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55968ca423c0 0x55968ca4b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 >> 172.21.15.142:0/417833688 conn(0x55968c969000 msgr2=0x55968ca41170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.163 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.137+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 shutdown_connections 2023-09-21T13:04:17.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa604279b80 1 -- 172.21.15.142:0/417833688 wait complete. 2023-09-21T13:04:17.164 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa604279b80 20 client.27418 trim_cache size 0 max 16384 2023-09-21T13:04:17.165 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:04:17.165 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:04:17.165 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:04:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:04:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:04:17.166 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:04:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:04:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:04:17.167 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:04:17.168 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:04:17.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 msgr2=0x7fa5d40a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 0x7fa5d40a2d10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa5e4009ec0 tx=0x7fa5e40134a0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 msgr2=0x7fa5ec19a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:17.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.138+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fa5e000e9c0 tx=0x7fa5e000ecd0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 shutdown_connections 2023-09-21T13:04:17.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa5d40a0850 0x7fa5d40a2d10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa5ec19ea90 0x7fa5ec19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa5ec100e20 0x7fa5ec199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 --2- 172.21.15.142:0/2245099316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5ec105f40 0x7fa5ec19a160 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:17.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 >> 172.21.15.142:0/2245099316 conn(0x7fa5ec0fc680 msgr2=0x7fa5ec0fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:17.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 shutdown_connections 2023-09-21T13:04:17.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:17.139+0000 7fa5eb59e700 1 -- 172.21.15.142:0/2245099316 wait complete. 2023-09-21T13:04:17.173 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:04:17.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 735639 8.78 MB/sec execute 298 sec latency 14.913 ms 2023-09-21T13:04:17.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:17 smithi156 ceph-mon[134078]: pgmap v249: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:17.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:17 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:17.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:17 smithi142 ceph-mon[97663]: pgmap v249: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:17.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:17 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:17.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:17 smithi160 ceph-mon[134450]: pgmap v249: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:17.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:17 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:18.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 737804 8.79 MB/sec execute 299 sec latency 17.480 ms 2023-09-21T13:04:19.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 739039 8.79 MB/sec execute 300 sec latency 36.214 ms 2023-09-21T13:04:19.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:19 smithi156 ceph-mon[134078]: pgmap v250: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:19.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:19 smithi142 ceph-mon[97663]: pgmap v250: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:19.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:19 smithi160 ceph-mon[134450]: pgmap v250: 97 pgs: 97 active+clean; 216 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 196 op/s 2023-09-21T13:04:20.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 741064 8.78 MB/sec execute 301 sec latency 33.806 ms 2023-09-21T13:04:21.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 742608 8.79 MB/sec execute 302 sec latency 17.015 ms 2023-09-21T13:04:21.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:21 smithi156 ceph-mon[134078]: pgmap v251: 97 pgs: 97 active+clean; 210 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 194 op/s 2023-09-21T13:04:21.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:21 smithi142 ceph-mon[97663]: pgmap v251: 97 pgs: 97 active+clean; 210 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 194 op/s 2023-09-21T13:04:21.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:21 smithi160 ceph-mon[134450]: pgmap v251: 97 pgs: 97 active+clean; 210 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 194 op/s 2023-09-21T13:04:22.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 744712 8.79 MB/sec execute 303 sec latency 17.747 ms 2023-09-21T13:04:23.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 746234 8.80 MB/sec execute 304 sec latency 13.855 ms 2023-09-21T13:04:23.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:23 smithi156 ceph-mon[134078]: pgmap v252: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-09-21T13:04:23.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:23 smithi142 ceph-mon[97663]: pgmap v252: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-09-21T13:04:23.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:23 smithi160 ceph-mon[134450]: pgmap v252: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 219 op/s 2023-09-21T13:04:24.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 748273 8.79 MB/sec execute 305 sec latency 23.154 ms 2023-09-21T13:04:25.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 749654 8.80 MB/sec execute 306 sec latency 36.455 ms 2023-09-21T13:04:25.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:25 smithi156 ceph-mon[134078]: pgmap v253: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2023-09-21T13:04:25.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:25 smithi142 ceph-mon[97663]: pgmap v253: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2023-09-21T13:04:25.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:25 smithi160 ceph-mon[134450]: pgmap v253: 97 pgs: 97 active+clean; 212 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 200 op/s 2023-09-21T13:04:26.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 751648 8.80 MB/sec execute 307 sec latency 18.255 ms 2023-09-21T13:04:27.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 753190 8.81 MB/sec execute 308 sec latency 13.701 ms 2023-09-21T13:04:27.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:27 smithi156 ceph-mon[134078]: pgmap v254: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2023-09-21T13:04:27.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:27 smithi142 ceph-mon[97663]: pgmap v254: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2023-09-21T13:04:27.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:27 smithi160 ceph-mon[134450]: pgmap v254: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 284 op/s 2023-09-21T13:04:28.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 755070 8.80 MB/sec execute 309 sec latency 19.906 ms 2023-09-21T13:04:29.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 -- 172.21.15.142:0/1743398909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c101970 msgr2=0x7fe51c1059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 --2- 172.21.15.142:0/1743398909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c101970 0x7fe51c1059b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe50c009990 tx=0x7fe50c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 -- 172.21.15.142:0/1743398909 shutdown_connections 2023-09-21T13:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 --2- 172.21.15.142:0/1743398909 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c1060e0 0x7fe51c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 --2- 172.21.15.142:0/1743398909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c100fc0 0x7fe51c1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 --2- 172.21.15.142:0/1743398909 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c101970 0x7fe51c1059b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 -- 172.21.15.142:0/1743398909 >> 172.21.15.142:0/1743398909 conn(0x7fe51c0fc840 msgr2=0x7fe51c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 -- 172.21.15.142:0/1743398909 shutdown_connections 2023-09-21T13:04:29.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.200+0000 7fe5237ff700 1 -- 172.21.15.142:0/1743398909 wait complete. 2023-09-21T13:04:29.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.201+0000 7fe5237ff700 1 Processor -- start 2023-09-21T13:04:29.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 -- start start 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c19bb40 0x7fe51c19bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c19c5c0 con 0x7fe51c100fc0 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c19c730 con 0x7fe51c1060e0 2023-09-21T13:04:29.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe5237ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c19c8f0 con 0x7fe51c19bb40 2023-09-21T13:04:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe52159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe520d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe52159b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57484/0 (socket says 172.21.15.142:57484) 2023-09-21T13:04:29.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe520d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58158/0 (socket says 172.21.15.142:58158) 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe52159b700 1 -- 172.21.15.142:0/177378824 learned_addr learned my addr 172.21.15.142:0/177378824 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.202+0000 7fe521d9c700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c19bb40 0x7fe51c19bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 -- 172.21.15.142:0/177378824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c19bb40 msgr2=0x7fe51c19bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c19bb40 0x7fe51c19bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 -- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 msgr2=0x7fe51c196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 -- 172.21.15.142:0/177378824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0095f0 con 0x7fe51c1060e0 2023-09-21T13:04:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe52159b700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe520d9a700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0059d0 tx=0x7fe50c004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe5127fc700 1 -- 172.21.15.142:0/177378824 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c01d070 con 0x7fe51c1060e0 2023-09-21T13:04:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe5127fc700 1 -- 172.21.15.142:0/177378824 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe50c022470 con 0x7fe51c1060e0 2023-09-21T13:04:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c073010 con 0x7fe51c1060e0 2023-09-21T13:04:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.203+0000 7fe5127fc700 1 -- 172.21.15.142:0/177378824 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c017650 con 0x7fe51c1060e0 2023-09-21T13:04:29.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.204+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c073540 con 0x7fe51c1060e0 2023-09-21T13:04:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.207+0000 7fe5127fc700 1 -- 172.21.15.142:0/177378824 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe50c0225e0 con 0x7fe51c1060e0 2023-09-21T13:04:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.209+0000 7fe5127fc700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 0x7fe5080a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.209+0000 7fe5127fc700 1 -- 172.21.15.142:0/177378824 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe50c0cd100 con 0x7fe51c1060e0 2023-09-21T13:04:29.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.209+0000 7fe53721fb80 1 Processor -- start 2023-09-21T13:04:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.209+0000 7fe52159b700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 0x7fe5080a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.209+0000 7fe53721fb80 1 -- start start 2023-09-21T13:04:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dce910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dcf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73d3ec40 con 0x55fe73dca9c0 2023-09-21T13:04:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73d22c10 con 0x55fe73dca0a0 2023-09-21T13:04:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe53721fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73d20530 con 0x55fe73dcee50 2023-09-21T13:04:29.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe52159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe520d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dce910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe521d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dcf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe52159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58164/0 (socket says 172.21.15.142:58164) 2023-09-21T13:04:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe52159b700 1 -- 172.21.15.142:0/2152863021 learned_addr learned my addr 172.21.15.142:0/2152863021 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:29.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.210+0000 7fe52159b700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 0x7fe5080a2cf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe518011550 tx=0x7fe518009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 -- 172.21.15.142:0/2152863021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 msgr2=0x55fe73dcf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dcf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 -- 172.21.15.142:0/2152863021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 msgr2=0x55fe73dce910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dce910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 -- 172.21.15.142:0/2152863021 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe73b46d80 con 0x55fe73dca0a0 2023-09-21T13:04:29.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe521d9c700 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dcf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe520d9a700 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe52159b700 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe51800e6b0 tx=0x7fe518014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc35c3d16ac2a3e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe5077fe700 1 -- 172.21.15.142:0/2152863021 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518026630 con 0x55fe73dca0a0 2023-09-21T13:04:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe5077fe700 1 -- 172.21.15.142:0/2152863021 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe518021070 con 0x55fe73dca0a0 2023-09-21T13:04:29.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.211+0000 7fe5077fe700 1 -- 172.21.15.142:0/2152863021 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5180256a0 con 0x55fe73dca0a0 2023-09-21T13:04:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 -- 172.21.15.142:0/2152863021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 msgr2=0x55fe73dca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe51800e6b0 tx=0x7fe518014000 comp rx=0 tx=0).stop 2023-09-21T13:04:29.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 -- 172.21.15.142:0/2152863021 shutdown_connections 2023-09-21T13:04:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dcf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dca480 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 --2- 172.21.15.142:0/2152863021 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dce910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 -- 172.21.15.142:0/2152863021 >> 172.21.15.142:0/2152863021 conn(0x55fe73cf6fa0 msgr2=0x55fe73dc50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 -- 172.21.15.142:0/2152863021 shutdown_connections 2023-09-21T13:04:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.212+0000 7fe53721fb80 1 -- 172.21.15.142:0/2152863021 wait complete. 2023-09-21T13:04:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.213+0000 7fe53721fb80 1 -- start start 2023-09-21T13:04:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.213+0000 7fe53721fb80 1 Processor -- start 2023-09-21T13:04:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dca0a0 0x55fe73dd6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dd37e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73d1be20 con 0x55fe73dca9c0 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73cb86e0 con 0x55fe73dcee50 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73cb8380 con 0x55fe73dca0a0 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe53721fb80 10 client.0 _ll_register_callbacks cb 0x55fe73c02a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:29.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe52159b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dca0a0 0x55fe73dd6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58170/0 (socket says 172.21.15.142:58170) 2023-09-21T13:04:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 -- 172.21.15.142:0/243238907 learned_addr learned my addr 172.21.15.142:0/243238907 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe520d9a700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dd37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 -- 172.21.15.142:0/243238907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dca0a0 msgr2=0x55fe73dd6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dca0a0 0x55fe73dd6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 -- 172.21.15.142:0/243238907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 msgr2=0x55fe73dd37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dd37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.214+0000 7fe521d9c700 1 -- 172.21.15.142:0/243238907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c073540 con 0x55fe73dcee50 2023-09-21T13:04:29.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe521d9c700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe514007d10 tx=0x7fe5140116a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8668954fdea52ce4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51400e040 con 0x55fe73dcee50 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe73c8cb50 con 0x55fe73dcee50 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe51401f460 con 0x55fe73dcee50 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe51401f620 con 0x55fe73dcee50 2023-09-21T13:04:29.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe53721fb80 10 client.27470 fetch_fsmap learned FSMap version 35 2023-09-21T13:04:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x7fe514011230 con 0x55fe73dcee50 2023-09-21T13:04:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.215+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fe73c8cb50 con 0x55fe73dcee50 2023-09-21T13:04:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe514016990 con 0x55fe73dcee50 2023-09-21T13:04:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 10 client.27470 fetch_fsmap finished waiting for FSMap version 35 2023-09-21T13:04:29.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 10 client.27470 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 20 client.27470 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73de3f40 0x55fe73de6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 4 client.27470 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe73d98fc0 con 0x55fe73de3f40 2023-09-21T13:04:29.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe52159b700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73de3f40 0x55fe73de6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe52159b700 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73de3f40 0x55fe73de6360 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5095a64fdf886ac server_cookie=580dafeb74fbbd7e in_seq=0 out_seq=0 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.216+0000 7fe504ff9700 10 client.27470 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.217+0000 7fe504ff9700 1 -- 172.21.15.142:0/243238907 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fe73d98fc0 con 0x55fe73de3f40 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.217+0000 7fe504ff9700 10 client.27470 handle_command_reply: tid=0 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.217+0000 7fe53721fb80 1 client.27470 shutdown 2023-09-21T13:04:29.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 msgr2=0x55fe73dd3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe514007d10 tx=0x7fe5140116a0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 shutdown_connections 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73de3f40 0x55fe73de6360 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dcee50 0x55fe73dd3e10 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dca0a0 0x55fe73dd6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe504ff9700 0 client.27470 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 --2- 172.21.15.142:0/243238907 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73dd37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 >> 172.21.15.142:0/243238907 conn(0x55fe73cf6fa0 msgr2=0x55fe73dc4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 shutdown_connections 2023-09-21T13:04:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 1 -- 172.21.15.142:0/243238907 wait complete. 2023-09-21T13:04:29.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.218+0000 7fe53721fb80 20 client.27470 trim_cache size 0 max 16384 2023-09-21T13:04:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.236+0000 7fe53721fb80 1 Processor -- start 2023-09-21T13:04:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.236+0000 7fe53721fb80 1 -- start start 2023-09-21T13:04:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73ddb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dd37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73b9c8c0 con 0x55fe73dca9c0 2023-09-21T13:04:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73dd6df0 con 0x55fe73dca0a0 2023-09-21T13:04:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe53721fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73dca810 con 0x55fe73dcee50 2023-09-21T13:04:29.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe52159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe520d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73ddb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe52159b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58172/0 (socket says 172.21.15.142:58172) 2023-09-21T13:04:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe52159b700 1 -- 172.21.15.142:0/4114742127 learned_addr learned my addr 172.21.15.142:0/4114742127 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:29.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe521d9c700 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dd37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe52159b700 1 -- 172.21.15.142:0/4114742127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 msgr2=0x55fe73dd37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.237+0000 7fe52159b700 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dd37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe52159b700 1 -- 172.21.15.142:0/4114742127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 msgr2=0x55fe73ddb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe52159b700 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73ddb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe52159b700 1 -- 172.21.15.142:0/4114742127 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518017070 con 0x55fe73dca0a0 2023-09-21T13:04:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe52159b700 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe518009fd0 tx=0x7fe51801dd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e96bfd843bf595b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe507fff700 1 -- 172.21.15.142:0/4114742127 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800ee50 con 0x55fe73dca0a0 2023-09-21T13:04:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe507fff700 1 -- 172.21.15.142:0/4114742127 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5180331b0 con 0x55fe73dca0a0 2023-09-21T13:04:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.238+0000 7fe507fff700 1 -- 172.21.15.142:0/4114742127 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518005640 con 0x55fe73dca0a0 2023-09-21T13:04:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 -- 172.21.15.142:0/4114742127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 msgr2=0x55fe73dd1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe518009fd0 tx=0x7fe51801dd80 comp rx=0 tx=0).stop 2023-09-21T13:04:29.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 -- 172.21.15.142:0/4114742127 shutdown_connections 2023-09-21T13:04:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dd37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca0a0 0x55fe73dd1250 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 --2- 172.21.15.142:0/4114742127 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca9c0 0x55fe73ddb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 -- 172.21.15.142:0/4114742127 >> 172.21.15.142:0/4114742127 conn(0x55fe73cf6fa0 msgr2=0x55fe73dccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 -- 172.21.15.142:0/4114742127 shutdown_connections 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.239+0000 7fe53721fb80 1 -- 172.21.15.142:0/4114742127 wait complete. 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.240+0000 7fe53721fb80 1 -- start start 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.240+0000 7fe53721fb80 1 Processor -- start 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.240+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca0a0 0x55fe73dd71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.240+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 0x55fe73dd7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.240+0000 7fe53721fb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dda6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe53721fb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73ddac00 con 0x55fe73dca0a0 2023-09-21T13:04:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe53721fb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73ddad70 con 0x55fe73dca9c0 2023-09-21T13:04:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe53721fb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe73ddaf30 con 0x55fe73dcee50 2023-09-21T13:04:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe53721fb80 10 client.0 _ll_register_callbacks cb 0x55fe73c02a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:29.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe521d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dda6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 0x55fe73dd7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe521d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dda6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:59512/0 (socket says 172.21.15.142:59512) 2023-09-21T13:04:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe521d9c700 1 -- 172.21.15.142:0/140140730 learned_addr learned my addr 172.21.15.142:0/140140730 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 -- 172.21.15.142:0/140140730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 msgr2=0x55fe73dda6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dda6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 -- 172.21.15.142:0/140140730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca0a0 msgr2=0x55fe73dd71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca0a0 0x55fe73dd71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 -- 172.21.15.142:0/140140730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51802a040 con 0x55fe73dca9c0 2023-09-21T13:04:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe520d9a700 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 0x55fe73dd7730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0ca7f0 tx=0x7fe50c09a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adc1d5b86a67f041 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:29.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.241+0000 7fe504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe50c09aa40 con 0x55fe73dca9c0 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe50c09a5e0 con 0x55fe73dca9c0 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe518021070 con 0x55fe73dca9c0 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe50c09e410 con 0x55fe73dca9c0 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 10 client.27476 fetch_fsmap learned FSMap version 35 2023-09-21T13:04:29.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) v3 -- 0x55fe73b2fc00 con 0x55fe73dca9c0 2023-09-21T13:04:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe518021070 con 0x55fe73dca9c0 2023-09-21T13:04:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 35) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe50c0a21c0 con 0x55fe73dca9c0 2023-09-21T13:04:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 10 client.27476 fetch_fsmap finished waiting for FSMap version 35 2023-09-21T13:04:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 10 client.27476 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:29.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 20 client.27476 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73e38be0 0x55fe73e3b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 4 client.27476 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:04:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.242+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fe73d14e00 con 0x55fe73e38be0 2023-09-21T13:04:29.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.243+0000 7fe52159b700 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73e38be0 0x55fe73e3b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.243+0000 7fe504ff9700 10 client.27476 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:29.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.243+0000 7fe52159b700 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73e38be0 0x55fe73e3b000 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88cbd4a3d8e4f78 server_cookie=eb1cd0b6352539e9 in_seq=0 out_seq=0 2023-09-21T13:04:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.310+0000 7fe504ff9700 1 -- 172.21.15.142:0/140140730 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fe73d14e00 con 0x55fe73e38be0 2023-09-21T13:04:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.310+0000 7fe504ff9700 10 client.27476 handle_command_reply: tid=0 2023-09-21T13:04:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.310+0000 7fe53721fb80 1 client.27476 shutdown 2023-09-21T13:04:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.311+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 msgr2=0x55fe73dd7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.311+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 0x55fe73dd7730 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0ca7f0 tx=0x7fe50c09a4c0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 shutdown_connections 2023-09-21T13:04:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fe73e38be0 0x55fe73e3b000 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fe73dca0a0 0x55fe73dd71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fe73dcee50 0x55fe73dda6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 --2- 172.21.15.142:0/140140730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fe73dca9c0 0x55fe73dd7730 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 >> 172.21.15.142:0/140140730 conn(0x55fe73cf6fa0 msgr2=0x55fe73dcf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe504ff9700 0 client.27476 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:29.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.312+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 shutdown_connections 2023-09-21T13:04:29.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.313+0000 7fe53721fb80 1 -- 172.21.15.142:0/140140730 wait complete. 2023-09-21T13:04:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.319+0000 7fe53721fb80 20 client.27476 trim_cache size 0 max 16384 2023-09-21T13:04:29.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:04:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:04:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:04:29.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:04:29.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.321+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 msgr2=0x7fe5080a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.321+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 0x7fe5080a2cf0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe518011550 tx=0x7fe518009260 comp rx=0 tx=0).stop 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.321+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 msgr2=0x7fe51c1974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.321+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe50c0059d0 tx=0x7fe50c004710 comp rx=0 tx=0).stop 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 shutdown_connections 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe5080a0830 0x7fe5080a2cf0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe518011550 tx=0x7fe518009260 comp rx=0 tx=0).stop 2023-09-21T13:04:29.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe51c100fc0 0x7fe51c196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe51c19bb40 0x7fe51c19bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 --2- 172.21.15.142:0/177378824 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe51c1060e0 0x7fe51c1974d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:29.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.322+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 >> 172.21.15.142:0/177378824 conn(0x7fe51c0fc840 msgr2=0x7fe51c104990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.324+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 shutdown_connections 2023-09-21T13:04:29.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:29.324+0000 7fe5237ff700 1 -- 172.21.15.142:0/177378824 wait complete. 2023-09-21T13:04:29.698 INFO:tasks.workunit.client.0.smithi142.stdout: 1 756641 8.81 MB/sec execute 310 sec latency 58.273 ms 2023-09-21T13:04:29.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:29 smithi156 ceph-mon[134078]: pgmap v255: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2023-09-21T13:04:29.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:29 smithi142 ceph-mon[97663]: pgmap v255: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2023-09-21T13:04:29.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:29 smithi160 ceph-mon[134450]: pgmap v255: 97 pgs: 97 active+clean; 220 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 201 op/s 2023-09-21T13:04:30.436 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:04:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:04:30.436 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:04:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:04:30.437 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:04:29 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/2068622029 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ba83bff1e0 con 0x55ba83bd4800 2023-09-21T13:04:30.437 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:04:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:04:30.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 757836 8.80 MB/sec execute 311 sec latency 159.156 ms 2023-09-21T13:04:30.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:30 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:04:30.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:30 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:04:30.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:30 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:04:31.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 759218 8.79 MB/sec execute 312 sec latency 403.558 ms 2023-09-21T13:04:31.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: pgmap v256: 97 pgs: 97 active+clean; 223 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-21T13:04:31.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: osdmap e93: 12 total, 12 up, 12 in 2023-09-21T13:04:31.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/952801523,v1:172.21.15.160:6839/952801523] up:boot 2023-09-21T13:04:31.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:04:31.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:04:31.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:31.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:31 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:04:32.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: pgmap v256: 97 pgs: 97 active+clean; 223 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-21T13:04:32.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: osdmap e93: 12 total, 12 up, 12 in 2023-09-21T13:04:32.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/952801523,v1:172.21.15.160:6839/952801523] up:boot 2023-09-21T13:04:32.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:04:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:04:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:32.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:31 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:04:32.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: pgmap v256: 97 pgs: 97 active+clean; 223 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-21T13:04:32.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: osdmap e93: 12 total, 12 up, 12 in 2023-09-21T13:04:32.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/952801523,v1:172.21.15.160:6839/952801523] up:boot 2023-09-21T13:04:32.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:04:32.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:04:32.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:04:32.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:31 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:04:32.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 760119 8.79 MB/sec execute 313 sec latency 239.940 ms 2023-09-21T13:04:32.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:32 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:04:32.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:32 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:04:32.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:32 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:04:33.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:32 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:04:33.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:32 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:04:33.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:32 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:04:33.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:32 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:04:33.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:32 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:04:33.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:32 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:04:33.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 761515 8.78 MB/sec execute 314 sec latency 16.146 ms 2023-09-21T13:04:33.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:33 smithi160 ceph-mon[134450]: pgmap v258: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:34.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:33 smithi156 ceph-mon[134078]: pgmap v258: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:34.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:33 smithi142 ceph-mon[97663]: pgmap v258: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:34.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 763672 8.79 MB/sec execute 315 sec latency 16.188 ms 2023-09-21T13:04:35.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 765101 8.78 MB/sec execute 316 sec latency 57.057 ms 2023-09-21T13:04:35.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:35 smithi160 ceph-mon[134450]: pgmap v259: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:36.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:35 smithi156 ceph-mon[134078]: pgmap v259: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:36.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:35 smithi142 ceph-mon[97663]: pgmap v259: 97 pgs: 97 active+clean; 216 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 237 op/s 2023-09-21T13:04:36.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 767202 8.80 MB/sec execute 317 sec latency 26.103 ms 2023-09-21T13:04:37.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 768643 8.79 MB/sec execute 318 sec latency 17.375 ms 2023-09-21T13:04:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:37 smithi160 ceph-mon[134450]: pgmap v260: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:38.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:37 smithi156 ceph-mon[134078]: pgmap v260: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:38.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:37 smithi142 ceph-mon[97663]: pgmap v260: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:38.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 770755 8.80 MB/sec execute 319 sec latency 20.460 ms 2023-09-21T13:04:39.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 772148 8.79 MB/sec execute 320 sec latency 18.126 ms 2023-09-21T13:04:39.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:39 smithi160 ceph-mon[134450]: pgmap v261: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:40.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:39 smithi156 ceph-mon[134078]: pgmap v261: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:40.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:39 smithi142 ceph-mon[97663]: pgmap v261: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 363 op/s 2023-09-21T13:04:40.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 774273 8.81 MB/sec execute 321 sec latency 15.050 ms 2023-09-21T13:04:41.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 775501 8.80 MB/sec execute 322 sec latency 30.490 ms 2023-09-21T13:04:42.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:41 smithi156 ceph-mon[134078]: pgmap v262: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2023-09-21T13:04:42.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:41 smithi142 ceph-mon[97663]: pgmap v262: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2023-09-21T13:04:42.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:41 smithi160 ceph-mon[134450]: pgmap v262: 97 pgs: 97 active+clean; 220 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.9 MiB/s wr, 332 op/s 2023-09-21T13:04:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.509+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1862045312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf010b350 msgr2=0x7fbdf010d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.509+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1862045312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf010b350 0x7fbdf010d810 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b0a0 tx=0x7fbde800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1862045312 shutdown_connections 2023-09-21T13:04:42.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1862045312 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf0101f30 0x7fbdf0102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1862045312 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf010b350 0x7fbdf010d810 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1862045312 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf010ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1862045312 >> 172.21.15.142:0/1862045312 conn(0x7fbdf00fb750 msgr2=0x7fbdf00fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1862045312 shutdown_connections 2023-09-21T13:04:42.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.510+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1862045312 wait complete. 2023-09-21T13:04:42.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.511+0000 7fbdf87ff700 1 Processor -- start 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.511+0000 7fbdf87ff700 1 -- start start 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf0101f30 0x7fbdf019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf010b350 0x7fbdf0199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf019a3c0 con 0x7fbdf010b350 2023-09-21T13:04:42.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf019a530 con 0x7fbdf0101f30 2023-09-21T13:04:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf87ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf019a6f0 con 0x7fbdf0102850 2023-09-21T13:04:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf5d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf5d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60636/0 (socket says 172.21.15.142:60636) 2023-09-21T13:04:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/1758815208 learned_addr learned my addr 172.21.15.142:0/1758815208 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:42.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf010b350 0x7fbdf0199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf659b700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf0101f30 0x7fbdf019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.512+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/1758815208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf0101f30 msgr2=0x7fbdf019e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf0101f30 0x7fbdf019e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf010b350 msgr2=0x7fbdf0199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf010b350 0x7fbdf0199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/1758815208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde8009d00 con 0x7fbdf0102850 2023-09-21T13:04:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9f0 tx=0x7fbde000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbde77fe700 1 -- 172.21.15.142:0/1758815208 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000c9c0 con 0x7fbdf0102850 2023-09-21T13:04:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbde77fe700 1 -- 172.21.15.142:0/1758815208 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde0010430 con 0x7fbdf0102850 2023-09-21T13:04:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbde77fe700 1 -- 172.21.15.142:0/1758815208 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0018680 con 0x7fbdf0102850 2023-09-21T13:04:42.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf019a9d0 con 0x7fbdf0102850 2023-09-21T13:04:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.513+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01a6190 con 0x7fbdf0102850 2023-09-21T13:04:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.517+0000 7fbde77fe700 1 -- 172.21.15.142:0/1758815208 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fbde0010860 con 0x7fbdf0102850 2023-09-21T13:04:42.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.519+0000 7fbe0c1b2b80 1 Processor -- start 2023-09-21T13:04:42.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.519+0000 7fbde77fe700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 0x7fbddc0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.519+0000 7fbe0c1b2b80 1 -- start start 2023-09-21T13:04:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.519+0000 7fbde77fe700 1 -- 172.21.15.142:0/1758815208 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbde0014070 con 0x7fbdf0102850 2023-09-21T13:04:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.519+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 0x7fbddc0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d6244ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d624503910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d6245042b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d624473c40 con 0x55d6244ff0a0 2023-09-21T13:04:42.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d624457c10 con 0x55d624503e50 2023-09-21T13:04:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d624455530 con 0x55d6244ff9c0 2023-09-21T13:04:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf6d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d6245042b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf5d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d624503910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf6d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d6245042b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46860/0 (socket says 172.21.15.142:46860) 2023-09-21T13:04:42.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf6d9c700 1 -- 172.21.15.142:0/3692595168 learned_addr learned my addr 172.21.15.142:0/3692595168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:42.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf659b700 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d6244ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/3692595168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 msgr2=0x55d6245042b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d6245042b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/3692595168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 msgr2=0x55d6244ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.520+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d6244ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/3692595168 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d62427bd80 con 0x55d6244ff9c0 2023-09-21T13:04:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d624503910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbde00c9a70 tx=0x7fbde0099130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=889c4f5779cd9e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 0x7fbddc0a2c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b0a0 tx=0x7fbde80094b0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbde4ff9700 1 -- 172.21.15.142:0/3692595168 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde009d600 con 0x55d6244ff9c0 2023-09-21T13:04:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbde4ff9700 1 -- 172.21.15.142:0/3692595168 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde00af070 con 0x55d6244ff9c0 2023-09-21T13:04:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.521+0000 7fbde4ff9700 1 -- 172.21.15.142:0/3692595168 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0098cc0 con 0x55d6244ff9c0 2023-09-21T13:04:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3692595168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 msgr2=0x55d624503910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d624503910 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fbde00c9a70 tx=0x7fbde0099130 comp rx=0 tx=0).stop 2023-09-21T13:04:42.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3692595168 shutdown_connections 2023-09-21T13:04:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d6244ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d6245042b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3692595168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d624503910 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3692595168 >> 172.21.15.142:0/3692595168 conn(0x55d62442bfa0 msgr2=0x55d6244fa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3692595168 shutdown_connections 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.522+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3692595168 wait complete. 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.523+0000 7fbe0c1b2b80 1 -- start start 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.523+0000 7fbe0c1b2b80 1 Processor -- start 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6244ff0a0 0x55d624508910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d624508e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d624450e20 con 0x55d6244ff9c0 2023-09-21T13:04:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6243ed6e0 con 0x55d6244ff0a0 2023-09-21T13:04:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6243ed380 con 0x55d624503e50 2023-09-21T13:04:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbe0c1b2b80 10 client.0 _ll_register_callbacks cb 0x55d624337a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:42.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf5d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d624508e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60652/0 (socket says 172.21.15.142:60652) 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 -- 172.21.15.142:0/255187453 learned_addr learned my addr 172.21.15.142:0/255187453 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 -- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6244ff0a0 msgr2=0x55d624508910 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6244ff0a0 0x55d624508910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 -- 172.21.15.142:0/255187453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 msgr2=0x55d624508e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d624508e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.524+0000 7fbdf6d9c700 1 -- 172.21.15.142:0/255187453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01a6190 con 0x55d624503e50 2023-09-21T13:04:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.525+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbde8004c70 tx=0x7fbde800b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e34a8774d6f9255 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.525+0000 7fbdd9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.525+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8025070 con 0x55d624503e50 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.525+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6243c1b50 con 0x55d624503e50 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.525+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbde8031d20 con 0x55d624503e50 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde800e040 con 0x55d624503e50 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 10 client.27454 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d624264c00 con 0x55d624503e50 2023-09-21T13:04:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d6243c1b50 con 0x55d624503e50 2023-09-21T13:04:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fbde8019070 con 0x55d624503e50 2023-09-21T13:04:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 10 client.27454 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 10 client.27454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:42.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 20 client.27454 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d624519010 0x55d62451b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 4 client.27454 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.526+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6244cdfc0 con 0x55d624519010 2023-09-21T13:04:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.527+0000 7fbdf659b700 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d624519010 0x55d62451b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.527+0000 7fbdf659b700 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d624519010 0x55d62451b430 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e77d51260add8d1 server_cookie=df5a6626526ab039 in_seq=0 out_seq=0 2023-09-21T13:04:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.527+0000 7fbdd9ffb700 10 client.27454 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.528+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/255187453 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d6244cdfc0 con 0x55d624519010 2023-09-21T13:04:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.528+0000 7fbdd9ffb700 10 client.27454 handle_command_reply: tid=0 2023-09-21T13:04:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.528+0000 7fbe0c1b2b80 1 client.27454 shutdown 2023-09-21T13:04:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 msgr2=0x55d624509390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fbde8004c70 tx=0x7fbde800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 shutdown_connections 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d624519010 0x55d62451b430 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d624503e50 0x55d624509390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d6244ff0a0 0x55d624508910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/255187453 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d624508e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbdd9ffb700 0 client.27454 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 >> 172.21.15.142:0/255187453 conn(0x55d62442bfa0 msgr2=0x55d6244f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 shutdown_connections 2023-09-21T13:04:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/255187453 wait complete. 2023-09-21T13:04:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.529+0000 7fbe0c1b2b80 20 client.27454 trim_cache size 0 max 16384 2023-09-21T13:04:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.549+0000 7fbe0c1b2b80 1 Processor -- start 2023-09-21T13:04:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.549+0000 7fbe0c1b2b80 1 -- start start 2023-09-21T13:04:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d624501740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d62450ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d624502f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6242d18c0 con 0x55d6244ff0a0 2023-09-21T13:04:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6244f6920 con 0x55d624503e50 2023-09-21T13:04:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d624500160 con 0x55d6244ff9c0 2023-09-21T13:04:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d624501740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf659b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d624501740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48588/0 (socket says 172.21.15.142:48588) 2023-09-21T13:04:42.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf659b700 1 -- 172.21.15.142:0/2384915814 learned_addr learned my addr 172.21.15.142:0/2384915814 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d62450ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d624502f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/2384915814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 msgr2=0x55d624502f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d624502f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/2384915814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 msgr2=0x55d624501740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d624501740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf5d9a700 1 -- 172.21.15.142:0/2384915814 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6242a21f0 con 0x55d6244ff9c0 2023-09-21T13:04:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.550+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d624502f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.551+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d62450ffd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbde00cc2c0 tx=0x7fbde0084040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6867f62f6143a37 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.551+0000 7fbde57fa700 1 -- 172.21.15.142:0/2384915814 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde009d600 con 0x55d6244ff9c0 2023-09-21T13:04:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.551+0000 7fbde57fa700 1 -- 172.21.15.142:0/2384915814 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde00a1840 con 0x55d6244ff9c0 2023-09-21T13:04:42.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.551+0000 7fbde57fa700 1 -- 172.21.15.142:0/2384915814 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0099a30 con 0x55d6244ff9c0 2023-09-21T13:04:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/2384915814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 msgr2=0x55d62450ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d62450ffd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbde00cc2c0 tx=0x7fbde0084040 comp rx=0 tx=0).stop 2023-09-21T13:04:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/2384915814 shutdown_connections 2023-09-21T13:04:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff0a0 0x55d624501740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d624502f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/2384915814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff9c0 0x55d62450ffd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.552+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/2384915814 >> 172.21.15.142:0/2384915814 conn(0x55d62442bfa0 msgr2=0x55d624501fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.553+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/2384915814 shutdown_connections 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.553+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/2384915814 wait complete. 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.553+0000 7fbe0c1b2b80 1 -- start start 2023-09-21T13:04:42.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 Processor -- start 2023-09-21T13:04:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d6245101d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d62450e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62450e8d0 con 0x55d6244ff9c0 2023-09-21T13:04:42.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62450ea40 con 0x55d624503e50 2023-09-21T13:04:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62450ec00 con 0x55d6244ff0a0 2023-09-21T13:04:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbe0c1b2b80 10 client.0 _ll_register_callbacks cb 0x55d624337a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbdf659b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbdf659b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60678/0 (socket says 172.21.15.142:60678) 2023-09-21T13:04:42.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbdf5d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d6245101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbdf659b700 1 -- 172.21.15.142:0/3771545389 learned_addr learned my addr 172.21.15.142:0/3771545389 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.554+0000 7fbdf6d9c700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d62450e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 -- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 msgr2=0x55d62450e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d62450e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 -- 172.21.15.142:0/3771545389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 msgr2=0x55d6245101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:42.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d6245101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 -- 172.21.15.142:0/3771545389 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d624264c00 con 0x55d6244ff0a0 2023-09-21T13:04:42.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdf659b700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004440 tx=0x7fbdec01a5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82f92f635f49ad81 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:42.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdd9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:42.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.555+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec018040 con 0x55d6244ff0a0 2023-09-21T13:04:42.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbde00af070 con 0x55d6244ff0a0 2023-09-21T13:04:42.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fbdec0098d0 con 0x55d6244ff0a0 2023-09-21T13:04:42.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdec009a90 con 0x55d6244ff0a0 2023-09-21T13:04:42.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 10 client.27460 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:42.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x55d62427bd80 con 0x55d6244ff0a0 2023-09-21T13:04:42.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbde00af070 con 0x55d6244ff0a0 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fbdec012450 con 0x55d6244ff0a0 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 10 client.27460 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 10 client.27460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 20 client.27460 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d62456e210 0x55d624570630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:42.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 4 client.27460 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:04:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.556+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d624449e00 con 0x55d62456e210 2023-09-21T13:04:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.557+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d62456e210 0x55d624570630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.557+0000 7fbdf5d9a700 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d62456e210 0x55d624570630 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e7f4ad2b41763fe server_cookie=9e4341ab2a0e2bf5 in_seq=0 out_seq=0 2023-09-21T13:04:42.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.557+0000 7fbdd9ffb700 10 client.27460 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.620+0000 7fbdd9ffb700 1 -- 172.21.15.142:0/3771545389 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d624449e00 con 0x55d62456e210 2023-09-21T13:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.620+0000 7fbdd9ffb700 10 client.27460 handle_command_reply: tid=0 2023-09-21T13:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.620+0000 7fbe0c1b2b80 1 client.27460 shutdown 2023-09-21T13:04:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.620+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 msgr2=0x55d62450fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.620+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fbdec004440 tx=0x7fbdec01a5b0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 shutdown_connections 2023-09-21T13:04:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d62456e210 0x55d624570630 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d624503e50 0x55d62450e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d6244ff0a0 0x55d62450fc90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 --2- 172.21.15.142:0/3771545389 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d6244ff9c0 0x55d6245101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 >> 172.21.15.142:0/3771545389 conn(0x55d62442bfa0 msgr2=0x55d624502f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbdd9ffb700 0 client.27460 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 shutdown_connections 2023-09-21T13:04:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.621+0000 7fbe0c1b2b80 1 -- 172.21.15.142:0/3771545389 wait complete. 2023-09-21T13:04:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.622+0000 7fbe0c1b2b80 20 client.27460 trim_cache size 0 max 16384 2023-09-21T13:04:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:04:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:04:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:04:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:04:42.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 msgr2=0x7fbddc0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 0x7fbddc0a2c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbde800b0a0 tx=0x7fbde80094b0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 msgr2=0x7fbdf019e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fbde000e9f0 tx=0x7fbde000ed00 comp rx=0 tx=0).stop 2023-09-21T13:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 shutdown_connections 2023-09-21T13:04:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbddc0a07b0 0x7fbddc0a2c70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbdf010b350 0x7fbdf0199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbdf0101f30 0x7fbdf019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 --2- 172.21.15.142:0/1758815208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdf0102850 0x7fbdf019e5d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 >> 172.21.15.142:0/1758815208 conn(0x7fbdf00fb750 msgr2=0x7fbdf010b770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 shutdown_connections 2023-09-21T13:04:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:42.623+0000 7fbdf87ff700 1 -- 172.21.15.142:0/1758815208 wait complete. 2023-09-21T13:04:42.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 777397 8.80 MB/sec execute 323 sec latency 52.022 ms 2023-09-21T13:04:43.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 778659 8.79 MB/sec execute 324 sec latency 14.189 ms 2023-09-21T13:04:44.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:43 smithi156 ceph-mon[134078]: pgmap v263: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2023-09-21T13:04:44.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:43 smithi142 ceph-mon[97663]: pgmap v263: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2023-09-21T13:04:44.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:43 smithi160 ceph-mon[134450]: pgmap v263: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.4 MiB/s wr, 315 op/s 2023-09-21T13:04:44.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 780768 8.80 MB/sec execute 325 sec latency 23.870 ms 2023-09-21T13:04:45.699 INFO:tasks.workunit.client.0.smithi142.stdout: 1 782117 8.79 MB/sec execute 326 sec latency 12.430 ms 2023-09-21T13:04:46.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:45 smithi156 ceph-mon[134078]: pgmap v264: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 274 op/s 2023-09-21T13:04:46.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:45 smithi142 ceph-mon[97663]: pgmap v264: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 274 op/s 2023-09-21T13:04:46.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:45 smithi160 ceph-mon[134450]: pgmap v264: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.0 MiB/s wr, 274 op/s 2023-09-21T13:04:46.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 784325 8.80 MB/sec execute 327 sec latency 15.166 ms 2023-09-21T13:04:47.174 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:04:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 -- 172.21.15.142:0/397826831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd81060f0 msgr2=0x7fcfd810dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/397826831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd81060f0 0x7fcfd810dc70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcfd000b0a0 tx=0x7fcfd000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 -- 172.21.15.142:0/397826831 shutdown_connections 2023-09-21T13:04:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/397826831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd81060f0 0x7fcfd810dc70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/397826831 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/397826831 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd8101980 0x7fcfd81059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 -- 172.21.15.142:0/397826831 >> 172.21.15.142:0/397826831 conn(0x7fcfd80fc8b0 msgr2=0x7fcfd80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 -- 172.21.15.142:0/397826831 shutdown_connections 2023-09-21T13:04:47.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.419+0000 7fcfde5ff700 1 -- 172.21.15.142:0/397826831 wait complete. 2023-09-21T13:04:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 Processor -- start 2023-09-21T13:04:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 -- start start 2023-09-21T13:04:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd81060f0 0x7fcfd8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 0x7fcfd819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd819e5e0 con 0x7fcfd81060f0 2023-09-21T13:04:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd819e750 con 0x7fcfd8100fd0 2023-09-21T13:04:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.421+0000 7fcfde5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd819e910 con 0x7fcfd819db60 2023-09-21T13:04:47.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37120/0 (socket says 172.21.15.142:37120) 2023-09-21T13:04:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 -- 172.21.15.142:0/653636880 learned_addr learned my addr 172.21.15.142:0/653636880 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd81060f0 0x7fcfd8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 0x7fcfd819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 -- 172.21.15.142:0/653636880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 msgr2=0x7fcfd819dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 0x7fcfd819dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 -- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd81060f0 msgr2=0x7fcfd8199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd81060f0 0x7fcfd8199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfd7fff700 1 -- 172.21.15.142:0/653636880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd0009d00 con 0x7fcfd8100fd0 2023-09-21T13:04:47.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.422+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 0x7fcfd819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800e9a0 tx=0x7fcfc800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfd57fa700 1 -- 172.21.15.142:0/653636880 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8009790 con 0x7fcfd8100fd0 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfd57fa700 1 -- 172.21.15.142:0/653636880 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfc8010430 con 0x7fcfd8100fd0 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd81a5e70 con 0x7fcfd8100fd0 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfd57fa700 1 -- 172.21.15.142:0/653636880 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8018680 con 0x7fcfd8100fd0 2023-09-21T13:04:47.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.423+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd81a6340 con 0x7fcfd8100fd0 2023-09-21T13:04:47.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.427+0000 7fcfd57fa700 1 -- 172.21.15.142:0/653636880 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcfc80105a0 con 0x7fcfd8100fd0 2023-09-21T13:04:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.429+0000 7fcff1fc1b80 1 Processor -- start 2023-09-21T13:04:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.429+0000 7fcfd57fa700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 0x7fcfc00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.429+0000 7fcff1fc1b80 1 -- start start 2023-09-21T13:04:47.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.429+0000 7fcfd57fa700 1 -- 172.21.15.142:0/653636880 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcfc8014070 con 0x7fcfd8100fd0 2023-09-21T13:04:47.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 0x7fcfc00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e974740 0x56008e978630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e978fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e8dfca0 con 0x56008e978b70 2023-09-21T13:04:47.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e8c3c70 con 0x56008e973e20 2023-09-21T13:04:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e8c1590 con 0x56008e974740 2023-09-21T13:04:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37132/0 (socket says 172.21.15.142:37132) 2023-09-21T13:04:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2152945548 learned_addr learned my addr 172.21.15.142:0/2152945548 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:47.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e974740 0x56008e978630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.430+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e978fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2152945548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e974740 msgr2=0x56008e978630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e974740 0x56008e978630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2152945548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 msgr2=0x56008e978fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e978fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2152945548 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008e6e7de0 con 0x56008e973e20 2023-09-21T13:04:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 0x7fcfc00a2cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0007fd0 tx=0x7fcfd0009510 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8096010 tx=0x7fcfc8098fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c03f6cf5071a3382 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfbe7fc700 1 -- 172.21.15.142:0/2152945548 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc809d3d0 con 0x56008e973e20 2023-09-21T13:04:47.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfbe7fc700 1 -- 172.21.15.142:0/2152945548 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfc80a1610 con 0x56008e973e20 2023-09-21T13:04:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.431+0000 7fcfbe7fc700 1 -- 172.21.15.142:0/2152945548 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8099800 con 0x56008e973e20 2023-09-21T13:04:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2152945548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 msgr2=0x56008e974200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8096010 tx=0x7fcfc8098fd0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2152945548 shutdown_connections 2023-09-21T13:04:47.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e978fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e974200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2152945548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e974740 0x56008e978630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2152945548 >> 172.21.15.142:0/2152945548 conn(0x56008e898000 msgr2=0x56008e9666a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2152945548 shutdown_connections 2023-09-21T13:04:47.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.432+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2152945548 wait complete. 2023-09-21T13:04:47.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.433+0000 7fcff1fc1b80 1 -- start start 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.433+0000 7fcff1fc1b80 1 Processor -- start 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e97d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e97dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e8bce80 con 0x56008e978b70 2023-09-21T13:04:47.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e859740 con 0x56008e974740 2023-09-21T13:04:47.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e8593e0 con 0x56008e973e20 2023-09-21T13:04:47.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcff1fc1b80 10 client.0 _ll_register_callbacks cb 0x56008e7a3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:47.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35300/0 (socket says 172.21.15.142:35300) 2023-09-21T13:04:47.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2476572273 learned_addr learned my addr 172.21.15.142:0/2476572273 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e97dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e97d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 msgr2=0x56008e97d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e97d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2476572273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 msgr2=0x56008e97dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e97dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 -- 172.21.15.142:0/2476572273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd81a6340 con 0x56008e973e20 2023-09-21T13:04:47.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e97dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:04:47.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80c9dc0 tx=0x7fcfc800c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=844e32b4428f1749 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.434+0000 7fcfb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:47.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8098c90 con 0x56008e973e20 2023-09-21T13:04:47.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcfc8010900 con 0x56008e973e20 2023-09-21T13:04:47.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56008e82dbb0 con 0x56008e973e20 2023-09-21T13:04:47.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8099800 con 0x56008e973e20 2023-09-21T13:04:47.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 10 client.27472 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:47.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56008e6d0c60 con 0x56008e973e20 2023-09-21T13:04:47.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56008e82dbb0 con 0x56008e973e20 2023-09-21T13:04:47.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fcfc80b1c30 con 0x56008e973e20 2023-09-21T13:04:47.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 10 client.27472 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:47.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 10 client.27472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:47.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 20 client.27472 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.435+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e98d800 0x56008e98fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.436+0000 7fcff1fc1b80 4 client.27472 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.436+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56008e93a020 con 0x56008e98d800 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.436+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e98d800 0x56008e98fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.436+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e98d800 0x56008e98fc20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8451e247267810cb server_cookie=e2d2cc72ef916b65 in_seq=0 out_seq=0 2023-09-21T13:04:47.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.436+0000 7fcfb77fe700 10 client.27472 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:47.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcfb77fe700 1 -- 172.21.15.142:0/2476572273 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56008e93a020 con 0x56008e98d800 2023-09-21T13:04:47.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcfb77fe700 10 client.27472 handle_command_reply: tid=0 2023-09-21T13:04:47.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 client.27472 shutdown 2023-09-21T13:04:47.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 msgr2=0x56008e980330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80c9dc0 tx=0x7fcfc800c4b0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 shutdown_connections 2023-09-21T13:04:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e98d800 0x56008e98fc20 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e978b70 0x56008e97dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.437+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e973e20 0x56008e980330 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/2476572273 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e97d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 >> 172.21.15.142:0/2476572273 conn(0x56008e898000 msgr2=0x56008e965880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcfb77fe700 0 client.27472 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 shutdown_connections 2023-09-21T13:04:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/2476572273 wait complete. 2023-09-21T13:04:47.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.438+0000 7fcff1fc1b80 20 client.27472 trim_cache size 0 max 16384 2023-09-21T13:04:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.458+0000 7fcff1fc1b80 1 Processor -- start 2023-09-21T13:04:47.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.458+0000 7fcff1fc1b80 1 -- start start 2023-09-21T13:04:47.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.458+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.458+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e974740 0x56008e97cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.457 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.458+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e73d920 con 0x56008e974740 2023-09-21T13:04:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e98a620 con 0x56008e973e20 2023-09-21T13:04:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e9609c0 con 0x56008e978b70 2023-09-21T13:04:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.458 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37152/0 (socket says 172.21.15.142:37152) 2023-09-21T13:04:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 -- 172.21.15.142:0/4273951028 learned_addr learned my addr 172.21.15.142:0/4273951028 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e974740 0x56008e97cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 -- 172.21.15.142:0/4273951028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 msgr2=0x56008e97fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.459 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 -- 172.21.15.142:0/4273951028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e974740 msgr2=0x56008e97cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e974740 0x56008e97cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 -- 172.21.15.142:0/4273951028 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56008e967ce0 con 0x56008e973e20 2023-09-21T13:04:47.460 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.459+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8096010 tx=0x7fcfc8098fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62558ddcb4548459 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcfbeffd700 1 -- 172.21.15.142:0/4273951028 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8099ca0 con 0x56008e973e20 2023-09-21T13:04:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcfbeffd700 1 -- 172.21.15.142:0/4273951028 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfc80a1180 con 0x56008e973e20 2023-09-21T13:04:47.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcfbeffd700 1 -- 172.21.15.142:0/4273951028 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8099a20 con 0x56008e973e20 2023-09-21T13:04:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/4273951028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 msgr2=0x56008e984c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8096010 tx=0x7fcfc8098fd0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/4273951028 shutdown_connections 2023-09-21T13:04:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e973e20 0x56008e984c90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/4273951028 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e974740 0x56008e97cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.460+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/4273951028 >> 172.21.15.142:0/4273951028 conn(0x56008e898000 msgr2=0x56008e976c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.461+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/4273951028 shutdown_connections 2023-09-21T13:04:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.461+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/4273951028 wait complete. 2023-09-21T13:04:47.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.461+0000 7fcff1fc1b80 1 -- start start 2023-09-21T13:04:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.461+0000 7fcff1fc1b80 1 Processor -- start 2023-09-21T13:04:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 0x56008e97f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e9805d0 con 0x56008e97f280 2023-09-21T13:04:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e980740 con 0x56008e974740 2023-09-21T13:04:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56008e9e1630 con 0x56008e978b70 2023-09-21T13:04:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcff1fc1b80 10 client.0 _ll_register_callbacks cb 0x56008e7a3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37154/0 (socket says 172.21.15.142:37154) 2023-09-21T13:04:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 -- 172.21.15.142:0/528441901 learned_addr learned my addr 172.21.15.142:0/528441901 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 0x56008e97f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 -- 172.21.15.142:0/528441901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 msgr2=0x56008e97ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 -- 172.21.15.142:0/528441901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 msgr2=0x56008e97f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 0x56008e97f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd7fff700 1 -- 172.21.15.142:0/528441901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56008e6d0c60 con 0x56008e974740 2023-09-21T13:04:47.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfdcb9c700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 0x56008e97f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:04:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.462+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:04:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfd7fff700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c2d0 tx=0x7fcfc800c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa68b74f78167e79 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc8098c90 con 0x56008e974740 2023-09-21T13:04:47.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfc80a1610 con 0x56008e974740 2023-09-21T13:04:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fcfc80b1ba0 con 0x56008e974740 2023-09-21T13:04:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfc8099ca0 con 0x56008e974740 2023-09-21T13:04:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcff1fc1b80 10 client.27515 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x56008e70e250 con 0x56008e974740 2023-09-21T13:04:47.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.463+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfc80a1610 con 0x56008e974740 2023-09-21T13:04:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fcfc8098500 con 0x56008e974740 2023-09-21T13:04:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 10 client.27515 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 10 client.27515 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 20 client.27515 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:47.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e9e27a0 0x56008e9e4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 4 client.27515 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:04:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56008e8b5e60 con 0x56008e9e27a0 2023-09-21T13:04:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e9e27a0 0x56008e9e4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcfb77fe700 10 client.27515 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:47.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.464+0000 7fcfd77fe700 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e9e27a0 0x56008e9e4b90 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab643aafd503c3df server_cookie=7b3b86bb9528ecff in_seq=0 out_seq=0 2023-09-21T13:04:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcfb77fe700 1 -- 172.21.15.142:0/528441901 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56008e8b5e60 con 0x56008e9e27a0 2023-09-21T13:04:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcfb77fe700 10 client.27515 handle_command_reply: tid=0 2023-09-21T13:04:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 client.27515 shutdown 2023-09-21T13:04:47.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 msgr2=0x56008e980090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800c2d0 tx=0x7fcfc800c4b0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 shutdown_connections 2023-09-21T13:04:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56008e9e27a0 0x56008e9e4b90 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56008e97f280 0x56008e97f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56008e974740 0x56008e980090 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 --2- 172.21.15.142:0/528441901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56008e978b70 0x56008e97ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcfb77fe700 0 client.27515 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 >> 172.21.15.142:0/528441901 conn(0x56008e898000 msgr2=0x56008e978f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 shutdown_connections 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 1 -- 172.21.15.142:0/528441901 wait complete. 2023-09-21T13:04:47.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.465+0000 7fcff1fc1b80 20 client.27515 trim_cache size 0 max 16384 2023-09-21T13:04:47.478 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:04:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:04:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:04:47.478 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:04:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:04:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:04:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:04:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:04:47.479 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:04:47.480 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:04:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 msgr2=0x7fcfc00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 0x7fcfc00a2cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0007fd0 tx=0x7fcfd0009510 comp rx=0 tx=0).stop 2023-09-21T13:04:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 msgr2=0x7fcfd81991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:47.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcfc800e9a0 tx=0x7fcfc800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 shutdown_connections 2023-09-21T13:04:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfc00a0830 0x7fcfc00a2cf0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfd819db60 0x7fcfd819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcfd8100fd0 0x7fcfd81991c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 --2- 172.21.15.142:0/653636880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcfd81060f0 0x7fcfd8199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 >> 172.21.15.142:0/653636880 conn(0x7fcfd80fc8b0 msgr2=0x7fcfd80fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 shutdown_connections 2023-09-21T13:04:47.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:04:47.466+0000 7fcfde5ff700 1 -- 172.21.15.142:0/653636880 wait complete. 2023-09-21T13:04:47.484 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:04:47.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 785287 8.79 MB/sec execute 328 sec latency 39.744 ms 2023-09-21T13:04:48.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:47 smithi156 ceph-mon[134078]: pgmap v265: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 377 op/s 2023-09-21T13:04:48.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:47 smithi142 ceph-mon[97663]: pgmap v265: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 377 op/s 2023-09-21T13:04:48.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:47 smithi160 ceph-mon[134450]: pgmap v265: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 377 op/s 2023-09-21T13:04:48.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 787611 8.80 MB/sec execute 329 sec latency 15.762 ms 2023-09-21T13:04:49.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 789142 8.80 MB/sec execute 330 sec latency 9.542 ms 2023-09-21T13:04:50.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:49 smithi156 ceph-mon[134078]: pgmap v266: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:04:50.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:49 smithi142 ceph-mon[97663]: pgmap v266: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:04:50.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:49 smithi160 ceph-mon[134450]: pgmap v266: 97 pgs: 97 active+clean; 226 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:04:50.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 791497 8.82 MB/sec execute 331 sec latency 16.081 ms 2023-09-21T13:04:51.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 792927 8.81 MB/sec execute 332 sec latency 13.767 ms 2023-09-21T13:04:52.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:51 smithi156 ceph-mon[134078]: pgmap v267: 97 pgs: 97 active+clean; 232 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2023-09-21T13:04:52.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:51 smithi142 ceph-mon[97663]: pgmap v267: 97 pgs: 97 active+clean; 232 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2023-09-21T13:04:52.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:51 smithi160 ceph-mon[134450]: pgmap v267: 97 pgs: 97 active+clean; 232 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.2 MiB/s wr, 248 op/s 2023-09-21T13:04:52.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 794945 8.82 MB/sec execute 333 sec latency 31.578 ms 2023-09-21T13:04:53.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 796389 8.81 MB/sec execute 334 sec latency 10.924 ms 2023-09-21T13:04:54.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:53 smithi156 ceph-mon[134078]: pgmap v268: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2023-09-21T13:04:54.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:53 smithi142 ceph-mon[97663]: pgmap v268: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2023-09-21T13:04:54.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:53 smithi160 ceph-mon[134450]: pgmap v268: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 250 op/s 2023-09-21T13:04:54.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 798676 8.82 MB/sec execute 335 sec latency 17.084 ms 2023-09-21T13:04:55.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 800050 8.82 MB/sec execute 336 sec latency 11.538 ms 2023-09-21T13:04:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.803+0000 7f04e0dff700 1 -- 172.21.15.142:0/4191603825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc100fe0 msgr2=0x7f04dc1013c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.803+0000 7f04e0dff700 1 --2- 172.21.15.142:0/4191603825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc100fe0 0x7f04dc1013c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009990 tx=0x7f04cc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 -- 172.21.15.142:0/4191603825 shutdown_connections 2023-09-21T13:04:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 --2- 172.21.15.142:0/4191603825 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 --2- 172.21.15.142:0/4191603825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc100fe0 0x7f04dc1013c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 --2- 172.21.15.142:0/4191603825 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc101990 0x7f04dc1059d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 -- 172.21.15.142:0/4191603825 >> 172.21.15.142:0/4191603825 conn(0x7f04dc0fc840 msgr2=0x7f04dc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 -- 172.21.15.142:0/4191603825 shutdown_connections 2023-09-21T13:04:55.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.804+0000 7f04e0dff700 1 -- 172.21.15.142:0/4191603825 wait complete. 2023-09-21T13:04:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.805+0000 7f04e0dff700 1 Processor -- start 2023-09-21T13:04:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.805+0000 7f04e0dff700 1 -- start start 2023-09-21T13:04:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc100fe0 0x7f04dc1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc19dd50 0x7f04dc19e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19e7d0 con 0x7f04dc100fe0 2023-09-21T13:04:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19e940 con 0x7f04dc106100 2023-09-21T13:04:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04e0dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19eb00 con 0x7f04dc19dd50 2023-09-21T13:04:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04dad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc19dd50 0x7f04dc19e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39910/0 (socket says 172.21.15.142:39910) 2023-09-21T13:04:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1413508303 learned_addr learned my addr 172.21.15.142:0/1413508303 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.806+0000 7f04da59c700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc100fe0 0x7f04dc1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1413508303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc19dd50 msgr2=0x7f04dc19e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc19dd50 0x7f04dc19e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc100fe0 msgr2=0x7f04dc1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc100fe0 0x7f04dc1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1413508303 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0095f0 con 0x7f04dc106100 2023-09-21T13:04:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04d000d950 tx=0x7f04d000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04cb7fe700 1 -- 172.21.15.142:0/1413508303 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0004220 con 0x7f04dc106100 2023-09-21T13:04:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc1a6060 con 0x7f04dc106100 2023-09-21T13:04:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04cb7fe700 1 -- 172.21.15.142:0/1413508303 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04d0007620 con 0x7f04dc106100 2023-09-21T13:04:55.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04cb7fe700 1 -- 172.21.15.142:0/1413508303 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0005690 con 0x7f04dc106100 2023-09-21T13:04:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.807+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1a6590 con 0x7f04dc106100 2023-09-21T13:04:55.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.812+0000 7f04cb7fe700 1 -- 172.21.15.142:0/1413508303 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f04d0004750 con 0x7f04dc106100 2023-09-21T13:04:55.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.813+0000 7f04f47c9b80 1 Processor -- start 2023-09-21T13:04:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 -- start start 2023-09-21T13:04:55.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc914c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc919ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc880c40 con 0x5652cc9148b0 2023-09-21T13:04:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc864c10 con 0x5652cc919660 2023-09-21T13:04:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc862530 con 0x5652cc9151d0 2023-09-21T13:04:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04da59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04da59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36502/0 (socket says 172.21.15.142:36502) 2023-09-21T13:04:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04da59c700 1 -- 172.21.15.142:0/2690934689 learned_addr learned my addr 172.21.15.142:0/2690934689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04dad9d700 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc914c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.814+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc919ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04cb7fe700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 0x7f04c40a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 -- 172.21.15.142:0/2690934689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 msgr2=0x5652cc919ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc919ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 -- 172.21.15.142:0/2690934689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 msgr2=0x5652cc914c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc914c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 -- 172.21.15.142:0/2690934689 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652cc688d80 con 0x5652cc9151d0 2023-09-21T13:04:55.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04cb7fe700 1 -- 172.21.15.142:0/1413508303 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04d00cbcf0 con 0x7f04dc106100 2023-09-21T13:04:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04da59c700 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005e80 tx=0x7f04cc005eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283cd1af40e1d628 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.815+0000 7f04dad9d700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 0x7f04c40a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.816+0000 7f04c8ff9700 1 -- 172.21.15.142:0/2690934689 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0056d0 con 0x5652cc9151d0 2023-09-21T13:04:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.816+0000 7f04c8ff9700 1 -- 172.21.15.142:0/2690934689 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04cc01e040 con 0x5652cc9151d0 2023-09-21T13:04:55.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.816+0000 7f04c8ff9700 1 -- 172.21.15.142:0/2690934689 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc004a90 con 0x5652cc9151d0 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2690934689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 msgr2=0x5652cc919120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005e80 tx=0x7f04cc005eb0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04dad9d700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 0x7f04c40a2cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f04d40075c0 tx=0x7f04d4009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2690934689 shutdown_connections 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc914c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc919ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2690934689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc919120 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2690934689 >> 172.21.15.142:0/2690934689 conn(0x5652cc838fa0 msgr2=0x5652cc9070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2690934689 shutdown_connections 2023-09-21T13:04:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.817+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2690934689 wait complete. 2023-09-21T13:04:55.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.818+0000 7f04f47c9b80 1 -- start start 2023-09-21T13:04:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.818+0000 7f04f47c9b80 1 Processor -- start 2023-09-21T13:04:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 0x5652cc920e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc91e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc85de20 con 0x5652cc9151d0 2023-09-21T13:04:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc7fa6e0 con 0x5652cc919660 2023-09-21T13:04:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc7fa380 con 0x5652cc9148b0 2023-09-21T13:04:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04f47c9b80 10 client.0 _ll_register_callbacks cb 0x5652cc744a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51014/0 (socket says 172.21.15.142:51014) 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04d9d9b700 1 -- 172.21.15.142:0/3479723818 learned_addr learned my addr 172.21.15.142:0/3479723818 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.819+0000 7f04da59c700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 0x5652cc920e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04dad9d700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc91e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 -- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 msgr2=0x5652cc91e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc91e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 -- 172.21.15.142:0/3479723818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 msgr2=0x5652cc91e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 -- 172.21.15.142:0/3479723818 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc10e4f0 con 0x5652cc9148b0 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04dad9d700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc91e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04da59c700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 0x5652cc920e80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f04cc025040 tx=0x7f04cc00baa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd78196ef9be9abf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:04:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc004700 con 0x5652cc9148b0 2023-09-21T13:04:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.820+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652cc7ceb50 con 0x5652cc9148b0 2023-09-21T13:04:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04cc004860 con 0x5652cc9148b0 2023-09-21T13:04:55.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04cc004a20 con 0x5652cc9148b0 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04f47c9b80 10 client.27487 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5652cc671c00 con 0x5652cc9148b0 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04cc03a020 con 0x5652cc9148b0 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f04cc036be0 con 0x5652cc9148b0 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04f47c9b80 10 client.27487 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:55.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04f47c9b80 10 client.27487 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.821+0000 7f04f47c9b80 20 client.27487 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc92e1d0 0x5652cc9305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04f47c9b80 4 client.27487 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:04:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5652cc8dafc0 con 0x5652cc92e1d0 2023-09-21T13:04:55.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc92e1d0 0x5652cc9305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04c1ffb700 10 client.27487 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:55.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.822+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc92e1d0 0x5652cc9305c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9ca9a3cc1814cef server_cookie=934830090374e038 in_seq=0 out_seq=0 2023-09-21T13:04:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04c1ffb700 1 -- 172.21.15.142:0/3479723818 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5652cc8dafc0 con 0x5652cc92e1d0 2023-09-21T13:04:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04c1ffb700 10 client.27487 handle_command_reply: tid=0 2023-09-21T13:04:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04f47c9b80 1 client.27487 shutdown 2023-09-21T13:04:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 msgr2=0x5652cc920e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 0x5652cc920e80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f04cc025040 tx=0x7f04cc00baa0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 shutdown_connections 2023-09-21T13:04:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.823+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc92e1d0 0x5652cc9305c0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc91e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9148b0 0x5652cc920e80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/3479723818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc91e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 >> 172.21.15.142:0/3479723818 conn(0x5652cc838fa0 msgr2=0x5652cc906cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04c1ffb700 0 client.27487 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 shutdown_connections 2023-09-21T13:04:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 1 -- 172.21.15.142:0/3479723818 wait complete. 2023-09-21T13:04:55.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.824+0000 7f04f47c9b80 20 client.27487 trim_cache size 0 max 16384 2023-09-21T13:04:55.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 Processor -- start 2023-09-21T13:04:55.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 -- start start 2023-09-21T13:04:55.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc9209b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc917c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc6de8c0 con 0x5652cc9148b0 2023-09-21T13:04:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc91f5c0 con 0x5652cc919660 2023-09-21T13:04:55.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.843+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc91f190 con 0x5652cc9151d0 2023-09-21T13:04:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04da59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc9209b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04da59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc9209b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:51018/0 (socket says 172.21.15.142:51018) 2023-09-21T13:04:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36522/0 (socket says 172.21.15.142:36522) 2023-09-21T13:04:55.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04da59c700 1 -- 172.21.15.142:0/1315862678 learned_addr learned my addr 172.21.15.142:0/1315862678 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04dad9d700 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc917c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1315862678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 msgr2=0x5652cc917c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc917c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1315862678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 msgr2=0x5652cc9209b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc9209b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 -- 172.21.15.142:0/1315862678 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5652cc6af1f0 con 0x5652cc9151d0 2023-09-21T13:04:55.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.844+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b540 tx=0x7f04d00955e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76618e65241299de server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04c97fa700 1 -- 172.21.15.142:0/1315862678 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0098ad0 con 0x5652cc9151d0 2023-09-21T13:04:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04c97fa700 1 -- 172.21.15.142:0/1315862678 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04d0099870 con 0x5652cc9151d0 2023-09-21T13:04:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04c97fa700 1 -- 172.21.15.142:0/1315862678 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0022e80 con 0x5652cc9151d0 2023-09-21T13:04:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 -- 172.21.15.142:0/1315862678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 msgr2=0x5652cc917730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f04d000b540 tx=0x7f04d00955e0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 -- 172.21.15.142:0/1315862678 shutdown_connections 2023-09-21T13:04:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9148b0 0x5652cc9209b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc919660 0x5652cc917c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/1315862678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc9151d0 0x5652cc917730 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.845+0000 7f04f47c9b80 1 -- 172.21.15.142:0/1315862678 >> 172.21.15.142:0/1315862678 conn(0x5652cc838fa0 msgr2=0x5652cc929f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.846+0000 7f04f47c9b80 1 -- 172.21.15.142:0/1315862678 shutdown_connections 2023-09-21T13:04:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.846+0000 7f04f47c9b80 1 -- 172.21.15.142:0/1315862678 wait complete. 2023-09-21T13:04:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.846+0000 7f04f47c9b80 1 -- start start 2023-09-21T13:04:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.846+0000 7f04f47c9b80 1 Processor -- start 2023-09-21T13:04:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc924eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 0x5652cc980fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc925680 con 0x5652cc9151d0 2023-09-21T13:04:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc9257f0 con 0x5652cc9148b0 2023-09-21T13:04:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652cc981530 con 0x5652cc919660 2023-09-21T13:04:55.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04f47c9b80 10 client.0 _ll_register_callbacks cb 0x5652cc744a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:04:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39936/0 (socket says 172.21.15.142:39936) 2023-09-21T13:04:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 -- 172.21.15.142:0/2188294301 learned_addr learned my addr 172.21.15.142:0/2188294301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:04:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc924eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04dad9d700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 0x5652cc980fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 -- 172.21.15.142:0/2188294301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 msgr2=0x5652cc980fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 0x5652cc980fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 -- 172.21.15.142:0/2188294301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 msgr2=0x5652cc924eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc924eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04da59c700 1 -- 172.21.15.142:0/2188294301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1a6590 con 0x5652cc9148b0 2023-09-21T13:04:55.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.847+0000 7f04dad9d700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 0x5652cc980fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:04:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04da59c700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0098e0 tx=0x7f04cc017620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7450ed0988b220cd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:04:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:04:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc00fd60 con 0x5652cc9148b0 2023-09-21T13:04:55.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f04cc03b080 con 0x5652cc9148b0 2023-09-21T13:04:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04cc01e040 con 0x5652cc9148b0 2023-09-21T13:04:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04cc00f790 con 0x5652cc9148b0 2023-09-21T13:04:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04f47c9b80 10 client.27533 fetch_fsmap learned FSMap version 37 2023-09-21T13:04:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.848+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x5652cc687250 con 0x5652cc9148b0 2023-09-21T13:04:55.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04cc01e040 con 0x5652cc9148b0 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 37) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f04cc034070 con 0x5652cc9148b0 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 10 client.27533 fetch_fsmap finished waiting for FSMap version 37 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 10 client.27533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 20 client.27533 populate_metadata read hostname 'smithi142' 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc982890 0x5652cc984cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:04:55.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 4 client.27533 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:04:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5652cc856e00 con 0x5652cc982890 2023-09-21T13:04:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.849+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc982890 0x5652cc984cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:04:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.850+0000 7f04d9d9b700 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc982890 0x5652cc984cb0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51d411ea2c79462c server_cookie=10b21cb9782f8ce6 in_seq=0 out_seq=0 2023-09-21T13:04:55.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.850+0000 7f04c1ffb700 10 client.27533 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:55.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.915+0000 7f04c1ffb700 1 -- 172.21.15.142:0/2188294301 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5652cc856e00 con 0x5652cc982890 2023-09-21T13:04:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.915+0000 7f04c1ffb700 10 client.27533 handle_command_reply: tid=0 2023-09-21T13:04:55.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.915+0000 7f04f47c9b80 1 client.27533 shutdown 2023-09-21T13:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.916+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 msgr2=0x5652cc924970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.916+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0098e0 tx=0x7f04cc017620 comp rx=0 tx=0).stop 2023-09-21T13:04:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 shutdown_connections 2023-09-21T13:04:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5652cc982890 0x5652cc984cb0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.915 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5652cc919660 0x5652cc980fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5652cc9148b0 0x5652cc924970 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 --2- 172.21.15.142:0/2188294301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5652cc9151d0 0x5652cc924eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.917+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 >> 172.21.15.142:0/2188294301 conn(0x5652cc838fa0 msgr2=0x5652cc917730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.918+0000 7f04c1ffb700 0 client.27533 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:04:55.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.918+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 shutdown_connections 2023-09-21T13:04:55.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:04:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:04:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:04:55.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:04:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.918+0000 7f04f47c9b80 1 -- 172.21.15.142:0/2188294301 wait complete. 2023-09-21T13:04:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.920+0000 7f04f47c9b80 20 client.27533 trim_cache size 0 max 16384 2023-09-21T13:04:55.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.922+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 msgr2=0x7f04c40a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.922+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 0x7f04c40a2cf0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f04d40075c0 tx=0x7f04d4009040 comp rx=0 tx=0).stop 2023-09-21T13:04:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.922+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 msgr2=0x7f04dc1996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:04:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.922+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f04d000d950 tx=0x7f04d000dc60 comp rx=0 tx=0).stop 2023-09-21T13:04:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 shutdown_connections 2023-09-21T13:04:55.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04c40a0830 0x7f04c40a2cf0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04dc100fe0 0x7f04dc1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc19dd50 0x7f04dc19e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 --2- 172.21.15.142:0/1413508303 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04dc106100 0x7f04dc1996e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.923+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 >> 172.21.15.142:0/1413508303 conn(0x7f04dc0fc840 msgr2=0x7f04dc10cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:04:55.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.924+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 shutdown_connections 2023-09-21T13:04:55.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:04:55.925+0000 7f04e0dff700 1 -- 172.21.15.142:0/1413508303 wait complete. 2023-09-21T13:04:56.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:55 smithi156 ceph-mon[134078]: pgmap v269: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-09-21T13:04:56.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:55 smithi142 ceph-mon[97663]: pgmap v269: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-09-21T13:04:56.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:55 smithi160 ceph-mon[134450]: pgmap v269: 97 pgs: 97 active+clean; 234 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 185 op/s 2023-09-21T13:04:56.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 802213 8.83 MB/sec execute 337 sec latency 39.974 ms 2023-09-21T13:04:57.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 803470 8.82 MB/sec execute 338 sec latency 24.145 ms 2023-09-21T13:04:58.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:57 smithi156 ceph-mon[134078]: pgmap v270: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 273 op/s 2023-09-21T13:04:58.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:57 smithi142 ceph-mon[97663]: pgmap v270: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 273 op/s 2023-09-21T13:04:58.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:57 smithi160 ceph-mon[134450]: pgmap v270: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 273 op/s 2023-09-21T13:04:58.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 805779 8.83 MB/sec execute 339 sec latency 15.379 ms 2023-09-21T13:04:59.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 807186 8.83 MB/sec execute 340 sec latency 12.383 ms 2023-09-21T13:05:00.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:04:59 smithi156 ceph-mon[134078]: pgmap v271: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:05:00.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:04:59 smithi142 ceph-mon[97663]: pgmap v271: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:05:00.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:04:59 smithi160 ceph-mon[134450]: pgmap v271: 97 pgs: 97 active+clean; 242 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 170 op/s 2023-09-21T13:05:00.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 809587 8.85 MB/sec execute 341 sec latency 16.692 ms 2023-09-21T13:05:01.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 810530 8.83 MB/sec execute 342 sec latency 35.623 ms 2023-09-21T13:05:02.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:01 smithi156 ceph-mon[134078]: pgmap v272: 97 pgs: 97 active+clean; 238 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:05:02.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:01 smithi142 ceph-mon[97663]: pgmap v272: 97 pgs: 97 active+clean; 238 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:05:02.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:01 smithi160 ceph-mon[134450]: pgmap v272: 97 pgs: 97 active+clean; 238 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:05:02.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 811686 8.82 MB/sec execute 343 sec latency 297.689 ms 2023-09-21T13:05:03.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 813332 8.83 MB/sec execute 344 sec latency 326.140 ms 2023-09-21T13:05:04.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:03 smithi156 ceph-mon[134078]: pgmap v273: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2023-09-21T13:05:04.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:03 smithi142 ceph-mon[97663]: pgmap v273: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2023-09-21T13:05:04.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:03 smithi160 ceph-mon[134450]: pgmap v273: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 226 op/s 2023-09-21T13:05:04.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 814638 8.82 MB/sec execute 345 sec latency 46.501 ms 2023-09-21T13:05:05.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:04 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:05.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:04 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:05.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:04 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:05.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 816804 8.83 MB/sec execute 346 sec latency 21.226 ms 2023-09-21T13:05:06.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:05 smithi156 ceph-mon[134078]: pgmap v274: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 204 op/s 2023-09-21T13:05:06.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:05 smithi142 ceph-mon[97663]: pgmap v274: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 204 op/s 2023-09-21T13:05:06.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:05 smithi160 ceph-mon[134450]: pgmap v274: 97 pgs: 97 active+clean; 238 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 204 op/s 2023-09-21T13:05:06.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 818123 8.82 MB/sec execute 347 sec latency 15.523 ms 2023-09-21T13:05:07.700 INFO:tasks.workunit.client.0.smithi142.stdout: 1 820276 8.83 MB/sec execute 348 sec latency 20.179 ms 2023-09-21T13:05:08.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:07 smithi156 ceph-mon[134078]: pgmap v275: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 310 op/s 2023-09-21T13:05:08.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:07 smithi142 ceph-mon[97663]: pgmap v275: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 310 op/s 2023-09-21T13:05:08.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:07 smithi160 ceph-mon[134450]: pgmap v275: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 310 op/s 2023-09-21T13:05:08.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 820727 8.81 MB/sec execute 349 sec latency 229.588 ms 2023-09-21T13:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 -- 172.21.15.142:0/3060032482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17700ffdb0 msgr2=0x7f1770104140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 --2- 172.21.15.142:0/3060032482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17700ffdb0 0x7f1770104140 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1758009990 tx=0x7f1758009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 -- 172.21.15.142:0/3060032482 shutdown_connections 2023-09-21T13:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 --2- 172.21.15.142:0/3060032482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1770109ea0 0x7f177010c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 --2- 172.21.15.142:0/3060032482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 0x7f1770103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 --2- 172.21.15.142:0/3060032482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f17700ffdb0 0x7f1770104140 secure :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1758009990 tx=0x7f1758009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.135+0000 7f17757ff700 1 -- 172.21.15.142:0/3060032482 >> 172.21.15.142:0/3060032482 conn(0x7f1770074b50 msgr2=0x7f1770074f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.137+0000 7f17757ff700 1 -- 172.21.15.142:0/3060032482 shutdown_connections 2023-09-21T13:05:09.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.140+0000 7f17757ff700 1 -- 172.21.15.142:0/3060032482 wait complete. 2023-09-21T13:05:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.141+0000 7f17757ff700 1 Processor -- start 2023-09-21T13:05:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.141+0000 7f17757ff700 1 -- start start 2023-09-21T13:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 0x7f17701971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 0x7f17701976e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 0x7f177019c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177019c7d0 con 0x7f1770109ea0 2023-09-21T13:05:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177019c910 con 0x7f17700674f0 2023-09-21T13:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f17757ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177019ca80 con 0x7f177019bd50 2023-09-21T13:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f1767fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 0x7f17701976e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f176f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 0x7f177019c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f1767fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 0x7f17701976e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57290/0 (socket says 172.21.15.142:57290) 2023-09-21T13:05:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.142+0000 7f1767fff700 1 -- 172.21.15.142:0/4198857283 learned_addr learned my addr 172.21.15.142:0/4198857283 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.143+0000 7f176effd700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 0x7f17701971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 -- 172.21.15.142:0/4198857283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 msgr2=0x7f17701971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 0x7f17701971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 -- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 msgr2=0x7f17701976e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 0x7f17701976e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 -- 172.21.15.142:0/4198857283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580095f0 con 0x7f177019bd50 2023-09-21T13:05:09.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.144+0000 7f176f7fe700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 0x7f177019c1d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f176800d720 tx=0x7f176800da30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.147+0000 7f176cff9700 1 -- 172.21.15.142:0/4198857283 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768004020 con 0x7f177019bd50 2023-09-21T13:05:09.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.147+0000 7f176cff9700 1 -- 172.21.15.142:0/4198857283 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1768004830 con 0x7f177019bd50 2023-09-21T13:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.147+0000 7f176cff9700 1 -- 172.21.15.142:0/4198857283 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768005490 con 0x7f177019bd50 2023-09-21T13:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.147+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177006a800 con 0x7f177019bd50 2023-09-21T13:05:09.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.147+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177006acc0 con 0x7f177019bd50 2023-09-21T13:05:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.156+0000 7f17891e2b80 1 Processor -- start 2023-09-21T13:05:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.156+0000 7f176cff9700 1 -- 172.21.15.142:0/4198857283 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f17680049a0 con 0x7f177019bd50 2023-09-21T13:05:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.156+0000 7f17891e2b80 1 -- start start 2023-09-21T13:05:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186c52920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c5a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186bb9c40 con 0x55a186c44eb0 2023-09-21T13:05:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186b9dc10 con 0x55a186c52540 2023-09-21T13:05:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f17891e2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186b9b530 con 0x55a186c45870 2023-09-21T13:05:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f176effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f176effd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57298/0 (socket says 172.21.15.142:57298) 2023-09-21T13:05:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.157+0000 7f176effd700 1 -- 172.21.15.142:0/33346799 learned_addr learned my addr 172.21.15.142:0/33346799 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 -- 172.21.15.142:0/33346799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 msgr2=0x55a186c5a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c5a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 -- 172.21.15.142:0/33346799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 msgr2=0x55a186c52920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186c52920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 -- 172.21.15.142:0/33346799 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1869c1d80 con 0x55a186c44eb0 2023-09-21T13:05:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.158+0000 7f176effd700 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f176000a730 tx=0x7f1760007990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386c9d58e3eac3e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.159+0000 7f17657fa700 1 -- 172.21.15.142:0/33346799 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000f050 con 0x55a186c44eb0 2023-09-21T13:05:09.159 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.159+0000 7f17657fa700 1 -- 172.21.15.142:0/33346799 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1760010040 con 0x55a186c44eb0 2023-09-21T13:05:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.159+0000 7f17657fa700 1 -- 172.21.15.142:0/33346799 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760008950 con 0x55a186c44eb0 2023-09-21T13:05:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 -- 172.21.15.142:0/33346799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 msgr2=0x55a186c45330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f176000a730 tx=0x7f1760007990 comp rx=0 tx=0).stop 2023-09-21T13:05:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 -- 172.21.15.142:0/33346799 shutdown_connections 2023-09-21T13:05:09.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c5a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186c52920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 --2- 172.21.15.142:0/33346799 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c44eb0 0x55a186c45330 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f17891e2b80 1 -- 172.21.15.142:0/33346799 >> 172.21.15.142:0/33346799 conn(0x55a186b71fa0 msgr2=0x55a186c3fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.160+0000 7f176cff9700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 0x7f175c0a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.161+0000 7f17891e2b80 1 -- 172.21.15.142:0/33346799 shutdown_connections 2023-09-21T13:05:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.161+0000 7f176cff9700 1 -- 172.21.15.142:0/4198857283 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17680cb6f0 con 0x7f177019bd50 2023-09-21T13:05:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.161+0000 7f17891e2b80 1 -- 172.21.15.142:0/33346799 wait complete. 2023-09-21T13:05:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.162+0000 7f176effd700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 0x7f175c0a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.162+0000 7f17891e2b80 1 -- start start 2023-09-21T13:05:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 Processor -- start 2023-09-21T13:05:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 0x55a186c57460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c57a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186b96e20 con 0x55a186c52540 2023-09-21T13:05:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186b336e0 con 0x55a186c45870 2023-09-21T13:05:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.163+0000 7f17891e2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186b33380 con 0x55a186c44eb0 2023-09-21T13:05:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.164+0000 7f17891e2b80 10 client.0 _ll_register_callbacks cb 0x55a186a7da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:09.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.164+0000 7f1767fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 0x55a186c57460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.164+0000 7f1767fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 0x55a186c57460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59670/0 (socket says 172.21.15.142:59670) 2023-09-21T13:05:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.164+0000 7f1767fff700 1 -- 172.21.15.142:0/100851621 learned_addr learned my addr 172.21.15.142:0/100851621 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.164+0000 7f176f7fe700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c57a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.166 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176f7fe700 1 -- 172.21.15.142:0/100851621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 msgr2=0x55a186c5a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176f7fe700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176f7fe700 1 -- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 msgr2=0x55a186c57460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176f7fe700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 0x55a186c57460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176f7fe700 1 -- 172.21.15.142:0/100851621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176000a410 con 0x55a186c52540 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.165+0000 7f176effd700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 0x7f175c0a2d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17600060b0 tx=0x7f17600083f0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.167 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.166+0000 7f176f7fe700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c57a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f17680c8e10 tx=0x7f1768098b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774a777516a9296d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.166+0000 7f17567fc700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:05:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.166+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680c9290 con 0x55a186c52540 2023-09-21T13:05:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.166+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f17680b8070 con 0x55a186c52540 2023-09-21T13:05:09.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.166+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a186b07b50 con 0x55a186c52540 2023-09-21T13:05:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.167+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17680b8270 con 0x55a186c52540 2023-09-21T13:05:09.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.170+0000 7f17891e2b80 10 client.17442 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.170+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55a1869aac00 con 0x55a186c52540 2023-09-21T13:05:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a186b07b50 con 0x55a186c52540 2023-09-21T13:05:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f17680a0750 con 0x55a186c52540 2023-09-21T13:05:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 10 client.17442 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:09.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 10 client.17442 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 20 client.17442 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c67680 0x55a186c69aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 4 client.17442 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.171+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a186c13fc0 con 0x55a186c67680 2023-09-21T13:05:09.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.172+0000 7f176effd700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c67680 0x55a186c69aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.173+0000 7f176effd700 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c67680 0x55a186c69aa0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3c246c0e06102f6 server_cookie=7d7aa7d20956c1a8 in_seq=0 out_seq=0 2023-09-21T13:05:09.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.173+0000 7f17567fc700 10 client.17442 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.174+0000 7f17567fc700 1 -- 172.21.15.142:0/100851621 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a186c13fc0 con 0x55a186c67680 2023-09-21T13:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.174+0000 7f17567fc700 10 client.17442 handle_command_reply: tid=0 2023-09-21T13:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.174+0000 7f17891e2b80 1 client.17442 shutdown 2023-09-21T13:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.175+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 msgr2=0x55a186c57a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.175+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c57a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f17680c8e10 tx=0x7f1768098b70 comp rx=0 tx=0).stop 2023-09-21T13:05:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 shutdown_connections 2023-09-21T13:05:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c67680 0x55a186c69aa0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c57a90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 --2- 172.21.15.142:0/100851621 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c45870 0x55a186c57460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.178+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 >> 172.21.15.142:0/100851621 conn(0x55a186b71fa0 msgr2=0x55a186c3fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.179+0000 7f17567fc700 0 client.17442 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:09.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.179+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 shutdown_connections 2023-09-21T13:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.179+0000 7f17891e2b80 1 -- 172.21.15.142:0/100851621 wait complete. 2023-09-21T13:05:09.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.179+0000 7f17891e2b80 20 client.17442 trim_cache size 0 max 16384 2023-09-21T13:05:09.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.207+0000 7f17891e2b80 1 Processor -- start 2023-09-21T13:05:09.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.207+0000 7f17891e2b80 1 -- start start 2023-09-21T13:05:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c44eb0 0x55a186c50f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c59d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186a178c0 con 0x55a186c52540 2023-09-21T13:05:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186c3c920 con 0x55a186c44eb0 2023-09-21T13:05:09.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.208+0000 7f17891e2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186c41790 con 0x55a186c45870 2023-09-21T13:05:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.209+0000 7f1767fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.209+0000 7f1767fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38254/0 (socket says 172.21.15.142:38254) 2023-09-21T13:05:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.209+0000 7f1767fff700 1 -- 172.21.15.142:0/3772542930 learned_addr learned my addr 172.21.15.142:0/3772542930 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f176f7fe700 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c59d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 -- 172.21.15.142:0/3772542930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c44eb0 msgr2=0x55a186c50f80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:05:09.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c44eb0 0x55a186c50f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 -- 172.21.15.142:0/3772542930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 msgr2=0x55a186c59d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c59d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 -- 172.21.15.142:0/3772542930 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1869e81f0 con 0x55a186c45870 2023-09-21T13:05:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f176f7fe700 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c59d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:05:09.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.210+0000 7f1767fff700 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1758015000 tx=0x7f1758005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c891aa26843040da server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.212+0000 7f1765ffb700 1 -- 172.21.15.142:0/3772542930 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175801d030 con 0x55a186c45870 2023-09-21T13:05:09.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.212+0000 7f1765ffb700 1 -- 172.21.15.142:0/3772542930 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f175801e040 con 0x55a186c45870 2023-09-21T13:05:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.212+0000 7f1765ffb700 1 -- 172.21.15.142:0/3772542930 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758005420 con 0x55a186c45870 2023-09-21T13:05:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 -- 172.21.15.142:0/3772542930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 msgr2=0x55a186c69690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1758015000 tx=0x7f1758005ab0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 -- 172.21.15.142:0/3772542930 shutdown_connections 2023-09-21T13:05:09.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c52540 0x55a186c59d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c44eb0 0x55a186c50f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 --2- 172.21.15.142:0/3772542930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c45870 0x55a186c69690 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.213+0000 7f17891e2b80 1 -- 172.21.15.142:0/3772542930 >> 172.21.15.142:0/3772542930 conn(0x55a186b71fa0 msgr2=0x55a186c62f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.215+0000 7f17891e2b80 1 -- 172.21.15.142:0/3772542930 shutdown_connections 2023-09-21T13:05:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.216+0000 7f17891e2b80 1 -- 172.21.15.142:0/3772542930 wait complete. 2023-09-21T13:05:09.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.217+0000 7f17891e2b80 1 -- start start 2023-09-21T13:05:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.217+0000 7f17891e2b80 1 Processor -- start 2023-09-21T13:05:09.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 0x55a186cb3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186cb39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186cb7130 con 0x55a186c45870 2023-09-21T13:05:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186cb72a0 con 0x55a186c52540 2023-09-21T13:05:09.216 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a186cb3ee0 con 0x55a186c44eb0 2023-09-21T13:05:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.218+0000 7f17891e2b80 10 client.0 _ll_register_callbacks cb 0x55a186a7da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:09.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.219+0000 7f176f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186cb39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.220+0000 7f1767fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 0x55a186cb3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.220+0000 7f1767fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 0x55a186cb3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57320/0 (socket says 172.21.15.142:57320) 2023-09-21T13:05:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.220+0000 7f1767fff700 1 -- 172.21.15.142:0/59183649 learned_addr learned my addr 172.21.15.142:0/59183649 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:09.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.220+0000 7f176effd700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.221+0000 7f176f7fe700 1 -- 172.21.15.142:0/59183649 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 msgr2=0x55a186c5e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.221+0000 7f176f7fe700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.221+0000 7f176f7fe700 1 -- 172.21.15.142:0/59183649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 msgr2=0x55a186cb3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.221+0000 7f176f7fe700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 0x55a186cb3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.221+0000 7f176f7fe700 1 -- 172.21.15.142:0/59183649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700ff810 con 0x55a186c52540 2023-09-21T13:05:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.223+0000 7f176f7fe700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186cb39a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1768098870 tx=0x7f1768098310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4d4c5da66c36b76 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.223+0000 7f17567fc700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:09.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.224+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680b82b0 con 0x55a186c52540 2023-09-21T13:05:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.224+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f1768099b80 con 0x55a186c52540 2023-09-21T13:05:09.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.224+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1760010040 con 0x55a186c52540 2023-09-21T13:05:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.224+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1768098940 con 0x55a186c52540 2023-09-21T13:05:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.225+0000 7f17891e2b80 10 client.27542 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.225+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55a1869c0250 con 0x55a186c52540 2023-09-21T13:05:09.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.225+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1760010040 con 0x55a186c52540 2023-09-21T13:05:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.225+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1768098e60 con 0x55a186c52540 2023-09-21T13:05:09.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 10 client.27542 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 10 client.27542 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 20 client.27542 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c4af50 0x55a186c4d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 4 client.27542 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:05:09.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.226+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a186b8fe00 con 0x55a186c4af50 2023-09-21T13:05:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.227+0000 7f176effd700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c4af50 0x55a186c4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:09.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.229+0000 7f17567fc700 10 client.27542 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:09.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.229+0000 7f176effd700 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c4af50 0x55a186c4d340 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f412e14736c081aa server_cookie=4d7295cb85c7c55d in_seq=0 out_seq=0 2023-09-21T13:05:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17567fc700 1 -- 172.21.15.142:0/59183649 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a186b8fe00 con 0x55a186c4af50 2023-09-21T13:05:09.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17567fc700 10 client.27542 handle_command_reply: tid=0 2023-09-21T13:05:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 client.27542 shutdown 2023-09-21T13:05:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 msgr2=0x55a186cb39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186cb39a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f1768098870 tx=0x7f1768098310 comp rx=0 tx=0).stop 2023-09-21T13:05:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 shutdown_connections 2023-09-21T13:05:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a186c4af50 0x55a186c4d340 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a186c52540 0x55a186cb39a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a186c44eb0 0x55a186c5e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 --2- 172.21.15.142:0/59183649 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a186c45870 0x55a186cb3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 >> 172.21.15.142:0/59183649 conn(0x55a186b71fa0 msgr2=0x55a186c69690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.316+0000 7f17567fc700 0 client.27542 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.318+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 shutdown_connections 2023-09-21T13:05:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.318+0000 7f17891e2b80 1 -- 172.21.15.142:0/59183649 wait complete. 2023-09-21T13:05:09.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.318+0000 7f17891e2b80 20 client.27542 trim_cache size 0 max 16384 2023-09-21T13:05:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:05:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:05:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:05:09.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:05:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 msgr2=0x7f175c0a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 0x7f175c0a2d50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17600060b0 tx=0x7f17600083f0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 msgr2=0x7f177019c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 0x7f177019c1d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f176800d720 tx=0x7f176800da30 comp rx=0 tx=0).stop 2023-09-21T13:05:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 shutdown_connections 2023-09-21T13:05:09.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f175c0a0890 0x7f175c0a2d50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f177019bd50 0x7f177019c1d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f17700674f0 0x7f17701971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 --2- 172.21.15.142:0/4198857283 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1770109ea0 0x7f17701976e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.319+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 >> 172.21.15.142:0/4198857283 conn(0x7f1770074b50 msgr2=0x7f177010bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:09.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.320+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 shutdown_connections 2023-09-21T13:05:09.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:09.320+0000 7f17757ff700 1 -- 172.21.15.142:0/4198857283 wait complete. 2023-09-21T13:05:09.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 822091 8.80 MB/sec execute 350 sec latency 66.955 ms 2023-09-21T13:05:10.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:09 smithi156 ceph-mon[134078]: pgmap v276: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2023-09-21T13:05:10.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:09 smithi142 ceph-mon[97663]: pgmap v276: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2023-09-21T13:05:10.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:09 smithi160 ceph-mon[134450]: pgmap v276: 97 pgs: 97 active+clean; 247 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 222 op/s 2023-09-21T13:05:10.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 824002 8.82 MB/sec execute 351 sec latency 20.514 ms 2023-09-21T13:05:11.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 825376 8.81 MB/sec execute 352 sec latency 56.492 ms 2023-09-21T13:05:12.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:11 smithi156 ceph-mon[134078]: pgmap v277: 97 pgs: 97 active+clean; 242 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 364 op/s 2023-09-21T13:05:12.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:11 smithi142 ceph-mon[97663]: pgmap v277: 97 pgs: 97 active+clean; 242 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 364 op/s 2023-09-21T13:05:12.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:11 smithi160 ceph-mon[134450]: pgmap v277: 97 pgs: 97 active+clean; 242 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 364 op/s 2023-09-21T13:05:12.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 827467 8.82 MB/sec execute 353 sec latency 17.571 ms 2023-09-21T13:05:13.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 828836 8.81 MB/sec execute 354 sec latency 19.618 ms 2023-09-21T13:05:14.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:13 smithi156 ceph-mon[134078]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 409 op/s 2023-09-21T13:05:14.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:13 smithi142 ceph-mon[97663]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 409 op/s 2023-09-21T13:05:14.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:13 smithi160 ceph-mon[134450]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 409 op/s 2023-09-21T13:05:14.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 830880 8.82 MB/sec execute 355 sec latency 30.555 ms 2023-09-21T13:05:15.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 832227 8.81 MB/sec execute 356 sec latency 37.067 ms 2023-09-21T13:05:16.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:15 smithi156 ceph-mon[134078]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2023-09-21T13:05:16.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:15 smithi142 ceph-mon[97663]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2023-09-21T13:05:16.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:15 smithi160 ceph-mon[134450]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 351 op/s 2023-09-21T13:05:16.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 834408 8.82 MB/sec execute 357 sec latency 14.926 ms 2023-09-21T13:05:17.485 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:05:17.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 835728 8.82 MB/sec execute 358 sec latency 18.292 ms 2023-09-21T13:05:17.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 -- 172.21.15.142:0/4033537692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe718067f40 msgr2=0x7fe7180683a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 --2- 172.21.15.142:0/4033537692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe718067f40 0x7fe7180683a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe704009990 tx=0x7fe704009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 -- 172.21.15.142:0/4033537692 shutdown_connections 2023-09-21T13:05:17.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 --2- 172.21.15.142:0/4033537692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe7180688e0 0x7fe71810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 --2- 172.21.15.142:0/4033537692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 0x7fe718105f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 --2- 172.21.15.142:0/4033537692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe718067f40 0x7fe7180683a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 -- 172.21.15.142:0/4033537692 >> 172.21.15.142:0/4033537692 conn(0x7fe7180755a0 msgr2=0x7fe7180759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 -- 172.21.15.142:0/4033537692 shutdown_connections 2023-09-21T13:05:17.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.723+0000 7fe71d99d700 1 -- 172.21.15.142:0/4033537692 wait complete. 2023-09-21T13:05:17.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 Processor -- start 2023-09-21T13:05:17.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 -- start start 2023-09-21T13:05:17.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7180688e0 0x7fe718100330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 0x7fe7181a4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe718100b60 con 0x7fe7180688e0 2023-09-21T13:05:17.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7181a52a0 con 0x7fe718067f40 2023-09-21T13:05:17.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.724+0000 7fe71d99d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7181a53e0 con 0x7fe718105ba0 2023-09-21T13:05:17.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49684/0 (socket says 172.21.15.142:49684) 2023-09-21T13:05:17.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 -- 172.21.15.142:0/177499683 learned_addr learned my addr 172.21.15.142:0/177499683 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:17.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe717fff700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7180688e0 0x7fe718100330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71d19c700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 0x7fe7181a4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 -- 172.21.15.142:0/177499683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 msgr2=0x7fe7181a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 0x7fe7181a4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 -- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7180688e0 msgr2=0x7fe718100330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7180688e0 0x7fe718100330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 -- 172.21.15.142:0/177499683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7040095f0 con 0x7fe718067f40 2023-09-21T13:05:17.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.725+0000 7fe71c99b700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d980 tx=0x7fe70c00dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.726+0000 7fe715ffb700 1 -- 172.21.15.142:0/177499683 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c004020 con 0x7fe718067f40 2023-09-21T13:05:17.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.726+0000 7fe715ffb700 1 -- 172.21.15.142:0/177499683 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70c00f690 con 0x7fe718067f40 2023-09-21T13:05:17.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.726+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7181a5640 con 0x7fe718067f40 2023-09-21T13:05:17.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.726+0000 7fe715ffb700 1 -- 172.21.15.142:0/177499683 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c003a60 con 0x7fe718067f40 2023-09-21T13:05:17.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.726+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7181a5b20 con 0x7fe718067f40 2023-09-21T13:05:17.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.730+0000 7fe715ffb700 1 -- 172.21.15.142:0/177499683 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe70c00fb00 con 0x7fe718067f40 2023-09-21T13:05:17.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 Processor -- start 2023-09-21T13:05:17.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 -- start start 2023-09-21T13:05:17.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe715ffb700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 0x7fe7080a2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff90030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff03ca0 con 0x55a4eff95ce0 2023-09-21T13:05:17.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efee7c70 con 0x55a4eff8fbb0 2023-09-21T13:05:17.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe732560b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efee5590 con 0x55a4eff953c0 2023-09-21T13:05:17.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe715ffb700 1 -- 172.21.15.142:0/177499683 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe70c0cbb10 con 0x7fe718067f40 2023-09-21T13:05:17.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.732+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60822/0 (socket says 172.21.15.142:60822) 2023-09-21T13:05:17.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 -- 172.21.15.142:0/3489384980 learned_addr learned my addr 172.21.15.142:0/3489384980 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:17.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71d19c700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff90030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe717fff700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71d19c700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 0x7fe7080a2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 -- 172.21.15.142:0/3489384980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 msgr2=0x55a4eff90030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff90030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 -- 172.21.15.142:0/3489384980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 msgr2=0x55a4eff8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 -- 172.21.15.142:0/3489384980 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4efd0bde0 con 0x55a4eff953c0 2023-09-21T13:05:17.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71d19c700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff90030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:05:17.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0a0b30 tx=0x7fe70c0989d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11cba5dddabee014 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe702ffd700 1 -- 172.21.15.142:0/3489384980 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0764e0 con 0x55a4eff953c0 2023-09-21T13:05:17.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe702ffd700 1 -- 172.21.15.142:0/3489384980 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70c076a80 con 0x55a4eff953c0 2023-09-21T13:05:17.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.733+0000 7fe702ffd700 1 -- 172.21.15.142:0/3489384980 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c098ff0 con 0x55a4eff953c0 2023-09-21T13:05:17.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 -- 172.21.15.142:0/3489384980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 msgr2=0x55a4eff957a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe71d19c700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 0x7fe7080a2d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ec0 tx=0x7fe71000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0a0b30 tx=0x7fe70c0989d0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 -- 172.21.15.142:0/3489384980 shutdown_connections 2023-09-21T13:05:17.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff90030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff953c0 0x55a4eff957a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 --2- 172.21.15.142:0/3489384980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 -- 172.21.15.142:0/3489384980 >> 172.21.15.142:0/3489384980 conn(0x55a4efebc000 msgr2=0x55a4eff8a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 -- 172.21.15.142:0/3489384980 shutdown_connections 2023-09-21T13:05:17.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.734+0000 7fe732560b80 1 -- 172.21.15.142:0/3489384980 wait complete. 2023-09-21T13:05:17.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.735+0000 7fe732560b80 1 -- start start 2023-09-21T13:05:17.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.735+0000 7fe732560b80 1 Processor -- start 2023-09-21T13:05:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff953c0 0x55a4eff99470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 0x55a4eff999b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efee0e80 con 0x55a4eff953c0 2023-09-21T13:05:17.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe7d740 con 0x55a4eff8fbb0 2023-09-21T13:05:17.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efe7d3e0 con 0x55a4eff95ce0 2023-09-21T13:05:17.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe732560b80 10 client.0 _ll_register_callbacks cb 0x55a4efdc7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:17.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49714/0 (socket says 172.21.15.142:49714) 2023-09-21T13:05:17.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe71c99b700 1 -- 172.21.15.142:0/433099655 learned_addr learned my addr 172.21.15.142:0/433099655 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:17.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.736+0000 7fe71d19c700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 0x55a4eff999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 -- 172.21.15.142:0/433099655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 msgr2=0x55a4eff999b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 0x55a4eff999b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 -- 172.21.15.142:0/433099655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff953c0 msgr2=0x55a4eff99470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff953c0 0x55a4eff99470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 -- 172.21.15.142:0/433099655 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7181a5b20 con 0x55a4eff8fbb0 2023-09-21T13:05:17.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71d19c700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 0x55a4eff999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:05:17.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe71c99b700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0c9890 tx=0x7fe70c079050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc0090672212890c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe6f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:17.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c079690 con 0x55a4eff8fbb0 2023-09-21T13:05:17.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe70c0a1060 con 0x55a4eff8fbb0 2023-09-21T13:05:17.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4efe51bb0 con 0x55a4eff8fbb0 2023-09-21T13:05:17.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe70c098ff0 con 0x55a4eff8fbb0 2023-09-21T13:05:17.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe732560b80 10 client.27554 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.737+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55a4efcf4c60 con 0x55a4eff8fbb0 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe70c0b5080 con 0x55a4eff8fbb0 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe70c0992e0 con 0x55a4eff8fbb0 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 10 client.27554 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 10 client.27554 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:17.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 20 client.27554 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:17.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4effa91d0 0x55a4effab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 4 client.27554 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:17.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4eff5e020 con 0x55a4effa91d0 2023-09-21T13:05:17.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.738+0000 7fe717fff700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4effa91d0 0x55a4effab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.739+0000 7fe6f7fff700 10 client.27554 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:17.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.739+0000 7fe717fff700 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4effa91d0 0x55a4effab5c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59b25a1c31ac0458 server_cookie=e8de6d4f223ec6d6 in_seq=0 out_seq=0 2023-09-21T13:05:17.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.739+0000 7fe6f7fff700 1 -- 172.21.15.142:0/433099655 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4eff5e020 con 0x55a4effa91d0 2023-09-21T13:05:17.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.739+0000 7fe6f7fff700 10 client.27554 handle_command_reply: tid=0 2023-09-21T13:05:17.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 client.27554 shutdown 2023-09-21T13:05:17.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 msgr2=0x55a4eff98f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0c9890 tx=0x7fe70c079050 comp rx=0 tx=0).stop 2023-09-21T13:05:17.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 shutdown_connections 2023-09-21T13:05:17.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4effa91d0 0x55a4effab5c0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff95ce0 0x55a4eff999b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff8fbb0 0x55a4eff98f30 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe6f7fff700 0 client.27554 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:17.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 --2- 172.21.15.142:0/433099655 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff953c0 0x55a4eff99470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 >> 172.21.15.142:0/433099655 conn(0x55a4efebc000 msgr2=0x55a4eff8a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 shutdown_connections 2023-09-21T13:05:17.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 1 -- 172.21.15.142:0/433099655 wait complete. 2023-09-21T13:05:17.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.740+0000 7fe732560b80 20 client.27554 trim_cache size 0 max 16384 2023-09-21T13:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.763+0000 7fe732560b80 1 Processor -- start 2023-09-21T13:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 -- start start 2023-09-21T13:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4eff8f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4effa06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efd61920 con 0x55a4eff95ce0 2023-09-21T13:05:17.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4effa0c20 con 0x55a4eff953c0 2023-09-21T13:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe732560b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff97490 con 0x55a4eff8fbb0 2023-09-21T13:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe71d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe71c99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4eff8f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe71d19c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56526/0 (socket says 172.21.15.142:56526) 2023-09-21T13:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe717fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4effa06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.764+0000 7fe71d19c700 1 -- 172.21.15.142:0/2200640110 learned_addr learned my addr 172.21.15.142:0/2200640110 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 -- 172.21.15.142:0/2200640110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 msgr2=0x55a4eff8f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4eff8f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 -- 172.21.15.142:0/2200640110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 msgr2=0x55a4effa06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4effa06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 -- 172.21.15.142:0/2200640110 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4effb01a0 con 0x55a4eff95ce0 2023-09-21T13:05:17.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe717fff700 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4effa06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:17.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe71d19c700 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe710009550 tx=0x7fe710010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb52e48a10f80c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe7037fe700 1 -- 172.21.15.142:0/2200640110 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71000e040 con 0x55a4eff95ce0 2023-09-21T13:05:17.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe7037fe700 1 -- 172.21.15.142:0/2200640110 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe71001f070 con 0x55a4eff95ce0 2023-09-21T13:05:17.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.765+0000 7fe7037fe700 1 -- 172.21.15.142:0/2200640110 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7100256d0 con 0x55a4eff95ce0 2023-09-21T13:05:17.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 -- 172.21.15.142:0/2200640110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 msgr2=0x55a4eff997b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe710009550 tx=0x7fe710010000 comp rx=0 tx=0).stop 2023-09-21T13:05:17.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 -- 172.21.15.142:0/2200640110 shutdown_connections 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff997b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4eff8f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 --2- 172.21.15.142:0/2200640110 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4effa06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 -- 172.21.15.142:0/2200640110 >> 172.21.15.142:0/2200640110 conn(0x55a4efebc000 msgr2=0x55a4eff931b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.766+0000 7fe732560b80 1 -- 172.21.15.142:0/2200640110 shutdown_connections 2023-09-21T13:05:17.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.767+0000 7fe732560b80 1 -- 172.21.15.142:0/2200640110 wait complete. 2023-09-21T13:05:17.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.767+0000 7fe732560b80 1 -- start start 2023-09-21T13:05:17.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.767+0000 7fe732560b80 1 Processor -- start 2023-09-21T13:05:17.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4effa04f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff9ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff9f410 con 0x55a4eff95ce0 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4eff9f580 con 0x55a4eff953c0 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4efffcf90 con 0x55a4eff8fbb0 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe732560b80 10 client.0 _ll_register_callbacks cb 0x55a4efdc7a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe717fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe717fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49724/0 (socket says 172.21.15.142:49724) 2023-09-21T13:05:17.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe717fff700 1 -- 172.21.15.142:0/3187662174 learned_addr learned my addr 172.21.15.142:0/3187662174 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:17.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe71d19c700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff9ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4effa04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.768+0000 7fe717fff700 1 -- 172.21.15.142:0/3187662174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 msgr2=0x55a4effa04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe717fff700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4effa04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe717fff700 1 -- 172.21.15.142:0/3187662174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 msgr2=0x55a4eff9ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:17.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe717fff700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff9ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe717fff700 1 -- 172.21.15.142:0/3187662174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe71810e330 con 0x55a4eff953c0 2023-09-21T13:05:17.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4effa04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:05:17.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe717fff700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe70400b8a0 tx=0x7fe704026600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf1aedb80570f20d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:17.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe6f7fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:17.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70401d040 con 0x55a4eff953c0 2023-09-21T13:05:17.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe70c076a80 con 0x55a4eff953c0 2023-09-21T13:05:17.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.769+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe70400b970 con 0x55a4eff953c0 2023-09-21T13:05:17.776 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe70400bb30 con 0x55a4eff953c0 2023-09-21T13:05:17.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 10 client.27560 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:17.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7fe710019400 con 0x55a4eff953c0 2023-09-21T13:05:17.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe704036030 con 0x55a4eff953c0 2023-09-21T13:05:17.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe70402f430 con 0x55a4eff953c0 2023-09-21T13:05:17.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 10 client.27560 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 10 client.27560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 20 client.27560 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4efffe720 0x55a4f0000b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 4 client.27560 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a4efed9e60 con 0x55a4efffe720 2023-09-21T13:05:17.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.770+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4efffe720 0x55a4f0000b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:17.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe6f7fff700 10 client.27560 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:17.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe71c99b700 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4efffe720 0x55a4f0000b40 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88376edabdc231ed server_cookie=dd5bed1086e56bd1 in_seq=0 out_seq=0 2023-09-21T13:05:17.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe6f7fff700 1 -- 172.21.15.142:0/3187662174 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a4efed9e60 con 0x55a4efffe720 2023-09-21T13:05:17.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe6f7fff700 10 client.27560 handle_command_reply: tid=0 2023-09-21T13:05:17.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 client.27560 shutdown 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 msgr2=0x55a4eff9e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe70400b8a0 tx=0x7fe704026600 comp rx=0 tx=0).stop 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 shutdown_connections 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a4efffe720 0x55a4f0000b40 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a4eff95ce0 0x55a4eff9ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a4eff8fbb0 0x55a4effa04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe6f7fff700 0 client.27560 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:17.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 --2- 172.21.15.142:0/3187662174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a4eff953c0 0x55a4eff9e7e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.771+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 >> 172.21.15.142:0/3187662174 conn(0x55a4efebc000 msgr2=0x55a4eff996f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.772+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 shutdown_connections 2023-09-21T13:05:17.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.772+0000 7fe732560b80 1 -- 172.21.15.142:0/3187662174 wait complete. 2023-09-21T13:05:17.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.772+0000 7fe732560b80 20 client.27560 trim_cache size 0 max 16384 2023-09-21T13:05:17.782 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:05:17.782 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:05:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:05:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:05:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:05:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:05:17.783 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:05:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:05:17.784 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:05:17.784 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:05:17.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.772+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 msgr2=0x7fe7080a2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.772+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 0x7fe7080a2d10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe710009ec0 tx=0x7fe71000b040 comp rx=0 tx=0).stop 2023-09-21T13:05:17.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 msgr2=0x7fe7180ffdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:17.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d980 tx=0x7fe70c00dc90 comp rx=0 tx=0).stop 2023-09-21T13:05:17.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 shutdown_connections 2023-09-21T13:05:17.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe7080a0850 0x7fe7080a2d10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe718105ba0 0x7fe7181a4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.786 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe718067f40 0x7fe7180ffdf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 --2- 172.21.15.142:0/177499683 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe7180688e0 0x7fe718100330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:17.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 >> 172.21.15.142:0/177499683 conn(0x7fe7180755a0 msgr2=0x7fe7180fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:17.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 shutdown_connections 2023-09-21T13:05:17.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:17.773+0000 7fe71d99d700 1 -- 172.21.15.142:0/177499683 wait complete. 2023-09-21T13:05:17.790 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:05:17.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:17 smithi142 ceph-mon[97663]: pgmap v280: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 432 op/s 2023-09-21T13:05:18.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:17 smithi156 ceph-mon[134078]: pgmap v280: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 432 op/s 2023-09-21T13:05:18.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:17 smithi160 ceph-mon[134450]: pgmap v280: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.9 MiB/s wr, 432 op/s 2023-09-21T13:05:18.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 837965 8.83 MB/sec execute 359 sec latency 18.861 ms 2023-09-21T13:05:19.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 839159 8.81 MB/sec execute 360 sec latency 22.964 ms 2023-09-21T13:05:20.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:19 smithi156 ceph-mon[134078]: pgmap v281: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 326 op/s 2023-09-21T13:05:20.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:19 smithi142 ceph-mon[97663]: pgmap v281: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 326 op/s 2023-09-21T13:05:20.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:19 smithi160 ceph-mon[134450]: pgmap v281: 97 pgs: 97 active+clean; 248 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.8 MiB/s wr, 326 op/s 2023-09-21T13:05:20.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 841262 8.82 MB/sec execute 361 sec latency 18.924 ms 2023-09-21T13:05:21.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 842407 8.82 MB/sec execute 362 sec latency 15.999 ms 2023-09-21T13:05:22.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:21 smithi156 ceph-mon[134078]: pgmap v282: 97 pgs: 97 active+clean; 250 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2023-09-21T13:05:22.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:21 smithi142 ceph-mon[97663]: pgmap v282: 97 pgs: 97 active+clean; 250 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2023-09-21T13:05:22.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:21 smithi160 ceph-mon[134450]: pgmap v282: 97 pgs: 97 active+clean; 250 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.0 MiB/s wr, 346 op/s 2023-09-21T13:05:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 -- 172.21.15.142:0/4190451829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c106130 msgr2=0x7f6e7c10dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 --2- 172.21.15.142:0/4190451829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c106130 0x7f6e7c10dcb0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098f0 tx=0x7f6e74009c00 comp rx=0 tx=0).stop 2023-09-21T13:05:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 -- 172.21.15.142:0/4190451829 shutdown_connections 2023-09-21T13:05:22.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 --2- 172.21.15.142:0/4190451829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c106130 0x7f6e7c10dcb0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 --2- 172.21.15.142:0/4190451829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c1013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 --2- 172.21.15.142:0/4190451829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c1019c0 0x7f6e7c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 -- 172.21.15.142:0/4190451829 >> 172.21.15.142:0/4190451829 conn(0x7f6e7c0fc8b0 msgr2=0x7f6e7c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 -- 172.21.15.142:0/4190451829 shutdown_connections 2023-09-21T13:05:22.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.506+0000 7f6e811ff700 1 -- 172.21.15.142:0/4190451829 wait complete. 2023-09-21T13:05:22.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.507+0000 7f6e811ff700 1 Processor -- start 2023-09-21T13:05:22.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.507+0000 7f6e811ff700 1 -- start start 2023-09-21T13:05:22.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 0x7f6e7c197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c19baa0 0x7f6e7c19bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19c520 con 0x7f6e7c19baa0 2023-09-21T13:05:22.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19c690 con 0x7f6e7c101010 2023-09-21T13:05:22.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e811ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7c19c850 con 0x7f6e7c106130 2023-09-21T13:05:22.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7b59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c19baa0 0x7f6e7c19bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 0x7f6e7c197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49746/0 (socket says 172.21.15.142:49746) 2023-09-21T13:05:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/2946111332 learned_addr learned my addr 172.21.15.142:0/2946111332 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 0x7f6e7c197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60880/0 (socket says 172.21.15.142:60880) 2023-09-21T13:05:22.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/2946111332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 msgr2=0x7f6e7c197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.508+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 0x7f6e7c197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c19baa0 msgr2=0x7f6e7c19bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c19baa0 0x7f6e7c19bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/2946111332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74009520 con 0x7f6e7c101010 2023-09-21T13:05:22.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c0c0 tx=0x7f6e6c00c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e63fff700 1 -- 172.21.15.142:0/2946111332 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c018070 con 0x7f6e7c101010 2023-09-21T13:05:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e63fff700 1 -- 172.21.15.142:0/2946111332 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e6c00f040 con 0x7f6e7c101010 2023-09-21T13:05:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e63fff700 1 -- 172.21.15.142:0/2946111332 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00e020 con 0x7f6e7c101010 2023-09-21T13:05:22.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e7c1a3d50 con 0x7f6e7c101010 2023-09-21T13:05:22.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.509+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c1a4180 con 0x7f6e7c101010 2023-09-21T13:05:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.514+0000 7f6e63fff700 1 -- 172.21.15.142:0/2946111332 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f6e6c00ca50 con 0x7f6e7c101010 2023-09-21T13:05:22.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e63fff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 0x7f6e640a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e94a4cb80 1 Processor -- start 2023-09-21T13:05:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e63fff700 1 -- 172.21.15.142:0/2946111332 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6e6c0cbc80 con 0x7f6e7c101010 2023-09-21T13:05:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e94a4cb80 1 -- start start 2023-09-21T13:05:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 0x7f6e640a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.516+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1ee9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 0x5568a1eee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1e5dc40 con 0x5568a1ee90a0 2023-09-21T13:05:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1e41c10 con 0x5568a1ee99c0 2023-09-21T13:05:22.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1e3f530 con 0x5568a1eede50 2023-09-21T13:05:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49750/0 (socket says 172.21.15.142:49750) 2023-09-21T13:05:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3313810469 learned_addr learned my addr 172.21.15.142:0/3313810469 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:22.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 0x7f6e640a2cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c198710 tx=0x7f6e70009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1ee9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 0x5568a1eee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3313810469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 msgr2=0x5568a1eee2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 0x5568a1eee2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3313810469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 msgr2=0x5568a1ee9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1ee9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3313810469 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a1c65d80 con 0x5568a1ee99c0 2023-09-21T13:05:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 0x5568a1eee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:05:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.517+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011eb0 tx=0x7f6e7001c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e2fcbdf8f25a3e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.518+0000 7f6e617fa700 1 -- 172.21.15.142:0/3313810469 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70004830 con 0x5568a1ee99c0 2023-09-21T13:05:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.518+0000 7f6e617fa700 1 -- 172.21.15.142:0/3313810469 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e70004e50 con 0x5568a1ee99c0 2023-09-21T13:05:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.518+0000 7f6e617fa700 1 -- 172.21.15.142:0/3313810469 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000f700 con 0x5568a1ee99c0 2023-09-21T13:05:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.518+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3313810469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 msgr2=0x5568a1eed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.518+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011eb0 tx=0x7f6e7001c000 comp rx=0 tx=0).stop 2023-09-21T13:05:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.519+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3313810469 shutdown_connections 2023-09-21T13:05:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.519+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1ee9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.519+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1eede50 0x5568a1eee2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.519+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3313810469 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1eed910 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.519+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3313810469 >> 172.21.15.142:0/3313810469 conn(0x5568a1e15fa0 msgr2=0x5568a1ee40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.520+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3313810469 shutdown_connections 2023-09-21T13:05:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.520+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3313810469 wait complete. 2023-09-21T13:05:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.521+0000 7f6e94a4cb80 1 -- start start 2023-09-21T13:05:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 Processor -- start 2023-09-21T13:05:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1ef5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1ef2f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1e3ae20 con 0x5568a1eede50 2023-09-21T13:05:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1dd76e0 con 0x5568a1ee99c0 2023-09-21T13:05:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.522+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1dd7380 con 0x5568a1ee90a0 2023-09-21T13:05:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e94a4cb80 10 client.0 _ll_register_callbacks cb 0x5568a1d21a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49756/0 (socket says 172.21.15.142:49756) 2023-09-21T13:05:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3314736924 learned_addr learned my addr 172.21.15.142:0/3314736924 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1ef2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1ef5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3314736924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 msgr2=0x5568a1ef5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1ef5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3314736924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 msgr2=0x5568a1ef2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1ef2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3314736924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e70011b60 con 0x5568a1ee99c0 2023-09-21T13:05:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6e70014040 tx=0x7f6e700051d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1862bbd592a8e6e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.523+0000 7f6e5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7002b070 con 0x5568a1ee99c0 2023-09-21T13:05:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6e70005430 con 0x5568a1ee99c0 2023-09-21T13:05:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568a1dabb50 con 0x5568a1ee99c0 2023-09-21T13:05:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e70003680 con 0x5568a1ee99c0 2023-09-21T13:05:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 10 client.27572 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5568a1c4ec00 con 0x5568a1ee99c0 2023-09-21T13:05:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568a1dabb50 con 0x5568a1ee99c0 2023-09-21T13:05:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e7000fa50 con 0x5568a1ee99c0 2023-09-21T13:05:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 10 client.27572 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 10 client.27572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.524+0000 7f6e94a4cb80 20 client.27572 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f07170 0x5568a1f09590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e94a4cb80 4 client.27572 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568a1eb7fc0 con 0x5568a1f07170 2023-09-21T13:05:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f07170 0x5568a1f09590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f07170 0x5568a1f09590 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85a097714decee46 server_cookie=97d77f5daa7a5278 in_seq=0 out_seq=0 2023-09-21T13:05:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.525+0000 7f6e5eff5700 10 client.27572 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.526+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3314736924 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568a1eb7fc0 con 0x5568a1f07170 2023-09-21T13:05:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.526+0000 7f6e5eff5700 10 client.27572 handle_command_reply: tid=0 2023-09-21T13:05:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.526+0000 7f6e94a4cb80 1 client.27572 shutdown 2023-09-21T13:05:22.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 msgr2=0x5568a1ef2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6e70014040 tx=0x7f6e700051d0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 shutdown_connections 2023-09-21T13:05:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f07170 0x5568a1f09590 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1ef2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1ef5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3314736924 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1ef2870 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 >> 172.21.15.142:0/3314736924 conn(0x5568a1e15fa0 msgr2=0x5568a1ee3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e5eff5700 0 client.27572 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:22.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 shutdown_connections 2023-09-21T13:05:22.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.527+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3314736924 wait complete. 2023-09-21T13:05:22.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.528+0000 7f6e94a4cb80 20 client.27572 trim_cache size 0 max 16384 2023-09-21T13:05:22.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.546+0000 7f6e94a4cb80 1 Processor -- start 2023-09-21T13:05:22.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.546+0000 7f6e94a4cb80 1 -- start start 2023-09-21T13:05:22.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.546+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.546+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1efa030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.546+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1eef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1cbb8c0 con 0x5568a1eede50 2023-09-21T13:05:22.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1eea160 con 0x5568a1ee99c0 2023-09-21T13:05:22.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1edbc50 con 0x5568a1ee90a0 2023-09-21T13:05:22.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1efa030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1efa030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:49768/0 (socket says 172.21.15.142:49768) 2023-09-21T13:05:22.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60910/0 (socket says 172.21.15.142:60910) 2023-09-21T13:05:22.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7a59c700 1 -- 172.21.15.142:0/4020774139 learned_addr learned my addr 172.21.15.142:0/4020774139 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:22.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1eef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/4020774139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 msgr2=0x5568a1efa030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1efa030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/4020774139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 msgr2=0x5568a1eef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1eef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/4020774139 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568a1c8c1f0 con 0x5568a1ee90a0 2023-09-21T13:05:22.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.547+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1eef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:05:22.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.548+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0c9400 tx=0x7f6e6c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6cd10e5a713754 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.548+0000 7f6e61ffb700 1 -- 172.21.15.142:0/4020774139 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c09cf90 con 0x5568a1ee90a0 2023-09-21T13:05:22.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.548+0000 7f6e61ffb700 1 -- 172.21.15.142:0/4020774139 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e6c0a11d0 con 0x5568a1ee90a0 2023-09-21T13:05:22.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.548+0000 7f6e61ffb700 1 -- 172.21.15.142:0/4020774139 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00ce20 con 0x5568a1ee90a0 2023-09-21T13:05:22.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/4020774139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 msgr2=0x5568a1eeb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c0c9400 tx=0x7f6e6c00c8d0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/4020774139 shutdown_connections 2023-09-21T13:05:22.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1eede50 0x5568a1eef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee90a0 0x5568a1eeb740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/4020774139 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1ee99c0 0x5568a1efa030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/4020774139 >> 172.21.15.142:0/4020774139 conn(0x5568a1e15fa0 msgr2=0x5568a1efe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/4020774139 shutdown_connections 2023-09-21T13:05:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.549+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/4020774139 wait complete. 2023-09-21T13:05:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.550+0000 7f6e94a4cb80 1 -- start start 2023-09-21T13:05:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.550+0000 7f6e94a4cb80 1 Processor -- start 2023-09-21T13:05:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 0x5568a1ef4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 0x5568a1ef46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1ef4dd0 con 0x5568a1ee90a0 2023-09-21T13:05:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1ef4f40 con 0x5568a1eede50 2023-09-21T13:05:22.556 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568a1f5af80 con 0x5568a1ee99c0 2023-09-21T13:05:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e94a4cb80 10 client.0 _ll_register_callbacks cb 0x5568a1d21a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e7ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56586/0 (socket says 172.21.15.142:56586) 2023-09-21T13:05:22.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e7ad9d700 1 -- 172.21.15.142:0/3662079059 learned_addr learned my addr 172.21.15.142:0/3662079059 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 0x5568a1ef4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.551+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 0x5568a1ef46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 msgr2=0x5568a1ef46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 0x5568a1ef46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3662079059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 msgr2=0x5568a1efa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 -- 172.21.15.142:0/3662079059 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7c1a4180 con 0x5568a1ee99c0 2023-09-21T13:05:22.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7b59e700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 0x5568a1ef46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e7a59c700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 0x5568a1ef4180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5568a1ef3a60 tx=0x7f6e70026d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fef18e014d97b66 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:22.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e5eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:05:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7002b070 con 0x5568a1ee99c0 2023-09-21T13:05:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f6e70005ce0 con 0x5568a1ee99c0 2023-09-21T13:05:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e70004e50 con 0x5568a1ee99c0 2023-09-21T13:05:22.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e70026e50 con 0x5568a1ee99c0 2023-09-21T13:05:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e94a4cb80 10 client.27532 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.552+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x5568a1c64250 con 0x5568a1ee99c0 2023-09-21T13:05:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e70004e50 con 0x5568a1ee99c0 2023-09-21T13:05:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e7000fa40 con 0x5568a1ee99c0 2023-09-21T13:05:22.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 10 client.27532 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 10 client.27532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 20 client.27532 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f5c330 0x5568a1f5e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 4 client.27532 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:05:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5568a1e33e00 con 0x5568a1f5c330 2023-09-21T13:05:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.553+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f5c330 0x5568a1f5e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.554+0000 7f6e5eff5700 10 client.27532 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.554+0000 7f6e7ad9d700 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f5c330 0x5568a1f5e750 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=551b081e6ef95236 server_cookie=d0ae7e4c1d14cc83 in_seq=0 out_seq=0 2023-09-21T13:05:22.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.628+0000 7f6e5eff5700 1 -- 172.21.15.142:0/3662079059 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5568a1e33e00 con 0x5568a1f5c330 2023-09-21T13:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.628+0000 7f6e5eff5700 10 client.27532 handle_command_reply: tid=0 2023-09-21T13:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.628+0000 7f6e94a4cb80 1 client.27532 shutdown 2023-09-21T13:05:22.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 msgr2=0x5568a1ef4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 0x5568a1ef4180 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x5568a1ef3a60 tx=0x7f6e70026d60 comp rx=0 tx=0).stop 2023-09-21T13:05:22.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 shutdown_connections 2023-09-21T13:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5568a1f5c330 0x5568a1f5e750 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5568a1ee90a0 0x5568a1efa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5568a1eede50 0x5568a1ef46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 --2- 172.21.15.142:0/3662079059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5568a1ee99c0 0x5568a1ef4180 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 >> 172.21.15.142:0/3662079059 conn(0x5568a1e15fa0 msgr2=0x5568a1eecea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e5eff5700 0 client.27532 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 shutdown_connections 2023-09-21T13:05:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 1 -- 172.21.15.142:0/3662079059 wait complete. 2023-09-21T13:05:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.629+0000 7f6e94a4cb80 20 client.27532 trim_cache size 0 max 16384 2023-09-21T13:05:22.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:05:22.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 msgr2=0x7f6e640a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 0x7f6e640a2cf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c198710 tx=0x7f6e70009260 comp rx=0 tx=0).stop 2023-09-21T13:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 msgr2=0x7f6e7c196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:22.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c0c0 tx=0x7f6e6c00c3d0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 shutdown_connections 2023-09-21T13:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6e640a0830 0x7f6e640a2cf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6e7c19baa0 0x7f6e7c19bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6e7c101010 0x7f6e7c196ef0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 --2- 172.21.15.142:0/2946111332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6e7c106130 0x7f6e7c197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.630+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 >> 172.21.15.142:0/2946111332 conn(0x7f6e7c0fc8b0 msgr2=0x7f6e7c0fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.631+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 shutdown_connections 2023-09-21T13:05:22.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:22.631+0000 7f6e811ff700 1 -- 172.21.15.142:0/2946111332 wait complete. 2023-09-21T13:05:22.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 844366 8.82 MB/sec execute 363 sec latency 40.344 ms 2023-09-21T13:05:23.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 845599 8.82 MB/sec execute 364 sec latency 15.363 ms 2023-09-21T13:05:24.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:23 smithi156 ceph-mon[134078]: pgmap v283: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-21T13:05:24.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:23 smithi142 ceph-mon[97663]: pgmap v283: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-21T13:05:24.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:23 smithi160 ceph-mon[134450]: pgmap v283: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-21T13:05:24.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 847777 8.82 MB/sec execute 365 sec latency 14.807 ms 2023-09-21T13:05:25.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 849024 8.82 MB/sec execute 366 sec latency 27.623 ms 2023-09-21T13:05:26.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:25 smithi156 ceph-mon[134078]: pgmap v284: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-09-21T13:05:26.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:25 smithi142 ceph-mon[97663]: pgmap v284: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-09-21T13:05:26.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:25 smithi160 ceph-mon[134450]: pgmap v284: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 160 op/s 2023-09-21T13:05:26.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 850899 8.82 MB/sec execute 367 sec latency 63.059 ms 2023-09-21T13:05:27.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 852478 8.83 MB/sec execute 368 sec latency 17.612 ms 2023-09-21T13:05:28.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:27 smithi156 ceph-mon[134078]: pgmap v285: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-21T13:05:28.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:27 smithi142 ceph-mon[97663]: pgmap v285: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-21T13:05:28.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:27 smithi160 ceph-mon[134450]: pgmap v285: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-21T13:05:28.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 853972 8.82 MB/sec execute 369 sec latency 17.157 ms 2023-09-21T13:05:29.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 855909 8.83 MB/sec execute 370 sec latency 14.186 ms 2023-09-21T13:05:30.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:29 smithi156 ceph-mon[134078]: pgmap v286: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2023-09-21T13:05:30.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:29 smithi142 ceph-mon[97663]: pgmap v286: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2023-09-21T13:05:30.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:29 smithi160 ceph-mon[134450]: pgmap v286: 97 pgs: 97 active+clean; 252 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 189 op/s 2023-09-21T13:05:30.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 857262 8.82 MB/sec execute 371 sec latency 17.682 ms 2023-09-21T13:05:31.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 859181 8.83 MB/sec execute 372 sec latency 41.025 ms 2023-09-21T13:05:32.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:31 smithi156 ceph-mon[134078]: pgmap v287: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-21T13:05:32.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:31 smithi142 ceph-mon[97663]: pgmap v287: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-21T13:05:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:31 smithi160 ceph-mon[134450]: pgmap v287: 97 pgs: 97 active+clean; 256 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-21T13:05:32.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 860454 8.82 MB/sec execute 373 sec latency 11.053 ms 2023-09-21T13:05:33.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:32 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:05:33.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:32 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:05:33.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:32 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:05:33.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 862504 8.82 MB/sec execute 374 sec latency 70.408 ms 2023-09-21T13:05:34.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:33 smithi156 ceph-mon[134078]: pgmap v288: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 248 op/s 2023-09-21T13:05:34.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:33 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:05:34.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:33 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:05:34.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:33 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:05:34.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:33 smithi142 ceph-mon[97663]: pgmap v288: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 248 op/s 2023-09-21T13:05:34.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:33 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:05:34.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:33 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:05:34.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:33 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:05:34.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:33 smithi160 ceph-mon[134450]: pgmap v288: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 248 op/s 2023-09-21T13:05:34.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:33 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:05:34.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:33 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:05:34.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:33 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:05:34.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 863924 8.82 MB/sec execute 375 sec latency 11.562 ms 2023-09-21T13:05:35.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 866307 8.84 MB/sec execute 376 sec latency 17.922 ms 2023-09-21T13:05:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.791+0000 7f8dcadff700 1 -- 172.21.15.142:0/3620063918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4103be0 msgr2=0x7f8dc4107c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.791+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3620063918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4103be0 0x7f8dc4107c20 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f8db0009990 tx=0x7f8db0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 -- 172.21.15.142:0/3620063918 shutdown_connections 2023-09-21T13:05:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3620063918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc4103230 0x7f8dc4103610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3620063918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4108350 0x7f8dc410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3620063918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4103be0 0x7f8dc4107c20 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 -- 172.21.15.142:0/3620063918 >> 172.21.15.142:0/3620063918 conn(0x7f8dc40fea90 msgr2=0x7f8dc4100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 -- 172.21.15.142:0/3620063918 shutdown_connections 2023-09-21T13:05:35.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.792+0000 7f8dcadff700 1 -- 172.21.15.142:0/3620063918 wait complete. 2023-09-21T13:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 Processor -- start 2023-09-21T13:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 -- start start 2023-09-21T13:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 0x7f8dc4199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc419dc80 0x7f8dc419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc419e700 con 0x7f8dc419dc80 2023-09-21T13:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc419e870 con 0x7f8dc4108350 2023-09-21T13:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.793+0000 7f8dcadff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc419ea30 con 0x7f8dc4103230 2023-09-21T13:05:35.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 0x7f8dc4199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 0x7f8dc4199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37658/0 (socket says 172.21.15.142:37658) 2023-09-21T13:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc3fff700 1 -- 172.21.15.142:0/3421741209 learned_addr learned my addr 172.21.15.142:0/3421741209 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49208/0 (socket says 172.21.15.142:49208) 2023-09-21T13:05:35.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc939c700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc419dc80 0x7f8dc419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3421741209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 msgr2=0x7f8dc4199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 0x7f8dc4199610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc419dc80 msgr2=0x7f8dc419e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc419dc80 0x7f8dc419e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3421741209 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db00095f0 con 0x7f8dc4103230 2023-09-21T13:05:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.794+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e9f0 tx=0x7f8db800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.795+0000 7f8dc1ffb700 1 -- 172.21.15.142:0/3421741209 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db800c9c0 con 0x7f8dc4103230 2023-09-21T13:05:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.795+0000 7f8dc1ffb700 1 -- 172.21.15.142:0/3421741209 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8db8010430 con 0x7f8dc4103230 2023-09-21T13:05:35.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.795+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc41a5f90 con 0x7f8dc4103230 2023-09-21T13:05:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.795+0000 7f8dc1ffb700 1 -- 172.21.15.142:0/3421741209 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8018680 con 0x7f8dc4103230 2023-09-21T13:05:35.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.795+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc41a63c0 con 0x7f8dc4103230 2023-09-21T13:05:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.800+0000 7f8dc1ffb700 1 -- 172.21.15.142:0/3421741209 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8db8010860 con 0x7f8dc4103230 2023-09-21T13:05:35.800 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.801+0000 7f8dc1ffb700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 0x7f8db40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.801+0000 7f8dc1ffb700 1 -- 172.21.15.142:0/3421741209 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8db8014070 con 0x7f8dc4103230 2023-09-21T13:05:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.801+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 0x7f8db40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 Processor -- start 2023-09-21T13:05:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 -- start start 2023-09-21T13:05:35.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 0x7f8db40a2c70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8dc419a8f0 tx=0x7f8db0005fb0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 0x55cebfc15910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfb85c40 con 0x55cebfc119c0 2023-09-21T13:05:35.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfb69c10 con 0x55cebfc15e50 2023-09-21T13:05:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfb67530 con 0x55cebfc110a0 2023-09-21T13:05:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc939c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc939c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37662/0 (socket says 172.21.15.142:37662) 2023-09-21T13:05:35.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49222/0 (socket says 172.21.15.142:49222) 2023-09-21T13:05:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.802+0000 7f8dc939c700 1 -- 172.21.15.142:0/446919918 learned_addr learned my addr 172.21.15.142:0/446919918 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 0x55cebfc15910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 -- 172.21.15.142:0/446919918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 msgr2=0x55cebfc11480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 -- 172.21.15.142:0/446919918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 msgr2=0x55cebfc15910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 0x55cebfc15910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 -- 172.21.15.142:0/446919918 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cebf98dd80 con 0x55cebfc15e50 2023-09-21T13:05:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:35.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 0x55cebfc15910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:05:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8dc939c700 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc011680 tx=0x7f8dbc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d785f8a3dafedd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8daeffd700 1 -- 172.21.15.142:0/446919918 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc00e040 con 0x55cebfc15e50 2023-09-21T13:05:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8daeffd700 1 -- 172.21.15.142:0/446919918 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dbc00f040 con 0x55cebfc15e50 2023-09-21T13:05:35.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.803+0000 7f8daeffd700 1 -- 172.21.15.142:0/446919918 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dbc004860 con 0x55cebfc15e50 2023-09-21T13:05:35.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 -- 172.21.15.142:0/446919918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 msgr2=0x55cebfc162b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc011680 tx=0x7f8dbc009920 comp rx=0 tx=0).stop 2023-09-21T13:05:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 -- 172.21.15.142:0/446919918 shutdown_connections 2023-09-21T13:05:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc162b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc11480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/446919918 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc119c0 0x55cebfc15910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 -- 172.21.15.142:0/446919918 >> 172.21.15.142:0/446919918 conn(0x55cebfb3dfa0 msgr2=0x55cebfc0c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 -- 172.21.15.142:0/446919918 shutdown_connections 2023-09-21T13:05:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.804+0000 7f8dde75cb80 1 -- 172.21.15.142:0/446919918 wait complete. 2023-09-21T13:05:35.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 -- start start 2023-09-21T13:05:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 Processor -- start 2023-09-21T13:05:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfb62e20 con 0x55cebfc15e50 2023-09-21T13:05:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfaff6e0 con 0x55cebfc110a0 2023-09-21T13:05:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfaff380 con 0x55cebfc119c0 2023-09-21T13:05:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dde75cb80 10 client.0 _ll_register_callbacks cb 0x55cebfa49a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49234/0 (socket says 172.21.15.142:49234) 2023-09-21T13:05:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37676/0 (socket says 172.21.15.142:37676) 2023-09-21T13:05:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc3fff700 1 -- 172.21.15.142:0/3893170197 learned_addr learned my addr 172.21.15.142:0/3893170197 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc939c700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3893170197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 msgr2=0x55cebfc1a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3893170197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 msgr2=0x55cebfc1ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.806+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/3893170197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc41a63c0 con 0x55cebfc110a0 2023-09-21T13:05:35.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8db80c9750 tx=0x7f8db8099390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0ccd5606c69d888 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80c9ea0 con 0x55cebfc110a0 2023-09-21T13:05:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cebfad3b50 con 0x55cebfc110a0 2023-09-21T13:05:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8db80994b0 con 0x55cebfc110a0 2023-09-21T13:05:35.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8db809d2e0 con 0x55cebfc110a0 2023-09-21T13:05:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8dde75cb80 10 client.27590 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f8dbc011330 con 0x55cebfc110a0 2023-09-21T13:05:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cebfad3b50 con 0x55cebfc110a0 2023-09-21T13:05:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8db80a1170 con 0x55cebfc110a0 2023-09-21T13:05:35.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.807+0000 7f8dde75cb80 10 client.27590 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dde75cb80 10 client.27590 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dde75cb80 20 client.27590 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc2af70 0x55cebfc2d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dde75cb80 4 client.27590 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:35.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cebfbdffc0 con 0x55cebfc2af70 2023-09-21T13:05:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc2af70 0x55cebfc2d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc2af70 0x55cebfc2d390 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc0738fd8c44066e server_cookie=2a5cd0aabd9c3f89 in_seq=0 out_seq=0 2023-09-21T13:05:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.808+0000 7f8da3fff700 10 client.27590 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8da3fff700 1 -- 172.21.15.142:0/3893170197 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cebfbdffc0 con 0x55cebfc2af70 2023-09-21T13:05:35.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8da3fff700 10 client.27590 handle_command_reply: tid=0 2023-09-21T13:05:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 client.27590 shutdown 2023-09-21T13:05:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 msgr2=0x55cebfc1d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8db80c9750 tx=0x7f8db8099390 comp rx=0 tx=0).stop 2023-09-21T13:05:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 shutdown_connections 2023-09-21T13:05:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc2af70 0x55cebfc2d390 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.809+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc110a0 0x55cebfc1d560 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8da3fff700 0 client.27590 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/3893170197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 >> 172.21.15.142:0/3893170197 conn(0x55cebfb3dfa0 msgr2=0x55cebfc0b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 shutdown_connections 2023-09-21T13:05:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 1 -- 172.21.15.142:0/3893170197 wait complete. 2023-09-21T13:05:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.810+0000 7f8dde75cb80 20 client.27590 trim_cache size 0 max 16384 2023-09-21T13:05:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.829+0000 7f8dde75cb80 1 Processor -- start 2023-09-21T13:05:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.829+0000 7f8dde75cb80 1 -- start start 2023-09-21T13:05:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.829+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc14e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebf9e38c0 con 0x55cebfc110a0 2023-09-21T13:05:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfc1b960 con 0x55cebfc15e50 2023-09-21T13:05:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfc08210 con 0x55cebfc119c0 2023-09-21T13:05:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:58376/0 (socket says 172.21.15.142:58376) 2023-09-21T13:05:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/1616255121 learned_addr learned my addr 172.21.15.142:0/1616255121 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc939c700 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc14e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/1616255121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 msgr2=0x55cebfc1d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/1616255121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 msgr2=0x55cebfc14e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc14e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.830+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/1616255121 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cebfc31f80 con 0x55cebfc110a0 2023-09-21T13:05:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.831+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8db80053d0 tx=0x7f8db8099cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa72d1d286921a60 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.831+0000 7f8daf7fe700 1 -- 172.21.15.142:0/1616255121 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db80c9ea0 con 0x55cebfc110a0 2023-09-21T13:05:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.831+0000 7f8daf7fe700 1 -- 172.21.15.142:0/1616255121 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8db80b5020 con 0x55cebfc110a0 2023-09-21T13:05:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.831+0000 7f8daf7fe700 1 -- 172.21.15.142:0/1616255121 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8098be0 con 0x55cebfc110a0 2023-09-21T13:05:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- 172.21.15.142:0/1616255121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 msgr2=0x55cebfc1a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f8db80053d0 tx=0x7f8db8099cf0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- 172.21.15.142:0/1616255121 shutdown_connections 2023-09-21T13:05:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc110a0 0x55cebfc1a030 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc15e50 0x55cebfc14e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/1616255121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc119c0 0x55cebfc1d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- 172.21.15.142:0/1616255121 >> 172.21.15.142:0/1616255121 conn(0x55cebfb3dfa0 msgr2=0x55cebfc18240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- 172.21.15.142:0/1616255121 shutdown_connections 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- 172.21.15.142:0/1616255121 wait complete. 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.832+0000 7f8dde75cb80 1 -- start start 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 Processor -- start 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 0x55cebfc22210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfc1e900 con 0x55cebfc15e50 2023-09-21T13:05:35.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfc1ea70 con 0x55cebfc119c0 2023-09-21T13:05:35.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cebfc1ec30 con 0x55cebfc110a0 2023-09-21T13:05:35.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.833+0000 7f8dde75cb80 10 client.0 _ll_register_callbacks cb 0x55cebfa49a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:35.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 0x55cebfc22210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49264/0 (socket says 172.21.15.142:49264) 2023-09-21T13:05:35.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/350770325 learned_addr learned my addr 172.21.15.142:0/350770325 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:35.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc939c700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 msgr2=0x55cebfc22210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 0x55cebfc22210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/350770325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 msgr2=0x55cebfc1e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 -- 172.21.15.142:0/350770325 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dbc011330 con 0x55cebfc110a0 2023-09-21T13:05:35.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 0x55cebfc22210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dc8b9b700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8db80991b0 tx=0x7f8db80107d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6bdd72d77ff444a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8da3fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db8065070 con 0x55cebfc110a0 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8db80b6070 con 0x55cebfc110a0 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.834+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dbc00f040 con 0x55cebfc110a0 2023-09-21T13:05:35.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8db80c9ea0 con 0x55cebfc110a0 2023-09-21T13:05:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 10 client.27550 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55cebf976c00 con 0x55cebfc110a0 2023-09-21T13:05:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dbc00f040 con 0x55cebfc110a0 2023-09-21T13:05:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8db80a1090 con 0x55cebfc110a0 2023-09-21T13:05:35.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 10 client.27550 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 10 client.27550 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 20 client.27550 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc7fb90 0x55cebfc81f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 4 client.27550 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:05:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cebfb5be00 con 0x55cebfc7fb90 2023-09-21T13:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.835+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc7fb90 0x55cebfc81f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.836+0000 7f8da3fff700 10 client.27550 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.836+0000 7f8dc3fff700 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc7fb90 0x55cebfc81f80 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ce34cec0a652b server_cookie=5f7b01c40b7778d7 in_seq=0 out_seq=0 2023-09-21T13:05:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.908+0000 7f8da3fff700 1 -- 172.21.15.142:0/350770325 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cebfb5be00 con 0x55cebfc7fb90 2023-09-21T13:05:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.908+0000 7f8da3fff700 10 client.27550 handle_command_reply: tid=0 2023-09-21T13:05:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.908+0000 7f8dde75cb80 1 client.27550 shutdown 2023-09-21T13:05:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 msgr2=0x55cebfc21cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8db80991b0 tx=0x7f8db80107d0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 shutdown_connections 2023-09-21T13:05:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55cebfc7fb90 0x55cebfc81f80 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55cebfc15e50 0x55cebfc1e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55cebfc110a0 0x55cebfc21cd0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8da3fff700 0 client.27550 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 --2- 172.21.15.142:0/350770325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55cebfc119c0 0x55cebfc22210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 >> 172.21.15.142:0/350770325 conn(0x55cebfb3dfa0 msgr2=0x55cebfc10730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.908 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 shutdown_connections 2023-09-21T13:05:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 1 -- 172.21.15.142:0/350770325 wait complete. 2023-09-21T13:05:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.909+0000 7f8dde75cb80 20 client.27550 trim_cache size 0 max 16384 2023-09-21T13:05:35.909 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:05:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:05:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:05:35.910 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:05:35.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 msgr2=0x7f8db40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 0x7f8db40a2c70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8dc419a8f0 tx=0x7f8db0005fb0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.911 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 msgr2=0x7f8dc41990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8db800e9f0 tx=0x7f8db800ed00 comp rx=0 tx=0).stop 2023-09-21T13:05:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 shutdown_connections 2023-09-21T13:05:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8db40a07b0 0x7f8db40a2c70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8dc419dc80 0x7f8dc419e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8dc4103230 0x7f8dc41990d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 --2- 172.21.15.142:0/3421741209 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8dc4108350 0x7f8dc4199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 >> 172.21.15.142:0/3421741209 conn(0x7f8dc40fea90 msgr2=0x7f8dc40ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 shutdown_connections 2023-09-21T13:05:35.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:35.910+0000 7f8dcadff700 1 -- 172.21.15.142:0/3421741209 wait complete. 2023-09-21T13:05:36.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:35 smithi156 ceph-mon[134078]: pgmap v289: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:05:36.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:35 smithi142 ceph-mon[97663]: pgmap v289: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:05:36.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:35 smithi160 ceph-mon[134450]: pgmap v289: 97 pgs: 97 active+clean; 261 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 188 op/s 2023-09-21T13:05:36.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 867338 8.82 MB/sec execute 377 sec latency 55.166 ms 2023-09-21T13:05:37.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 869499 8.83 MB/sec execute 378 sec latency 15.841 ms 2023-09-21T13:05:38.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:37 smithi156 ceph-mon[134078]: pgmap v290: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2023-09-21T13:05:38.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:37 smithi142 ceph-mon[97663]: pgmap v290: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2023-09-21T13:05:38.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:37 smithi160 ceph-mon[134450]: pgmap v290: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 268 op/s 2023-09-21T13:05:38.701 INFO:tasks.workunit.client.0.smithi142.stdout: 1 870908 8.83 MB/sec execute 379 sec latency 13.027 ms 2023-09-21T13:05:39.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 872172 8.82 MB/sec execute 380 sec latency 316.796 ms 2023-09-21T13:05:40.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:39 smithi156 ceph-mon[134078]: pgmap v291: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-09-21T13:05:40.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:39 smithi142 ceph-mon[97663]: pgmap v291: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-09-21T13:05:40.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:39 smithi160 ceph-mon[134450]: pgmap v291: 97 pgs: 97 active+clean; 269 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 157 op/s 2023-09-21T13:05:40.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 873660 8.82 MB/sec execute 381 sec latency 47.999 ms 2023-09-21T13:05:41.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 875159 8.82 MB/sec execute 382 sec latency 16.540 ms 2023-09-21T13:05:42.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:41 smithi156 ceph-mon[134078]: pgmap v292: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2023-09-21T13:05:42.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:41 smithi142 ceph-mon[97663]: pgmap v292: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2023-09-21T13:05:42.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:41 smithi160 ceph-mon[134450]: pgmap v292: 97 pgs: 97 active+clean; 274 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 4.4 MiB/s wr, 310 op/s 2023-09-21T13:05:42.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 877211 8.83 MB/sec execute 383 sec latency 29.151 ms 2023-09-21T13:05:43.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 878738 8.82 MB/sec execute 384 sec latency 18.503 ms 2023-09-21T13:05:44.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:43 smithi156 ceph-mon[134078]: pgmap v293: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 349 op/s 2023-09-21T13:05:44.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:43 smithi142 ceph-mon[97663]: pgmap v293: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 349 op/s 2023-09-21T13:05:44.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:43 smithi160 ceph-mon[134450]: pgmap v293: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.6 MiB/s wr, 349 op/s 2023-09-21T13:05:44.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 880793 8.83 MB/sec execute 385 sec latency 13.505 ms 2023-09-21T13:05:45.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 882367 8.82 MB/sec execute 386 sec latency 52.656 ms 2023-09-21T13:05:46.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:45 smithi156 ceph-mon[134078]: pgmap v294: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2023-09-21T13:05:46.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:45 smithi142 ceph-mon[97663]: pgmap v294: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2023-09-21T13:05:46.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:45 smithi160 ceph-mon[134450]: pgmap v294: 97 pgs: 97 active+clean; 266 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 305 op/s 2023-09-21T13:05:46.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 884384 8.84 MB/sec execute 387 sec latency 15.494 ms 2023-09-21T13:05:47.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 885911 8.83 MB/sec execute 388 sec latency 18.963 ms 2023-09-21T13:05:47.791 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:05:48.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 -- 172.21.15.142:0/1844496274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540100fa0 msgr2=0x7f8540101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 --2- 172.21.15.142:0/1844496274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540100fa0 0x7f8540101380 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f853c009990 tx=0x7f853c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 -- 172.21.15.142:0/1844496274 shutdown_connections 2023-09-21T13:05:48.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 --2- 172.21.15.142:0/1844496274 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f854010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 --2- 172.21.15.142:0/1844496274 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540100fa0 0x7f8540101380 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 --2- 172.21.15.142:0/1844496274 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540101950 0x7f8540105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.020+0000 7f85475ff700 1 -- 172.21.15.142:0/1844496274 >> 172.21.15.142:0/1844496274 conn(0x7f85400fc860 msgr2=0x7f85400fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.021+0000 7f85475ff700 1 -- 172.21.15.142:0/1844496274 shutdown_connections 2023-09-21T13:05:48.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.021+0000 7f85475ff700 1 -- 172.21.15.142:0/1844496274 wait complete. 2023-09-21T13:05:48.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 Processor -- start 2023-09-21T13:05:48.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 -- start start 2023-09-21T13:05:48.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540100fa0 0x7f85400730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 0x7f85401a5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a56b0 con 0x7f8540100fa0 2023-09-21T13:05:48.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a5820 con 0x7f8540073b60 2023-09-21T13:05:48.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.022+0000 7f85475ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85401a59e0 con 0x7f85401060c0 2023-09-21T13:05:48.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8545b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 0x7f85401a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38184/0 (socket says 172.21.15.142:38184) 2023-09-21T13:05:48.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8545b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 0x7f85401a5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59320/0 (socket says 172.21.15.142:59320) 2023-09-21T13:05:48.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 -- 172.21.15.142:0/1867615762 learned_addr learned my addr 172.21.15.142:0/1867615762 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:48.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f854539b700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540100fa0 0x7f85400730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 -- 172.21.15.142:0/1867615762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 msgr2=0x7f85401a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 0x7f85401a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 -- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540100fa0 msgr2=0x7f85400730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540100fa0 0x7f85400730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 -- 172.21.15.142:0/1867615762 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0095f0 con 0x7f85401060c0 2023-09-21T13:05:48.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f8544b9a700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f853000e970 tx=0x7f853000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.023+0000 7f85367fc700 1 -- 172.21.15.142:0/1867615762 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530009790 con 0x7f85401060c0 2023-09-21T13:05:48.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.024+0000 7f85367fc700 1 -- 172.21.15.142:0/1867615762 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f853000c7e0 con 0x7f85401060c0 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.024+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85401a5cc0 con 0x7f85401060c0 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.024+0000 7f85367fc700 1 -- 172.21.15.142:0/1867615762 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300054e0 con 0x7f85401060c0 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.024+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a61d0 con 0x7f85401060c0 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.027+0000 7f85367fc700 1 -- 172.21.15.142:0/1867615762 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f853000c950 con 0x7f85401060c0 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.028+0000 7f855af3cb80 1 Processor -- start 2023-09-21T13:05:48.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.028+0000 7f855af3cb80 1 -- start start 2023-09-21T13:05:48.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc601ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f85367fc700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 0x7f852c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f8eca0 con 0x563dc601af30 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f72c70 con 0x563dc601a610 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f855af3cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f70590 con 0x563dc601f360 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f8545b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f85367fc700 1 -- 172.21.15.142:0/1867615762 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8530014070 con 0x7f85401060c0 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f8545b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59322/0 (socket says 172.21.15.142:59322) 2023-09-21T13:05:48.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f8545b9c700 1 -- 172.21.15.142:0/873061114 learned_addr learned my addr 172.21.15.142:0/873061114 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f8544b9a700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc601ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f854539b700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 0x7f852c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.029+0000 7f8545b9c700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 -- 172.21.15.142:0/873061114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 msgr2=0x563dc601f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 -- 172.21.15.142:0/873061114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 msgr2=0x563dc601ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc601ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 -- 172.21.15.142:0/873061114 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc5d96de0 con 0x563dc601a610 2023-09-21T13:05:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8544b9a700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc601ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:48.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f854539b700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 0x7f852c0a2c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b2e0 tx=0x7f853c005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f8545b9c700 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8538013ef0 tx=0x7f8538009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9285378605ee0092 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f852b7fe700 1 -- 172.21.15.142:0/873061114 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800e040 con 0x563dc601a610 2023-09-21T13:05:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f852b7fe700 1 -- 172.21.15.142:0/873061114 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f853800f040 con 0x563dc601a610 2023-09-21T13:05:48.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.030+0000 7f852b7fe700 1 -- 172.21.15.142:0/873061114 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8538004020 con 0x563dc601a610 2023-09-21T13:05:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 -- 172.21.15.142:0/873061114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 msgr2=0x563dc601a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8538013ef0 tx=0x7f8538009920 comp rx=0 tx=0).stop 2023-09-21T13:05:48.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 -- 172.21.15.142:0/873061114 shutdown_connections 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601a9f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 --2- 172.21.15.142:0/873061114 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc601ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 -- 172.21.15.142:0/873061114 >> 172.21.15.142:0/873061114 conn(0x563dc5f47000 msgr2=0x563dc60156a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 -- 172.21.15.142:0/873061114 shutdown_connections 2023-09-21T13:05:48.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.031+0000 7f855af3cb80 1 -- 172.21.15.142:0/873061114 wait complete. 2023-09-21T13:05:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.032+0000 7f855af3cb80 1 -- start start 2023-09-21T13:05:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.032+0000 7f855af3cb80 1 Processor -- start 2023-09-21T13:05:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 0x563dc6026ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc6023dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 0x563dc6024440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f6be80 con 0x563dc601af30 2023-09-21T13:05:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f08740 con 0x563dc601f360 2023-09-21T13:05:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5f083e0 con 0x563dc601a610 2023-09-21T13:05:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f855af3cb80 10 client.0 _ll_register_callbacks cb 0x563dc5e52a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:48.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f854539b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 0x563dc6026ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f854539b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 0x563dc6026ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38216/0 (socket says 172.21.15.142:38216) 2023-09-21T13:05:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f854539b700 1 -- 172.21.15.142:0/1779649745 learned_addr learned my addr 172.21.15.142:0/1779649745 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 0x563dc6024440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8544b9a700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc6023dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 -- 172.21.15.142:0/1779649745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 msgr2=0x563dc6026ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 0x563dc6026ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 -- 172.21.15.142:0/1779649745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 msgr2=0x563dc6023dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc6023dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.033+0000 7f8545b9c700 1 -- 172.21.15.142:0/1779649745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401a61d0 con 0x563dc601f360 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f8545b9c700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 0x563dc6024440 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8538009f50 tx=0x7f8538003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae79739495432695 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f8528ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853800e070 con 0x563dc601f360 2023-09-21T13:05:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dc5edcbb0 con 0x563dc601f360 2023-09-21T13:05:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8538018b60 con 0x563dc601f360 2023-09-21T13:05:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8538018d60 con 0x563dc601f360 2023-09-21T13:05:48.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f855af3cb80 10 client.27608 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.034+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f8538013ba0 con 0x563dc601f360 2023-09-21T13:05:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563dc5edcbb0 con 0x563dc601f360 2023-09-21T13:05:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f85380043e0 con 0x563dc601f360 2023-09-21T13:05:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 10 client.27608 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:48.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 10 client.27608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 20 client.27608 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6034180 0x563dc6036570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 4 client.27608 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dc5fe9020 con 0x563dc6034180 2023-09-21T13:05:48.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.035+0000 7f854539b700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6034180 0x563dc6036570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.036+0000 7f854539b700 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6034180 0x563dc6036570 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af9b2b0ca9e4986e server_cookie=d180a35ce2cb3745 in_seq=0 out_seq=0 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.036+0000 7f8528ff9700 10 client.27608 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.036+0000 7f8528ff9700 1 -- 172.21.15.142:0/1779649745 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563dc5fe9020 con 0x563dc6034180 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.036+0000 7f8528ff9700 10 client.27608 handle_command_reply: tid=0 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 client.27608 shutdown 2023-09-21T13:05:48.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 msgr2=0x563dc6024440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 0x563dc6024440 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8538009f50 tx=0x7f8538003e70 comp rx=0 tx=0).stop 2023-09-21T13:05:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 shutdown_connections 2023-09-21T13:05:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6034180 0x563dc6036570 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601f360 0x563dc6024440 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601a610 0x563dc6026ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f8528ff9700 0 client.27608 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1779649745 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc6023dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 >> 172.21.15.142:0/1779649745 conn(0x563dc5f47000 msgr2=0x563dc6014920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 shutdown_connections 2023-09-21T13:05:48.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.037+0000 7f855af3cb80 1 -- 172.21.15.142:0/1779649745 wait complete. 2023-09-21T13:05:48.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.038+0000 7f855af3cb80 20 client.27608 trim_cache size 0 max 16384 2023-09-21T13:05:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.061+0000 7f855af3cb80 1 Processor -- start 2023-09-21T13:05:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.061+0000 7f855af3cb80 1 -- start start 2023-09-21T13:05:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc602b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc5dec920 con 0x563dc601af30 2023-09-21T13:05:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc602ba30 con 0x563dc601a610 2023-09-21T13:05:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f855af3cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc6016ed0 con 0x563dc601f360 2023-09-21T13:05:48.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59348/0 (socket says 172.21.15.142:59348) 2023-09-21T13:05:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 -- 172.21.15.142:0/1302705902 learned_addr learned my addr 172.21.15.142:0/1302705902 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f8544b9a700 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc602b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f8545b9c700 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.061 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 -- 172.21.15.142:0/1302705902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 msgr2=0x563dc601e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 -- 172.21.15.142:0/1302705902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 msgr2=0x563dc602b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc602b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.062 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.062+0000 7f854539b700 1 -- 172.21.15.142:0/1302705902 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dc603b170 con 0x563dc601a610 2023-09-21T13:05:48.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.063+0000 7f854539b700 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f853c009990 tx=0x7f853c023000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4abc0aba53d99b05 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.063+0000 7f852bfff700 1 -- 172.21.15.142:0/1302705902 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c02b030 con 0x563dc601a610 2023-09-21T13:05:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.063+0000 7f852bfff700 1 -- 172.21.15.142:0/1302705902 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f853c02c040 con 0x563dc601a610 2023-09-21T13:05:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.063+0000 7f852bfff700 1 -- 172.21.15.142:0/1302705902 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0049c0 con 0x563dc601a610 2023-09-21T13:05:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- 172.21.15.142:0/1302705902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 msgr2=0x563dc601cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f853c009990 tx=0x7f853c023000 comp rx=0 tx=0).stop 2023-09-21T13:05:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- 172.21.15.142:0/1302705902 shutdown_connections 2023-09-21T13:05:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc601e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601a610 0x563dc601cc50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 --2- 172.21.15.142:0/1302705902 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601af30 0x563dc602b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- 172.21.15.142:0/1302705902 >> 172.21.15.142:0/1302705902 conn(0x563dc5f47000 msgr2=0x563dc6021750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- 172.21.15.142:0/1302705902 shutdown_connections 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- 172.21.15.142:0/1302705902 wait complete. 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.064+0000 7f855af3cb80 1 -- start start 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 Processor -- start 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601a610 0x563dc6029f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc6087f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc602ac40 con 0x563dc601a610 2023-09-21T13:05:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc60884a0 con 0x563dc601af30 2023-09-21T13:05:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dc6088660 con 0x563dc601f360 2023-09-21T13:05:48.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f855af3cb80 10 client.0 _ll_register_callbacks cb 0x563dc5e52a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f8544b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f854539b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601a610 0x563dc6029f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f8544b9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59360/0 (socket says 172.21.15.142:59360) 2023-09-21T13:05:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f8544b9a700 1 -- 172.21.15.142:0/2636265687 learned_addr learned my addr 172.21.15.142:0/2636265687 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:48.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.065+0000 7f8545b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc6087f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 -- 172.21.15.142:0/2636265687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 msgr2=0x563dc6087f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc6087f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 -- 172.21.15.142:0/2636265687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601a610 msgr2=0x563dc6029f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601a610 0x563dc6029f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 -- 172.21.15.142:0/2636265687 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854010e4b0 con 0x563dc601af30 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8545b9c700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc6087f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8544b9a700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8530004800 tx=0x7f853000e8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0b35df2dcef43af server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8528ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a1030 con 0x563dc601af30 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f853000cc50 con 0x563dc601af30 2023-09-21T13:05:48.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f853800f040 con 0x563dc601af30 2023-09-21T13:05:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85300a0e40 con 0x563dc601af30 2023-09-21T13:05:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.066+0000 7f855af3cb80 10 client.27614 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x563dc5d7fc60 con 0x563dc601af30 2023-09-21T13:05:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8530063020 con 0x563dc601af30 2023-09-21T13:05:48.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f85300a0a40 con 0x563dc601af30 2023-09-21T13:05:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 10 client.27614 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 10 client.27614 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 20 client.27614 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6089e10 0x563dc608c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:48.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 4 client.27614 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:05:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563dc5f64e60 con 0x563dc6089e10 2023-09-21T13:05:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.067+0000 7f854539b700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6089e10 0x563dc608c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f854539b700 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6089e10 0x563dc608c230 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b504bff2419b5a78 server_cookie=ed2b7167499a422f in_seq=0 out_seq=0 2023-09-21T13:05:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f8528ff9700 10 client.27614 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:48.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f8528ff9700 1 -- 172.21.15.142:0/2636265687 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x563dc5f64e60 con 0x563dc6089e10 2023-09-21T13:05:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f8528ff9700 10 client.27614 handle_command_reply: tid=0 2023-09-21T13:05:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f855af3cb80 1 client.27614 shutdown 2023-09-21T13:05:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 msgr2=0x563dc602a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8530004800 tx=0x7f853000e8f0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 shutdown_connections 2023-09-21T13:05:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.068+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x563dc6089e10 0x563dc608c230 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x563dc601a610 0x563dc6029f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563dc601f360 0x563dc6087f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f8528ff9700 0 client.27614 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 --2- 172.21.15.142:0/2636265687 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x563dc601af30 0x563dc602a4d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 >> 172.21.15.142:0/2636265687 conn(0x563dc5f47000 msgr2=0x563dc6021750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 shutdown_connections 2023-09-21T13:05:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 1 -- 172.21.15.142:0/2636265687 wait complete. 2023-09-21T13:05:48.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.069+0000 7f855af3cb80 20 client.27614 trim_cache size 0 max 16384 2023-09-21T13:05:48.082 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:05:48.082 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:05:48.083 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:05:48.083 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:05:48.083 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:05:48.084 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:05:48.084 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:05:48.084 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:05:48.085 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:05:48.085 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:05:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 msgr2=0x7f852c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 0x7f852c0a2c70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f853c00b2e0 tx=0x7f853c005fd0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 msgr2=0x7f8540073620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f853000e970 tx=0x7f853000ec80 comp rx=0 tx=0).stop 2023-09-21T13:05:48.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 shutdown_connections 2023-09-21T13:05:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f852c0a07b0 0x7f852c0a2c70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8540100fa0 0x7f85400730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8540073b60 0x7f85401a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 --2- 172.21.15.142:0/1867615762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85401060c0 0x7f8540073620 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 >> 172.21.15.142:0/1867615762 conn(0x7f85400fc860 msgr2=0x7f8540104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:48.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 shutdown_connections 2023-09-21T13:05:48.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:05:48.070+0000 7f85475ff700 1 -- 172.21.15.142:0/1867615762 wait complete. 2023-09-21T13:05:48.092 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:47 smithi142 ceph-mon[97663]: pgmap v295: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2023-09-21T13:05:48.093 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:05:48.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:47 smithi156 ceph-mon[134078]: pgmap v295: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2023-09-21T13:05:48.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:47 smithi160 ceph-mon[134450]: pgmap v295: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.0 MiB/s wr, 396 op/s 2023-09-21T13:05:48.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 887843 8.84 MB/sec execute 389 sec latency 30.685 ms 2023-09-21T13:05:49.083 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 -- 172.21.15.142:0/1091871135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 msgr2=0x7f8c3c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 --2- 172.21.15.142:0/1091871135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c068c20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009990 tx=0x7f8c30009ca0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 -- 172.21.15.142:0/1091871135 shutdown_connections 2023-09-21T13:05:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 --2- 172.21.15.142:0/1091871135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c10d650 0x7f8c3c10fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 --2- 172.21.15.142:0/1091871135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c101cd0 0x7f8c3c0681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 --2- 172.21.15.142:0/1091871135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c068c20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.085 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 -- 172.21.15.142:0/1091871135 >> 172.21.15.142:0/1091871135 conn(0x7f8c3c076800 msgr2=0x7f8c3c076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.085 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 -- 172.21.15.142:0/1091871135 shutdown_connections 2023-09-21T13:05:49.085 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.086+0000 7f8c409ff700 1 -- 172.21.15.142:0/1091871135 wait complete. 2023-09-21T13:05:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.087+0000 7f8c409ff700 1 Processor -- start 2023-09-21T13:05:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.087+0000 7f8c409ff700 1 -- start start 2023-09-21T13:05:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c10d650 0x7f8c3c1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c19dd40 0x7f8c3c19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c19e7c0 con 0x7f8c3c19dd40 2023-09-21T13:05:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c19e930 con 0x7f8c3c0687a0 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c409ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c19eaf0 con 0x7f8c3c10d650 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59384/0 (socket says 172.21.15.142:59384) 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c3a59c700 1 -- 172.21.15.142:0/2579296227 learned_addr learned my addr 172.21.15.142:0/2579296227 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c19dd40 0x7f8c3c19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.088+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c10d650 0x7f8c3c1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 -- 172.21.15.142:0/2579296227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c10d650 msgr2=0x7f8c3c1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c10d650 0x7f8c3c1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 -- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c19dd40 msgr2=0x7f8c3c19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c19dd40 0x7f8c3c19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 -- 172.21.15.142:0/2579296227 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c009520 con 0x7f8c3c0687a0 2023-09-21T13:05:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00eb30 tx=0x7f8c2c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c2b7fe700 1 -- 172.21.15.142:0/2579296227 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c009880 con 0x7f8c3c0687a0 2023-09-21T13:05:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c2b7fe700 1 -- 172.21.15.142:0/2579296227 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c2c0044e0 con 0x7f8c3c0687a0 2023-09-21T13:05:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c300095f0 con 0x7f8c3c0687a0 2023-09-21T13:05:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c2b7fe700 1 -- 172.21.15.142:0/2579296227 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c003d80 con 0x7f8c3c0687a0 2023-09-21T13:05:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.089+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c1a6340 con 0x7f8c3c0687a0 2023-09-21T13:05:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.093+0000 7f8c2b7fe700 1 -- 172.21.15.142:0/2579296227 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8c2c003f20 con 0x7f8c3c0687a0 2023-09-21T13:05:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.094+0000 7f8c5439eb80 1 Processor -- start 2023-09-21T13:05:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.094+0000 7f8c5439eb80 1 -- start start 2023-09-21T13:05:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.094+0000 7f8c2b7fe700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 0x7f8c240a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.094+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d3fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c2b7fe700 1 -- 172.21.15.142:0/2579296227 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8c2c014070 con 0x7f8c3c0687a0 2023-09-21T13:05:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d36bc40 con 0x55903d3f70a0 2023-09-21T13:05:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d34fc10 con 0x55903d3fbe50 2023-09-21T13:05:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d34d530 con 0x55903d3f79c0 2023-09-21T13:05:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 0x7f8c240a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59388/0 (socket says 172.21.15.142:59388) 2023-09-21T13:05:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/11550182 learned_addr learned my addr 172.21.15.142:0/11550182 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d3fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/11550182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 msgr2=0x55903d3fb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d3fb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/11550182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 msgr2=0x55903d3f7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/11550182 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903d173d80 con 0x55903d3fbe50 2023-09-21T13:05:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.095+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:05:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.096+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c34008f80 tx=0x7f8c3401a6c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a27f5f6c26c43f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.096+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 0x7f8c240a2c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009fd0 tx=0x7f8c34010000 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.096+0000 7f8c28ff9700 1 -- 172.21.15.142:0/11550182 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400e040 con 0x55903d3fbe50 2023-09-21T13:05:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.096+0000 7f8c28ff9700 1 -- 172.21.15.142:0/11550182 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c3401f070 con 0x55903d3fbe50 2023-09-21T13:05:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.096+0000 7f8c28ff9700 1 -- 172.21.15.142:0/11550182 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34003e20 con 0x55903d3fbe50 2023-09-21T13:05:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 -- 172.21.15.142:0/11550182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 msgr2=0x55903d3fc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f8c34008f80 tx=0x7f8c3401a6c0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 -- 172.21.15.142:0/11550182 shutdown_connections 2023-09-21T13:05:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d3fc2b0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/11550182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d3fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 -- 172.21.15.142:0/11550182 >> 172.21.15.142:0/11550182 conn(0x55903d323fa0 msgr2=0x55903d3f20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 -- 172.21.15.142:0/11550182 shutdown_connections 2023-09-21T13:05:49.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.097+0000 7f8c5439eb80 1 -- 172.21.15.142:0/11550182 wait complete. 2023-09-21T13:05:49.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.098+0000 7f8c5439eb80 1 -- start start 2023-09-21T13:05:49.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.098+0000 7f8c5439eb80 1 Processor -- start 2023-09-21T13:05:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f70a0 0x55903d4036b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d401070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d348e20 con 0x55903d3fbe50 2023-09-21T13:05:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d2e56e0 con 0x55903d3f79c0 2023-09-21T13:05:49.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d2e5380 con 0x55903d3f70a0 2023-09-21T13:05:49.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c5439eb80 10 client.0 _ll_register_callbacks cb 0x55903d22fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:49.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c39d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f70a0 0x55903d4036b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c39d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59404/0 (socket says 172.21.15.142:59404) 2023-09-21T13:05:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.099+0000 7f8c39d9b700 1 -- 172.21.15.142:0/3082644168 learned_addr learned my addr 172.21.15.142:0/3082644168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 -- 172.21.15.142:0/3082644168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f70a0 msgr2=0x55903d4036b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f70a0 0x55903d4036b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 -- 172.21.15.142:0/3082644168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 msgr2=0x55903d401070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d401070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 -- 172.21.15.142:0/3082644168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c1a6340 con 0x55903d3f79c0 2023-09-21T13:05:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0fff20 tx=0x7f8c30005a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c963da884fc615d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.100+0000 7f8c21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3001d070 con 0x55903d3f79c0 2023-09-21T13:05:49.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55903d2b9b50 con 0x55903d3f79c0 2023-09-21T13:05:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8c30004500 con 0x55903d3f79c0 2023-09-21T13:05:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c30004700 con 0x55903d3f79c0 2023-09-21T13:05:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c5439eb80 10 client.27626 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f8c34008b30 con 0x55903d3f79c0 2023-09-21T13:05:49.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55903d2b9b50 con 0x55903d3f79c0 2023-09-21T13:05:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.101+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8c3000f9d0 con 0x55903d3f79c0 2023-09-21T13:05:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 10 client.27626 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 10 client.27626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 20 client.27626 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d410fb0 0x55903d4133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 4 client.27626 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:05:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.102+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55903d3c5fc0 con 0x55903d410fb0 2023-09-21T13:05:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.103+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d410fb0 0x55903d4133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.104+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d410fb0 0x55903d4133d0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201ec5f60832bf5b server_cookie=71cc746884acdcae in_seq=0 out_seq=0 2023-09-21T13:05:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.104+0000 7f8c21ffb700 10 client.27626 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.105+0000 7f8c21ffb700 1 -- 172.21.15.142:0/3082644168 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55903d3c5fc0 con 0x55903d410fb0 2023-09-21T13:05:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.105+0000 7f8c21ffb700 10 client.27626 handle_command_reply: tid=0 2023-09-21T13:05:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.105+0000 7f8c5439eb80 1 client.27626 shutdown 2023-09-21T13:05:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 msgr2=0x55903d400930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0fff20 tx=0x7f8c30005a90 comp rx=0 tx=0).stop 2023-09-21T13:05:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 shutdown_connections 2023-09-21T13:05:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d410fb0 0x55903d4133d0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d401070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f70a0 0x55903d4036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c21ffb700 0 client.27626 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/3082644168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f79c0 0x55903d400930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 >> 172.21.15.142:0/3082644168 conn(0x55903d323fa0 msgr2=0x55903d3f1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 shutdown_connections 2023-09-21T13:05:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 1 -- 172.21.15.142:0/3082644168 wait complete. 2023-09-21T13:05:49.115 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.106+0000 7f8c5439eb80 20 client.27626 trim_cache size 0 max 16384 2023-09-21T13:05:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 Processor -- start 2023-09-21T13:05:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 -- start start 2023-09-21T13:05:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.120 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d4031e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d1c98c0 con 0x55903d3f70a0 2023-09-21T13:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d3ee920 con 0x55903d3fbe50 2023-09-21T13:05:49.121 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.123+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d3f7f40 con 0x55903d3f79c0 2023-09-21T13:05:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59412/0 (socket says 172.21.15.142:59412) 2023-09-21T13:05:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/2672673078 learned_addr learned my addr 172.21.15.142:0/2672673078 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:49.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d4031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/2672673078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 msgr2=0x55903d4031e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d4031e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/2672673078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 msgr2=0x55903d3f9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 -- 172.21.15.142:0/2672673078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55903d15cc00 con 0x55903d3fbe50 2023-09-21T13:05:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.124+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c340086e0 tx=0x7f8c34008710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c768c1523f3834bc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.125+0000 7f8c297fa700 1 -- 172.21.15.142:0/2672673078 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400e040 con 0x55903d3fbe50 2023-09-21T13:05:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.125+0000 7f8c297fa700 1 -- 172.21.15.142:0/2672673078 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c3400f040 con 0x55903d3fbe50 2023-09-21T13:05:49.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.125+0000 7f8c297fa700 1 -- 172.21.15.142:0/2672673078 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3402c480 con 0x55903d3fbe50 2023-09-21T13:05:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- 172.21.15.142:0/2672673078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 msgr2=0x55903d403720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8c340086e0 tx=0x7f8c34008710 comp rx=0 tx=0).stop 2023-09-21T13:05:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- 172.21.15.142:0/2672673078 shutdown_connections 2023-09-21T13:05:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3f70a0 0x55903d3f9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3fbe50 0x55903d403720 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/2672673078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d4031e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- 172.21.15.142:0/2672673078 >> 172.21.15.142:0/2672673078 conn(0x55903d323fa0 msgr2=0x55903d3f9f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- 172.21.15.142:0/2672673078 shutdown_connections 2023-09-21T13:05:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- 172.21.15.142:0/2672673078 wait complete. 2023-09-21T13:05:49.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.126+0000 7f8c5439eb80 1 -- start start 2023-09-21T13:05:49.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 Processor -- start 2023-09-21T13:05:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d406070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d4065b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d406af0 con 0x55903d3fbe50 2023-09-21T13:05:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d406c60 con 0x55903d3f70a0 2023-09-21T13:05:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55903d406e20 con 0x55903d3f79c0 2023-09-21T13:05:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c5439eb80 10 client.0 _ll_register_callbacks cb 0x55903d22fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:05:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c3a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59424/0 (socket says 172.21.15.142:59424) 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c3a59c700 1 -- 172.21.15.142:0/4203409781 learned_addr learned my addr 172.21.15.142:0/4203409781 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.127+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d406070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3ad9d700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d4065b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 -- 172.21.15.142:0/4203409781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 msgr2=0x55903d406070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d406070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 -- 172.21.15.142:0/4203409781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 msgr2=0x55903d4065b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:05:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d4065b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 -- 172.21.15.142:0/4203409781 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55903d173d80 con 0x55903d3f70a0 2023-09-21T13:05:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c3a59c700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00cd80 tx=0x7f8c2c003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47acdbecac82e7fb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:05:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:05:49.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c063070 con 0x55903d3f70a0 2023-09-21T13:05:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f8c2c084040 con 0x55903d3f70a0 2023-09-21T13:05:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c3401f070 con 0x55903d3f70a0 2023-09-21T13:05:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c2c0a1a00 con 0x55903d3f70a0 2023-09-21T13:05:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c5439eb80 10 client.27632 fetch_fsmap learned FSMap version 38 2023-09-21T13:05:49.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.128+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x55903d19a1f0 con 0x55903d3f70a0 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c3401f070 con 0x55903d3f70a0 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 38) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8c2c0c9eb0 con 0x55903d3f70a0 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 10 client.27632 fetch_fsmap finished waiting for FSMap version 38 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 10 client.27632 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 20 client.27632 populate_metadata read hostname 'smithi142' 2023-09-21T13:05:49.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d4661d0 0x55903d4685f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:05:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 4 client.27632 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:05:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55903d341e00 con 0x55903d4661d0 2023-09-21T13:05:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d4661d0 0x55903d4685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:05:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c39d9b700 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d4661d0 0x55903d4685f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4826407c6e47d32 server_cookie=30035fd79b09882 in_seq=0 out_seq=0 2023-09-21T13:05:49.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.129+0000 7f8c21ffb700 10 client.27632 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c21ffb700 1 -- 172.21.15.142:0/4203409781 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55903d341e00 con 0x55903d4661d0 2023-09-21T13:05:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c21ffb700 10 client.27632 handle_command_reply: tid=0 2023-09-21T13:05:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 client.27632 shutdown 2023-09-21T13:05:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 msgr2=0x55903d407d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00cd80 tx=0x7f8c2c003820 comp rx=0 tx=0).stop 2023-09-21T13:05:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 shutdown_connections 2023-09-21T13:05:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55903d4661d0 0x55903d4685f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55903d3fbe50 0x55903d4065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55903d3f70a0 0x55903d407d40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 --2- 172.21.15.142:0/4203409781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55903d3f79c0 0x55903d406070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 >> 172.21.15.142:0/4203409781 conn(0x55903d323fa0 msgr2=0x55903d3faf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c21ffb700 0 client.27632 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 shutdown_connections 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.186+0000 7f8c5439eb80 1 -- 172.21.15.142:0/4203409781 wait complete. 2023-09-21T13:05:49.185 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c5439eb80 20 client.27632 trim_cache size 0 max 16384 2023-09-21T13:05:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:05:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:05:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:05:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:05:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 msgr2=0x7f8c240a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 0x7f8c240a2c70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c34009fd0 tx=0x7f8c34010000 comp rx=0 tx=0).stop 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 msgr2=0x7f8c3c199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c00eb30 tx=0x7f8c2c00ee40 comp rx=0 tx=0).stop 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 shutdown_connections 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8c240a07b0 0x7f8c240a2c70 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8c3c19dd40 0x7f8c3c19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8c3c0687a0 0x7f8c3c199190 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 --2- 172.21.15.142:0/2579296227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c3c10d650 0x7f8c3c1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:05:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.187+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 >> 172.21.15.142:0/2579296227 conn(0x7f8c3c076800 msgr2=0x7f8c3c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:05:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.188+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 shutdown_connections 2023-09-21T13:05:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:05:49.188+0000 7f8c409ff700 1 -- 172.21.15.142:0/2579296227 wait complete. 2023-09-21T13:05:49.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 889261 8.83 MB/sec execute 390 sec latency 27.063 ms 2023-09-21T13:05:49.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-mon[134450]: pgmap v296: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2023-09-21T13:05:49.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:05:49.935 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:05:49.936 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:05:49.936 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/3891476145 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5564a9abd1e0 con 0x5564a9a92c00 2023-09-21T13:05:49.936 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:05:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:05:50.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:49 smithi156 ceph-mon[134078]: pgmap v296: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2023-09-21T13:05:50.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:49 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:05:50.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:49 smithi142 ceph-mon[97663]: pgmap v296: 97 pgs: 97 active+clean; 268 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.2 MiB/s wr, 317 op/s 2023-09-21T13:05:50.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:49 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:05:50.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 891408 8.84 MB/sec execute 391 sec latency 16.229 ms 2023-09-21T13:05:51.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:50 smithi156 ceph-mon[134078]: osdmap e94: 12 total, 12 up, 12 in 2023-09-21T13:05:51.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:50 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:05:51.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:50 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/622226892,v1:172.21.15.160:6839/622226892] up:boot 2023-09-21T13:05:51.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:50 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:05:51.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:50 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:51.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:50 smithi142 ceph-mon[97663]: osdmap e94: 12 total, 12 up, 12 in 2023-09-21T13:05:51.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:50 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:05:51.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:50 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/622226892,v1:172.21.15.160:6839/622226892] up:boot 2023-09-21T13:05:51.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:50 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:05:51.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:50 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:51.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:50 smithi160 ceph-mon[134450]: osdmap e94: 12 total, 12 up, 12 in 2023-09-21T13:05:51.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:50 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:05:51.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:50 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/622226892,v1:172.21.15.160:6839/622226892] up:boot 2023-09-21T13:05:51.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:50 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:05:51.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:50 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:05:51.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 892971 8.84 MB/sec execute 392 sec latency 17.551 ms 2023-09-21T13:05:52.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:51 smithi156 ceph-mon[134078]: pgmap v298: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 308 op/s 2023-09-21T13:05:52.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:51 smithi142 ceph-mon[97663]: pgmap v298: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 308 op/s 2023-09-21T13:05:52.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:51 smithi160 ceph-mon[134450]: pgmap v298: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 308 op/s 2023-09-21T13:05:52.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 895024 8.85 MB/sec execute 393 sec latency 15.335 ms 2023-09-21T13:05:53.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 896551 8.84 MB/sec execute 394 sec latency 40.844 ms 2023-09-21T13:05:54.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:53 smithi156 ceph-mon[134078]: pgmap v299: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:54.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:53 smithi142 ceph-mon[97663]: pgmap v299: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:54.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:53 smithi160 ceph-mon[134450]: pgmap v299: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:54.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 898587 8.85 MB/sec execute 395 sec latency 45.142 ms 2023-09-21T13:05:55.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 900624 8.85 MB/sec execute 396 sec latency 16.405 ms 2023-09-21T13:05:56.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:55 smithi156 ceph-mon[134078]: pgmap v300: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:56.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:55 smithi142 ceph-mon[97663]: pgmap v300: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:56.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:55 smithi160 ceph-mon[134450]: pgmap v300: 97 pgs: 97 active+clean; 261 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.0 MiB/s wr, 238 op/s 2023-09-21T13:05:56.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 902278 8.85 MB/sec execute 397 sec latency 16.082 ms 2023-09-21T13:05:57.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 904625 8.86 MB/sec execute 398 sec latency 15.768 ms 2023-09-21T13:05:58.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:57 smithi156 ceph-mon[134078]: pgmap v301: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:05:58.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:57 smithi142 ceph-mon[97663]: pgmap v301: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:05:58.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:57 smithi160 ceph-mon[134450]: pgmap v301: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:05:58.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 905967 8.86 MB/sec execute 399 sec latency 31.504 ms 2023-09-21T13:05:59.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 908307 8.87 MB/sec execute 400 sec latency 14.945 ms 2023-09-21T13:06:00.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:05:59 smithi156 ceph-mon[134078]: pgmap v302: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:00.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:05:59 smithi142 ceph-mon[97663]: pgmap v302: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:00.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:05:59 smithi160 ceph-mon[134450]: pgmap v302: 97 pgs: 97 active+clean; 270 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:00.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 909908 8.87 MB/sec execute 401 sec latency 10.912 ms 2023-09-21T13:06:01.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 911268 8.86 MB/sec execute 402 sec latency 32.783 ms 2023-09-21T13:06:02.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:01 smithi156 ceph-mon[134078]: pgmap v303: 97 pgs: 97 active+clean; 278 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 298 op/s 2023-09-21T13:06:02.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:01 smithi142 ceph-mon[97663]: pgmap v303: 97 pgs: 97 active+clean; 278 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 298 op/s 2023-09-21T13:06:02.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:01 smithi160 ceph-mon[134450]: pgmap v303: 97 pgs: 97 active+clean; 278 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.7 MiB/s wr, 298 op/s 2023-09-21T13:06:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 -- 172.21.15.142:0/4090251339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc105010 msgr2=0x7f4fdc10cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/4090251339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc105010 0x7f4fdc10cb90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b0d0 tx=0x7f4fd400b3e0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 -- 172.21.15.142:0/4090251339 shutdown_connections 2023-09-21T13:06:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/4090251339 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc100120 0x7f4fdc100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/4090251339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc105010 0x7f4fdc10cb90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/4090251339 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100ad0 0x7f4fdc1048e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 -- 172.21.15.142:0/4090251339 >> 172.21.15.142:0/4090251339 conn(0x7f4fdc076800 msgr2=0x7f4fdc076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 -- 172.21.15.142:0/4090251339 shutdown_connections 2023-09-21T13:06:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.406+0000 7f4fe43ff700 1 -- 172.21.15.142:0/4090251339 wait complete. 2023-09-21T13:06:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.407+0000 7f4fe43ff700 1 Processor -- start 2023-09-21T13:06:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.407+0000 7f4fe43ff700 1 -- start start 2023-09-21T13:06:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 0x7f4fdc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc19dd40 0x7f4fdc19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19e7c0 con 0x7f4fdc105010 2023-09-21T13:06:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19e930 con 0x7f4fdc100120 2023-09-21T13:06:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe43ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fdc19eaf0 con 0x7f4fdc19dd40 2023-09-21T13:06:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc19dd40 0x7f4fdc19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35370/0 (socket says 172.21.15.142:35370) 2023-09-21T13:06:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 -- 172.21.15.142:0/3906097747 learned_addr learned my addr 172.21.15.142:0/3906097747 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe199a700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 0x7f4fdc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 -- 172.21.15.142:0/3906097747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc19dd40 msgr2=0x7f4fdc19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc19dd40 0x7f4fdc19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 -- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 msgr2=0x7f4fdc1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 0x7f4fdc1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe219b700 1 -- 172.21.15.142:0/3906097747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4009d00 con 0x7f4fdc100120 2023-09-21T13:06:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.408+0000 7f4fe199a700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 0x7f4fdc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e9a0 tx=0x7f4fd800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fd37fe700 1 -- 172.21.15.142:0/3906097747 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8009790 con 0x7f4fdc100120 2023-09-21T13:06:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fd37fe700 1 -- 172.21.15.142:0/3906097747 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fd800cbd0 con 0x7f4fdc100120 2023-09-21T13:06:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fdc1a5ff0 con 0x7f4fdc100120 2023-09-21T13:06:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fd37fe700 1 -- 172.21.15.142:0/3906097747 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8018680 con 0x7f4fdc100120 2023-09-21T13:06:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.409+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc1a6520 con 0x7f4fdc100120 2023-09-21T13:06:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.414+0000 7f4fd37fe700 1 -- 172.21.15.142:0/3906097747 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4fd800cd40 con 0x7f4fdc100120 2023-09-21T13:06:02.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 Processor -- start 2023-09-21T13:06:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 -- start start 2023-09-21T13:06:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf415480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf41a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf389c40 con 0x562aaf4150a0 2023-09-21T13:06:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf36dc10 con 0x562aaf419e50 2023-09-21T13:06:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf36b530 con 0x562aaf4159c0 2023-09-21T13:06:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.415+0000 7f4fd37fe700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 0x7f4fc80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fd37fe700 1 -- 172.21.15.142:0/3906097747 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4fd8014070 con 0x7f4fdc100120 2023-09-21T13:06:02.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:42612/0 (socket says 172.21.15.142:42612) 2023-09-21T13:06:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 -- 172.21.15.142:0/3815181740 learned_addr learned my addr 172.21.15.142:0/3815181740 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe199a700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf41a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe299c700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf415480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 -- 172.21.15.142:0/3815181740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 msgr2=0x562aaf41a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe299c700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 0x7f4fc80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf41a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 -- 172.21.15.142:0/3815181740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 msgr2=0x562aaf415480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf415480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 -- 172.21.15.142:0/3815181740 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aaf191d80 con 0x562aaf4159c0 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe199a700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf41a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.416+0000 7f4fe219b700 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c5b0 tx=0x7f4fd80991f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5122aeb1b36cada1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.417+0000 7f4fd0bfe700 1 -- 172.21.15.142:0/3815181740 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8099630 con 0x562aaf4159c0 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.417+0000 7f4fd0bfe700 1 -- 172.21.15.142:0/3815181740 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fd809d460 con 0x562aaf4159c0 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.417+0000 7f4fd0bfe700 1 -- 172.21.15.142:0/3815181740 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8099890 con 0x562aaf4159c0 2023-09-21T13:06:02.425 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4fe299c700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 0x7f4fc80a2cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40060b0 tx=0x7f4fd400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/3815181740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 msgr2=0x562aaf419910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800c5b0 tx=0x7f4fd80991f0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/3815181740 shutdown_connections 2023-09-21T13:06:02.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf415480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf41a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/3815181740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf419910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/3815181740 >> 172.21.15.142:0/3815181740 conn(0x562aaf341fa0 msgr2=0x562aaf4100c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/3815181740 shutdown_connections 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.418+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/3815181740 wait complete. 2023-09-21T13:06:02.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.419+0000 7f4ff7dd1b80 1 -- start start 2023-09-21T13:06:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.419+0000 7f4ff7dd1b80 1 Processor -- start 2023-09-21T13:06:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 0x562aaf41e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 0x562aaf41f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf366e20 con 0x562aaf419e50 2023-09-21T13:06:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf3036e0 con 0x562aaf4150a0 2023-09-21T13:06:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf303380 con 0x562aaf4159c0 2023-09-21T13:06:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4ff7dd1b80 10 client.0 _ll_register_callbacks cb 0x562aaf24da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:42628/0 (socket says 172.21.15.142:42628) 2023-09-21T13:06:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 -- 172.21.15.142:0/1280051078 learned_addr learned my addr 172.21.15.142:0/1280051078 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 0x562aaf41e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 0x562aaf41f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 -- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 msgr2=0x562aaf41e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 0x562aaf41e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 -- 172.21.15.142:0/1280051078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 msgr2=0x562aaf41f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 0x562aaf41f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe199a700 1 -- 172.21.15.142:0/1280051078 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc1a6520 con 0x562aaf4159c0 2023-09-21T13:06:02.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 0x562aaf41e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.420+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 0x562aaf41f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fe199a700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc012780 tx=0x7f4fcc012a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fadc516f4181c92 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0106f0 con 0x562aaf4159c0 2023-09-21T13:06:02.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aaf2d7b50 con 0x562aaf4159c0 2023-09-21T13:06:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4fcc010850 con 0x562aaf4159c0 2023-09-21T13:06:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fcc010a10 con 0x562aaf4159c0 2023-09-21T13:06:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4ff7dd1b80 10 client.27604 fetch_fsmap learned FSMap version 40 2023-09-21T13:06:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x562aaf17ac00 con 0x562aaf4159c0 2023-09-21T13:06:02.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.421+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fcc029020 con 0x562aaf4159c0 2023-09-21T13:06:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 40) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4fcc0243d0 con 0x562aaf4159c0 2023-09-21T13:06:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 10 client.27604 fetch_fsmap finished waiting for FSMap version 40 2023-09-21T13:06:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 10 client.27604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 20 client.27604 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:02.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf42eee0 0x562aaf431300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 4 client.27604 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aaf3e3fc0 con 0x562aaf42eee0 2023-09-21T13:06:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.422+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf42eee0 0x562aaf431300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.423+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf42eee0 0x562aaf431300 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37d645bfc9a22613 server_cookie=8a4ae322cbe2a8de in_seq=0 out_seq=0 2023-09-21T13:06:02.435 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.423+0000 7f4fc5ffb700 10 client.27604 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.424+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1280051078 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562aaf3e3fc0 con 0x562aaf42eee0 2023-09-21T13:06:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.424+0000 7f4fc5ffb700 10 client.27604 handle_command_reply: tid=0 2023-09-21T13:06:02.436 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.424+0000 7f4ff7dd1b80 1 client.27604 shutdown 2023-09-21T13:06:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.424+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 msgr2=0x562aaf41ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.424+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc012780 tx=0x7f4fcc012a90 comp rx=0 tx=0).stop 2023-09-21T13:06:02.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 shutdown_connections 2023-09-21T13:06:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf42eee0 0x562aaf431300 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf419e50 0x562aaf41f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4150a0 0x562aaf41e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1280051078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4159c0 0x562aaf41ee70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4fc5ffb700 0 client.27604 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 >> 172.21.15.142:0/1280051078 conn(0x562aaf341fa0 msgr2=0x562aaf40fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 shutdown_connections 2023-09-21T13:06:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1280051078 wait complete. 2023-09-21T13:06:02.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.425+0000 7f4ff7dd1b80 20 client.27604 trim_cache size 0 max 16384 2023-09-21T13:06:02.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.448+0000 7f4ff7dd1b80 1 Processor -- start 2023-09-21T13:06:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 -- start start 2023-09-21T13:06:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4150a0 0x562aaf417740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4159c0 0x562aaf425fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf1e78c0 con 0x562aaf4159c0 2023-09-21T13:06:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf426570 con 0x562aaf419e50 2023-09-21T13:06:02.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf419bc0 con 0x562aaf4150a0 2023-09-21T13:06:02.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4fe299c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4fe199a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4159c0 0x562aaf425fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4fe299c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35408/0 (socket says 172.21.15.142:35408) 2023-09-21T13:06:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4fe299c700 1 -- 172.21.15.142:0/2043274089 learned_addr learned my addr 172.21.15.142:0/2043274089 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.449+0000 7f4fe219b700 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4150a0 0x562aaf417740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 -- 172.21.15.142:0/2043274089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4150a0 msgr2=0x562aaf417740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4150a0 0x562aaf417740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 -- 172.21.15.142:0/2043274089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4159c0 msgr2=0x562aaf425fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4159c0 0x562aaf425fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 -- 172.21.15.142:0/2043274089 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aaf1b81f0 con 0x562aaf419e50 2023-09-21T13:06:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fe299c700 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4008f70 tx=0x7f4fd4006040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=967ec2fade6d3378 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.450+0000 7f4fd13ff700 1 -- 172.21.15.142:0/2043274089 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd400e040 con 0x562aaf419e50 2023-09-21T13:06:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4fd13ff700 1 -- 172.21.15.142:0/2043274089 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fd4006160 con 0x562aaf419e50 2023-09-21T13:06:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4fd13ff700 1 -- 172.21.15.142:0/2043274089 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40055b0 con 0x562aaf419e50 2023-09-21T13:06:02.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/2043274089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 msgr2=0x562aaf419650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4008f70 tx=0x7f4fd4006040 comp rx=0 tx=0).stop 2023-09-21T13:06:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/2043274089 shutdown_connections 2023-09-21T13:06:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf419e50 0x562aaf419650 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf4150a0 0x562aaf417740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/2043274089 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4159c0 0x562aaf425fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.451+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/2043274089 >> 172.21.15.142:0/2043274089 conn(0x562aaf341fa0 msgr2=0x562aaf418f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.452+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/2043274089 shutdown_connections 2023-09-21T13:06:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.452+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/2043274089 wait complete. 2023-09-21T13:06:02.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.452+0000 7f4ff7dd1b80 1 -- start start 2023-09-21T13:06:02.455 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.452+0000 7f4ff7dd1b80 1 Processor -- start 2023-09-21T13:06:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf425760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 0x562aaf421fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf4226c0 con 0x562aaf4150a0 2023-09-21T13:06:02.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf422830 con 0x562aaf4159c0 2023-09-21T13:06:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaf4229f0 con 0x562aaf419e50 2023-09-21T13:06:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4ff7dd1b80 10 client.0 _ll_register_callbacks cb 0x562aaf24da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4fe199a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.453+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf425760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe199a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35418/0 (socket says 172.21.15.142:35418) 2023-09-21T13:06:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe219b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf425760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45436/0 (socket says 172.21.15.142:45436) 2023-09-21T13:06:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 0x562aaf421fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe199a700 1 -- 172.21.15.142:0/1804739580 learned_addr learned my addr 172.21.15.142:0/1804739580 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 -- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 msgr2=0x562aaf425ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 -- 172.21.15.142:0/1804739580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 msgr2=0x562aaf425760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf425760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 -- 172.21.15.142:0/1804739580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fdc0681d0 con 0x562aaf419e50 2023-09-21T13:06:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe199a700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fe299c700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 0x562aaf421fb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b770 tx=0x7f4fd4003cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dffd9a77855f0ee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.454+0000 7f4fc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd40054f0 con 0x562aaf419e50 2023-09-21T13:06:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fd809d460 con 0x562aaf419e50 2023-09-21T13:06:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4fd4023070 con 0x562aaf419e50 2023-09-21T13:06:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4fd4005650 con 0x562aaf419e50 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4ff7dd1b80 10 client.27610 fetch_fsmap learned FSMap version 40 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x562aaf190250 con 0x562aaf419e50 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.455+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fd809d460 con 0x562aaf419e50 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 40) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4fd401e430 con 0x562aaf419e50 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 10 client.27610 fetch_fsmap finished waiting for FSMap version 40 2023-09-21T13:06:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 10 client.27610 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 20 client.27610 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf4839b0 0x562aaf485dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 4 client.27610 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:06:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562aaf35fe00 con 0x562aaf4839b0 2023-09-21T13:06:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf4839b0 0x562aaf485dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4fc5ffb700 10 client.27610 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.456+0000 7f4fe219b700 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf4839b0 0x562aaf485dd0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6603bcc466ae8d8a server_cookie=de5b02e058cb2af7 in_seq=0 out_seq=0 2023-09-21T13:06:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.522+0000 7f4fc5ffb700 1 -- 172.21.15.142:0/1804739580 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562aaf35fe00 con 0x562aaf4839b0 2023-09-21T13:06:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.522+0000 7f4fc5ffb700 10 client.27610 handle_command_reply: tid=0 2023-09-21T13:06:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.522+0000 7f4ff7dd1b80 1 client.27610 shutdown 2023-09-21T13:06:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 msgr2=0x562aaf421fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 0x562aaf421fb0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4fd400b770 tx=0x7f4fd4003cb0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 shutdown_connections 2023-09-21T13:06:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562aaf4839b0 0x562aaf485dd0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562aaf4150a0 0x562aaf425760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aaf419e50 0x562aaf421fb0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 --2- 172.21.15.142:0/1804739580 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562aaf4159c0 0x562aaf425ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 >> 172.21.15.142:0/1804739580 conn(0x562aaf341fa0 msgr2=0x562aaf41eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.523+0000 7f4fc5ffb700 0 client.27610 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.524+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 shutdown_connections 2023-09-21T13:06:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.524+0000 7f4ff7dd1b80 1 -- 172.21.15.142:0/1804739580 wait complete. 2023-09-21T13:06:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.524+0000 7f4ff7dd1b80 20 client.27610 trim_cache size 0 max 16384 2023-09-21T13:06:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:06:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:06:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:06:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:06:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.526+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 msgr2=0x7f4fc80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.526+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 0x7f4fc80a2cf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40060b0 tx=0x7f4fd400b040 comp rx=0 tx=0).stop 2023-09-21T13:06:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.526+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 msgr2=0x7f4fdc199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.526+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800e9a0 tx=0x7f4fd800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 shutdown_connections 2023-09-21T13:06:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4fc80a0830 0x7f4fc80a2cf0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4fdc19dd40 0x7f4fdc19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4fdc100120 0x7f4fdc199190 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 --2- 172.21.15.142:0/3906097747 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4fdc105010 0x7f4fdc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 >> 172.21.15.142:0/3906097747 conn(0x7f4fdc076800 msgr2=0x7f4fdc10b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 shutdown_connections 2023-09-21T13:06:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:02.529+0000 7f4fe43ff700 1 -- 172.21.15.142:0/3906097747 wait complete. 2023-09-21T13:06:02.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 912521 8.86 MB/sec execute 403 sec latency 59.698 ms 2023-09-21T13:06:03.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:02 smithi156 ceph-mon[134078]: osdmap e95: 12 total, 12 up, 12 in 2023-09-21T13:06:03.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:02 smithi142 ceph-mon[97663]: osdmap e95: 12 total, 12 up, 12 in 2023-09-21T13:06:03.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:02 smithi160 ceph-mon[134450]: osdmap e95: 12 total, 12 up, 12 in 2023-09-21T13:06:03.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 913900 8.86 MB/sec execute 404 sec latency 15.154 ms 2023-09-21T13:06:04.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:03 smithi156 ceph-mon[134078]: pgmap v305: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:04.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:03 smithi142 ceph-mon[97663]: pgmap v305: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:03 smithi160 ceph-mon[134450]: pgmap v305: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:04.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 916125 8.87 MB/sec execute 405 sec latency 24.448 ms 2023-09-21T13:06:05.702 INFO:tasks.workunit.client.0.smithi142.stdout: 1 916951 8.87 MB/sec execute 406 sec latency 71.025 ms 2023-09-21T13:06:06.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:05 smithi156 ceph-mon[134078]: pgmap v306: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:06.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:05 smithi142 ceph-mon[97663]: pgmap v306: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:05 smithi160 ceph-mon[134450]: pgmap v306: 97 pgs: 97 active+clean; 280 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.1 MiB/s wr, 206 op/s 2023-09-21T13:06:06.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 918374 8.89 MB/sec execute 407 sec latency 17.611 ms 2023-09-21T13:06:07.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 920473 8.90 MB/sec execute 408 sec latency 15.439 ms 2023-09-21T13:06:08.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:07 smithi156 ceph-mon[134078]: pgmap v307: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:08.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:07 smithi142 ceph-mon[97663]: pgmap v307: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:08.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:07 smithi160 ceph-mon[134450]: pgmap v307: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:08.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 921821 8.89 MB/sec execute 409 sec latency 16.058 ms 2023-09-21T13:06:09.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 923948 8.90 MB/sec execute 410 sec latency 15.628 ms 2023-09-21T13:06:10.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:09 smithi156 ceph-mon[134078]: pgmap v308: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:10.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:09 smithi142 ceph-mon[97663]: pgmap v308: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:09 smithi160 ceph-mon[134450]: pgmap v308: 97 pgs: 97 active+clean; 273 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-09-21T13:06:10.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924395 8.88 MB/sec execute 411 sec latency 207.040 ms 2023-09-21T13:06:11.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:10 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:06:11.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:10 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:06:11.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:10 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:06:11.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924395 8.86 MB/sec execute 412 sec latency 1207.080 ms 2023-09-21T13:06:12.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:11 smithi156 ceph-mon[134078]: pgmap v309: 97 pgs: 97 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-21T13:06:12.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:11 smithi156 ceph-mon[134078]: osdmap e96: 12 total, 12 up, 12 in 2023-09-21T13:06:12.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:11 smithi142 ceph-mon[97663]: pgmap v309: 97 pgs: 97 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-21T13:06:12.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:11 smithi142 ceph-mon[97663]: osdmap e96: 12 total, 12 up, 12 in 2023-09-21T13:06:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:11 smithi160 ceph-mon[134450]: pgmap v309: 97 pgs: 97 active+clean; 280 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-21T13:06:12.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:11 smithi160 ceph-mon[134450]: osdmap e96: 12 total, 12 up, 12 in 2023-09-21T13:06:12.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924395 8.84 MB/sec execute 413 sec latency 2207.140 ms 2023-09-21T13:06:13.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924395 8.82 MB/sec execute 414 sec latency 3207.185 ms 2023-09-21T13:06:14.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:13 smithi156 ceph-mon[134078]: pgmap v311: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:14.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:13 smithi142 ceph-mon[97663]: pgmap v311: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:14.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:13 smithi160 ceph-mon[134450]: pgmap v311: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:14.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924395 8.80 MB/sec execute 415 sec latency 4207.224 ms 2023-09-21T13:06:15.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 924663 8.78 MB/sec execute 416 sec latency 4857.640 ms 2023-09-21T13:06:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.722+0000 7f2a72b9d700 1 -- 172.21.15.142:0/3618757951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 msgr2=0x7f2a6c10cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.722+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/3618757951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c10cf30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0098f0 tx=0x7f2a5c009c00 comp rx=0 tx=0).stop 2023-09-21T13:06:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 -- 172.21.15.142:0/3618757951 shutdown_connections 2023-09-21T13:06:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/3618757951 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 0x7f2a6c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/3618757951 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c10f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/3618757951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c10cf30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 -- 172.21.15.142:0/3618757951 >> 172.21.15.142:0/3618757951 conn(0x7f2a6c0fc680 msgr2=0x7f2a6c0feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 -- 172.21.15.142:0/3618757951 shutdown_connections 2023-09-21T13:06:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.723+0000 7f2a72b9d700 1 -- 172.21.15.142:0/3618757951 wait complete. 2023-09-21T13:06:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 Processor -- start 2023-09-21T13:06:15.723 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 -- start start 2023-09-21T13:06:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 0x7f2a6c198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c1994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c19df90 con 0x7f2a6c0731b0 2023-09-21T13:06:15.724 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c19e100 con 0x7f2a6c10d470 2023-09-21T13:06:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.724+0000 7f2a72b9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a6c19e2c0 con 0x7f2a6c073ad0 2023-09-21T13:06:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 0x7f2a6c198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7139a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c1994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35524/0 (socket says 172.21.15.142:35524) 2023-09-21T13:06:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 -- 172.21.15.142:0/524796251 learned_addr learned my addr 172.21.15.142:0/524796251 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 -- 172.21.15.142:0/524796251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 msgr2=0x7f2a6c1994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c1994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 -- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 msgr2=0x7f2a6c198fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.726 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 0x7f2a6c198fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 -- 172.21.15.142:0/524796251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a64009d00 con 0x7f2a6c10d470 2023-09-21T13:06:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7139a700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.725+0000 7f2a7239c700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400c3d0 tx=0x7f2a6400c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.726+0000 7f2a62ffd700 1 -- 172.21.15.142:0/524796251 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6400e050 con 0x7f2a6c10d470 2023-09-21T13:06:15.727 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.726+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c009520 con 0x7f2a6c10d470 2023-09-21T13:06:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.726+0000 7f2a62ffd700 1 -- 172.21.15.142:0/524796251 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a6400f040 con 0x7f2a6c10d470 2023-09-21T13:06:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.726+0000 7f2a62ffd700 1 -- 172.21.15.142:0/524796251 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a64004590 con 0x7f2a6c10d470 2023-09-21T13:06:15.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.726+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c1a5c00 con 0x7f2a6c10d470 2023-09-21T13:06:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.729+0000 7f2a62ffd700 1 -- 172.21.15.142:0/524796251 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2a640046f0 con 0x7f2a6c10d470 2023-09-21T13:06:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.730+0000 7f2a876feb80 1 Processor -- start 2023-09-21T13:06:15.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.730+0000 7f2a876feb80 1 -- start start 2023-09-21T13:06:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a62ffd700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 0x7f2a580a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff36ec40 con 0x556cff400780 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff352c10 con 0x556cff3ffe60 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a876feb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff350530 con 0x556cff3fa7a0 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a62ffd700 1 -- 172.21.15.142:0/524796251 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a640cbc60 con 0x7f2a6c10d470 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35530/0 (socket says 172.21.15.142:35530) 2023-09-21T13:06:15.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3804808922 learned_addr learned my addr 172.21.15.142:0/3804808922 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a7139a700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 0x7f2a580a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.731+0000 7f2a7239c700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a7139a700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3804808922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 msgr2=0x556cff3fabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fabe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3804808922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 msgr2=0x556cff3fa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3804808922 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cff176d80 con 0x556cff3ffe60 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a7239c700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:15.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d80 tx=0x7f2a68011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae2668b9feb43397 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a7139a700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 0x7f2a580a2c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c005e90 tx=0x7f2a5c00f740 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a57fff700 1 -- 172.21.15.142:0/3804808922 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68004230 con 0x556cff3ffe60 2023-09-21T13:06:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a57fff700 1 -- 172.21.15.142:0/3804808922 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a68004390 con 0x556cff3ffe60 2023-09-21T13:06:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.732+0000 7f2a57fff700 1 -- 172.21.15.142:0/3804808922 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680197a0 con 0x556cff3ffe60 2023-09-21T13:06:15.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 -- 172.21.15.142:0/3804808922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 msgr2=0x556cff400240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2a68009d80 tx=0x7f2a68011720 comp rx=0 tx=0).stop 2023-09-21T13:06:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 -- 172.21.15.142:0/3804808922 shutdown_connections 2023-09-21T13:06:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff400240 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3804808922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 -- 172.21.15.142:0/3804808922 >> 172.21.15.142:0/3804808922 conn(0x556cff326fa0 msgr2=0x556cff3f5180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 -- 172.21.15.142:0/3804808922 shutdown_connections 2023-09-21T13:06:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.733+0000 7f2a876feb80 1 -- 172.21.15.142:0/3804808922 wait complete. 2023-09-21T13:06:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.734+0000 7f2a876feb80 1 -- start start 2023-09-21T13:06:15.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.734+0000 7f2a876feb80 1 Processor -- start 2023-09-21T13:06:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff4067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff34be20 con 0x556cff3ffe60 2023-09-21T13:06:15.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff2e86e0 con 0x556cff400780 2023-09-21T13:06:15.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff2e8380 con 0x556cff3fa7a0 2023-09-21T13:06:15.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a876feb80 10 client.0 _ll_register_callbacks cb 0x556cff232a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:15.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45704/0 (socket says 172.21.15.142:45704) 2023-09-21T13:06:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7139a700 1 -- 172.21.15.142:0/3998414397 learned_addr learned my addr 172.21.15.142:0/3998414397 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff4067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 -- 172.21.15.142:0/3998414397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 msgr2=0x556cff4067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff4067d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 -- 172.21.15.142:0/3998414397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 msgr2=0x556cff4039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.735+0000 7f2a7239c700 1 -- 172.21.15.142:0/3998414397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6c1a5c00 con 0x556cff400780 2023-09-21T13:06:15.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a7239c700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c9350 tx=0x7f2a64003b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cea6005eae3851b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6409c070 con 0x556cff400780 2023-09-21T13:06:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556cff2bcb50 con 0x556cff400780 2023-09-21T13:06:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a6409cee0 con 0x556cff400780 2023-09-21T13:06:15.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a64003e00 con 0x556cff400780 2023-09-21T13:06:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 10 client.27668 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f2a680099e0 con 0x556cff400780 2023-09-21T13:06:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556cff2bcb50 con 0x556cff400780 2023-09-21T13:06:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2a64099380 con 0x556cff400780 2023-09-21T13:06:15.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 10 client.27668 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 10 client.27668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 20 client.27668 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.736+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff414180 0x556cff4165a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.737+0000 7f2a876feb80 4 client.27668 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:15.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.737+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556cff3c8fc0 con 0x556cff414180 2023-09-21T13:06:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.737+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff414180 0x556cff4165a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.737+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff414180 0x556cff4165a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05725ab517b0c45 server_cookie=6b297b1533fb093c in_seq=0 out_seq=0 2023-09-21T13:06:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.737+0000 7f2a557fa700 10 client.27668 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a557fa700 1 -- 172.21.15.142:0/3998414397 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556cff3c8fc0 con 0x556cff414180 2023-09-21T13:06:15.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a557fa700 10 client.27668 handle_command_reply: tid=0 2023-09-21T13:06:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 client.27668 shutdown 2023-09-21T13:06:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 msgr2=0x556cff403fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403fd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2a640c9350 tx=0x7f2a64003b40 comp rx=0 tx=0).stop 2023-09-21T13:06:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 shutdown_connections 2023-09-21T13:06:15.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff414180 0x556cff4165a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403fd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a557fa700 0 client.27668 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff4067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3998414397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.738+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 >> 172.21.15.142:0/3998414397 conn(0x556cff326fa0 msgr2=0x556cff3f4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.739+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 shutdown_connections 2023-09-21T13:06:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.739+0000 7f2a876feb80 1 -- 172.21.15.142:0/3998414397 wait complete. 2023-09-21T13:06:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.739+0000 7f2a876feb80 20 client.27668 trim_cache size 0 max 16384 2023-09-21T13:06:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 Processor -- start 2023-09-21T13:06:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 -- start start 2023-09-21T13:06:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff406300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff1cc8c0 con 0x556cff3ffe60 2023-09-21T13:06:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff4045d0 con 0x556cff400780 2023-09-21T13:06:15.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a876feb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff401f80 con 0x556cff3fa7a0 2023-09-21T13:06:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a7239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.757+0000 7f2a7139a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff406300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a7239c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35554/0 (socket says 172.21.15.142:35554) 2023-09-21T13:06:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a7239c700 1 -- 172.21.15.142:0/3060609253 learned_addr learned my addr 172.21.15.142:0/3060609253 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3060609253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 msgr2=0x556cff403ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3060609253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 msgr2=0x556cff4039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 -- 172.21.15.142:0/3060609253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556cff15fc00 con 0x556cff3fa7a0 2023-09-21T13:06:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff406300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000c00 tx=0x7f2a68009fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97eef74db3a2cdf0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a60bff700 1 -- 172.21.15.142:0/3060609253 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68004140 con 0x556cff3fa7a0 2023-09-21T13:06:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a60bff700 1 -- 172.21.15.142:0/3060609253 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a68003b40 con 0x556cff3fa7a0 2023-09-21T13:06:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.758+0000 7f2a60bff700 1 -- 172.21.15.142:0/3060609253 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a680052a0 con 0x556cff3fa7a0 2023-09-21T13:06:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 -- 172.21.15.142:0/3060609253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 msgr2=0x556cff406300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff406300 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2a68000c00 tx=0x7f2a68009fd0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 -- 172.21.15.142:0/3060609253 shutdown_connections 2023-09-21T13:06:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff400780 0x556cff403ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff406300 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 --2- 172.21.15.142:0/3060609253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff3ffe60 0x556cff4039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 -- 172.21.15.142:0/3060609253 >> 172.21.15.142:0/3060609253 conn(0x556cff326fa0 msgr2=0x556cff3fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 -- 172.21.15.142:0/3060609253 shutdown_connections 2023-09-21T13:06:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.759+0000 7f2a876feb80 1 -- 172.21.15.142:0/3060609253 wait complete. 2023-09-21T13:06:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 -- start start 2023-09-21T13:06:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 Processor -- start 2023-09-21T13:06:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff3fc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff467fb0 con 0x556cff400780 2023-09-21T13:06:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff4680f0 con 0x556cff3ffe60 2023-09-21T13:06:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556cff468230 con 0x556cff3fa7a0 2023-09-21T13:06:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.760+0000 7f2a876feb80 10 client.0 _ll_register_callbacks cb 0x556cff232a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47534/0 (socket says 172.21.15.142:47534) 2023-09-21T13:06:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a7139a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff3fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 -- 172.21.15.142:0/938295115 learned_addr learned my addr 172.21.15.142:0/938295115 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a7239c700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 -- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 msgr2=0x556cff3fc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff3fc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 -- 172.21.15.142:0/938295115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 msgr2=0x556cff3fc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 -- 172.21.15.142:0/938295115 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556cff176d80 con 0x556cff3fa7a0 2023-09-21T13:06:15.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a7239c700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:15.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a71b9b700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801b040 tx=0x7f2a68009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87a07a965323dd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a557fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.761+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68003880 con 0x556cff3fa7a0 2023-09-21T13:06:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a68004390 con 0x556cff3fa7a0 2023-09-21T13:06:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2a68004150 con 0x556cff3fa7a0 2023-09-21T13:06:15.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a680039e0 con 0x556cff3fa7a0 2023-09-21T13:06:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 10 client.27628 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x556cff19d1f0 con 0x556cff3fa7a0 2023-09-21T13:06:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a68004390 con 0x556cff3fa7a0 2023-09-21T13:06:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2a6802ba80 con 0x556cff3fa7a0 2023-09-21T13:06:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 10 client.27628 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 10 client.27628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 20 client.27628 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff469670 0x556cff46ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 4 client.27628 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:06:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.762+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556cff344e00 con 0x556cff469670 2023-09-21T13:06:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.763+0000 7f2a7139a700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff469670 0x556cff46ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.763+0000 7f2a7139a700 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff469670 0x556cff46ba90 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ee6465e84991af server_cookie=58a577544be61d74 in_seq=0 out_seq=0 2023-09-21T13:06:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.763+0000 7f2a557fa700 10 client.27628 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.827+0000 7f2a557fa700 1 -- 172.21.15.142:0/938295115 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556cff344e00 con 0x556cff469670 2023-09-21T13:06:15.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.827+0000 7f2a557fa700 10 client.27628 handle_command_reply: tid=0 2023-09-21T13:06:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.827+0000 7f2a876feb80 1 client.27628 shutdown 2023-09-21T13:06:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 msgr2=0x556cff3fbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2a6801b040 tx=0x7f2a68009f60 comp rx=0 tx=0).stop 2023-09-21T13:06:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 shutdown_connections 2023-09-21T13:06:15.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556cff469670 0x556cff46ba90 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556cff400780 0x556cff3fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556cff3fa7a0 0x556cff3fbf00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a557fa700 0 client.27628 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:15.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 --2- 172.21.15.142:0/938295115 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556cff3ffe60 0x556cff3fc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 >> 172.21.15.142:0/938295115 conn(0x556cff326fa0 msgr2=0x556cff3fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 shutdown_connections 2023-09-21T13:06:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 1 -- 172.21.15.142:0/938295115 wait complete. 2023-09-21T13:06:15.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.828+0000 7f2a876feb80 20 client.27628 trim_cache size 0 max 16384 2023-09-21T13:06:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:06:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:06:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:06:15.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:06:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 msgr2=0x7f2a580a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 0x7f2a580a2c70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c005e90 tx=0x7f2a5c00f740 comp rx=0 tx=0).stop 2023-09-21T13:06:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 msgr2=0x7f2a6c19d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2a6400c3d0 tx=0x7f2a6400c6e0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 shutdown_connections 2023-09-21T13:06:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2a580a07b0 0x7f2a580a2c70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2a6c0731b0 0x7f2a6c198fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2a6c10d470 0x7f2a6c19d950 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 --2- 172.21.15.142:0/524796251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2a6c073ad0 0x7f2a6c1994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.829+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 >> 172.21.15.142:0/524796251 conn(0x7f2a6c0fc680 msgr2=0x7f2a6c10f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.830+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 shutdown_connections 2023-09-21T13:06:15.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:15.830+0000 7f2a72b9d700 1 -- 172.21.15.142:0/524796251 wait complete. 2023-09-21T13:06:16.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:15 smithi156 ceph-mon[134078]: pgmap v312: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:16.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:15 smithi142 ceph-mon[97663]: pgmap v312: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:15 smithi160 ceph-mon[134450]: pgmap v312: 97 pgs: 97 active+clean; 282 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.3 MiB/s wr, 266 op/s 2023-09-21T13:06:16.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 926361 8.78 MB/sec execute 417 sec latency 46.295 ms 2023-09-21T13:06:17.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 927769 8.78 MB/sec execute 418 sec latency 15.077 ms 2023-09-21T13:06:18.094 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:06:18.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:17 smithi156 ceph-mon[134078]: pgmap v313: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:18.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:17 smithi142 ceph-mon[97663]: pgmap v313: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:17 smithi160 ceph-mon[134450]: pgmap v313: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:18.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/775429576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e8101f60 msgr2=0x7fe6e8102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/775429576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102340 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4009990 tx=0x7fe6e4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/775429576 shutdown_connections 2023-09-21T13:06:18.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/775429576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e810b330 0x7fe6e810d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/775429576 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102340 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/775429576 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 0x7fe6e810ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.356+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/775429576 >> 172.21.15.142:0/775429576 conn(0x7fe6e80fb740 msgr2=0x7fe6e80fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.357+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/775429576 shutdown_connections 2023-09-21T13:06:18.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.357+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/775429576 wait complete. 2023-09-21T13:06:18.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 Processor -- start 2023-09-21T13:06:18.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 -- start start 2023-09-21T13:06:18.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 0x7fe6e8103310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e810b330 0x7fe6e8103850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81a9770 con 0x7fe6e8102880 2023-09-21T13:06:18.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81a98e0 con 0x7fe6e810b330 2023-09-21T13:06:18.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.358+0000 7fe6ef9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e81a9aa0 con 0x7fe6e8101f60 2023-09-21T13:06:18.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47556/0 (socket says 172.21.15.142:47556) 2023-09-21T13:06:18.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 -- 172.21.15.142:0/609539733 learned_addr learned my addr 172.21.15.142:0/609539733 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:18.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 0x7fe6e8103310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e810b330 0x7fe6e8103850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 -- 172.21.15.142:0/609539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e810b330 msgr2=0x7fe6e8103850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e810b330 0x7fe6e8103850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 -- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 msgr2=0x7fe6e8103310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 0x7fe6e8103310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 -- 172.21.15.142:0/609539733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40095f0 con 0x7fe6e8101f60 2023-09-21T13:06:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.359+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4005910 tx=0x7fe6e4005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.360+0000 7fe6de7fc700 1 -- 172.21.15.142:0/609539733 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e401d070 con 0x7fe6e8101f60 2023-09-21T13:06:18.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.360+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e81a9d20 con 0x7fe6e8101f60 2023-09-21T13:06:18.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.360+0000 7fe6de7fc700 1 -- 172.21.15.142:0/609539733 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e4022470 con 0x7fe6e8101f60 2023-09-21T13:06:18.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.360+0000 7fe6de7fc700 1 -- 172.21.15.142:0/609539733 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e4017650 con 0x7fe6e8101f60 2023-09-21T13:06:18.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.360+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e81aa1d0 con 0x7fe6e8101f60 2023-09-21T13:06:18.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.364+0000 7fe6de7fc700 1 -- 172.21.15.142:0/609539733 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe6e40225e0 con 0x7fe6e8101f60 2023-09-21T13:06:18.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.365+0000 7fe703354b80 1 Processor -- start 2023-09-21T13:06:18.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 -- start start 2023-09-21T13:06:18.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9e79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a95bca0 con 0x55d66a9ec360 2023-09-21T13:06:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a93fc70 con 0x55d66a9e7f30 2023-09-21T13:06:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe703354b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a93d590 con 0x55d66a9e7610 2023-09-21T13:06:18.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe6edf9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9e79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe6edf9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9e79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47562/0 (socket says 172.21.15.142:47562) 2023-09-21T13:06:18.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.366+0000 7fe6edf9c700 1 -- 172.21.15.142:0/1370873595 learned_addr learned my addr 172.21.15.142:0/1370873595 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:18.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6de7fc700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 0x7fe6d40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6de7fc700 1 -- 172.21.15.142:0/609539733 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe6e40cd2f0 con 0x7fe6e8101f60 2023-09-21T13:06:18.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1370873595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 msgr2=0x55d66a9e79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9e79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1370873595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 msgr2=0x55d66a9ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1370873595 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d66a763de0 con 0x55d66a9e7f30 2023-09-21T13:06:18.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 0x7fe6d40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9ebe20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40ca9e0 tx=0x7fe6e4005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37014c26105830b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6d37fe700 1 -- 172.21.15.142:0/1370873595 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40cc070 con 0x55d66a9e7f30 2023-09-21T13:06:18.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6d37fe700 1 -- 172.21.15.142:0/1370873595 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e409a430 con 0x55d66a9e7f30 2023-09-21T13:06:18.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.367+0000 7fe6d37fe700 1 -- 172.21.15.142:0/1370873595 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e409e720 con 0x55d66a9e7f30 2023-09-21T13:06:18.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 -- 172.21.15.142:0/1370873595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 msgr2=0x55d66a9ebe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 0x7fe6d40a2c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00075c0 tx=0x7fe6e0009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9ebe20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6e40ca9e0 tx=0x7fe6e4005f10 comp rx=0 tx=0).stop 2023-09-21T13:06:18.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 -- 172.21.15.142:0/1370873595 shutdown_connections 2023-09-21T13:06:18.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9e79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 --2- 172.21.15.142:0/1370873595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9ebe20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.368+0000 7fe703354b80 1 -- 172.21.15.142:0/1370873595 >> 172.21.15.142:0/1370873595 conn(0x55d66a914000 msgr2=0x55d66a9e26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.369+0000 7fe703354b80 1 -- 172.21.15.142:0/1370873595 shutdown_connections 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.369+0000 7fe703354b80 1 -- 172.21.15.142:0/1370873595 wait complete. 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.369+0000 7fe703354b80 1 -- start start 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.369+0000 7fe703354b80 1 Processor -- start 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a938e80 con 0x55d66a9ec360 2023-09-21T13:06:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a8d5740 con 0x55d66a9e7f30 2023-09-21T13:06:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a8d53e0 con 0x55d66a9e7610 2023-09-21T13:06:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe703354b80 10 client.0 _ll_register_callbacks cb 0x55d66a81fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:18.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47572/0 (socket says 172.21.15.142:47572) 2023-09-21T13:06:18.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1991636149 learned_addr learned my addr 172.21.15.142:0/1991636149 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:18.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.370+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/1991636149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 msgr2=0x55d66a9f3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/1991636149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 msgr2=0x55d66a9f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/1991636149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e81aa1d0 con 0x55d66a9e7f30 2023-09-21T13:06:18.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0d20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6e810c830 tx=0x7fe6d8012960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c045df4555762ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8017070 con 0x55d66a9e7f30 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.371+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe6d8004830 con 0x55d66a9e7f30 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d66a8a9bb0 con 0x55d66a9e7f30 2023-09-21T13:06:18.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6d8004a30 con 0x55d66a9e7f30 2023-09-21T13:06:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe703354b80 10 client.27686 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55d66a74cc60 con 0x55d66a9e7f30 2023-09-21T13:06:18.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d66a8a9bb0 con 0x55d66a9e7f30 2023-09-21T13:06:18.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe6d801c630 con 0x55d66a9e7f30 2023-09-21T13:06:18.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe703354b80 10 client.27686 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:18.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.372+0000 7fe703354b80 10 client.27686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:18.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe703354b80 20 client.27686 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:18.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa010b0 0x55d66aa034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe703354b80 4 client.27686 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d66a9b6020 con 0x55d66aa010b0 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa010b0 0x55d66aa034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe6d0ff9700 10 client.27686 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.373+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa010b0 0x55d66aa034d0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d31397860a40866 server_cookie=d24114129418ad01 in_seq=0 out_seq=0 2023-09-21T13:06:18.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1991636149 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d66a9b6020 con 0x55d66aa010b0 2023-09-21T13:06:18.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe6d0ff9700 10 client.27686 handle_command_reply: tid=0 2023-09-21T13:06:18.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 client.27686 shutdown 2023-09-21T13:06:18.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 msgr2=0x55d66a9f0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0d20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe6e810c830 tx=0x7fe6d8012960 comp rx=0 tx=0).stop 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 shutdown_connections 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa010b0 0x55d66aa034d0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe6d0ff9700 0 client.27686 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:18.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 --2- 172.21.15.142:0/1991636149 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0d20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 >> 172.21.15.142:0/1991636149 conn(0x55d66a914000 msgr2=0x55d66a9e2230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 shutdown_connections 2023-09-21T13:06:18.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.374+0000 7fe703354b80 1 -- 172.21.15.142:0/1991636149 wait complete. 2023-09-21T13:06:18.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.375+0000 7fe703354b80 20 client.27686 trim_cache size 0 max 16384 2023-09-21T13:06:18.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.394+0000 7fe703354b80 1 Processor -- start 2023-09-21T13:06:18.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 -- start start 2023-09-21T13:06:18.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9ec360 0x55d66a9ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a7b9920 con 0x55d66a9e7f30 2023-09-21T13:06:18.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a9e8490 con 0x55d66a9ec360 2023-09-21T13:06:18.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe703354b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a9e3ed0 con 0x55d66a9e7610 2023-09-21T13:06:18.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe6ecf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe6ecf9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:45794/0 (socket says 172.21.15.142:45794) 2023-09-21T13:06:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/3380569002 learned_addr learned my addr 172.21.15.142:0/3380569002 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe6edf9c700 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9ec360 0x55d66a9ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.395+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/3380569002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 msgr2=0x55d66a9f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/3380569002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9ec360 msgr2=0x55d66a9ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9ec360 0x55d66a9ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 -- 172.21.15.142:0/3380569002 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d66aa08100 con 0x55d66a9e7f30 2023-09-21T13:06:18.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8000c00 tx=0x7fe6d8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e6237218abfa41 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6d3fff700 1 -- 172.21.15.142:0/3380569002 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d8017050 con 0x55d66a9e7f30 2023-09-21T13:06:18.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6d3fff700 1 -- 172.21.15.142:0/3380569002 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6d8018040 con 0x55d66a9e7f30 2023-09-21T13:06:18.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.396+0000 7fe6d3fff700 1 -- 172.21.15.142:0/3380569002 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d80038e0 con 0x55d66a9e7f30 2023-09-21T13:06:18.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 -- 172.21.15.142:0/3380569002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 msgr2=0x55d66a9f0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8000c00 tx=0x7fe6d8009750 comp rx=0 tx=0).stop 2023-09-21T13:06:18.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 -- 172.21.15.142:0/3380569002 shutdown_connections 2023-09-21T13:06:18.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9ec360 0x55d66a9ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.400 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 --2- 172.21.15.142:0/3380569002 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9e7f30 0x55d66a9f0520 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 -- 172.21.15.142:0/3380569002 >> 172.21.15.142:0/3380569002 conn(0x55d66a914000 msgr2=0x55d66a9ea3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.397+0000 7fe703354b80 1 -- 172.21.15.142:0/3380569002 shutdown_connections 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.398+0000 7fe703354b80 1 -- 172.21.15.142:0/3380569002 wait complete. 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.398+0000 7fe703354b80 1 -- start start 2023-09-21T13:06:18.401 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.398+0000 7fe703354b80 1 Processor -- start 2023-09-21T13:06:18.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.402 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a9f3ed0 con 0x55d66a9ec360 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a9f30b0 con 0x55d66a9e7f30 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d66a9f3270 con 0x55d66a9e7610 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe703354b80 10 client.0 _ll_register_callbacks cb 0x55d66a81fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ecf9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.403 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:47596/0 (socket says 172.21.15.142:47596) 2023-09-21T13:06:18.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ecf9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:35628/0 (socket says 172.21.15.142:35628) 2023-09-21T13:06:18.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1914456036 learned_addr learned my addr 172.21.15.142:0/1914456036 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:18.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 msgr2=0x55d66a9f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1914456036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 msgr2=0x55d66a9f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.399+0000 7fe6ed79b700 1 -- 172.21.15.142:0/1914456036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d66a74cc60 con 0x55d66a9e7610 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6ed79b700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400f740 tx=0x7fe6e4022f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56552df30b240065 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:18.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6e40cc040 con 0x55d66a9e7610 2023-09-21T13:06:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe6e40a28d0 con 0x55d66a9e7610 2023-09-21T13:06:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe6e409a430 con 0x55d66a9e7610 2023-09-21T13:06:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6e409e720 con 0x55d66a9e7610 2023-09-21T13:06:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe703354b80 10 client.27646 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:18.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55d66a78a250 con 0x55d66a9e7610 2023-09-21T13:06:18.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe6e409a430 con 0x55d66a9e7610 2023-09-21T13:06:18.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.400+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe6e4099de0 con 0x55d66a9e7610 2023-09-21T13:06:18.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 10 client.27646 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:18.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 10 client.27646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:18.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 20 client.27646 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:18.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa55d80 0x55d66aa581a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:18.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 4 client.27646 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:06:18.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d66a931e60 con 0x55d66aa55d80 2023-09-21T13:06:18.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa55d80 0x55d66aa581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:18.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe6ecf9a700 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa55d80 0x55d66aa581a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5912186a01f41fe server_cookie=7e54d5f16e023623 in_seq=0 out_seq=0 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.401+0000 7fe6d0ff9700 10 client.27646 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe6d0ff9700 1 -- 172.21.15.142:0/1914456036 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55d66a931e60 con 0x55d66aa55d80 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe6d0ff9700 10 client.27646 handle_command_reply: tid=0 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 client.27646 shutdown 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 msgr2=0x55d66a9f3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe6e400f740 tx=0x7fe6e4022f90 comp rx=0 tx=0).stop 2023-09-21T13:06:18.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 shutdown_connections 2023-09-21T13:06:18.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55d66aa55d80 0x55d66aa581a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55d66a9ec360 0x55d66a9f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55d66a9e7610 0x55d66a9f3790 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 --2- 172.21.15.142:0/1914456036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55d66a9e7f30 0x55d66a9f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 >> 172.21.15.142:0/1914456036 conn(0x55d66a914000 msgr2=0x55d66a9e6410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe6d0ff9700 0 client.27646 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 shutdown_connections 2023-09-21T13:06:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 1 -- 172.21.15.142:0/1914456036 wait complete. 2023-09-21T13:06:18.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.402+0000 7fe703354b80 20 client.27646 trim_cache size 0 max 16384 2023-09-21T13:06:18.412 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:06:18.412 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:06:18.412 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:06:18.412 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:06:18.413 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:06:18.413 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:06:18.413 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:06:18.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:06:18.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:06:18.414 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:06:18.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 msgr2=0x7fe6d40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 0x7fe6d40a2c70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe6e00075c0 tx=0x7fe6e0009040 comp rx=0 tx=0).stop 2023-09-21T13:06:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 msgr2=0x7fe6e8102dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe6e4005910 tx=0x7fe6e4005720 comp rx=0 tx=0).stop 2023-09-21T13:06:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 shutdown_connections 2023-09-21T13:06:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6d40a07b0 0x7fe6d40a2c70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe6e810b330 0x7fe6e8103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe6e8101f60 0x7fe6e8102dd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 --2- 172.21.15.142:0/609539733 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6e8102880 0x7fe6e8103310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:18.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.403+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 >> 172.21.15.142:0/609539733 conn(0x7fe6e80fb740 msgr2=0x7fe6e810d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:18.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.404+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 shutdown_connections 2023-09-21T13:06:18.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:18.404+0000 7fe6ef9ff700 1 -- 172.21.15.142:0/609539733 wait complete. 2023-09-21T13:06:18.421 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:06:18.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 929540 8.77 MB/sec execute 419 sec latency 20.994 ms 2023-09-21T13:06:19.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 931271 8.78 MB/sec execute 420 sec latency 11.669 ms 2023-09-21T13:06:20.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:19 smithi156 ceph-mon[134078]: pgmap v314: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:20.169 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:19 smithi142 ceph-mon[97663]: pgmap v314: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:20.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:19 smithi160 ceph-mon[134450]: pgmap v314: 97 pgs: 97 active+clean; 330 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 7.0 MiB/s wr, 198 op/s 2023-09-21T13:06:20.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 932694 8.78 MB/sec execute 421 sec latency 47.376 ms 2023-09-21T13:06:21.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 934672 8.79 MB/sec execute 422 sec latency 20.711 ms 2023-09-21T13:06:22.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:21 smithi156 ceph-mon[134078]: pgmap v315: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.5 MiB/s wr, 266 op/s 2023-09-21T13:06:22.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:21 smithi142 ceph-mon[97663]: pgmap v315: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.5 MiB/s wr, 266 op/s 2023-09-21T13:06:22.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:21 smithi160 ceph-mon[134450]: pgmap v315: 97 pgs: 97 active+clean; 314 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.5 MiB/s wr, 266 op/s 2023-09-21T13:06:22.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 936072 8.78 MB/sec execute 423 sec latency 18.982 ms 2023-09-21T13:06:23.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 938254 8.79 MB/sec execute 424 sec latency 14.252 ms 2023-09-21T13:06:24.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:23 smithi156 ceph-mon[134078]: pgmap v316: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.7 MiB/s wr, 257 op/s 2023-09-21T13:06:24.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:23 smithi142 ceph-mon[97663]: pgmap v316: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.7 MiB/s wr, 257 op/s 2023-09-21T13:06:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:23 smithi160 ceph-mon[134450]: pgmap v316: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 6.7 MiB/s wr, 257 op/s 2023-09-21T13:06:24.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 939671 8.78 MB/sec execute 425 sec latency 19.544 ms 2023-09-21T13:06:25.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 941815 8.79 MB/sec execute 426 sec latency 14.286 ms 2023-09-21T13:06:26.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:25 smithi156 ceph-mon[134078]: pgmap v317: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 6.2 MiB/s wr, 235 op/s 2023-09-21T13:06:26.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:25 smithi142 ceph-mon[97663]: pgmap v317: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 6.2 MiB/s wr, 235 op/s 2023-09-21T13:06:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:25 smithi160 ceph-mon[134450]: pgmap v317: 97 pgs: 97 active+clean; 301 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1009 KiB/s rd, 6.2 MiB/s wr, 235 op/s 2023-09-21T13:06:26.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 943222 8.79 MB/sec execute 427 sec latency 15.925 ms 2023-09-21T13:06:27.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 945320 8.80 MB/sec execute 428 sec latency 19.504 ms 2023-09-21T13:06:28.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:27 smithi156 ceph-mon[134078]: pgmap v318: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 319 op/s 2023-09-21T13:06:28.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:27 smithi142 ceph-mon[97663]: pgmap v318: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 319 op/s 2023-09-21T13:06:28.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:27 smithi160 ceph-mon[134450]: pgmap v318: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 7.0 MiB/s wr, 319 op/s 2023-09-21T13:06:28.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 946611 8.79 MB/sec execute 429 sec latency 49.750 ms 2023-09-21T13:06:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 -- 172.21.15.142:0/384244652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f8068b90 msgr2=0x7f45f810dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 --2- 172.21.15.142:0/384244652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f8068b90 0x7f45f810dc30 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f45f0009fc0 tx=0x7f45f000b330 comp rx=0 tx=0).stop 2023-09-21T13:06:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 -- 172.21.15.142:0/384244652 shutdown_connections 2023-09-21T13:06:28.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 --2- 172.21.15.142:0/384244652 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f8068b90 0x7f45f810dc30 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 --2- 172.21.15.142:0/384244652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f8106140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 --2- 172.21.15.142:0/384244652 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f80681d0 0x7f45f8068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 -- 172.21.15.142:0/384244652 >> 172.21.15.142:0/384244652 conn(0x7f45f8076800 msgr2=0x7f45f8076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 -- 172.21.15.142:0/384244652 shutdown_connections 2023-09-21T13:06:29.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.002+0000 7f45ffbff700 1 -- 172.21.15.142:0/384244652 wait complete. 2023-09-21T13:06:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 Processor -- start 2023-09-21T13:06:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 -- start start 2023-09-21T13:06:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f8068b90 0x7f45f81006a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f81a5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81a55d0 con 0x7f45f8068b90 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81a5710 con 0x7f45f80681d0 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45ffbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81a5880 con 0x7f45f8105d60 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45fd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f8068b90 0x7f45f81006a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43756/0 (socket says 172.21.15.142:43756) 2023-09-21T13:06:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45fd99b700 1 -- 172.21.15.142:0/1116960356 learned_addr learned my addr 172.21.15.142:0/1116960356 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.004+0000 7f45fe19c700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f81a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 -- 172.21.15.142:0/1116960356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 msgr2=0x7f45f81a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f81a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 -- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f8068b90 msgr2=0x7f45f81006a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f8068b90 0x7f45f81006a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 -- 172.21.15.142:0/1116960356 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e80095f0 con 0x7f45f80681d0 2023-09-21T13:06:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fe19c700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f81a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45fd99b700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e9a0 tx=0x7f45f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45eeffd700 1 -- 172.21.15.142:0/1116960356 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4009790 con 0x7f45f80681d0 2023-09-21T13:06:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f0009c40 con 0x7f45f80681d0 2023-09-21T13:06:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45eeffd700 1 -- 172.21.15.142:0/1116960356 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f4010430 con 0x7f45f80681d0 2023-09-21T13:06:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45eeffd700 1 -- 172.21.15.142:0/1116960356 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4018680 con 0x7f45f80681d0 2023-09-21T13:06:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.005+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f81a5f30 con 0x7f45f80681d0 2023-09-21T13:06:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.009+0000 7f45eeffd700 1 -- 172.21.15.142:0/1116960356 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f45f40105a0 con 0x7f45f80681d0 2023-09-21T13:06:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.011+0000 7f45eeffd700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 0x7f45e40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.011+0000 7f46134d7b80 1 Processor -- start 2023-09-21T13:06:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.011+0000 7f45eeffd700 1 -- 172.21.15.142:0/1116960356 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f45f4014070 con 0x7f45f80681d0 2023-09-21T13:06:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.011+0000 7f45fd19a700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 0x7f45e40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 -- start start 2023-09-21T13:06:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a1b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18982c40 con 0x55df18a171d0 2023-09-21T13:06:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18966c10 con 0x55df18a168b0 2023-09-21T13:06:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f46134d7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18964530 con 0x55df18a1b660 2023-09-21T13:06:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43764/0 (socket says 172.21.15.142:43764) 2023-09-21T13:06:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f45fd19a700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 0x7f45e40a2c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45f8101910 tx=0x7f45e8009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.012+0000 7f45fd99b700 1 -- 172.21.15.142:0/3237237572 learned_addr learned my addr 172.21.15.142:0/3237237572 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd19a700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a1b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fe19c700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 -- 172.21.15.142:0/3237237572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 msgr2=0x55df18a1bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 -- 172.21.15.142:0/3237237572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 msgr2=0x55df18a1b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a1b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 -- 172.21.15.142:0/3237237572 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df1878ad80 con 0x55df18a168b0 2023-09-21T13:06:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd19a700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a1b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f45f40a1090 tx=0x7f45f4098f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f7dc3671558e4c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45e3fff700 1 -- 172.21.15.142:0/3237237572 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4099550 con 0x55df18a168b0 2023-09-21T13:06:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45e3fff700 1 -- 172.21.15.142:0/3237237572 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f409d380 con 0x55df18a168b0 2023-09-21T13:06:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.013+0000 7f45e3fff700 1 -- 172.21.15.142:0/3237237572 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40997b0 con 0x55df18a168b0 2023-09-21T13:06:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 -- 172.21.15.142:0/3237237572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 msgr2=0x55df18a16c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f45f40a1090 tx=0x7f45f4098f80 comp rx=0 tx=0).stop 2023-09-21T13:06:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 -- 172.21.15.142:0/3237237572 shutdown_connections 2023-09-21T13:06:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a16c90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3237237572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a1b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 -- 172.21.15.142:0/3237237572 >> 172.21.15.142:0/3237237572 conn(0x55df1893afa0 msgr2=0x55df18a090c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 -- 172.21.15.142:0/3237237572 shutdown_connections 2023-09-21T13:06:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.014+0000 7f46134d7b80 1 -- 172.21.15.142:0/3237237572 wait complete. 2023-09-21T13:06:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.015+0000 7f46134d7b80 1 -- start start 2023-09-21T13:06:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.015+0000 7f46134d7b80 1 Processor -- start 2023-09-21T13:06:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 0x55df18a205f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a1b660 0x55df18a20b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df1895fe20 con 0x55df18a1b660 2023-09-21T13:06:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df188fc6e0 con 0x55df18a168b0 2023-09-21T13:06:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df188fc380 con 0x55df18a171d0 2023-09-21T13:06:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f46134d7b80 10 client.0 _ll_register_callbacks cb 0x55df18846a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.016+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43774/0 (socket says 172.21.15.142:43774) 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 -- 172.21.15.142:0/2842602243 learned_addr learned my addr 172.21.15.142:0/2842602243 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd19a700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 0x55df18a205f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fe19c700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a1b660 0x55df18a20b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 -- 172.21.15.142:0/2842602243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 msgr2=0x55df18a205f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 0x55df18a205f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 -- 172.21.15.142:0/2842602243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a1b660 msgr2=0x55df18a20b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a1b660 0x55df18a20b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 -- 172.21.15.142:0/2842602243 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f4095040 con 0x55df18a168b0 2023-09-21T13:06:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd19a700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 0x55df18a205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45fd99b700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e970 tx=0x7f45f4097b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b17d470ae993ed6e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f40995d0 con 0x55df18a168b0 2023-09-21T13:06:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.017+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f45f4098a40 con 0x55df18a168b0 2023-09-21T13:06:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df188d0b50 con 0x55df18a168b0 2023-09-21T13:06:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f4098c00 con 0x55df18a168b0 2023-09-21T13:06:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 10 client.27704 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55df18773c00 con 0x55df18a168b0 2023-09-21T13:06:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55df188d0b50 con 0x55df18a168b0 2023-09-21T13:06:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f45f40b7020 con 0x55df18a168b0 2023-09-21T13:06:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 10 client.27704 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 10 client.27704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 20 client.27704 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a30430 0x55df18a32850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 4 client.27704 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.018+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df189dcfc0 con 0x55df18a30430 2023-09-21T13:06:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.019+0000 7f45fd19a700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a30430 0x55df18a32850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.019+0000 7f45fd19a700 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a30430 0x55df18a32850 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bf68ef3a06e47ff server_cookie=668a342adca68535 in_seq=0 out_seq=0 2023-09-21T13:06:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.019+0000 7f45e17fa700 10 client.27704 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f45e17fa700 1 -- 172.21.15.142:0/2842602243 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55df189dcfc0 con 0x55df18a30430 2023-09-21T13:06:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f45e17fa700 10 client.27704 handle_command_reply: tid=0 2023-09-21T13:06:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 client.27704 shutdown 2023-09-21T13:06:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 msgr2=0x55df18a200b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e970 tx=0x7f45f4097b00 comp rx=0 tx=0).stop 2023-09-21T13:06:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 shutdown_connections 2023-09-21T13:06:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a30430 0x55df18a32850 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a1b660 0x55df18a20b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a200b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 --2- 172.21.15.142:0/2842602243 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a171d0 0x55df18a205f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f45e17fa700 0 client.27704 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 >> 172.21.15.142:0/2842602243 conn(0x55df1893afa0 msgr2=0x55df18a08cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 shutdown_connections 2023-09-21T13:06:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.020+0000 7f46134d7b80 1 -- 172.21.15.142:0/2842602243 wait complete. 2023-09-21T13:06:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.021+0000 7f46134d7b80 20 client.27704 trim_cache size 0 max 16384 2023-09-21T13:06:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 Processor -- start 2023-09-21T13:06:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 -- start start 2023-09-21T13:06:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a27780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df187e08c0 con 0x55df18a171d0 2023-09-21T13:06:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18a03470 con 0x55df18a168b0 2023-09-21T13:06:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f46134d7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18a27cc0 con 0x55df18a1b660 2023-09-21T13:06:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f45fd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a27780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43780/0 (socket says 172.21.15.142:43780) 2023-09-21T13:06:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.043+0000 7f45fd99b700 1 -- 172.21.15.142:0/393265448 learned_addr learned my addr 172.21.15.142:0/393265448 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fe19c700 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 -- 172.21.15.142:0/393265448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 msgr2=0x55df18a1ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 -- 172.21.15.142:0/393265448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 msgr2=0x55df18a27780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a27780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 -- 172.21.15.142:0/393265448 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df187b11f0 con 0x55df18a168b0 2023-09-21T13:06:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fe19c700 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45fd99b700 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f45f4095a50 tx=0x7f45f40959c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d99327cd320ebec server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45ecbff700 1 -- 172.21.15.142:0/393265448 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4099c50 con 0x55df18a168b0 2023-09-21T13:06:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45ecbff700 1 -- 172.21.15.142:0/393265448 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f4099550 con 0x55df18a168b0 2023-09-21T13:06:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.044+0000 7f45ecbff700 1 -- 172.21.15.142:0/393265448 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4099a10 con 0x55df18a168b0 2023-09-21T13:06:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 -- 172.21.15.142:0/393265448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 msgr2=0x55df18a18f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f45f4095a50 tx=0x7f45f40959c0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 -- 172.21.15.142:0/393265448 shutdown_connections 2023-09-21T13:06:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a1ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a18f50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 --2- 172.21.15.142:0/393265448 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a27780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 -- 172.21.15.142:0/393265448 >> 172.21.15.142:0/393265448 conn(0x55df1893afa0 msgr2=0x55df18a1a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 -- 172.21.15.142:0/393265448 shutdown_connections 2023-09-21T13:06:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.045+0000 7f46134d7b80 1 -- 172.21.15.142:0/393265448 wait complete. 2023-09-21T13:06:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.046+0000 7f46134d7b80 1 -- start start 2023-09-21T13:06:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.046+0000 7f46134d7b80 1 Processor -- start 2023-09-21T13:06:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a275e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a24e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18a253c0 con 0x55df18a171d0 2023-09-21T13:06:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18a25530 con 0x55df18a168b0 2023-09-21T13:06:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df18a256f0 con 0x55df18a1b660 2023-09-21T13:06:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f46134d7b80 10 client.0 _ll_register_callbacks cb 0x55df18846a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f45fd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f45fd99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a275e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f45fd19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33258/0 (socket says 172.21.15.142:33258) 2023-09-21T13:06:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f45fd19a700 1 -- 172.21.15.142:0/3744709375 learned_addr learned my addr 172.21.15.142:0/3744709375 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.047+0000 7f45fe19c700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a24e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 -- 172.21.15.142:0/3744709375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 msgr2=0x55df18a24e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a24e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 -- 172.21.15.142:0/3744709375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 msgr2=0x55df18a24900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 -- 172.21.15.142:0/3744709375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df18773c00 con 0x55df18a168b0 2023-09-21T13:06:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd19a700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45fd99b700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a275e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f45f40978a0 tx=0x7f45f4099320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30b4f9a3b00f8905 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f4099c50 con 0x55df18a168b0 2023-09-21T13:06:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f45f409d380 con 0x55df18a168b0 2023-09-21T13:06:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f45f4098c50 con 0x55df18a168b0 2023-09-21T13:06:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45f40b1b50 con 0x55df18a168b0 2023-09-21T13:06:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f46134d7b80 10 client.27710 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.048+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55df18789250 con 0x55df18a168b0 2023-09-21T13:06:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45f409d380 con 0x55df18a168b0 2023-09-21T13:06:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f45f4095c60 con 0x55df18a168b0 2023-09-21T13:06:29.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 10 client.27710 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 10 client.27710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 20 client.27710 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a84220 0x55df18a86610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 4 client.27710 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:06:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55df18958e00 con 0x55df18a84220 2023-09-21T13:06:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.049+0000 7f45fd19a700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a84220 0x55df18a86610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.050+0000 7f45fd19a700 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a84220 0x55df18a86610 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334f55736da985d1 server_cookie=7fda4151a485a318 in_seq=0 out_seq=0 2023-09-21T13:06:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.050+0000 7f45e17fa700 10 client.27710 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:29.123 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.127+0000 7f45e17fa700 1 -- 172.21.15.142:0/3744709375 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55df18958e00 con 0x55df18a84220 2023-09-21T13:06:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.127+0000 7f45e17fa700 10 client.27710 handle_command_reply: tid=0 2023-09-21T13:06:29.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.127+0000 7f46134d7b80 1 client.27710 shutdown 2023-09-21T13:06:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 msgr2=0x55df18a275e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a275e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f45f40978a0 tx=0x7f45f4099320 comp rx=0 tx=0).stop 2023-09-21T13:06:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 shutdown_connections 2023-09-21T13:06:29.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55df18a84220 0x55df18a86610 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55df18a1b660 0x55df18a24e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55df18a168b0 0x55df18a275e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 --2- 172.21.15.142:0/3744709375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55df18a171d0 0x55df18a24900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 >> 172.21.15.142:0/3744709375 conn(0x55df1893afa0 msgr2=0x55df18a0cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f45e17fa700 0 client.27710 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:29.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 shutdown_connections 2023-09-21T13:06:29.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.128+0000 7f46134d7b80 1 -- 172.21.15.142:0/3744709375 wait complete. 2023-09-21T13:06:29.127 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.129+0000 7f46134d7b80 20 client.27710 trim_cache size 0 max 16384 2023-09-21T13:06:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:06:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:06:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:06:29.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:06:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.129+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 msgr2=0x7f45e40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.129+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 0x7f45e40a2c70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f45f8101910 tx=0x7f45e8009310 comp rx=0 tx=0).stop 2023-09-21T13:06:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.129+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 msgr2=0x7f45f8100160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:29.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.129+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e9a0 tx=0x7f45f400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 shutdown_connections 2023-09-21T13:06:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45e40a07b0 0x7f45e40a2c70 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45f8105d60 0x7f45f81a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f45f80681d0 0x7f45f8100160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 --2- 172.21.15.142:0/1116960356 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f45f8068b90 0x7f45f81006a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:29.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 >> 172.21.15.142:0/1116960356 conn(0x7f45f8076800 msgr2=0x7f45f80fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:29.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 shutdown_connections 2023-09-21T13:06:29.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:29.130+0000 7f45ffbff700 1 -- 172.21.15.142:0/1116960356 wait complete. 2023-09-21T13:06:29.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 948658 8.80 MB/sec execute 430 sec latency 23.540 ms 2023-09-21T13:06:30.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:29 smithi156 ceph-mon[134078]: pgmap v319: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-21T13:06:30.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:29 smithi142 ceph-mon[97663]: pgmap v319: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-21T13:06:30.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:29 smithi160 ceph-mon[134450]: pgmap v319: 97 pgs: 97 active+clean; 306 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-21T13:06:30.703 INFO:tasks.workunit.client.0.smithi142.stdout: 1 949904 8.79 MB/sec execute 431 sec latency 11.449 ms 2023-09-21T13:06:31.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 952161 8.80 MB/sec execute 432 sec latency 43.634 ms 2023-09-21T13:06:32.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:31 smithi156 ceph-mon[134078]: pgmap v320: 97 pgs: 97 active+clean; 302 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2023-09-21T13:06:32.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:31 smithi142 ceph-mon[97663]: pgmap v320: 97 pgs: 97 active+clean; 302 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2023-09-21T13:06:32.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:31 smithi160 ceph-mon[134450]: pgmap v320: 97 pgs: 97 active+clean; 302 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 328 op/s 2023-09-21T13:06:32.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 952959 8.79 MB/sec execute 433 sec latency 128.754 ms 2023-09-21T13:06:33.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 955204 8.79 MB/sec execute 434 sec latency 16.254 ms 2023-09-21T13:06:34.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:33 smithi156 ceph-mon[134078]: pgmap v321: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-09-21T13:06:34.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:33 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:06:34.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:33 smithi142 ceph-mon[97663]: pgmap v321: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-09-21T13:06:34.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:33 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:06:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:33 smithi160 ceph-mon[134450]: pgmap v321: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-09-21T13:06:34.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:33 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:06:34.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 956429 8.79 MB/sec execute 435 sec latency 19.528 ms 2023-09-21T13:06:35.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 958463 8.79 MB/sec execute 436 sec latency 20.132 ms 2023-09-21T13:06:36.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:35 smithi156 ceph-mon[134078]: pgmap v322: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2023-09-21T13:06:36.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:35 smithi142 ceph-mon[97663]: pgmap v322: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2023-09-21T13:06:36.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:35 smithi160 ceph-mon[134450]: pgmap v322: 97 pgs: 97 active+clean; 303 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 196 op/s 2023-09-21T13:06:36.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 959682 8.79 MB/sec execute 437 sec latency 19.200 ms 2023-09-21T13:06:37.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 960977 8.78 MB/sec execute 438 sec latency 32.826 ms 2023-09-21T13:06:37.902 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: pgmap v323: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-21T13:06:37.902 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.902 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.903 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.904 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.905 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.906 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:37 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: pgmap v323: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-21T13:06:37.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.914 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.915 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.916 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.917 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:37 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: pgmap v323: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-21T13:06:37.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:37.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.936 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.937 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.938 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:37.939 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:37 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:38.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 963036 8.80 MB/sec execute 439 sec latency 27.004 ms 2023-09-21T13:06:39.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T13:06:39.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T13:06:39.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.153 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:06:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:06:39.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:38 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T13:06:39.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T13:06:39.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.164 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.165 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:06:39.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:06:39.166 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:38 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi160 to 196.2M 2023-09-21T13:06:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi160 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi156 to 196.2M 2023-09-21T13:06:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi156 to 205769625: error parsing value: Value '205769625' is below minimum 939524096 2023-09-21T13:06:39.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.187 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-21T13:06:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:06:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:06:39.188 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:38 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:06:39.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 964365 8.79 MB/sec execute 440 sec latency 18.839 ms 2023-09-21T13:06:40.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:39 smithi156 ceph-mon[134078]: pgmap v324: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-09-21T13:06:40.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:39 smithi156 ceph-mon[134078]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T13:06:40.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:39 smithi156 ceph-mon[134078]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T13:06:40.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:39 smithi142 ceph-mon[97663]: pgmap v324: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-09-21T13:06:40.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:39 smithi142 ceph-mon[97663]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T13:06:40.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:39 smithi142 ceph-mon[97663]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T13:06:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:39 smithi160 ceph-mon[134450]: pgmap v324: 97 pgs: 97 active+clean; 312 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 188 op/s 2023-09-21T13:06:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:39 smithi160 ceph-mon[134450]: Adjusting osd_memory_target on smithi142 to 220.9M 2023-09-21T13:06:40.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:39 smithi160 ceph-mon[134450]: Unable to set osd_memory_target on smithi142 to 231659008: error parsing value: Value '231659008' is below minimum 939524096 2023-09-21T13:06:40.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 966587 8.80 MB/sec execute 441 sec latency 16.141 ms 2023-09-21T13:06:41.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 967897 8.79 MB/sec execute 442 sec latency 18.395 ms 2023-09-21T13:06:42.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:41 smithi156 ceph-mon[134078]: pgmap v325: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:42.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:41 smithi142 ceph-mon[97663]: pgmap v325: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:42.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:41 smithi160 ceph-mon[134450]: pgmap v325: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 230 op/s 2023-09-21T13:06:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 -- 172.21.15.142:0/4130266535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764100e30 msgr2=0x7fa764101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 --2- 172.21.15.142:0/4130266535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764100e30 0x7fa764101210 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009990 tx=0x7fa74c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 -- 172.21.15.142:0/4130266535 shutdown_connections 2023-09-21T13:06:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 --2- 172.21.15.142:0/4130266535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 0x7fa76410c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 --2- 172.21.15.142:0/4130266535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764100e30 0x7fa764101210 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 --2- 172.21.15.142:0/4130266535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764101750 0x7fa764109c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 -- 172.21.15.142:0/4130266535 >> 172.21.15.142:0/4130266535 conn(0x7fa764074b50 msgr2=0x7fa764074f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 -- 172.21.15.142:0/4130266535 shutdown_connections 2023-09-21T13:06:42.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.309+0000 7fa768bff700 1 -- 172.21.15.142:0/4130266535 wait complete. 2023-09-21T13:06:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 Processor -- start 2023-09-21T13:06:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 -- start start 2023-09-21T13:06:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764100e30 0x7fa7641990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 0x7fa76419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76419e2c0 con 0x7fa764100e30 2023-09-21T13:06:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.311+0000 7fa768bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76419e430 con 0x7fa76410a2a0 2023-09-21T13:06:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa768bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76419e5f0 con 0x7fa764101750 2023-09-21T13:06:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46446/0 (socket says 172.21.15.142:46446) 2023-09-21T13:06:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 -- 172.21.15.142:0/4000278036 learned_addr learned my addr 172.21.15.142:0/4000278036 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa762d9d700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 0x7fa76419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa76259c700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764100e30 0x7fa7641990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 -- 172.21.15.142:0/4000278036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 msgr2=0x7fa76419dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 0x7fa76419dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 -- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764100e30 msgr2=0x7fa7641990d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764100e30 0x7fa7641990d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.312+0000 7fa759d9b700 1 -- 172.21.15.142:0/4000278036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0095f0 con 0x7fa764101750 2023-09-21T13:06:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa759d9b700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d950 tx=0x7fa75400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa75bfff700 1 -- 172.21.15.142:0/4000278036 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400f890 con 0x7fa764101750 2023-09-21T13:06:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76419e8d0 con 0x7fa764101750 2023-09-21T13:06:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa75bfff700 1 -- 172.21.15.142:0/4000278036 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa754010460 con 0x7fa764101750 2023-09-21T13:06:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa75bfff700 1 -- 172.21.15.142:0/4000278036 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400e610 con 0x7fa764101750 2023-09-21T13:06:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.313+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7641a6110 con 0x7fa764101750 2023-09-21T13:06:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.316+0000 7fa75bfff700 1 -- 172.21.15.142:0/4000278036 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa7540108d0 con 0x7fa764101750 2023-09-21T13:06:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.318+0000 7fa75bfff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 0x7fa7500a2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.318+0000 7fa75bfff700 1 -- 172.21.15.142:0/4000278036 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa7540cbdc0 con 0x7fa764101750 2023-09-21T13:06:42.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.318+0000 7fa76259c700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 0x7fa7500a2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.319+0000 7fa76259c700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 0x7fa7500a2ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b2e0 tx=0x7fa74c005fb0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.319+0000 7fa77c4dcb80 1 Processor -- start 2023-09-21T13:06:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.319+0000 7fa77c4dcb80 1 -- start start 2023-09-21T13:06:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9d42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c943c40 con 0x55b25c9d3e50 2023-09-21T13:06:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c927c10 con 0x55b25c9cf9c0 2023-09-21T13:06:42.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c925530 con 0x55b25c9cf0a0 2023-09-21T13:06:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa76259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa759d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa76259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46456/0 (socket says 172.21.15.142:46456) 2023-09-21T13:06:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa76259c700 1 -- 172.21.15.142:0/3008940694 learned_addr learned my addr 172.21.15.142:0/3008940694 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.320+0000 7fa762d9d700 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9d42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 -- 172.21.15.142:0/3008940694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf9c0 msgr2=0x55b25c9d3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 -- 172.21.15.142:0/3008940694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 msgr2=0x55b25c9d42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9d42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 -- 172.21.15.142:0/3008940694 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b25c74bd80 con 0x55b25c9cf0a0 2023-09-21T13:06:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa76259c700 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa74c015000 tx=0x7fa74c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83bfcce0bb4a6d14 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa758d99700 1 -- 172.21.15.142:0/3008940694 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02b070 con 0x55b25c9cf0a0 2023-09-21T13:06:42.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa758d99700 1 -- 172.21.15.142:0/3008940694 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c01e040 con 0x55b25c9cf0a0 2023-09-21T13:06:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.321+0000 7fa758d99700 1 -- 172.21.15.142:0/3008940694 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c00f6c0 con 0x55b25c9cf0a0 2023-09-21T13:06:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/3008940694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 msgr2=0x55b25c9cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fa74c015000 tx=0x7fa74c020000 comp rx=0 tx=0).stop 2023-09-21T13:06:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/3008940694 shutdown_connections 2023-09-21T13:06:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9d42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9cf480 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/3008940694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/3008940694 >> 172.21.15.142:0/3008940694 conn(0x55b25c8fbfa0 msgr2=0x55b25c9ca0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/3008940694 shutdown_connections 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.322+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/3008940694 wait complete. 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.323+0000 7fa77c4dcb80 1 -- start start 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.323+0000 7fa77c4dcb80 1 Processor -- start 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c920e20 con 0x55b25c9cf9c0 2023-09-21T13:06:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c8bd6e0 con 0x55b25c9d3e50 2023-09-21T13:06:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c8bd380 con 0x55b25c9cf0a0 2023-09-21T13:06:42.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa77c4dcb80 10 client.0 _ll_register_callbacks cb 0x55b25c807a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa762d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa76259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa762d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55340/0 (socket says 172.21.15.142:55340) 2023-09-21T13:06:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa76259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46464/0 (socket says 172.21.15.142:46464) 2023-09-21T13:06:42.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa762d9d700 1 -- 172.21.15.142:0/2098397266 learned_addr learned my addr 172.21.15.142:0/2098397266 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.324+0000 7fa759d9b700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 -- 172.21.15.142:0/2098397266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 msgr2=0x55b25c9db620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 -- 172.21.15.142:0/2098397266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf9c0 msgr2=0x55b25c9d8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 -- 172.21.15.142:0/2098397266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76410d3b0 con 0x55b25c9d3e50 2023-09-21T13:06:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa76259c700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa762d9d700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa75c007e60 tx=0x7fa75c007e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4be1968c603cd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa749ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:42.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c00e040 con 0x55b25c9d3e50 2023-09-21T13:06:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b25c891b50 con 0x55b25c9d3e50 2023-09-21T13:06:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa75c016640 con 0x55b25c9d3e50 2023-09-21T13:06:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa75c016800 con 0x55b25c9d3e50 2023-09-21T13:06:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa77c4dcb80 10 client.27722 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:42.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.325+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b25c734c00 con 0x55b25c9d3e50 2023-09-21T13:06:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b25c891b50 con 0x55b25c9d3e50 2023-09-21T13:06:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa75c028b10 con 0x55b25c9d3e50 2023-09-21T13:06:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 10 client.27722 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 10 client.27722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:42.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 20 client.27722 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25c9e8e10 0x55b25c9eb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 4 client.27722 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b25c99dfc0 con 0x55b25c9e8e10 2023-09-21T13:06:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.326+0000 7fa76259c700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25c9e8e10 0x55b25c9eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.327+0000 7fa749ffb700 10 client.27722 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:42.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.327+0000 7fa76259c700 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25c9e8e10 0x55b25c9eb230 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c833d1d66372885 server_cookie=7e8ce4f6ade9b3f in_seq=0 out_seq=0 2023-09-21T13:06:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa749ffb700 1 -- 172.21.15.142:0/2098397266 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b25c99dfc0 con 0x55b25c9e8e10 2023-09-21T13:06:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa749ffb700 10 client.27722 handle_command_reply: tid=0 2023-09-21T13:06:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 client.27722 shutdown 2023-09-21T13:06:42.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 msgr2=0x55b25c9d8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa75c007e60 tx=0x7fa75c007e90 comp rx=0 tx=0).stop 2023-09-21T13:06:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 shutdown_connections 2023-09-21T13:06:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25c9e8e10 0x55b25c9eb230 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d8df0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2098397266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 >> 172.21.15.142:0/2098397266 conn(0x55b25c8fbfa0 msgr2=0x55b25c9c9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa749ffb700 0 client.27722 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 shutdown_connections 2023-09-21T13:06:42.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.328+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2098397266 wait complete. 2023-09-21T13:06:42.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.329+0000 7fa77c4dcb80 20 client.27722 trim_cache size 0 max 16384 2023-09-21T13:06:42.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 Processor -- start 2023-09-21T13:06:42.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 -- start start 2023-09-21T13:06:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c7a18c0 con 0x55b25c9cf0a0 2023-09-21T13:06:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c9c1ba0 con 0x55b25c9d3e50 2023-09-21T13:06:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c9e64d0 con 0x55b25c9cf9c0 2023-09-21T13:06:42.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa76259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa762d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa759d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.348+0000 7fa762d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55354/0 (socket says 172.21.15.142:55354) 2023-09-21T13:06:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa762d9d700 1 -- 172.21.15.142:0/4919632 learned_addr learned my addr 172.21.15.142:0/4919632 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:42.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:42920/0 (socket says 172.21.15.142:42920) 2023-09-21T13:06:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 -- 172.21.15.142:0/4919632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 msgr2=0x55b25c9d6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 -- 172.21.15.142:0/4919632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 msgr2=0x55b25c9d6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 -- 172.21.15.142:0/4919632 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b25c7721f0 con 0x55b25c9cf0a0 2023-09-21T13:06:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa762d9d700 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa76259c700 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005600 tx=0x7fa74c0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d933d3e24e8789f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.349+0000 7fa75959a700 1 -- 172.21.15.142:0/4919632 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02b040 con 0x55b25c9cf0a0 2023-09-21T13:06:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa75959a700 1 -- 172.21.15.142:0/4919632 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c004d00 con 0x55b25c9cf0a0 2023-09-21T13:06:42.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa75959a700 1 -- 172.21.15.142:0/4919632 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c004760 con 0x55b25c9cf0a0 2023-09-21T13:06:42.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/4919632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 msgr2=0x55b25c9db150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa74c005600 tx=0x7fa74c0058e0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/4919632 shutdown_connections 2023-09-21T13:06:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9cf0a0 0x55b25c9db150 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9d3e50 0x55b25c9d6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/4919632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9d6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.350+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/4919632 >> 172.21.15.142:0/4919632 conn(0x55b25c8fbfa0 msgr2=0x55b25c9e50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.351+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/4919632 shutdown_connections 2023-09-21T13:06:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.351+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/4919632 wait complete. 2023-09-21T13:06:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.351+0000 7fa77c4dcb80 1 -- start start 2023-09-21T13:06:42.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.351+0000 7fa77c4dcb80 1 Processor -- start 2023-09-21T13:06:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9ddf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9de470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c9de9b0 con 0x55b25c9d3e50 2023-09-21T13:06:42.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c9deb20 con 0x55b25c9cf0a0 2023-09-21T13:06:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b25c9dece0 con 0x55b25c9cf9c0 2023-09-21T13:06:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa77c4dcb80 10 client.0 _ll_register_callbacks cb 0x55b25c807a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa76259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa76259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55364/0 (socket says 172.21.15.142:55364) 2023-09-21T13:06:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa76259c700 1 -- 172.21.15.142:0/2790809208 learned_addr learned my addr 172.21.15.142:0/2790809208 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa759d9b700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9ddf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.352+0000 7fa762d9d700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9de470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 -- 172.21.15.142:0/2790809208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 msgr2=0x55b25c9ddf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9ddf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 -- 172.21.15.142:0/2790809208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 msgr2=0x55b25c9de470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9de470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 -- 172.21.15.142:0/2790809208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b25c734c00 con 0x55b25c9cf0a0 2023-09-21T13:06:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa762d9d700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9de470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:42.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa76259c700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c00bdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243623b72beda057 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa749ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74c02b070 con 0x55b25c9cf0a0 2023-09-21T13:06:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.353+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa74c01e040 con 0x55b25c9cf0a0 2023-09-21T13:06:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa74c03b330 con 0x55b25c9cf0a0 2023-09-21T13:06:42.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74c029040 con 0x55b25c9cf0a0 2023-09-21T13:06:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 10 client.27728 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b25c74bd80 con 0x55b25c9cf0a0 2023-09-21T13:06:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa74c01e040 con 0x55b25c9cf0a0 2023-09-21T13:06:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa74c042030 con 0x55b25c9cf0a0 2023-09-21T13:06:42.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 10 client.27728 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 10 client.27728 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 20 client.27728 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25ca3cd60 0x55b25ca3f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 4 client.27728 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:06:42.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.354+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b25c919e00 con 0x55b25ca3cd60 2023-09-21T13:06:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.355+0000 7fa759d9b700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25ca3cd60 0x55b25ca3f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.355+0000 7fa759d9b700 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25ca3cd60 0x55b25ca3f180 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e704dda4478433 server_cookie=e01e960a6fa234ea in_seq=0 out_seq=0 2023-09-21T13:06:42.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.355+0000 7fa749ffb700 10 client.27728 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:42.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.437+0000 7fa749ffb700 1 -- 172.21.15.142:0/2790809208 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b25c919e00 con 0x55b25ca3cd60 2023-09-21T13:06:42.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.437+0000 7fa749ffb700 10 client.27728 handle_command_reply: tid=0 2023-09-21T13:06:42.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.437+0000 7fa77c4dcb80 1 client.27728 shutdown 2023-09-21T13:06:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.442+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 msgr2=0x55b25c9dff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.442+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa74c000c00 tx=0x7fa74c00bdf0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 shutdown_connections 2023-09-21T13:06:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55b25ca3cd60 0x55b25ca3f180 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55b25c9d3e50 0x55b25c9de470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55b25c9cf0a0 0x55b25c9dff50 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 --2- 172.21.15.142:0/2790809208 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55b25c9cf9c0 0x55b25c9ddf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 >> 172.21.15.142:0/2790809208 conn(0x55b25c8fbfa0 msgr2=0x55b25c9d6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.443+0000 7fa749ffb700 0 client.27728 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.444+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 shutdown_connections 2023-09-21T13:06:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.444+0000 7fa77c4dcb80 1 -- 172.21.15.142:0/2790809208 wait complete. 2023-09-21T13:06:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.444+0000 7fa77c4dcb80 20 client.27728 trim_cache size 0 max 16384 2023-09-21T13:06:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:06:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:06:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:06:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:06:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 msgr2=0x7fa7500a2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 0x7fa7500a2ca0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b2e0 tx=0x7fa74c005fb0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 msgr2=0x7fa764199610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fa75400d950 tx=0x7fa75400dc60 comp rx=0 tx=0).stop 2023-09-21T13:06:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 shutdown_connections 2023-09-21T13:06:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa7500a07e0 0x7fa7500a2ca0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa764100e30 0x7fa7641990d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa76410a2a0 0x7fa76419dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 --2- 172.21.15.142:0/4000278036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa764101750 0x7fa764199610 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 >> 172.21.15.142:0/4000278036 conn(0x7fa764074b50 msgr2=0x7fa7640fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 shutdown_connections 2023-09-21T13:06:42.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:42.446+0000 7fa768bff700 1 -- 172.21.15.142:0/4000278036 wait complete. 2023-09-21T13:06:42.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 969867 8.80 MB/sec execute 443 sec latency 48.466 ms 2023-09-21T13:06:43.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 971079 8.79 MB/sec execute 444 sec latency 13.163 ms 2023-09-21T13:06:44.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:43 smithi156 ceph-mon[134078]: pgmap v326: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 169 op/s 2023-09-21T13:06:44.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:43 smithi142 ceph-mon[97663]: pgmap v326: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 169 op/s 2023-09-21T13:06:44.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:43 smithi160 ceph-mon[134450]: pgmap v326: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 169 op/s 2023-09-21T13:06:44.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 973263 8.80 MB/sec execute 445 sec latency 18.116 ms 2023-09-21T13:06:45.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 974442 8.79 MB/sec execute 446 sec latency 52.548 ms 2023-09-21T13:06:46.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:45 smithi156 ceph-mon[134078]: pgmap v327: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 152 op/s 2023-09-21T13:06:46.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:45 smithi142 ceph-mon[97663]: pgmap v327: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 152 op/s 2023-09-21T13:06:46.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:45 smithi160 ceph-mon[134450]: pgmap v327: 97 pgs: 97 active+clean; 320 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 152 op/s 2023-09-21T13:06:46.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 976479 8.80 MB/sec execute 447 sec latency 18.255 ms 2023-09-21T13:06:47.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 977836 8.79 MB/sec execute 448 sec latency 11.693 ms 2023-09-21T13:06:48.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:47 smithi156 ceph-mon[134078]: pgmap v328: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2023-09-21T13:06:48.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:47 smithi142 ceph-mon[97663]: pgmap v328: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2023-09-21T13:06:48.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:47 smithi160 ceph-mon[134450]: pgmap v328: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 266 op/s 2023-09-21T13:06:48.425 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:06:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.668+0000 7f7d35dff700 1 -- 172.21.15.142:0/1228123362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 msgr2=0x7f7d3010acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.668+0000 7f7d35dff700 1 --2- 172.21.15.142:0/1228123362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d3010acf0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7d24009990 tx=0x7f7d24009ca0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 -- 172.21.15.142:0/1228123362 shutdown_connections 2023-09-21T13:06:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 --2- 172.21.15.142:0/1228123362 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 0x7f7d3010d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 --2- 172.21.15.142:0/1228123362 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d301022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 --2- 172.21.15.142:0/1228123362 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d3010acf0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 -- 172.21.15.142:0/1228123362 >> 172.21.15.142:0/1228123362 conn(0x7f7d300fb730 msgr2=0x7f7d300fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 -- 172.21.15.142:0/1228123362 shutdown_connections 2023-09-21T13:06:48.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.669+0000 7f7d35dff700 1 -- 172.21.15.142:0/1228123362 wait complete. 2023-09-21T13:06:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.670+0000 7f7d35dff700 1 Processor -- start 2023-09-21T13:06:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.670+0000 7f7d35dff700 1 -- start start 2023-09-21T13:06:48.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d30196e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 0x7f7d3019b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3019be60 con 0x7f7d3010b310 2023-09-21T13:06:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3019bfd0 con 0x7f7d30102810 2023-09-21T13:06:48.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d35dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3019c190 con 0x7f7d30101ef0 2023-09-21T13:06:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d30196e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44632/0 (socket says 172.21.15.142:44632) 2023-09-21T13:06:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2effd700 1 -- 172.21.15.142:0/3948813400 learned_addr learned my addr 172.21.15.142:0/3948813400 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:48.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d30196e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52842/0 (socket says 172.21.15.142:52842) 2023-09-21T13:06:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.671+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 0x7f7d3019b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 -- 172.21.15.142:0/3948813400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 msgr2=0x7f7d30196e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d30196e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 -- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 msgr2=0x7f7d3019b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 0x7f7d3019b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 -- 172.21.15.142:0/3948813400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d240095f0 con 0x7f7d30102810 2023-09-21T13:06:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d24005910 tx=0x7f7d24004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2cff9700 1 -- 172.21.15.142:0/3948813400 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2401d070 con 0x7f7d30102810 2023-09-21T13:06:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2cff9700 1 -- 172.21.15.142:0/3948813400 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d24022470 con 0x7f7d30102810 2023-09-21T13:06:48.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3019c410 con 0x7f7d30102810 2023-09-21T13:06:48.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d2cff9700 1 -- 172.21.15.142:0/3948813400 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24017650 con 0x7f7d30102810 2023-09-21T13:06:48.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.672+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301a3cb0 con 0x7f7d30102810 2023-09-21T13:06:48.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.677+0000 7f7d2cff9700 1 -- 172.21.15.142:0/3948813400 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7d240225e0 con 0x7f7d30102810 2023-09-21T13:06:48.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 Processor -- start 2023-09-21T13:06:48.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 -- start start 2023-09-21T13:06:48.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8542fca0 con 0x562d854bfa20 2023-09-21T13:06:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d85413c70 con 0x562d854c0340 2023-09-21T13:06:48.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.678+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d85411590 con 0x562d854c4770 2023-09-21T13:06:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44638/0 (socket says 172.21.15.142:44638) 2023-09-21T13:06:48.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3413638572 learned_addr learned my addr 172.21.15.142:0/3413638572 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2cff9700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 0x7f7d180a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3413638572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 msgr2=0x562d854c4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3413638572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 msgr2=0x562d854bfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854bfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3413638572 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d85237de0 con 0x562d854c0340 2023-09-21T13:06:48.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2cff9700 1 -- 172.21.15.142:0/3948813400 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d240cd1c0 con 0x7f7d30102810 2023-09-21T13:06:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009d80 tx=0x7f7d20011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caec6d9e2472ea4f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.679+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 0x7f7d180a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.680+0000 7f7d15ffb700 1 -- 172.21.15.142:0/3413638572 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20004230 con 0x562d854c0340 2023-09-21T13:06:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.680+0000 7f7d15ffb700 1 -- 172.21.15.142:0/3413638572 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d20004390 con 0x562d854c0340 2023-09-21T13:06:48.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.680+0000 7f7d15ffb700 1 -- 172.21.15.142:0/3413638572 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20019880 con 0x562d854c0340 2023-09-21T13:06:48.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3413638572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 msgr2=0x562d854c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 0x7f7d180a2c70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d28003f20 tx=0x7f7d2800b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7d20009d80 tx=0x7f7d20011720 comp rx=0 tx=0).stop 2023-09-21T13:06:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3413638572 shutdown_connections 2023-09-21T13:06:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854bfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3413638572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c4230 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3413638572 >> 172.21.15.142:0/3413638572 conn(0x562d853e8000 msgr2=0x562d854b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3413638572 shutdown_connections 2023-09-21T13:06:48.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.681+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3413638572 wait complete. 2023-09-21T13:06:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.682+0000 7f7d4981eb80 1 -- start start 2023-09-21T13:06:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.682+0000 7f7d4981eb80 1 Processor -- start 2023-09-21T13:06:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854c0340 0x562d854c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c4770 0x562d854c9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8540ce80 con 0x562d854c0340 2023-09-21T13:06:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d853a9740 con 0x562d854c4770 2023-09-21T13:06:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d853a93e0 con 0x562d854bfa20 2023-09-21T13:06:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d4981eb80 10 client.0 _ll_register_callbacks cb 0x562d852f3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:48.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52862/0 (socket says 172.21.15.142:52862) 2023-09-21T13:06:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3692326049 learned_addr learned my addr 172.21.15.142:0/3692326049 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854c0340 0x562d854c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c4770 0x562d854c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c4770 msgr2=0x562d854c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c4770 0x562d854c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3692326049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854c0340 msgr2=0x562d854c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854c0340 0x562d854c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.683+0000 7f7d2f7fe700 1 -- 172.21.15.142:0/3692326049 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d200099e0 con 0x562d854bfa20 2023-09-21T13:06:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d2001b040 tx=0x7f7d20003960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30530b3f76c373b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d0effd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20005450 con 0x562d854bfa20 2023-09-21T13:06:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d8537dbb0 con 0x562d854bfa20 2023-09-21T13:06:48.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d20005ce0 con 0x562d854bfa20 2023-09-21T13:06:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d20009ed0 con 0x562d854bfa20 2023-09-21T13:06:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d4981eb80 10 client.27694 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.684+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562d85220c60 con 0x562d854bfa20 2023-09-21T13:06:48.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562d8537dbb0 con 0x562d854bfa20 2023-09-21T13:06:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7d20021040 con 0x562d854bfa20 2023-09-21T13:06:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 10 client.27694 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 10 client.27694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:48.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 20 client.27694 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d854ddbb0 0x562d854dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 4 client.27694 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d8548a020 con 0x562d854ddbb0 2023-09-21T13:06:48.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.685+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d854ddbb0 0x562d854dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d2effd700 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d854ddbb0 0x562d854dffa0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=972ed3022985acd8 server_cookie=c52ca809d8e8c9fc in_seq=0 out_seq=0 2023-09-21T13:06:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d0effd700 10 client.27694 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d0effd700 1 -- 172.21.15.142:0/3692326049 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562d8548a020 con 0x562d854ddbb0 2023-09-21T13:06:48.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d0effd700 10 client.27694 handle_command_reply: tid=0 2023-09-21T13:06:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d4981eb80 1 client.27694 shutdown 2023-09-21T13:06:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 msgr2=0x562d854cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.686+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7d2001b040 tx=0x7f7d20003960 comp rx=0 tx=0).stop 2023-09-21T13:06:48.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 shutdown_connections 2023-09-21T13:06:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d854ddbb0 0x562d854dffa0 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c4770 0x562d854c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854bfa20 0x562d854cbf80 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d0effd700 0 client.27694 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:48.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/3692326049 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854c0340 0x562d854c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 >> 172.21.15.142:0/3692326049 conn(0x562d853e8000 msgr2=0x562d854b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 shutdown_connections 2023-09-21T13:06:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 1 -- 172.21.15.142:0/3692326049 wait complete. 2023-09-21T13:06:48.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.687+0000 7f7d4981eb80 20 client.27694 trim_cache size 0 max 16384 2023-09-21T13:06:48.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 979894 8.80 MB/sec execute 449 sec latency 22.828 ms 2023-09-21T13:06:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.713+0000 7f7d4981eb80 1 Processor -- start 2023-09-21T13:06:48.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.713+0000 7f7d4981eb80 1 -- start start 2023-09-21T13:06:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8528d920 con 0x562d854bfa20 2023-09-21T13:06:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d854b7c60 con 0x562d854c0340 2023-09-21T13:06:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d854c77f0 con 0x562d854c4770 2023-09-21T13:06:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:52872/0 (socket says 172.21.15.142:52872) 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44666/0 (socket says 172.21.15.142:44666) 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2ffff700 1 -- 172.21.15.142:0/1844509074 learned_addr learned my addr 172.21.15.142:0/1844509074 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 -- 172.21.15.142:0/1844509074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 msgr2=0x562d854c8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 -- 172.21.15.142:0/1844509074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 msgr2=0x562d854cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.714+0000 7f7d2effd700 1 -- 172.21.15.142:0/1844509074 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d8525e250 con 0x562d854c0340 2023-09-21T13:06:48.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.715+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7d240ca910 tx=0x7f7d2401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37864f71c77b0935 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.715+0000 7f7d167fc700 1 -- 172.21.15.142:0/1844509074 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2409a060 con 0x562d854c0340 2023-09-21T13:06:48.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.715+0000 7f7d167fc700 1 -- 172.21.15.142:0/1844509074 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d2409ae00 con 0x562d854c0340 2023-09-21T13:06:48.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.715+0000 7f7d167fc700 1 -- 172.21.15.142:0/1844509074 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d24098b30 con 0x562d854c0340 2023-09-21T13:06:48.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1844509074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 msgr2=0x562d854c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f7d240ca910 tx=0x7f7d2401a040 comp rx=0 tx=0).stop 2023-09-21T13:06:48.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1844509074 shutdown_connections 2023-09-21T13:06:48.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d854c8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1844509074 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854c8a50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1844509074 >> 172.21.15.142:0/1844509074 conn(0x562d853e8000 msgr2=0x562d854c28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1844509074 shutdown_connections 2023-09-21T13:06:48.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1844509074 wait complete. 2023-09-21T13:06:48.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.716+0000 7f7d4981eb80 1 -- start start 2023-09-21T13:06:48.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 Processor -- start 2023-09-21T13:06:48.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d8552a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8552af00 con 0x562d854bfa20 2023-09-21T13:06:48.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8552b070 con 0x562d854c0340 2023-09-21T13:06:48.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d8552b230 con 0x562d854c4770 2023-09-21T13:06:48.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d4981eb80 10 client.0 _ll_register_callbacks cb 0x7f7d20009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:48.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.717+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2f7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44672/0 (socket says 172.21.15.142:44672) 2023-09-21T13:06:48.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 -- 172.21.15.142:0/1278567019 learned_addr learned my addr 172.21.15.142:0/1278567019 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:48.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d8552a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 -- 172.21.15.142:0/1278567019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 msgr2=0x562d8552a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d8552a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 -- 172.21.15.142:0/1278567019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 msgr2=0x562d854d88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:48.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854d88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 -- 172.21.15.142:0/1278567019 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d301a3cb0 con 0x562d854c0340 2023-09-21T13:06:48.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2ffff700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d8552a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:06:48.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d2effd700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d24096c00 tx=0x7f7d2409a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d705a68c0bfa644 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:48.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d0effd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:06:48.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240a26e0 con 0x562d854c0340 2023-09-21T13:06:48.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7d2409a960 con 0x562d854c0340 2023-09-21T13:06:48.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.718+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d20004390 con 0x562d854c0340 2023-09-21T13:06:48.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2409ab60 con 0x562d854c0340 2023-09-21T13:06:48.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 10 client.27746 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:48.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562d852362b0 con 0x562d854c0340 2023-09-21T13:06:48.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d20004390 con 0x562d854c0340 2023-09-21T13:06:48.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7d2409e020 con 0x562d854c0340 2023-09-21T13:06:48.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 10 client.27746 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:48.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 10 client.27746 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:48.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 20 client.27746 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:48.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d85532630 0x562d85534a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:48.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 4 client.27746 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:06:48.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.719+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562d85405e60 con 0x562d85532630 2023-09-21T13:06:48.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d85532630 0x562d85534a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:48.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d0effd700 10 client.27746 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:48.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d2f7fe700 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d85532630 0x562d85534a50 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21930017ed8ab307 server_cookie=faa283e41c7be0c7 in_seq=0 out_seq=0 2023-09-21T13:06:48.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d0effd700 1 -- 172.21.15.142:0/1278567019 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x562d85405e60 con 0x562d85532630 2023-09-21T13:06:48.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d0effd700 10 client.27746 handle_command_reply: tid=0 2023-09-21T13:06:48.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 client.27746 shutdown 2023-09-21T13:06:48.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 msgr2=0x562d854d8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f7d24096c00 tx=0x7f7d2409a7b0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 shutdown_connections 2023-09-21T13:06:48.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562d85532630 0x562d85534a50 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562d854bfa20 0x562d854d88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562d854c4770 0x562d8552a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d0effd700 0 client.27746 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:48.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 --2- 172.21.15.142:0/1278567019 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562d854c0340 0x562d854d8e20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.720+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 >> 172.21.15.142:0/1278567019 conn(0x562d853e8000 msgr2=0x562d854c3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 shutdown_connections 2023-09-21T13:06:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d4981eb80 1 -- 172.21.15.142:0/1278567019 wait complete. 2023-09-21T13:06:48.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d4981eb80 20 client.27746 trim_cache size 0 max 16384 2023-09-21T13:06:48.733 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:06:48.733 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:06:48.733 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:06:48.733 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:06:48.734 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:06:48.734 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:06:48.734 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:06:48.734 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:06:48.735 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:06:48.735 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:06:48.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 msgr2=0x7f7d180a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 0x7f7d180a2c70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7d28003f20 tx=0x7f7d2800b040 comp rx=0 tx=0).stop 2023-09-21T13:06:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 msgr2=0x7f7d301973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.721+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7d24005910 tx=0x7f7d24004710 comp rx=0 tx=0).stop 2023-09-21T13:06:48.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 shutdown_connections 2023-09-21T13:06:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7d180a07b0 0x7f7d180a2c70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7d3010b310 0x7f7d3019b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d30101ef0 0x7f7d30196e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 --2- 172.21.15.142:0/3948813400 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7d30102810 0x7f7d301973c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:48.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 >> 172.21.15.142:0/3948813400 conn(0x7f7d300fb730 msgr2=0x7f7d3010d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 shutdown_connections 2023-09-21T13:06:48.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:06:48.722+0000 7f7d35dff700 1 -- 172.21.15.142:0/3948813400 wait complete. 2023-09-21T13:06:48.739 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:06:49.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 980838 8.79 MB/sec execute 450 sec latency 316.553 ms 2023-09-21T13:06:50.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:49 smithi156 ceph-mon[134078]: pgmap v329: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:06:50.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:49 smithi142 ceph-mon[97663]: pgmap v329: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:06:50.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:49 smithi160 ceph-mon[134450]: pgmap v329: 97 pgs: 97 active+clean; 316 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:06:50.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 982384 8.79 MB/sec execute 451 sec latency 16.455 ms 2023-09-21T13:06:51.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 983540 8.78 MB/sec execute 452 sec latency 236.715 ms 2023-09-21T13:06:52.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:51 smithi156 ceph-mon[134078]: pgmap v330: 97 pgs: 97 active+clean; 323 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-21T13:06:52.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:51 smithi142 ceph-mon[97663]: pgmap v330: 97 pgs: 97 active+clean; 323 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-21T13:06:52.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:51 smithi160 ceph-mon[134450]: pgmap v330: 97 pgs: 97 active+clean; 323 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-21T13:06:52.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 984785 8.78 MB/sec execute 453 sec latency 17.768 ms 2023-09-21T13:06:53.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 986875 8.78 MB/sec execute 454 sec latency 18.010 ms 2023-09-21T13:06:54.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:53 smithi156 ceph-mon[134078]: pgmap v331: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2023-09-21T13:06:54.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:53 smithi142 ceph-mon[97663]: pgmap v331: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2023-09-21T13:06:54.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:53 smithi160 ceph-mon[134450]: pgmap v331: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 224 op/s 2023-09-21T13:06:54.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 988107 8.78 MB/sec execute 455 sec latency 25.827 ms 2023-09-21T13:06:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 -- 172.21.15.142:0/3836778352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f8101980 msgr2=0x7f28f81059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 --2- 172.21.15.142:0/3836778352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f8101980 0x7f28f81059c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f28e8009990 tx=0x7f28e8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 -- 172.21.15.142:0/3836778352 shutdown_connections 2023-09-21T13:06:55.623 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 --2- 172.21.15.142:0/3836778352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f81060f0 0x7f28f810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 --2- 172.21.15.142:0/3836778352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f8100fd0 0x7f28f81013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 --2- 172.21.15.142:0/3836778352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f8101980 0x7f28f81059c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.626+0000 7f29005ff700 1 -- 172.21.15.142:0/3836778352 >> 172.21.15.142:0/3836778352 conn(0x7f28f80fc830 msgr2=0x7f28f80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.627+0000 7f29005ff700 1 -- 172.21.15.142:0/3836778352 shutdown_connections 2023-09-21T13:06:55.624 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.627+0000 7f29005ff700 1 -- 172.21.15.142:0/3836778352 wait complete. 2023-09-21T13:06:55.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.628+0000 7f29005ff700 1 Processor -- start 2023-09-21T13:06:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.628+0000 7f29005ff700 1 -- start start 2023-09-21T13:06:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 0x7f28f8196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f81060f0 0x7f28f8197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819c470 con 0x7f28f8100fd0 2023-09-21T13:06:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819c5e0 con 0x7f28f819b9f0 2023-09-21T13:06:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f29005ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f819c7a0 con 0x7f28f81060f0 2023-09-21T13:06:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 0x7f28f8196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39722/0 (socket says 172.21.15.142:39722) 2023-09-21T13:06:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 -- 172.21.15.142:0/3408212555 learned_addr learned my addr 172.21.15.142:0/3408212555 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f81060f0 0x7f28f8197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 -- 172.21.15.142:0/3408212555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f81060f0 msgr2=0x7f28f8197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f81060f0 0x7f28f8197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 -- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 msgr2=0x7f28f8196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 0x7f28f8196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28feb9c700 1 -- 172.21.15.142:0/3408212555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80095f0 con 0x7f28f819b9f0 2023-09-21T13:06:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.629+0000 7f28fe39b700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 0x7f28f8196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f28feb9c700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ef30 tx=0x7f28f000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f28ef7fe700 1 -- 172.21.15.142:0/3408212555 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0018070 con 0x7f28f819b9f0 2023-09-21T13:06:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f28ef7fe700 1 -- 172.21.15.142:0/3408212555 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28f000f040 con 0x7f28f819b9f0 2023-09-21T13:06:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f81a3ca0 con 0x7f28f819b9f0 2023-09-21T13:06:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f28ef7fe700 1 -- 172.21.15.142:0/3408212555 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000cd00 con 0x7f28f819b9f0 2023-09-21T13:06:55.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.630+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f81a41d0 con 0x7f28f819b9f0 2023-09-21T13:06:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.634+0000 7f28ef7fe700 1 -- 172.21.15.142:0/3408212555 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f28f0003a00 con 0x7f28f819b9f0 2023-09-21T13:06:55.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.635+0000 7f2913e7ab80 1 Processor -- start 2023-09-21T13:06:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 -- start start 2023-09-21T13:06:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28ef7fe700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 0x7f28e40a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc307dd0 0x55adcc30bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc30c260 0x55adcc30c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc277c40 con 0x55adcc30c260 2023-09-21T13:06:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc25bc10 con 0x55adcc3074b0 2023-09-21T13:06:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc259530 con 0x55adcc307dd0 2023-09-21T13:06:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28ef7fe700 1 -- 172.21.15.142:0/3408212555 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28f00cb9f0 con 0x7f28f819b9f0 2023-09-21T13:06:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39732/0 (socket says 172.21.15.142:39732) 2023-09-21T13:06:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28fe39b700 1 -- 172.21.15.142:0/4183273301 learned_addr learned my addr 172.21.15.142:0/4183273301 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.636+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 0x7f28e40a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28feb9c700 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc30c260 0x55adcc30c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 -- 172.21.15.142:0/4183273301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc307dd0 msgr2=0x55adcc30bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc307dd0 0x55adcc30bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 -- 172.21.15.142:0/4183273301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc30c260 msgr2=0x55adcc30c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc30c260 0x55adcc30c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 -- 172.21.15.142:0/4183273301 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adcc07fd80 con 0x55adcc3074b0 2023-09-21T13:06:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28fe39b700 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f28f40115f0 tx=0x7f28f4011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15902a16813605c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28ecbfe700 1 -- 172.21.15.142:0/4183273301 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400f680 con 0x55adcc3074b0 2023-09-21T13:06:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28ecbfe700 1 -- 172.21.15.142:0/4183273301 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28f400fca0 con 0x55adcc3074b0 2023-09-21T13:06:55.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.637+0000 7f28ecbfe700 1 -- 172.21.15.142:0/4183273301 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4019d10 con 0x55adcc3074b0 2023-09-21T13:06:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 -- 172.21.15.142:0/4183273301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 msgr2=0x55adcc307890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 0x7f28e40a2cf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28f8198660 tx=0x7f28e801a040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f28f40115f0 tx=0x7f28f4011900 comp rx=0 tx=0).stop 2023-09-21T13:06:55.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 -- 172.21.15.142:0/4183273301 shutdown_connections 2023-09-21T13:06:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc30c260 0x55adcc30c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc307890 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/4183273301 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc307dd0 0x55adcc30bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 -- 172.21.15.142:0/4183273301 >> 172.21.15.142:0/4183273301 conn(0x55adcc22ffa0 msgr2=0x55adcc2fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 -- 172.21.15.142:0/4183273301 shutdown_connections 2023-09-21T13:06:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.638+0000 7f2913e7ab80 1 -- 172.21.15.142:0/4183273301 wait complete. 2023-09-21T13:06:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.639+0000 7f2913e7ab80 1 -- start start 2023-09-21T13:06:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.639+0000 7f2913e7ab80 1 Processor -- start 2023-09-21T13:06:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 0x55adcc312a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc312fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc254e20 con 0x55adcc307dd0 2023-09-21T13:06:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc1f16e0 con 0x55adcc30c260 2023-09-21T13:06:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc1f1380 con 0x55adcc3074b0 2023-09-21T13:06:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f2913e7ab80 10 client.0 _ll_register_callbacks cb 0x55adcc13ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28feb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 0x55adcc312a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fdb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc312fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28feb9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39742/0 (socket says 172.21.15.142:39742) 2023-09-21T13:06:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28feb9c700 1 -- 172.21.15.142:0/306548913 learned_addr learned my addr 172.21.15.142:0/306548913 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 -- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 msgr2=0x55adcc3060a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 -- 172.21.15.142:0/306548913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 msgr2=0x55adcc312fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc312fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28fe39b700 1 -- 172.21.15.142:0/306548913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f4009dd0 con 0x55adcc3074b0 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.640+0000 7f28feb9c700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f28fe39b700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 0x55adcc312a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f28f4005920 tx=0x7f28f401af70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25bb03b29af41319 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f28e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400f480 con 0x55adcc3074b0 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55adcc1c5b50 con 0x55adcc3074b0 2023-09-21T13:06:55.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28f400f5e0 con 0x55adcc3074b0 2023-09-21T13:06:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28f400f7a0 con 0x55adcc3074b0 2023-09-21T13:06:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f2913e7ab80 10 client.27709 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.641+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55adcc068c00 con 0x55adcc3074b0 2023-09-21T13:06:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55adcc1c5b50 con 0x55adcc3074b0 2023-09-21T13:06:55.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f28f4004890 con 0x55adcc3074b0 2023-09-21T13:06:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 10 client.27709 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 10 client.27709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 20 client.27709 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc31ceb0 0x55adcc31f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 4 client.27709 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:06:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55adcc2d1fc0 con 0x55adcc31ceb0 2023-09-21T13:06:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.642+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc31ceb0 0x55adcc31f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.643+0000 7f28e1ffb700 10 client.27709 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.643+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc31ceb0 0x55adcc31f2d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5401c6c5b13c2401 server_cookie=2e0a9315b853373d in_seq=0 out_seq=0 2023-09-21T13:06:55.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.643+0000 7f28e1ffb700 1 -- 172.21.15.142:0/306548913 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55adcc2d1fc0 con 0x55adcc31ceb0 2023-09-21T13:06:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.643+0000 7f28e1ffb700 10 client.27709 handle_command_reply: tid=0 2023-09-21T13:06:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.643+0000 7f2913e7ab80 1 client.27709 shutdown 2023-09-21T13:06:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 msgr2=0x55adcc312a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 0x55adcc312a90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f28f4005920 tx=0x7f28f401af70 comp rx=0 tx=0).stop 2023-09-21T13:06:55.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 shutdown_connections 2023-09-21T13:06:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc31ceb0 0x55adcc31f2d0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc30c260 0x55adcc3060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc3074b0 0x55adcc312a90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f28e1ffb700 0 client.27709 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:55.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/306548913 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc312fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 >> 172.21.15.142:0/306548913 conn(0x55adcc22ffa0 msgr2=0x55adcc2fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 shutdown_connections 2023-09-21T13:06:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 1 -- 172.21.15.142:0/306548913 wait complete. 2023-09-21T13:06:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.644+0000 7f2913e7ab80 20 client.27709 trim_cache size 0 max 16384 2023-09-21T13:06:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.662+0000 7f2913e7ab80 1 Processor -- start 2023-09-21T13:06:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.662+0000 7f2913e7ab80 1 -- start start 2023-09-21T13:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc2fda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc2fdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc0d58c0 con 0x55adcc307dd0 2023-09-21T13:06:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc2ff9b0 con 0x55adcc3074b0 2023-09-21T13:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc2fa210 con 0x55adcc30c260 2023-09-21T13:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39756/0 (socket says 172.21.15.142:39756) 2023-09-21T13:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f28fdb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc2fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f28fe39b700 1 -- 172.21.15.142:0/3526748571 learned_addr learned my addr 172.21.15.142:0/3526748571 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.663+0000 7f28feb9c700 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc2fdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 -- 172.21.15.142:0/3526748571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 msgr2=0x55adcc2fdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc2fdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 -- 172.21.15.142:0/3526748571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 msgr2=0x55adcc2fda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc2fda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 -- 172.21.15.142:0/3526748571 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55adcc0a61f0 con 0x55adcc3074b0 2023-09-21T13:06:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc2fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28fe39b700 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f28f4004c50 tx=0x7f28f4011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8dda596dbd0ed77 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28ed3ff700 1 -- 172.21.15.142:0/3526748571 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4005ce0 con 0x55adcc3074b0 2023-09-21T13:06:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28ed3ff700 1 -- 172.21.15.142:0/3526748571 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28f4015070 con 0x55adcc3074b0 2023-09-21T13:06:55.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.664+0000 7f28ed3ff700 1 -- 172.21.15.142:0/3526748571 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40055e0 con 0x55adcc3074b0 2023-09-21T13:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- 172.21.15.142:0/3526748571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 msgr2=0x55adcc300b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f28f4004c50 tx=0x7f28f4011900 comp rx=0 tx=0).stop 2023-09-21T13:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- 172.21.15.142:0/3526748571 shutdown_connections 2023-09-21T13:06:55.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc2fdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc300b40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/3526748571 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc2fda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- 172.21.15.142:0/3526748571 >> 172.21.15.142:0/3526748571 conn(0x55adcc22ffa0 msgr2=0x55adcc2fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- 172.21.15.142:0/3526748571 shutdown_connections 2023-09-21T13:06:55.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- 172.21.15.142:0/3526748571 wait complete. 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.665+0000 7f2913e7ab80 1 -- start start 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 Processor -- start 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc310670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc3110f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc36fe90 con 0x55adcc307dd0 2023-09-21T13:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc370000 con 0x55adcc3074b0 2023-09-21T13:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55adcc3701c0 con 0x55adcc30c260 2023-09-21T13:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f2913e7ab80 10 client.0 _ll_register_callbacks cb 0x55adcc13ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:06:55.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f28fe39b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc310670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.666+0000 7f28fdb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:38526/0 (socket says 172.21.15.142:38526) 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 -- 172.21.15.142:0/2676807113 learned_addr learned my addr 172.21.15.142:0/2676807113 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28feb9c700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc3110f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 -- 172.21.15.142:0/2676807113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 msgr2=0x55adcc3110f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc3110f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 -- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 msgr2=0x55adcc310670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc310670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 -- 172.21.15.142:0/2676807113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e8030040 con 0x55adcc307dd0 2023-09-21T13:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fe39b700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc310670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:06:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28fdb9a700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f28f806a390 tx=0x7f28e800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8de8a45b11842ff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.667+0000 7f28e1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e803c040 con 0x55adcc307dd0 2023-09-21T13:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f28f400fca0 con 0x55adcc307dd0 2023-09-21T13:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28e8035430 con 0x55adcc307dd0 2023-09-21T13:06:55.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28e8043e70 con 0x55adcc307dd0 2023-09-21T13:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f2913e7ab80 10 client.17655 fetch_fsmap learned FSMap version 41 2023-09-21T13:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55adcc068c00 con 0x55adcc307dd0 2023-09-21T13:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28f400fca0 con 0x55adcc307dd0 2023-09-21T13:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.668+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f28e80555a0 con 0x55adcc307dd0 2023-09-21T13:06:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 10 client.17655 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:06:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 10 client.17655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:06:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 20 client.17655 populate_metadata read hostname 'smithi142' 2023-09-21T13:06:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc371910 0x55adcc373d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:06:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 4 client.17655 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:06:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55adcc24de00 con 0x55adcc371910 2023-09-21T13:06:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f28fe39b700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc371910 0x55adcc373d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:06:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f28fe39b700 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc371910 0x55adcc373d30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69e3790482affda9 server_cookie=99a94ba98caa04a8 in_seq=0 out_seq=0 2023-09-21T13:06:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.669+0000 7f28e1ffb700 10 client.17655 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:55.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 990012 8.78 MB/sec execute 456 sec latency 18.668 ms 2023-09-21T13:06:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.738+0000 7f28e1ffb700 1 -- 172.21.15.142:0/2676807113 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55adcc24de00 con 0x55adcc371910 2023-09-21T13:06:55.735 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.738+0000 7f28e1ffb700 10 client.17655 handle_command_reply: tid=0 2023-09-21T13:06:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.739+0000 7f2913e7ab80 1 client.17655 shutdown 2023-09-21T13:06:55.736 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 msgr2=0x55adcc310bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f28f806a390 tx=0x7f28e800b260 comp rx=0 tx=0).stop 2023-09-21T13:06:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 shutdown_connections 2023-09-21T13:06:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55adcc371910 0x55adcc373d30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55adcc30c260 0x55adcc3110f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55adcc3074b0 0x55adcc310670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 --2- 172.21.15.142:0/2676807113 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55adcc307dd0 0x55adcc310bb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 >> 172.21.15.142:0/2676807113 conn(0x55adcc22ffa0 msgr2=0x55adcc2fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f28e1ffb700 0 client.17655 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:06:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 shutdown_connections 2023-09-21T13:06:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 1 -- 172.21.15.142:0/2676807113 wait complete. 2023-09-21T13:06:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.740+0000 7f2913e7ab80 20 client.17655 trim_cache size 0 max 16384 2023-09-21T13:06:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:06:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:06:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:06:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:06:55.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 msgr2=0x7f28e40a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 0x7f28e40a2cf0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28f8198660 tx=0x7f28e801a040 comp rx=0 tx=0).stop 2023-09-21T13:06:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 msgr2=0x7f28f819be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:06:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f28f000ef30 tx=0x7f28f000c3a0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 shutdown_connections 2023-09-21T13:06:55.741 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f28e40a0830 0x7f28e40a2cf0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28f8100fd0 0x7f28f8196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28f819b9f0 0x7f28f819be70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 --2- 172.21.15.142:0/3408212555 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28f81060f0 0x7f28f8197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:06:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.741+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 >> 172.21.15.142:0/3408212555 conn(0x7f28f80fc830 msgr2=0x7f28f80fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:06:55.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.742+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 shutdown_connections 2023-09-21T13:06:55.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:06:55.742+0000 7f29005ff700 1 -- 172.21.15.142:0/3408212555 wait complete. 2023-09-21T13:06:56.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:55 smithi156 ceph-mon[134078]: pgmap v332: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-09-21T13:06:56.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:55 smithi142 ceph-mon[97663]: pgmap v332: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-09-21T13:06:56.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:55 smithi160 ceph-mon[134450]: pgmap v332: 97 pgs: 97 active+clean; 324 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 190 op/s 2023-09-21T13:06:56.704 INFO:tasks.workunit.client.0.smithi142.stdout: 1 991540 8.78 MB/sec execute 457 sec latency 22.862 ms 2023-09-21T13:06:57.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 993057 8.78 MB/sec execute 458 sec latency 18.043 ms 2023-09-21T13:06:58.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:57 smithi156 ceph-mon[134078]: pgmap v333: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-09-21T13:06:58.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:57 smithi142 ceph-mon[97663]: pgmap v333: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-09-21T13:06:58.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:57 smithi160 ceph-mon[134450]: pgmap v333: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.3 MiB/s wr, 404 op/s 2023-09-21T13:06:58.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 995150 8.79 MB/sec execute 459 sec latency 14.610 ms 2023-09-21T13:06:59.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 996754 8.78 MB/sec execute 460 sec latency 25.608 ms 2023-09-21T13:07:00.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:06:59 smithi156 ceph-mon[134078]: pgmap v334: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 290 op/s 2023-09-21T13:07:00.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:06:59 smithi142 ceph-mon[97663]: pgmap v334: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 290 op/s 2023-09-21T13:07:00.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:06:59 smithi160 ceph-mon[134450]: pgmap v334: 97 pgs: 97 active+clean; 325 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 290 op/s 2023-09-21T13:07:00.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 998339 8.79 MB/sec execute 461 sec latency 25.291 ms 2023-09-21T13:07:01.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 999733 8.78 MB/sec execute 462 sec latency 16.882 ms 2023-09-21T13:07:02.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:01 smithi156 ceph-mon[134078]: pgmap v335: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.4 MiB/s wr, 407 op/s 2023-09-21T13:07:02.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:01 smithi142 ceph-mon[97663]: pgmap v335: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.4 MiB/s wr, 407 op/s 2023-09-21T13:07:02.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:01 smithi160 ceph-mon[134450]: pgmap v335: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.4 MiB/s wr, 407 op/s 2023-09-21T13:07:02.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1001091 8.78 MB/sec execute 463 sec latency 55.187 ms 2023-09-21T13:07:03.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:02 smithi156 ceph-mon[134078]: osdmap e97: 12 total, 12 up, 12 in 2023-09-21T13:07:03.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:02 smithi142 ceph-mon[97663]: osdmap e97: 12 total, 12 up, 12 in 2023-09-21T13:07:03.185 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:02 smithi160 ceph-mon[134450]: osdmap e97: 12 total, 12 up, 12 in 2023-09-21T13:07:03.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1002460 8.78 MB/sec execute 464 sec latency 14.551 ms 2023-09-21T13:07:04.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:03 smithi156 ceph-mon[134078]: pgmap v337: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:04.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:03 smithi142 ceph-mon[97663]: pgmap v337: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:04.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:03 smithi160 ceph-mon[134450]: pgmap v337: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:04.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1004625 8.78 MB/sec execute 465 sec latency 19.112 ms 2023-09-21T13:07:05.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1005868 8.78 MB/sec execute 466 sec latency 27.272 ms 2023-09-21T13:07:06.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:05 smithi156 ceph-mon[134078]: pgmap v338: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:06.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:05 smithi142 ceph-mon[97663]: pgmap v338: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:06.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:05 smithi160 ceph-mon[134450]: pgmap v338: 97 pgs: 97 active+clean; 321 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.9 MiB/s wr, 404 op/s 2023-09-21T13:07:06.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1007996 8.78 MB/sec execute 467 sec latency 16.110 ms 2023-09-21T13:07:07.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1009562 8.78 MB/sec execute 468 sec latency 16.236 ms 2023-09-21T13:07:08.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:07 smithi156 ceph-mon[134078]: pgmap v339: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:08.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:07 smithi142 ceph-mon[97663]: pgmap v339: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:08.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:07 smithi160 ceph-mon[134450]: pgmap v339: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:08.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1011857 8.79 MB/sec execute 469 sec latency 17.156 ms 2023-09-21T13:07:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/3844667012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b4073210 msgr2=0x7fb8b40735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/3844667012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b4073210 0x7fb8b40735f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4009990 tx=0x7fb8a4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/3844667012 shutdown_connections 2023-09-21T13:07:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/3844667012 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b410d5a0 0x7fb8b410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/3844667012 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b4073210 0x7fb8b40735f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/3844667012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073b30 0x7fb8b410d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/3844667012 >> 172.21.15.142:0/3844667012 conn(0x7fb8b40fc830 msgr2=0x7fb8b40fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:08.913 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/3844667012 shutdown_connections 2023-09-21T13:07:08.914 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.916+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/3844667012 wait complete. 2023-09-21T13:07:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.917+0000 7fb8ba3ff700 1 Processor -- start 2023-09-21T13:07:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.917+0000 7fb8ba3ff700 1 -- start start 2023-09-21T13:07:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 0x7fb8b41990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b4073b30 0x7fb8b4199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 0x7fb8b419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b419e2b0 con 0x7fb8b4073b30 2023-09-21T13:07:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b419e420 con 0x7fb8b410d5a0 2023-09-21T13:07:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8ba3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b419e5e0 con 0x7fb8b4073210 2023-09-21T13:07:08.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 0x7fb8b41990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 0x7fb8b419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 0x7fb8b41990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46260/0 (socket says 172.21.15.142:46260) 2023-09-21T13:07:08.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b3fff700 1 -- 172.21.15.142:0/98007773 learned_addr learned my addr 172.21.15.142:0/98007773 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b4073b30 0x7fb8b4199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 -- 172.21.15.142:0/98007773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 msgr2=0x7fb8b41990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 0x7fb8b41990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 -- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b4073b30 msgr2=0x7fb8b4199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b4073b30 0x7fb8b4199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.918+0000 7fb8b899c700 1 -- 172.21.15.142:0/98007773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a8009520 con 0x7fb8b410d5a0 2023-09-21T13:07:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8b899c700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 0x7fb8b419dc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00efc0 tx=0x7fb8ac00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8b17fa700 1 -- 172.21.15.142:0/98007773 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac018070 con 0x7fb8b410d5a0 2023-09-21T13:07:08.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8b17fa700 1 -- 172.21.15.142:0/98007773 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8ac00f040 con 0x7fb8b410d5a0 2023-09-21T13:07:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40095f0 con 0x7fb8b410d5a0 2023-09-21T13:07:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8b17fa700 1 -- 172.21.15.142:0/98007773 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00cd40 con 0x7fb8b410d5a0 2023-09-21T13:07:08.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.919+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b41a5f20 con 0x7fb8b410d5a0 2023-09-21T13:07:08.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.924+0000 7fb8b17fa700 1 -- 172.21.15.142:0/98007773 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fb8ac003a00 con 0x7fb8b410d5a0 2023-09-21T13:07:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.925+0000 7fb8cdd92b80 1 Processor -- start 2023-09-21T13:07:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.925+0000 7fb8cdd92b80 1 -- start start 2023-09-21T13:07:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b17fa700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 0x7fb89c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c862081120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b17fa700 1 -- 172.21.15.142:0/98007773 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb8ac0cba90 con 0x7fb8b410d5a0 2023-09-21T13:07:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 0x55c862081ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861fe8c40 con 0x55c86207c8b0 2023-09-21T13:07:08.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861fccc10 con 0x55c862081660 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861fca530 con 0x55c86207d1d0 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b899c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 0x55c862081ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 0x7fb89c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40382/0 (socket says 172.21.15.142:40382) 2023-09-21T13:07:08.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2235922392 learned_addr learned my addr 172.21.15.142:0/2235922392 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.926+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c862081120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2235922392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 msgr2=0x55c862081120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c862081120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2235922392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 msgr2=0x55c862081ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 0x55c862081ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2235922392 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c861df0d80 con 0x55c86207c8b0 2023-09-21T13:07:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b899c700 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 0x55c862081ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005f30 tx=0x7fb8a4005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b9f8646fdeee38 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 0x7fb89c0a2cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009fd0 tx=0x7fb8a8009a60 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.927+0000 7fb89a7fc700 1 -- 172.21.15.142:0/2235922392 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4026070 con 0x55c86207c8b0 2023-09-21T13:07:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb89a7fc700 1 -- 172.21.15.142:0/2235922392 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a401e040 con 0x55c86207c8b0 2023-09-21T13:07:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb89a7fc700 1 -- 172.21.15.142:0/2235922392 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a401d070 con 0x55c86207c8b0 2023-09-21T13:07:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2235922392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 msgr2=0x55c86207cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005f30 tx=0x7fb8a4005c00 comp rx=0 tx=0).stop 2023-09-21T13:07:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2235922392 shutdown_connections 2023-09-21T13:07:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c86207cc90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c862081660 0x55c862081ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2235922392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c862081120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.928+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2235922392 >> 172.21.15.142:0/2235922392 conn(0x55c861fa0fa0 msgr2=0x55c86206f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.929+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2235922392 shutdown_connections 2023-09-21T13:07:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.929+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2235922392 wait complete. 2023-09-21T13:07:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.929+0000 7fb8cdd92b80 1 -- start start 2023-09-21T13:07:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.929+0000 7fb8cdd92b80 1 Processor -- start 2023-09-21T13:07:08.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c862088e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 0x55c862086690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861fc5e20 con 0x55c86207c8b0 2023-09-21T13:07:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861f626e0 con 0x55c86207d1d0 2023-09-21T13:07:08.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861f62380 con 0x55c862081660 2023-09-21T13:07:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8cdd92b80 10 client.0 _ll_register_callbacks cb 0x55c861eaca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.930+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44220/0 (socket says 172.21.15.142:44220) 2023-09-21T13:07:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 -- 172.21.15.142:0/744252645 learned_addr learned my addr 172.21.15.142:0/744252645 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:08.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c862088e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b899c700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 0x55c862086690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 -- 172.21.15.142:0/744252645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 msgr2=0x55c862086690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 0x55c862086690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 -- 172.21.15.142:0/744252645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 msgr2=0x55c862088e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.939 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c862088e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 -- 172.21.15.142:0/744252645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b41a5f20 con 0x55c86207d1d0 2023-09-21T13:07:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b899c700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 0x55c862086690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8a801db30 tx=0x7fb8a8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d23bae694f94fda server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.931+0000 7fb8937fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:08.940 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80098e0 con 0x55c86207d1d0 2023-09-21T13:07:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c861f36b50 con 0x55c86207d1d0 2023-09-21T13:07:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb8a801de40 con 0x55c86207d1d0 2023-09-21T13:07:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a800fae0 con 0x55c86207d1d0 2023-09-21T13:07:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 10 client.27776 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:08.941 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7fb8b41106d0 con 0x55c86207d1d0 2023-09-21T13:07:08.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a8034020 con 0x55c86207d1d0 2023-09-21T13:07:08.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fb8a802f3d0 con 0x55c86207d1d0 2023-09-21T13:07:08.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 10 client.27776 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:08.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 10 client.27776 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:08.942 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.932+0000 7fb8cdd92b80 20 client.27776 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:08.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c862096780 0x55c862098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8cdd92b80 4 client.27776 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:08.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c862042fc0 con 0x55c862096780 2023-09-21T13:07:08.943 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c862096780 0x55c862098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.944 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c862096780 0x55c862098ba0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=477b6cf8d271f940 server_cookie=ec1fd9ea8dbbc1a0 in_seq=0 out_seq=0 2023-09-21T13:07:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.933+0000 7fb8937fe700 10 client.27776 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.934+0000 7fb8937fe700 1 -- 172.21.15.142:0/744252645 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c862042fc0 con 0x55c862096780 2023-09-21T13:07:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.934+0000 7fb8937fe700 10 client.27776 handle_command_reply: tid=0 2023-09-21T13:07:08.945 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.934+0000 7fb8cdd92b80 1 client.27776 shutdown 2023-09-21T13:07:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.934+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 msgr2=0x55c862086080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.934+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb8a801db30 tx=0x7fb8a8004750 comp rx=0 tx=0).stop 2023-09-21T13:07:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 shutdown_connections 2023-09-21T13:07:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c862096780 0x55c862098ba0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.946 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c86207c8b0 0x55c862088e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c862081660 0x55c862086690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/744252645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862086080 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 >> 172.21.15.142:0/744252645 conn(0x55c861fa0fa0 msgr2=0x55c86206ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8937fe700 0 client.27776 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 shutdown_connections 2023-09-21T13:07:08.947 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/744252645 wait complete. 2023-09-21T13:07:08.948 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.935+0000 7fb8cdd92b80 20 client.27776 trim_cache size 0 max 16384 2023-09-21T13:07:08.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 Processor -- start 2023-09-21T13:07:08.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 -- start start 2023-09-21T13:07:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862083a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c862083f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c861e468c0 con 0x55c862081660 2023-09-21T13:07:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8620707f0 con 0x55c86207d1d0 2023-09-21T13:07:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.957+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c862086c90 con 0x55c86207c8b0 2023-09-21T13:07:08.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862083a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:46284/0 (socket says 172.21.15.142:46284) 2023-09-21T13:07:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862083a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44222/0 (socket says 172.21.15.142:44222) 2023-09-21T13:07:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2857212889 learned_addr learned my addr 172.21.15.142:0/2857212889 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:08.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b899c700 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c862083f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2857212889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 msgr2=0x55c862083a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862083a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2857212889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 msgr2=0x55c862083f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c862083f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 -- 172.21.15.142:0/2857212889 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c861dd9c00 con 0x55c86207c8b0 2023-09-21T13:07:08.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.958+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005f00 tx=0x7fb8a4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c0487e38af721f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.959+0000 7fb89affd700 1 -- 172.21.15.142:0/2857212889 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a401d040 con 0x55c86207c8b0 2023-09-21T13:07:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.959+0000 7fb89affd700 1 -- 172.21.15.142:0/2857212889 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a4030180 con 0x55c86207c8b0 2023-09-21T13:07:08.958 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.959+0000 7fb89affd700 1 -- 172.21.15.142:0/2857212889 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4026040 con 0x55c86207c8b0 2023-09-21T13:07:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2857212889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 msgr2=0x55c862088930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4005f00 tx=0x7fb8a4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.961 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2857212889 shutdown_connections 2023-09-21T13:07:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c862083f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207c8b0 0x55c862088930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/2857212889 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207d1d0 0x55c862083a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2857212889 >> 172.21.15.142:0/2857212889 conn(0x55c861fa0fa0 msgr2=0x55c862091f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:08.962 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2857212889 shutdown_connections 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/2857212889 wait complete. 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.960+0000 7fb8cdd92b80 1 -- start start 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 Processor -- start 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c86208d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c86208b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86208be60 con 0x55c862081660 2023-09-21T13:07:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86208bfd0 con 0x55c86207c8b0 2023-09-21T13:07:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c86208c190 con 0x55c86207d1d0 2023-09-21T13:07:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8cdd92b80 10 client.0 _ll_register_callbacks cb 0x55c861eaca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:08.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.961+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:44230/0 (socket says 172.21.15.142:44230) 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 -- 172.21.15.142:0/83783602 learned_addr learned my addr 172.21.15.142:0/83783602 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b899c700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c86208b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 -- 172.21.15.142:0/83783602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 msgr2=0x55c86208d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c86208d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 -- 172.21.15.142:0/83783602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 msgr2=0x55c86208b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c86208b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 -- 172.21.15.142:0/83783602 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c861df0d80 con 0x55c86207c8b0 2023-09-21T13:07:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8b3fff700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40098e0 tx=0x7fb8a4005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acfcea9b6d2c2215 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8937fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:08.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.962+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a401d070 con 0x55c86207c8b0 2023-09-21T13:07:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(97..97 src has 1..97) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fb8a4005470 con 0x55c86207c8b0 2023-09-21T13:07:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8a401e040 con 0x55c86207c8b0 2023-09-21T13:07:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8a40305c0 con 0x55c86207c8b0 2023-09-21T13:07:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 10 client.27782 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:08.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55c861e171f0 con 0x55c86207c8b0 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8a401e040 con 0x55c86207c8b0 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fb8a4004d40 con 0x55c86207c8b0 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 10 client.27782 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 10 client.27782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 20 client.27782 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:08.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8620eb200 0x55c8620ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:08.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 4 client.27782 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:07:08.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.963+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c861fbee00 con 0x55c8620eb200 2023-09-21T13:07:08.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.964+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8620eb200 0x55c8620ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:08.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.964+0000 7fb8b37fe700 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8620eb200 0x55c8620ed5f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d16af50644508eae server_cookie=4a67b447933c0616 in_seq=0 out_seq=0 2023-09-21T13:07:08.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:08.964+0000 7fb8937fe700 10 client.27782 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:09.033 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.037+0000 7fb8937fe700 1 -- 172.21.15.142:0/83783602 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c861fbee00 con 0x55c8620eb200 2023-09-21T13:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.037+0000 7fb8937fe700 10 client.27782 handle_command_reply: tid=0 2023-09-21T13:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.037+0000 7fb8cdd92b80 1 client.27782 shutdown 2023-09-21T13:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 msgr2=0x55c86208d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:09.034 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40098e0 tx=0x7fb8a4005050 comp rx=0 tx=0).stop 2023-09-21T13:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 shutdown_connections 2023-09-21T13:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8620eb200 0x55c8620ed5f0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c862081660 0x55c86208b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8937fe700 0 client.27782 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:09.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c86207c8b0 0x55c86208d0c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 --2- 172.21.15.142:0/83783602 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c86207d1d0 0x55c86208d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 >> 172.21.15.142:0/83783602 conn(0x55c861fa0fa0 msgr2=0x55c862083a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 shutdown_connections 2023-09-21T13:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 1 -- 172.21.15.142:0/83783602 wait complete. 2023-09-21T13:07:09.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.038+0000 7fb8cdd92b80 20 client.27782 trim_cache size 0 max 16384 2023-09-21T13:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:07:09.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:07:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:07:09.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 msgr2=0x7fb89c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 0x7fb89c0a2cf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb8a8009fd0 tx=0x7fb8a8009a60 comp rx=0 tx=0).stop 2023-09-21T13:07:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 msgr2=0x7fb8b419dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 0x7fb8b419dc70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00efc0 tx=0x7fb8ac00c3a0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 shutdown_connections 2023-09-21T13:07:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb89c0a0830 0x7fb89c0a2cf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb8b410d5a0 0x7fb8b419dc70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8b4073210 0x7fb8b41990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 --2- 172.21.15.142:0/98007773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb8b4073b30 0x7fb8b4199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:09.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.039+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 >> 172.21.15.142:0/98007773 conn(0x7fb8b40fc830 msgr2=0x7fb8b410f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.040+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 shutdown_connections 2023-09-21T13:07:09.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:09.040+0000 7fb8ba3ff700 1 -- 172.21.15.142:0/98007773 wait complete. 2023-09-21T13:07:09.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1012960 8.79 MB/sec execute 470 sec latency 60.922 ms 2023-09-21T13:07:10.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:09 smithi156 ceph-mon[134078]: pgmap v340: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:10.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:09 smithi142 ceph-mon[97663]: pgmap v340: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:10.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:09 smithi160 ceph-mon[134450]: pgmap v340: 97 pgs: 97 active+clean; 326 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-21T13:07:10.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1014645 8.78 MB/sec execute 471 sec latency 50.672 ms 2023-09-21T13:07:11.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1016261 8.79 MB/sec execute 472 sec latency 67.222 ms 2023-09-21T13:07:12.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:11 smithi156 ceph-mon[134078]: pgmap v341: 97 pgs: 97 active+clean; 322 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2023-09-21T13:07:12.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:11 smithi156 ceph-mon[134078]: osdmap e98: 12 total, 12 up, 12 in 2023-09-21T13:07:12.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:11 smithi142 ceph-mon[97663]: pgmap v341: 97 pgs: 97 active+clean; 322 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2023-09-21T13:07:12.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:11 smithi142 ceph-mon[97663]: osdmap e98: 12 total, 12 up, 12 in 2023-09-21T13:07:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:11 smithi160 ceph-mon[134450]: pgmap v341: 97 pgs: 97 active+clean; 322 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 202 op/s 2023-09-21T13:07:12.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:11 smithi160 ceph-mon[134450]: osdmap e98: 12 total, 12 up, 12 in 2023-09-21T13:07:12.705 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1017474 8.78 MB/sec execute 473 sec latency 90.990 ms 2023-09-21T13:07:13.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1019535 8.79 MB/sec execute 474 sec latency 15.860 ms 2023-09-21T13:07:14.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:13 smithi156 ceph-mon[134078]: pgmap v343: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:14.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:13 smithi142 ceph-mon[97663]: pgmap v343: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:14.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:13 smithi160 ceph-mon[134450]: pgmap v343: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:14.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1020571 8.78 MB/sec execute 475 sec latency 22.002 ms 2023-09-21T13:07:15.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1022527 8.78 MB/sec execute 476 sec latency 22.341 ms 2023-09-21T13:07:16.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:15 smithi156 ceph-mon[134078]: pgmap v344: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:16.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:15 smithi142 ceph-mon[97663]: pgmap v344: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:16.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:15 smithi160 ceph-mon[134450]: pgmap v344: 97 pgs: 97 active+clean; 324 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 228 op/s 2023-09-21T13:07:16.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1023686 8.78 MB/sec execute 477 sec latency 39.818 ms 2023-09-21T13:07:17.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1025546 8.77 MB/sec execute 478 sec latency 18.065 ms 2023-09-21T13:07:18.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:17 smithi156 ceph-mon[134078]: pgmap v345: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:18.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:17 smithi142 ceph-mon[97663]: pgmap v345: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:18.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:17 smithi160 ceph-mon[134450]: pgmap v345: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:18.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1027081 8.78 MB/sec execute 479 sec latency 14.734 ms 2023-09-21T13:07:18.740 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:07:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/524275856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac105ba0 msgr2=0x7f9cac105f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/524275856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac105ba0 0x7f9cac105f80 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009990 tx=0x7f9ca8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/524275856 shutdown_connections 2023-09-21T13:07:18.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/524275856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac0688e0 0x7f9cac10da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/524275856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac105ba0 0x7f9cac105f80 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/524275856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac0683a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/524275856 >> 172.21.15.142:0/524275856 conn(0x7f9cac0755a0 msgr2=0x7f9cac0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/524275856 shutdown_connections 2023-09-21T13:07:18.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.980+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/524275856 wait complete. 2023-09-21T13:07:18.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.981+0000 7f9cb2f9d700 1 Processor -- start 2023-09-21T13:07:18.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.981+0000 7f9cb2f9d700 1 -- start start 2023-09-21T13:07:18.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac0688e0 0x7f9cac19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 0x7f9cac194790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac194e00 con 0x7f9cac105ba0 2023-09-21T13:07:18.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac194f70 con 0x7f9cac067f40 2023-09-21T13:07:18.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb2f9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac195130 con 0x7f9cac0688e0 2023-09-21T13:07:18.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33980/0 (socket says 172.21.15.142:33980) 2023-09-21T13:07:18.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/2725344989 learned_addr learned my addr 172.21.15.142:0/2725344989 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:18.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb179a700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac0688e0 0x7f9cac19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.982+0000 7f9cb279c700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 0x7f9cac194790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/2725344989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac0688e0 msgr2=0x7f9cac19ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:18.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac0688e0 0x7f9cac19ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 msgr2=0x7f9cac194790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:18.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 0x7f9cac194790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:18.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/2725344989 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c009520 con 0x7f9cac067f40 2023-09-21T13:07:18.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb279c700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 0x7f9cac194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:07:18.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:18.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9ca2ffd700 1 -- 172.21.15.142:0/2725344989 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca801d070 con 0x7f9cac067f40 2023-09-21T13:07:18.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca80095f0 con 0x7f9cac067f40 2023-09-21T13:07:18.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9ca2ffd700 1 -- 172.21.15.142:0/2725344989 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ca8021410 con 0x7f9cac067f40 2023-09-21T13:07:18.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9ca2ffd700 1 -- 172.21.15.142:0/2725344989 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8017650 con 0x7f9cac067f40 2023-09-21T13:07:18.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.983+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac1a1530 con 0x7f9cac067f40 2023-09-21T13:07:18.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.988+0000 7f9ca2ffd700 1 -- 172.21.15.142:0/2725344989 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f9ca8021580 con 0x7f9cac067f40 2023-09-21T13:07:18.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.989+0000 7f9cc7b7db80 1 Processor -- start 2023-09-21T13:07:18.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.990+0000 7f9ca2ffd700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 0x7f9c980a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.990+0000 7f9cc7b7db80 1 -- start start 2023-09-21T13:07:18.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.990+0000 7f9ca2ffd700 1 -- 172.21.15.142:0/2725344989 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ca80cd3c0 con 0x7f9cac067f40 2023-09-21T13:07:18.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.990+0000 7f9cb279c700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 0x7f9c980a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.990+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c0247a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 0x55ef7c01e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:18.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf92ca0 con 0x55ef7c0243c0 2023-09-21T13:07:18.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf76c70 con 0x55ef7c024ce0 2023-09-21T13:07:18.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf74590 con 0x55ef7c01ebb0 2023-09-21T13:07:18.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb279c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 0x55ef7c01e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:18.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb279c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43954/0 (socket says 172.21.15.142:43954) 2023-09-21T13:07:18.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb279c700 1 -- 172.21.15.142:0/2442156642 learned_addr learned my addr 172.21.15.142:0/2442156642 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:18.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c0247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 -- 172.21.15.142:0/2442156642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 msgr2=0x55ef7c01f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 -- 172.21.15.142:0/2442156642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 msgr2=0x55ef7c0247a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c0247a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.991+0000 7f9cb179a700 1 -- 172.21.15.142:0/2442156642 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7bd9ade0 con 0x55ef7c024ce0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.992+0000 7f9cb179a700 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 0x55ef7c01e670 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009e10 tx=0x7f9c9c011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a214f3939673e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.992+0000 7f9cb279c700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 0x7f9c980a2d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400dfd0 tx=0x7f9ca400df20 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.992+0000 7f9c97fff700 1 -- 172.21.15.142:0/2442156642 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c019630 con 0x55ef7c024ce0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.992+0000 7f9c97fff700 1 -- 172.21.15.142:0/2442156642 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c9c019c50 con 0x55ef7c024ce0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.992+0000 7f9c97fff700 1 -- 172.21.15.142:0/2442156642 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c00ed70 con 0x55ef7c024ce0 2023-09-21T13:07:19.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/2442156642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 msgr2=0x55ef7c01e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 0x55ef7c01e670 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c009e10 tx=0x7f9c9c011720 comp rx=0 tx=0).stop 2023-09-21T13:07:19.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/2442156642 shutdown_connections 2023-09-21T13:07:19.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c0247a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/2442156642 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c024ce0 0x55ef7c01e670 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/2442156642 >> 172.21.15.142:0/2442156642 conn(0x55ef7bf4b000 msgr2=0x55ef7c019650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:19.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/2442156642 shutdown_connections 2023-09-21T13:07:19.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/2442156642 wait complete. 2023-09-21T13:07:19.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.993+0000 7f9cc7b7db80 1 -- start start 2023-09-21T13:07:19.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 Processor -- start 2023-09-21T13:07:19.004 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c028500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 0x55ef7c028a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf6fe80 con 0x55ef7c024ce0 2023-09-21T13:07:19.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf0c740 con 0x55ef7c0243c0 2023-09-21T13:07:19.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bf0c3e0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cc7b7db80 10 client.0 _ll_register_callbacks cb 0x55ef7be56a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:19.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cb179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c028500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43958/0 (socket says 172.21.15.142:43958) 2023-09-21T13:07:19.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.994+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/37563512 learned_addr learned my addr 172.21.15.142:0/37563512 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:19.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb279c700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 0x55ef7c028a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 msgr2=0x55ef7c028500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c028500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/37563512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 msgr2=0x55ef7c028a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 0x55ef7c028a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/37563512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c009a70 con 0x55ef7c01ebb0 2023-09-21T13:07:19.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb279c700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 0x55ef7c028a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:07:19.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80cab10 tx=0x7f9ca80cb010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768de104df2a9e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:19.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9c957fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:07:19.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80af030 con 0x55ef7c01ebb0 2023-09-21T13:07:19.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef7bee0bb0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ca80b0070 con 0x55ef7c01ebb0 2023-09-21T13:07:19.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ca809e6d0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cc7b7db80 10 client.27742 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:19.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.995+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55ef7bd83c60 con 0x55ef7c01ebb0 2023-09-21T13:07:19.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9ca8064080 con 0x55ef7c01ebb0 2023-09-21T13:07:19.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9ca8060af0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 10 client.27742 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:19.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 10 client.27742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:19.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 20 client.27742 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:19.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c038270 0x55ef7c03a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 4 client.27742 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:19.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef7bfed020 con 0x55ef7c038270 2023-09-21T13:07:19.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.996+0000 7f9cb179a700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c038270 0x55ef7c03a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.997+0000 7f9c957fa700 10 client.27742 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:19.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.997+0000 7f9cb179a700 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c038270 0x55ef7c03a660 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd019f0976ddaae7 server_cookie=a7cc403d05ec81f1 in_seq=0 out_seq=0 2023-09-21T13:07:19.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9c957fa700 1 -- 172.21.15.142:0/37563512 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ef7bfed020 con 0x55ef7c038270 2023-09-21T13:07:19.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9c957fa700 10 client.27742 handle_command_reply: tid=0 2023-09-21T13:07:19.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 client.27742 shutdown 2023-09-21T13:07:19.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 msgr2=0x55ef7c027fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80cab10 tx=0x7f9ca80cb010 comp rx=0 tx=0).stop 2023-09-21T13:07:19.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 shutdown_connections 2023-09-21T13:07:19.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c038270 0x55ef7c03a660 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c024ce0 0x55ef7c028a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9c957fa700 0 client.27742 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:19.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c01ebb0 0x55ef7c027fc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/37563512 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c028500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 >> 172.21.15.142:0/37563512 conn(0x55ef7bf4b000 msgr2=0x55ef7c019360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:19.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 shutdown_connections 2023-09-21T13:07:19.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:18.999+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/37563512 wait complete. 2023-09-21T13:07:19.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.000+0000 7f9cc7b7db80 20 client.27742 trim_cache size 0 max 16384 2023-09-21T13:07:19.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 Processor -- start 2023-09-21T13:07:19.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 -- start start 2023-09-21T13:07:19.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c022250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7bdf0920 con 0x55ef7c01ebb0 2023-09-21T13:07:19.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7c013e50 con 0x55ef7c0243c0 2023-09-21T13:07:19.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7c0113f0 con 0x55ef7c024ce0 2023-09-21T13:07:19.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cb179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cb179a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34000/0 (socket says 172.21.15.142:34000) 2023-09-21T13:07:19.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cb179a700 1 -- 172.21.15.142:0/1738410326 learned_addr learned my addr 172.21.15.142:0/1738410326 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:19.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.019+0000 7f9cb279c700 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c022250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 -- 172.21.15.142:0/1738410326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 msgr2=0x55ef7c022250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c022250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 -- 172.21.15.142:0/1738410326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c01ebb0 msgr2=0x55ef7c01e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 -- 172.21.15.142:0/1738410326 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef7bdc1250 con 0x55ef7c0243c0 2023-09-21T13:07:19.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb279c700 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c022250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:07:19.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9cb179a700 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00e920 tx=0x7f9c9c009800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6076f1063fb968ed server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:19.030 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9ca0ff9700 1 -- 172.21.15.142:0/1738410326 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c029070 con 0x55ef7c0243c0 2023-09-21T13:07:19.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9ca0ff9700 1 -- 172.21.15.142:0/1738410326 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c9c005b00 con 0x55ef7c0243c0 2023-09-21T13:07:19.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.020+0000 7f9ca0ff9700 1 -- 172.21.15.142:0/1738410326 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9c019940 con 0x55ef7c0243c0 2023-09-21T13:07:19.031 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/1738410326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 msgr2=0x55ef7c02f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c00e920 tx=0x7f9c9c009800 comp rx=0 tx=0).stop 2023-09-21T13:07:19.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/1738410326 shutdown_connections 2023-09-21T13:07:19.032 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c01ebb0 0x55ef7c01e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c022250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/1738410326 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c0243c0 0x55ef7c02f720 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/1738410326 >> 172.21.15.142:0/1738410326 conn(0x55ef7bf4b000 msgr2=0x55ef7c0285d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:19.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/1738410326 shutdown_connections 2023-09-21T13:07:19.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.021+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/1738410326 wait complete. 2023-09-21T13:07:19.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 -- start start 2023-09-21T13:07:19.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 Processor -- start 2023-09-21T13:07:19.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c084ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c07ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7c0806c0 con 0x55ef7c0243c0 2023-09-21T13:07:19.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7c080830 con 0x55ef7c01ebb0 2023-09-21T13:07:19.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef7c0809f0 con 0x55ef7c024ce0 2023-09-21T13:07:19.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.022+0000 7f9cc7b7db80 10 client.0 _ll_register_callbacks cb 0x55ef7be56a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:19.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34014/0 (socket says 172.21.15.142:34014) 2023-09-21T13:07:19.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/299624551 learned_addr learned my addr 172.21.15.142:0/299624551 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:19.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb279c700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c07ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb179a700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c084ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.039 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/299624551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 msgr2=0x55ef7c07ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c07ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/299624551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 msgr2=0x55ef7c084ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:19.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c084ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 -- 172.21.15.142:0/299624551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ef7bd9ade0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9cb1f9b700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8097310 tx=0x7f9ca8021c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ae019a691e95380 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:19.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.023+0000 7f9c957fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:19.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca80af030 con 0x55ef7c01ebb0 2023-09-21T13:07:19.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f9ca80b0070 con 0x55ef7c01ebb0 2023-09-21T13:07:19.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef7bf68e60 con 0x55ef7c01ebb0 2023-09-21T13:07:19.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ca8099fa0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 10 client.27800 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:19.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55ef7bd992b0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ef7bf68e60 con 0x55ef7c01ebb0 2023-09-21T13:07:19.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9ca80a2ad0 con 0x55ef7c01ebb0 2023-09-21T13:07:19.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 10 client.27800 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:19.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 10 client.27800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:19.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 20 client.27800 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:19.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c08d110 0x55ef7c08f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:19.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.024+0000 7f9cc7b7db80 4 client.27800 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:07:19.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ef7bf68b80 con 0x55ef7c08d110 2023-09-21T13:07:19.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9cb179a700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c08d110 0x55ef7c08f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:19.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9cb179a700 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c08d110 0x55ef7c08f500 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74bb27480334f2cb server_cookie=848f1be10ca4858e in_seq=0 out_seq=0 2023-09-21T13:07:19.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9c957fa700 10 client.27800 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:19.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9c957fa700 1 -- 172.21.15.142:0/299624551 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ef7bf68b80 con 0x55ef7c08d110 2023-09-21T13:07:19.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9c957fa700 10 client.27800 handle_command_reply: tid=0 2023-09-21T13:07:19.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.025+0000 7f9cc7b7db80 1 client.27800 shutdown 2023-09-21T13:07:19.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 msgr2=0x55ef7c084660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8097310 tx=0x7f9ca8021c30 comp rx=0 tx=0).stop 2023-09-21T13:07:19.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 shutdown_connections 2023-09-21T13:07:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ef7c08d110 0x55ef7c08f500 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.051 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ef7c024ce0 0x55ef7c07ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ef7c01ebb0 0x55ef7c084660 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 --2- 172.21.15.142:0/299624551 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ef7c0243c0 0x55ef7c084ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 >> 172.21.15.142:0/299624551 conn(0x55ef7bf4b000 msgr2=0x55ef7c0285d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:19.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9c957fa700 0 client.27800 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:19.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 shutdown_connections 2023-09-21T13:07:19.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 1 -- 172.21.15.142:0/299624551 wait complete. 2023-09-21T13:07:19.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.026+0000 7f9cc7b7db80 20 client.27800 trim_cache size 0 max 16384 2023-09-21T13:07:19.055 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:07:19.055 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:07:19.055 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:07:19.055 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:07:19.055 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:07:19.056 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:07:19.056 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:07:19.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:07:19.056 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:07:19.056 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:07:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 msgr2=0x7f9c980a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 0x7f9c980a2d90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400dfd0 tx=0x7f9ca400df20 comp rx=0 tx=0).stop 2023-09-21T13:07:19.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 msgr2=0x7f9cac19a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8000c00 tx=0x7f9ca8005740 comp rx=0 tx=0).stop 2023-09-21T13:07:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 shutdown_connections 2023-09-21T13:07:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f9c980a08d0 0x7f9c980a2d90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9cac105ba0 0x7f9cac194790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.059 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9cac067f40 0x7f9cac19a720 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 --2- 172.21.15.142:0/2725344989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cac0688e0 0x7f9cac19ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 >> 172.21.15.142:0/2725344989 conn(0x7f9cac0755a0 msgr2=0x7f9cac0fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 shutdown_connections 2023-09-21T13:07:19.060 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:19.027+0000 7f9cb2f9d700 1 -- 172.21.15.142:0/2725344989 wait complete. 2023-09-21T13:07:19.061 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:07:19.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1028888 8.77 MB/sec execute 480 sec latency 18.677 ms 2023-09-21T13:07:20.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:19 smithi156 ceph-mon[134078]: pgmap v346: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:20.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:19 smithi142 ceph-mon[97663]: pgmap v346: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:20.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:19 smithi160 ceph-mon[134450]: pgmap v346: 97 pgs: 97 active+clean; 335 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-21T13:07:20.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1030599 8.78 MB/sec execute 481 sec latency 19.868 ms 2023-09-21T13:07:21.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1031926 8.78 MB/sec execute 482 sec latency 35.715 ms 2023-09-21T13:07:22.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:21 smithi156 ceph-mon[134078]: pgmap v347: 97 pgs: 97 active+clean; 340 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 183 op/s 2023-09-21T13:07:22.288 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:21 smithi160 ceph-mon[134450]: pgmap v347: 97 pgs: 97 active+clean; 340 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 183 op/s 2023-09-21T13:07:22.288 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:21 smithi142 ceph-mon[97663]: pgmap v347: 97 pgs: 97 active+clean; 340 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 183 op/s 2023-09-21T13:07:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3579769892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 msgr2=0x7f7fac101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.303 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3579769892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac101200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009990 tx=0x7f7f9c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3579769892 shutdown_connections 2023-09-21T13:07:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3579769892 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 0x7f7fac10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3579769892 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac101200 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.304 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3579769892 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac1017d0 0x7f7fac105810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3579769892 >> 172.21.15.142:0/3579769892 conn(0x7f7fac0fc6a0 msgr2=0x7f7fac0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3579769892 shutdown_connections 2023-09-21T13:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.218+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3579769892 wait complete. 2023-09-21T13:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.219+0000 7f7fb09fe700 1 Processor -- start 2023-09-21T13:07:22.305 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 -- start start 2023-09-21T13:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 0x7f7fac1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac19a5a0 0x7f7fac19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.306 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac19af90 con 0x7f7fac105f40 2023-09-21T13:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac19b100 con 0x7f7fac100e20 2023-09-21T13:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fb09fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac19b2c0 con 0x7f7fac19a5a0 2023-09-21T13:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.307 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7faa59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 0x7f7fac1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34044/0 (socket says 172.21.15.142:34044) 2023-09-21T13:07:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7faad9d700 1 -- 172.21.15.142:0/3401392321 learned_addr learned my addr 172.21.15.142:0/3401392321 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:22.308 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.220+0000 7f7fab59e700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac19a5a0 0x7f7fac19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 -- 172.21.15.142:0/3401392321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac19a5a0 msgr2=0x7f7fac19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac19a5a0 0x7f7fac19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 -- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 msgr2=0x7f7fac1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 0x7f7fac1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.309 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 -- 172.21.15.142:0/3401392321 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0095f0 con 0x7f7fac100e20 2023-09-21T13:07:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005910 tx=0x7f7f9c005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7f93fff700 1 -- 172.21.15.142:0/3401392321 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c01d070 con 0x7f7fac100e20 2023-09-21T13:07:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7f93fff700 1 -- 172.21.15.142:0/3401392321 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9c022470 con 0x7f7fac100e20 2023-09-21T13:07:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac1a3930 con 0x7f7fac100e20 2023-09-21T13:07:22.310 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7f93fff700 1 -- 172.21.15.142:0/3401392321 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c017650 con 0x7f7fac100e20 2023-09-21T13:07:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.221+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1a3db0 con 0x7f7fac100e20 2023-09-21T13:07:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.225+0000 7f7f93fff700 1 -- 172.21.15.142:0/3401392321 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7f9c0225e0 con 0x7f7fac100e20 2023-09-21T13:07:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 Processor -- start 2023-09-21T13:07:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 -- start start 2023-09-21T13:07:22.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d23240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c91c40 con 0x5586a1d22e60 2023-09-21T13:07:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c75c10 con 0x5586a1d23780 2023-09-21T13:07:22.312 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.227+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c73530 con 0x5586a1d1d7a0 2023-09-21T13:07:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7f93fff700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 0x7f7f940a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34048/0 (socket says 172.21.15.142:34048) 2023-09-21T13:07:22.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 -- 172.21.15.142:0/539212517 learned_addr learned my addr 172.21.15.142:0/539212517 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faa59c700 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7fab59e700 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d23240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7f93fff700 1 -- 172.21.15.142:0/3401392321 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7f9c0cd160 con 0x7f7fac100e20 2023-09-21T13:07:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7fab59e700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 0x7f7f940a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 -- 172.21.15.142:0/539212517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 msgr2=0x5586a1d1dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 -- 172.21.15.142:0/539212517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 msgr2=0x5586a1d23240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d23240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.228+0000 7f7faad9d700 1 -- 172.21.15.142:0/539212517 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a1a99d80 con 0x5586a1d23780 2023-09-21T13:07:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7faad9d700 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c096c60 tx=0x7f7f9c096bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=575cf1b2508d954f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7f917fa700 1 -- 172.21.15.142:0/539212517 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09a2a0 con 0x5586a1d23780 2023-09-21T13:07:22.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7f917fa700 1 -- 172.21.15.142:0/539212517 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9c09a0c0 con 0x5586a1d23780 2023-09-21T13:07:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7f917fa700 1 -- 172.21.15.142:0/539212517 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0228c0 con 0x5586a1d23780 2023-09-21T13:07:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/539212517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 msgr2=0x5586a1d1d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c096c60 tx=0x7f7f9c096bd0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.229+0000 7f7fab59e700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 0x7f7f940a2d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ec0 tx=0x7f7fa400b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.318 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/539212517 shutdown_connections 2023-09-21T13:07:22.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d23240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.319 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/539212517 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d1d260 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/539212517 >> 172.21.15.142:0/539212517 conn(0x5586a1c49fa0 msgr2=0x5586a1d18180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.320 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/539212517 shutdown_connections 2023-09-21T13:07:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/539212517 wait complete. 2023-09-21T13:07:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.230+0000 7f7fc4b8db80 1 -- start start 2023-09-21T13:07:22.321 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 Processor -- start 2023-09-21T13:07:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d29840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.322 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d26ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c6ee20 con 0x5586a1d22e60 2023-09-21T13:07:22.323 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c0b6e0 con 0x5586a1d23780 2023-09-21T13:07:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1c0b380 con 0x5586a1d1d7a0 2023-09-21T13:07:22.324 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fc4b8db80 10 client.0 _ll_register_callbacks cb 0x5586a1b55a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fab59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34060/0 (socket says 172.21.15.142:34060) 2023-09-21T13:07:22.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.231+0000 7f7fab59e700 1 -- 172.21.15.142:0/2374575531 learned_addr learned my addr 172.21.15.142:0/2374575531 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7faa59c700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d26ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.326 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7faad9d700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d29840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 -- 172.21.15.142:0/2374575531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 msgr2=0x5586a1d29840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d29840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 -- 172.21.15.142:0/2374575531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 msgr2=0x5586a1d26ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d26ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 -- 172.21.15.142:0/2374575531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1a3db0 con 0x5586a1d23780 2023-09-21T13:07:22.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7fab59e700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4018bc0 tx=0x7f7fa4004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9179c3dddc6f98f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.232+0000 7f7f8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400e070 con 0x5586a1d23780 2023-09-21T13:07:22.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586a1bdfb50 con 0x5586a1d23780 2023-09-21T13:07:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7fa4016990 con 0x5586a1d23780 2023-09-21T13:07:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa4016b50 con 0x5586a1d23780 2023-09-21T13:07:22.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7fc4b8db80 10 client.27812 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5586a1a82c00 con 0x5586a1d23780 2023-09-21T13:07:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.233+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fa4030020 con 0x5586a1d23780 2023-09-21T13:07:22.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7fa402b3b0 con 0x5586a1d23780 2023-09-21T13:07:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 10 client.27812 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 10 client.27812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 20 client.27812 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d3b2b0 0x5586a1d3d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.332 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 4 client.27812 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586a1cebfc0 con 0x5586a1d3b2b0 2023-09-21T13:07:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7faad9d700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d3b2b0 0x5586a1d3d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7faad9d700 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d3b2b0 0x5586a1d3d6d0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa38ba1b5ba5b140 server_cookie=888d37333c13655a in_seq=0 out_seq=0 2023-09-21T13:07:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.234+0000 7f7f8eff5700 10 client.27812 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:22.333 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.235+0000 7f7f8eff5700 1 -- 172.21.15.142:0/2374575531 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5586a1cebfc0 con 0x5586a1d3b2b0 2023-09-21T13:07:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.235+0000 7f7f8eff5700 10 client.27812 handle_command_reply: tid=0 2023-09-21T13:07:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.235+0000 7f7fc4b8db80 1 client.27812 shutdown 2023-09-21T13:07:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 msgr2=0x5586a1d271b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4018bc0 tx=0x7f7fa4004ad0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 shutdown_connections 2023-09-21T13:07:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d3b2b0 0x5586a1d3d6d0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d23780 0x5586a1d271b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7f8eff5700 0 client.27812 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:22.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d29840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/2374575531 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d26ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 >> 172.21.15.142:0/2374575531 conn(0x5586a1c49fa0 msgr2=0x5586a1d176c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 shutdown_connections 2023-09-21T13:07:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/2374575531 wait complete. 2023-09-21T13:07:22.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.236+0000 7f7fc4b8db80 20 client.27812 trim_cache size 0 max 16384 2023-09-21T13:07:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.254+0000 7f7fc4b8db80 1 Processor -- start 2023-09-21T13:07:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.254+0000 7f7fc4b8db80 1 -- start start 2023-09-21T13:07:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.254+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d29370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d23780 0x5586a1d20c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1aef8c0 con 0x5586a1d22e60 2023-09-21T13:07:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1d277e0 con 0x5586a1d1d7a0 2023-09-21T13:07:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1d37bd0 con 0x5586a1d23780 2023-09-21T13:07:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:34068/0 (socket says 172.21.15.142:34068) 2023-09-21T13:07:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 -- 172.21.15.142:0/3578752447 learned_addr learned my addr 172.21.15.142:0/3578752447 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7fab59e700 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d23780 0x5586a1d20c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faa59c700 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d29370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 -- 172.21.15.142:0/3578752447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d23780 msgr2=0x5586a1d20c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d23780 0x5586a1d20c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 -- 172.21.15.142:0/3578752447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 msgr2=0x5586a1d29370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d29370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 -- 172.21.15.142:0/3578752447 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a1ac01f0 con 0x5586a1d1d7a0 2023-09-21T13:07:22.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.255+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c09a460 tx=0x7f7f9c022f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6152d62d8674b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.256+0000 7f7f91ffb700 1 -- 172.21.15.142:0/3578752447 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09ae60 con 0x5586a1d1d7a0 2023-09-21T13:07:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.256+0000 7f7f91ffb700 1 -- 172.21.15.142:0/3578752447 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9c0b2070 con 0x5586a1d1d7a0 2023-09-21T13:07:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.256+0000 7f7f91ffb700 1 -- 172.21.15.142:0/3578752447 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09e380 con 0x5586a1d1d7a0 2023-09-21T13:07:22.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.256+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3578752447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 msgr2=0x5586a1d1d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.256+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c09a460 tx=0x7f7f9c022f90 comp rx=0 tx=0).stop 2023-09-21T13:07:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3578752447 shutdown_connections 2023-09-21T13:07:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d23780 0x5586a1d20c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d1d7a0 0x5586a1d1d260 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3578752447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d22e60 0x5586a1d29370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3578752447 >> 172.21.15.142:0/3578752447 conn(0x5586a1c49fa0 msgr2=0x5586a1d374c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3578752447 shutdown_connections 2023-09-21T13:07:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3578752447 wait complete. 2023-09-21T13:07:22.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 -- start start 2023-09-21T13:07:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.257+0000 7f7fc4b8db80 1 Processor -- start 2023-09-21T13:07:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d22e60 0x5586a1d32560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d23780 0x5586a1d30550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1d30c20 con 0x5586a1d23780 2023-09-21T13:07:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1d30d90 con 0x5586a1d22e60 2023-09-21T13:07:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a1d30f50 con 0x5586a1d1d7a0 2023-09-21T13:07:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7fc4b8db80 10 client.0 _ll_register_callbacks cb 0x5586a1b55a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:22.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7faad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:44030/0 (socket says 172.21.15.142:44030) 2023-09-21T13:07:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7faad9d700 1 -- 172.21.15.142:0/3660245674 learned_addr learned my addr 172.21.15.142:0/3660245674 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.258+0000 7f7faa59c700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d22e60 0x5586a1d32560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7fab59e700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d23780 0x5586a1d30550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.347 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 -- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d22e60 msgr2=0x5586a1d32560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d22e60 0x5586a1d32560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 -- 172.21.15.142:0/3660245674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d23780 msgr2=0x5586a1d30550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d23780 0x5586a1d30550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 -- 172.21.15.142:0/3660245674 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586a1a99d80 con 0x5586a1d1d7a0 2023-09-21T13:07:22.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7faad9d700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0058b0 tx=0x7f7f9c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc69a5cda6657811 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7f8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:07:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c09a760 con 0x5586a1d1d7a0 2023-09-21T13:07:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7f9c09e120 con 0x5586a1d1d7a0 2023-09-21T13:07:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f9c09a0c0 con 0x5586a1d1d7a0 2023-09-21T13:07:22.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f9c09e2e0 con 0x5586a1d1d7a0 2023-09-21T13:07:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7fc4b8db80 10 client.27766 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.259+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5586a1a98250 con 0x5586a1d1d7a0 2023-09-21T13:07:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9c09a0c0 con 0x5586a1d1d7a0 2023-09-21T13:07:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7f9c099d70 con 0x5586a1d1d7a0 2023-09-21T13:07:22.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 10 client.27766 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 10 client.27766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 20 client.27766 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d8fed0 0x5586a1d922c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 4 client.27766 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:07:22.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5586a1c67e00 con 0x5586a1d8fed0 2023-09-21T13:07:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.260+0000 7f7faa59c700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d8fed0 0x5586a1d922c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.261+0000 7f7f8eff5700 10 client.27766 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:22.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.261+0000 7f7faa59c700 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d8fed0 0x5586a1d922c0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56229eb41d395afb server_cookie=efefc6df0e1761b6 in_seq=0 out_seq=0 2023-09-21T13:07:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.353+0000 7f7f8eff5700 1 -- 172.21.15.142:0/3660245674 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5586a1c67e00 con 0x5586a1d8fed0 2023-09-21T13:07:22.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.353+0000 7f7f8eff5700 10 client.27766 handle_command_reply: tid=0 2023-09-21T13:07:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.353+0000 7f7fc4b8db80 1 client.27766 shutdown 2023-09-21T13:07:22.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.353+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 msgr2=0x5586a1d32020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.353+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0058b0 tx=0x7f7f9c009310 comp rx=0 tx=0).stop 2023-09-21T13:07:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 shutdown_connections 2023-09-21T13:07:22.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5586a1d8fed0 0x5586a1d922c0 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5586a1d23780 0x5586a1d30550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5586a1d1d7a0 0x5586a1d32020 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 --2- 172.21.15.142:0/3660245674 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5586a1d22e60 0x5586a1d32560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 >> 172.21.15.142:0/3660245674 conn(0x5586a1c49fa0 msgr2=0x5586a1d20c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7f8eff5700 0 client.27766 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 shutdown_connections 2023-09-21T13:07:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 1 -- 172.21.15.142:0/3660245674 wait complete. 2023-09-21T13:07:22.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.354+0000 7f7fc4b8db80 20 client.27766 trim_cache size 0 max 16384 2023-09-21T13:07:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:07:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:07:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:07:22.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:07:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.355+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 msgr2=0x7f7f940a2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.359 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.355+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 0x7f7f940a2d20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ec0 tx=0x7f7fa400b040 comp rx=0 tx=0).stop 2023-09-21T13:07:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.355+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 msgr2=0x7f7fac196cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.355+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c005910 tx=0x7f7f9c005720 comp rx=0 tx=0).stop 2023-09-21T13:07:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 shutdown_connections 2023-09-21T13:07:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7f940a0860 0x7f7f940a2d20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.360 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7fac19a5a0 0x7f7fac19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7fac100e20 0x7f7fac196cb0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 --2- 172.21.15.142:0/3401392321 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7fac105f40 0x7f7fac1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 >> 172.21.15.142:0/3401392321 conn(0x7f7fac0fc6a0 msgr2=0x7f7fac104850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:22.361 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 shutdown_connections 2023-09-21T13:07:22.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:22.356+0000 7f7fb09fe700 1 -- 172.21.15.142:0/3401392321 wait complete. 2023-09-21T13:07:22.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1033935 8.78 MB/sec execute 483 sec latency 36.982 ms 2023-09-21T13:07:23.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1035284 8.78 MB/sec execute 484 sec latency 27.024 ms 2023-09-21T13:07:24.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:23 smithi156 ceph-mon[134078]: pgmap v348: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-09-21T13:07:24.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:23 smithi142 ceph-mon[97663]: pgmap v348: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-09-21T13:07:24.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:23 smithi160 ceph-mon[134450]: pgmap v348: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 169 op/s 2023-09-21T13:07:24.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1036989 8.78 MB/sec execute 485 sec latency 253.673 ms 2023-09-21T13:07:25.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1038429 8.78 MB/sec execute 486 sec latency 10.608 ms 2023-09-21T13:07:26.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:25 smithi156 ceph-mon[134078]: pgmap v349: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-09-21T13:07:26.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:25 smithi142 ceph-mon[97663]: pgmap v349: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-09-21T13:07:26.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:25 smithi160 ceph-mon[134450]: pgmap v349: 97 pgs: 97 active+clean; 343 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 154 op/s 2023-09-21T13:07:26.706 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1040670 8.78 MB/sec execute 487 sec latency 18.885 ms 2023-09-21T13:07:27.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1041090 8.77 MB/sec execute 488 sec latency 288.845 ms 2023-09-21T13:07:28.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:27 smithi156 ceph-mon[134078]: pgmap v350: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 263 op/s 2023-09-21T13:07:28.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:27 smithi142 ceph-mon[97663]: pgmap v350: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 263 op/s 2023-09-21T13:07:28.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:27 smithi160 ceph-mon[134450]: pgmap v350: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.6 MiB/s wr, 263 op/s 2023-09-21T13:07:28.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1042305 8.77 MB/sec execute 489 sec latency 17.971 ms 2023-09-21T13:07:29.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1044242 8.77 MB/sec execute 490 sec latency 17.298 ms 2023-09-21T13:07:30.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:29 smithi156 ceph-mon[134078]: pgmap v351: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-09-21T13:07:30.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:29 smithi142 ceph-mon[97663]: pgmap v351: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-09-21T13:07:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:29 smithi160 ceph-mon[134450]: pgmap v351: 97 pgs: 97 active+clean; 339 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 185 op/s 2023-09-21T13:07:30.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1045324 8.76 MB/sec execute 491 sec latency 13.719 ms 2023-09-21T13:07:31.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1047316 8.77 MB/sec execute 492 sec latency 19.338 ms 2023-09-21T13:07:32.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:31 smithi156 ceph-mon[134078]: pgmap v352: 97 pgs: 97 active+clean; 345 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2023-09-21T13:07:32.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:31 smithi142 ceph-mon[97663]: pgmap v352: 97 pgs: 97 active+clean; 345 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2023-09-21T13:07:32.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:31 smithi160 ceph-mon[134450]: pgmap v352: 97 pgs: 97 active+clean; 345 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.8 MiB/s wr, 328 op/s 2023-09-21T13:07:32.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1048517 8.76 MB/sec execute 493 sec latency 12.431 ms 2023-09-21T13:07:33.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1050383 8.76 MB/sec execute 494 sec latency 31.134 ms 2023-09-21T13:07:34.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:33 smithi142 ceph-mon[97663]: pgmap v353: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-09-21T13:07:34.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:33 smithi160 ceph-mon[134450]: pgmap v353: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-09-21T13:07:34.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:33 smithi156 ceph-mon[134078]: pgmap v353: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.9 MiB/s wr, 335 op/s 2023-09-21T13:07:34.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1051894 8.77 MB/sec execute 495 sec latency 21.918 ms 2023-09-21T13:07:35.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.552+0000 7f00061ff700 1 -- 172.21.15.142:0/1965722418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00000687a0 msgr2=0x7f0000068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.552+0000 7f00061ff700 1 --2- 172.21.15.142:0/1965722418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00000687a0 0x7f0000068c20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7efff4009990 tx=0x7efff4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 -- 172.21.15.142:0/1965722418 shutdown_connections 2023-09-21T13:07:35.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 --2- 172.21.15.142:0/1965722418 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0000101cd0 0x7f00000681d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 --2- 172.21.15.142:0/1965722418 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000010d650 0x7f000010fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 --2- 172.21.15.142:0/1965722418 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f00000687a0 0x7f0000068c20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 -- 172.21.15.142:0/1965722418 >> 172.21.15.142:0/1965722418 conn(0x7f0000076800 msgr2=0x7f0000076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 -- 172.21.15.142:0/1965722418 shutdown_connections 2023-09-21T13:07:35.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.553+0000 7f00061ff700 1 -- 172.21.15.142:0/1965722418 wait complete. 2023-09-21T13:07:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.554+0000 7f00061ff700 1 Processor -- start 2023-09-21T13:07:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 -- start start 2023-09-21T13:07:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 0x7f0000199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000019dcf0 0x7f000019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000019e770 con 0x7f00000687a0 2023-09-21T13:07:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000019e8e0 con 0x7f000010d650 2023-09-21T13:07:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7f00061ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000019eaa0 con 0x7f000019dcf0 2023-09-21T13:07:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7efffeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7effff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 0x7f0000199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7effff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 0x7f0000199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:39788/0 (socket says 172.21.15.142:39788) 2023-09-21T13:07:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7effff7fe700 1 -- 172.21.15.142:0/3623301502 learned_addr learned my addr 172.21.15.142:0/3623301502 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.555+0000 7efffeffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58356/0 (socket says 172.21.15.142:58356) 2023-09-21T13:07:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffffff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000019dcf0 0x7f000019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 -- 172.21.15.142:0/3623301502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000019dcf0 msgr2=0x7f000019e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000019dcf0 0x7f000019e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 -- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 msgr2=0x7f0000199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 0x7f0000199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 -- 172.21.15.142:0/3623301502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40095f0 con 0x7f000010d650 2023-09-21T13:07:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.556+0000 7efffeffd700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.557+0000 7efffcff9700 1 -- 172.21.15.142:0/3623301502 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff401d070 con 0x7f000010d650 2023-09-21T13:07:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.557+0000 7efffcff9700 1 -- 172.21.15.142:0/3623301502 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff4021410 con 0x7f000010d650 2023-09-21T13:07:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.557+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00001a5fa0 con 0x7f000010d650 2023-09-21T13:07:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.557+0000 7efffcff9700 1 -- 172.21.15.142:0/3623301502 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4017650 con 0x7f000010d650 2023-09-21T13:07:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.557+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00001a6310 con 0x7f000010d650 2023-09-21T13:07:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.561+0000 7efffcff9700 1 -- 172.21.15.142:0/3623301502 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7efff40217f0 con 0x7f000010d650 2023-09-21T13:07:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.562+0000 7f0019b11b80 1 Processor -- start 2023-09-21T13:07:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.562+0000 7f0019b11b80 1 -- start start 2023-09-21T13:07:35.569 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.562+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.562+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.562+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71e2e50 0x55c8d71e32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7f0019b11b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7152c40 con 0x55c8d71e2e50 2023-09-21T13:07:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7f0019b11b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7136c10 con 0x55c8d71de9c0 2023-09-21T13:07:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7f0019b11b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7134530 con 0x55c8d71de0a0 2023-09-21T13:07:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7effff7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffeffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71e2e50 0x55c8d71e32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53438/0 (socket says 172.21.15.142:53438) 2023-09-21T13:07:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7effff7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58370/0 (socket says 172.21.15.142:58370) 2023-09-21T13:07:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 -- 172.21.15.142:0/1822592120 learned_addr learned my addr 172.21.15.142:0/1822592120 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 -- 172.21.15.142:0/1822592120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 msgr2=0x55c8d71e2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffcff9700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 0x7effe80a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 -- 172.21.15.142:0/1822592120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71e2e50 msgr2=0x55c8d71e32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71e2e50 0x55c8d71e32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffffff700 1 -- 172.21.15.142:0/1822592120 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d6f5ad80 con 0x55c8d71de0a0 2023-09-21T13:07:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.563+0000 7efffcff9700 1 -- 172.21.15.142:0/3623301502 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efff40cd330 con 0x7f000010d650 2023-09-21T13:07:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.564+0000 7efffffff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 0x7effe80a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.573 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.564+0000 7effff7fe700 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.564+0000 7efffffff700 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efff8011680 tx=0x7efff8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac7ea1b0295a8b00 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.564+0000 7effe5ffb700 1 -- 172.21.15.142:0/1822592120 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800e040 con 0x55c8d71de0a0 2023-09-21T13:07:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.564+0000 7efffffff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 0x7effe80a2c70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efff80094f0 tx=0x7efff8023000 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7effe5ffb700 1 -- 172.21.15.142:0/1822592120 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff800f040 con 0x55c8d71de0a0 2023-09-21T13:07:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7effe5ffb700 1 -- 172.21.15.142:0/1822592120 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80156b0 con 0x55c8d71de0a0 2023-09-21T13:07:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 -- 172.21.15.142:0/1822592120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 msgr2=0x55c8d71de480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efff8011680 tx=0x7efff8009920 comp rx=0 tx=0).stop 2023-09-21T13:07:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 -- 172.21.15.142:0/1822592120 shutdown_connections 2023-09-21T13:07:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71e2e50 0x55c8d71e32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71de480 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1822592120 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71de9c0 0x55c8d71e2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.565+0000 7f0019b11b80 1 -- 172.21.15.142:0/1822592120 >> 172.21.15.142:0/1822592120 conn(0x55c8d710afa0 msgr2=0x55c8d71d90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.566+0000 7f0019b11b80 1 -- 172.21.15.142:0/1822592120 shutdown_connections 2023-09-21T13:07:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.566+0000 7f0019b11b80 1 -- 172.21.15.142:0/1822592120 wait complete. 2023-09-21T13:07:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.566+0000 7f0019b11b80 1 -- start start 2023-09-21T13:07:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 Processor -- start 2023-09-21T13:07:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71ea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d712fe20 con 0x55c8d71de0a0 2023-09-21T13:07:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d70cc6e0 con 0x55c8d71e2e50 2023-09-21T13:07:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.567+0000 7f0019b11b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d70cc380 con 0x55c8d71de9c0 2023-09-21T13:07:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7f0019b11b80 10 client.0 _ll_register_callbacks cb 0x55c8d7016a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53442/0 (socket says 172.21.15.142:53442) 2023-09-21T13:07:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 -- 172.21.15.142:0/3808543811 learned_addr learned my addr 172.21.15.142:0/3808543811 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7effff7fe700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71ea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffffff700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 -- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 msgr2=0x55c8d71e7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e7e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 -- 172.21.15.142:0/3808543811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 msgr2=0x55c8d71ea580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71ea580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 -- 172.21.15.142:0/3808543811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff0009970 con 0x55c8d71de9c0 2023-09-21T13:07:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7efffeffd700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efff400b2e0 tx=0x7efff40caf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cdac96f0c52c8ce server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7effdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:07:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.568+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4099f00 con 0x55c8d71de9c0 2023-09-21T13:07:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8d70a0b50 con 0x55c8d71de9c0 2023-09-21T13:07:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efff409af10 con 0x55c8d71de9c0 2023-09-21T13:07:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff409a5e0 con 0x55c8d71de9c0 2023-09-21T13:07:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 10 client.27778 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7efff8011330 con 0x55c8d71de9c0 2023-09-21T13:07:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c8d70a0b50 con 0x55c8d71de9c0 2023-09-21T13:07:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7efff40a2360 con 0x55c8d71de9c0 2023-09-21T13:07:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 10 client.27778 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 10 client.27778 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 20 client.27778 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d71f7bf0 0x55c8d71f9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 4 client.27778 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.569+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8d71acfc0 con 0x55c8d71f7bf0 2023-09-21T13:07:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.570+0000 7effff7fe700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d71f7bf0 0x55c8d71f9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.570+0000 7effff7fe700 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d71f7bf0 0x55c8d71f9fe0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97e0989b550616c8 server_cookie=8e84bfa82074bc4b in_seq=0 out_seq=0 2023-09-21T13:07:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.570+0000 7effdeffd700 10 client.27778 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7effdeffd700 1 -- 172.21.15.142:0/3808543811 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8d71acfc0 con 0x55c8d71f7bf0 2023-09-21T13:07:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7effdeffd700 10 client.27778 handle_command_reply: tid=0 2023-09-21T13:07:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 client.27778 shutdown 2023-09-21T13:07:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 msgr2=0x55c8d71e7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7efff400b2e0 tx=0x7efff40caf80 comp rx=0 tx=0).stop 2023-09-21T13:07:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 shutdown_connections 2023-09-21T13:07:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d71f7bf0 0x55c8d71f9fe0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71ea580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 --2- 172.21.15.142:0/3808543811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71e7800 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 >> 172.21.15.142:0/3808543811 conn(0x55c8d710afa0 msgr2=0x55c8d71d8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.571+0000 7effdeffd700 0 client.27778 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.572+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 shutdown_connections 2023-09-21T13:07:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.572+0000 7f0019b11b80 1 -- 172.21.15.142:0/3808543811 wait complete. 2023-09-21T13:07:35.589 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.572+0000 7f0019b11b80 20 client.27778 trim_cache size 0 max 16384 2023-09-21T13:07:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.589+0000 7f0019b11b80 1 Processor -- start 2023-09-21T13:07:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 -- start start 2023-09-21T13:07:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71ef030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 0x55c8d71e4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d6fb08c0 con 0x55c8d71de9c0 2023-09-21T13:07:35.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d71acfc0 con 0x55c8d71e2e50 2023-09-21T13:07:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.590+0000 7f0019b11b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d71eadc0 con 0x55c8d71de0a0 2023-09-21T13:07:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:58384/0 (socket says 172.21.15.142:58384) 2023-09-21T13:07:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 -- 172.21.15.142:0/2298827352 learned_addr learned my addr 172.21.15.142:0/2298827352 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:35.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7effff7fe700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71ef030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffeffd700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 0x55c8d71e4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 -- 172.21.15.142:0/2298827352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 msgr2=0x55c8d71ef030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71ef030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 -- 172.21.15.142:0/2298827352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 msgr2=0x55c8d71e4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 0x55c8d71e4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 -- 172.21.15.142:0/2298827352 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8d6f43c00 con 0x55c8d71e2e50 2023-09-21T13:07:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffeffd700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 0x55c8d71e4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:07:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7effff7fe700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.591+0000 7efffffff700 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efff8011c70 tx=0x7efff8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec71813aedf450b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.592+0000 7effe67fc700 1 -- 172.21.15.142:0/2298827352 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff800e040 con 0x55c8d71e2e50 2023-09-21T13:07:35.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.592+0000 7effe67fc700 1 -- 172.21.15.142:0/2298827352 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff8014eb0 con 0x55c8d71e2e50 2023-09-21T13:07:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.592+0000 7effe67fc700 1 -- 172.21.15.142:0/2298827352 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff8007500 con 0x55c8d71e2e50 2023-09-21T13:07:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- 172.21.15.142:0/2298827352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 msgr2=0x55c8d71e0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7efff8011c70 tx=0x7efff8009b60 comp rx=0 tx=0).stop 2023-09-21T13:07:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- 172.21.15.142:0/2298827352 shutdown_connections 2023-09-21T13:07:35.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d71e0ea0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de0a0 0x55c8d71ef030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 --2- 172.21.15.142:0/2298827352 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de9c0 0x55c8d71e4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- 172.21.15.142:0/2298827352 >> 172.21.15.142:0/2298827352 conn(0x55c8d710afa0 msgr2=0x55c8d71f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- 172.21.15.142:0/2298827352 shutdown_connections 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- 172.21.15.142:0/2298827352 wait complete. 2023-09-21T13:07:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.593+0000 7f0019b11b80 1 -- start start 2023-09-21T13:07:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 Processor -- start 2023-09-21T13:07:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d7253200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d71ed880 con 0x55c8d71de0a0 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7253740 con 0x55c8d71e2e50 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8d7253880 con 0x55c8d71de9c0 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7f0019b11b80 10 client.0 _ll_register_callbacks cb 0x55c8d7016a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7efffeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7effff7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7efffeffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53462/0 (socket says 172.21.15.142:53462) 2023-09-21T13:07:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7efffeffd700 1 -- 172.21.15.142:0/1432492976 learned_addr learned my addr 172.21.15.142:0/1432492976 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.594+0000 7efffffff700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d7253200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 -- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 msgr2=0x55c8d7253200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d7253200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 -- 172.21.15.142:0/1432492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 msgr2=0x55c8d71eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 -- 172.21.15.142:0/1432492976 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff0009e40 con 0x55c8d71de9c0 2023-09-21T13:07:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7efffeffd700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efff4097230 tx=0x7efff40a2590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8b0a37b270866 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7effdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:07:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff409a5e0 con 0x55c8d71de9c0 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efff800f040 con 0x55c8d71de9c0 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efff409af10 con 0x55c8d71de9c0 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff409a350 con 0x55c8d71de9c0 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7f0019b11b80 10 client.27784 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.595+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55c8d6f5ad80 con 0x55c8d71de9c0 2023-09-21T13:07:35.604 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efff800f040 con 0x55c8d71de9c0 2023-09-21T13:07:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7efff40662c0 con 0x55c8d71de9c0 2023-09-21T13:07:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 10 client.27784 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 10 client.27784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 20 client.27784 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:35.605 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d7254a90 0x55c8d7256e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 4 client.27784 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:07:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c8d7128e00 con 0x55c8d7254a90 2023-09-21T13:07:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.596+0000 7effff7fe700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d7254a90 0x55c8d7256e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.597+0000 7effff7fe700 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d7254a90 0x55c8d7256e80 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f861288383d96f2 server_cookie=3e96445d7c6c5f06 in_seq=0 out_seq=0 2023-09-21T13:07:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.597+0000 7effdeffd700 10 client.27784 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.658+0000 7effdeffd700 1 -- 172.21.15.142:0/1432492976 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c8d7128e00 con 0x55c8d7254a90 2023-09-21T13:07:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.658+0000 7effdeffd700 10 client.27784 handle_command_reply: tid=0 2023-09-21T13:07:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.658+0000 7f0019b11b80 1 client.27784 shutdown 2023-09-21T13:07:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 msgr2=0x55c8d71ecf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efff4097230 tx=0x7efff40a2590 comp rx=0 tx=0).stop 2023-09-21T13:07:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 shutdown_connections 2023-09-21T13:07:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55c8d7254a90 0x55c8d7256e80 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55c8d71de0a0 0x55c8d71eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55c8d71e2e50 0x55c8d7253200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7effdeffd700 0 client.27784 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 --2- 172.21.15.142:0/1432492976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55c8d71de9c0 0x55c8d71ecf70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 >> 172.21.15.142:0/1432492976 conn(0x55c8d710afa0 msgr2=0x55c8d71e0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 shutdown_connections 2023-09-21T13:07:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 1 -- 172.21.15.142:0/1432492976 wait complete. 2023-09-21T13:07:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.659+0000 7f0019b11b80 20 client.27784 trim_cache size 0 max 16384 2023-09-21T13:07:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:07:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:07:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:07:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:07:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 msgr2=0x7effe80a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 0x7effe80a2c70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efff80094f0 tx=0x7efff8023000 comp rx=0 tx=0).stop 2023-09-21T13:07:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 msgr2=0x7f0000199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efff4000c00 tx=0x7efff4005740 comp rx=0 tx=0).stop 2023-09-21T13:07:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 shutdown_connections 2023-09-21T13:07:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7effe80a07b0 0x7effe80a2c70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f00000687a0 0x7f0000199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f000019dcf0 0x7f000019e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 --2- 172.21.15.142:0/3623301502 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f000010d650 0x7f0000199680 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.660+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 >> 172.21.15.142:0/3623301502 conn(0x7f0000076800 msgr2=0x7f00000feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.661+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 shutdown_connections 2023-09-21T13:07:35.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:35.661+0000 7f00061ff700 1 -- 172.21.15.142:0/3623301502 wait complete. 2023-09-21T13:07:35.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1053334 8.76 MB/sec execute 496 sec latency 44.767 ms 2023-09-21T13:07:36.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:35 smithi142 ceph-mon[97663]: pgmap v354: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2023-09-21T13:07:36.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:35 smithi160 ceph-mon[134450]: pgmap v354: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2023-09-21T13:07:36.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:35 smithi156 ceph-mon[134078]: pgmap v354: 97 pgs: 97 active+clean; 344 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 307 op/s 2023-09-21T13:07:36.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1055302 8.77 MB/sec execute 497 sec latency 15.575 ms 2023-09-21T13:07:37.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1056608 8.76 MB/sec execute 498 sec latency 20.465 ms 2023-09-21T13:07:38.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:37 smithi142 ceph-mon[97663]: pgmap v355: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 388 op/s 2023-09-21T13:07:38.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:37 smithi160 ceph-mon[134450]: pgmap v355: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 388 op/s 2023-09-21T13:07:38.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:37 smithi156 ceph-mon[134078]: pgmap v355: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.4 MiB/s wr, 388 op/s 2023-09-21T13:07:38.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1058545 8.77 MB/sec execute 499 sec latency 39.855 ms 2023-09-21T13:07:39.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1059390 8.76 MB/sec execute 500 sec latency 21.852 ms 2023-09-21T13:07:40.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:39 smithi142 ceph-mon[97663]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 280 op/s 2023-09-21T13:07:40.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:39 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:07:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:39 smithi160 ceph-mon[134450]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 280 op/s 2023-09-21T13:07:40.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:39 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:07:40.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:39 smithi156 ceph-mon[134078]: pgmap v356: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.5 MiB/s wr, 280 op/s 2023-09-21T13:07:40.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:39 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:07:40.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1061364 8.76 MB/sec execute 501 sec latency 20.409 ms 2023-09-21T13:07:41.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:40 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:07:41.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:40 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:07:41.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:40 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:07:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:40 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:07:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:40 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:07:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:40 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:07:41.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:40 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:07:41.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:40 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:07:41.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:40 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:07:41.707 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1062600 8.76 MB/sec execute 502 sec latency 27.115 ms 2023-09-21T13:07:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:42 smithi156 ceph-mon[134078]: pgmap v357: 97 pgs: 97 active+clean; 345 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2023-09-21T13:07:42.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:42 smithi142 ceph-mon[97663]: pgmap v357: 97 pgs: 97 active+clean; 345 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2023-09-21T13:07:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:42 smithi160 ceph-mon[134450]: pgmap v357: 97 pgs: 97 active+clean; 345 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 6.1 MiB/s wr, 356 op/s 2023-09-21T13:07:42.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1064349 8.75 MB/sec execute 503 sec latency 18.431 ms 2023-09-21T13:07:43.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1065938 8.76 MB/sec execute 504 sec latency 36.955 ms 2023-09-21T13:07:44.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:44 smithi156 ceph-mon[134078]: pgmap v358: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 230 op/s 2023-09-21T13:07:44.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:44 smithi142 ceph-mon[97663]: pgmap v358: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 230 op/s 2023-09-21T13:07:44.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:44 smithi160 ceph-mon[134450]: pgmap v358: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.1 MiB/s wr, 230 op/s 2023-09-21T13:07:44.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1067207 8.76 MB/sec execute 505 sec latency 17.537 ms 2023-09-21T13:07:45.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1069307 8.76 MB/sec execute 506 sec latency 18.296 ms 2023-09-21T13:07:46.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:46 smithi156 ceph-mon[134078]: pgmap v359: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 174 op/s 2023-09-21T13:07:46.414 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:46 smithi142 ceph-mon[97663]: pgmap v359: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 174 op/s 2023-09-21T13:07:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:46 smithi160 ceph-mon[134450]: pgmap v359: 97 pgs: 97 active+clean; 346 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 174 op/s 2023-09-21T13:07:46.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1070623 8.76 MB/sec execute 507 sec latency 11.217 ms 2023-09-21T13:07:47.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1072787 8.77 MB/sec execute 508 sec latency 18.533 ms 2023-09-21T13:07:47.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:47 smithi156 ceph-mon[134078]: pgmap v360: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 250 op/s 2023-09-21T13:07:47.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:47 smithi142 ceph-mon[97663]: pgmap v360: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 250 op/s 2023-09-21T13:07:47.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:47 smithi160 ceph-mon[134450]: pgmap v360: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 250 op/s 2023-09-21T13:07:48.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1074013 8.76 MB/sec execute 509 sec latency 11.262 ms 2023-09-21T13:07:48.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 -- 172.21.15.142:0/2302420730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 msgr2=0x7f1f5410dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 --2- 172.21.15.142:0/2302420730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f5410dc30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009fc0 tx=0x7f1f4c00b330 comp rx=0 tx=0).stop 2023-09-21T13:07:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 -- 172.21.15.142:0/2302420730 shutdown_connections 2023-09-21T13:07:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 --2- 172.21.15.142:0/2302420730 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f54105d60 0x7f1f54106140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 --2- 172.21.15.142:0/2302420730 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f5410dc30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 --2- 172.21.15.142:0/2302420730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f540681d0 0x7f1f54068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 -- 172.21.15.142:0/2302420730 >> 172.21.15.142:0/2302420730 conn(0x7f1f54076800 msgr2=0x7f1f54076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 -- 172.21.15.142:0/2302420730 shutdown_connections 2023-09-21T13:07:48.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.827+0000 7f1f589ff700 1 -- 172.21.15.142:0/2302420730 wait complete. 2023-09-21T13:07:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.828+0000 7f1f589ff700 1 Processor -- start 2023-09-21T13:07:48.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 -- start start 2023-09-21T13:07:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f540681d0 0x7f1f54196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f54105d60 0x7f1f5419baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419c130 con 0x7f1f540681d0 2023-09-21T13:07:48.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419c2a0 con 0x7f1f54068b90 2023-09-21T13:07:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f589ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5419c460 con 0x7f1f54105d60 2023-09-21T13:07:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59070/0 (socket says 172.21.15.142:59070) 2023-09-21T13:07:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f51d9b700 1 -- 172.21.15.142:0/544081397 learned_addr learned my addr 172.21.15.142:0/544081397 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:48.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.829+0000 7f1f5259c700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f540681d0 0x7f1f54196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f54105d60 0x7f1f5419baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 -- 172.21.15.142:0/544081397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f54105d60 msgr2=0x7f1f5419baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f54105d60 0x7f1f5419baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 -- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f540681d0 msgr2=0x7f1f54196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f540681d0 0x7f1f54196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 -- 172.21.15.142:0/544081397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009c40 con 0x7f1f54068b90 2023-09-21T13:07:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9a0 tx=0x7f1f4800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f437fe700 1 -- 172.21.15.142:0/544081397 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48009790 con 0x7f1f54068b90 2023-09-21T13:07:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f437fe700 1 -- 172.21.15.142:0/544081397 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f4800ce80 con 0x7f1f54068b90 2023-09-21T13:07:48.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f437fe700 1 -- 172.21.15.142:0/544081397 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48018680 con 0x7f1f54068b90 2023-09-21T13:07:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.830+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5419c740 con 0x7f1f54068b90 2023-09-21T13:07:48.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.831+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f54100090 con 0x7f1f54068b90 2023-09-21T13:07:48.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.834+0000 7f1f437fe700 1 -- 172.21.15.142:0/544081397 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f1f48010430 con 0x7f1f54068b90 2023-09-21T13:07:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.836+0000 7f1f6c41bb80 1 Processor -- start 2023-09-21T13:07:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.836+0000 7f1f6c41bb80 1 -- start start 2023-09-21T13:07:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.836+0000 7f1f437fe700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 0x7f1f3c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a19c0 0x5623636a5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a5e50 0x5623636a62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562363615c40 con 0x5623636a19c0 2023-09-21T13:07:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623635f9c10 con 0x5623636a10a0 2023-09-21T13:07:48.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623635f7530 con 0x5623636a5e50 2023-09-21T13:07:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f437fe700 1 -- 172.21.15.142:0/544081397 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1f48014070 con 0x7f1f54068b90 2023-09-21T13:07:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59076/0 (socket says 172.21.15.142:59076) 2023-09-21T13:07:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 -- 172.21.15.142:0/3297292207 learned_addr learned my addr 172.21.15.142:0/3297292207 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:48.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a19c0 0x5623636a5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a5e50 0x5623636a62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 0x7f1f3c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 -- 172.21.15.142:0/3297292207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a5e50 msgr2=0x5623636a62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a5e50 0x5623636a62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 -- 172.21.15.142:0/3297292207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a19c0 msgr2=0x5623636a5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a19c0 0x5623636a5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.837+0000 7f1f5259c700 1 -- 172.21.15.142:0/3297292207 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56236341dd80 con 0x5623636a10a0 2023-09-21T13:07:48.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.838+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009d60 tx=0x7f1f44011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd1b2bf01191fee server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.838+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 0x7f1f3c0a2cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00b6c0 tx=0x7f1f4c009f30 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.838+0000 7f1f40ff9700 1 -- 172.21.15.142:0/3297292207 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44019630 con 0x5623636a10a0 2023-09-21T13:07:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.838+0000 7f1f40ff9700 1 -- 172.21.15.142:0/3297292207 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f44019c50 con 0x5623636a10a0 2023-09-21T13:07:48.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.838+0000 7f1f40ff9700 1 -- 172.21.15.142:0/3297292207 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4400ec10 con 0x5623636a10a0 2023-09-21T13:07:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3297292207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 msgr2=0x5623636a1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1f44009d60 tx=0x7f1f44011720 comp rx=0 tx=0).stop 2023-09-21T13:07:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3297292207 shutdown_connections 2023-09-21T13:07:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a5e50 0x5623636a62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636a1480 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3297292207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a19c0 0x5623636a5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3297292207 >> 172.21.15.142:0/3297292207 conn(0x5623635cdfa0 msgr2=0x56236369c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3297292207 shutdown_connections 2023-09-21T13:07:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.839+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3297292207 wait complete. 2023-09-21T13:07:48.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 -- start start 2023-09-21T13:07:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 Processor -- start 2023-09-21T13:07:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 0x5623636aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636aae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 0x5623636ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623635f2e20 con 0x5623636a10a0 2023-09-21T13:07:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236358f6e0 con 0x5623636a5e50 2023-09-21T13:07:48.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236358f380 con 0x5623636a19c0 2023-09-21T13:07:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.840+0000 7f1f6c41bb80 10 client.0 _ll_register_callbacks cb 0x5623634d9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 0x5623636aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 0x5623636aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33700/0 (socket says 172.21.15.142:33700) 2023-09-21T13:07:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f5259c700 1 -- 172.21.15.142:0/2303296173 learned_addr learned my addr 172.21.15.142:0/2303296173 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:48.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 0x5623636ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 -- 172.21.15.142:0/2303296173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 msgr2=0x5623636aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 -- 172.21.15.142:0/2303296173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 msgr2=0x5623636aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.847 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 0x5623636aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f52d9d700 1 -- 172.21.15.142:0/2303296173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440099c0 con 0x5623636a5e50 2023-09-21T13:07:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.841+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 0x5623636ab380 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c003c30 tx=0x7f1f4c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4fe6695003fc23 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:48.848 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00e040 con 0x5623636a5e50 2023-09-21T13:07:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562363563b50 con 0x5623636a5e50 2023-09-21T13:07:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1f4c020450 con 0x5623636a5e50 2023-09-21T13:07:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f4c020610 con 0x5623636a5e50 2023-09-21T13:07:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f6c41bb80 10 client.27848 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x562363406c00 con 0x5623636a5e50 2023-09-21T13:07:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.842+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562363563b50 con 0x5623636a5e50 2023-09-21T13:07:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f1f4c005340 con 0x5623636a5e50 2023-09-21T13:07:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 10 client.27848 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 10 client.27848 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 20 client.27848 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623636baf30 0x5623636bd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 4 client.27848 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56236366ffc0 con 0x5623636baf30 2023-09-21T13:07:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.843+0000 7f1f5259c700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623636baf30 0x5623636bd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.844+0000 7f1f39ffb700 10 client.27848 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.844+0000 7f1f5259c700 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623636baf30 0x5623636bd350 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdabd9fbe43c5a4d server_cookie=422774b95023b2ee in_seq=0 out_seq=0 2023-09-21T13:07:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.844+0000 7f1f39ffb700 1 -- 172.21.15.142:0/2303296173 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56236366ffc0 con 0x5623636baf30 2023-09-21T13:07:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.844+0000 7f1f39ffb700 10 client.27848 handle_command_reply: tid=0 2023-09-21T13:07:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.844+0000 7f1f6c41bb80 1 client.27848 shutdown 2023-09-21T13:07:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 msgr2=0x5623636ab380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 0x5623636ab380 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c003c30 tx=0x7f1f4c00b330 comp rx=0 tx=0).stop 2023-09-21T13:07:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 shutdown_connections 2023-09-21T13:07:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5623636baf30 0x5623636bd350 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a10a0 0x5623636aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a5e50 0x5623636ab380 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f39ffb700 0 client.27848 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/2303296173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 >> 172.21.15.142:0/2303296173 conn(0x5623635cdfa0 msgr2=0x56236369bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.856 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 shutdown_connections 2023-09-21T13:07:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.845+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/2303296173 wait complete. 2023-09-21T13:07:48.857 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.846+0000 7f1f6c41bb80 20 client.27848 trim_cache size 0 max 16384 2023-09-21T13:07:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.863+0000 7f1f6c41bb80 1 Processor -- start 2023-09-21T13:07:48.859 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.863+0000 7f1f6c41bb80 1 -- start start 2023-09-21T13:07:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 0x5623636b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623634738c0 con 0x5623636a5e50 2023-09-21T13:07:48.861 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623636a68b0 con 0x5623636a19c0 2023-09-21T13:07:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623636b2510 con 0x5623636a10a0 2023-09-21T13:07:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 0x5623636b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f51d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59090/0 (socket says 172.21.15.142:59090) 2023-09-21T13:07:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f51d9b700 1 -- 172.21.15.142:0/760636079 learned_addr learned my addr 172.21.15.142:0/760636079 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.864+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 -- 172.21.15.142:0/760636079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 msgr2=0x5623636b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 0x5623636b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.863 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 -- 172.21.15.142:0/760636079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 msgr2=0x5623636a7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636a7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 -- 172.21.15.142:0/760636079 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623634441f0 con 0x5623636a19c0 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f5259c700 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 0x5623636b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1f480c9980 tx=0x7f1f480959f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2575d773a1510b9c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f417fa700 1 -- 172.21.15.142:0/760636079 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48099630 con 0x5623636a19c0 2023-09-21T13:07:48.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f417fa700 1 -- 172.21.15.142:0/760636079 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f4809d460 con 0x5623636a19c0 2023-09-21T13:07:48.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.865+0000 7f1f417fa700 1 -- 172.21.15.142:0/760636079 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48084310 con 0x5623636a19c0 2023-09-21T13:07:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/760636079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 msgr2=0x5623636ab1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1f480c9980 tx=0x7f1f480959f0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/760636079 shutdown_connections 2023-09-21T13:07:48.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636a7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a10a0 0x5623636b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/760636079 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a19c0 0x5623636ab1b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/760636079 >> 172.21.15.142:0/760636079 conn(0x5623635cdfa0 msgr2=0x5623636a5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/760636079 shutdown_connections 2023-09-21T13:07:48.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.866+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/760636079 wait complete. 2023-09-21T13:07:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.867+0000 7f1f6c41bb80 1 -- start start 2023-09-21T13:07:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.867+0000 7f1f6c41bb80 1 Processor -- start 2023-09-21T13:07:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636b0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623636b0de0 con 0x5623636a5e50 2023-09-21T13:07:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623636b0f50 con 0x5623636a10a0 2023-09-21T13:07:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236370ed70 con 0x5623636a19c0 2023-09-21T13:07:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f6c41bb80 10 client.0 _ll_register_callbacks cb 0x5623634d9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:48.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f5259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59094/0 (socket says 172.21.15.142:59094) 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f5259c700 1 -- 172.21.15.142:0/3700313108 learned_addr learned my addr 172.21.15.142:0/3700313108 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.868+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 -- 172.21.15.142:0/3700313108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 msgr2=0x5623636b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 -- 172.21.15.142:0/3700313108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 msgr2=0x5623636b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 -- 172.21.15.142:0/3700313108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56236341dd80 con 0x5623636a10a0 2023-09-21T13:07:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f52d9d700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:07:48.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f5259c700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1f44006010 tx=0x7f1f44009c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e37020bf9f2f3149 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4402a4f0 con 0x5623636a10a0 2023-09-21T13:07:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f1f440195d0 con 0x5623636a10a0 2023-09-21T13:07:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.869+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f44019c50 con 0x5623636a10a0 2023-09-21T13:07:48.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f440197d0 con 0x5623636a10a0 2023-09-21T13:07:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 10 client.27854 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f1f54100090 con 0x5623636a10a0 2023-09-21T13:07:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1f44038020 con 0x5623636a10a0 2023-09-21T13:07:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f1f4402a960 con 0x5623636a10a0 2023-09-21T13:07:48.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 10 client.27854 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 10 client.27854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 20 client.27854 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562363710450 0x562363712870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:48.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 4 client.27854 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:07:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5623635ebe00 con 0x562363710450 2023-09-21T13:07:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.870+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562363710450 0x562363712870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.871+0000 7f1f51d9b700 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562363710450 0x562363712870 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=307850b19412dcd3 server_cookie=19891bcd0adc4c1a in_seq=0 out_seq=0 2023-09-21T13:07:48.880 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.871+0000 7f1f39ffb700 10 client.27854 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:48.950 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.954+0000 7f1f39ffb700 1 -- 172.21.15.142:0/3700313108 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5623635ebe00 con 0x562363710450 2023-09-21T13:07:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.954+0000 7f1f39ffb700 10 client.27854 handle_command_reply: tid=0 2023-09-21T13:07:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.954+0000 7f1f6c41bb80 1 client.27854 shutdown 2023-09-21T13:07:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.954+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 msgr2=0x5623636b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.954+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1f44006010 tx=0x7f1f44009c90 comp rx=0 tx=0).stop 2023-09-21T13:07:48.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 shutdown_connections 2023-09-21T13:07:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x562363710450 0x562363712870 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f39ffb700 0 client.27854 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5623636a5e50 0x5623636b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5623636a10a0 0x5623636b1e60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.952 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 --2- 172.21.15.142:0/3700313108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5623636a19c0 0x5623636b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 >> 172.21.15.142:0/3700313108 conn(0x5623635cdfa0 msgr2=0x56236369fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 shutdown_connections 2023-09-21T13:07:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 1 -- 172.21.15.142:0/3700313108 wait complete. 2023-09-21T13:07:48.953 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.955+0000 7f1f6c41bb80 20 client.27854 trim_cache size 0 max 16384 2023-09-21T13:07:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:07:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:07:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:07:48.954 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:07:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 msgr2=0x7f1f3c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 0x7f1f3c0a2cf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00b6c0 tx=0x7f1f4c009f30 comp rx=0 tx=0).stop 2023-09-21T13:07:48.955 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 msgr2=0x7f1f54197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800e9a0 tx=0x7f1f4800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 shutdown_connections 2023-09-21T13:07:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f1f3c0a0830 0x7f1f3c0a2cf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f1f540681d0 0x7f1f54196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.956 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f54105d60 0x7f1f5419baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 --2- 172.21.15.142:0/544081397 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f1f54068b90 0x7f1f54197480 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 >> 172.21.15.142:0/544081397 conn(0x7f1f54076800 msgr2=0x7f1f540fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 shutdown_connections 2023-09-21T13:07:48.957 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:07:48.956+0000 7f1f589ff700 1 -- 172.21.15.142:0/544081397 wait complete. 2023-09-21T13:07:49.062 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:07:49.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 -- 172.21.15.142:0/138343266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f94101980 msgr2=0x7f2f941059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 --2- 172.21.15.142:0/138343266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f94101980 0x7f2f941059c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f80009990 tx=0x7f2f80009ca0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 -- 172.21.15.142:0/138343266 shutdown_connections 2023-09-21T13:07:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 --2- 172.21.15.142:0/138343266 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 0x7f2f941013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 --2- 172.21.15.142:0/138343266 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f941060f0 0x7f2f9410dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 --2- 172.21.15.142:0/138343266 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f94101980 0x7f2f941059c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 -- 172.21.15.142:0/138343266 >> 172.21.15.142:0/138343266 conn(0x7f2f940fc850 msgr2=0x7f2f940fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.303+0000 7f2f9abff700 1 -- 172.21.15.142:0/138343266 shutdown_connections 2023-09-21T13:07:49.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.304+0000 7f2f9abff700 1 -- 172.21.15.142:0/138343266 wait complete. 2023-09-21T13:07:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.304+0000 7f2f9abff700 1 Processor -- start 2023-09-21T13:07:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 -- start start 2023-09-21T13:07:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 0x7f2f94196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 0x7f2f9419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9419c3e0 con 0x7f2f94100fd0 2023-09-21T13:07:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9419c550 con 0x7f2f941060f0 2023-09-21T13:07:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9abff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9419c710 con 0x7f2f9419b960 2023-09-21T13:07:49.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 0x7f2f9419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f93fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59106/0 (socket says 172.21.15.142:59106) 2023-09-21T13:07:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.305+0000 7f2f93fff700 1 -- 172.21.15.142:0/2842920175 learned_addr learned my addr 172.21.15.142:0/2842920175 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f9899b700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 0x7f2f94196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 -- 172.21.15.142:0/2842920175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 msgr2=0x7f2f9419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 0x7f2f9419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 -- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 msgr2=0x7f2f94196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 0x7f2f94196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 -- 172.21.15.142:0/2842920175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800095f0 con 0x7f2f941060f0 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f9919c700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 0x7f2f9419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:07:49.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f93fff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f91ffb700 1 -- 172.21.15.142:0/2842920175 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8001d070 con 0x7f2f941060f0 2023-09-21T13:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f94073010 con 0x7f2f941060f0 2023-09-21T13:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f91ffb700 1 -- 172.21.15.142:0/2842920175 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f80021410 con 0x7f2f941060f0 2023-09-21T13:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.306+0000 7f2f91ffb700 1 -- 172.21.15.142:0/2842920175 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f80017650 con 0x7f2f941060f0 2023-09-21T13:07:49.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.307+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f94073570 con 0x7f2f941060f0 2023-09-21T13:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.310+0000 7f2f91ffb700 1 -- 172.21.15.142:0/2842920175 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2f80021580 con 0x7f2f941060f0 2023-09-21T13:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.311+0000 7f2fae606b80 1 Processor -- start 2023-09-21T13:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.311+0000 7f2fae606b80 1 -- start start 2023-09-21T13:07:49.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 0x55638ec4b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec507c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f91ffb700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 0x7f2f840a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ebbfca0 con 0x55638ec4b610 2023-09-21T13:07:49.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638eba3c70 con 0x55638ec50360 2023-09-21T13:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2fae606b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638eba1590 con 0x55638ec4bf30 2023-09-21T13:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f91ffb700 1 -- 172.21.15.142:0/2842920175 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f800cd2b0 con 0x7f2f941060f0 2023-09-21T13:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f9899b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f9899b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:40522/0 (socket says 172.21.15.142:40522) 2023-09-21T13:07:49.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f9899b700 1 -- 172.21.15.142:0/557775128 learned_addr learned my addr 172.21.15.142:0/557775128 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.312+0000 7f2f9919c700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 0x55638ec4b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9919c700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 -- 172.21.15.142:0/557775128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 msgr2=0x55638ec507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f93fff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 0x7f2f840a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 -- 172.21.15.142:0/557775128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 msgr2=0x55638ec4b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 0x55638ec4b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 -- 172.21.15.142:0/557775128 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55638e9c7de0 con 0x55638ec4bf30 2023-09-21T13:07:49.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9919c700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 0x55638ec4b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:07:49.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f9899b700 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009d10 tx=0x7f2f880116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b126327440def614 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f7effd700 1 -- 172.21.15.142:0/557775128 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f880097e0 con 0x55638ec4bf30 2023-09-21T13:07:49.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f7effd700 1 -- 172.21.15.142:0/557775128 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f88011ed0 con 0x55638ec4bf30 2023-09-21T13:07:49.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f93fff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 0x7f2f840a2cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f800a22a0 tx=0x7f2f80005ef0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.313+0000 7f2f7effd700 1 -- 172.21.15.142:0/557775128 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8800f8e0 con 0x55638ec4bf30 2023-09-21T13:07:49.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 -- 172.21.15.142:0/557775128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 msgr2=0x55638ec4fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2f88009d10 tx=0x7f2f880116c0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 -- 172.21.15.142:0/557775128 shutdown_connections 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4b610 0x55638ec4b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 --2- 172.21.15.142:0/557775128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4bf30 0x55638ec4fe20 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 -- 172.21.15.142:0/557775128 >> 172.21.15.142:0/557775128 conn(0x55638eb78000 msgr2=0x55638ec466a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 -- 172.21.15.142:0/557775128 shutdown_connections 2023-09-21T13:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.314+0000 7f2fae606b80 1 -- 172.21.15.142:0/557775128 wait complete. 2023-09-21T13:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.315+0000 7f2fae606b80 1 -- start start 2023-09-21T13:07:49.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.315+0000 7f2fae606b80 1 Processor -- start 2023-09-21T13:07:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.315+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.315+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2fae606b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638eb9ce80 con 0x55638ec4bf30 2023-09-21T13:07:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2fae606b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638eb39740 con 0x55638ec50360 2023-09-21T13:07:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2fae606b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638eb393e0 con 0x55638ec4b610 2023-09-21T13:07:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2fae606b80 10 client.0 _ll_register_callbacks cb 0x55638ea83a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:40534/0 (socket says 172.21.15.142:40534) 2023-09-21T13:07:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9899b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 -- 172.21.15.142:0/3230605693 learned_addr learned my addr 172.21.15.142:0/3230605693 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 -- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 msgr2=0x55638ec555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec555c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 -- 172.21.15.142:0/3230605693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 msgr2=0x55638ec54e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec54e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 -- 172.21.15.142:0/3230605693 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f88009940 con 0x55638ec4b610 2023-09-21T13:07:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f9919c700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00ff40 tx=0x7f2f8c011040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2420b390ad5781a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.316+0000 7f2f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:07:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c014040 con 0x55638ec4b610 2023-09-21T13:07:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f8c004bb0 con 0x55638ec4b610 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55638eb0dbb0 con 0x55638ec4b610 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f8c003a00 con 0x55638ec4b610 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2fae606b80 10 client.27814 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55638e9b0c60 con 0x55638ec4b610 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.317+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55638eb0dbb0 con 0x55638ec4b610 2023-09-21T13:07:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2f8c028020 con 0x55638ec4b610 2023-09-21T13:07:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 10 client.27814 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 10 client.27814 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 20 client.27814 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ec654e0 0x55638ec67900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 4 client.27814 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55638ec1a020 con 0x55638ec654e0 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2f9899b700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ec654e0 0x55638ec67900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2f9899b700 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ec654e0 0x55638ec67900 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e4a288a9437e19 server_cookie=b07046b374a50c8f in_seq=0 out_seq=0 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.318+0000 7f2f73fff700 10 client.27814 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.321+0000 7f2f73fff700 1 -- 172.21.15.142:0/3230605693 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55638ec1a020 con 0x55638ec654e0 2023-09-21T13:07:49.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.321+0000 7f2f73fff700 10 client.27814 handle_command_reply: tid=0 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.321+0000 7f2fae606b80 1 client.27814 shutdown 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.321+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 msgr2=0x55638ec57b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.321+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c00ff40 tx=0x7f2f8c011040 comp rx=0 tx=0).stop 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 shutdown_connections 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ec654e0 0x55638ec67900 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec50360 0x55638ec555c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec57b90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2f73fff700 0 client.27814 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 --2- 172.21.15.142:0/3230605693 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec54e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 >> 172.21.15.142:0/3230605693 conn(0x55638eb78000 msgr2=0x55638ec46290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 shutdown_connections 2023-09-21T13:07:49.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 1 -- 172.21.15.142:0/3230605693 wait complete. 2023-09-21T13:07:49.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.322+0000 7f2fae606b80 20 client.27814 trim_cache size 0 max 16384 2023-09-21T13:07:49.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.342+0000 7f2fae606b80 1 Processor -- start 2023-09-21T13:07:49.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.342+0000 7f2fae606b80 1 -- start start 2023-09-21T13:07:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec4dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec50360 0x55638ec57730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ea1d920 con 0x55638ec50360 2023-09-21T13:07:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ec563d0 con 0x55638ec4bf30 2023-09-21T13:07:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2fae606b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ec47ed0 con 0x55638ec4b610 2023-09-21T13:07:49.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec4dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59120/0 (socket says 172.21.15.142:59120) 2023-09-21T13:07:49.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 -- 172.21.15.142:0/451602440 learned_addr learned my addr 172.21.15.142:0/451602440 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:49.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9919c700 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec50360 0x55638ec57730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 -- 172.21.15.142:0/451602440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 msgr2=0x55638ec4dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec4dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 -- 172.21.15.142:0/451602440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec50360 msgr2=0x55638ec57730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec50360 0x55638ec57730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.343+0000 7f2f9899b700 1 -- 172.21.15.142:0/451602440 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55638e9ee250 con 0x55638ec4bf30 2023-09-21T13:07:49.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.344+0000 7f2f9899b700 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2f88011ac0 tx=0x7f2f88009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6550fbb9ba63681 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.344+0000 7f2f7f7fe700 1 -- 172.21.15.142:0/451602440 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88005ce0 con 0x55638ec4bf30 2023-09-21T13:07:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.344+0000 7f2f7f7fe700 1 -- 172.21.15.142:0/451602440 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f88011d50 con 0x55638ec4bf30 2023-09-21T13:07:49.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.344+0000 7f2f7f7fe700 1 -- 172.21.15.142:0/451602440 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f88012450 con 0x55638ec4bf30 2023-09-21T13:07:49.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- 172.21.15.142:0/451602440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 msgr2=0x55638ec5c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2f88011ac0 tx=0x7f2f88009860 comp rx=0 tx=0).stop 2023-09-21T13:07:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- 172.21.15.142:0/451602440 shutdown_connections 2023-09-21T13:07:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec50360 0x55638ec57730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.346 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec4b610 0x55638ec4dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 --2- 172.21.15.142:0/451602440 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4bf30 0x55638ec5c4e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- 172.21.15.142:0/451602440 >> 172.21.15.142:0/451602440 conn(0x55638eb78000 msgr2=0x55638ec60c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- 172.21.15.142:0/451602440 shutdown_connections 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- 172.21.15.142:0/451602440 wait complete. 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.345+0000 7f2fae606b80 1 -- start start 2023-09-21T13:07:49.347 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 Processor -- start 2023-09-21T13:07:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec53690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec50360 0x55638ec53d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ec54390 con 0x55638ec4bf30 2023-09-21T13:07:49.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ec54500 con 0x55638ec4b610 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55638ecb9300 con 0x55638ec50360 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.346+0000 7f2fae606b80 10 client.0 _ll_register_callbacks cb 0x55638ea83a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59130/0 (socket says 172.21.15.142:59130) 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 -- 172.21.15.142:0/4098802366 learned_addr learned my addr 172.21.15.142:0/4098802366 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:07:49.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9899b700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec53690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec50360 0x55638ec53d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 -- 172.21.15.142:0/4098802366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec50360 msgr2=0x55638ec53d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec50360 0x55638ec53d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 -- 172.21.15.142:0/4098802366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 msgr2=0x55638ec53690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:07:49.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec53690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 -- 172.21.15.142:0/4098802366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55638e9c7de0 con 0x55638ec4b610 2023-09-21T13:07:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f9919c700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0095d0 tx=0x7f2f8c0091b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=408250b4d4f8fa71 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:07:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f73fff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:07:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.347+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c014040 con 0x55638ec4b610 2023-09-21T13:07:49.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2f8c004b30 con 0x55638ec4b610 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55638eb95e60 con 0x55638ec4b610 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f8c003a00 con 0x55638ec4b610 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 10 client.27872 fetch_fsmap learned FSMap version 41 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55638e9c62b0 con 0x55638ec4b610 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f8c044080 con 0x55638ec4b610 2023-09-21T13:07:49.352 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f2f8c03e030 con 0x55638ec4b610 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 10 client.27872 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 10 client.27872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 20 client.27872 populate_metadata read hostname 'smithi142' 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ecbaa20 0x55638ecbce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 4 client.27872 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:07:49.353 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.348+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55638eb95b80 con 0x55638ecbaa20 2023-09-21T13:07:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.349+0000 7f2f9899b700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ecbaa20 0x55638ecbce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:07:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.349+0000 7f2f73fff700 10 client.27872 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.349+0000 7f2f9899b700 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ecbaa20 0x55638ecbce40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a22ba33bb527553c server_cookie=40b0c32da6f9fc9b in_seq=0 out_seq=0 2023-09-21T13:07:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.350+0000 7f2f73fff700 1 -- 172.21.15.142:0/4098802366 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55638eb95b80 con 0x55638ecbaa20 2023-09-21T13:07:49.354 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.350+0000 7f2f73fff700 10 client.27872 handle_command_reply: tid=0 2023-09-21T13:07:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.350+0000 7f2fae606b80 1 client.27872 shutdown 2023-09-21T13:07:49.355 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 msgr2=0x55638ec54de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0095d0 tx=0x7f2f8c0091b0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 shutdown_connections 2023-09-21T13:07:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55638ecbaa20 0x55638ecbce40 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55638ec50360 0x55638ec53d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55638ec4b610 0x55638ec54de0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 --2- 172.21.15.142:0/4098802366 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55638ec4bf30 0x55638ec53690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 >> 172.21.15.142:0/4098802366 conn(0x55638eb78000 msgr2=0x55638ec4e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2f73fff700 0 client.27872 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.352+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 shutdown_connections 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.353+0000 7f2fae606b80 1 -- 172.21.15.142:0/4098802366 wait complete. 2023-09-21T13:07:49.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.353+0000 7f2fae606b80 20 client.27872 trim_cache size 0 max 16384 2023-09-21T13:07:49.358 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:07:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:07:49.358 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:07:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:07:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:07:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:07:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:07:49.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:07:49.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:07:49.360 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:07:49.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 msgr2=0x7f2f840a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 0x7f2f840a2cf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f800a22a0 tx=0x7f2f80005ef0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 msgr2=0x7f2f94197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:07:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2f80000c00 tx=0x7f2f80005740 comp rx=0 tx=0).stop 2023-09-21T13:07:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 shutdown_connections 2023-09-21T13:07:49.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f2f840a0830 0x7f2f840a2cf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2f94100fd0 0x7f2f94196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f9419b960 0x7f2f9419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 --2- 172.21.15.142:0/2842920175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2f941060f0 0x7f2f94197500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:07:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 >> 172.21.15.142:0/2842920175 conn(0x7f2f940fc850 msgr2=0x7f2f940fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:07:49.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 shutdown_connections 2023-09-21T13:07:49.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:07:49.354+0000 7f2f9abff700 1 -- 172.21.15.142:0/2842920175 wait complete. 2023-09-21T13:07:49.378 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:07:49.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1075774 8.76 MB/sec execute 510 sec latency 38.812 ms 2023-09-21T13:07:49.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:49 smithi156 ceph-mon[134078]: pgmap v361: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2023-09-21T13:07:49.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:49 smithi142 ceph-mon[97663]: pgmap v361: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2023-09-21T13:07:49.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:49 smithi160 ceph-mon[134450]: pgmap v361: 97 pgs: 97 active+clean; 354 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 168 op/s 2023-09-21T13:07:50.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1077082 8.76 MB/sec execute 511 sec latency 11.501 ms 2023-09-21T13:07:51.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1079089 8.76 MB/sec execute 512 sec latency 88.755 ms 2023-09-21T13:07:51.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:51 smithi156 ceph-mon[134078]: pgmap v362: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-21T13:07:51.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:51 smithi142 ceph-mon[97663]: pgmap v362: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-21T13:07:51.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:51 smithi160 ceph-mon[134450]: pgmap v362: 97 pgs: 97 active+clean; 350 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-21T13:07:52.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1080423 8.76 MB/sec execute 513 sec latency 12.253 ms 2023-09-21T13:07:53.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1082330 8.75 MB/sec execute 514 sec latency 15.877 ms 2023-09-21T13:07:53.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:53 smithi156 ceph-mon[134078]: pgmap v363: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2023-09-21T13:07:53.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:53 smithi142 ceph-mon[97663]: pgmap v363: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2023-09-21T13:07:53.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:53 smithi160 ceph-mon[134450]: pgmap v363: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 208 op/s 2023-09-21T13:07:54.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1083842 8.76 MB/sec execute 515 sec latency 13.765 ms 2023-09-21T13:07:55.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1085112 8.75 MB/sec execute 516 sec latency 65.187 ms 2023-09-21T13:07:55.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:55 smithi156 ceph-mon[134078]: pgmap v364: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:07:55.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:55 smithi142 ceph-mon[97663]: pgmap v364: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:07:55.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:55 smithi160 ceph-mon[134450]: pgmap v364: 97 pgs: 97 active+clean; 351 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:07:56.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1087126 8.76 MB/sec execute 517 sec latency 21.065 ms 2023-09-21T13:07:57.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1088225 8.75 MB/sec execute 518 sec latency 15.460 ms 2023-09-21T13:07:57.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:57 smithi156 ceph-mon[134078]: pgmap v365: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 265 op/s 2023-09-21T13:07:57.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:57 smithi142 ceph-mon[97663]: pgmap v365: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 265 op/s 2023-09-21T13:07:57.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:57 smithi160 ceph-mon[134450]: pgmap v365: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.5 MiB/s wr, 265 op/s 2023-09-21T13:07:58.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1088807 8.74 MB/sec execute 519 sec latency 198.417 ms 2023-09-21T13:07:59.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1090779 8.75 MB/sec execute 520 sec latency 21.481 ms 2023-09-21T13:07:59.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:07:59 smithi156 ceph-mon[134078]: pgmap v366: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:07:59.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:07:59 smithi142 ceph-mon[97663]: pgmap v366: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:07:59.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:07:59 smithi160 ceph-mon[134450]: pgmap v366: 97 pgs: 97 active+clean; 359 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 190 op/s 2023-09-21T13:08:00.708 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1091544 8.74 MB/sec execute 521 sec latency 33.736 ms 2023-09-21T13:08:01.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1093489 8.74 MB/sec execute 522 sec latency 35.816 ms 2023-09-21T13:08:01.901 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:01 smithi156 ceph-mon[134078]: pgmap v367: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 335 op/s 2023-09-21T13:08:01.913 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:01 smithi142 ceph-mon[97663]: pgmap v367: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 335 op/s 2023-09-21T13:08:01.935 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:01 smithi160 ceph-mon[134450]: pgmap v367: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.7 MiB/s wr, 335 op/s 2023-09-21T13:08:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 -- 172.21.15.142:0/1526460835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e70073210 msgr2=0x7f7e700735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.197 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1526460835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e70073210 0x7f7e700735f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009990 tx=0x7f7e6c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 -- 172.21.15.142:0/1526460835 shutdown_connections 2023-09-21T13:08:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1526460835 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e7010d5a0 0x7f7e7010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1526460835 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e70073210 0x7f7e700735f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1526460835 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e7010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 -- 172.21.15.142:0/1526460835 >> 172.21.15.142:0/1526460835 conn(0x7f7e700fc890 msgr2=0x7f7e700fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 -- 172.21.15.142:0/1526460835 shutdown_connections 2023-09-21T13:08:02.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.202+0000 7f7e77bff700 1 -- 172.21.15.142:0/1526460835 wait complete. 2023-09-21T13:08:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.203+0000 7f7e77bff700 1 Processor -- start 2023-09-21T13:08:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.203+0000 7f7e77bff700 1 -- start start 2023-09-21T13:08:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.203+0000 7f7e77bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e70073210 0x7f7e701990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.203+0000 7f7e77bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e77bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 0x7f7e7019dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e77bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7019e2e0 con 0x7f7e70073b30 2023-09-21T13:08:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e77bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7019e450 con 0x7f7e70073210 2023-09-21T13:08:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e77bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7019e610 con 0x7f7e7010d5a0 2023-09-21T13:08:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e70073210 0x7f7e701990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49164/0 (socket says 172.21.15.142:49164) 2023-09-21T13:08:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7519a700 1 -- 172.21.15.142:0/1008887707 learned_addr learned my addr 172.21.15.142:0/1008887707 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 0x7f7e7019dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 -- 172.21.15.142:0/1008887707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e70073210 msgr2=0x7f7e701990f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e70073210 0x7f7e701990f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 -- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 msgr2=0x7f7e70199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7619c700 1 -- 172.21.15.142:0/1008887707 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0095f0 con 0x7f7e7010d5a0 2023-09-21T13:08:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.204+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 0x7f7e7019dca0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800efc0 tx=0x7f7e6800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e66ffd700 1 -- 172.21.15.142:0/1008887707 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68018070 con 0x7f7e7010d5a0 2023-09-21T13:08:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e66ffd700 1 -- 172.21.15.142:0/1008887707 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e6800f040 con 0x7f7e7010d5a0 2023-09-21T13:08:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e66ffd700 1 -- 172.21.15.142:0/1008887707 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800cd40 con 0x7f7e7010d5a0 2023-09-21T13:08:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e7019e890 con 0x7f7e7010d5a0 2023-09-21T13:08:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.205+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e701a6130 con 0x7f7e7010d5a0 2023-09-21T13:08:02.206 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.210+0000 7f7e66ffd700 1 -- 172.21.15.142:0/1008887707 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7e68003a00 con 0x7f7e7010d5a0 2023-09-21T13:08:02.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.210+0000 7f7e8b4e4b80 1 Processor -- start 2023-09-21T13:08:02.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 -- start start 2023-09-21T13:08:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562da8b0 0x557c562dac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 0x557c562df120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c56246c40 con 0x557c562db1d0 2023-09-21T13:08:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c5622ac10 con 0x557c562df660 2023-09-21T13:08:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.212+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c56228530 con 0x557c562da8b0 2023-09-21T13:08:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:42890/0 (socket says 172.21.15.142:42890) 2023-09-21T13:08:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 -- 172.21.15.142:0/2360538124 learned_addr learned my addr 172.21.15.142:0/2360538124 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562da8b0 0x557c562dac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 0x557c562df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e66ffd700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 0x7f7e5c0a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 -- 172.21.15.142:0/2360538124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562da8b0 msgr2=0x557c562dac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562da8b0 0x557c562dac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 -- 172.21.15.142:0/2360538124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 msgr2=0x557c562df120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 0x557c562df120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 -- 172.21.15.142:0/2360538124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c5604ed80 con 0x557c562df660 2023-09-21T13:08:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e66ffd700 1 -- 172.21.15.142:0/1008887707 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f7e680cbaf0 con 0x7f7e7010d5a0 2023-09-21T13:08:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 0x557c562df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:08:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 0x7f7e5c0a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.213+0000 7f7e7519a700 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e60011d30 tx=0x7f7e60009cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6727a2d799cb0ad9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.214+0000 7f7e5bfff700 1 -- 172.21.15.142:0/2360538124 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000f9b0 con 0x557c562df660 2023-09-21T13:08:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.214+0000 7f7e5bfff700 1 -- 172.21.15.142:0/2360538124 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e6001f440 con 0x557c562df660 2023-09-21T13:08:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.214+0000 7f7e5bfff700 1 -- 172.21.15.142:0/2360538124 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6000e620 con 0x557c562df660 2023-09-21T13:08:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e7619c700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 0x7f7e5c0a2d70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800ef90 tx=0x7f7e680092e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2360538124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 msgr2=0x557c562dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f7e60011d30 tx=0x7f7e60009cf0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2360538124 shutdown_connections 2023-09-21T13:08:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562dfac0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562da8b0 0x557c562dac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2360538124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562db1d0 0x557c562df120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2360538124 >> 172.21.15.142:0/2360538124 conn(0x557c561fefa0 msgr2=0x557c562cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2360538124 shutdown_connections 2023-09-21T13:08:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.215+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2360538124 wait complete. 2023-09-21T13:08:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.216+0000 7f7e8b4e4b80 1 -- start start 2023-09-21T13:08:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.216+0000 7f7e8b4e4b80 1 Processor -- start 2023-09-21T13:08:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 0x557c562e4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c56223e20 con 0x557c562da8b0 2023-09-21T13:08:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c561c06e0 con 0x557c562db1d0 2023-09-21T13:08:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c561c0380 con 0x557c562df660 2023-09-21T13:08:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e8b4e4b80 10 client.0 _ll_register_callbacks cb 0x557c5610aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:42904/0 (socket says 172.21.15.142:42904) 2023-09-21T13:08:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 -- 172.21.15.142:0/1013318793 learned_addr learned my addr 172.21.15.142:0/1013318793 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 0x557c562e4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 -- 172.21.15.142:0/1013318793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 msgr2=0x557c562e4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 0x557c562e4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 -- 172.21.15.142:0/1013318793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 msgr2=0x557c562e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562e6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.217+0000 7f7e7599b700 1 -- 172.21.15.142:0/1013318793 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e60019040 con 0x557c562db1d0 2023-09-21T13:08:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 0x557c562e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:08:02.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e7599b700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00bf60 tx=0x7f7e6c009530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60c2355ed974744f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e597fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c01d070 con 0x557c562db1d0 2023-09-21T13:08:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f7e6c004700 con 0x557c562db1d0 2023-09-21T13:08:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c56194b50 con 0x557c562db1d0 2023-09-21T13:08:02.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c0056e0 con 0x557c562db1d0 2023-09-21T13:08:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e8b4e4b80 10 client.27884 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.218+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557c56037c00 con 0x557c562db1d0 2023-09-21T13:08:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557c56194b50 con 0x557c562db1d0 2023-09-21T13:08:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7e6c0249e0 con 0x557c562db1d0 2023-09-21T13:08:02.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 10 client.27884 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 10 client.27884 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 20 client.27884 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c562f4800 0x557c562f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 4 client.27884 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:02.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.219+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c562a0fc0 con 0x557c562f4800 2023-09-21T13:08:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.220+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c562f4800 0x557c562f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.220+0000 7f7e7519a700 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c562f4800 0x557c562f6c20 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9cb42ded7fc8f4b server_cookie=a0cf43b48b91a1d1 in_seq=0 out_seq=0 2023-09-21T13:08:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.220+0000 7f7e597fa700 10 client.27884 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e597fa700 1 -- 172.21.15.142:0/1013318793 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c562a0fc0 con 0x557c562f4800 2023-09-21T13:08:02.228 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e597fa700 10 client.27884 handle_command_reply: tid=0 2023-09-21T13:08:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 client.27884 shutdown 2023-09-21T13:08:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 msgr2=0x557c562e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00bf60 tx=0x7f7e6c009530 comp rx=0 tx=0).stop 2023-09-21T13:08:02.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 shutdown_connections 2023-09-21T13:08:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c562f4800 0x557c562f6c20 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562e6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562df660 0x557c562e4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/1013318793 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562db1d0 0x557c562e40d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.221+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 >> 172.21.15.142:0/1013318793 conn(0x557c561fefa0 msgr2=0x557c562cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.222+0000 7f7e597fa700 0 client.27884 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.222+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 shutdown_connections 2023-09-21T13:08:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.222+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/1013318793 wait complete. 2023-09-21T13:08:02.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.222+0000 7f7e8b4e4b80 20 client.27884 trim_cache size 0 max 16384 2023-09-21T13:08:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 Processor -- start 2023-09-21T13:08:02.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 -- start start 2023-09-21T13:08:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562dcf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562eff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c560a48c0 con 0x557c562da8b0 2023-09-21T13:08:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c562ce520 con 0x557c562df660 2023-09-21T13:08:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.238+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c562cddf0 con 0x557c562db1d0 2023-09-21T13:08:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562dcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7519a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562dcf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:49186/0 (socket says 172.21.15.142:49186) 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7519a700 1 -- 172.21.15.142:0/2728591180 learned_addr learned my addr 172.21.15.142:0/2728591180 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7519a700 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 -- 172.21.15.142:0/2728591180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 msgr2=0x557c562e69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562e69f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 -- 172.21.15.142:0/2728591180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 msgr2=0x557c562dcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562dcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.239+0000 7f7e7599b700 1 -- 172.21.15.142:0/2728591180 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c562e3c40 con 0x557c562db1d0 2023-09-21T13:08:02.240 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.240+0000 7f7e7599b700 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562eff70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c024df0 tx=0x7f7e6c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa3f7ecbb466c16 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.240+0000 7f7e64bff700 1 -- 172.21.15.142:0/2728591180 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c01d040 con 0x557c562db1d0 2023-09-21T13:08:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.240+0000 7f7e64bff700 1 -- 172.21.15.142:0/2728591180 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e6c01e040 con 0x557c562db1d0 2023-09-21T13:08:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.240+0000 7f7e64bff700 1 -- 172.21.15.142:0/2728591180 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00f920 con 0x557c562db1d0 2023-09-21T13:08:02.241 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2728591180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 msgr2=0x557c562eff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562eff70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c024df0 tx=0x7f7e6c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2728591180 shutdown_connections 2023-09-21T13:08:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562da8b0 0x557c562dcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562df660 0x557c562e69f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/2728591180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562eff70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2728591180 >> 172.21.15.142:0/2728591180 conn(0x557c561fefa0 msgr2=0x557c562f6810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2728591180 shutdown_connections 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/2728591180 wait complete. 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 -- start start 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.241+0000 7f7e8b4e4b80 1 Processor -- start 2023-09-21T13:08:02.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562da8b0 0x557c562e99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562df660 0x557c56347630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c562ea6c0 con 0x557c562df660 2023-09-21T13:08:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c56347b70 con 0x557c562da8b0 2023-09-21T13:08:02.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c56347ce0 con 0x557c562db1d0 2023-09-21T13:08:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e8b4e4b80 10 client.0 _ll_register_callbacks cb 0x557c5610aa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e7599b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e7599b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54292/0 (socket says 172.21.15.142:54292) 2023-09-21T13:08:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e7599b700 1 -- 172.21.15.142:0/935465226 learned_addr learned my addr 172.21.15.142:0/935465226 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:02.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e7519a700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562da8b0 0x557c562e99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.242+0000 7f7e7519a700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562df660 0x557c56347630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 -- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562da8b0 msgr2=0x557c562e99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562da8b0 0x557c562e99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 -- 172.21.15.142:0/935465226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562df660 msgr2=0x557c56347630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:02.246 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562df660 0x557c56347630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 -- 172.21.15.142:0/935465226 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c56037c00 con 0x557c562db1d0 2023-09-21T13:08:02.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e7599b700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c006010 tx=0x7f7e6c025f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=743c827710425adf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:02.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e597fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:02.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c024890 con 0x557c562db1d0 2023-09-21T13:08:02.247 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f7e6c000e40 con 0x557c562db1d0 2023-09-21T13:08:02.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.243+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7e6001f440 con 0x557c562db1d0 2023-09-21T13:08:02.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.244+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7e6c005320 con 0x557c562db1d0 2023-09-21T13:08:02.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.244+0000 7f7e8b4e4b80 10 client.27838 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:02.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.244+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x557c560751f0 con 0x557c562db1d0 2023-09-21T13:08:02.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.244+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7e6001f440 con 0x557c562db1d0 2023-09-21T13:08:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f7e6c004500 con 0x557c562db1d0 2023-09-21T13:08:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 10 client.27838 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 10 client.27838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 20 client.27838 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:02.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c56348fc0 0x557c5634b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 4 client.27838 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:08:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557c5621ce00 con 0x557c56348fc0 2023-09-21T13:08:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e7519a700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c56348fc0 0x557c5634b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e7519a700 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c56348fc0 0x557c5634b3e0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d580b95916118a37 server_cookie=639611a6946afc06 in_seq=0 out_seq=0 2023-09-21T13:08:02.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.245+0000 7f7e597fa700 10 client.27838 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.291+0000 7f7e597fa700 1 -- 172.21.15.142:0/935465226 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557c5621ce00 con 0x557c56348fc0 2023-09-21T13:08:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.291+0000 7f7e597fa700 10 client.27838 handle_command_reply: tid=0 2023-09-21T13:08:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.291+0000 7f7e8b4e4b80 1 client.27838 shutdown 2023-09-21T13:08:02.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 msgr2=0x557c562e9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c006010 tx=0x7f7e6c025f20 comp rx=0 tx=0).stop 2023-09-21T13:08:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 shutdown_connections 2023-09-21T13:08:02.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557c56348fc0 0x557c5634b3e0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557c562df660 0x557c56347630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557c562da8b0 0x557c562e99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 --2- 172.21.15.142:0/935465226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557c562db1d0 0x557c562e9f30 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 >> 172.21.15.142:0/935465226 conn(0x557c561fefa0 msgr2=0x557c562f0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e597fa700 0 client.27838 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 shutdown_connections 2023-09-21T13:08:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.292+0000 7f7e8b4e4b80 1 -- 172.21.15.142:0/935465226 wait complete. 2023-09-21T13:08:02.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.293+0000 7f7e8b4e4b80 20 client.27838 trim_cache size 0 max 16384 2023-09-21T13:08:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:08:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:08:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:08:02.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:08:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.293+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 msgr2=0x7f7e5c0a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.293+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 0x7f7e5c0a2d70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800ef90 tx=0x7f7e680092e0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.293+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 msgr2=0x7f7e7019dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.293+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 0x7f7e7019dca0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800efc0 tx=0x7f7e6800c3a0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 shutdown_connections 2023-09-21T13:08:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7e5c0a08b0 0x7f7e5c0a2d70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e7010d5a0 0x7f7e7019dca0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7e70073210 0x7f7e701990f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 --2- 172.21.15.142:0/1008887707 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7e70073b30 0x7f7e70199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 >> 172.21.15.142:0/1008887707 conn(0x7f7e700fc890 msgr2=0x7f7e7010f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 shutdown_connections 2023-09-21T13:08:02.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:02.294+0000 7f7e77bff700 1 -- 172.21.15.142:0/1008887707 wait complete. 2023-09-21T13:08:02.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1094366 8.74 MB/sec execute 523 sec latency 45.980 ms 2023-09-21T13:08:02.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:02 smithi142 ceph-mon[97663]: osdmap e99: 12 total, 12 up, 12 in 2023-09-21T13:08:02.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:02 smithi160 ceph-mon[134450]: osdmap e99: 12 total, 12 up, 12 in 2023-09-21T13:08:03.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:02 smithi156 ceph-mon[134078]: osdmap e99: 12 total, 12 up, 12 in 2023-09-21T13:08:03.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1095749 8.73 MB/sec execute 524 sec latency 20.255 ms 2023-09-21T13:08:03.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:03 smithi142 ceph-mon[97663]: pgmap v369: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:03.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:03 smithi160 ceph-mon[134450]: pgmap v369: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:04.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:03 smithi156 ceph-mon[134078]: pgmap v369: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:04.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1097870 8.74 MB/sec execute 525 sec latency 14.622 ms 2023-09-21T13:08:05.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1099249 8.73 MB/sec execute 526 sec latency 32.551 ms 2023-09-21T13:08:05.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:05 smithi142 ceph-mon[97663]: pgmap v370: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:05.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:05 smithi160 ceph-mon[134450]: pgmap v370: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:06.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:05 smithi156 ceph-mon[134078]: pgmap v370: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 333 op/s 2023-09-21T13:08:06.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1101454 8.74 MB/sec execute 527 sec latency 15.345 ms 2023-09-21T13:08:07.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1103123 8.74 MB/sec execute 528 sec latency 18.324 ms 2023-09-21T13:08:07.912 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:07 smithi142 ceph-mon[97663]: pgmap v371: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:07.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:07 smithi160 ceph-mon[134450]: pgmap v371: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:08.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:07 smithi156 ceph-mon[134078]: pgmap v371: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:08.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1105085 8.75 MB/sec execute 529 sec latency 13.545 ms 2023-09-21T13:08:09.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1107029 8.74 MB/sec execute 530 sec latency 15.104 ms 2023-09-21T13:08:09.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:09 smithi160 ceph-mon[134450]: pgmap v372: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:10.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:09 smithi156 ceph-mon[134078]: pgmap v372: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:10.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:09 smithi142 ceph-mon[97663]: pgmap v372: 97 pgs: 97 active+clean; 354 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.9 MiB/s wr, 362 op/s 2023-09-21T13:08:10.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1108689 8.75 MB/sec execute 531 sec latency 12.863 ms 2023-09-21T13:08:11.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1110435 8.74 MB/sec execute 532 sec latency 30.930 ms 2023-09-21T13:08:11.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:11 smithi160 ceph-mon[134450]: pgmap v373: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 283 op/s 2023-09-21T13:08:11.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:11 smithi160 ceph-mon[134450]: osdmap e100: 12 total, 12 up, 12 in 2023-09-21T13:08:12.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:11 smithi156 ceph-mon[134078]: pgmap v373: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 283 op/s 2023-09-21T13:08:12.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:11 smithi156 ceph-mon[134078]: osdmap e100: 12 total, 12 up, 12 in 2023-09-21T13:08:12.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:11 smithi142 ceph-mon[97663]: pgmap v373: 97 pgs: 97 active+clean; 363 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 283 op/s 2023-09-21T13:08:12.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:11 smithi142 ceph-mon[97663]: osdmap e100: 12 total, 12 up, 12 in 2023-09-21T13:08:12.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1112196 8.75 MB/sec execute 533 sec latency 17.275 ms 2023-09-21T13:08:13.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1114208 8.75 MB/sec execute 534 sec latency 16.216 ms 2023-09-21T13:08:13.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:13 smithi160 ceph-mon[134450]: pgmap v375: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:14.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:13 smithi156 ceph-mon[134078]: pgmap v375: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:14.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:13 smithi142 ceph-mon[97663]: pgmap v375: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:14.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1115884 8.75 MB/sec execute 535 sec latency 10.196 ms 2023-09-21T13:08:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 -- 172.21.15.142:0/1304311138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638101980 msgr2=0x7f46381059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 --2- 172.21.15.142:0/1304311138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638101980 0x7f46381059c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f462c0098f0 tx=0x7f462c009c00 comp rx=0 tx=0).stop 2023-09-21T13:08:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 -- 172.21.15.142:0/1304311138 shutdown_connections 2023-09-21T13:08:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 --2- 172.21.15.142:0/1304311138 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f463810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 --2- 172.21.15.142:0/1304311138 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4638100fd0 0x7f46381013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 --2- 172.21.15.142:0/1304311138 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638101980 0x7f46381059c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 -- 172.21.15.142:0/1304311138 >> 172.21.15.142:0/1304311138 conn(0x7f46380fc830 msgr2=0x7f46380fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 -- 172.21.15.142:0/1304311138 shutdown_connections 2023-09-21T13:08:15.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.469+0000 7f463cdff700 1 -- 172.21.15.142:0/1304311138 wait complete. 2023-09-21T13:08:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.470+0000 7f463cdff700 1 Processor -- start 2023-09-21T13:08:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.470+0000 7f463cdff700 1 -- start start 2023-09-21T13:08:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638100fd0 0x7f46380732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 0x7f46381a54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381a5a30 con 0x7f4638100fd0 2023-09-21T13:08:15.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381a5b70 con 0x7f46381060f0 2023-09-21T13:08:15.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463cdff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46381a5ce0 con 0x7f46381a3100 2023-09-21T13:08:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59744/0 (socket says 172.21.15.142:59744) 2023-09-21T13:08:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 -- 172.21.15.142:0/1965924923 learned_addr learned my addr 172.21.15.142:0/1965924923 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f463659c700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638100fd0 0x7f46380732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4636d9d700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 0x7f46381a54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 -- 172.21.15.142:0/1965924923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 msgr2=0x7f46381a54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 0x7f46381a54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 -- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638100fd0 msgr2=0x7f46380732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638100fd0 0x7f46380732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4635d9b700 1 -- 172.21.15.142:0/1965924923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4630009d00 con 0x7f46381060f0 2023-09-21T13:08:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.471+0000 7f4636d9d700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 0x7f46381a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f4635d9b700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f462c009fd0 tx=0x7f462c00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f46277fe700 1 -- 172.21.15.142:0/1965924923 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c01c070 con 0x7f46381060f0 2023-09-21T13:08:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c009520 con 0x7f46381060f0 2023-09-21T13:08:15.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f46277fe700 1 -- 172.21.15.142:0/1965924923 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f462c00ba40 con 0x7f46381060f0 2023-09-21T13:08:15.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f46277fe700 1 -- 172.21.15.142:0/1965924923 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c004950 con 0x7f46381060f0 2023-09-21T13:08:15.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.472+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4638196f80 con 0x7f46381060f0 2023-09-21T13:08:15.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.477+0000 7f46277fe700 1 -- 172.21.15.142:0/1965924923 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f462c020070 con 0x7f46381060f0 2023-09-21T13:08:15.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.478+0000 7f465081bb80 1 Processor -- start 2023-09-21T13:08:15.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 -- start start 2023-09-21T13:08:15.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f46277fe700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 0x7f46200a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c889c0 0x55f889c8c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c8d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f46277fe700 1 -- 172.21.15.142:0/1965924923 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f462c0ccc50 con 0x7f46381060f0 2023-09-21T13:08:15.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889bfcc40 con 0x55f889c8ce50 2023-09-21T13:08:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889be0c10 con 0x55f889c880a0 2023-09-21T13:08:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f465081bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889bde530 con 0x55f889c889c0 2023-09-21T13:08:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.479+0000 7f4636d9d700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 0x7f46200a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59748/0 (socket says 172.21.15.142:59748) 2023-09-21T13:08:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 -- 172.21.15.142:0/730085337 learned_addr learned my addr 172.21.15.142:0/730085337 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f4635d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c889c0 0x55f889c8c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f4636d9d700 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c8d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 -- 172.21.15.142:0/730085337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c889c0 msgr2=0x55f889c8c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c889c0 0x55f889c8c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 -- 172.21.15.142:0/730085337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 msgr2=0x55f889c8d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c8d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 -- 172.21.15.142:0/730085337 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f889a04d80 con 0x55f889c880a0 2023-09-21T13:08:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f4636d9d700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 0x7f46200a2c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4630009fd0 tx=0x7f46300093d0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.480+0000 7f463659c700 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46280098e0 tx=0x7f4628009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d4e30507b8f06f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.481+0000 7f4624ff9700 1 -- 172.21.15.142:0/730085337 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628019050 con 0x55f889c880a0 2023-09-21T13:08:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.481+0000 7f4624ff9700 1 -- 172.21.15.142:0/730085337 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f462801a040 con 0x55f889c880a0 2023-09-21T13:08:15.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.481+0000 7f4624ff9700 1 -- 172.21.15.142:0/730085337 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462801e640 con 0x55f889c880a0 2023-09-21T13:08:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.481+0000 7f465081bb80 1 -- 172.21.15.142:0/730085337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 msgr2=0x55f889c88480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.481+0000 7f465081bb80 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f46280098e0 tx=0x7f4628009260 comp rx=0 tx=0).stop 2023-09-21T13:08:15.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 -- 172.21.15.142:0/730085337 shutdown_connections 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c8d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c88480 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 --2- 172.21.15.142:0/730085337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c889c0 0x55f889c8c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 -- 172.21.15.142:0/730085337 >> 172.21.15.142:0/730085337 conn(0x55f889bb4fa0 msgr2=0x55f889c830c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 -- 172.21.15.142:0/730085337 shutdown_connections 2023-09-21T13:08:15.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 -- 172.21.15.142:0/730085337 wait complete. 2023-09-21T13:08:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.482+0000 7f465081bb80 1 -- start start 2023-09-21T13:08:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.483+0000 7f465081bb80 1 Processor -- start 2023-09-21T13:08:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.483+0000 7f465081bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c94580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c889c0 0x55f889c91870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889bd9e20 con 0x55f889c889c0 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889b766e0 con 0x55f889c880a0 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889b76380 con 0x55f889c8ce50 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f465081bb80 10 client.0 _ll_register_callbacks cb 0x55f889ac0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:15.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35258/0 (socket says 172.21.15.142:35258) 2023-09-21T13:08:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 -- 172.21.15.142:0/869272151 learned_addr learned my addr 172.21.15.142:0/869272151 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4635d9b700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c889c0 0x55f889c91870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f463659c700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 -- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 msgr2=0x55f889c94580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c94580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 -- 172.21.15.142:0/869272151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c889c0 msgr2=0x55f889c91870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c889c0 0x55f889c91870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.484+0000 7f4636d9d700 1 -- 172.21.15.142:0/869272151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46280095c0 con 0x55f889c8ce50 2023-09-21T13:08:15.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f4636d9d700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4630009610 tx=0x7f463000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bdc74f5bd95ca78 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f461dffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463000ee10 con 0x55f889c8ce50 2023-09-21T13:08:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f889b4ab50 con 0x55f889c8ce50 2023-09-21T13:08:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4630021040 con 0x55f889c8ce50 2023-09-21T13:08:15.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f463001a640 con 0x55f889c8ce50 2023-09-21T13:08:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f465081bb80 10 client.27850 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55f8899edc00 con 0x55f889c8ce50 2023-09-21T13:08:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.485+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f889b4ab50 con 0x55f889c8ce50 2023-09-21T13:08:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f4630025070 con 0x55f889c8ce50 2023-09-21T13:08:15.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 10 client.27850 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 10 client.27850 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 20 client.27850 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889ca1f00 0x55f889ca4320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 4 client.27850 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:15.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f889c56fc0 con 0x55f889ca1f00 2023-09-21T13:08:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f463659c700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889ca1f00 0x55f889ca4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f463659c700 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889ca1f00 0x55f889ca4320 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb303647a7ba0a8c server_cookie=8920f88382b578b7 in_seq=0 out_seq=0 2023-09-21T13:08:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.486+0000 7f461dffb700 10 client.27850 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f461dffb700 1 -- 172.21.15.142:0/869272151 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f889c56fc0 con 0x55f889ca1f00 2023-09-21T13:08:15.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f461dffb700 10 client.27850 handle_command_reply: tid=0 2023-09-21T13:08:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 client.27850 shutdown 2023-09-21T13:08:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 msgr2=0x55f889c91e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4630009610 tx=0x7f463000b040 comp rx=0 tx=0).stop 2023-09-21T13:08:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 shutdown_connections 2023-09-21T13:08:15.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889ca1f00 0x55f889ca4320 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c8ce50 0x55f889c91e80 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c880a0 0x55f889c94580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 --2- 172.21.15.142:0/869272151 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c889c0 0x55f889c91870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f461dffb700 0 client.27850 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:15.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.487+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 >> 172.21.15.142:0/869272151 conn(0x55f889bb4fa0 msgr2=0x55f889c82310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.488+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 shutdown_connections 2023-09-21T13:08:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.488+0000 7f465081bb80 1 -- 172.21.15.142:0/869272151 wait complete. 2023-09-21T13:08:15.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.488+0000 7f465081bb80 20 client.27850 trim_cache size 0 max 16384 2023-09-21T13:08:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.507+0000 7f465081bb80 1 Processor -- start 2023-09-21T13:08:15.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.507+0000 7f465081bb80 1 -- start start 2023-09-21T13:08:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c98fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c91030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c94120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889a5a8c0 con 0x55f889c8ce50 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889c7f210 con 0x55f889c889c0 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f465081bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889c99510 con 0x55f889c880a0 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f4635d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c91030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c98fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f4635d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c91030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59762/0 (socket says 172.21.15.142:59762) 2023-09-21T13:08:15.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f4635d9b700 1 -- 172.21.15.142:0/424971214 learned_addr learned my addr 172.21.15.142:0/424971214 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f4636d9d700 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c94120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 -- 172.21.15.142:0/424971214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 msgr2=0x55f889c91030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c91030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 -- 172.21.15.142:0/424971214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 msgr2=0x55f889c94120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c94120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.508+0000 7f463659c700 1 -- 172.21.15.142:0/424971214 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f889ca8f70 con 0x55f889c880a0 2023-09-21T13:08:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.509+0000 7f463659c700 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c98fd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4628009ed0 tx=0x7f4628003cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c48d07d6fbde209 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.509+0000 7f46257fa700 1 -- 172.21.15.142:0/424971214 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462802d040 con 0x55f889c880a0 2023-09-21T13:08:15.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.509+0000 7f46257fa700 1 -- 172.21.15.142:0/424971214 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4628003b00 con 0x55f889c880a0 2023-09-21T13:08:15.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.509+0000 7f46257fa700 1 -- 172.21.15.142:0/424971214 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4628019040 con 0x55f889c880a0 2023-09-21T13:08:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- 172.21.15.142:0/424971214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 msgr2=0x55f889c98fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c98fd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4628009ed0 tx=0x7f4628003cc0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- 172.21.15.142:0/424971214 shutdown_connections 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889c94120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c98fd0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 --2- 172.21.15.142:0/424971214 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c91030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- 172.21.15.142:0/424971214 >> 172.21.15.142:0/424971214 conn(0x55f889bb4fa0 msgr2=0x55f889c91830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- 172.21.15.142:0/424971214 shutdown_connections 2023-09-21T13:08:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- 172.21.15.142:0/424971214 wait complete. 2023-09-21T13:08:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.510+0000 7f465081bb80 1 -- start start 2023-09-21T13:08:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 Processor -- start 2023-09-21T13:08:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c954f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889cf4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889c95de0 con 0x55f889c8ce50 2023-09-21T13:08:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889cf5280 con 0x55f889c889c0 2023-09-21T13:08:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f889cf53f0 con 0x55f889c880a0 2023-09-21T13:08:15.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.511+0000 7f465081bb80 10 client.0 _ll_register_callbacks cb 0x55f889ac0a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35274/0 (socket says 172.21.15.142:35274) 2023-09-21T13:08:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 -- 172.21.15.142:0/3364835807 learned_addr learned my addr 172.21.15.142:0/3364835807 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:15.514 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f4635d9b700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c954f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f4636d9d700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889cf4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 -- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 msgr2=0x55f889c954f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c954f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 -- 172.21.15.142:0/3364835807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 msgr2=0x55f889cf4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:15.515 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889cf4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 -- 172.21.15.142:0/3364835807 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f889a04d80 con 0x55f889c880a0 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f463659c700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4628000c00 tx=0x7f4628031000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83a155599b51caef server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.512+0000 7f461dffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462802d070 con 0x55f889c880a0 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4628005430 con 0x55f889c880a0 2023-09-21T13:08:15.516 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f462801a040 con 0x55f889c880a0 2023-09-21T13:08:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4628019070 con 0x55f889c880a0 2023-09-21T13:08:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 10 client.27856 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55f889a2b1f0 con 0x55f889c880a0 2023-09-21T13:08:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f462801a040 con 0x55f889c880a0 2023-09-21T13:08:15.517 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f4628035020 con 0x55f889c880a0 2023-09-21T13:08:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 10 client.27856 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 10 client.27856 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 20 client.27856 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889cf6700 0x55f889cf8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:15.518 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 4 client.27856 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:08:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.513+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f889bd2e00 con 0x55f889cf6700 2023-09-21T13:08:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.514+0000 7f4635d9b700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889cf6700 0x55f889cf8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.514+0000 7f461dffb700 10 client.27856 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:15.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.514+0000 7f4635d9b700 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889cf6700 0x55f889cf8af0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a13d1824df0c409 server_cookie=540bdf225e9e8448 in_seq=0 out_seq=0 2023-09-21T13:08:15.585 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.591+0000 7f461dffb700 1 -- 172.21.15.142:0/3364835807 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f889bd2e00 con 0x55f889cf6700 2023-09-21T13:08:15.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.591+0000 7f461dffb700 10 client.27856 handle_command_reply: tid=0 2023-09-21T13:08:15.586 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.591+0000 7f465081bb80 1 client.27856 shutdown 2023-09-21T13:08:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 msgr2=0x55f889c94fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4628000c00 tx=0x7f4628031000 comp rx=0 tx=0).stop 2023-09-21T13:08:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 shutdown_connections 2023-09-21T13:08:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f889cf6700 0x55f889cf8af0 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f889c8ce50 0x55f889cf4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f889c880a0 0x55f889c94fb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 --2- 172.21.15.142:0/3364835807 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f889c889c0 0x55f889c954f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f461dffb700 0 client.27856 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:15.595 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 >> 172.21.15.142:0/3364835807 conn(0x55f889bb4fa0 msgr2=0x55f889c86ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 shutdown_connections 2023-09-21T13:08:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.599+0000 7f465081bb80 1 -- 172.21.15.142:0/3364835807 wait complete. 2023-09-21T13:08:15.596 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.600+0000 7f465081bb80 20 client.27856 trim_cache size 0 max 16384 2023-09-21T13:08:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:08:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:08:15.597 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:08:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:08:15.598 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.601+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 msgr2=0x7f46200a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.601+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 0x7f46200a2c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4630009fd0 tx=0x7f46300093d0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.601+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 msgr2=0x7f4638073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.601+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f462c009fd0 tx=0x7f462c00fa00 comp rx=0 tx=0).stop 2023-09-21T13:08:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 shutdown_connections 2023-09-21T13:08:15.599 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f46200a07b0 0x7f46200a2c70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4638100fd0 0x7f46380732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46381a3100 0x7f46381a54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 --2- 172.21.15.142:0/1965924923 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f46381060f0 0x7f4638073800 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 >> 172.21.15.142:0/1965924923 conn(0x7f46380fc830 msgr2=0x7f46380fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:15.600 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 shutdown_connections 2023-09-21T13:08:15.601 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:15.602+0000 7f463cdff700 1 -- 172.21.15.142:0/1965924923 wait complete. 2023-09-21T13:08:15.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1117769 8.75 MB/sec execute 536 sec latency 73.635 ms 2023-09-21T13:08:15.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:15 smithi160 ceph-mon[134450]: pgmap v376: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:16.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:15 smithi156 ceph-mon[134078]: pgmap v376: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:16.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:15 smithi142 ceph-mon[97663]: pgmap v376: 97 pgs: 97 active+clean; 364 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 218 op/s 2023-09-21T13:08:16.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1119376 8.76 MB/sec execute 537 sec latency 15.352 ms 2023-09-21T13:08:17.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1120937 8.75 MB/sec execute 538 sec latency 71.568 ms 2023-09-21T13:08:17.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:17 smithi160 ceph-mon[134450]: pgmap v377: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:18.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:17 smithi156 ceph-mon[134078]: pgmap v377: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:18.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:17 smithi142 ceph-mon[97663]: pgmap v377: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:18.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1122805 8.76 MB/sec execute 539 sec latency 20.052 ms 2023-09-21T13:08:19.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:08:19.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 -- 172.21.15.142:0/958174442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410101950 msgr2=0x7fa410105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 --2- 172.21.15.142:0/958174442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410101950 0x7fa410105990 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fa404009990 tx=0x7fa404009ca0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 -- 172.21.15.142:0/958174442 shutdown_connections 2023-09-21T13:08:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 --2- 172.21.15.142:0/958174442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa410100fa0 0x7fa410101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 --2- 172.21.15.142:0/958174442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 0x7fa41010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 --2- 172.21.15.142:0/958174442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410101950 0x7fa410105990 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 -- 172.21.15.142:0/958174442 >> 172.21.15.142:0/958174442 conn(0x7fa4100fc860 msgr2=0x7fa4100fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 -- 172.21.15.142:0/958174442 shutdown_connections 2023-09-21T13:08:19.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.649+0000 7fa4165ff700 1 -- 172.21.15.142:0/958174442 wait complete. 2023-09-21T13:08:19.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.650+0000 7fa4165ff700 1 Processor -- start 2023-09-21T13:08:19.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 -- start start 2023-09-21T13:08:19.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 0x7fa410199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 0x7fa41019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41019e4e0 con 0x7fa41019da60 2023-09-21T13:08:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41019e650 con 0x7fa410100fa0 2023-09-21T13:08:19.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.651+0000 7fa4165ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41019e810 con 0x7fa4101060c0 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59786/0 (socket says 172.21.15.142:59786) 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 -- 172.21.15.142:0/2980667946 learned_addr learned my addr 172.21.15.142:0/2980667946 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 0x7fa410199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 0x7fa41019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 -- 172.21.15.142:0/2980667946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 msgr2=0x7fa410199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 0x7fa410199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 -- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 msgr2=0x7fa41019dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 0x7fa41019dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 -- 172.21.15.142:0/2980667946 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4040095f0 con 0x7fa410100fa0 2023-09-21T13:08:19.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 0x7fa41019dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.652+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa40000e9a0 tx=0x7fa40000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.653+0000 7fa40d7fa700 1 -- 172.21.15.142:0/2980667946 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400009790 con 0x7fa410100fa0 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.653+0000 7fa40d7fa700 1 -- 172.21.15.142:0/2980667946 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa40000cbd0 con 0x7fa410100fa0 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.653+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4101a5d70 con 0x7fa410100fa0 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.653+0000 7fa40d7fa700 1 -- 172.21.15.142:0/2980667946 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa400018680 con 0x7fa410100fa0 2023-09-21T13:08:19.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.653+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4101a6240 con 0x7fa410100fa0 2023-09-21T13:08:19.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.657+0000 7fa40d7fa700 1 -- 172.21.15.142:0/2980667946 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fa40000cd40 con 0x7fa410100fa0 2023-09-21T13:08:19.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.658+0000 7fa429fd0b80 1 Processor -- start 2023-09-21T13:08:19.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 -- start start 2023-09-21T13:08:19.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa40d7fa700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 0x7fa3f80a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544da59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5f30 0x558544da9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544daa7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544d19ca0 con 0x558544da5f30 2023-09-21T13:08:19.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544cfdc70 con 0x558544da5610 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa40d7fa700 1 -- 172.21.15.142:0/2980667946 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa400014070 con 0x7fa410100fa0 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544cfb590 con 0x558544daa360 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544daa7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.659+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544da59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544da59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59802/0 (socket says 172.21.15.142:59802) 2023-09-21T13:08:19.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa40ffff700 1 -- 172.21.15.142:0/767595984 learned_addr learned my addr 172.21.15.142:0/767595984 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:19.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5f30 0x558544da9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 0x7fa3f80a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 -- 172.21.15.142:0/767595984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 msgr2=0x558544da59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544da59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 -- 172.21.15.142:0/767595984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5f30 msgr2=0x558544da9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5f30 0x558544da9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 -- 172.21.15.142:0/767595984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558544b21de0 con 0x558544daa360 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544daa7c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa4080060b0 tx=0x7fa408018640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ebb3d167288606 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.660+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 0x7fa3f80a2cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa40800b000 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa3f67fc700 1 -- 172.21.15.142:0/767595984 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800e040 con 0x558544daa360 2023-09-21T13:08:19.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa3f67fc700 1 -- 172.21.15.142:0/767595984 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa408009b10 con 0x558544daa360 2023-09-21T13:08:19.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa3f67fc700 1 -- 172.21.15.142:0/767595984 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408005040 con 0x558544daa360 2023-09-21T13:08:19.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 -- 172.21.15.142:0/767595984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 msgr2=0x558544daa7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544daa7c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa4080060b0 tx=0x7fa408018640 comp rx=0 tx=0).stop 2023-09-21T13:08:19.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 -- 172.21.15.142:0/767595984 shutdown_connections 2023-09-21T13:08:19.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544daa7c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544da59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/767595984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5f30 0x558544da9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.661+0000 7fa429fd0b80 1 -- 172.21.15.142:0/767595984 >> 172.21.15.142:0/767595984 conn(0x558544cd2000 msgr2=0x558544da06a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.662+0000 7fa429fd0b80 1 -- 172.21.15.142:0/767595984 shutdown_connections 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.662+0000 7fa429fd0b80 1 -- 172.21.15.142:0/767595984 wait complete. 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.662+0000 7fa429fd0b80 1 -- start start 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.662+0000 7fa429fd0b80 1 Processor -- start 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544db1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544daedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544cf6e80 con 0x558544daa360 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544c93740 con 0x558544da5610 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544c933e0 con 0x558544da5f30 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa429fd0b80 10 client.0 _ll_register_callbacks cb 0x558544bdda80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:19.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33518/0 (socket says 172.21.15.142:33518) 2023-09-21T13:08:19.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa414b9c700 1 -- 172.21.15.142:0/2635948269 learned_addr learned my addr 172.21.15.142:0/2635948269 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:19.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544daedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.663+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544db1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.665 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 -- 172.21.15.142:0/2635948269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 msgr2=0x558544daedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544daedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 -- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 msgr2=0x558544db1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544db1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 -- 172.21.15.142:0/2635948269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa408007a50 con 0x558544daa360 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa414b9c700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa40801aed0 tx=0x7fa408004a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808b71cc838cda1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa3ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800e070 con 0x558544daa360 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558544c67bb0 con 0x558544daa360 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.664+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa40801a720 con 0x558544daa360 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa40801a8e0 con 0x558544daa360 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 10 client.17808 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:19.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x558544b0ac60 con 0x558544daa360 2023-09-21T13:08:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558544c67bb0 con 0x558544daa360 2023-09-21T13:08:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa408022450 con 0x558544daa360 2023-09-21T13:08:19.669 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 10 client.17808 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 10 client.17808 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 20 client.17808 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.665+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544dbf3d0 0x558544dc17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.666+0000 7fa429fd0b80 4 client.17808 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:19.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.666+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558544d74020 con 0x558544dbf3d0 2023-09-21T13:08:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.666+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544dbf3d0 0x558544dc17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.666+0000 7fa3ef7fe700 10 client.17808 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.666+0000 7fa40ffff700 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544dbf3d0 0x558544dc17f0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f987a65a8b802bc server_cookie=ea95adbc672f70c0 in_seq=0 out_seq=0 2023-09-21T13:08:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/2635948269 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558544d74020 con 0x558544dbf3d0 2023-09-21T13:08:19.671 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa3ef7fe700 10 client.17808 handle_command_reply: tid=0 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 client.17808 shutdown 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 msgr2=0x558544daf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa40801aed0 tx=0x7fa408004a90 comp rx=0 tx=0).stop 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 shutdown_connections 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544dbf3d0 0x558544dc17f0 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544daa360 0x558544daf4e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5610 0x558544db1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/2635948269 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544daedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 >> 172.21.15.142:0/2635948269 conn(0x558544cd2000 msgr2=0x558544da0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.667+0000 7fa3ef7fe700 0 client.17808 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:19.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.668+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 shutdown_connections 2023-09-21T13:08:19.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.668+0000 7fa429fd0b80 1 -- 172.21.15.142:0/2635948269 wait complete. 2023-09-21T13:08:19.674 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.668+0000 7fa429fd0b80 20 client.17808 trim_cache size 0 max 16384 2023-09-21T13:08:19.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.689+0000 7fa429fd0b80 1 Processor -- start 2023-09-21T13:08:19.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.689+0000 7fa429fd0b80 1 -- start start 2023-09-21T13:08:19.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.689+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544db6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544dab790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544b77920 con 0x558544da5610 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544da1ed0 con 0x558544daa360 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544db6990 con 0x558544da5f30 2023-09-21T13:08:19.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59812/0 (socket says 172.21.15.142:59812) 2023-09-21T13:08:19.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 -- 172.21.15.142:0/3958483782 learned_addr learned my addr 172.21.15.142:0/3958483782 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:19.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544dab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa40ffff700 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544db6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 -- 172.21.15.142:0/3958483782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 msgr2=0x558544dab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544dab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 -- 172.21.15.142:0/3958483782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 msgr2=0x558544db6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.690+0000 7fa414b9c700 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544db6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa414b9c700 1 -- 172.21.15.142:0/3958483782 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558544dc6420 con 0x558544daa360 2023-09-21T13:08:19.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544dab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:19.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa414b9c700 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa408009d00 tx=0x7fa408007620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2e16d711045555 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa3f6ffd700 1 -- 172.21.15.142:0/3958483782 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800e050 con 0x558544daa360 2023-09-21T13:08:19.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa3f6ffd700 1 -- 172.21.15.142:0/3958483782 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa40801abe0 con 0x558544daa360 2023-09-21T13:08:19.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.691+0000 7fa3f6ffd700 1 -- 172.21.15.142:0/3958483782 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408022b70 con 0x558544daa360 2023-09-21T13:08:19.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 -- 172.21.15.142:0/3958483782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 msgr2=0x558544da93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fa408009d00 tx=0x7fa408007620 comp rx=0 tx=0).stop 2023-09-21T13:08:19.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 -- 172.21.15.142:0/3958483782 shutdown_connections 2023-09-21T13:08:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544db6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544daa360 0x558544da93a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/3958483782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544da5f30 0x558544dab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 -- 172.21.15.142:0/3958483782 >> 172.21.15.142:0/3958483782 conn(0x558544cd2000 msgr2=0x558544da8430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 -- 172.21.15.142:0/3958483782 shutdown_connections 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.692+0000 7fa429fd0b80 1 -- 172.21.15.142:0/3958483782 wait complete. 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 -- start start 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 Processor -- start 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544dad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 0x558544dadce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544dae220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544daf0d0 con 0x558544da5610 2023-09-21T13:08:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544e13200 con 0x558544da5f30 2023-09-21T13:08:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544e13340 con 0x558544daa360 2023-09-21T13:08:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.693+0000 7fa429fd0b80 10 client.0 _ll_register_callbacks cb 0x7fa400005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:19.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544dad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544dae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 0x558544dadce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544dad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:33534/0 (socket says 172.21.15.142:33534) 2023-09-21T13:08:19.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa414b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544dae220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:35344/0 (socket says 172.21.15.142:35344) 2023-09-21T13:08:19.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40ffff700 1 -- 172.21.15.142:0/1309510456 learned_addr learned my addr 172.21.15.142:0/1309510456 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 -- 172.21.15.142:0/1309510456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 msgr2=0x558544dae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544dae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 -- 172.21.15.142:0/1309510456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 msgr2=0x558544dad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544dad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 -- 172.21.15.142:0/1309510456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41010e4b0 con 0x558544da5f30 2023-09-21T13:08:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.694+0000 7fa40f7fe700 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 0x558544dadce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa40400ba80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25592e336e6c5eff server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa3ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404005450 con 0x558544da5f30 2023-09-21T13:08:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fa4040055b0 con 0x558544da5f30 2023-09-21T13:08:19.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa408009b10 con 0x558544da5f30 2023-09-21T13:08:19.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa404004500 con 0x558544da5f30 2023-09-21T13:08:19.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa429fd0b80 10 client.27926 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:19.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.695+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x558544b0ac60 con 0x558544da5f30 2023-09-21T13:08:19.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa408009b10 con 0x558544da5f30 2023-09-21T13:08:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa40402f6b0 con 0x558544da5f30 2023-09-21T13:08:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 10 client.27926 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 10 client.27926 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 20 client.27926 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:19.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544e14a70 0x558544e16e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 4 client.27926 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:08:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.696+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558544cefe60 con 0x558544e14a70 2023-09-21T13:08:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa40ffff700 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544e14a70 0x558544e16e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa3ef7fe700 10 client.27926 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:19.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa40ffff700 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544e14a70 0x558544e16e90 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c8601f771d431e server_cookie=867b30b7698c5108 in_seq=0 out_seq=0 2023-09-21T13:08:19.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa3ef7fe700 1 -- 172.21.15.142:0/1309510456 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x558544cefe60 con 0x558544e14a70 2023-09-21T13:08:19.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa3ef7fe700 10 client.27926 handle_command_reply: tid=0 2023-09-21T13:08:19.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.697+0000 7fa429fd0b80 1 client.27926 shutdown 2023-09-21T13:08:19.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 msgr2=0x558544dadce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 0x558544dadce0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fa404000c00 tx=0x7fa40400ba80 comp rx=0 tx=0).stop 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 shutdown_connections 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558544e14a70 0x558544e16e90 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558544da5610 0x558544dad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558544daa360 0x558544dae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 --2- 172.21.15.142:0/1309510456 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558544da5f30 0x558544dadce0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 >> 172.21.15.142:0/1309510456 conn(0x558544cd2000 msgr2=0x558544da93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa3ef7fe700 0 client.27926 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:19.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 shutdown_connections 2023-09-21T13:08:19.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.698+0000 7fa429fd0b80 1 -- 172.21.15.142:0/1309510456 wait complete. 2023-09-21T13:08:19.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa429fd0b80 20 client.27926 trim_cache size 0 max 16384 2023-09-21T13:08:19.705 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:08:19.705 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:08:19.705 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:08:19.705 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:08:19.706 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:08:19.706 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:08:19.706 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:08:19.706 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:08:19.707 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:08:19.707 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:08:19.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 msgr2=0x7fa3f80a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 0x7fa3f80a2cf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa408009fd0 tx=0x7fa40800b000 comp rx=0 tx=0).stop 2023-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 msgr2=0x7fa4101990c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fa40000e9a0 tx=0x7fa40000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 shutdown_connections 2023-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fa3f80a0830 0x7fa3f80a2cf0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fa41019da60 0x7fa41019dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fa410100fa0 0x7fa4101990c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 --2- 172.21.15.142:0/2980667946 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4101060c0 0x7fa410199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.699+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 >> 172.21.15.142:0/2980667946 conn(0x7fa4100fc860 msgr2=0x7fa4100fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.700+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 shutdown_connections 2023-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:19.700+0000 7fa4165ff700 1 -- 172.21.15.142:0/2980667946 wait complete. 2023-09-21T13:08:19.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1124373 8.75 MB/sec execute 540 sec latency 23.655 ms 2023-09-21T13:08:19.713 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:19 smithi142 ceph-mon[97663]: pgmap v378: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:19.715 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:08:19.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:19 smithi160 ceph-mon[134450]: pgmap v378: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:20.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:19 smithi156 ceph-mon[134078]: pgmap v378: 97 pgs: 97 active+clean; 369 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 221 op/s 2023-09-21T13:08:20.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1126306 8.76 MB/sec execute 541 sec latency 18.095 ms 2023-09-21T13:08:21.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1127792 8.76 MB/sec execute 542 sec latency 19.235 ms 2023-09-21T13:08:21.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:21 smithi160 ceph-mon[134450]: pgmap v379: 97 pgs: 97 active+clean; 368 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:08:22.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:21 smithi156 ceph-mon[134078]: pgmap v379: 97 pgs: 97 active+clean; 368 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:08:22.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:21 smithi142 ceph-mon[97663]: pgmap v379: 97 pgs: 97 active+clean; 368 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 228 op/s 2023-09-21T13:08:22.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1129736 8.77 MB/sec execute 543 sec latency 29.999 ms 2023-09-21T13:08:23.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1131066 8.76 MB/sec execute 544 sec latency 20.295 ms 2023-09-21T13:08:23.934 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:23 smithi160 ceph-mon[134450]: pgmap v380: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-09-21T13:08:24.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:23 smithi156 ceph-mon[134078]: pgmap v380: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-09-21T13:08:24.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:23 smithi142 ceph-mon[97663]: pgmap v380: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 222 op/s 2023-09-21T13:08:24.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1133246 8.77 MB/sec execute 545 sec latency 19.826 ms 2023-09-21T13:08:25.709 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1134520 8.76 MB/sec execute 546 sec latency 54.398 ms 2023-09-21T13:08:25.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:25 smithi160 ceph-mon[134450]: pgmap v381: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 202 op/s 2023-09-21T13:08:26.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:25 smithi156 ceph-mon[134078]: pgmap v381: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 202 op/s 2023-09-21T13:08:26.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:25 smithi142 ceph-mon[97663]: pgmap v381: 97 pgs: 97 active+clean; 370 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 202 op/s 2023-09-21T13:08:26.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1136485 8.76 MB/sec execute 547 sec latency 17.398 ms 2023-09-21T13:08:27.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1137527 8.76 MB/sec execute 548 sec latency 64.852 ms 2023-09-21T13:08:28.154 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:27 smithi156 ceph-mon[134078]: pgmap v382: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-21T13:08:28.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:27 smithi142 ceph-mon[97663]: pgmap v382: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-21T13:08:28.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:27 smithi160 ceph-mon[134450]: pgmap v382: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2023-09-21T13:08:28.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1139625 8.76 MB/sec execute 549 sec latency 20.963 ms 2023-09-21T13:08:28.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.794+0000 7f23813ff700 1 -- 172.21.15.142:0/4219193240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c101980 msgr2=0x7f237c1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.794+0000 7f23813ff700 1 --2- 172.21.15.142:0/4219193240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c101980 0x7f237c1059c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f23700098f0 tx=0x7f2370009c00 comp rx=0 tx=0).stop 2023-09-21T13:08:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 -- 172.21.15.142:0/4219193240 shutdown_connections 2023-09-21T13:08:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 --2- 172.21.15.142:0/4219193240 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 --2- 172.21.15.142:0/4219193240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c1060f0 0x7f237c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 --2- 172.21.15.142:0/4219193240 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c101980 0x7f237c1059c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 -- 172.21.15.142:0/4219193240 >> 172.21.15.142:0/4219193240 conn(0x7f237c0fc830 msgr2=0x7f237c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 -- 172.21.15.142:0/4219193240 shutdown_connections 2023-09-21T13:08:28.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.795+0000 7f23813ff700 1 -- 172.21.15.142:0/4219193240 wait complete. 2023-09-21T13:08:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 Processor -- start 2023-09-21T13:08:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 -- start start 2023-09-21T13:08:28.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 0x7f237c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 0x7f237c19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19e660 con 0x7f237c100fd0 2023-09-21T13:08:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19e7d0 con 0x7f237c1060f0 2023-09-21T13:08:28.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.796+0000 7f23813ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19e990 con 0x7f237c19dbe0 2023-09-21T13:08:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 0x7f237c19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36066/0 (socket says 172.21.15.142:36066) 2023-09-21T13:08:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 -- 172.21.15.142:0/414600656 learned_addr learned my addr 172.21.15.142:0/414600656 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:28.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237a7fc700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 0x7f237c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 -- 172.21.15.142:0/414600656 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 msgr2=0x7f237c19e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 0x7f237c19e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 -- 172.21.15.142:0/414600656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 msgr2=0x7f237c1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 0x7f237c1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237affd700 1 -- 172.21.15.142:0/414600656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0095f0 con 0x7f237c100fd0 2023-09-21T13:08:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237a7fc700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 0x7f237c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.797+0000 7f237b7fe700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 0x7f237c19e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f237affd700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f236c00ec10 tx=0x7f236c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.798 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f2363fff700 1 -- 172.21.15.142:0/414600656 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cc80 con 0x7f237c100fd0 2023-09-21T13:08:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f2363fff700 1 -- 172.21.15.142:0/414600656 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f236c0044e0 con 0x7f237c100fd0 2023-09-21T13:08:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2374009c40 con 0x7f237c100fd0 2023-09-21T13:08:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f2363fff700 1 -- 172.21.15.142:0/414600656 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c010430 con 0x7f237c100fd0 2023-09-21T13:08:28.799 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.798+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370009520 con 0x7f237c100fd0 2023-09-21T13:08:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.802+0000 7f2363fff700 1 -- 172.21.15.142:0/414600656 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f236c003f90 con 0x7f237c100fd0 2023-09-21T13:08:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.804+0000 7f2394d86b80 1 Processor -- start 2023-09-21T13:08:28.801 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.804+0000 7f2394d86b80 1 -- start start 2023-09-21T13:08:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.804+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee780480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee784910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee7852b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2394d86b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee6f4c40 con 0x5651ee784e50 2023-09-21T13:08:28.802 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2394d86b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee6d8c10 con 0x5651ee7809c0 2023-09-21T13:08:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2394d86b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee6d6530 con 0x5651ee7800a0 2023-09-21T13:08:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee780480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee784910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee780480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:48150/0 (socket says 172.21.15.142:48150) 2023-09-21T13:08:28.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237b7fe700 1 -- 172.21.15.142:0/2432456534 learned_addr learned my addr 172.21.15.142:0/2432456534 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2363fff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 0x7f23640a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237a7fc700 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee7852b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237b7fe700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 0x7f23640a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 -- 172.21.15.142:0/2432456534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 msgr2=0x5651ee780480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee780480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 -- 172.21.15.142:0/2432456534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 msgr2=0x5651ee7852b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee7852b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237affd700 1 -- 172.21.15.142:0/2432456534 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651ee4fcd80 con 0x5651ee7809c0 2023-09-21T13:08:28.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f237a7fc700 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee7852b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:08:28.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.805+0000 7f2363fff700 1 -- 172.21.15.142:0/414600656 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f236c014070 con 0x7f237c100fd0 2023-09-21T13:08:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.806+0000 7f237affd700 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee784910 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f236c0c9b40 tx=0x7f236c020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ad5201bf121a16 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.806+0000 7f237b7fe700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 0x7f23640a2cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2374009550 tx=0x7f2374004b40 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.806+0000 7f23617fa700 1 -- 172.21.15.142:0/2432456534 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00cde0 con 0x5651ee7809c0 2023-09-21T13:08:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.806+0000 7f23617fa700 1 -- 172.21.15.142:0/2432456534 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f236c099670 con 0x5651ee7809c0 2023-09-21T13:08:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.806+0000 7f23617fa700 1 -- 172.21.15.142:0/2432456534 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c099fa0 con 0x5651ee7809c0 2023-09-21T13:08:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 -- 172.21.15.142:0/2432456534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 msgr2=0x5651ee784910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee784910 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f236c0c9b40 tx=0x7f236c020000 comp rx=0 tx=0).stop 2023-09-21T13:08:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 -- 172.21.15.142:0/2432456534 shutdown_connections 2023-09-21T13:08:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee7852b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee780480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2432456534 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee784910 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 -- 172.21.15.142:0/2432456534 >> 172.21.15.142:0/2432456534 conn(0x5651ee6acfa0 msgr2=0x5651ee77b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 -- 172.21.15.142:0/2432456534 shutdown_connections 2023-09-21T13:08:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.807+0000 7f2394d86b80 1 -- 172.21.15.142:0/2432456534 wait complete. 2023-09-21T13:08:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.808+0000 7f2394d86b80 1 -- start start 2023-09-21T13:08:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.808+0000 7f2394d86b80 1 Processor -- start 2023-09-21T13:08:28.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee789850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee6d1e20 con 0x5651ee784e50 2023-09-21T13:08:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee66e6e0 con 0x5651ee7809c0 2023-09-21T13:08:28.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee66e380 con 0x5651ee7800a0 2023-09-21T13:08:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f2394d86b80 10 client.0 _ll_register_callbacks cb 0x5651ee5b8a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee789850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f237affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee789850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59104/0 (socket says 172.21.15.142:59104) 2023-09-21T13:08:28.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f237affd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:48164/0 (socket says 172.21.15.142:48164) 2023-09-21T13:08:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.809+0000 7f237a7fc700 1 -- 172.21.15.142:0/2995266997 learned_addr learned my addr 172.21.15.142:0/2995266997 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237b7fe700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 -- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 msgr2=0x5651ee789850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee789850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 -- 172.21.15.142:0/2995266997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 msgr2=0x5651ee789e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 -- 172.21.15.142:0/2995266997 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370009520 con 0x5651ee7800a0 2023-09-21T13:08:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f237affd700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f236c0c9b40 tx=0x7f236c00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefdee672669b81d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f235eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:28.816 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c099200 con 0x5651ee7800a0 2023-09-21T13:08:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651ee642b50 con 0x5651ee7800a0 2023-09-21T13:08:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f236c099fa0 con 0x5651ee7800a0 2023-09-21T13:08:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f236c0993e0 con 0x5651ee7800a0 2023-09-21T13:08:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f2394d86b80 10 client.27886 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:28.817 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.810+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5651ee4e5c00 con 0x5651ee7800a0 2023-09-21T13:08:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5651ee642b50 con 0x5651ee7800a0 2023-09-21T13:08:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f236c095710 con 0x5651ee7800a0 2023-09-21T13:08:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 10 client.27886 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 10 client.27886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:28.818 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 20 client.27886 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7a22d0 0x5651ee7a46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 4 client.27886 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651ee74efc0 con 0x5651ee7a22d0 2023-09-21T13:08:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.811+0000 7f237a7fc700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7a22d0 0x5651ee7a46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.819 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.812+0000 7f235eff5700 10 client.27886 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.812+0000 7f237a7fc700 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7a22d0 0x5651ee7a46c0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e473ff796697b9 server_cookie=1e7450c852f65459 in_seq=0 out_seq=0 2023-09-21T13:08:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.812+0000 7f235eff5700 1 -- 172.21.15.142:0/2995266997 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651ee74efc0 con 0x5651ee7a22d0 2023-09-21T13:08:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.812+0000 7f235eff5700 10 client.27886 handle_command_reply: tid=0 2023-09-21T13:08:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.812+0000 7f2394d86b80 1 client.27886 shutdown 2023-09-21T13:08:28.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 msgr2=0x5651ee78c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f236c0c9b40 tx=0x7f236c00ef90 comp rx=0 tx=0).stop 2023-09-21T13:08:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 shutdown_connections 2023-09-21T13:08:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7a22d0 0x5651ee7a46c0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7800a0 0x5651ee78c5d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 --2- 172.21.15.142:0/2995266997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee789850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 >> 172.21.15.142:0/2995266997 conn(0x5651ee6acfa0 msgr2=0x5651ee77ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f235eff5700 0 client.27886 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 shutdown_connections 2023-09-21T13:08:28.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.813+0000 7f2394d86b80 1 -- 172.21.15.142:0/2995266997 wait complete. 2023-09-21T13:08:28.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.814+0000 7f2394d86b80 20 client.27886 trim_cache size 0 max 16384 2023-09-21T13:08:28.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.832+0000 7f2394d86b80 1 Processor -- start 2023-09-21T13:08:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.832+0000 7f2394d86b80 1 -- start start 2023-09-21T13:08:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.832+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 0x5651ee787950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.832+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f2394d86b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee796880 con 0x5651ee784e50 2023-09-21T13:08:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f2394d86b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee5528c0 con 0x5651ee7800a0 2023-09-21T13:08:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f2394d86b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee77c9b0 con 0x5651ee7809c0 2023-09-21T13:08:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 0x5651ee787950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237affd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 0x5651ee787950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59112/0 (socket says 172.21.15.142:59112) 2023-09-21T13:08:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:48176/0 (socket says 172.21.15.142:48176) 2023-09-21T13:08:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237affd700 1 -- 172.21.15.142:0/4282629564 learned_addr learned my addr 172.21.15.142:0/4282629564 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:28.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 -- 172.21.15.142:0/4282629564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 msgr2=0x5651ee787950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 0x5651ee787950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 -- 172.21.15.142:0/4282629564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 msgr2=0x5651ee789030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 -- 172.21.15.142:0/4282629564 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651ee5231f0 con 0x5651ee7809c0 2023-09-21T13:08:28.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.833+0000 7f237a7fc700 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x5651ee7755b0 tx=0x7f237000b360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12929355dfc3ed90 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.834+0000 7f2361ffb700 1 -- 172.21.15.142:0/4282629564 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237001c040 con 0x5651ee7809c0 2023-09-21T13:08:28.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.834+0000 7f2361ffb700 1 -- 172.21.15.142:0/4282629564 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f237001d040 con 0x5651ee7809c0 2023-09-21T13:08:28.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.834+0000 7f2361ffb700 1 -- 172.21.15.142:0/4282629564 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237000b7c0 con 0x5651ee7809c0 2023-09-21T13:08:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- 172.21.15.142:0/4282629564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 msgr2=0x5651ee78c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x5651ee7755b0 tx=0x7f237000b360 comp rx=0 tx=0).stop 2023-09-21T13:08:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- 172.21.15.142:0/4282629564 shutdown_connections 2023-09-21T13:08:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee784e50 0x5651ee789030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7800a0 0x5651ee787950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 --2- 172.21.15.142:0/4282629564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee7809c0 0x5651ee78c170 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- 172.21.15.142:0/4282629564 >> 172.21.15.142:0/4282629564 conn(0x5651ee6acfa0 msgr2=0x5651ee787240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- 172.21.15.142:0/4282629564 shutdown_connections 2023-09-21T13:08:28.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- 172.21.15.142:0/4282629564 wait complete. 2023-09-21T13:08:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.835+0000 7f2394d86b80 1 -- start start 2023-09-21T13:08:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.836+0000 7f2394d86b80 1 Processor -- start 2023-09-21T13:08:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.836+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee7800a0 0x5651ee790bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.836+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.839 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f2394d86b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee784e50 0x5651ee78f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f2394d86b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee78f870 con 0x5651ee7800a0 2023-09-21T13:08:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f2394d86b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee78f9e0 con 0x5651ee7809c0 2023-09-21T13:08:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f2394d86b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651ee78fba0 con 0x5651ee784e50 2023-09-21T13:08:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f2394d86b80 10 client.0 _ll_register_callbacks cb 0x5651ee5b8a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:28.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237affd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee7800a0 0x5651ee790bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237b7fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee784e50 0x5651ee78f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59116/0 (socket says 172.21.15.142:59116) 2023-09-21T13:08:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 -- 172.21.15.142:0/459808124 learned_addr learned my addr 172.21.15.142:0/459808124 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:28.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 -- 172.21.15.142:0/459808124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee784e50 msgr2=0x5651ee78f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee784e50 0x5651ee78f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 -- 172.21.15.142:0/459808124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee7800a0 msgr2=0x5651ee790bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee7800a0 0x5651ee790bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.837+0000 7f237a7fc700 1 -- 172.21.15.142:0/459808124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c10e4e0 con 0x5651ee7809c0 2023-09-21T13:08:28.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f237a7fc700 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f237000f5b0 tx=0x7f2370026680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c212d3663ba1a50b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:28.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f235eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:28.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237001c040 con 0x5651ee7809c0 2023-09-21T13:08:28.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f236c099670 con 0x5651ee7809c0 2023-09-21T13:08:28.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2370026040 con 0x5651ee7809c0 2023-09-21T13:08:28.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2370026200 con 0x5651ee7809c0 2023-09-21T13:08:28.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f2394d86b80 10 client.27944 fetch_fsmap learned FSMap version 41 2023-09-21T13:08:28.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5651ee4fb250 con 0x5651ee7809c0 2023-09-21T13:08:28.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.838+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2370044080 con 0x5651ee7809c0 2023-09-21T13:08:28.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 41) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f237003e030 con 0x5651ee7809c0 2023-09-21T13:08:28.844 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 10 client.27944 fetch_fsmap finished waiting for FSMap version 41 2023-09-21T13:08:28.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 10 client.27944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:28.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 20 client.27944 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:28.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7f7090 0x5651ee7f94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:28.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 4 client.27944 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:08:28.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5651ee6cae00 con 0x5651ee7f7090 2023-09-21T13:08:28.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.839+0000 7f237affd700 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7f7090 0x5651ee7f94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:28.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.840+0000 7f237affd700 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7f7090 0x5651ee7f94b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=287e819e70e64027 server_cookie=ad91765e1ba11066 in_seq=0 out_seq=0 2023-09-21T13:08:28.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.840+0000 7f235eff5700 10 client.27944 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:28.929 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.932+0000 7f235eff5700 1 -- 172.21.15.142:0/459808124 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5651ee6cae00 con 0x5651ee7f7090 2023-09-21T13:08:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.932+0000 7f235eff5700 10 client.27944 handle_command_reply: tid=0 2023-09-21T13:08:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.932+0000 7f2394d86b80 1 client.27944 shutdown 2023-09-21T13:08:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 msgr2=0x5651ee7910f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f237000f5b0 tx=0x7f2370026680 comp rx=0 tx=0).stop 2023-09-21T13:08:28.930 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 shutdown_connections 2023-09-21T13:08:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5651ee7f7090 0x5651ee7f94b0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5651ee7800a0 0x5651ee790bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5651ee784e50 0x5651ee78f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f235eff5700 0 client.27944 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 --2- 172.21.15.142:0/459808124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5651ee7809c0 0x5651ee7910f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 >> 172.21.15.142:0/459808124 conn(0x5651ee6acfa0 msgr2=0x5651ee783e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 shutdown_connections 2023-09-21T13:08:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.933+0000 7f2394d86b80 1 -- 172.21.15.142:0/459808124 wait complete. 2023-09-21T13:08:28.932 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f2394d86b80 20 client.27944 trim_cache size 0 max 16384 2023-09-21T13:08:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:08:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:08:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:08:28.933 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:08:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 msgr2=0x7f23640a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.934 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 0x7f23640a2cf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2374009550 tx=0x7f2374004b40 comp rx=0 tx=0).stop 2023-09-21T13:08:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 msgr2=0x7f237c1990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f236c00ec10 tx=0x7f236c00ef20 comp rx=0 tx=0).stop 2023-09-21T13:08:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 shutdown_connections 2023-09-21T13:08:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.934+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23640a0830 0x7f23640a2cf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.935 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f237c100fd0 0x7f237c1990a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f237c19dbe0 0x7f237c19e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 --2- 172.21.15.142:0/414600656 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f237c1060f0 0x7f237c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 >> 172.21.15.142:0/414600656 conn(0x7f237c0fc830 msgr2=0x7f237c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 shutdown_connections 2023-09-21T13:08:28.936 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:28.935+0000 7f23813ff700 1 -- 172.21.15.142:0/414600656 wait complete. 2023-09-21T13:08:29.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1140513 8.76 MB/sec execute 550 sec latency 291.964 ms 2023-09-21T13:08:30.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:29 smithi156 ceph-mon[134078]: pgmap v383: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 180 op/s 2023-09-21T13:08:30.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:29 smithi142 ceph-mon[97663]: pgmap v383: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 180 op/s 2023-09-21T13:08:30.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:29 smithi160 ceph-mon[134450]: pgmap v383: 97 pgs: 97 active+clean; 380 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 180 op/s 2023-09-21T13:08:30.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1141720 8.75 MB/sec execute 551 sec latency 369.992 ms 2023-09-21T13:08:31.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:30 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:08:31.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:30 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:08:31.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:30 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:08:31.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1143828 8.76 MB/sec execute 552 sec latency 15.985 ms 2023-09-21T13:08:32.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:31 smithi156 ceph-mon[134078]: pgmap v384: 97 pgs: 97 active+clean; 377 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-21T13:08:32.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:31 smithi142 ceph-mon[97663]: pgmap v384: 97 pgs: 97 active+clean; 377 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-21T13:08:32.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:31 smithi160 ceph-mon[134450]: pgmap v384: 97 pgs: 97 active+clean; 377 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-21T13:08:32.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1144927 8.75 MB/sec execute 553 sec latency 48.216 ms 2023-09-21T13:08:33.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1146760 8.75 MB/sec execute 554 sec latency 48.835 ms 2023-09-21T13:08:34.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:33 smithi156 ceph-mon[134078]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-21T13:08:34.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:33 smithi142 ceph-mon[97663]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-21T13:08:34.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:33 smithi160 ceph-mon[134450]: pgmap v385: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-21T13:08:34.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1147503 8.75 MB/sec execute 555 sec latency 171.759 ms 2023-09-21T13:08:35.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1148727 8.74 MB/sec execute 556 sec latency 17.899 ms 2023-09-21T13:08:36.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:35 smithi156 ceph-mon[134078]: pgmap v386: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-09-21T13:08:36.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:35 smithi142 ceph-mon[97663]: pgmap v386: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-09-21T13:08:36.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:35 smithi160 ceph-mon[134450]: pgmap v386: 97 pgs: 97 active+clean; 375 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 180 op/s 2023-09-21T13:08:36.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1150915 8.75 MB/sec execute 557 sec latency 16.942 ms 2023-09-21T13:08:37.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1152260 8.75 MB/sec execute 558 sec latency 18.858 ms 2023-09-21T13:08:38.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:37 smithi156 ceph-mon[134078]: pgmap v387: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2023-09-21T13:08:38.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:37 smithi142 ceph-mon[97663]: pgmap v387: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2023-09-21T13:08:38.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:37 smithi160 ceph-mon[134450]: pgmap v387: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.4 MiB/s wr, 387 op/s 2023-09-21T13:08:38.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1154459 8.75 MB/sec execute 559 sec latency 16.746 ms 2023-09-21T13:08:39.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1155643 8.74 MB/sec execute 560 sec latency 29.242 ms 2023-09-21T13:08:40.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:39 smithi156 ceph-mon[134078]: pgmap v388: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 309 op/s 2023-09-21T13:08:40.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:39 smithi142 ceph-mon[97663]: pgmap v388: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 309 op/s 2023-09-21T13:08:40.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:39 smithi160 ceph-mon[134450]: pgmap v388: 97 pgs: 97 active+clean; 379 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.6 MiB/s wr, 309 op/s 2023-09-21T13:08:40.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1157739 8.75 MB/sec execute 561 sec latency 21.637 ms 2023-09-21T13:08:41.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:40 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:08:41.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:40 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:40 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:40 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:40 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:40 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:08:41.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:40 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:40 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:40 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:40 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:40 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:08:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:40 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:40 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:40 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.184 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:40 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:41.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1158727 8.74 MB/sec execute 562 sec latency 15.100 ms 2023-09-21T13:08:42.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 -- 172.21.15.142:0/4290960997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c101cd0 msgr2=0x7f8b2c0681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 --2- 172.21.15.142:0/4290960997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c101cd0 0x7f8b2c0681d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8b280098f0 tx=0x7f8b28009c00 comp rx=0 tx=0).stop 2023-09-21T13:08:42.124 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 -- 172.21.15.142:0/4290960997 shutdown_connections 2023-09-21T13:08:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 --2- 172.21.15.142:0/4290960997 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c101cd0 0x7f8b2c0681d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 --2- 172.21.15.142:0/4290960997 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c10d650 0x7f8b2c10fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 --2- 172.21.15.142:0/4290960997 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c068c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.125 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 -- 172.21.15.142:0/4290960997 >> 172.21.15.142:0/4290960997 conn(0x7f8b2c076800 msgr2=0x7f8b2c076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 -- 172.21.15.142:0/4290960997 shutdown_connections 2023-09-21T13:08:42.126 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.129+0000 7f8b33fff700 1 -- 172.21.15.142:0/4290960997 wait complete. 2023-09-21T13:08:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.130+0000 7f8b33fff700 1 Processor -- start 2023-09-21T13:08:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 -- start start 2023-09-21T13:08:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c10d650 0x7f8b2c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 0x7f8b2c19e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19e720 con 0x7f8b2c10d650 2023-09-21T13:08:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19e890 con 0x7f8b2c0687a0 2023-09-21T13:08:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b33fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2c19ea50 con 0x7f8b2c19dca0 2023-09-21T13:08:42.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b31d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b31d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38496/0 (socket says 172.21.15.142:38496) 2023-09-21T13:08:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b31d9b700 1 -- 172.21.15.142:0/757734163 learned_addr learned my addr 172.21.15.142:0/757734163 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.131+0000 7f8b3159a700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c10d650 0x7f8b2c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b3259c700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 0x7f8b2c19e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 -- 172.21.15.142:0/757734163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 msgr2=0x7f8b2c19e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 0x7f8b2c19e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 -- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c10d650 msgr2=0x7f8b2c199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c10d650 0x7f8b2c199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 -- 172.21.15.142:0/757734163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b28009520 con 0x7f8b2c0687a0 2023-09-21T13:08:42.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b3259c700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 0x7f8b2c19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:08:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009810 tx=0x7f8b2800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b22ffd700 1 -- 172.21.15.142:0/757734163 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b2801c070 con 0x7f8b2c0687a0 2023-09-21T13:08:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b22ffd700 1 -- 172.21.15.142:0/757734163 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b2800bbd0 con 0x7f8b2c0687a0 2023-09-21T13:08:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b2c1a5f50 con 0x7f8b2c0687a0 2023-09-21T13:08:42.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.132+0000 7f8b22ffd700 1 -- 172.21.15.142:0/757734163 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b280049c0 con 0x7f8b2c0687a0 2023-09-21T13:08:42.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.133+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b2c1a6370 con 0x7f8b2c0687a0 2023-09-21T13:08:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.136+0000 7f8b22ffd700 1 -- 172.21.15.142:0/757734163 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8b28020070 con 0x7f8b2c0687a0 2023-09-21T13:08:42.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.137+0000 7f8b47901b80 1 Processor -- start 2023-09-21T13:08:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.137+0000 7f8b47901b80 1 -- start start 2023-09-21T13:08:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb08910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fa78c40 con 0x56315fb049c0 2023-09-21T13:08:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fa5cc10 con 0x56315fb040a0 2023-09-21T13:08:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b47901b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fa5a530 con 0x56315fb08e50 2023-09-21T13:08:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38504/0 (socket says 172.21.15.142:38504) 2023-09-21T13:08:42.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 -- 172.21.15.142:0/3634820627 learned_addr learned my addr 172.21.15.142:0/3634820627 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3159a700 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb08910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 -- 172.21.15.142:0/3634820627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 msgr2=0x56315fb092b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb092b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 -- 172.21.15.142:0/3634820627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 msgr2=0x56315fb08910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb08910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b3259c700 1 -- 172.21.15.142:0/3634820627 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315f880d80 con 0x56315fb040a0 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.138+0000 7f8b22ffd700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 0x7f8b180a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b22ffd700 1 -- 172.21.15.142:0/757734163 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8b280ccc00 con 0x7f8b2c0687a0 2023-09-21T13:08:42.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b3259c700 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8b240094f0 tx=0x7f8b240099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24011168f4386b95 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b17fff700 1 -- 172.21.15.142:0/3634820627 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24007ea0 con 0x56315fb040a0 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b17fff700 1 -- 172.21.15.142:0/3634820627 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b24011040 con 0x56315fb040a0 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b17fff700 1 -- 172.21.15.142:0/3634820627 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b240149c0 con 0x56315fb040a0 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.139+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 0x7f8b180a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 -- 172.21.15.142:0/3634820627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 msgr2=0x56315fb04480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8b240094f0 tx=0x7f8b240099e0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 -- 172.21.15.142:0/3634820627 shutdown_connections 2023-09-21T13:08:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb092b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb04480 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 --2- 172.21.15.142:0/3634820627 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb08910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 -- 172.21.15.142:0/3634820627 >> 172.21.15.142:0/3634820627 conn(0x56315fa30fa0 msgr2=0x56315faff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.140+0000 7f8b47901b80 1 -- 172.21.15.142:0/3634820627 shutdown_connections 2023-09-21T13:08:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.141+0000 7f8b47901b80 1 -- 172.21.15.142:0/3634820627 wait complete. 2023-09-21T13:08:42.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.141+0000 7f8b31d9b700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 0x7f8b180a2cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8b280ca400 tx=0x7f8b28009c00 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.141+0000 7f8b47901b80 1 -- start start 2023-09-21T13:08:42.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.141+0000 7f8b47901b80 1 Processor -- start 2023-09-21T13:08:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb0d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fa55e20 con 0x56315fb049c0 2023-09-21T13:08:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315f9f26e0 con 0x56315fb040a0 2023-09-21T13:08:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315f9f2380 con 0x56315fb08e50 2023-09-21T13:08:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b47901b80 10 client.0 _ll_register_callbacks cb 0x56315f93ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b3259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b3159a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb0d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b3259c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38512/0 (socket says 172.21.15.142:38512) 2023-09-21T13:08:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b3259c700 1 -- 172.21.15.142:0/4071204955 learned_addr learned my addr 172.21.15.142:0/4071204955 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.142+0000 7f8b3259c700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 -- 172.21.15.142:0/4071204955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 msgr2=0x56315fb0dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.148 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 -- 172.21.15.142:0/4071204955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 msgr2=0x56315fb0d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb0d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 -- 172.21.15.142:0/4071204955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b240091a0 con 0x56315fb040a0 2023-09-21T13:08:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b3259c700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8b24017040 tx=0x7f8b2400d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a8d23c2e6197c41 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.149 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b157fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b24015800 con 0x56315fb040a0 2023-09-21T13:08:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56315f9c6b50 con 0x56315fb040a0 2023-09-21T13:08:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.143+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8b24015960 con 0x56315fb040a0 2023-09-21T13:08:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.144+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b24009b80 con 0x56315fb040a0 2023-09-21T13:08:42.150 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.144+0000 7f8b47901b80 10 client.27956 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.144+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x56315f869c00 con 0x56315fb040a0 2023-09-21T13:08:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.144+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56315f9c6b50 con 0x56315fb040a0 2023-09-21T13:08:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.144+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b24014070 con 0x56315fb040a0 2023-09-21T13:08:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 10 client.27956 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:42.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 10 client.27956 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 20 client.27956 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb266d0 0x56315fb28af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 4 client.27956 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56315fad2fc0 con 0x56315fb266d0 2023-09-21T13:08:42.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b3159a700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb266d0 0x56315fb28af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b157fa700 10 client.27956 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.145+0000 7f8b3159a700 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb266d0 0x56315fb28af0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17c20301259efcf5 server_cookie=3f0b5a3388717300 in_seq=0 out_seq=0 2023-09-21T13:08:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b157fa700 1 -- 172.21.15.142:0/4071204955 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56315fad2fc0 con 0x56315fb266d0 2023-09-21T13:08:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b157fa700 10 client.27956 handle_command_reply: tid=0 2023-09-21T13:08:42.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 client.27956 shutdown 2023-09-21T13:08:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 msgr2=0x56315fb10520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f8b24017040 tx=0x7f8b2400d040 comp rx=0 tx=0).stop 2023-09-21T13:08:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 shutdown_connections 2023-09-21T13:08:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb266d0 0x56315fb28af0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b157fa700 0 client.27956 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb040a0 0x56315fb10520 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4071204955 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb049c0 0x56315fb0d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.146+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 >> 172.21.15.142:0/4071204955 conn(0x56315fa30fa0 msgr2=0x56315fafe310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.147+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 shutdown_connections 2023-09-21T13:08:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.147+0000 7f8b47901b80 1 -- 172.21.15.142:0/4071204955 wait complete. 2023-09-21T13:08:42.156 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.147+0000 7f8b47901b80 20 client.27956 trim_cache size 0 max 16384 2023-09-21T13:08:42.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.165+0000 7f8b47901b80 1 Processor -- start 2023-09-21T13:08:42.160 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 -- start start 2023-09-21T13:08:42.161 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb1d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315f8d68c0 con 0x56315fb040a0 2023-09-21T13:08:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fb04dd0 con 0x56315fb049c0 2023-09-21T13:08:42.162 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b47901b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fb009b0 con 0x56315fb08e50 2023-09-21T13:08:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b3159a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b3159a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38522/0 (socket says 172.21.15.142:38522) 2023-09-21T13:08:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b3159a700 1 -- 172.21.15.142:0/4195420904 learned_addr learned my addr 172.21.15.142:0/4195420904 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:42.163 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.166+0000 7f8b3259c700 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb1d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 -- 172.21.15.142:0/4195420904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 msgr2=0x56315fb0cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 -- 172.21.15.142:0/4195420904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 msgr2=0x56315fb1d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb1d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.164 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 -- 172.21.15.142:0/4195420904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56315fb2d6e0 con 0x56315fb049c0 2023-09-21T13:08:42.165 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b3159a700 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56315fb0ed50 tx=0x7f8b1c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1184eaf514a79d71 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b20ff9700 1 -- 172.21.15.142:0/4195420904 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017030 con 0x56315fb049c0 2023-09-21T13:08:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b20ff9700 1 -- 172.21.15.142:0/4195420904 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b1c018040 con 0x56315fb049c0 2023-09-21T13:08:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.167+0000 7f8b20ff9700 1 -- 172.21.15.142:0/4195420904 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c003680 con 0x56315fb049c0 2023-09-21T13:08:42.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 -- 172.21.15.142:0/4195420904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 msgr2=0x56315fb0b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x56315fb0ed50 tx=0x7f8b1c009260 comp rx=0 tx=0).stop 2023-09-21T13:08:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 -- 172.21.15.142:0/4195420904 shutdown_connections 2023-09-21T13:08:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb1d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 --2- 172.21.15.142:0/4195420904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b210 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 -- 172.21.15.142:0/4195420904 >> 172.21.15.142:0/4195420904 conn(0x56315fa30fa0 msgr2=0x56315fb06ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.168+0000 7f8b47901b80 1 -- 172.21.15.142:0/4195420904 shutdown_connections 2023-09-21T13:08:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.169+0000 7f8b47901b80 1 -- 172.21.15.142:0/4195420904 wait complete. 2023-09-21T13:08:42.170 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.169+0000 7f8b47901b80 1 -- start start 2023-09-21T13:08:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.169+0000 7f8b47901b80 1 Processor -- start 2023-09-21T13:08:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb0af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.171 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fb0f5f0 con 0x56315fb040a0 2023-09-21T13:08:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fb0f760 con 0x56315fb049c0 2023-09-21T13:08:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56315fb0f920 con 0x56315fb08e50 2023-09-21T13:08:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b47901b80 10 client.0 _ll_register_callbacks cb 0x56315f93ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.172 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38530/0 (socket says 172.21.15.142:38530) 2023-09-21T13:08:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 -- 172.21.15.142:0/1334575857 learned_addr learned my addr 172.21.15.142:0/1334575857 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3259c700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb0af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3259c700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 -- 172.21.15.142:0/1334575857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 msgr2=0x56315fb0f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.173 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 -- 172.21.15.142:0/1334575857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 msgr2=0x56315fb0af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb0af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.170+0000 7f8b3159a700 1 -- 172.21.15.142:0/1334575857 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c010430 con 0x56315fb049c0 2023-09-21T13:08:42.174 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b3159a700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c022000 tx=0x7f8b1c010f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf83a258b8234a5d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b157fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017040 con 0x56315fb049c0 2023-09-21T13:08:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8b1c01ed90 con 0x56315fb049c0 2023-09-21T13:08:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8b24011040 con 0x56315fb049c0 2023-09-21T13:08:42.175 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8b1c004020 con 0x56315fb049c0 2023-09-21T13:08:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.171+0000 7f8b47901b80 10 client.27962 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x56315f8a71f0 con 0x56315fb049c0 2023-09-21T13:08:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b24011040 con 0x56315fb049c0 2023-09-21T13:08:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8b1c025070 con 0x56315fb049c0 2023-09-21T13:08:42.176 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 10 client.27962 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 10 client.27962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 20 client.27962 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb7b330 0x56315fb7d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 4 client.27962 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:08:42.177 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56315fa4ee00 con 0x56315fb7b330 2023-09-21T13:08:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.172+0000 7f8b3259c700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb7b330 0x56315fb7d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.173+0000 7f8b157fa700 10 client.27962 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:42.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.173+0000 7f8b3259c700 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb7b330 0x56315fb7d750 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8c8fde54409a62b server_cookie=dcc10deb19f0fb81 in_seq=0 out_seq=0 2023-09-21T13:08:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.235+0000 7f8b157fa700 1 -- 172.21.15.142:0/1334575857 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56315fa4ee00 con 0x56315fb7b330 2023-09-21T13:08:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.235+0000 7f8b157fa700 10 client.27962 handle_command_reply: tid=0 2023-09-21T13:08:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.235+0000 7f8b47901b80 1 client.27962 shutdown 2023-09-21T13:08:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.235+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 msgr2=0x56315fb0b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.235+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c022000 tx=0x7f8b1c010f80 comp rx=0 tx=0).stop 2023-09-21T13:08:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 shutdown_connections 2023-09-21T13:08:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56315fb7b330 0x56315fb7d750 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56315fb040a0 0x56315fb0af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56315fb08e50 0x56315fb0f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 --2- 172.21.15.142:0/1334575857 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56315fb049c0 0x56315fb0b480 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 >> 172.21.15.142:0/1334575857 conn(0x56315fa30fa0 msgr2=0x56315fb09230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b157fa700 0 client.27962 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 shutdown_connections 2023-09-21T13:08:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 1 -- 172.21.15.142:0/1334575857 wait complete. 2023-09-21T13:08:42.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.236+0000 7f8b47901b80 20 client.27962 trim_cache size 0 max 16384 2023-09-21T13:08:42.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:08:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:08:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:08:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:08:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.237+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 msgr2=0x7f8b180a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.237+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 0x7f8b180a2cf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8b280ca400 tx=0x7f8b28009c00 comp rx=0 tx=0).stop 2023-09-21T13:08:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.237+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 msgr2=0x7f8b2c1990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.237+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009810 tx=0x7f8b2800fa00 comp rx=0 tx=0).stop 2023-09-21T13:08:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 shutdown_connections 2023-09-21T13:08:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8b180a0830 0x7f8b180a2cf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b2c19dca0 0x7f8b2c19e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8b2c0687a0 0x7f8b2c1990f0 secure :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8b28009810 tx=0x7f8b2800fa00 comp rx=0 tx=0).stop 2023-09-21T13:08:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 --2- 172.21.15.142:0/757734163 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8b2c10d650 0x7f8b2c199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.238+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 >> 172.21.15.142:0/757734163 conn(0x7f8b2c076800 msgr2=0x7f8b2c0feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.241+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 shutdown_connections 2023-09-21T13:08:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:42.241+0000 7f8b33fff700 1 -- 172.21.15.142:0/757734163 wait complete. 2023-09-21T13:08:42.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: pgmap v389: 97 pgs: 97 active+clean; 384 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2023-09-21T13:08:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:08:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:08:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:41 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: pgmap v389: 97 pgs: 97 active+clean; 384 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2023-09-21T13:08:42.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:08:42.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:08:42.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:41 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: pgmap v389: 97 pgs: 97 active+clean; 384 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 6.1 MiB/s wr, 344 op/s 2023-09-21T13:08:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:08:42.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:08:42.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:41 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:08:42.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1160684 8.75 MB/sec execute 563 sec latency 36.999 ms 2023-09-21T13:08:43.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1162062 8.75 MB/sec execute 564 sec latency 11.857 ms 2023-09-21T13:08:44.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:43 smithi156 ceph-mon[134078]: pgmap v390: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2023-09-21T13:08:44.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:43 smithi142 ceph-mon[97663]: pgmap v390: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2023-09-21T13:08:44.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:43 smithi160 ceph-mon[134450]: pgmap v390: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.0 MiB/s wr, 314 op/s 2023-09-21T13:08:44.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1163917 8.74 MB/sec execute 565 sec latency 30.059 ms 2023-09-21T13:08:45.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1165475 8.75 MB/sec execute 566 sec latency 18.749 ms 2023-09-21T13:08:46.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:45 smithi156 ceph-mon[134078]: pgmap v391: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 286 op/s 2023-09-21T13:08:46.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:45 smithi142 ceph-mon[97663]: pgmap v391: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 286 op/s 2023-09-21T13:08:46.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:45 smithi160 ceph-mon[134450]: pgmap v391: 97 pgs: 97 active+clean; 388 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 5.8 MiB/s wr, 286 op/s 2023-09-21T13:08:46.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1167424 8.75 MB/sec execute 567 sec latency 21.941 ms 2023-09-21T13:08:47.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1168966 8.75 MB/sec execute 568 sec latency 14.510 ms 2023-09-21T13:08:48.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:47 smithi156 ceph-mon[134078]: pgmap v392: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 389 op/s 2023-09-21T13:08:48.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:47 smithi142 ceph-mon[97663]: pgmap v392: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 389 op/s 2023-09-21T13:08:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:47 smithi160 ceph-mon[134450]: pgmap v392: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 6.6 MiB/s wr, 389 op/s 2023-09-21T13:08:48.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1170768 8.75 MB/sec execute 569 sec latency 17.653 ms 2023-09-21T13:08:49.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1172396 8.75 MB/sec execute 570 sec latency 31.275 ms 2023-09-21T13:08:49.717 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:08:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 -- 172.21.15.142:0/656864343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768100880 msgr2=0x7f37681048c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 --2- 172.21.15.142:0/656864343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768100880 0x7f37681048c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f375c0098f0 tx=0x7f375c009c00 comp rx=0 tx=0).stop 2023-09-21T13:08:49.971 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 -- 172.21.15.142:0/656864343 shutdown_connections 2023-09-21T13:08:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 --2- 172.21.15.142:0/656864343 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3768104ff0 0x7f376810cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 --2- 172.21.15.142:0/656864343 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f37680ffed0 0x7f37681002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 --2- 172.21.15.142:0/656864343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768100880 0x7f37681048c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.972 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.975+0000 7f376d5ff700 1 -- 172.21.15.142:0/656864343 >> 172.21.15.142:0/656864343 conn(0x7f37680fb730 msgr2=0x7f37680fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:49.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.976+0000 7f376d5ff700 1 -- 172.21.15.142:0/656864343 shutdown_connections 2023-09-21T13:08:49.973 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.976+0000 7f376d5ff700 1 -- 172.21.15.142:0/656864343 wait complete. 2023-09-21T13:08:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.977+0000 7f376d5ff700 1 Processor -- start 2023-09-21T13:08:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.977+0000 7f376d5ff700 1 -- start start 2023-09-21T13:08:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.977+0000 7f376d5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37680ffed0 0x7f3768197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.975 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f376d5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f376d5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 0x7f37681a2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f376d5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37681a3640 con 0x7f37680ffed0 2023-09-21T13:08:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f376d5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37681a37b0 con 0x7f3768198960 2023-09-21T13:08:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f376d5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37681a3970 con 0x7f3768104ff0 2023-09-21T13:08:49.976 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60956/0 (socket says 172.21.15.142:60956) 2023-09-21T13:08:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 -- 172.21.15.142:0/2045412265 learned_addr learned my addr 172.21.15.142:0/2045412265 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37680ffed0 0x7f3768197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37677fe700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 0x7f37681a2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.977 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 -- 172.21.15.142:0/2045412265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 msgr2=0x7f37681a2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:49.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 0x7f37681a2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 -- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37680ffed0 msgr2=0x7f3768197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:49.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37680ffed0 0x7f3768197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 -- 172.21.15.142:0/2045412265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c009520 con 0x7f3768104ff0 2023-09-21T13:08:49.978 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37677fe700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 0x7f37681a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:08:49.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.978+0000 7f37667fc700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f375c009fd0 tx=0x7f375c00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:49.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.979+0000 7f374ffff700 1 -- 172.21.15.142:0/2045412265 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c01c070 con 0x7f3768104ff0 2023-09-21T13:08:49.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.979+0000 7f374ffff700 1 -- 172.21.15.142:0/2045412265 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f375c005040 con 0x7f3768104ff0 2023-09-21T13:08:49.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.979+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37681a3bf0 con 0x7f3768104ff0 2023-09-21T13:08:49.979 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.979+0000 7f374ffff700 1 -- 172.21.15.142:0/2045412265 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c004950 con 0x7f3768104ff0 2023-09-21T13:08:49.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.979+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37681a4070 con 0x7f3768104ff0 2023-09-21T13:08:49.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.983+0000 7f374ffff700 1 -- 172.21.15.142:0/2045412265 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f375c020070 con 0x7f3768104ff0 2023-09-21T13:08:49.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.984+0000 7f374ffff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 0x7f37500a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.984+0000 7f374ffff700 1 -- 172.21.15.142:0/2045412265 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f375c0ccbe0 con 0x7f3768104ff0 2023-09-21T13:08:49.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 0x7f37500a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3780f21b80 1 Processor -- start 2023-09-21T13:08:49.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3780f21b80 1 -- start start 2023-09-21T13:08:49.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 0x7f37500a2cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3758005fd0 tx=0x7f3758009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:49.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f740e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.985+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f7417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3780f21b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f6b0ca0 con 0x55f74f741360 2023-09-21T13:08:49.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3780f21b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f694c70 con 0x55f74f73c610 2023-09-21T13:08:49.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3780f21b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f692590 con 0x55f74f73cf30 2023-09-21T13:08:49.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33374/0 (socket says 172.21.15.142:33374) 2023-09-21T13:08:49.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 -- 172.21.15.142:0/3933026722 learned_addr learned my addr 172.21.15.142:0/3933026722 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f37667fc700 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f740e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f37677fe700 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f7417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 -- 172.21.15.142:0/3933026722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 msgr2=0x55f74f740e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f740e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 -- 172.21.15.142:0/3933026722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 msgr2=0x55f74f7417c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:49.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f7417c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 -- 172.21.15.142:0/3933026722 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74f4b8de0 con 0x55f74f73c610 2023-09-21T13:08:49.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.986+0000 7f3766ffd700 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f37580041d0 tx=0x7f3758014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13b59a662081295a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:49.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.987+0000 7f374d7fa700 1 -- 172.21.15.142:0/3933026722 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758003d10 con 0x55f74f73c610 2023-09-21T13:08:49.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.987+0000 7f374d7fa700 1 -- 172.21.15.142:0/3933026722 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3758004590 con 0x55f74f73c610 2023-09-21T13:08:49.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.987+0000 7f374d7fa700 1 -- 172.21.15.142:0/3933026722 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758005630 con 0x55f74f73c610 2023-09-21T13:08:49.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- 172.21.15.142:0/3933026722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 msgr2=0x55f74f73c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:49.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f37580041d0 tx=0x7f3758014000 comp rx=0 tx=0).stop 2023-09-21T13:08:49.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- 172.21.15.142:0/3933026722 shutdown_connections 2023-09-21T13:08:49.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f7417c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73c610 0x55f74f73c9f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3933026722 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f740e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- 172.21.15.142:0/3933026722 >> 172.21.15.142:0/3933026722 conn(0x55f74f669000 msgr2=0x55f74f7376a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:49.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- 172.21.15.142:0/3933026722 shutdown_connections 2023-09-21T13:08:49.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- 172.21.15.142:0/3933026722 wait complete. 2023-09-21T13:08:49.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.988+0000 7f3780f21b80 1 -- start start 2023-09-21T13:08:49.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 Processor -- start 2023-09-21T13:08:49.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 0x55f74f745e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f746580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f68de80 con 0x55f74f73cf30 2023-09-21T13:08:49.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f62a740 con 0x55f74f741360 2023-09-21T13:08:49.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f62a3e0 con 0x55f74f73c610 2023-09-21T13:08:49.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.989+0000 7f3780f21b80 10 client.0 _ll_register_callbacks cb 0x55f74f574a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:49.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60972/0 (socket says 172.21.15.142:60972) 2023-09-21T13:08:49.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 -- 172.21.15.142:0/1047413811 learned_addr learned my addr 172.21.15.142:0/1047413811 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:49.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f37677fe700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f746580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 -- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 msgr2=0x55f74f746580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:49.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f746580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 -- 172.21.15.142:0/1047413811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 msgr2=0x55f74f745e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:49.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f37667fc700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 0x55f74f745e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 0x55f74f745e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:49.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 -- 172.21.15.142:0/1047413811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3758017070 con 0x55f74f73c610 2023-09-21T13:08:49.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f37667fc700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 0x55f74f745e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:08:49.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f3766ffd700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3758005400 tx=0x7f37580054e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a413b108814b3b73 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:49.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.990+0000 7f374aff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375802c070 con 0x55f74f73c610 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f74f70b020 con 0x55f74f73c610 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3758009e60 con 0x55f74f73c610 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37580047a0 con 0x55f74f73c610 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f3780f21b80 10 client.27913 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:49.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55f74f4a1c60 con 0x55f74f73c610 2023-09-21T13:08:49.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.991+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f375803d080 con 0x55f74f73c610 2023-09-21T13:08:49.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3758037030 con 0x55f74f73c610 2023-09-21T13:08:49.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 10 client.27913 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:49.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 10 client.27913 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:49.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 20 client.27913 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:49.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f75a7e0 0x55f74f75cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:49.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 4 client.27913 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:49.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f74f686e60 con 0x55f74f75a7e0 2023-09-21T13:08:49.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.992+0000 7f37667fc700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f75a7e0 0x55f74f75cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:49.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f374aff5700 10 client.27913 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:50.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f37667fc700 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f75a7e0 0x55f74f75cbd0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a6d69cd80c610d8 server_cookie=a2bb7768784db1d2 in_seq=0 out_seq=0 2023-09-21T13:08:50.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f374aff5700 1 -- 172.21.15.142:0/1047413811 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f74f686e60 con 0x55f74f75a7e0 2023-09-21T13:08:50.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f374aff5700 10 client.27913 handle_command_reply: tid=0 2023-09-21T13:08:50.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f3780f21b80 1 client.27913 shutdown 2023-09-21T13:08:50.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 msgr2=0x55f74f748b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:50.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.993+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3758005400 tx=0x7f37580054e0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 shutdown_connections 2023-09-21T13:08:50.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f75a7e0 0x55f74f75cbd0 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f746580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f748b50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f374aff5700 0 client.27913 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:50.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 --2- 172.21.15.142:0/1047413811 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73cf30 0x55f74f745e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 >> 172.21.15.142:0/1047413811 conn(0x55f74f669000 msgr2=0x55f74f737290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:50.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 shutdown_connections 2023-09-21T13:08:50.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 1 -- 172.21.15.142:0/1047413811 wait complete. 2023-09-21T13:08:50.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:49.994+0000 7f3780f21b80 20 client.27913 trim_cache size 0 max 16384 2023-09-21T13:08:50.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.013+0000 7f3780f21b80 1 Processor -- start 2023-09-21T13:08:50.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.013+0000 7f3780f21b80 1 -- start start 2023-09-21T13:08:50.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f73ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f742750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f50e920 con 0x55f74f741360 2023-09-21T13:08:50.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f731990 con 0x55f74f73cf30 2023-09-21T13:08:50.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3780f21b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f74da50 con 0x55f74f73c610 2023-09-21T13:08:50.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f37667fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f37667fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33388/0 (socket says 172.21.15.142:33388) 2023-09-21T13:08:50.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f37667fc700 1 -- 172.21.15.142:0/3432861505 learned_addr learned my addr 172.21.15.142:0/3432861505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:50.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f3766ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f73ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.014+0000 7f37677fe700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f742750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 -- 172.21.15.142:0/3432861505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 msgr2=0x55f74f73ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:50.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f73ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 -- 172.21.15.142:0/3432861505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 msgr2=0x55f74f742750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:50.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f742750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 -- 172.21.15.142:0/3432861505 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f74f4df250 con 0x55f74f73cf30 2023-09-21T13:08:50.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f3766ffd700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f73ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:50.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37677fe700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f742750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:08:50.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f37667fc700 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ca390 tx=0x7f375c0a0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebe4898a227565b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:50.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f374dffb700 1 -- 172.21.15.142:0/3432861505 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0a2220 con 0x55f74f73cf30 2023-09-21T13:08:50.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f374dffb700 1 -- 172.21.15.142:0/3432861505 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f375c0a00b0 con 0x55f74f73cf30 2023-09-21T13:08:50.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.015+0000 7f374dffb700 1 -- 172.21.15.142:0/3432861505 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c09a4a0 con 0x55f74f73cf30 2023-09-21T13:08:50.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- 172.21.15.142:0/3432861505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 msgr2=0x55f74f74d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:50.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f375c0ca390 tx=0x7f375c0a0040 comp rx=0 tx=0).stop 2023-09-21T13:08:50.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- 172.21.15.142:0/3432861505 shutdown_connections 2023-09-21T13:08:50.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f741360 0x55f74f742750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.018 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73c610 0x55f74f73ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 --2- 172.21.15.142:0/3432861505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f73cf30 0x55f74f74d510 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- 172.21.15.142:0/3432861505 >> 172.21.15.142:0/3432861505 conn(0x55f74f669000 msgr2=0x55f74f73f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:50.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- 172.21.15.142:0/3432861505 shutdown_connections 2023-09-21T13:08:50.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- 172.21.15.142:0/3432861505 wait complete. 2023-09-21T13:08:50.019 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.016+0000 7f3780f21b80 1 -- start start 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.017+0000 7f3780f21b80 1 Processor -- start 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.017+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73c610 0x55f74f7457e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f744610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f744d20 con 0x55f74f73c610 2023-09-21T13:08:50.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f744e90 con 0x55f74f741360 2023-09-21T13:08:50.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f74f745050 con 0x55f74f73cf30 2023-09-21T13:08:50.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3780f21b80 10 client.0 _ll_register_callbacks cb 0x55f74f574a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:50.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:60988/0 (socket says 172.21.15.142:60988) 2023-09-21T13:08:50.021 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 -- 172.21.15.142:0/2523923879 learned_addr learned my addr 172.21.15.142:0/2523923879 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:50.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73c610 0x55f74f7457e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37677fe700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f744610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 -- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 msgr2=0x55f74f744610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:50.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f744610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.022 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 -- 172.21.15.142:0/2523923879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73c610 msgr2=0x55f74f7457e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:50.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73c610 0x55f74f7457e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.018+0000 7f37667fc700 1 -- 172.21.15.142:0/2523923879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f74f4a1c60 con 0x55f74f73cf30 2023-09-21T13:08:50.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f37667fc700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f375c096cb0 tx=0x7f375c00b2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=972a05ca331eb2a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:50.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:50.023 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0a2220 con 0x55f74f73cf30 2023-09-21T13:08:50.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f74f5febb0 con 0x55f74f73cf30 2023-09-21T13:08:50.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f375c005490 con 0x55f74f73cf30 2023-09-21T13:08:50.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f375c005650 con 0x55f74f73cf30 2023-09-21T13:08:50.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 10 client.27919 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:50.024 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7f37681a4070 con 0x55f74f73cf30 2023-09-21T13:08:50.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f74f5febb0 con 0x55f74f73cf30 2023-09-21T13:08:50.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f375c07b070 con 0x55f74f73cf30 2023-09-21T13:08:50.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 10 client.27919 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:50.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 10 client.27919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:50.025 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 20 client.27919 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:50.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f7af370 0x55f74f7b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:50.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 4 client.27919 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:08:50.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.019+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f74f686b80 con 0x55f74f7af370 2023-09-21T13:08:50.026 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.020+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f7af370 0x55f74f7b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.020+0000 7f374aff5700 10 client.27919 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.020+0000 7f3766ffd700 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f7af370 0x55f74f7b1790 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e419d083252d0afa server_cookie=aeaabe49dcbd9fbf in_seq=0 out_seq=0 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.020+0000 7f374aff5700 1 -- 172.21.15.142:0/2523923879 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f74f686b80 con 0x55f74f7af370 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.020+0000 7f374aff5700 10 client.27919 handle_command_reply: tid=0 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 client.27919 shutdown 2023-09-21T13:08:50.027 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 msgr2=0x55f74f745d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:50.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f375c096cb0 tx=0x7f375c00b2e0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 shutdown_connections 2023-09-21T13:08:50.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f74f7af370 0x55f74f7b1790 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f74f73c610 0x55f74f7457e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.028 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f74f741360 0x55f74f744610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f374aff5700 0 client.27919 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 --2- 172.21.15.142:0/2523923879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f74f73cf30 0x55f74f745d20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 >> 172.21.15.142:0/2523923879 conn(0x55f74f669000 msgr2=0x55f74f740450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 shutdown_connections 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 1 -- 172.21.15.142:0/2523923879 wait complete. 2023-09-21T13:08:50.029 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.021+0000 7f3780f21b80 20 client.27919 trim_cache size 0 max 16384 2023-09-21T13:08:50.030 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:08:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:08:50.030 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:08:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:08:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:08:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:08:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:08:50.031 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:08:50.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:08:50.032 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:08:50.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 msgr2=0x7f37500a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:50.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 0x7f37500a2cf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3758005fd0 tx=0x7f3758009310 comp rx=0 tx=0).stop 2023-09-21T13:08:50.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 msgr2=0x7f3768198380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:50.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f375c009fd0 tx=0x7f375c00fa00 comp rx=0 tx=0).stop 2023-09-21T13:08:50.033 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 shutdown_connections 2023-09-21T13:08:50.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f37500a0830 0x7f37500a2cf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f37680ffed0 0x7f3768197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3768198960 0x7f37681a2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.034 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 --2- 172.21.15.142:0/2045412265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3768104ff0 0x7f3768198380 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:50.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 >> 172.21.15.142:0/2045412265 conn(0x7f37680fb730 msgr2=0x7f37680fc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:50.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 shutdown_connections 2023-09-21T13:08:50.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:08:50.022+0000 7f376d5ff700 1 -- 172.21.15.142:0/2045412265 wait complete. 2023-09-21T13:08:50.038 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:08:50.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:49 smithi142 ceph-mon[97663]: pgmap v393: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 182 op/s 2023-09-21T13:08:50.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:49 smithi156 ceph-mon[134078]: pgmap v393: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 182 op/s 2023-09-21T13:08:50.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:49 smithi160 ceph-mon[134450]: pgmap v393: 97 pgs: 97 active+clean; 383 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 182 op/s 2023-09-21T13:08:50.710 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1173731 8.75 MB/sec execute 571 sec latency 19.774 ms 2023-09-21T13:08:51.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1175871 8.76 MB/sec execute 572 sec latency 18.877 ms 2023-09-21T13:08:52.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:51 smithi156 ceph-mon[134078]: pgmap v394: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-21T13:08:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:51 smithi142 ceph-mon[97663]: pgmap v394: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-21T13:08:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:51 smithi160 ceph-mon[134450]: pgmap v394: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 256 op/s 2023-09-21T13:08:52.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1177216 8.75 MB/sec execute 573 sec latency 16.342 ms 2023-09-21T13:08:53.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1179414 8.76 MB/sec execute 574 sec latency 17.022 ms 2023-09-21T13:08:54.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:53 smithi156 ceph-mon[134078]: pgmap v395: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2023-09-21T13:08:54.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:53 smithi142 ceph-mon[97663]: pgmap v395: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2023-09-21T13:08:54.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:53 smithi160 ceph-mon[134450]: pgmap v395: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 226 op/s 2023-09-21T13:08:54.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1180706 8.75 MB/sec execute 575 sec latency 16.598 ms 2023-09-21T13:08:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 -- 172.21.15.142:0/608290734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 msgr2=0x7f232c105e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 --2- 172.21.15.142:0/608290734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c105e80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f231c009990 tx=0x7f231c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 -- 172.21.15.142:0/608290734 shutdown_connections 2023-09-21T13:08:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 --2- 172.21.15.142:0/608290734 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 0x7f232c10c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 --2- 172.21.15.142:0/608290734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c105e80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 --2- 172.21.15.142:0/608290734 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 0x7f232c100120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 -- 172.21.15.142:0/608290734 >> 172.21.15.142:0/608290734 conn(0x7f232c0765a0 msgr2=0x7f232c0769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 -- 172.21.15.142:0/608290734 shutdown_connections 2023-09-21T13:08:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.420+0000 7f23309fe700 1 -- 172.21.15.142:0/608290734 wait complete. 2023-09-21T13:08:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.421+0000 7f23309fe700 1 Processor -- start 2023-09-21T13:08:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.421+0000 7f23309fe700 1 -- start start 2023-09-21T13:08:55.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 0x7f232c196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 0x7f232c197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19abb0 con 0x7f232c0ffca0 2023-09-21T13:08:55.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19ad20 con 0x7f232c100660 2023-09-21T13:08:55.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f23309fe700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c19aee0 con 0x7f232c105aa0 2023-09-21T13:08:55.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 0x7f232c196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:37744/0 (socket says 172.21.15.142:37744) 2023-09-21T13:08:55.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 -- 172.21.15.142:0/2640232509 learned_addr learned my addr 172.21.15.142:0/2640232509 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232a59c700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 0x7f232c197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 -- 172.21.15.142:0/2640232509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 msgr2=0x7f232c197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 0x7f232c197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 -- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 msgr2=0x7f232c196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 0x7f232c196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.422+0000 7f232b59e700 1 -- 172.21.15.142:0/2640232509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c0095f0 con 0x7f232c105aa0 2023-09-21T13:08:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f232b59e700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f232400ef30 tx=0x7f232400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f2313fff700 1 -- 172.21.15.142:0/2640232509 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324018070 con 0x7f232c105aa0 2023-09-21T13:08:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f2313fff700 1 -- 172.21.15.142:0/2640232509 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f232400f040 con 0x7f232c105aa0 2023-09-21T13:08:55.423 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f2313fff700 1 -- 172.21.15.142:0/2640232509 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232400cd00 con 0x7f232c105aa0 2023-09-21T13:08:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c19b160 con 0x7f232c105aa0 2023-09-21T13:08:55.424 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.423+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c101770 con 0x7f232c105aa0 2023-09-21T13:08:55.426 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.427+0000 7f2313fff700 1 -- 172.21.15.142:0/2640232509 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f2324003a00 con 0x7f232c105aa0 2023-09-21T13:08:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.428+0000 7f2344c0cb80 1 Processor -- start 2023-09-21T13:08:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.428+0000 7f2344c0cb80 1 -- start start 2023-09-21T13:08:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2313fff700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 0x7f23140a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.427 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dcd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcd780 0x55f6b7dc7260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7d3bc40 con 0x55f6b7dcce60 2023-09-21T13:08:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7d1fc10 con 0x55f6b7dc77a0 2023-09-21T13:08:55.428 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7d1d530 con 0x55f6b7dcd780 2023-09-21T13:08:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f2313fff700 1 -- 172.21.15.142:0/2640232509 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f23240cb9f0 con 0x7f232c105aa0 2023-09-21T13:08:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232a59c700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 0x7f23140a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dcd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.429 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:32850/0 (socket says 172.21.15.142:32850) 2023-09-21T13:08:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232b59e700 1 -- 172.21.15.142:0/3591611325 learned_addr learned my addr 172.21.15.142:0/3591611325 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.429+0000 7f232a59c700 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcd780 0x55f6b7dc7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 -- 172.21.15.142:0/3591611325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcd780 msgr2=0x55f6b7dc7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcd780 0x55f6b7dc7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 -- 172.21.15.142:0/3591611325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 msgr2=0x55f6b7dcd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dcd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 -- 172.21.15.142:0/3591611325 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b7b43d80 con 0x55f6b7dc77a0 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232b59e700 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f23240a0980 tx=0x7f2324098a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53336ec2de8d294f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f232a59c700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 0x7f23140a2cf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f232c198290 tx=0x7f2320010c00 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f23117fa700 1 -- 172.21.15.142:0/3591611325 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232401b320 con 0x55f6b7dc77a0 2023-09-21T13:08:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f23117fa700 1 -- 172.21.15.142:0/3591611325 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23240995d0 con 0x55f6b7dc77a0 2023-09-21T13:08:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.430+0000 7f23117fa700 1 -- 172.21.15.142:0/3591611325 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23240a0eb0 con 0x55f6b7dc77a0 2023-09-21T13:08:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3591611325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 msgr2=0x55f6b7dc7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f23240a0980 tx=0x7f2324098a10 comp rx=0 tx=0).stop 2023-09-21T13:08:55.432 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3591611325 shutdown_connections 2023-09-21T13:08:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dcd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dc7be0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3591611325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcd780 0x55f6b7dc7260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3591611325 >> 172.21.15.142:0/3591611325 conn(0x55f6b7cf3fa0 msgr2=0x55f6b7dc2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.433 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3591611325 shutdown_connections 2023-09-21T13:08:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.431+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3591611325 wait complete. 2023-09-21T13:08:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.432+0000 7f2344c0cb80 1 -- start start 2023-09-21T13:08:55.434 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.432+0000 7f2344c0cb80 1 Processor -- start 2023-09-21T13:08:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.437 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7d18e20 con 0x55f6b7dc77a0 2023-09-21T13:08:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7cb56e0 con 0x55f6b7dcd780 2023-09-21T13:08:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7cb5380 con 0x55f6b7dcce60 2023-09-21T13:08:55.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f2344c0cb80 10 client.0 _ll_register_callbacks cb 0x55f6b7bffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36468/0 (socket says 172.21.15.142:36468) 2023-09-21T13:08:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f232ad9d700 1 -- 172.21.15.142:0/2893609065 learned_addr learned my addr 172.21.15.142:0/2893609065 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f232a59c700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.433+0000 7f232b59e700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 -- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 msgr2=0x55f6b7dd1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 -- 172.21.15.142:0/2893609065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 msgr2=0x55f6b7dd0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 -- 172.21.15.142:0/2893609065 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c101770 con 0x55f6b7dcce60 2023-09-21T13:08:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232ad9d700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f232a59c700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd1000 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55f6b7dcdc00 tx=0x7f23200047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67f6e0cce2679525 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f230eff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:08:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2320021dc0 con 0x55f6b7dcce60 2023-09-21T13:08:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f6b7c89b50 con 0x55f6b7dcce60 2023-09-21T13:08:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.434+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f2320004020 con 0x55f6b7dcce60 2023-09-21T13:08:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2320010950 con 0x55f6b7dcce60 2023-09-21T13:08:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 10 client.27931 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55f6b7b2cc00 con 0x55f6b7dcce60 2023-09-21T13:08:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2320037080 con 0x55f6b7dcce60 2023-09-21T13:08:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2320003680 con 0x55f6b7dcce60 2023-09-21T13:08:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 10 client.27931 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 10 client.27931 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:55.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 20 client.27931 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7de11e0 0x55f6b7de3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 4 client.27931 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:08:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.435+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f6b7d95fc0 con 0x55f6b7de11e0 2023-09-21T13:08:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.436+0000 7f232ad9d700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7de11e0 0x55f6b7de3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.436+0000 7f230eff5700 10 client.27931 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.436+0000 7f232ad9d700 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7de11e0 0x55f6b7de3600 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a89cfa4b118d82a server_cookie=d4546acc9310eee6 in_seq=0 out_seq=0 2023-09-21T13:08:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f230eff5700 1 -- 172.21.15.142:0/2893609065 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f6b7d95fc0 con 0x55f6b7de11e0 2023-09-21T13:08:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f230eff5700 10 client.27931 handle_command_reply: tid=0 2023-09-21T13:08:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 client.27931 shutdown 2023-09-21T13:08:55.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 msgr2=0x55f6b7dd1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd1000 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x55f6b7dcdc00 tx=0x7f23200047c0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 shutdown_connections 2023-09-21T13:08:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7de11e0 0x55f6b7de3600 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/2893609065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd1000 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f230eff5700 0 client.27931 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.437+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 >> 172.21.15.142:0/2893609065 conn(0x55f6b7cf3fa0 msgr2=0x55f6b7dc1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.438+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 shutdown_connections 2023-09-21T13:08:55.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.438+0000 7f2344c0cb80 1 -- 172.21.15.142:0/2893609065 wait complete. 2023-09-21T13:08:55.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.438+0000 7f2344c0cb80 20 client.27931 trim_cache size 0 max 16384 2023-09-21T13:08:55.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.464+0000 7f2344c0cb80 1 Processor -- start 2023-09-21T13:08:55.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 -- start start 2023-09-21T13:08:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7b998c0 con 0x55f6b7dcce60 2023-09-21T13:08:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7dd8780 con 0x55f6b7dcd780 2023-09-21T13:08:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.465+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7dd0080 con 0x55f6b7dc77a0 2023-09-21T13:08:55.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:32872/0 (socket says 172.21.15.142:32872) 2023-09-21T13:08:55.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 -- 172.21.15.142:0/3692279101 learned_addr learned my addr 172.21.15.142:0/3692279101 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 -- 172.21.15.142:0/3692279101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dc77a0 msgr2=0x55f6b7dd81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 -- 172.21.15.142:0/3692279101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 msgr2=0x55f6b7dd0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.466+0000 7f232b59e700 1 -- 172.21.15.142:0/3692279101 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f6b7b6a1f0 con 0x55f6b7dcd780 2023-09-21T13:08:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.467+0000 7f232b59e700 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23240953d0 tx=0x7f2324098930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca251d5fecc5fd97 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.467+0000 7f2311ffb700 1 -- 172.21.15.142:0/3692279101 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232401b320 con 0x55f6b7dcd780 2023-09-21T13:08:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.467+0000 7f2311ffb700 1 -- 172.21.15.142:0/3692279101 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f232400ce60 con 0x55f6b7dcd780 2023-09-21T13:08:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.467+0000 7f2311ffb700 1 -- 172.21.15.142:0/3692279101 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324099390 con 0x55f6b7dcd780 2023-09-21T13:08:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3692279101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 msgr2=0x55f6b7dd0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23240953d0 tx=0x7f2324098930 comp rx=0 tx=0).stop 2023-09-21T13:08:55.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3692279101 shutdown_connections 2023-09-21T13:08:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd0fc0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/3692279101 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.468+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3692279101 >> 172.21.15.142:0/3692279101 conn(0x55f6b7cf3fa0 msgr2=0x55f6b7dcacb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.469+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3692279101 shutdown_connections 2023-09-21T13:08:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.469+0000 7f2344c0cb80 1 -- 172.21.15.142:0/3692279101 wait complete. 2023-09-21T13:08:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.469+0000 7f2344c0cb80 1 -- start start 2023-09-21T13:08:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.470+0000 7f2344c0cb80 1 Processor -- start 2023-09-21T13:08:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd65f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7dd7400 con 0x55f6b7dc77a0 2023-09-21T13:08:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7e3d850 con 0x55f6b7dcd780 2023-09-21T13:08:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f6b7e3d990 con 0x55f6b7dcce60 2023-09-21T13:08:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f2344c0cb80 10 client.0 _ll_register_callbacks cb 0x55f6b7bffa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:08:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f232ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:36486/0 (socket says 172.21.15.142:36486) 2023-09-21T13:08:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f232ad9d700 1 -- 172.21.15.142:0/978941978 learned_addr learned my addr 172.21.15.142:0/978941978 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:08:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.471+0000 7f232b59e700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232a59c700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232b59e700 1 -- 172.21.15.142:0/978941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 msgr2=0x55f6b7dd65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232b59e700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232b59e700 1 -- 172.21.15.142:0/978941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 msgr2=0x55f6b7dd8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:08:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232b59e700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232b59e700 1 -- 172.21.15.142:0/978941978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f6b7b43d80 con 0x55f6b7dcd780 2023-09-21T13:08:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.472+0000 7f232ad9d700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:08:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.473+0000 7f232b59e700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd6d30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f232400c6f0 tx=0x7f2324099740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70a7ea937d9504f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:08:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.473+0000 7f230eff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:08:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.473+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324098ed0 con 0x55f6b7dcd780 2023-09-21T13:08:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.473+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f232409cd00 con 0x55f6b7dcd780 2023-09-21T13:08:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.473+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23240995d0 con 0x55f6b7dcd780 2023-09-21T13:08:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.474+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23240a0eb0 con 0x55f6b7dcd780 2023-09-21T13:08:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.474+0000 7f2344c0cb80 10 client.27998 fetch_fsmap learned FSMap version 42 2023-09-21T13:08:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.474+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55f6b7b42250 con 0x55f6b7dcd780 2023-09-21T13:08:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.475+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f23240995d0 con 0x55f6b7dcd780 2023-09-21T13:08:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.475+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2324094cc0 con 0x55f6b7dcd780 2023-09-21T13:08:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.475+0000 7f2344c0cb80 10 client.27998 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:08:55.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.475+0000 7f2344c0cb80 10 client.27998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:08:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.475+0000 7f2344c0cb80 20 client.27998 populate_metadata read hostname 'smithi142' 2023-09-21T13:08:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.476+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7e3eb70 0x55f6b7e40f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:08:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.476+0000 7f2344c0cb80 4 client.27998 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:08:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.476+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f6b7d11e00 con 0x55f6b7e3eb70 2023-09-21T13:08:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.477+0000 7f232ad9d700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7e3eb70 0x55f6b7e40f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:08:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.478+0000 7f232ad9d700 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7e3eb70 0x55f6b7e40f60 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b6f19f308b9b7 server_cookie=3f85cd1c54a3a432 in_seq=0 out_seq=0 2023-09-21T13:08:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.478+0000 7f230eff5700 10 client.27998 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:55.557 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f230eff5700 1 -- 172.21.15.142:0/978941978 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f6b7d11e00 con 0x55f6b7e3eb70 2023-09-21T13:08:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f230eff5700 10 client.27998 handle_command_reply: tid=0 2023-09-21T13:08:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 client.27998 shutdown 2023-09-21T13:08:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 msgr2=0x55f6b7dd6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd6d30 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f232400c6f0 tx=0x7f2324099740 comp rx=0 tx=0).stop 2023-09-21T13:08:55.558 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 shutdown_connections 2023-09-21T13:08:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55f6b7e3eb70 0x55f6b7e40f60 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55f6b7dc77a0 0x55f6b7dd8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55f6b7dcd780 0x55f6b7dd6d30 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 --2- 172.21.15.142:0/978941978 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55f6b7dcce60 0x55f6b7dd65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.559 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.562+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 >> 172.21.15.142:0/978941978 conn(0x55f6b7cf3fa0 msgr2=0x55f6b7dc16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.563+0000 7f230eff5700 0 client.27998 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:08:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.563+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 shutdown_connections 2023-09-21T13:08:55.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.563+0000 7f2344c0cb80 1 -- 172.21.15.142:0/978941978 wait complete. 2023-09-21T13:08:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:08:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:08:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:08:55.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:08:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.563+0000 7f2344c0cb80 20 client.27998 trim_cache size 0 max 16384 2023-09-21T13:08:55.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.564+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 msgr2=0x7f23140a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.564+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 0x7f23140a2cf0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f232c198290 tx=0x7f2320010c00 comp rx=0 tx=0).stop 2023-09-21T13:08:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.564+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 msgr2=0x7f232c19a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:08:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.564+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f232400ef30 tx=0x7f232400c3a0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 shutdown_connections 2023-09-21T13:08:55.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f23140a0830 0x7f23140a2cf0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f232c0ffca0 0x7f232c196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f232c105aa0 0x7f232c19a5b0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 --2- 172.21.15.142:0/2640232509 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f232c100660 0x7f232c197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:08:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 >> 172.21.15.142:0/2640232509 conn(0x7f232c0765a0 msgr2=0x7f232c0682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:08:55.564 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 shutdown_connections 2023-09-21T13:08:55.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:08:55.565+0000 7f23309fe700 1 -- 172.21.15.142:0/2640232509 wait complete. 2023-09-21T13:08:55.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1182571 8.75 MB/sec execute 576 sec latency 61.227 ms 2023-09-21T13:08:56.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:55 smithi156 ceph-mon[134078]: pgmap v396: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:08:56.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:55 smithi142 ceph-mon[97663]: pgmap v396: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:08:56.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:55 smithi160 ceph-mon[134450]: pgmap v396: 97 pgs: 97 active+clean; 392 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:08:56.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1183999 8.75 MB/sec execute 577 sec latency 9.511 ms 2023-09-21T13:08:57.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1186299 8.76 MB/sec execute 578 sec latency 16.210 ms 2023-09-21T13:08:58.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:57 smithi156 ceph-mon[134078]: pgmap v397: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 286 op/s 2023-09-21T13:08:58.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:57 smithi142 ceph-mon[97663]: pgmap v397: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 286 op/s 2023-09-21T13:08:58.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:57 smithi160 ceph-mon[134450]: pgmap v397: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.5 MiB/s wr, 286 op/s 2023-09-21T13:08:58.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1187738 8.76 MB/sec execute 579 sec latency 17.057 ms 2023-09-21T13:08:59.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1189951 8.77 MB/sec execute 580 sec latency 14.942 ms 2023-09-21T13:09:00.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:08:59 smithi156 ceph-mon[134078]: pgmap v398: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:09:00.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:08:59 smithi142 ceph-mon[97663]: pgmap v398: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:09:00.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:08:59 smithi160 ceph-mon[134450]: pgmap v398: 97 pgs: 97 active+clean; 401 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 182 op/s 2023-09-21T13:09:00.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1190868 8.76 MB/sec execute 581 sec latency 28.630 ms 2023-09-21T13:09:01.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1192269 8.75 MB/sec execute 582 sec latency 58.994 ms 2023-09-21T13:09:02.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:01 smithi156 ceph-mon[134078]: pgmap v399: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 285 op/s 2023-09-21T13:09:02.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:01 smithi142 ceph-mon[97663]: pgmap v399: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 285 op/s 2023-09-21T13:09:02.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:01 smithi160 ceph-mon[134450]: pgmap v399: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 2.6 MiB/s wr, 285 op/s 2023-09-21T13:09:02.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1193549 8.75 MB/sec execute 583 sec latency 40.756 ms 2023-09-21T13:09:03.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:02 smithi156 ceph-mon[134078]: osdmap e101: 12 total, 12 up, 12 in 2023-09-21T13:09:03.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:02 smithi142 ceph-mon[97663]: osdmap e101: 12 total, 12 up, 12 in 2023-09-21T13:09:03.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:02 smithi160 ceph-mon[134450]: osdmap e101: 12 total, 12 up, 12 in 2023-09-21T13:09:03.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1194874 8.75 MB/sec execute 584 sec latency 18.371 ms 2023-09-21T13:09:04.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:03 smithi156 ceph-mon[134078]: pgmap v401: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:04.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:03 smithi142 ceph-mon[97663]: pgmap v401: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:04.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:03 smithi160 ceph-mon[134450]: pgmap v401: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:04.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1197044 8.76 MB/sec execute 585 sec latency 16.367 ms 2023-09-21T13:09:05.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1197651 8.74 MB/sec execute 586 sec latency 316.287 ms 2023-09-21T13:09:06.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:05 smithi156 ceph-mon[134078]: pgmap v402: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:06.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:05 smithi142 ceph-mon[97663]: pgmap v402: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:06.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:05 smithi160 ceph-mon[134450]: pgmap v402: 97 pgs: 97 active+clean; 398 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 250 op/s 2023-09-21T13:09:06.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1199687 8.75 MB/sec execute 587 sec latency 33.669 ms 2023-09-21T13:09:07.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1200938 8.75 MB/sec execute 588 sec latency 12.875 ms 2023-09-21T13:09:08.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:07 smithi156 ceph-mon[134078]: pgmap v403: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:08.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:07 smithi142 ceph-mon[97663]: pgmap v403: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:08.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:07 smithi160 ceph-mon[134450]: pgmap v403: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:08.711 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1202828 8.74 MB/sec execute 589 sec latency 53.527 ms 2023-09-21T13:09:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 -- 172.21.15.142:0/1199204155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78103bc0 msgr2=0x7fbd78107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.742 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 --2- 172.21.15.142:0/1199204155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78103bc0 0x7fbd78107c00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fbd68009990 tx=0x7fbd68009ca0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 -- 172.21.15.142:0/1199204155 shutdown_connections 2023-09-21T13:09:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 --2- 172.21.15.142:0/1199204155 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 0x7fbd781035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 --2- 172.21.15.142:0/1199204155 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd78108330 0x7fbd7810feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.743 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 --2- 172.21.15.142:0/1199204155 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78103bc0 0x7fbd78107c00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 -- 172.21.15.142:0/1199204155 >> 172.21.15.142:0/1199204155 conn(0x7fbd780fea70 msgr2=0x7fbd78100e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 -- 172.21.15.142:0/1199204155 shutdown_connections 2023-09-21T13:09:08.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.747+0000 7fbd801ff700 1 -- 172.21.15.142:0/1199204155 wait complete. 2023-09-21T13:09:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.748+0000 7fbd801ff700 1 Processor -- start 2023-09-21T13:09:08.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.748+0000 7fbd801ff700 1 -- start start 2023-09-21T13:09:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 0x7fbd781991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd7819dd00 0x7fbd7819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7819e780 con 0x7fbd78103210 2023-09-21T13:09:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7819e8f0 con 0x7fbd78108330 2023-09-21T13:09:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd801ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7819eab0 con 0x7fbd7819dd00 2023-09-21T13:09:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 0x7fbd781991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55544/0 (socket says 172.21.15.142:55544) 2023-09-21T13:09:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 -- 172.21.15.142:0/3398001468 learned_addr learned my addr 172.21.15.142:0/3398001468 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd7819dd00 0x7fbd7819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 -- 172.21.15.142:0/3398001468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd7819dd00 msgr2=0x7fbd7819e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd7819dd00 0x7fbd7819e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 -- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 msgr2=0x7fbd781991f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.749+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 0x7fbd781991f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd7d79a700 1 -- 172.21.15.142:0/3398001468 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd74009520 con 0x7fbd78108330 2023-09-21T13:09:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004730 tx=0x7fbd68004760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd6effd700 1 -- 172.21.15.142:0/3398001468 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6801d070 con 0x7fbd78108330 2023-09-21T13:09:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd680095f0 con 0x7fbd78108330 2023-09-21T13:09:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd6effd700 1 -- 172.21.15.142:0/3398001468 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd680047d0 con 0x7fbd78108330 2023-09-21T13:09:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd6effd700 1 -- 172.21.15.142:0/3398001468 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680053b0 con 0x7fbd78108330 2023-09-21T13:09:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.750+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd781a61e0 con 0x7fbd78108330 2023-09-21T13:09:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.754+0000 7fbd6effd700 1 -- 172.21.15.142:0/3398001468 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fbd68004940 con 0x7fbd78108330 2023-09-21T13:09:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.755+0000 7fbd93b8cb80 1 Processor -- start 2023-09-21T13:09:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 -- start start 2023-09-21T13:09:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d09c0 0x5612ea6d4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea644c40 con 0x5612ea6d09c0 2023-09-21T13:09:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea628c10 con 0x5612ea6d00a0 2023-09-21T13:09:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea626530 con 0x5612ea6d4e50 2023-09-21T13:09:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd7e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd7e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:55552/0 (socket says 172.21.15.142:55552) 2023-09-21T13:09:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd7e79c700 1 -- 172.21.15.142:0/3805700765 learned_addr learned my addr 172.21.15.142:0/3805700765 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d09c0 0x5612ea6d4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.756+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 -- 172.21.15.142:0/3805700765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 msgr2=0x5612ea6d52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 -- 172.21.15.142:0/3805700765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d09c0 msgr2=0x5612ea6d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d09c0 0x5612ea6d4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 -- 172.21.15.142:0/3805700765 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ea44cd80 con 0x5612ea6d00a0 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd6effd700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 0x7fbd640a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd6effd700 1 -- 172.21.15.142:0/3398001468 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbd680cd190 con 0x7fbd78108330 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbd70003fa0 tx=0x7fbd70009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f34dd20c26fea72c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 0x7fbd640a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd63fff700 1 -- 172.21.15.142:0/3805700765 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70019070 con 0x5612ea6d00a0 2023-09-21T13:09:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd63fff700 1 -- 172.21.15.142:0/3805700765 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7000f040 con 0x5612ea6d00a0 2023-09-21T13:09:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.757+0000 7fbd63fff700 1 -- 172.21.15.142:0/3805700765 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd70007a00 con 0x5612ea6d00a0 2023-09-21T13:09:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3805700765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 msgr2=0x5612ea6d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 0x7fbd640a2c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009fc0 tx=0x7fbd74009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbd70003fa0 tx=0x7fbd70009ba0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3805700765 shutdown_connections 2023-09-21T13:09:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d00a0 0x5612ea6d0480 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3805700765 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d09c0 0x5612ea6d4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3805700765 >> 172.21.15.142:0/3805700765 conn(0x5612ea5fcfa0 msgr2=0x5612ea6cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3805700765 shutdown_connections 2023-09-21T13:09:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.758+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3805700765 wait complete. 2023-09-21T13:09:08.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.759+0000 7fbd93b8cb80 1 -- start start 2023-09-21T13:09:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.759+0000 7fbd93b8cb80 1 Processor -- start 2023-09-21T13:09:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d4e50 0x5612ea6d9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea621e20 con 0x5612ea6d00a0 2023-09-21T13:09:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea5be6e0 con 0x5612ea6d4e50 2023-09-21T13:09:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea5be380 con 0x5612ea6d09c0 2023-09-21T13:09:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd93b8cb80 10 client.0 _ll_register_callbacks cb 0x5612ea508a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7d79a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49056/0 (socket says 172.21.15.142:49056) 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7d79a700 1 -- 172.21.15.142:0/2538492108 learned_addr learned my addr 172.21.15.142:0/2538492108 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d4e50 0x5612ea6d9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.760+0000 7fbd7d79a700 1 -- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d4e50 msgr2=0x5612ea6d9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d4e50 0x5612ea6d9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd7d79a700 1 -- 172.21.15.142:0/2538492108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 msgr2=0x5612ea6dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6dc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd7d79a700 1 -- 172.21.15.142:0/2538492108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd70003bd0 con 0x5612ea6d09c0 2023-09-21T13:09:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd680a2100 tx=0x7fbd68004f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6eb62a6b385ebdbc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd617fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:09:08.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680852b0 con 0x5612ea6d09c0 2023-09-21T13:09:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612ea592b50 con 0x5612ea6d09c0 2023-09-21T13:09:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbd6809ad50 con 0x5612ea6d09c0 2023-09-21T13:09:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd68099fb0 con 0x5612ea6d09c0 2023-09-21T13:09:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd93b8cb80 10 client.27946 fetch_fsmap learned FSMap version 42 2023-09-21T13:09:08.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x5612ea435c00 con 0x5612ea6d09c0 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.761+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd680b1030 con 0x5612ea6d09c0 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd6809e100 con 0x5612ea6d09c0 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 10 client.27946 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 10 client.27946 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 20 client.27946 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:08.770 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea6e9af0 0x5612ea6ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 4 client.27946 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612ea69efc0 con 0x5612ea6e9af0 2023-09-21T13:09:08.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.762+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea6e9af0 0x5612ea6ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.763+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea6e9af0 0x5612ea6ebee0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=143853deab33f39 server_cookie=220f80bc475c1094 in_seq=0 out_seq=0 2023-09-21T13:09:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.763+0000 7fbd617fa700 10 client.27946 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:08.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.763+0000 7fbd617fa700 1 -- 172.21.15.142:0/2538492108 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5612ea69efc0 con 0x5612ea6e9af0 2023-09-21T13:09:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.763+0000 7fbd617fa700 10 client.27946 handle_command_reply: tid=0 2023-09-21T13:09:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.763+0000 7fbd93b8cb80 1 client.27946 shutdown 2023-09-21T13:09:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 msgr2=0x5612ea6d9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.773 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbd680a2100 tx=0x7fbd68004f00 comp rx=0 tx=0).stop 2023-09-21T13:09:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 shutdown_connections 2023-09-21T13:09:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea6e9af0 0x5612ea6ebee0 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d4e50 0x5612ea6d9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2538492108 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9860 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd617fa700 0 client.27946 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 >> 172.21.15.142:0/2538492108 conn(0x5612ea5fcfa0 msgr2=0x5612ea6ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 shutdown_connections 2023-09-21T13:09:08.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2538492108 wait complete. 2023-09-21T13:09:08.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.764+0000 7fbd93b8cb80 20 client.27946 trim_cache size 0 max 16384 2023-09-21T13:09:08.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 Processor -- start 2023-09-21T13:09:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 -- start start 2023-09-21T13:09:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6e5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea4a28c0 con 0x5612ea6d00a0 2023-09-21T13:09:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea6cbef0 con 0x5612ea6d09c0 2023-09-21T13:09:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea6dc8b0 con 0x5612ea6d4e50 2023-09-21T13:09:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd7d79a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53638/0 (socket says 172.21.15.142:53638) 2023-09-21T13:09:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.783+0000 7fbd7df9b700 1 -- 172.21.15.142:0/3433473880 learned_addr learned my addr 172.21.15.142:0/3433473880 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 -- 172.21.15.142:0/3433473880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 msgr2=0x5612ea6d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 -- 172.21.15.142:0/3433473880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 msgr2=0x5612ea6e5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6e5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 -- 172.21.15.142:0/3433473880 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ea4731f0 con 0x5612ea6d00a0 2023-09-21T13:09:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:09:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5612ea6ec7f0 tx=0x7fbd7401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ff01ebf9b40316 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd6cff9700 1 -- 172.21.15.142:0/3433473880 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74022040 con 0x5612ea6d00a0 2023-09-21T13:09:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd6cff9700 1 -- 172.21.15.142:0/3433473880 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd74023040 con 0x5612ea6d00a0 2023-09-21T13:09:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.784+0000 7fbd6cff9700 1 -- 172.21.15.142:0/3433473880 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74017070 con 0x5612ea6d00a0 2023-09-21T13:09:08.786 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3433473880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 msgr2=0x5612ea6e1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x5612ea6ec7f0 tx=0x7fbd7401b000 comp rx=0 tx=0).stop 2023-09-21T13:09:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3433473880 shutdown_connections 2023-09-21T13:09:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d00a0 0x5612ea6e1030 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d4e50 0x5612ea6d2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.787 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/3433473880 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3433473880 >> 172.21.15.142:0/3433473880 conn(0x5612ea5fcfa0 msgr2=0x5612ea6dc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.785+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3433473880 shutdown_connections 2023-09-21T13:09:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.786+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/3433473880 wait complete. 2023-09-21T13:09:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.786+0000 7fbd93b8cb80 1 -- start start 2023-09-21T13:09:08.788 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.786+0000 7fbd93b8cb80 1 Processor -- start 2023-09-21T13:09:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.786+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.786+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd93b8cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d4e50 0x5612ea6d8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea6d85d0 con 0x5612ea6d4e50 2023-09-21T13:09:08.789 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea6d8740 con 0x5612ea6d09c0 2023-09-21T13:09:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd93b8cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ea6d8900 con 0x5612ea6d00a0 2023-09-21T13:09:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd93b8cb80 10 client.0 _ll_register_callbacks cb 0x5612ea508a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:49074/0 (socket says 172.21.15.142:49074) 2023-09-21T13:09:08.790 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 -- 172.21.15.142:0/2745272197 learned_addr learned my addr 172.21.15.142:0/2745272197 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7e79c700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d4e50 0x5612ea6d8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 -- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 msgr2=0x5612ea6d9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 -- 172.21.15.142:0/2745272197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d4e50 msgr2=0x5612ea6d8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d4e50 0x5612ea6d8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 -- 172.21.15.142:0/2745272197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5612ea435c00 con 0x5612ea6d00a0 2023-09-21T13:09:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd7df9b700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402c420 tx=0x7fbd7402c570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecada0994363412 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:08.792 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.787+0000 7fbd617fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:09:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74017050 con 0x5612ea6d00a0 2023-09-21T13:09:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd7000f040 con 0x5612ea6d00a0 2023-09-21T13:09:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 8557+0+0 (secure 0 0 0) 0x7fbd7401db70 con 0x5612ea6d00a0 2023-09-21T13:09:08.793 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd7401dd30 con 0x5612ea6d00a0 2023-09-21T13:09:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 10 client.27952 fetch_fsmap learned FSMap version 42 2023-09-21T13:09:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7fbd7402ca00 con 0x5612ea6d00a0 2023-09-21T13:09:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd7000f040 con 0x5612ea6d00a0 2023-09-21T13:09:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 42) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd74004b20 con 0x5612ea6d00a0 2023-09-21T13:09:08.794 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 10 client.27952 fetch_fsmap finished waiting for FSMap version 42 2023-09-21T13:09:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 10 client.27952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 20 client.27952 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea73e830 0x5612ea740c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:08.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 4 client.27952 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:09:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.788+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5612ea61ae00 con 0x5612ea73e830 2023-09-21T13:09:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.789+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea73e830 0x5612ea740c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.789+0000 7fbd617fa700 10 client.27952 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:08.796 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.789+0000 7fbd7d79a700 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea73e830 0x5612ea740c50 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59c705facb9a183 server_cookie=a7a9ceb45bde954 in_seq=0 out_seq=0 2023-09-21T13:09:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.874+0000 7fbd617fa700 1 -- 172.21.15.142:0/2745272197 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5612ea61ae00 con 0x5612ea73e830 2023-09-21T13:09:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.874+0000 7fbd617fa700 10 client.27952 handle_command_reply: tid=0 2023-09-21T13:09:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.874+0000 7fbd93b8cb80 1 client.27952 shutdown 2023-09-21T13:09:08.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 msgr2=0x5612ea6d9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbd7402c420 tx=0x7fbd7402c570 comp rx=0 tx=0).stop 2023-09-21T13:09:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 shutdown_connections 2023-09-21T13:09:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5612ea73e830 0x5612ea740c50 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5612ea6d4e50 0x5612ea6d8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5612ea6d00a0 0x5612ea6d9100 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 --2- 172.21.15.142:0/2745272197 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5612ea6d09c0 0x5612ea6d9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd617fa700 0 client.27952 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:08.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 >> 172.21.15.142:0/2745272197 conn(0x5612ea5fcfa0 msgr2=0x5612ea6d2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 shutdown_connections 2023-09-21T13:09:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 1 -- 172.21.15.142:0/2745272197 wait complete. 2023-09-21T13:09:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.875+0000 7fbd93b8cb80 20 client.27952 trim_cache size 0 max 16384 2023-09-21T13:09:08.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:09:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:09:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:09:08.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:09:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 msgr2=0x7fbd640a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 0x7fbd640a2c70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbd74009fc0 tx=0x7fbd74009260 comp rx=0 tx=0).stop 2023-09-21T13:09:08.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 msgr2=0x7fbd78199730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004730 tx=0x7fbd68004760 comp rx=0 tx=0).stop 2023-09-21T13:09:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 shutdown_connections 2023-09-21T13:09:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fbd640a07b0 0x7fbd640a2c70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fbd78103210 0x7fbd781991f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbd7819dd00 0x7fbd7819e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 --2- 172.21.15.142:0/3398001468 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fbd78108330 0x7fbd78199730 secure :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fbd68004730 tx=0x7fbd68004760 comp rx=0 tx=0).stop 2023-09-21T13:09:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.876+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 >> 172.21.15.142:0/3398001468 conn(0x7fbd780fea70 msgr2=0x7fbd780ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.878+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 shutdown_connections 2023-09-21T13:09:08.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:08.879+0000 7fbd801ff700 1 -- 172.21.15.142:0/3398001468 wait complete. 2023-09-21T13:09:09.687 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:09:09.687 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:09:09.687 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/3735865439 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5642c449f1e0 con 0x5642c4474800 2023-09-21T13:09:09.687 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:09:09.716 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1204277 8.75 MB/sec execute 590 sec latency 63.152 ms 2023-09-21T13:09:10.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:09 smithi156 ceph-mon[134078]: pgmap v404: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:10.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:09 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:09:10.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:09 smithi142 ceph-mon[97663]: pgmap v404: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:10.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:09 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:09:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-mon[134450]: pgmap v404: 97 pgs: 97 active+clean; 405 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-21T13:09:10.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:09 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:09:10.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1204753 8.73 MB/sec execute 591 sec latency 267.194 ms 2023-09-21T13:09:11.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:10 smithi156 ceph-mon[134078]: osdmap e102: 12 total, 12 up, 12 in 2023-09-21T13:09:11.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:10 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/2484275719,v1:172.21.15.160:6839/2484275719] up:boot 2023-09-21T13:09:11.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:10 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:09:11.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:10 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:09:11.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:10 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:11.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:10 smithi142 ceph-mon[97663]: osdmap e102: 12 total, 12 up, 12 in 2023-09-21T13:09:11.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:10 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/2484275719,v1:172.21.15.160:6839/2484275719] up:boot 2023-09-21T13:09:11.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:10 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:09:11.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:10 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:09:11.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:10 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:11.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:10 smithi160 ceph-mon[134450]: osdmap e102: 12 total, 12 up, 12 in 2023-09-21T13:09:11.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:10 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/2484275719,v1:172.21.15.160:6839/2484275719] up:boot 2023-09-21T13:09:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:10 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:09:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:10 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:09:11.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:10 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:11.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1206596 8.73 MB/sec execute 592 sec latency 54.779 ms 2023-09-21T13:09:12.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:12 smithi156 ceph-mon[134078]: pgmap v406: 97 pgs: 97 active+clean; 415 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-09-21T13:09:12.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:12 smithi156 ceph-mon[134078]: osdmap e103: 12 total, 12 up, 12 in 2023-09-21T13:09:12.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:12 smithi142 ceph-mon[97663]: pgmap v406: 97 pgs: 97 active+clean; 415 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-09-21T13:09:12.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:12 smithi142 ceph-mon[97663]: osdmap e103: 12 total, 12 up, 12 in 2023-09-21T13:09:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:12 smithi160 ceph-mon[134450]: pgmap v406: 97 pgs: 97 active+clean; 415 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 6.5 MiB/s wr, 307 op/s 2023-09-21T13:09:12.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:12 smithi160 ceph-mon[134450]: osdmap e103: 12 total, 12 up, 12 in 2023-09-21T13:09:12.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1207994 8.74 MB/sec execute 593 sec latency 21.186 ms 2023-09-21T13:09:13.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1209654 8.73 MB/sec execute 594 sec latency 64.449 ms 2023-09-21T13:09:14.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:14 smithi156 ceph-mon[134078]: pgmap v408: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.3 MiB/s wr, 396 op/s 2023-09-21T13:09:14.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:14 smithi142 ceph-mon[97663]: pgmap v408: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.3 MiB/s wr, 396 op/s 2023-09-21T13:09:14.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:14 smithi160 ceph-mon[134450]: pgmap v408: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.3 MiB/s wr, 396 op/s 2023-09-21T13:09:14.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1211431 8.74 MB/sec execute 595 sec latency 13.095 ms 2023-09-21T13:09:15.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1212817 8.73 MB/sec execute 596 sec latency 28.612 ms 2023-09-21T13:09:16.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:16 smithi156 ceph-mon[134078]: pgmap v409: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.0 MiB/s wr, 271 op/s 2023-09-21T13:09:16.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:16 smithi142 ceph-mon[97663]: pgmap v409: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.0 MiB/s wr, 271 op/s 2023-09-21T13:09:16.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:16 smithi160 ceph-mon[134450]: pgmap v409: 97 pgs: 97 active+clean; 418 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.0 MiB/s wr, 271 op/s 2023-09-21T13:09:16.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1214906 8.74 MB/sec execute 597 sec latency 16.346 ms 2023-09-21T13:09:17.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1216255 8.74 MB/sec execute 598 sec latency 17.315 ms 2023-09-21T13:09:18.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:18 smithi156 ceph-mon[134078]: pgmap v410: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 470 op/s 2023-09-21T13:09:18.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:18 smithi142 ceph-mon[97663]: pgmap v410: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 470 op/s 2023-09-21T13:09:18.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:18 smithi160 ceph-mon[134450]: pgmap v410: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 470 op/s 2023-09-21T13:09:18.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 1218419 8.74 MB/sec execute 599 sec latency 14.663 ms 2023-09-21T13:09:19.714 INFO:tasks.workunit.client.0.smithi142.stdout: 1 cleanup 600 sec 2023-09-21T13:09:19.886 INFO:tasks.workunit.client.0.smithi142.stdout: 0 cleanup 600 sec 2023-09-21T13:09:19.886 INFO:tasks.workunit.client.0.smithi142.stdout: 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: Operation Count AvgLat MaxLat 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: ---------------------------------------- 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: NTCreateX 167038 1.530 9659.625 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: Close 122700 0.004 0.519 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: Rename 7074 5.012 198.400 2023-09-21T13:09:19.887 INFO:tasks.workunit.client.0.smithi142.stdout: Unlink 33736 2.089 8775.466 2023-09-21T13:09:19.888 INFO:tasks.workunit.client.0.smithi142.stdout: Deltree 4 93.143 119.912 2023-09-21T13:09:19.888 INFO:tasks.workunit.client.0.smithi142.stdout: Mkdir 2 0.016 0.017 2023-09-21T13:09:19.888 INFO:tasks.workunit.client.0.smithi142.stdout: Qpathinfo 151417 1.094 1465.751 2023-09-21T13:09:19.888 INFO:tasks.workunit.client.0.smithi142.stdout: Qfileinfo 26527 0.002 0.060 2023-09-21T13:09:19.888 INFO:tasks.workunit.client.0.smithi142.stdout: Qfsinfo 27764 0.222 12.337 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: Sfileinfo 13608 0.033 6.476 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: Find 58539 0.228 91.752 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: WriteX 83244 0.075 156.811 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: ReadX 261869 0.009 13.142 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: LockX 544 0.657 11.267 2023-09-21T13:09:19.889 INFO:tasks.workunit.client.0.smithi142.stdout: UnlockX 544 0.566 3.521 2023-09-21T13:09:19.890 INFO:tasks.workunit.client.0.smithi142.stdout: Flush 11708 3.357 316.536 2023-09-21T13:09:19.890 INFO:tasks.workunit.client.0.smithi142.stdout: 2023-09-21T13:09:19.890 INFO:tasks.workunit.client.0.smithi142.stdout:Throughput 8.74465 MB/sec 1 clients 1 procs max_latency=9659.634 ms 2023-09-21T13:09:19.890 INFO:tasks.workunit.client.0.smithi142.stderr:+ dbench 10 2023-09-21T13:09:19.891 INFO:tasks.workunit.client.0.smithi142.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-09-21T13:09:19.891 INFO:tasks.workunit.client.0.smithi142.stdout: 2023-09-21T13:09:19.891 INFO:tasks.workunit.client.0.smithi142.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-09-21T13:09:19.892 INFO:tasks.workunit.client.0.smithi142.stdout:9 of 10 processes prepared for launch 0 sec 2023-09-21T13:09:19.992 INFO:tasks.workunit.client.0.smithi142.stdout:10 of 10 processes prepared for launch 0 sec 2023-09-21T13:09:19.992 INFO:tasks.workunit.client.0.smithi142.stdout:releasing clients 2023-09-21T13:09:20.039 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:09:20.286 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 -- 172.21.15.142:0/3862416821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 msgr2=0x7f7b4c10cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 --2- 172.21.15.142:0/3862416821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c10cb40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400b0a0 tx=0x7f7b4400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 -- 172.21.15.142:0/3862416821 shutdown_connections 2023-09-21T13:09:20.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 --2- 172.21.15.142:0/3862416821 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c0ffea0 0x7f7b4c100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.287 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 --2- 172.21.15.142:0/3862416821 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c10cb40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 --2- 172.21.15.142:0/3862416821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c100850 0x7f7b4c104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 -- 172.21.15.142:0/3862416821 >> 172.21.15.142:0/3862416821 conn(0x7f7b4c0fb740 msgr2=0x7f7b4c0fdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.291+0000 7f7b529ff700 1 -- 172.21.15.142:0/3862416821 shutdown_connections 2023-09-21T13:09:20.288 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.292+0000 7f7b529ff700 1 -- 172.21.15.142:0/3862416821 wait complete. 2023-09-21T13:09:20.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.292+0000 7f7b529ff700 1 Processor -- start 2023-09-21T13:09:20.290 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 -- start start 2023-09-21T13:09:20.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c0ffea0 0x7f7b4c101930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c1023b0 0x7f7b4c1a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1a5600 con 0x7f7b4c1023b0 2023-09-21T13:09:20.291 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1a5770 con 0x7f7b4c104fc0 2023-09-21T13:09:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b529ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c1a5930 con 0x7f7b4c0ffea0 2023-09-21T13:09:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b43fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46274/0 (socket says 172.21.15.142:46274) 2023-09-21T13:09:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b43fff700 1 -- 172.21.15.142:0/989559806 learned_addr learned my addr 172.21.15.142:0/989559806 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:20.292 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c1023b0 0x7f7b4c1a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.293+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c0ffea0 0x7f7b4c101930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 -- 172.21.15.142:0/989559806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c0ffea0 msgr2=0x7f7b4c101930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c0ffea0 0x7f7b4c101930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 -- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c1023b0 msgr2=0x7f7b4c1a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c1023b0 0x7f7b4c1a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 -- 172.21.15.142:0/989559806 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b44009d00 con 0x7f7b4c104fc0 2023-09-21T13:09:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b43fff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e970 tx=0x7f7b3400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b49ffb700 1 -- 172.21.15.142:0/989559806 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34009790 con 0x7f7b4c104fc0 2023-09-21T13:09:20.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b49ffb700 1 -- 172.21.15.142:0/989559806 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b3400c7e0 con 0x7f7b4c104fc0 2023-09-21T13:09:20.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c1a5c10 con 0x7f7b4c104fc0 2023-09-21T13:09:20.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b49ffb700 1 -- 172.21.15.142:0/989559806 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b340054e0 con 0x7f7b4c104fc0 2023-09-21T13:09:20.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.294+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c1a6170 con 0x7f7b4c104fc0 2023-09-21T13:09:20.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.299+0000 7f7b49ffb700 1 -- 172.21.15.142:0/989559806 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7b3400c950 con 0x7f7b4c104fc0 2023-09-21T13:09:20.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.299+0000 7f7b662c9b80 1 Processor -- start 2023-09-21T13:09:20.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 -- start start 2023-09-21T13:09:20.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 0x555a13bb4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb5360 0x555a13bb57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13b24ca0 con 0x555a13bb5360 2023-09-21T13:09:20.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13b08c70 con 0x555a13bb0f30 2023-09-21T13:09:20.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13b06590 con 0x555a13bb0610 2023-09-21T13:09:20.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 0x555a13bb4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41110/0 (socket says 172.21.15.142:41110) 2023-09-21T13:09:20.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b49ffb700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 0x7f7b380a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.300+0000 7f7b50f9c700 1 -- 172.21.15.142:0/1050463547 learned_addr learned my addr 172.21.15.142:0/1050463547 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b49ffb700 1 -- 172.21.15.142:0/989559806 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b34014070 con 0x7f7b4c104fc0 2023-09-21T13:09:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b43fff700 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb5360 0x555a13bb57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 0x7f7b380a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 -- 172.21.15.142:0/1050463547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 msgr2=0x555a13bb09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 -- 172.21.15.142:0/1050463547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb5360 msgr2=0x555a13bb57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb5360 0x555a13bb57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 -- 172.21.15.142:0/1050463547 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a1392cde0 con 0x555a13bb0f30 2023-09-21T13:09:20.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:20.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.301+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 0x555a13bb4e20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009cb0 tx=0x7f7b3c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a64da5efd0cb15 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 0x7f7b380a2cf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400bfd0 tx=0x7f7b4400b3b0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b427fc700 1 -- 172.21.15.142:0/1050463547 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c011d20 con 0x555a13bb0f30 2023-09-21T13:09:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b427fc700 1 -- 172.21.15.142:0/1050463547 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b3c011e80 con 0x555a13bb0f30 2023-09-21T13:09:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b427fc700 1 -- 172.21.15.142:0/1050463547 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c004a90 con 0x555a13bb0f30 2023-09-21T13:09:20.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1050463547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 msgr2=0x555a13bb4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.302+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 0x555a13bb4e20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009cb0 tx=0x7f7b3c011440 comp rx=0 tx=0).stop 2023-09-21T13:09:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1050463547 shutdown_connections 2023-09-21T13:09:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb5360 0x555a13bb57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bb09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1050463547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb0f30 0x555a13bb4e20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1050463547 >> 172.21.15.142:0/1050463547 conn(0x555a13add000 msgr2=0x555a13bab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1050463547 shutdown_connections 2023-09-21T13:09:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1050463547 wait complete. 2023-09-21T13:09:20.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.303+0000 7f7b662c9b80 1 -- start start 2023-09-21T13:09:20.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 Processor -- start 2023-09-21T13:09:20.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bb9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bba320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13b01e80 con 0x555a13bb0610 2023-09-21T13:09:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13a9e740 con 0x555a13bb5360 2023-09-21T13:09:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13a9e3e0 con 0x555a13bb0f30 2023-09-21T13:09:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b662c9b80 10 client.0 _ll_register_callbacks cb 0x555a139e8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:20.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bb9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46288/0 (socket says 172.21.15.142:46288) 2023-09-21T13:09:20.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b50f9c700 1 -- 172.21.15.142:0/754712729 learned_addr learned my addr 172.21.15.142:0/754712729 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:20.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.304+0000 7f7b43fff700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bba320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 -- 172.21.15.142:0/754712729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 msgr2=0x555a13bba320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bba320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 -- 172.21.15.142:0/754712729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 msgr2=0x555a13bb9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bb9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 -- 172.21.15.142:0/754712729 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c10d3b0 con 0x555a13bb5360 2023-09-21T13:09:20.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bb9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:20.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b43fff700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:20.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b44003f90 tx=0x7f7b440099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=325f5c0edbad004e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:20.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4400e040 con 0x555a13bb5360 2023-09-21T13:09:20.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a13a72bb0 con 0x555a13bb5360 2023-09-21T13:09:20.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.305+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b440217a0 con 0x555a13bb5360 2023-09-21T13:09:20.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b44021960 con 0x555a13bb5360 2023-09-21T13:09:20.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 10 client.28034 fetch_fsmap learned FSMap version 44 2023-09-21T13:09:20.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7f7b3c0098e0 con 0x555a13bb5360 2023-09-21T13:09:20.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b44036020 con 0x555a13bb5360 2023-09-21T13:09:20.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 44) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b44019050 con 0x555a13bb5360 2023-09-21T13:09:20.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 10 client.28034 fetch_fsmap finished waiting for FSMap version 44 2023-09-21T13:09:20.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 10 client.28034 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:20.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 20 client.28034 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:20.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13bca460 0x555a13bcc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 4 client.28034 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:20.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555a13b7f020 con 0x555a13bca460 2023-09-21T13:09:20.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.306+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13bca460 0x555a13bcc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.307+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13bca460 0x555a13bcc880 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=553c83669abccd28 server_cookie=7a0bcc2750e6133 in_seq=0 out_seq=0 2023-09-21T13:09:20.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.307+0000 7f7b2b7fe700 10 client.28034 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:20.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.309+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/754712729 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555a13b7f020 con 0x555a13bca460 2023-09-21T13:09:20.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.309+0000 7f7b2b7fe700 10 client.28034 handle_command_reply: tid=0 2023-09-21T13:09:20.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.309+0000 7f7b662c9b80 1 client.28034 shutdown 2023-09-21T13:09:20.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 msgr2=0x555a13bba860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f7b44003f90 tx=0x7f7b440099e0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 shutdown_connections 2023-09-21T13:09:20.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13bca460 0x555a13bcc880 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bb9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba860 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/754712729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bba320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b2b7fe700 0 client.28034 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:20.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 >> 172.21.15.142:0/754712729 conn(0x555a13add000 msgr2=0x555a13bab230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 shutdown_connections 2023-09-21T13:09:20.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 1 -- 172.21.15.142:0/754712729 wait complete. 2023-09-21T13:09:20.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.310+0000 7f7b662c9b80 20 client.28034 trim_cache size 0 max 16384 2023-09-21T13:09:20.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 Processor -- start 2023-09-21T13:09:20.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 -- start start 2023-09-21T13:09:20.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bc14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bb4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13982920 con 0x555a13bb0610 2023-09-21T13:09:20.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13bb5020 con 0x555a13bb5360 2023-09-21T13:09:20.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13bb3ce0 con 0x555a13bb0f30 2023-09-21T13:09:20.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bc14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bc14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:59144/0 (socket says 172.21.15.142:59144) 2023-09-21T13:09:20.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.329+0000 7f7b4bfff700 1 -- 172.21.15.142:0/2587040436 learned_addr learned my addr 172.21.15.142:0/2587040436 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:20.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b43fff700 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bb4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 -- 172.21.15.142:0/2587040436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 msgr2=0x555a13bb4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bb4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 -- 172.21.15.142:0/2587040436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 msgr2=0x555a13bc14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bc14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 -- 172.21.15.142:0/2587040436 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a13915c60 con 0x555a13bb5360 2023-09-21T13:09:20.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba690 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005960 tx=0x7f7b44009a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=715c1c40e7172a50 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b42ffd700 1 -- 172.21.15.142:0/2587040436 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44021040 con 0x555a13bb5360 2023-09-21T13:09:20.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b42ffd700 1 -- 172.21.15.142:0/2587040436 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b44036020 con 0x555a13bb5360 2023-09-21T13:09:20.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.330+0000 7f7b42ffd700 1 -- 172.21.15.142:0/2587040436 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44021ad0 con 0x555a13bb5360 2023-09-21T13:09:20.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 -- 172.21.15.142:0/2587040436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 msgr2=0x555a13bba690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba690 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f7b44005960 tx=0x7f7b44009a50 comp rx=0 tx=0).stop 2023-09-21T13:09:20.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 -- 172.21.15.142:0/2587040436 shutdown_connections 2023-09-21T13:09:20.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0610 0x555a13bc14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bba690 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/2587040436 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0f30 0x555a13bb4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 -- 172.21.15.142:0/2587040436 >> 172.21.15.142:0/2587040436 conn(0x555a13add000 msgr2=0x555a13bb43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 -- 172.21.15.142:0/2587040436 shutdown_connections 2023-09-21T13:09:20.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.331+0000 7f7b662c9b80 1 -- 172.21.15.142:0/2587040436 wait complete. 2023-09-21T13:09:20.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 -- start start 2023-09-21T13:09:20.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 Processor -- start 2023-09-21T13:09:20.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bc13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0f30 0x555a13bbf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bbfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13bc0320 con 0x555a13bb0f30 2023-09-21T13:09:20.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13bc0490 con 0x555a13bb5360 2023-09-21T13:09:20.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a13c1e2c0 con 0x555a13bb0610 2023-09-21T13:09:20.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.332+0000 7f7b662c9b80 10 client.0 _ll_register_callbacks cb 0x555a139e8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:20.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bc13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bbfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b43fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0f30 0x555a13bbf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b4bfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bc13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41146/0 (socket says 172.21.15.142:41146) 2023-09-21T13:09:20.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b4bfff700 1 -- 172.21.15.142:0/1854783116 learned_addr learned my addr 172.21.15.142:0/1854783116 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:20.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 -- 172.21.15.142:0/1854783116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 msgr2=0x555a13bc13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bc13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 -- 172.21.15.142:0/1854783116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0f30 msgr2=0x555a13bbf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:20.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0f30 0x555a13bbf6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 -- 172.21.15.142:0/1854783116 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b3c0098e0 con 0x555a13bb5360 2023-09-21T13:09:20.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b50f9c700 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bbfc10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fd0 tx=0x7f7b44005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b8a51561dc8362 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.333+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b44021400 con 0x555a13bb5360 2023-09-21T13:09:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555a13bc6e90 con 0x555a13bb5360 2023-09-21T13:09:20.339 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7b44037080 con 0x555a13bb5360 2023-09-21T13:09:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b440219b0 con 0x555a13bb5360 2023-09-21T13:09:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 10 client.28040 fetch_fsmap learned FSMap version 44 2023-09-21T13:09:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x555a13953250 con 0x555a13bb5360 2023-09-21T13:09:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b4404a020 con 0x555a13bb5360 2023-09-21T13:09:20.340 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 44) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7b440074e0 con 0x555a13bb5360 2023-09-21T13:09:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 10 client.28040 fetch_fsmap finished waiting for FSMap version 44 2023-09-21T13:09:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 10 client.28040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 20 client.28040 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13c1f390 0x555a13c21780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:20.341 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 4 client.28040 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:09:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.334+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x7f7b3c011e80 con 0x555a13c1f390 2023-09-21T13:09:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.335+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13c1f390 0x555a13c21780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.335+0000 7f7b2b7fe700 10 client.28040 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.335+0000 7f7b4bfff700 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13c1f390 0x555a13c21780 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0eac7ade82940d server_cookie=4b3b84f5b43f633b in_seq=0 out_seq=0 2023-09-21T13:09:20.342 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b2b7fe700 1 -- 172.21.15.142:0/1854783116 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x7f7b3c011e80 con 0x555a13c1f390 2023-09-21T13:09:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b2b7fe700 10 client.28040 handle_command_reply: tid=0 2023-09-21T13:09:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 client.28040 shutdown 2023-09-21T13:09:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 msgr2=0x555a13bbfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bbfc10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f7b44009fd0 tx=0x7f7b44005710 comp rx=0 tx=0).stop 2023-09-21T13:09:20.343 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 shutdown_connections 2023-09-21T13:09:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555a13c1f390 0x555a13c21780 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555a13bb5360 0x555a13bbfc10 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b2b7fe700 0 client.28040 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555a13bb0610 0x555a13bc13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 --2- 172.21.15.142:0/1854783116 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555a13bb0f30 0x555a13bbf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 >> 172.21.15.142:0/1854783116 conn(0x555a13add000 msgr2=0x555a13bba370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 shutdown_connections 2023-09-21T13:09:20.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.338+0000 7f7b662c9b80 1 -- 172.21.15.142:0/1854783116 wait complete. 2023-09-21T13:09:20.345 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b662c9b80 20 client.28040 trim_cache size 0 max 16384 2023-09-21T13:09:20.346 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:09:20.346 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:09:20.346 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:09:20.346 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:09:20.347 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:09:20.347 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:09:20.347 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:09:20.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:09:20.347 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:09:20.348 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:09:20.348 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 msgr2=0x7f7b380a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 0x7f7b380a2cf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7b4400bfd0 tx=0x7f7b4400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 msgr2=0x7f7b4c101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7b3400e970 tx=0x7f7b3400ec80 comp rx=0 tx=0).stop 2023-09-21T13:09:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 shutdown_connections 2023-09-21T13:09:20.349 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7b380a0830 0x7f7b380a2cf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7b4c1023b0 0x7f7b4c1a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b4c0ffea0 0x7f7b4c101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 --2- 172.21.15.142:0/989559806 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7b4c104fc0 0x7f7b4c101e70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:20.350 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 >> 172.21.15.142:0/989559806 conn(0x7f7b4c0fb740 msgr2=0x7f7b4c103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.339+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 shutdown_connections 2023-09-21T13:09:20.351 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:20.340+0000 7f7b529ff700 1 -- 172.21.15.142:0/989559806 wait complete. 2023-09-21T13:09:20.352 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:20 smithi142 ceph-mon[97663]: pgmap v411: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 437 op/s 2023-09-21T13:09:20.355 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:09:20.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:20 smithi156 ceph-mon[134078]: pgmap v411: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 437 op/s 2023-09-21T13:09:20.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:20 smithi160 ceph-mon[134450]: pgmap v411: 97 pgs: 97 active+clean; 402 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.0 MiB/s wr, 437 op/s 2023-09-21T13:09:20.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 383 136.43 MB/sec warmup 1 sec latency 47.967 ms 2023-09-21T13:09:21.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 815 105.20 MB/sec warmup 2 sec latency 103.692 ms 2023-09-21T13:09:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3276451173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18106f10 msgr2=0x7f7a181072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3276451173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18106f10 0x7f7a181072f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009990 tx=0x7f7a14009ca0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3276451173 shutdown_connections 2023-09-21T13:09:22.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3276451173 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a1810dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3276451173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18106f10 0x7f7a181072f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3276451173 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18069160 0x7f7a180695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3276451173 >> 172.21.15.142:0/3276451173 conn(0x7f7a18076de0 msgr2=0x7f7a180771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3276451173 shutdown_connections 2023-09-21T13:09:22.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.047+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3276451173 wait complete. 2023-09-21T13:09:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.048+0000 7f7a1f7ff700 1 Processor -- start 2023-09-21T13:09:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.048+0000 7f7a1f7ff700 1 -- start start 2023-09-21T13:09:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18106f10 0x7f7a1819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819e230 con 0x7f7a18106f10 2023-09-21T13:09:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819e3a0 con 0x7f7a18069b20 2023-09-21T13:09:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1f7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1819e560 con 0x7f7a18069160 2023-09-21T13:09:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46314/0 (socket says 172.21.15.142:46314) 2023-09-21T13:09:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41172/0 (socket says 172.21.15.142:41172) 2023-09-21T13:09:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/3548684606 learned_addr learned my addr 172.21.15.142:0/3548684606 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:22.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.049+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18106f10 0x7f7a1819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/3548684606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 msgr2=0x7f7a18199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18106f10 msgr2=0x7f7a1819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18106f10 0x7f7a1819dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/3548684606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140095f0 con 0x7f7a18069b20 2023-09-21T13:09:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800e9a0 tx=0x7f7a0800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a0e7fc700 1 -- 172.21.15.142:0/3548684606 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08009790 con 0x7f7a18069b20 2023-09-21T13:09:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1819e840 con 0x7f7a18069b20 2023-09-21T13:09:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a0e7fc700 1 -- 172.21.15.142:0/3548684606 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a0800cbd0 con 0x7f7a18069b20 2023-09-21T13:09:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a0e7fc700 1 -- 172.21.15.142:0/3548684606 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08018680 con 0x7f7a18069b20 2023-09-21T13:09:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.050+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a181a6080 con 0x7f7a18069b20 2023-09-21T13:09:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.054+0000 7f7a0e7fc700 1 -- 172.21.15.142:0/3548684606 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7a0800cd40 con 0x7f7a18069b20 2023-09-21T13:09:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 Processor -- start 2023-09-21T13:09:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 -- start start 2023-09-21T13:09:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0881480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef08862b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef07f5c40 con 0x555ef0885e50 2023-09-21T13:09:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef07d9c10 con 0x555ef08819c0 2023-09-21T13:09:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a33030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef07d7530 con 0x555ef08810a0 2023-09-21T13:09:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.055+0000 7f7a0e7fc700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 0x7f7a040a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46322/0 (socket says 172.21.15.142:46322) 2023-09-21T13:09:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 -- 172.21.15.142:0/2400897017 learned_addr learned my addr 172.21.15.142:0/2400897017 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a0e7fc700 1 -- 172.21.15.142:0/3548684606 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a08014070 con 0x7f7a18069b20 2023-09-21T13:09:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0881480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef08862b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 0x7f7a040a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 -- 172.21.15.142:0/2400897017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 msgr2=0x555ef0881480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0881480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 -- 172.21.15.142:0/2400897017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 msgr2=0x555ef08862b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef08862b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 -- 172.21.15.142:0/2400897017 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ef05fdd80 con 0x555ef08819c0 2023-09-21T13:09:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef08862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:09:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.056+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005ee0 tx=0x7f7a14005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e35ba1489c0873ce server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 0x7f7a040a2c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a10012860 tx=0x7f7a1000b040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.059 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a037fe700 1 -- 172.21.15.142:0/2400897017 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1401d070 con 0x555ef08819c0 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a037fe700 1 -- 172.21.15.142:0/2400897017 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a1401e040 con 0x555ef08819c0 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a037fe700 1 -- 172.21.15.142:0/2400897017 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400f460 con 0x555ef08819c0 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a33030b80 1 -- 172.21.15.142:0/2400897017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 msgr2=0x555ef0885910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.057+0000 7f7a33030b80 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f7a14005ee0 tx=0x7f7a14005f10 comp rx=0 tx=0).stop 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 -- 172.21.15.142:0/2400897017 shutdown_connections 2023-09-21T13:09:22.060 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef08862b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0881480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 --2- 172.21.15.142:0/2400897017 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0885910 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 -- 172.21.15.142:0/2400897017 >> 172.21.15.142:0/2400897017 conn(0x555ef07adfa0 msgr2=0x555ef087c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 -- 172.21.15.142:0/2400897017 shutdown_connections 2023-09-21T13:09:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 -- 172.21.15.142:0/2400897017 wait complete. 2023-09-21T13:09:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.058+0000 7f7a33030b80 1 -- start start 2023-09-21T13:09:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 Processor -- start 2023-09-21T13:09:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 0x555ef088d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef08819c0 0x555ef088a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 0x555ef088af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef07d2e20 con 0x555ef08819c0 2023-09-21T13:09:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef076f6e0 con 0x555ef08810a0 2023-09-21T13:09:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef076f380 con 0x555ef0885e50 2023-09-21T13:09:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a33030b80 10 client.0 _ll_register_callbacks cb 0x555ef06b9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 0x555ef088d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 0x555ef088d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46328/0 (socket says 172.21.15.142:46328) 2023-09-21T13:09:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a1d59b700 1 -- 172.21.15.142:0/3909629709 learned_addr learned my addr 172.21.15.142:0/3909629709 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 0x555ef088af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.059+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef08819c0 0x555ef088a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 -- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 msgr2=0x555ef088d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 0x555ef088d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 -- 172.21.15.142:0/3909629709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef08819c0 msgr2=0x555ef088a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef08819c0 0x555ef088a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.065 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 -- 172.21.15.142:0/3909629709 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1810e540 con 0x555ef0885e50 2023-09-21T13:09:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 0x555ef088af50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7a10018ab0 tx=0x7f7a10004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49fc0f5a5eb91226 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.060+0000 7f7a00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:09:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1000e040 con 0x555ef0885e50 2023-09-21T13:09:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ef0743b50 con 0x555ef0885e50 2023-09-21T13:09:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a10007c80 con 0x555ef0885e50 2023-09-21T13:09:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a10018e80 con 0x555ef0885e50 2023-09-21T13:09:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 10 client.27988 fetch_fsmap learned FSMap version 44 2023-09-21T13:09:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x555ef05e6c00 con 0x555ef0885e50 2023-09-21T13:09:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a10030020 con 0x555ef0885e50 2023-09-21T13:09:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 44) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7a1002b3b0 con 0x555ef0885e50 2023-09-21T13:09:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 10 client.27988 fetch_fsmap finished waiting for FSMap version 44 2023-09-21T13:09:22.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 10 client.27988 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 20 client.27988 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef089af90 0x555ef089d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 4 client.27988 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.061+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ef084ffc0 con 0x555ef089af90 2023-09-21T13:09:22.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.062+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef089af90 0x555ef089d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.062+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef089af90 0x555ef089d380 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=288ea91f39c86cdc server_cookie=99bac97285163bd4 in_seq=0 out_seq=0 2023-09-21T13:09:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.062+0000 7f7a00ff9700 10 client.27988 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a00ff9700 1 -- 172.21.15.142:0/3909629709 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555ef084ffc0 con 0x555ef089af90 2023-09-21T13:09:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a00ff9700 10 client.27988 handle_command_reply: tid=0 2023-09-21T13:09:22.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 client.27988 shutdown 2023-09-21T13:09:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 msgr2=0x555ef088af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 0x555ef088af50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f7a10018ab0 tx=0x7f7a10004b40 comp rx=0 tx=0).stop 2023-09-21T13:09:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 shutdown_connections 2023-09-21T13:09:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef089af90 0x555ef089d380 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef0885e50 0x555ef088af50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08810a0 0x555ef088d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 --2- 172.21.15.142:0/3909629709 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef08819c0 0x555ef088a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 >> 172.21.15.142:0/3909629709 conn(0x555ef07adfa0 msgr2=0x555ef087b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a00ff9700 0 client.27988 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:22.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 shutdown_connections 2023-09-21T13:09:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.065+0000 7f7a33030b80 1 -- 172.21.15.142:0/3909629709 wait complete. 2023-09-21T13:09:22.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.066+0000 7f7a33030b80 20 client.27988 trim_cache size 0 max 16384 2023-09-21T13:09:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 Processor -- start 2023-09-21T13:09:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 -- start start 2023-09-21T13:09:22.078 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0888240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef06538c0 con 0x555ef0885e50 2023-09-21T13:09:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef087d9b0 con 0x555ef08819c0 2023-09-21T13:09:22.079 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.082+0000 7f7a33030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef0881810 con 0x555ef08810a0 2023-09-21T13:09:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1dd9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0888240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46334/0 (socket says 172.21.15.142:46334) 2023-09-21T13:09:22.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0888240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41186/0 (socket says 172.21.15.142:41186) 2023-09-21T13:09:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/1871200787 learned_addr learned my addr 172.21.15.142:0/1871200787 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/1871200787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 msgr2=0x555ef0888240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0888240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/1871200787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 msgr2=0x555ef088a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.081 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 -- 172.21.15.142:0/1871200787 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ef06241f0 con 0x555ef08819c0 2023-09-21T13:09:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.083+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7a080996b0 tx=0x7f7a08095b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22442302c59d0cab server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a03fff700 1 -- 172.21.15.142:0/1871200787 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08099080 con 0x555ef08819c0 2023-09-21T13:09:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a03fff700 1 -- 172.21.15.142:0/1871200787 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a08099e20 con 0x555ef08819c0 2023-09-21T13:09:22.083 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a03fff700 1 -- 172.21.15.142:0/1871200787 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08099980 con 0x555ef08819c0 2023-09-21T13:09:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 -- 172.21.15.142:0/1871200787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 msgr2=0x555ef0888780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.086 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7a080996b0 tx=0x7f7a08095b90 comp rx=0 tx=0).stop 2023-09-21T13:09:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 -- 172.21.15.142:0/1871200787 shutdown_connections 2023-09-21T13:09:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0888240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 --2- 172.21.15.142:0/1871200787 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef0888780 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 -- 172.21.15.142:0/1871200787 >> 172.21.15.142:0/1871200787 conn(0x555ef07adfa0 msgr2=0x555ef0883f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 -- 172.21.15.142:0/1871200787 shutdown_connections 2023-09-21T13:09:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.084+0000 7f7a33030b80 1 -- 172.21.15.142:0/1871200787 wait complete. 2023-09-21T13:09:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.085+0000 7f7a33030b80 1 -- start start 2023-09-21T13:09:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.085+0000 7f7a33030b80 1 Processor -- start 2023-09-21T13:09:22.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef08920f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef088e820 con 0x555ef0885e50 2023-09-21T13:09:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef088e990 con 0x555ef08819c0 2023-09-21T13:09:22.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ef088eb50 con 0x555ef08810a0 2023-09-21T13:09:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a33030b80 10 client.0 _ll_register_callbacks cb 0x555ef06b9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1cd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef08920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41196/0 (socket says 172.21.15.142:41196) 2023-09-21T13:09:22.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 -- 172.21.15.142:0/469557844 learned_addr learned my addr 172.21.15.142:0/469557844 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1dd9c700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 -- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 msgr2=0x555ef08920f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef08920f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 -- 172.21.15.142:0/469557844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 msgr2=0x555ef088e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:22.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 -- 172.21.15.142:0/469557844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ef05e6c00 con 0x555ef08810a0 2023-09-21T13:09:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef08920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a1d59b700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009ce0 tx=0x7f7a1401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3500ac8caabc4d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.086+0000 7f7a00ff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:09:22.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14033040 con 0x555ef08810a0 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f7a14034440 con 0x555ef08810a0 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a1401e040 con 0x555ef08810a0 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a1401d040 con 0x555ef08810a0 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 10 client.27994 fetch_fsmap learned FSMap version 44 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x7f7a181a6080 con 0x555ef08810a0 2023-09-21T13:09:22.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a1401e040 con 0x555ef08810a0 2023-09-21T13:09:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 44) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7a1400f660 con 0x555ef08810a0 2023-09-21T13:09:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 10 client.27994 fetch_fsmap finished waiting for FSMap version 44 2023-09-21T13:09:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 10 client.27994 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:22.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 20 client.27994 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef08efc30 0x555ef08f2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 4 client.27994 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:09:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.087+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555ef07cbe00 con 0x555ef08efc30 2023-09-21T13:09:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.088+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef08efc30 0x555ef08f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:22.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.088+0000 7f7a00ff9700 10 client.27994 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:22.096 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.088+0000 7f7a1cd9a700 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef08efc30 0x555ef08f2020 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752d65f81a51f45 server_cookie=c632bcbcc1425fc7 in_seq=0 out_seq=0 2023-09-21T13:09:22.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:22 smithi156 ceph-mon[134078]: pgmap v412: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2023-09-21T13:09:22.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:22 smithi142 ceph-mon[97663]: pgmap v412: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2023-09-21T13:09:22.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:22 smithi160 ceph-mon[134450]: pgmap v412: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.2 MiB/s wr, 300 op/s 2023-09-21T13:09:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a00ff9700 1 -- 172.21.15.142:0/469557844 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555ef07cbe00 con 0x555ef08efc30 2023-09-21T13:09:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a00ff9700 10 client.27994 handle_command_reply: tid=0 2023-09-21T13:09:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 client.27994 shutdown 2023-09-21T13:09:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 msgr2=0x555ef0891bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009ce0 tx=0x7f7a1401a040 comp rx=0 tx=0).stop 2023-09-21T13:09:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 shutdown_connections 2023-09-21T13:09:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x555ef08efc30 0x555ef08f2020 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x555ef0885e50 0x555ef088e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a00ff9700 0 client.27994 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555ef08810a0 0x555ef0891bb0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 --2- 172.21.15.142:0/469557844 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x555ef08819c0 0x555ef08920f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 >> 172.21.15.142:0/469557844 conn(0x555ef07adfa0 msgr2=0x555ef0888240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 shutdown_connections 2023-09-21T13:09:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.465+0000 7f7a33030b80 1 -- 172.21.15.142:0/469557844 wait complete. 2023-09-21T13:09:22.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a33030b80 20 client.27994 trim_cache size 0 max 16384 2023-09-21T13:09:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:09:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:09:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:09:22.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:09:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 msgr2=0x7f7a040a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 0x7f7a040a2c70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a10012860 tx=0x7f7a1000b040 comp rx=0 tx=0).stop 2023-09-21T13:09:22.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 msgr2=0x7f7a18199580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800e9a0 tx=0x7f7a0800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 shutdown_connections 2023-09-21T13:09:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7a040a07b0 0x7f7a040a2c70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7a18106f10 0x7f7a1819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7a18069160 0x7f7a18199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 --2- 172.21.15.142:0/3548684606 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7a18069b20 0x7f7a18199580 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.466+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 >> 172.21.15.142:0/3548684606 conn(0x7f7a18076de0 msgr2=0x7f7a180fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.467+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 shutdown_connections 2023-09-21T13:09:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:22.467+0000 7f7a1f7ff700 1 -- 172.21.15.142:0/3548684606 wait complete. 2023-09-21T13:09:22.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 1149 76.23 MB/sec warmup 3 sec latency 369.444 ms 2023-09-21T13:09:23.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 1832 65.20 MB/sec warmup 4 sec latency 85.995 ms 2023-09-21T13:09:24.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:24 smithi156 ceph-mon[134078]: pgmap v413: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2023-09-21T13:09:24.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:24 smithi142 ceph-mon[97663]: pgmap v413: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2023-09-21T13:09:24.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:24 smithi160 ceph-mon[134450]: pgmap v413: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 231 op/s 2023-09-21T13:09:24.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 2574 60.38 MB/sec warmup 5 sec latency 42.833 ms 2023-09-21T13:09:25.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:25 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:25.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:25 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:25.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:25 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:25.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 3331 60.08 MB/sec warmup 6 sec latency 77.839 ms 2023-09-21T13:09:26.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:26 smithi156 ceph-mon[134078]: pgmap v414: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2023-09-21T13:09:26.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:26 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:26.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:26 smithi142 ceph-mon[97663]: pgmap v414: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2023-09-21T13:09:26.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:26 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:26.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:26 smithi160 ceph-mon[134450]: pgmap v414: 97 pgs: 97 active+clean; 410 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 211 op/s 2023-09-21T13:09:26.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:26 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:26.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 3704 55.27 MB/sec warmup 7 sec latency 70.453 ms 2023-09-21T13:09:27.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 3878 49.07 MB/sec warmup 8 sec latency 905.508 ms 2023-09-21T13:09:28.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:28 smithi156 ceph-mon[134078]: pgmap v415: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 507 op/s 2023-09-21T13:09:28.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:28 smithi142 ceph-mon[97663]: pgmap v415: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 507 op/s 2023-09-21T13:09:28.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:28 smithi160 ceph-mon[134450]: pgmap v415: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.5 MiB/s wr, 507 op/s 2023-09-21T13:09:28.992 INFO:tasks.workunit.client.0.smithi142.stdout: 10 4120 44.01 MB/sec warmup 9 sec latency 1234.257 ms 2023-09-21T13:09:29.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 4578 41.45 MB/sec warmup 10 sec latency 74.163 ms 2023-09-21T13:09:30.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:30 smithi156 ceph-mon[134078]: pgmap v416: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2023-09-21T13:09:30.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:30 smithi142 ceph-mon[97663]: pgmap v416: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2023-09-21T13:09:30.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:30 smithi160 ceph-mon[134450]: pgmap v416: 97 pgs: 97 active+clean; 413 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 375 op/s 2023-09-21T13:09:30.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 5256 40.83 MB/sec warmup 11 sec latency 57.362 ms 2023-09-21T13:09:31.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 5901 39.36 MB/sec warmup 12 sec latency 61.002 ms 2023-09-21T13:09:32.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:32 smithi156 ceph-mon[134078]: pgmap v417: 97 pgs: 97 active+clean; 425 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-21T13:09:32.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:32 smithi142 ceph-mon[97663]: pgmap v417: 97 pgs: 97 active+clean; 425 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-21T13:09:32.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:32 smithi160 ceph-mon[134450]: pgmap v417: 97 pgs: 97 active+clean; 425 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-21T13:09:32.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 6518 40.19 MB/sec warmup 13 sec latency 56.020 ms 2023-09-21T13:09:33.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 7014 40.55 MB/sec warmup 14 sec latency 63.737 ms 2023-09-21T13:09:34.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:34 smithi156 ceph-mon[134078]: pgmap v418: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-09-21T13:09:34.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:34 smithi142 ceph-mon[97663]: pgmap v418: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-09-21T13:09:34.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:34 smithi160 ceph-mon[134450]: pgmap v418: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 409 op/s 2023-09-21T13:09:34.993 INFO:tasks.workunit.client.0.smithi142.stdout: 10 7227 38.52 MB/sec warmup 15 sec latency 86.376 ms 2023-09-21T13:09:35.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:35 smithi156 ceph-mon[134078]: pgmap v419: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2023-09-21T13:09:35.413 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:35 smithi142 ceph-mon[97663]: pgmap v419: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2023-09-21T13:09:35.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:35 smithi160 ceph-mon[134450]: pgmap v419: 97 pgs: 97 active+clean; 426 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.8 MiB/s wr, 405 op/s 2023-09-21T13:09:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 -- 172.21.15.142:0/3108873584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0488101980 msgr2=0x7f04881059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 --2- 172.21.15.142:0/3108873584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0488101980 0x7f04881059c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f047c009990 tx=0x7f047c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 -- 172.21.15.142:0/3108873584 shutdown_connections 2023-09-21T13:09:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 --2- 172.21.15.142:0/3108873584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0488100fd0 0x7f04881013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 --2- 172.21.15.142:0/3108873584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04881060f0 0x7f048810dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 --2- 172.21.15.142:0/3108873584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0488101980 0x7f04881059c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.633+0000 7f048d5ff700 1 -- 172.21.15.142:0/3108873584 >> 172.21.15.142:0/3108873584 conn(0x7f04880fc830 msgr2=0x7f04880fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.634+0000 7f048d5ff700 1 -- 172.21.15.142:0/3108873584 shutdown_connections 2023-09-21T13:09:35.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.634+0000 7f048d5ff700 1 -- 172.21.15.142:0/3108873584 wait complete. 2023-09-21T13:09:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 Processor -- start 2023-09-21T13:09:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 -- start start 2023-09-21T13:09:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 0x7f04880732c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04881060f0 0x7f0488073800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 0x7f04881a5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881a5980 con 0x7f04881060f0 2023-09-21T13:09:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881a5ac0 con 0x7f04881a3050 2023-09-21T13:09:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.635+0000 7f048d5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04881a5c30 con 0x7f0488100fd0 2023-09-21T13:09:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 0x7f04880732c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 0x7f04880732c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:50168/0 (socket says 172.21.15.142:50168) 2023-09-21T13:09:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f0486ffd700 1 -- 172.21.15.142:0/2270115958 learned_addr learned my addr 172.21.15.142:0/2270115958 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 0x7f04881a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04867fc700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04881060f0 0x7f0488073800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 -- 172.21.15.142:0/2270115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 msgr2=0x7f04880732c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 0x7f04880732c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 -- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04881060f0 msgr2=0x7f0488073800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04881060f0 0x7f0488073800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 -- 172.21.15.142:0/2270115958 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c0095f0 con 0x7f04881a3050 2023-09-21T13:09:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.636+0000 7f04877fe700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 0x7f04881a5440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f048000efc0 tx=0x7f048000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.637+0000 7f046ffff700 1 -- 172.21.15.142:0/2270115958 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480018070 con 0x7f04881a3050 2023-09-21T13:09:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.637+0000 7f046ffff700 1 -- 172.21.15.142:0/2270115958 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f048000f040 con 0x7f04881a3050 2023-09-21T13:09:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.637+0000 7f046ffff700 1 -- 172.21.15.142:0/2270115958 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048000cd40 con 0x7f04881a3050 2023-09-21T13:09:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.637+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04881a5eb0 con 0x7f04881a3050 2023-09-21T13:09:35.636 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.637+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04881a6340 con 0x7f04881a3050 2023-09-21T13:09:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.641+0000 7f046ffff700 1 -- 172.21.15.142:0/2270115958 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f0480003a00 con 0x7f04881a3050 2023-09-21T13:09:35.638 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.642+0000 7f04a0f87b80 1 Processor -- start 2023-09-21T13:09:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 -- start start 2023-09-21T13:09:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f046ffff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 0x7f04700a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.639 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb664c40 con 0x55bbbb6f09c0 2023-09-21T13:09:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb648c10 con 0x55bbbb6f4e50 2023-09-21T13:09:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb646530 con 0x55bbbb6f00a0 2023-09-21T13:09:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f046ffff700 1 -- 172.21.15.142:0/2270115958 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f04800cba70 con 0x7f04881a3050 2023-09-21T13:09:35.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04877fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04877fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51000/0 (socket says 172.21.15.142:51000) 2023-09-21T13:09:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04877fe700 1 -- 172.21.15.142:0/725677632 learned_addr learned my addr 172.21.15.142:0/725677632 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f0486ffd700 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.643+0000 7f04867fc700 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 -- 172.21.15.142:0/725677632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f00a0 msgr2=0x55bbbb6f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04867fc700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 0x7f04700a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 -- 172.21.15.142:0/725677632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 msgr2=0x55bbbb6f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 -- 172.21.15.142:0/725677632 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbbb46cd80 con 0x55bbbb6f4e50 2023-09-21T13:09:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f04877fe700 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04800090a0 tx=0x7f0480095370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f470107a80d73fc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f046d7fa700 1 -- 172.21.15.142:0/725677632 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480098910 con 0x55bbbb6f4e50 2023-09-21T13:09:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f046d7fa700 1 -- 172.21.15.142:0/725677632 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04800ab220 con 0x55bbbb6f4e50 2023-09-21T13:09:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.644+0000 7f046d7fa700 1 -- 172.21.15.142:0/725677632 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800aacc0 con 0x55bbbb6f4e50 2023-09-21T13:09:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- 172.21.15.142:0/725677632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 msgr2=0x55bbbb6f52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04867fc700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 0x7f04700a2cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0488074ae0 tx=0x7f047c005fb0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f04800090a0 tx=0x7f0480095370 comp rx=0 tx=0).stop 2023-09-21T13:09:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- 172.21.15.142:0/725677632 shutdown_connections 2023-09-21T13:09:35.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6f52b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/725677632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- 172.21.15.142:0/725677632 >> 172.21.15.142:0/725677632 conn(0x55bbbb61cfa0 msgr2=0x55bbbb6eb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- 172.21.15.142:0/725677632 shutdown_connections 2023-09-21T13:09:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- 172.21.15.142:0/725677632 wait complete. 2023-09-21T13:09:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.645+0000 7f04a0f87b80 1 -- start start 2023-09-21T13:09:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 Processor -- start 2023-09-21T13:09:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb641e20 con 0x55bbbb6f09c0 2023-09-21T13:09:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb5de6e0 con 0x55bbbb6f00a0 2023-09-21T13:09:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb5de380 con 0x55bbbb6f4e50 2023-09-21T13:09:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.646+0000 7f04a0f87b80 10 client.0 _ll_register_callbacks cb 0x55bbbb528a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:35.650 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51012/0 (socket says 172.21.15.142:51012) 2023-09-21T13:09:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 -- 172.21.15.142:0/1985933600 learned_addr learned my addr 172.21.15.142:0/1985933600 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f04877fe700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.651 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f04867fc700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 -- 172.21.15.142:0/1985933600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 msgr2=0x55bbbb6fa410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6fa410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 -- 172.21.15.142:0/1985933600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 msgr2=0x55bbbb6f9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.647+0000 7f0486ffd700 1 -- 172.21.15.142:0/1985933600 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04881a6340 con 0x55bbbb6f00a0 2023-09-21T13:09:35.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0478012860 tx=0x7f0478012c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d181c825f90bd5f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f046aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478017070 con 0x55bbbb6f00a0 2023-09-21T13:09:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f047800f830 con 0x55bbbb6f00a0 2023-09-21T13:09:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbbb5b2b50 con 0x55bbbb6f00a0 2023-09-21T13:09:35.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04780122e0 con 0x55bbbb6f00a0 2023-09-21T13:09:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f04a0f87b80 10 client.28070 fetch_fsmap learned FSMap version 46 2023-09-21T13:09:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55bbbb455c00 con 0x55bbbb6f00a0 2023-09-21T13:09:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.648+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0478028080 con 0x55bbbb6f00a0 2023-09-21T13:09:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 46) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0478022030 con 0x55bbbb6f00a0 2023-09-21T13:09:35.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 10 client.28070 fetch_fsmap finished waiting for FSMap version 46 2023-09-21T13:09:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 10 client.28070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 20 client.28070 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb712880 0x55bbbb714ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 4 client.28070 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbbb6befc0 con 0x55bbbb712880 2023-09-21T13:09:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.649+0000 7f04867fc700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb712880 0x55bbbb714ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.650+0000 7f046aff5700 10 client.28070 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:35.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.650+0000 7f04867fc700 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb712880 0x55bbbb714ca0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5fce116224aadef server_cookie=6be8f7c26821dca8 in_seq=0 out_seq=0 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f046aff5700 1 -- 172.21.15.142:0/1985933600 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bbbb6befc0 con 0x55bbbb712880 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f046aff5700 10 client.28070 handle_command_reply: tid=0 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 client.28070 shutdown 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 msgr2=0x55bbbb6f9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0478012860 tx=0x7f0478012c20 comp rx=0 tx=0).stop 2023-09-21T13:09:35.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 shutdown_connections 2023-09-21T13:09:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb712880 0x55bbbb714ca0 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb6fa410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f9990 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1985933600 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f046aff5700 0 client.28070 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.652+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 >> 172.21.15.142:0/1985933600 conn(0x55bbbb61cfa0 msgr2=0x55bbbb6ea350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.653+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 shutdown_connections 2023-09-21T13:09:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.653+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1985933600 wait complete. 2023-09-21T13:09:35.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.653+0000 7f04a0f87b80 20 client.28070 trim_cache size 0 max 16384 2023-09-21T13:09:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.670+0000 7f04a0f87b80 1 Processor -- start 2023-09-21T13:09:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.670+0000 7f04a0f87b80 1 -- start start 2023-09-21T13:09:35.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb700fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb4c28c0 con 0x55bbbb6f09c0 2023-09-21T13:09:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb6ec940 con 0x55bbbb6f00a0 2023-09-21T13:09:35.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb6ebf20 con 0x55bbbb6f4e50 2023-09-21T13:09:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04867fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51026/0 (socket says 172.21.15.142:51026) 2023-09-21T13:09:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04867fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:50414/0 (socket says 172.21.15.142:50414) 2023-09-21T13:09:35.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 -- 172.21.15.142:0/851917472 learned_addr learned my addr 172.21.15.142:0/851917472 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:35.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04877fe700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb700fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 -- 172.21.15.142:0/851917472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 msgr2=0x55bbbb700fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb700fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 -- 172.21.15.142:0/851917472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 msgr2=0x55bbbb6f47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f0486ffd700 1 -- 172.21.15.142:0/851917472 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbbb705a00 con 0x55bbbb6f00a0 2023-09-21T13:09:35.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04867fc700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:35.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.671+0000 7f04877fe700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb700fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:35.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.672+0000 7f0486ffd700 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f04780096b0 tx=0x7f047800f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9220a7b97346c98e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.672+0000 7f046dffb700 1 -- 172.21.15.142:0/851917472 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478017040 con 0x55bbbb6f00a0 2023-09-21T13:09:35.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.672+0000 7f046dffb700 1 -- 172.21.15.142:0/851917472 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbbb5b2b50 con 0x55bbbb6f00a0 2023-09-21T13:09:35.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.672+0000 7f046dffb700 1 -- 172.21.15.142:0/851917472 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478010430 con 0x55bbbb6f00a0 2023-09-21T13:09:35.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- 172.21.15.142:0/851917472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 msgr2=0x55bbbb6f2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:35.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f04780096b0 tx=0x7f047800f6a0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- 172.21.15.142:0/851917472 shutdown_connections 2023-09-21T13:09:35.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f4e50 0x55bbbb700fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6f2740 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/851917472 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6f47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- 172.21.15.142:0/851917472 >> 172.21.15.142:0/851917472 conn(0x55bbbb61cfa0 msgr2=0x55bbbb6f7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- 172.21.15.142:0/851917472 shutdown_connections 2023-09-21T13:09:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- 172.21.15.142:0/851917472 wait complete. 2023-09-21T13:09:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 -- start start 2023-09-21T13:09:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.673+0000 7f04a0f87b80 1 Processor -- start 2023-09-21T13:09:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6fde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f4e50 0x55bbbb7666d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb6fe5a0 con 0x55bbbb6f4e50 2023-09-21T13:09:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb6fe710 con 0x55bbbb6f00a0 2023-09-21T13:09:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbbb766c10 con 0x55bbbb6f09c0 2023-09-21T13:09:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04a0f87b80 10 client.0 _ll_register_callbacks cb 0x55bbbb528a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:35.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51034/0 (socket says 172.21.15.142:51034) 2023-09-21T13:09:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 -- 172.21.15.142:0/1341964564 learned_addr learned my addr 172.21.15.142:0/1341964564 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04867fc700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6fde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04877fe700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f4e50 0x55bbbb7666d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 -- 172.21.15.142:0/1341964564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 msgr2=0x55bbbb6fde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6fde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 -- 172.21.15.142:0/1341964564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f4e50 msgr2=0x55bbbb7666d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f4e50 0x55bbbb7666d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f0486ffd700 1 -- 172.21.15.142:0/1341964564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c020040 con 0x55bbbb6f00a0 2023-09-21T13:09:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.674+0000 7f04867fc700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f0486ffd700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0478005790 tx=0x7f04780057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c6f59dfd36a4d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f046aff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0478017030 con 0x55bbbb6f00a0 2023-09-21T13:09:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04800ab220 con 0x55bbbb6f00a0 2023-09-21T13:09:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f047802b040 con 0x55bbbb6f00a0 2023-09-21T13:09:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0478009260 con 0x55bbbb6f00a0 2023-09-21T13:09:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f04a0f87b80 10 client.28076 fetch_fsmap learned FSMap version 46 2023-09-21T13:09:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55bbbb46cd80 con 0x55bbbb6f00a0 2023-09-21T13:09:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.675+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04800ab220 con 0x55bbbb6f00a0 2023-09-21T13:09:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 46) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0478036070 con 0x55bbbb6f00a0 2023-09-21T13:09:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 10 client.28076 fetch_fsmap finished waiting for FSMap version 46 2023-09-21T13:09:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 10 client.28076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 20 client.28076 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb767fd0 0x55bbbb76a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 4 client.28076 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:09:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bbbb63ae00 con 0x55bbbb767fd0 2023-09-21T13:09:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04867fc700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb767fd0 0x55bbbb76a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f04867fc700 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb767fd0 0x55bbbb76a3c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7736193f24cb054 server_cookie=8e4ef49709fe562a in_seq=0 out_seq=0 2023-09-21T13:09:35.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:35.676+0000 7f046aff5700 10 client.28076 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:35.994 INFO:tasks.workunit.client.0.smithi142.stdout: 10 7325 36.12 MB/sec warmup 16 sec latency 183.583 ms 2023-09-21T13:09:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.258+0000 7f046aff5700 1 -- 172.21.15.142:0/1341964564 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bbbb63ae00 con 0x55bbbb767fd0 2023-09-21T13:09:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.258+0000 7f046aff5700 10 client.28076 handle_command_reply: tid=0 2023-09-21T13:09:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 client.28076 shutdown 2023-09-21T13:09:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 msgr2=0x55bbbb6fd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0478005790 tx=0x7f04780057c0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 shutdown_connections 2023-09-21T13:09:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55bbbb767fd0 0x55bbbb76a3c0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55bbbb6f4e50 0x55bbbb7666d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55bbbb6f00a0 0x55bbbb6fd8f0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 --2- 172.21.15.142:0/1341964564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55bbbb6f09c0 0x55bbbb6fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 >> 172.21.15.142:0/1341964564 conn(0x55bbbb61cfa0 msgr2=0x55bbbb6eaba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.259+0000 7f046aff5700 0 client.28076 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.260+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 shutdown_connections 2023-09-21T13:09:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.260+0000 7f04a0f87b80 1 -- 172.21.15.142:0/1341964564 wait complete. 2023-09-21T13:09:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.260+0000 7f04a0f87b80 20 client.28076 trim_cache size 0 max 16384 2023-09-21T13:09:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:09:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:09:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:09:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:09:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 msgr2=0x7f04700a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 0x7f04700a2cf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0488074ae0 tx=0x7f047c005fb0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 msgr2=0x7f04881a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 0x7f04881a5440 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f048000efc0 tx=0x7f048000c3a0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 shutdown_connections 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f04700a0830 0x7f04700a2cf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f04881a3050 0x7f04881a5440 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0488100fd0 0x7f04880732c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 --2- 172.21.15.142:0/2270115958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f04881060f0 0x7f0488073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.261+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 >> 172.21.15.142:0/2270115958 conn(0x7f04880fc830 msgr2=0x7f04880fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.262+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 shutdown_connections 2023-09-21T13:09:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:36.264+0000 7f048d5ff700 1 -- 172.21.15.142:0/2270115958 wait complete. 2023-09-21T13:09:36.994 INFO:tasks.workunit.client.0.smithi142.stdout: 10 7533 34.12 MB/sec warmup 17 sec latency 254.149 ms 2023-09-21T13:09:37.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:37 smithi142 ceph-mon[97663]: pgmap v420: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 533 op/s 2023-09-21T13:09:37.932 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:37 smithi160 ceph-mon[134450]: pgmap v420: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 533 op/s 2023-09-21T13:09:37.994 INFO:tasks.workunit.client.0.smithi142.stdout: 10 7897 32.77 MB/sec warmup 18 sec latency 56.239 ms 2023-09-21T13:09:38.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:37 smithi156 ceph-mon[134078]: pgmap v420: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 10 MiB/s wr, 533 op/s 2023-09-21T13:09:38.994 INFO:tasks.workunit.client.0.smithi142.stdout: 10 8477 33.29 MB/sec warmup 19 sec latency 67.258 ms 2023-09-21T13:09:39.911 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:39 smithi142 ceph-mon[97663]: pgmap v421: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.5 MiB/s wr, 237 op/s 2023-09-21T13:09:39.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:39 smithi160 ceph-mon[134450]: pgmap v421: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.5 MiB/s wr, 237 op/s 2023-09-21T13:09:39.994 INFO:tasks.workunit.client.0.smithi142.stdout: 10 9286 32.73 MB/sec warmup 20 sec latency 39.783 ms 2023-09-21T13:09:40.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:39 smithi156 ceph-mon[134078]: pgmap v421: 97 pgs: 97 active+clean; 509 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 8.5 MiB/s wr, 237 op/s 2023-09-21T13:09:40.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 9358 31.39 MB/sec warmup 21 sec latency 391.298 ms 2023-09-21T13:09:41.932 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:41 smithi160 ceph-mon[134450]: pgmap v422: 97 pgs: 97 active+clean; 546 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 541 op/s 2023-09-21T13:09:41.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 9388 30.18 MB/sec warmup 22 sec latency 753.772 ms 2023-09-21T13:09:42.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:41 smithi156 ceph-mon[134078]: pgmap v422: 97 pgs: 97 active+clean; 546 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 541 op/s 2023-09-21T13:09:42.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:41 smithi142 ceph-mon[97663]: pgmap v422: 97 pgs: 97 active+clean; 546 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 541 op/s 2023-09-21T13:09:42.932 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:42 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:09:42.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 9876 30.76 MB/sec warmup 23 sec latency 118.640 ms 2023-09-21T13:09:43.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:42 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:09:43.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:42 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:09:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:43 smithi160 ceph-mon[134450]: pgmap v423: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 495 op/s 2023-09-21T13:09:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:43 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:09:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:43 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:09:43.933 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:43 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:09:43.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 10382 31.29 MB/sec warmup 24 sec latency 105.721 ms 2023-09-21T13:09:44.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:43 smithi156 ceph-mon[134078]: pgmap v423: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 495 op/s 2023-09-21T13:09:44.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:43 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:09:44.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:43 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:09:44.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:43 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:09:44.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:43 smithi142 ceph-mon[97663]: pgmap v423: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 15 MiB/s wr, 495 op/s 2023-09-21T13:09:44.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:43 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:09:44.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:43 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:09:44.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:43 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:09:44.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 10611 30.47 MB/sec warmup 25 sec latency 117.350 ms 2023-09-21T13:09:45.932 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:45 smithi160 ceph-mon[134450]: pgmap v424: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 14 MiB/s wr, 490 op/s 2023-09-21T13:09:45.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 10784 29.46 MB/sec warmup 26 sec latency 118.972 ms 2023-09-21T13:09:46.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:45 smithi156 ceph-mon[134078]: pgmap v424: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 14 MiB/s wr, 490 op/s 2023-09-21T13:09:46.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:45 smithi142 ceph-mon[97663]: pgmap v424: 97 pgs: 97 active+clean; 564 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 14 MiB/s wr, 490 op/s 2023-09-21T13:09:46.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 11009 28.51 MB/sec warmup 27 sec latency 199.408 ms 2023-09-21T13:09:47.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 11594 28.28 MB/sec warmup 28 sec latency 361.019 ms 2023-09-21T13:09:48.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:47 smithi156 ceph-mon[134078]: pgmap v425: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 25 MiB/s wr, 744 op/s 2023-09-21T13:09:48.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:47 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:48.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:47 smithi142 ceph-mon[97663]: pgmap v425: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 25 MiB/s wr, 744 op/s 2023-09-21T13:09:48.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:47 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:48.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:47 smithi160 ceph-mon[134450]: pgmap v425: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 25 MiB/s wr, 744 op/s 2023-09-21T13:09:48.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:47 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:48.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 12648 29.26 MB/sec warmup 29 sec latency 44.015 ms 2023-09-21T13:09:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 -- 172.21.15.142:0/1593996353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe654101010 msgr2=0x7fe6541013f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/1593996353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe654101010 0x7fe6541013f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe650009990 tx=0x7fe650009ca0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 -- 172.21.15.142:0/1593996353 shutdown_connections 2023-09-21T13:09:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/1593996353 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe65410dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/1593996353 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe654101010 0x7fe6541013f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/1593996353 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe6541019c0 0x7fe654105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 -- 172.21.15.142:0/1593996353 >> 172.21.15.142:0/1593996353 conn(0x7fe6540fc8b0 msgr2=0x7fe6540fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.487+0000 7fe65b9ff700 1 -- 172.21.15.142:0/1593996353 shutdown_connections 2023-09-21T13:09:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.488+0000 7fe65b9ff700 1 -- 172.21.15.142:0/1593996353 wait complete. 2023-09-21T13:09:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.489+0000 7fe65b9ff700 1 Processor -- start 2023-09-21T13:09:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.489+0000 7fe65b9ff700 1 -- start start 2023-09-21T13:09:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654101010 0x7fe6541990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 0x7fe65419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65419e6e0 con 0x7fe654101010 2023-09-21T13:09:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65419e850 con 0x7fe65419dc60 2023-09-21T13:09:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65b9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65419ea10 con 0x7fe654106130 2023-09-21T13:09:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe658f9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe658f9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57926/0 (socket says 172.21.15.142:57926) 2023-09-21T13:09:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe658f9a700 1 -- 172.21.15.142:0/660992054 learned_addr learned my addr 172.21.15.142:0/660992054 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe65979b700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654101010 0x7fe6541990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.490+0000 7fe659f9c700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 0x7fe65419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 -- 172.21.15.142:0/660992054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 msgr2=0x7fe65419e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 0x7fe65419e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 -- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654101010 msgr2=0x7fe6541990b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654101010 0x7fe6541990b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 -- 172.21.15.142:0/660992054 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009c40 con 0x7fe654106130 2023-09-21T13:09:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe659f9c700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 0x7fe65419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:09:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe658f9a700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d950 tx=0x7fe64400dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe64a7fc700 1 -- 172.21.15.142:0/660992054 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64400bb60 con 0x7fe654106130 2023-09-21T13:09:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe64a7fc700 1 -- 172.21.15.142:0/660992054 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe644007620 con 0x7fe654106130 2023-09-21T13:09:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe64a7fc700 1 -- 172.21.15.142:0/660992054 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644005560 con 0x7fe654106130 2023-09-21T13:09:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.491+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6500095f0 con 0x7fe654106130 2023-09-21T13:09:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.492+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6541a6210 con 0x7fe654106130 2023-09-21T13:09:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.496+0000 7fe64a7fc700 1 -- 172.21.15.142:0/660992054 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe644004020 con 0x7fe654106130 2023-09-21T13:09:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.497+0000 7fe66f366b80 1 Processor -- start 2023-09-21T13:09:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 -- start start 2023-09-21T13:09:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1644fc40 con 0x55fb164dfe50 2023-09-21T13:09:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb16433c10 con 0x55fb164db0a0 2023-09-21T13:09:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe66f366b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb16431530 con 0x55fb164db9c0 2023-09-21T13:09:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe659f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe659f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38374/0 (socket says 172.21.15.142:38374) 2023-09-21T13:09:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.498+0000 7fe659f9c700 1 -- 172.21.15.142:0/4012484384 learned_addr learned my addr 172.21.15.142:0/4012484384 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe64a7fc700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 0x7fe6400a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe65979b700 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe64a7fc700 1 -- 172.21.15.142:0/660992054 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe6440cbb40 con 0x7fe654106130 2023-09-21T13:09:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 -- 172.21.15.142:0/4012484384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 msgr2=0x55fb164df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164df910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 -- 172.21.15.142:0/4012484384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 msgr2=0x55fb164e02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 -- 172.21.15.142:0/4012484384 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb16257d80 con 0x55fb164db0a0 2023-09-21T13:09:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 0x7fe6400a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.499+0000 7fe659f9c700 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe64c007740 tx=0x7fe64c007a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97c7acb10d4cf41 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.500+0000 7fe63f7fe700 1 -- 172.21.15.142:0/4012484384 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c00e030 con 0x55fb164db0a0 2023-09-21T13:09:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.500+0000 7fe63f7fe700 1 -- 172.21.15.142:0/4012484384 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe64c00f040 con 0x55fb164db0a0 2023-09-21T13:09:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.500+0000 7fe63f7fe700 1 -- 172.21.15.142:0/4012484384 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c0145e0 con 0x55fb164db0a0 2023-09-21T13:09:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 -- 172.21.15.142:0/4012484384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 msgr2=0x55fb164db480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe659f9c700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 0x7fe6400a2d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01f000 tx=0x7fe64c014c10 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe64c007740 tx=0x7fe64c007a50 comp rx=0 tx=0).stop 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 -- 172.21.15.142:0/4012484384 shutdown_connections 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164db480 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 --2- 172.21.15.142:0/4012484384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164df910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 -- 172.21.15.142:0/4012484384 >> 172.21.15.142:0/4012484384 conn(0x55fb16407fa0 msgr2=0x55fb164d60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.501+0000 7fe66f366b80 1 -- 172.21.15.142:0/4012484384 shutdown_connections 2023-09-21T13:09:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.502+0000 7fe66f366b80 1 -- 172.21.15.142:0/4012484384 wait complete. 2023-09-21T13:09:49.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.502+0000 7fe66f366b80 1 -- start start 2023-09-21T13:09:49.502 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.503+0000 7fe66f366b80 1 Processor -- start 2023-09-21T13:09:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb1642ce20 con 0x55fb164dfe50 2023-09-21T13:09:49.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb163c96e0 con 0x55fb164db0a0 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb163c9380 con 0x55fb164db9c0 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe66f366b80 10 client.0 _ll_register_callbacks cb 0x55fb16313a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe65979b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe65979b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38382/0 (socket says 172.21.15.142:38382) 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe658f9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe65979b700 1 -- 172.21.15.142:0/2493253586 learned_addr learned my addr 172.21.15.142:0/2493253586 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:49.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe659f9c700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe658f9a700 1 -- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 msgr2=0x55fb164e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe658f9a700 1 -- 172.21.15.142:0/2493253586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 msgr2=0x55fb164e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.504+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe658f9a700 1 -- 172.21.15.142:0/2493253586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64c009330 con 0x55fb164db9c0 2023-09-21T13:09:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e4880 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe6440c9230 tx=0x7fe6440988f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cd10d880e5c8b3c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe63cff9700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:09:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe644098f90 con 0x55fb164db9c0 2023-09-21T13:09:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe64409cdc0 con 0x55fb164db9c0 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb1639db50 con 0x55fb164db9c0 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6440a1000 con 0x55fb164db9c0 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe66f366b80 10 client.28024 fetch_fsmap learned FSMap version 47 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.505+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55fb16240c00 con 0x55fb164db9c0 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.506+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb1639db50 con 0x55fb164db9c0 2023-09-21T13:09:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 47) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe6440991f0 con 0x55fb164db9c0 2023-09-21T13:09:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 10 client.28024 fetch_fsmap finished waiting for FSMap version 47 2023-09-21T13:09:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 10 client.28024 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 20 client.28024 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb164f4fb0 0x55fb164f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 4 client.28024 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb164a9fc0 con 0x55fb164f4fb0 2023-09-21T13:09:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.507+0000 7fe65979b700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb164f4fb0 0x55fb164f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.508+0000 7fe63cff9700 10 client.28024 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.508+0000 7fe65979b700 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb164f4fb0 0x55fb164f73d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b2595c474822bfb server_cookie=633e117572e198dc in_seq=0 out_seq=0 2023-09-21T13:09:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.511+0000 7fe63cff9700 1 -- 172.21.15.142:0/2493253586 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb164a9fc0 con 0x55fb164f4fb0 2023-09-21T13:09:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.511+0000 7fe63cff9700 10 client.28024 handle_command_reply: tid=0 2023-09-21T13:09:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.511+0000 7fe66f366b80 1 client.28024 shutdown 2023-09-21T13:09:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 msgr2=0x55fb164e4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e4880 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe6440c9230 tx=0x7fe6440988f0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 shutdown_connections 2023-09-21T13:09:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb164f4fb0 0x55fb164f73d0 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2493253586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e4880 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 >> 172.21.15.142:0/2493253586 conn(0x55fb16407fa0 msgr2=0x55fb164d5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe63cff9700 0 client.28024 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 shutdown_connections 2023-09-21T13:09:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 1 -- 172.21.15.142:0/2493253586 wait complete. 2023-09-21T13:09:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.512+0000 7fe66f366b80 20 client.28024 trim_cache size 0 max 16384 2023-09-21T13:09:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 Processor -- start 2023-09-21T13:09:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 -- start start 2023-09-21T13:09:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164ddee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb162ad8c0 con 0x55fb164dfe50 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb164dc190 con 0x55fb164db0a0 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe66f366b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb164cdcd0 con 0x55fb164db9c0 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.541+0000 7fe658f9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57962/0 (socket says 172.21.15.142:57962) 2023-09-21T13:09:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 -- 172.21.15.142:0/1829212491 learned_addr learned my addr 172.21.15.142:0/1829212491 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe65979b700 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 -- 172.21.15.142:0/1829212491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 msgr2=0x55fb164e1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 -- 172.21.15.142:0/1829212491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 msgr2=0x55fb164ddee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164ddee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 -- 172.21.15.142:0/1829212491 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb1627e1f0 con 0x55fb164db9c0 2023-09-21T13:09:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe658f9a700 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe6440995f0 tx=0x7fe644000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69715caefd340bfd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.542+0000 7fe63ffff700 1 -- 172.21.15.142:0/1829212491 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64409cdc0 con 0x55fb164db9c0 2023-09-21T13:09:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.543+0000 7fe63ffff700 1 -- 172.21.15.142:0/1829212491 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe644098f90 con 0x55fb164db9c0 2023-09-21T13:09:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.543+0000 7fe63ffff700 1 -- 172.21.15.142:0/1829212491 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6440042d0 con 0x55fb164db9c0 2023-09-21T13:09:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- 172.21.15.142:0/1829212491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 msgr2=0x55fb164e71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fe6440995f0 tx=0x7fe644000bc0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- 172.21.15.142:0/1829212491 shutdown_connections 2023-09-21T13:09:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164dfe50 0x55fb164ddee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164db0a0 0x55fb164e1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 --2- 172.21.15.142:0/1829212491 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164e71a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- 172.21.15.142:0/1829212491 >> 172.21.15.142:0/1829212491 conn(0x55fb16407fa0 msgr2=0x55fb164f07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- 172.21.15.142:0/1829212491 shutdown_connections 2023-09-21T13:09:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- 172.21.15.142:0/1829212491 wait complete. 2023-09-21T13:09:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.544+0000 7fe66f366b80 1 -- start start 2023-09-21T13:09:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 Processor -- start 2023-09-21T13:09:49.543 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 0x55fb164eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb16547da0 con 0x55fb164db0a0 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb16547ee0 con 0x55fb164dfe50 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.545+0000 7fe66f366b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb16548020 con 0x55fb164db9c0 2023-09-21T13:09:49.544 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.546+0000 7fe66f366b80 10 client.0 _ll_register_callbacks cb 0x55fb16313a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:49.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.546+0000 7fe65979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.546+0000 7fe65979b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48528/0 (socket says 172.21.15.142:48528) 2023-09-21T13:09:49.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.546+0000 7fe65979b700 1 -- 172.21.15.142:0/2734388846 learned_addr learned my addr 172.21.15.142:0/2734388846 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:49.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.546+0000 7fe65979b700 1 -- 172.21.15.142:0/2734388846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 msgr2=0x55fb164ea590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:09:49.545 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe659f9c700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 0x55fb164eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe65979b700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe65979b700 1 -- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 msgr2=0x55fb164eaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe65979b700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 0x55fb164eaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe65979b700 1 -- 172.21.15.142:0/2734388846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb16240c00 con 0x55fb164db0a0 2023-09-21T13:09:49.546 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe659f9c700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 0x55fb164eaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:09:49.547 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:09:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe65979b700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098e0 tx=0x7fe65000b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99f71369f095f07 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe63cff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:09:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650029cf0 con 0x55fb164db0a0 2023-09-21T13:09:49.548 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fe650029130 con 0x55fb164db0a0 2023-09-21T13:09:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.547+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe64c00f040 con 0x55fb164db0a0 2023-09-21T13:09:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.548+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe650029e50 con 0x55fb164db0a0 2023-09-21T13:09:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.548+0000 7fe66f366b80 10 client.17967 fetch_fsmap learned FSMap version 47 2023-09-21T13:09:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.548+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55fb16256250 con 0x55fb164db0a0 2023-09-21T13:09:49.549 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.548+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe64c00f040 con 0x55fb164db0a0 2023-09-21T13:09:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.548+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 47) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fe65002f030 con 0x55fb164db0a0 2023-09-21T13:09:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 10 client.17967 fetch_fsmap finished waiting for FSMap version 47 2023-09-21T13:09:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 10 client.17967 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 20 client.17967 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:49.550 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb16549640 0x55fb1654ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 4 client.17967 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:09:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fb16425e00 con 0x55fb16549640 2023-09-21T13:09:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.549+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb16549640 0x55fb1654ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.550+0000 7fe658f9a700 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb16549640 0x55fb1654ba60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6deda86d63e47128 server_cookie=aac28e20eafab4e3 in_seq=0 out_seq=0 2023-09-21T13:09:49.551 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.550+0000 7fe63cff9700 10 client.17967 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:49.916 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.922+0000 7fe63cff9700 1 -- 172.21.15.142:0/2734388846 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fb16425e00 con 0x55fb16549640 2023-09-21T13:09:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.922+0000 7fe63cff9700 10 client.17967 handle_command_reply: tid=0 2023-09-21T13:09:49.917 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.922+0000 7fe66f366b80 1 client.17967 shutdown 2023-09-21T13:09:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 msgr2=0x55fb164ea050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe6500098e0 tx=0x7fe65000b2a0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 shutdown_connections 2023-09-21T13:09:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fb16549640 0x55fb1654ba60 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fb164db0a0 0x55fb164ea050 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fb164dfe50 0x55fb164eaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 --2- 172.21.15.142:0/2734388846 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fb164db9c0 0x55fb164ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe63cff9700 0 client.17967 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.924+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 >> 172.21.15.142:0/2734388846 conn(0x55fb16407fa0 msgr2=0x55fb164ddee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.925+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 shutdown_connections 2023-09-21T13:09:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.926+0000 7fe66f366b80 1 -- 172.21.15.142:0/2734388846 wait complete. 2023-09-21T13:09:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.926+0000 7fe66f366b80 20 client.17967 trim_cache size 0 max 16384 2023-09-21T13:09:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:09:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:09:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:09:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:09:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 msgr2=0x7fe6400a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 0x7fe6400a2d70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe64c01f000 tx=0x7fe64c014c10 comp rx=0 tx=0).stop 2023-09-21T13:09:49.923 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 msgr2=0x7fe6541995f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe64400d950 tx=0x7fe64400dd10 comp rx=0 tx=0).stop 2023-09-21T13:09:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 shutdown_connections 2023-09-21T13:09:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe6400a08b0 0x7fe6400a2d70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe654101010 0x7fe6541990b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe65419dc60 0x7fe65419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 --2- 172.21.15.142:0/660992054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe654106130 0x7fe6541995f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.927+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 >> 172.21.15.142:0/660992054 conn(0x7fe6540fc8b0 msgr2=0x7fe65410cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.928+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 shutdown_connections 2023-09-21T13:09:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:09:49.928+0000 7fe65b9ff700 1 -- 172.21.15.142:0/660992054 wait complete. 2023-09-21T13:09:49.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 13306 29.31 MB/sec warmup 30 sec latency 225.053 ms 2023-09-21T13:09:50.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:49 smithi156 ceph-mon[134078]: pgmap v426: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 18 MiB/s wr, 617 op/s 2023-09-21T13:09:50.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:49 smithi142 ceph-mon[97663]: pgmap v426: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 18 MiB/s wr, 617 op/s 2023-09-21T13:09:50.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:49 smithi160 ceph-mon[134450]: pgmap v426: 97 pgs: 97 active+clean; 627 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 18 MiB/s wr, 617 op/s 2023-09-21T13:09:50.357 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:09:50.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 -- 172.21.15.142:0/2080265761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 msgr2=0x7fd324101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/2080265761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324101380 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd314009990 tx=0x7fd314009ca0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 -- 172.21.15.142:0/2080265761 shutdown_connections 2023-09-21T13:09:50.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/2080265761 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd32410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/2080265761 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324101380 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/2080265761 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd324101950 0x7fd324105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.634+0000 7fd32a9ff700 1 -- 172.21.15.142:0/2080265761 >> 172.21.15.142:0/2080265761 conn(0x7fd3240fc860 msgr2=0x7fd3240fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.635+0000 7fd32a9ff700 1 -- 172.21.15.142:0/2080265761 shutdown_connections 2023-09-21T13:09:50.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.635+0000 7fd32a9ff700 1 -- 172.21.15.142:0/2080265761 wait complete. 2023-09-21T13:09:50.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.636+0000 7fd32a9ff700 1 Processor -- start 2023-09-21T13:09:50.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.636+0000 7fd32a9ff700 1 -- start start 2023-09-21T13:09:50.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd324199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 0x7fd32419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32419e520 con 0x7fd3241060c0 2023-09-21T13:09:50.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32419e690 con 0x7fd32419daa0 2023-09-21T13:09:50.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd32a9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32419e850 con 0x7fd324100fa0 2023-09-21T13:09:50.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd3237fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd324199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57996/0 (socket says 172.21.15.142:57996) 2023-09-21T13:09:50.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.637+0000 7fd323fff700 1 -- 172.21.15.142:0/522743692 learned_addr learned my addr 172.21.15.142:0/522743692 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:50.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd328f9c700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 0x7fd32419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 -- 172.21.15.142:0/522743692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 msgr2=0x7fd32419df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 0x7fd32419df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 -- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 msgr2=0x7fd324199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd324199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 -- 172.21.15.142:0/522743692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140095f0 con 0x7fd324100fa0 2023-09-21T13:09:50.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd328f9c700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 0x7fd32419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:09:50.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd3237fe700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd324199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:50.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.638+0000 7fd323fff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd314005910 tx=0x7fd314009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.639+0000 7fd3217fa700 1 -- 172.21.15.142:0/522743692 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31401d070 con 0x7fd324100fa0 2023-09-21T13:09:50.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.639+0000 7fd3217fa700 1 -- 172.21.15.142:0/522743692 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3140040e0 con 0x7fd324100fa0 2023-09-21T13:09:50.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.639+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3241a5d50 con 0x7fd324100fa0 2023-09-21T13:09:50.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.639+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3241a6170 con 0x7fd324100fa0 2023-09-21T13:09:50.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.639+0000 7fd3217fa700 1 -- 172.21.15.142:0/522743692 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400f460 con 0x7fd324100fa0 2023-09-21T13:09:50.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.644+0000 7fd3217fa700 1 -- 172.21.15.142:0/522743692 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd314003c20 con 0x7fd324100fa0 2023-09-21T13:09:50.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.645+0000 7fd33e400b80 1 Processor -- start 2023-09-21T13:09:50.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 -- start start 2023-09-21T13:09:50.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b709f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b74e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188ae4ca0 con 0x560188b70f30 2023-09-21T13:09:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188ac8c70 con 0x560188b75360 2023-09-21T13:09:50.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd33e400b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188ac6590 con 0x560188b70610 2023-09-21T13:09:50.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd328f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.646+0000 7fd328f9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57998/0 (socket says 172.21.15.142:57998) 2023-09-21T13:09:50.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd328f9c700 1 -- 172.21.15.142:0/1795440060 learned_addr learned my addr 172.21.15.142:0/1795440060 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:50.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd323fff700 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b74e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3217fa700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 0x7fd30c0a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 -- 172.21.15.142:0/1795440060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 msgr2=0x560188b709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 -- 172.21.15.142:0/1795440060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 msgr2=0x560188b74e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b74e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 -- 172.21.15.142:0/1795440060 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601888ecde0 con 0x560188b75360 2023-09-21T13:09:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd328f9c700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 0x7fd30c0a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3237fe700 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b757c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a490 tx=0x7fd31800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730811bce16a95df server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.647+0000 7fd3217fa700 1 -- 172.21.15.142:0/522743692 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd3140cd3b0 con 0x7fd324100fa0 2023-09-21T13:09:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.648+0000 7fd30a7fc700 1 -- 172.21.15.142:0/1795440060 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180098c0 con 0x560188b75360 2023-09-21T13:09:50.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.648+0000 7fd30a7fc700 1 -- 172.21.15.142:0/1795440060 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd31800ec20 con 0x560188b75360 2023-09-21T13:09:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.648+0000 7fd30a7fc700 1 -- 172.21.15.142:0/1795440060 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318012630 con 0x560188b75360 2023-09-21T13:09:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd328f9c700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 0x7fd30c0a2dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007fd0 tx=0x7fd31c004ad0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 -- 172.21.15.142:0/1795440060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 msgr2=0x560188b757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b757c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a490 tx=0x7fd31800e4b0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 -- 172.21.15.142:0/1795440060 shutdown_connections 2023-09-21T13:09:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b757c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 --2- 172.21.15.142:0/1795440060 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b74e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 -- 172.21.15.142:0/1795440060 >> 172.21.15.142:0/1795440060 conn(0x560188a9d000 msgr2=0x560188b6b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 -- 172.21.15.142:0/1795440060 shutdown_connections 2023-09-21T13:09:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.649+0000 7fd33e400b80 1 -- 172.21.15.142:0/1795440060 wait complete. 2023-09-21T13:09:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.650+0000 7fd33e400b80 1 -- start start 2023-09-21T13:09:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.650+0000 7fd33e400b80 1 Processor -- start 2023-09-21T13:09:50.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 0x560188b7a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188ac1e80 con 0x560188b75360 2023-09-21T13:09:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188a5e740 con 0x560188b70f30 2023-09-21T13:09:50.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188a5e3e0 con 0x560188b70610 2023-09-21T13:09:50.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd33e400b80 10 client.0 _ll_register_callbacks cb 0x5601889a8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:50.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38438/0 (socket says 172.21.15.142:38438) 2023-09-21T13:09:50.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 -- 172.21.15.142:0/3236170135 learned_addr learned my addr 172.21.15.142:0/3236170135 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:50.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd328f9c700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 0x560188b7a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 -- 172.21.15.142:0/3236170135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 msgr2=0x560188b7cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 -- 172.21.15.142:0/3236170135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 msgr2=0x560188b7a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 0x560188b7a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd3237fe700 1 -- 172.21.15.142:0/3236170135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd318009a20 con 0x560188b70f30 2023-09-21T13:09:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd323fff700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.651+0000 7fd328f9c700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 0x560188b7a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:09:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3237fe700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3180048a0 tx=0x7fd31801c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae0618d36c7a2755 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3037fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:50.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180098c0 con 0x560188b70f30 2023-09-21T13:09:50.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560188a32bb0 con 0x560188b70f30 2023-09-21T13:09:50.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd318006df0 con 0x560188b70f30 2023-09-21T13:09:50.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd318013950 con 0x560188b70f30 2023-09-21T13:09:50.656 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd33e400b80 10 client.28097 fetch_fsmap learned FSMap version 47 2023-09-21T13:09:50.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5601888d5c60 con 0x560188b70f30 2023-09-21T13:09:50.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.652+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd318031020 con 0x560188b70f30 2023-09-21T13:09:50.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 47) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd318011070 con 0x560188b70f30 2023-09-21T13:09:50.657 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 10 client.28097 fetch_fsmap finished waiting for FSMap version 47 2023-09-21T13:09:50.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 10 client.28097 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:50.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 20 client.28097 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:50.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188b9b310 0x560188b9d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 4 client.28097 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:09:50.658 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560188b3f020 con 0x560188b9b310 2023-09-21T13:09:50.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd323fff700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188b9b310 0x560188b9d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd323fff700 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188b9b310 0x560188b9d730 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3409eaac1df49265 server_cookie=73e54cb4568a48cd in_seq=0 out_seq=0 2023-09-21T13:09:50.659 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.653+0000 7fd3037fe700 10 client.28097 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:50.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd3037fe700 1 -- 172.21.15.142:0/3236170135 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560188b3f020 con 0x560188b9b310 2023-09-21T13:09:50.660 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd3037fe700 10 client.28097 handle_command_reply: tid=0 2023-09-21T13:09:50.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 client.28097 shutdown 2023-09-21T13:09:50.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 msgr2=0x560188b79d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3180048a0 tx=0x7fd31801c680 comp rx=0 tx=0).stop 2023-09-21T13:09:50.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 shutdown_connections 2023-09-21T13:09:50.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188b9b310 0x560188b9d730 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b75360 0x560188b7a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd3037fe700 0 client.28097 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:50.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 --2- 172.21.15.142:0/3236170135 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b70f30 0x560188b79d40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.657+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 >> 172.21.15.142:0/3236170135 conn(0x560188a9d000 msgr2=0x560188b6b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.658+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 shutdown_connections 2023-09-21T13:09:50.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.658+0000 7fd33e400b80 1 -- 172.21.15.142:0/3236170135 wait complete. 2023-09-21T13:09:50.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.658+0000 7fd33e400b80 20 client.28097 trim_cache size 0 max 16384 2023-09-21T13:09:50.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.682+0000 7fd33e400b80 1 Processor -- start 2023-09-21T13:09:50.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.682+0000 7fd33e400b80 1 -- start start 2023-09-21T13:09:50.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.678 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b795e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b79b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188942920 con 0x560188b70f30 2023-09-21T13:09:50.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188b7a060 con 0x560188b75360 2023-09-21T13:09:50.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd33e400b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188b7aa80 con 0x560188b70610 2023-09-21T13:09:50.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58018/0 (socket says 172.21.15.142:58018) 2023-09-21T13:09:50.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd323fff700 1 -- 172.21.15.142:0/644647775 learned_addr learned my addr 172.21.15.142:0/644647775 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:50.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd328f9c700 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b79b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.683+0000 7fd3237fe700 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b795e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 -- 172.21.15.142:0/644647775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 msgr2=0x560188b79b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b79b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 -- 172.21.15.142:0/644647775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 msgr2=0x560188b795e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b795e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 -- 172.21.15.142:0/644647775 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560188b97b30 con 0x560188b70610 2023-09-21T13:09:50.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd323fff700 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd314022af0 tx=0x7fd31401a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb1f168f7f8ac11c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd30affd700 1 -- 172.21.15.142:0/644647775 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31409b130 con 0x560188b70610 2023-09-21T13:09:50.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd30affd700 1 -- 172.21.15.142:0/644647775 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd31409aa30 con 0x560188b70610 2023-09-21T13:09:50.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.684+0000 7fd30affd700 1 -- 172.21.15.142:0/644647775 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314099f20 con 0x560188b70610 2023-09-21T13:09:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 -- 172.21.15.142:0/644647775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 msgr2=0x560188b7c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd314022af0 tx=0x7fd31401a040 comp rx=0 tx=0).stop 2023-09-21T13:09:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 -- 172.21.15.142:0/644647775 shutdown_connections 2023-09-21T13:09:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188b79b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b7c660 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 --2- 172.21.15.142:0/644647775 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b795e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 -- 172.21.15.142:0/644647775 >> 172.21.15.142:0/644647775 conn(0x560188a9d000 msgr2=0x560188b77750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 -- 172.21.15.142:0/644647775 shutdown_connections 2023-09-21T13:09:50.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.685+0000 7fd33e400b80 1 -- 172.21.15.142:0/644647775 wait complete. 2023-09-21T13:09:50.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.686+0000 7fd33e400b80 1 -- start start 2023-09-21T13:09:50.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.686+0000 7fd33e400b80 1 Processor -- start 2023-09-21T13:09:50.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188b91460 con 0x560188b70f30 2023-09-21T13:09:50.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188bee6c0 con 0x560188b75360 2023-09-21T13:09:50.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x560188bee880 con 0x560188b70610 2023-09-21T13:09:50.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd33e400b80 10 client.0 _ll_register_callbacks cb 0x5601889a8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:09:50.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd3237fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd328f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd3237fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:48586/0 (socket says 172.21.15.142:48586) 2023-09-21T13:09:50.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd3237fe700 1 -- 172.21.15.142:0/2619877743 learned_addr learned my addr 172.21.15.142:0/2619877743 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:09:50.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd323fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:58020/0 (socket says 172.21.15.142:58020) 2023-09-21T13:09:50.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.687+0000 7fd328f9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:38466/0 (socket says 172.21.15.142:38466) 2023-09-21T13:09:50.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 -- 172.21.15.142:0/2619877743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 msgr2=0x560188b90760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 -- 172.21.15.142:0/2619877743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 msgr2=0x560188b90ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:09:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 -- 172.21.15.142:0/2619877743 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3241a6170 con 0x560188b75360 2023-09-21T13:09:50.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd323fff700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:50.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd3237fe700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:09:50.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd328f9c700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007fa0 tx=0x7fd31c009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b0b527f9c883a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:09:50.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.688+0000 7fd3037fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:09:50.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c014bd0 con 0x560188b75360 2023-09-21T13:09:50.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd31c01d040 con 0x560188b75360 2023-09-21T13:09:50.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd31800ec20 con 0x560188b75360 2023-09-21T13:09:50.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd31c014d30 con 0x560188b75360 2023-09-21T13:09:50.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd33e400b80 10 client.28103 fetch_fsmap learned FSMap version 47 2023-09-21T13:09:50.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x560188ba23a0 con 0x560188b75360 2023-09-21T13:09:50.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.689+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd31800ec20 con 0x560188b75360 2023-09-21T13:09:50.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 47) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd31c0233e0 con 0x560188b75360 2023-09-21T13:09:50.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 10 client.28103 fetch_fsmap finished waiting for FSMap version 47 2023-09-21T13:09:50.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 10 client.28103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:09:50.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 20 client.28103 populate_metadata read hostname 'smithi142' 2023-09-21T13:09:50.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188bf0080 0x560188bf24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:09:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 4 client.28103 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:09:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560188abae60 con 0x560188bf0080 2023-09-21T13:09:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.690+0000 7fd323fff700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188bf0080 0x560188bf24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:09:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.691+0000 7fd323fff700 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188bf0080 0x560188bf24a0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbf110712f1ba348 server_cookie=db4c42f66a52f030 in_seq=0 out_seq=0 2023-09-21T13:09:50.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.691+0000 7fd3037fe700 10 client.28103 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:50.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd3037fe700 1 -- 172.21.15.142:0/2619877743 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x560188abae60 con 0x560188bf0080 2023-09-21T13:09:50.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd3037fe700 10 client.28103 handle_command_reply: tid=0 2023-09-21T13:09:50.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd33e400b80 1 client.28103 shutdown 2023-09-21T13:09:50.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 msgr2=0x560188bee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007fa0 tx=0x7fd31c009040 comp rx=0 tx=0).stop 2023-09-21T13:09:50.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 shutdown_connections 2023-09-21T13:09:50.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.692+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x560188bf0080 0x560188bf24a0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x560188b75360 0x560188bee180 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x560188b70610 0x560188b90760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 --2- 172.21.15.142:0/2619877743 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x560188b70f30 0x560188b90ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 >> 172.21.15.142:0/2619877743 conn(0x560188a9d000 msgr2=0x560188b77750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd3037fe700 0 client.28103 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:09:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 shutdown_connections 2023-09-21T13:09:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.693+0000 7fd33e400b80 1 -- 172.21.15.142:0/2619877743 wait complete. 2023-09-21T13:09:50.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.694+0000 7fd33e400b80 20 client.28103 trim_cache size 0 max 16384 2023-09-21T13:09:50.700 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:09:50.700 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:09:50.700 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:09:50.700 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:09:50.700 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:09:50.701 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:09:50.701 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:09:50.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:09:50.701 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:09:50.701 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:09:50.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 msgr2=0x7fd30c0a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 0x7fd30c0a2dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd31c007fd0 tx=0x7fd31c004ad0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 msgr2=0x7fd324199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:09:50.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd314005910 tx=0x7fd314009f90 comp rx=0 tx=0).stop 2023-09-21T13:09:50.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 shutdown_connections 2023-09-21T13:09:50.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd30c0a0900 0x7fd30c0a2dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd32419daa0 0x7fd32419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd324100fa0 0x7fd324199100 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 --2- 172.21.15.142:0/522743692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd3241060c0 0x7fd324199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:09:50.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 >> 172.21.15.142:0/522743692 conn(0x7fd3240fc860 msgr2=0x7fd324102960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:09:50.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 shutdown_connections 2023-09-21T13:09:50.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:09:50.695+0000 7fd32a9ff700 1 -- 172.21.15.142:0/522743692 wait complete. 2023-09-21T13:09:50.719 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:09:50.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 14134 30.24 MB/sec warmup 31 sec latency 61.776 ms 2023-09-21T13:09:51.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 14860 30.83 MB/sec warmup 32 sec latency 129.445 ms 2023-09-21T13:09:52.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:51 smithi156 ceph-mon[134078]: pgmap v427: 97 pgs: 97 active+clean; 624 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 19 MiB/s wr, 895 op/s 2023-09-21T13:09:52.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:51 smithi142 ceph-mon[97663]: pgmap v427: 97 pgs: 97 active+clean; 624 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 19 MiB/s wr, 895 op/s 2023-09-21T13:09:52.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:51 smithi160 ceph-mon[134450]: pgmap v427: 97 pgs: 97 active+clean; 624 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 19 MiB/s wr, 895 op/s 2023-09-21T13:09:52.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 15575 30.65 MB/sec warmup 33 sec latency 80.256 ms 2023-09-21T13:09:53.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:52 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:53.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:52 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:53.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:52 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:09:53.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 16762 31.44 MB/sec warmup 34 sec latency 38.578 ms 2023-09-21T13:09:54.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:53 smithi156 ceph-mon[134078]: pgmap v428: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 633 op/s 2023-09-21T13:09:54.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:53 smithi142 ceph-mon[97663]: pgmap v428: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 633 op/s 2023-09-21T13:09:54.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:53 smithi160 ceph-mon[134450]: pgmap v428: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 633 op/s 2023-09-21T13:09:54.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 17927 32.74 MB/sec warmup 35 sec latency 66.416 ms 2023-09-21T13:09:55.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 18695 32.89 MB/sec warmup 36 sec latency 74.205 ms 2023-09-21T13:09:56.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:55 smithi156 ceph-mon[134078]: pgmap v429: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 575 op/s 2023-09-21T13:09:56.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:55 smithi142 ceph-mon[97663]: pgmap v429: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 575 op/s 2023-09-21T13:09:56.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:55 smithi160 ceph-mon[134450]: pgmap v429: 97 pgs: 97 active+clean; 626 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 12 MiB/s wr, 575 op/s 2023-09-21T13:09:56.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 19509 32.88 MB/sec warmup 37 sec latency 66.330 ms 2023-09-21T13:09:57.995 INFO:tasks.workunit.client.0.smithi142.stdout: 10 20607 33.71 MB/sec warmup 38 sec latency 49.100 ms 2023-09-21T13:09:58.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:57 smithi156 ceph-mon[134078]: pgmap v430: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-09-21T13:09:58.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:57 smithi142 ceph-mon[97663]: pgmap v430: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-09-21T13:09:58.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:57 smithi160 ceph-mon[134450]: pgmap v430: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 15 MiB/s wr, 815 op/s 2023-09-21T13:09:58.996 INFO:tasks.workunit.client.0.smithi142.stdout: 10 21436 34.16 MB/sec warmup 39 sec latency 61.075 ms 2023-09-21T13:09:59.997 INFO:tasks.workunit.client.0.smithi142.stdout: 10 22131 34.30 MB/sec warmup 40 sec latency 78.902 ms 2023-09-21T13:10:00.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:09:59 smithi156 ceph-mon[134078]: pgmap v431: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 560 op/s 2023-09-21T13:10:00.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:09:59 smithi142 ceph-mon[97663]: pgmap v431: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 560 op/s 2023-09-21T13:10:00.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:09:59 smithi160 ceph-mon[134450]: pgmap v431: 97 pgs: 97 active+clean; 654 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 4.5 MiB/s wr, 560 op/s 2023-09-21T13:10:00.996 INFO:tasks.workunit.client.0.smithi142.stdout: 10 22848 34.09 MB/sec warmup 41 sec latency 101.265 ms 2023-09-21T13:10:01.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:00 smithi156 ceph-mon[134078]: overall HEALTH_OK 2023-09-21T13:10:01.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:00 smithi142 ceph-mon[97663]: overall HEALTH_OK 2023-09-21T13:10:01.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:00 smithi160 ceph-mon[134450]: overall HEALTH_OK 2023-09-21T13:10:01.997 INFO:tasks.workunit.client.0.smithi142.stdout: 10 23048 33.52 MB/sec warmup 42 sec latency 695.360 ms 2023-09-21T13:10:02.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:01 smithi156 ceph-mon[134078]: pgmap v432: 97 pgs: 97 active+clean; 673 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2023-09-21T13:10:02.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:01 smithi142 ceph-mon[97663]: pgmap v432: 97 pgs: 97 active+clean; 673 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2023-09-21T13:10:02.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:01 smithi160 ceph-mon[134450]: pgmap v432: 97 pgs: 97 active+clean; 673 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 6.4 MiB/s wr, 736 op/s 2023-09-21T13:10:02.996 INFO:tasks.workunit.client.0.smithi142.stdout: 10 23181 32.98 MB/sec warmup 43 sec latency 1179.148 ms 2023-09-21T13:10:03.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:02 smithi156 ceph-mon[134078]: osdmap e104: 12 total, 12 up, 12 in 2023-09-21T13:10:03.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:02 smithi142 ceph-mon[97663]: osdmap e104: 12 total, 12 up, 12 in 2023-09-21T13:10:03.178 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.185+0000 7f3b96dff700 1 -- 172.21.15.142:0/839925595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 msgr2=0x7f3b90107de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.179 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.185+0000 7f3b96dff700 1 --2- 172.21.15.142:0/839925595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b90107de0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3b8400b0a0 tx=0x7f3b8400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.188+0000 7f3b96dff700 1 -- 172.21.15.142:0/839925595 shutdown_connections 2023-09-21T13:10:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.188+0000 7f3b96dff700 1 --2- 172.21.15.142:0/839925595 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 0x7f3b901182a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.188+0000 7f3b96dff700 1 --2- 172.21.15.142:0/839925595 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b90107de0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.188+0000 7f3b96dff700 1 --2- 172.21.15.142:0/839925595 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b901087a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.183 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.188+0000 7f3b96dff700 1 -- 172.21.15.142:0/839925595 >> 172.21.15.142:0/839925595 conn(0x7f3b9006d2e0 msgr2=0x7f3b9006d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:02 smithi160 ceph-mon[134450]: osdmap e104: 12 total, 12 up, 12 in 2023-09-21T13:10:03.187 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.194+0000 7f3b96dff700 1 -- 172.21.15.142:0/839925595 shutdown_connections 2023-09-21T13:10:03.188 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.194+0000 7f3b96dff700 1 -- 172.21.15.142:0/839925595 wait complete. 2023-09-21T13:10:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.195+0000 7f3b96dff700 1 Processor -- start 2023-09-21T13:10:03.189 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 -- start start 2023-09-21T13:10:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b9010bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 0x7f3b9010c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901b2240 con 0x7f3b90115e70 2023-09-21T13:10:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901b23b0 con 0x7f3b90108320 2023-09-21T13:10:03.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.196+0000 7f3b96dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b901b2570 con 0x7f3b9010b4d0 2023-09-21T13:10:03.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.197+0000 7f3b94b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.192 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.197+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 0x7f3b9010c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.197+0000 7f3b94b9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60018/0 (socket says 172.21.15.142:60018) 2023-09-21T13:10:03.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.197+0000 7f3b8ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b9010bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.197+0000 7f3b94b9b700 1 -- 172.21.15.142:0/14948207 learned_addr learned my addr 172.21.15.142:0/14948207 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:03.193 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 -- 172.21.15.142:0/14948207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 msgr2=0x7f3b9010bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b9010bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 -- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 msgr2=0x7f3b9010c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 0x7f3b9010c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 -- 172.21.15.142:0/14948207 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009d00 con 0x7f3b90108320 2023-09-21T13:10:03.194 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b94b9b700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3b84000f80 tx=0x7f3b84004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b8dffb700 1 -- 172.21.15.142:0/14948207 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b84021070 con 0x7f3b90108320 2023-09-21T13:10:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b8dffb700 1 -- 172.21.15.142:0/14948207 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b840077d0 con 0x7f3b90108320 2023-09-21T13:10:03.195 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.198+0000 7f3b8dffb700 1 -- 172.21.15.142:0/14948207 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8400e040 con 0x7f3b90108320 2023-09-21T13:10:03.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.199+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b901b27f0 con 0x7f3b90108320 2023-09-21T13:10:03.196 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.199+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b901b2bc0 con 0x7f3b90108320 2023-09-21T13:10:03.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.211+0000 7f3baa790b80 1 Processor -- start 2023-09-21T13:10:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 -- start start 2023-09-21T13:10:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b71f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f9c0 0x558e9b723910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b693c40 con 0x558e9b71f9c0 2023-09-21T13:10:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b677c10 con 0x558e9b71f0a0 2023-09-21T13:10:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.212+0000 7f3baa790b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b675530 con 0x558e9b723e50 2023-09-21T13:10:03.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36070/0 (socket says 172.21.15.142:36070) 2023-09-21T13:10:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 -- 172.21.15.142:0/1850600253 learned_addr learned my addr 172.21.15.142:0/1850600253 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:03.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b71f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 -- 172.21.15.142:0/1850600253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 msgr2=0x558e9b71f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b71f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 -- 172.21.15.142:0/1850600253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f9c0 msgr2=0x558e9b723910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f9c0 0x558e9b723910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.213+0000 7f3b8ffff700 1 -- 172.21.15.142:0/1850600253 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e9b49bd80 con 0x558e9b723e50 2023-09-21T13:10:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.214+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00bcf0 tx=0x7f3b7c0103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37aaa387e90299b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.211 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.214+0000 7f3b7affd700 1 -- 172.21.15.142:0/1850600253 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c010d10 con 0x558e9b723e50 2023-09-21T13:10:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.214+0000 7f3b7affd700 1 -- 172.21.15.142:0/1850600253 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7c015070 con 0x558e9b723e50 2023-09-21T13:10:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.214+0000 7f3b7affd700 1 -- 172.21.15.142:0/1850600253 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c003e50 con 0x558e9b723e50 2023-09-21T13:10:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 -- 172.21.15.142:0/1850600253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 msgr2=0x558e9b7242b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00bcf0 tx=0x7f3b7c0103d0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 -- 172.21.15.142:0/1850600253 shutdown_connections 2023-09-21T13:10:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7242b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b71f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1850600253 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f9c0 0x558e9b723910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.213 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.215+0000 7f3baa790b80 1 -- 172.21.15.142:0/1850600253 >> 172.21.15.142:0/1850600253 conn(0x558e9b64bfa0 msgr2=0x558e9b71a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.216+0000 7f3b8dffb700 1 -- 172.21.15.142:0/14948207 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f3b84004670 con 0x7f3b90108320 2023-09-21T13:10:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.217+0000 7f3baa790b80 1 -- 172.21.15.142:0/1850600253 shutdown_connections 2023-09-21T13:10:03.214 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.217+0000 7f3baa790b80 1 -- 172.21.15.142:0/1850600253 wait complete. 2023-09-21T13:10:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.218+0000 7f3baa790b80 1 -- start start 2023-09-21T13:10:03.215 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.218+0000 7f3baa790b80 1 Processor -- start 2023-09-21T13:10:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b723e50 0x558e9b728ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b746100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.217 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b670e20 con 0x558e9b723e50 2023-09-21T13:10:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b60d6e0 con 0x558e9b729410 2023-09-21T13:10:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b60d380 con 0x558e9b71f0a0 2023-09-21T13:10:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3baa790b80 10 client.0 _ll_register_callbacks cb 0x558e9b557a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.218 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:36086/0 (socket says 172.21.15.142:36086) 2023-09-21T13:10:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.222+0000 7f3b9539c700 1 -- 172.21.15.142:0/1860197121 learned_addr learned my addr 172.21.15.142:0/1860197121 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:03.219 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b746100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b9539c700 1 -- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 msgr2=0x558e9b746100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b746100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b9539c700 1 -- 172.21.15.142:0/1860197121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b723e50 msgr2=0x558e9b728ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b723e50 0x558e9b728ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.220 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.223+0000 7f3b9539c700 1 -- 172.21.15.142:0/1860197121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c00b920 con 0x558e9b71f0a0 2023-09-21T13:10:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.224+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009c60 tx=0x7f3b88009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d16b615b7bdf5e40 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.224+0000 7f3b6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:10:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.224+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88016070 con 0x558e9b71f0a0 2023-09-21T13:10:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.224+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558e9b5e1b50 con 0x558e9b71f0a0 2023-09-21T13:10:03.221 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.224+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b88011440 con 0x558e9b71f0a0 2023-09-21T13:10:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.226+0000 7f3b8dffb700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 0x7f3b800a2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3b8dffb700 1 -- 172.21.15.142:0/14948207 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b840cc890 con 0x7f3b90108320 2023-09-21T13:10:03.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3b94b9b700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 0x7f3b800a2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b88011600 con 0x558e9b71f0a0 2023-09-21T13:10:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3baa790b80 10 client.28057 fetch_fsmap learned FSMap version 48 2023-09-21T13:10:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x558e9b484c00 con 0x558e9b71f0a0 2023-09-21T13:10:03.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.227+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b88027080 con 0x558e9b71f0a0 2023-09-21T13:10:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 48) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f3b880237f0 con 0x558e9b71f0a0 2023-09-21T13:10:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 10 client.28057 fetch_fsmap finished waiting for FSMap version 48 2023-09-21T13:10:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 10 client.28057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 20 client.28057 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:03.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b74a640 0x558e9b74ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 4 client.28057 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558e9b6edfc0 con 0x558e9b74a640 2023-09-21T13:10:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.228+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b74a640 0x558e9b74ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.229+0000 7f3b94b9b700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 0x7f3b800a2cc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x558e9b71ff20 tx=0x7f3b84009530 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.229+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b74a640 0x558e9b74ca60 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69f8bbefea13d852 server_cookie=78222293b1917e41 in_seq=0 out_seq=0 2023-09-21T13:10:03.227 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.229+0000 7f3b6ffff700 10 client.28057 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.238+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1860197121 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558e9b6edfc0 con 0x558e9b74a640 2023-09-21T13:10:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.238+0000 7f3b6ffff700 10 client.28057 handle_command_reply: tid=0 2023-09-21T13:10:03.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.238+0000 7f3baa790b80 1 client.28057 shutdown 2023-09-21T13:10:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 msgr2=0x558e9b728990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.236 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3b88009c60 tx=0x7f3b88009f70 comp rx=0 tx=0).stop 2023-09-21T13:10:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 shutdown_connections 2023-09-21T13:10:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b74a640 0x558e9b74ca60 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b746100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b71f0a0 0x558e9b728990 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.237 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1860197121 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b723e50 0x558e9b728ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.242+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 >> 172.21.15.142:0/1860197121 conn(0x558e9b64bfa0 msgr2=0x558e9b719cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.243+0000 7f3b6ffff700 0 client.28057 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.243+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 shutdown_connections 2023-09-21T13:10:03.242 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.244+0000 7f3baa790b80 1 -- 172.21.15.142:0/1860197121 wait complete. 2023-09-21T13:10:03.243 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.248+0000 7f3baa790b80 20 client.28057 trim_cache size 0 max 16384 2023-09-21T13:10:03.272 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 Processor -- start 2023-09-21T13:10:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 -- start start 2023-09-21T13:10:03.273 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f0a0 0x558e9b741040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7457a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b4f18c0 con 0x558e9b71f0a0 2023-09-21T13:10:03.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b741640 con 0x558e9b729410 2023-09-21T13:10:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.278+0000 7f3baa790b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b746ec0 con 0x558e9b723e50 2023-09-21T13:10:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.279+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60044/0 (socket says 172.21.15.142:60044) 2023-09-21T13:10:03.275 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 -- 172.21.15.142:0/3061981565 learned_addr learned my addr 172.21.15.142:0/3061981565 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f0a0 0x558e9b741040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.276 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 -- 172.21.15.142:0/3061981565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 msgr2=0x558e9b7457a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7457a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 -- 172.21.15.142:0/3061981565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f0a0 msgr2=0x558e9b741040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f0a0 0x558e9b741040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.277 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.280+0000 7f3b9539c700 1 -- 172.21.15.142:0/3061981565 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e9b751690 con 0x558e9b729410 2023-09-21T13:10:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.281+0000 7f3b9539c700 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3b88023c20 tx=0x7f3b880042d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=add6b858206910f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.281+0000 7f3b7b7fe700 1 -- 172.21.15.142:0/3061981565 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88016040 con 0x558e9b729410 2023-09-21T13:10:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.281+0000 7f3b7b7fe700 1 -- 172.21.15.142:0/3061981565 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558e9b5e1b50 con 0x558e9b729410 2023-09-21T13:10:03.278 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.281+0000 7f3b7b7fe700 1 -- 172.21.15.142:0/3061981565 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b88011dc0 con 0x558e9b729410 2023-09-21T13:10:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 -- 172.21.15.142:0/3061981565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 msgr2=0x558e9b745ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3b88023c20 tx=0x7f3b880042d0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 -- 172.21.15.142:0/3061981565 shutdown_connections 2023-09-21T13:10:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b71f0a0 0x558e9b741040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b729410 0x558e9b745ce0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 --2- 172.21.15.142:0/3061981565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b723e50 0x558e9b7457a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.282+0000 7f3baa790b80 1 -- 172.21.15.142:0/3061981565 >> 172.21.15.142:0/3061981565 conn(0x558e9b64bfa0 msgr2=0x558e9b721f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.284+0000 7f3baa790b80 1 -- 172.21.15.142:0/3061981565 shutdown_connections 2023-09-21T13:10:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.284+0000 7f3baa790b80 1 -- 172.21.15.142:0/3061981565 wait complete. 2023-09-21T13:10:03.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.285+0000 7f3baa790b80 1 -- start start 2023-09-21T13:10:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.285+0000 7f3baa790b80 1 Processor -- start 2023-09-21T13:10:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b729410 0x558e9b740d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.282 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b73f030 0x558e9b73f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b73f9f0 con 0x558e9b73f030 2023-09-21T13:10:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b73fb60 con 0x558e9b71f0a0 2023-09-21T13:10:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e9b73fd20 con 0x558e9b729410 2023-09-21T13:10:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3baa790b80 10 client.0 _ll_register_callbacks cb 0x558e9b557a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:03.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.286+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.287+0000 7f3b9539c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60052/0 (socket says 172.21.15.142:60052) 2023-09-21T13:10:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.287+0000 7f3b9539c700 1 -- 172.21.15.142:0/1525274124 learned_addr learned my addr 172.21.15.142:0/1525274124 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.287+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b729410 0x558e9b740d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.284 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.287+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b73f030 0x558e9b73f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 -- 172.21.15.142:0/1525274124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b729410 msgr2=0x558e9b740d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.285 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b729410 0x558e9b740d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 -- 172.21.15.142:0/1525274124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b73f030 msgr2=0x558e9b73f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b73f030 0x558e9b73f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 -- 172.21.15.142:0/1525274124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e9b484c00 con 0x558e9b71f0a0 2023-09-21T13:10:03.286 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b9539c700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3b88003b10 tx=0x7f3b88009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f6a760def5c7c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b6ffff700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8803a070 con 0x558e9b71f0a0 2023-09-21T13:10:03.287 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.288+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b7c015070 con 0x558e9b71f0a0 2023-09-21T13:10:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.290+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f3b88000e40 con 0x558e9b71f0a0 2023-09-21T13:10:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.291+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b88011810 con 0x558e9b71f0a0 2023-09-21T13:10:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.291+0000 7f3baa790b80 10 client.28121 fetch_fsmap learned FSMap version 48 2023-09-21T13:10:03.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.291+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x558e9b4c21f0 con 0x558e9b71f0a0 2023-09-21T13:10:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b7c015070 con 0x558e9b71f0a0 2023-09-21T13:10:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 48) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f3b8803d020 con 0x558e9b71f0a0 2023-09-21T13:10:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 10 client.28121 fetch_fsmap finished waiting for FSMap version 48 2023-09-21T13:10:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 10 client.28121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:03.289 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 20 client.28121 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b79f5f0 0x558e9b7a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 4 client.28121 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:10:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.292+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558e9b669e00 con 0x558e9b79f5f0 2023-09-21T13:10:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.293+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b79f5f0 0x558e9b7a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:03.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.294+0000 7f3b8ffff700 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b79f5f0 0x558e9b7a1a10 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2433ea810805889 server_cookie=40de7197146e63c9 in_seq=0 out_seq=0 2023-09-21T13:10:03.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.294+0000 7f3b6ffff700 10 client.28121 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.558+0000 7f3b6ffff700 1 -- 172.21.15.142:0/1525274124 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558e9b669e00 con 0x558e9b79f5f0 2023-09-21T13:10:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.558+0000 7f3b6ffff700 10 client.28121 handle_command_reply: tid=0 2023-09-21T13:10:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.558+0000 7f3baa790b80 1 client.28121 shutdown 2023-09-21T13:10:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.559+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 msgr2=0x558e9b7407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.559+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f3b88003b10 tx=0x7f3b88009260 comp rx=0 tx=0).stop 2023-09-21T13:10:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 shutdown_connections 2023-09-21T13:10:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x558e9b79f5f0 0x558e9b7a1a10 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x558e9b73f030 0x558e9b73f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x558e9b71f0a0 0x558e9b7407e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 --2- 172.21.15.142:0/1525274124 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558e9b729410 0x558e9b740d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 >> 172.21.15.142:0/1525274124 conn(0x558e9b64bfa0 msgr2=0x558e9b722f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.560+0000 7f3b6ffff700 0 client.28121 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.566+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 shutdown_connections 2023-09-21T13:10:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.568+0000 7f3baa790b80 1 -- 172.21.15.142:0/1525274124 wait complete. 2023-09-21T13:10:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:10:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:10:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:10:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:10:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.568+0000 7f3baa790b80 20 client.28121 trim_cache size 0 max 16384 2023-09-21T13:10:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 msgr2=0x7f3b800a2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 0x7f3b800a2cc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x558e9b71ff20 tx=0x7f3b84009530 comp rx=0 tx=0).stop 2023-09-21T13:10:03.565 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 msgr2=0x7f3b9010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3b84000f80 tx=0x7f3b84004c80 comp rx=0 tx=0).stop 2023-09-21T13:10:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 shutdown_connections 2023-09-21T13:10:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f3b800a0800 0x7f3b800a2cc0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x558e9b71ff20 tx=0x7f3b84009530 comp rx=0 tx=0).stop 2023-09-21T13:10:03.566 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3b90115e70 0x7f3b9010c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3b90108320 0x7f3b9010ba60 secure :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f3b84000f80 tx=0x7f3b84004c80 comp rx=0 tx=0).stop 2023-09-21T13:10:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 --2- 172.21.15.142:0/14948207 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b9010b4d0 0x7f3b9010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:03.567 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.569+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 >> 172.21.15.142:0/14948207 conn(0x7f3b9006d2e0 msgr2=0x7f3b90117450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.572+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 shutdown_connections 2023-09-21T13:10:03.568 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:03.573+0000 7f3b96dff700 1 -- 172.21.15.142:0/14948207 wait complete. 2023-09-21T13:10:03.996 INFO:tasks.workunit.client.0.smithi142.stdout: 10 23814 33.04 MB/sec warmup 44 sec latency 291.434 ms 2023-09-21T13:10:04.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:03 smithi156 ceph-mon[134078]: pgmap v434: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:04.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:03 smithi142 ceph-mon[97663]: pgmap v434: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:04.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:03 smithi160 ceph-mon[134450]: pgmap v434: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:04.996 INFO:tasks.workunit.client.0.smithi142.stdout: 10 24683 33.49 MB/sec warmup 45 sec latency 87.500 ms 2023-09-21T13:10:05.997 INFO:tasks.workunit.client.0.smithi142.stdout: 10 25303 33.38 MB/sec warmup 46 sec latency 343.278 ms 2023-09-21T13:10:06.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:05 smithi156 ceph-mon[134078]: pgmap v435: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:06.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:05 smithi142 ceph-mon[97663]: pgmap v435: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:06.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:05 smithi160 ceph-mon[134450]: pgmap v435: 97 pgs: 97 active+clean; 679 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 6.2 MiB/s wr, 571 op/s 2023-09-21T13:10:07.007 INFO:tasks.workunit.client.0.smithi142.stdout: 10 26114 33.52 MB/sec warmup 47 sec latency 64.058 ms 2023-09-21T13:10:08.009 INFO:tasks.workunit.client.0.smithi142.stdout: 10 26170 32.91 MB/sec warmup 48 sec latency 694.381 ms 2023-09-21T13:10:08.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:07 smithi156 ceph-mon[134078]: pgmap v436: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:08.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:07 smithi142 ceph-mon[97663]: pgmap v436: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:08.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:07 smithi160 ceph-mon[134450]: pgmap v436: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:09.012 INFO:tasks.workunit.client.0.smithi142.stdout: 10 26724 32.91 MB/sec warmup 49 sec latency 592.642 ms 2023-09-21T13:10:10.012 INFO:tasks.workunit.client.0.smithi142.stdout: 10 27336 32.85 MB/sec warmup 50 sec latency 83.312 ms 2023-09-21T13:10:10.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:09 smithi156 ceph-mon[134078]: pgmap v437: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:10.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:09 smithi142 ceph-mon[97663]: pgmap v437: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:10.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:09 smithi160 ceph-mon[134450]: pgmap v437: 97 pgs: 97 active+clean; 690 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 6.8 MiB/s wr, 814 op/s 2023-09-21T13:10:11.012 INFO:tasks.workunit.client.0.smithi142.stdout: 10 28339 33.42 MB/sec warmup 51 sec latency 148.954 ms 2023-09-21T13:10:12.012 INFO:tasks.workunit.client.0.smithi142.stdout: 10 29128 33.64 MB/sec warmup 52 sec latency 86.866 ms 2023-09-21T13:10:12.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:11 smithi156 ceph-mon[134078]: pgmap v438: 97 pgs: 97 active+clean; 710 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-09-21T13:10:12.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:11 smithi156 ceph-mon[134078]: osdmap e105: 12 total, 12 up, 12 in 2023-09-21T13:10:12.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:11 smithi142 ceph-mon[97663]: pgmap v438: 97 pgs: 97 active+clean; 710 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-09-21T13:10:12.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:11 smithi142 ceph-mon[97663]: osdmap e105: 12 total, 12 up, 12 in 2023-09-21T13:10:12.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:11 smithi160 ceph-mon[134450]: pgmap v438: 97 pgs: 97 active+clean; 710 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 16 MiB/s wr, 1.05k op/s 2023-09-21T13:10:12.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:11 smithi160 ceph-mon[134450]: osdmap e105: 12 total, 12 up, 12 in 2023-09-21T13:10:13.013 INFO:tasks.workunit.client.0.smithi142.stdout: 10 29627 33.43 MB/sec warmup 53 sec latency 380.733 ms 2023-09-21T13:10:14.014 INFO:tasks.workunit.client.0.smithi142.stdout: 10 30276 33.31 MB/sec warmup 54 sec latency 492.661 ms 2023-09-21T13:10:14.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:13 smithi156 ceph-mon[134078]: pgmap v440: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:14.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:13 smithi142 ceph-mon[97663]: pgmap v440: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:14.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:13 smithi160 ceph-mon[134450]: pgmap v440: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:15.014 INFO:tasks.workunit.client.0.smithi142.stdout: 10 31324 33.79 MB/sec warmup 55 sec latency 72.256 ms 2023-09-21T13:10:16.015 INFO:tasks.workunit.client.0.smithi142.stdout: 10 32219 34.18 MB/sec warmup 56 sec latency 79.517 ms 2023-09-21T13:10:16.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:15 smithi142 ceph-mon[97663]: pgmap v441: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:16.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:15 smithi160 ceph-mon[134450]: pgmap v441: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:16.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:15 smithi156 ceph-mon[134078]: pgmap v441: 97 pgs: 97 active+clean; 712 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 18 MiB/s wr, 1.11k op/s 2023-09-21T13:10:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.809+0000 7faebcfff700 1 -- 172.21.15.142:0/662669142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb8105cf0 msgr2=0x7faeb80681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:16.803 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.809+0000 7faebcfff700 1 --2- 172.21.15.142:0/662669142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb8105cf0 0x7faeb80681d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faea8009990 tx=0x7faea8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.810+0000 7faebcfff700 1 -- 172.21.15.142:0/662669142 shutdown_connections 2023-09-21T13:10:16.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.810+0000 7faebcfff700 1 --2- 172.21.15.142:0/662669142 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb81037f0 0x7faeb8103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.810+0000 7faebcfff700 1 --2- 172.21.15.142:0/662669142 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb8105cf0 0x7faeb80681d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.810+0000 7faebcfff700 1 --2- 172.21.15.142:0/662669142 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faeb8068710 0x7faeb8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.805 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.810+0000 7faebcfff700 1 -- 172.21.15.142:0/662669142 >> 172.21.15.142:0/662669142 conn(0x7faeb8076800 msgr2=0x7faeb8076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.812+0000 7faebcfff700 1 -- 172.21.15.142:0/662669142 shutdown_connections 2023-09-21T13:10:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.813+0000 7faebcfff700 1 -- 172.21.15.142:0/662669142 wait complete. 2023-09-21T13:10:16.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.814+0000 7faebcfff700 1 Processor -- start 2023-09-21T13:10:16.809 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 -- start start 2023-09-21T13:10:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb8068710 0x7faeb8113ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faeb8105cf0 0x7faeb810cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb810d590 con 0x7faeb8068710 2023-09-21T13:10:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb810d700 con 0x7faeb81037f0 2023-09-21T13:10:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.816+0000 7faebcfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb810d8c0 con 0x7faeb8105cf0 2023-09-21T13:10:16.812 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.817+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.817+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59688/0 (socket says 172.21.15.142:59688) 2023-09-21T13:10:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.817+0000 7faeb5d9b700 1 -- 172.21.15.142:0/559159587 learned_addr learned my addr 172.21.15.142:0/559159587 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 -- 172.21.15.142:0/559159587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faeb8105cf0 msgr2=0x7faeb810cdf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T13:10:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faeb8105cf0 0x7faeb810cdf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 -- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb8068710 msgr2=0x7faeb8113ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb8068710 0x7faeb8113ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 -- 172.21.15.142:0/559159587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80095f0 con 0x7faeb81037f0 2023-09-21T13:10:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.818+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.819+0000 7faea77fe700 1 -- 172.21.15.142:0/559159587 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac009790 con 0x7faeb81037f0 2023-09-21T13:10:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.819+0000 7faea77fe700 1 -- 172.21.15.142:0/559159587 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeac00cbd0 con 0x7faeb81037f0 2023-09-21T13:10:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.819+0000 7faea77fe700 1 -- 172.21.15.142:0/559159587 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac018680 con 0x7faeb81037f0 2023-09-21T13:10:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.819+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb810dba0 con 0x7faeb81037f0 2023-09-21T13:10:16.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.819+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8111e20 con 0x7faeb81037f0 2023-09-21T13:10:16.820 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.826+0000 7faea77fe700 1 -- 172.21.15.142:0/559159587 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7faeac00cd40 con 0x7faeb81037f0 2023-09-21T13:10:16.821 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.827+0000 7faed0969b80 1 Processor -- start 2023-09-21T13:10:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 -- start start 2023-09-21T13:10:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d2f9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.822 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 0x55a42d2fd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 0x55a42d2fe2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d26dc40 con 0x55a42d2f99c0 2023-09-21T13:10:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d251c10 con 0x55a42d2fde50 2023-09-21T13:10:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.828+0000 7faed0969b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d24f530 con 0x55a42d2f90a0 2023-09-21T13:10:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.829+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 0x55a42d2fe2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.829+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 0x55a42d2fe2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59690/0 (socket says 172.21.15.142:59690) 2023-09-21T13:10:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.829+0000 7faeb5d9b700 1 -- 172.21.15.142:0/1554368205 learned_addr learned my addr 172.21.15.142:0/1554368205 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.829+0000 7faeb6d9d700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d2f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 -- 172.21.15.142:0/1554368205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 msgr2=0x55a42d2fe2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 0x55a42d2fe2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb659c700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 0x55a42d2fd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 -- 172.21.15.142:0/1554368205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 msgr2=0x55a42d2fd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:16.826 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 0x55a42d2fd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 -- 172.21.15.142:0/1554368205 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a42d075d80 con 0x55a42d2f90a0 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb659c700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 0x55a42d2fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faea77fe700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 0x7faea00a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.830+0000 7faeb6d9d700 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d2f9480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faeb0007e40 tx=0x7faeb000a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=329b0d5c78a8e972 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.831+0000 7faea77fe700 1 -- 172.21.15.142:0/559159587 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faeac014070 con 0x7faeb81037f0 2023-09-21T13:10:16.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.831+0000 7faea4ff9700 1 -- 172.21.15.142:0/1554368205 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb000f070 con 0x55a42d2f90a0 2023-09-21T13:10:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.831+0000 7faea4ff9700 1 -- 172.21.15.142:0/1554368205 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faeb000a0d0 con 0x55a42d2f90a0 2023-09-21T13:10:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.831+0000 7faea4ff9700 1 -- 172.21.15.142:0/1554368205 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0008650 con 0x55a42d2f90a0 2023-09-21T13:10:16.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.831+0000 7faeb659c700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 0x7faea00a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 -- 172.21.15.142:0/1554368205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 msgr2=0x55a42d2f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d2f9480 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faeb0007e40 tx=0x7faeb000a6f0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faeb659c700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 0x7faea00a2e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faea8006010 tx=0x7faea8005c00 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 -- 172.21.15.142:0/1554368205 shutdown_connections 2023-09-21T13:10:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2fde50 0x55a42d2fe2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d2f9480 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 --2- 172.21.15.142:0/1554368205 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2f99c0 0x55a42d2fd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 -- 172.21.15.142:0/1554368205 >> 172.21.15.142:0/1554368205 conn(0x55a42d225fa0 msgr2=0x55a42d2f40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.833+0000 7faed0969b80 1 -- 172.21.15.142:0/1554368205 shutdown_connections 2023-09-21T13:10:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.834+0000 7faed0969b80 1 -- 172.21.15.142:0/1554368205 wait complete. 2023-09-21T13:10:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.834+0000 7faed0969b80 1 -- start start 2023-09-21T13:10:16.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.835+0000 7faed0969b80 1 Processor -- start 2023-09-21T13:10:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d302920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d3033a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d24ae20 con 0x55a42d2fde50 2023-09-21T13:10:16.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d1e76e0 con 0x55a42d2f90a0 2023-09-21T13:10:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d1e7380 con 0x55a42d2f99c0 2023-09-21T13:10:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faed0969b80 10 client.0 _ll_register_callbacks cb 0x55a42d131a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.834 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41810/0 (socket says 172.21.15.142:41810) 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 -- 172.21.15.142:0/3897915888 learned_addr learned my addr 172.21.15.142:0/3897915888 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 -- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 msgr2=0x55a42d302920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d302920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.836+0000 7faeb5d9b700 1 -- 172.21.15.142:0/3897915888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 msgr2=0x55a42d3033a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d3033a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.835 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7faeb5d9b700 1 -- 172.21.15.142:0/3897915888 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb0007af0 con 0x55a42d2f99c0 2023-09-21T13:10:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faeac0c9a10 tx=0x7faeac095b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28778db3e012bed7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7fae9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:10:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeac09d320 con 0x55a42d2f99c0 2023-09-21T13:10:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.837+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faeac0ce320 con 0x55a42d2f99c0 2023-09-21T13:10:16.836 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.838+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a42d1bbb50 con 0x55a42d2f99c0 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.838+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeac099dc0 con 0x55a42d2f99c0 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.838+0000 7faed0969b80 10 client.28069 fetch_fsmap learned FSMap version 48 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.838+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55a42d05ec00 con 0x55a42d2f99c0 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.838+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a42d1bbb50 con 0x55a42d2f99c0 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 48) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faeac0a12a0 con 0x55a42d2f99c0 2023-09-21T13:10:16.837 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 10 client.28069 fetch_fsmap finished waiting for FSMap version 48 2023-09-21T13:10:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 10 client.28069 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 20 client.28069 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d323ec0 0x55a42d3262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 4 client.28069 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:16.838 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a42d2c7fc0 con 0x55a42d323ec0 2023-09-21T13:10:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.839+0000 7faeb659c700 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d323ec0 0x55a42d3262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.840+0000 7faeb659c700 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d323ec0 0x55a42d3262e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36582021cdeb6adf server_cookie=36440181fc6eb08a in_seq=0 out_seq=0 2023-09-21T13:10:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.840+0000 7fae9dffb700 10 client.28069 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.842+0000 7fae9dffb700 1 -- 172.21.15.142:0/3897915888 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a42d2c7fc0 con 0x55a42d323ec0 2023-09-21T13:10:16.840 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.842+0000 7fae9dffb700 10 client.28069 handle_command_reply: tid=0 2023-09-21T13:10:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.842+0000 7faed0969b80 1 client.28069 shutdown 2023-09-21T13:10:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 msgr2=0x55a42d302e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7faeac0c9a10 tx=0x7faeac095b20 comp rx=0 tx=0).stop 2023-09-21T13:10:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 shutdown_connections 2023-09-21T13:10:16.841 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d323ec0 0x55a42d3262e0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d3033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d302920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 --2- 172.21.15.142:0/3897915888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d302e60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7fae9dffb700 0 client.28069 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:16.842 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 >> 172.21.15.142:0/3897915888 conn(0x55a42d225fa0 msgr2=0x55a42d2f3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 shutdown_connections 2023-09-21T13:10:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.843+0000 7faed0969b80 1 -- 172.21.15.142:0/3897915888 wait complete. 2023-09-21T13:10:16.843 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.844+0000 7faed0969b80 20 client.28069 trim_cache size 0 max 16384 2023-09-21T13:10:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.869+0000 7faed0969b80 1 Processor -- start 2023-09-21T13:10:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.869+0000 7faed0969b80 1 -- start start 2023-09-21T13:10:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.869+0000 7faed0969b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faed0969b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d2fcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faed0969b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faed0969b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d0cb8c0 con 0x55a42d2fde50 2023-09-21T13:10:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faed0969b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d305dc0 con 0x55a42d2f90a0 2023-09-21T13:10:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faed0969b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d1bbb50 con 0x55a42d2f99c0 2023-09-21T13:10:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59704/0 (socket says 172.21.15.142:59704) 2023-09-21T13:10:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 -- 172.21.15.142:0/230423330 learned_addr learned my addr 172.21.15.142:0/230423330 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d2fcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb6d9d700 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 -- 172.21.15.142:0/230423330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 msgr2=0x55a42d2fcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d2fcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 -- 172.21.15.142:0/230423330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 msgr2=0x55a42d2fd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.870+0000 7faeb659c700 1 -- 172.21.15.142:0/230423330 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a42d302490 con 0x55a42d2f90a0 2023-09-21T13:10:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.871+0000 7faeb659c700 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faea8009990 tx=0x7faea8021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac49131f3225167 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.871+0000 7faea57fa700 1 -- 172.21.15.142:0/230423330 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea802c040 con 0x55a42d2f90a0 2023-09-21T13:10:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.871+0000 7faea57fa700 1 -- 172.21.15.142:0/230423330 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faea8005700 con 0x55a42d2f90a0 2023-09-21T13:10:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.871+0000 7faea57fa700 1 -- 172.21.15.142:0/230423330 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea801e070 con 0x55a42d2f90a0 2023-09-21T13:10:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.872+0000 7faed0969b80 1 -- 172.21.15.142:0/230423330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 msgr2=0x55a42d309fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.872+0000 7faed0969b80 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faea8009990 tx=0x7faea8021000 comp rx=0 tx=0).stop 2023-09-21T13:10:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 -- 172.21.15.142:0/230423330 shutdown_connections 2023-09-21T13:10:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f90a0 0x55a42d309fd0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 --2- 172.21.15.142:0/230423330 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f99c0 0x55a42d2fcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 -- 172.21.15.142:0/230423330 >> 172.21.15.142:0/230423330 conn(0x55a42d225fa0 msgr2=0x55a42d2fc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 -- 172.21.15.142:0/230423330 shutdown_connections 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 -- 172.21.15.142:0/230423330 wait complete. 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.873+0000 7faed0969b80 1 -- start start 2023-09-21T13:10:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.874+0000 7faed0969b80 1 Processor -- start 2023-09-21T13:10:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.874+0000 7faed0969b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.874+0000 7faed0969b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f99c0 0x55a42d2fa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faed0969b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faed0969b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d305570 con 0x55a42d2fde50 2023-09-21T13:10:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faed0969b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d2fb1b0 con 0x55a42d2f99c0 2023-09-21T13:10:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faed0969b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a42d2fb340 con 0x55a42d2f90a0 2023-09-21T13:10:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faed0969b80 10 client.0 _ll_register_callbacks cb 0x55a42d131a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41840/0 (socket says 172.21.15.142:41840) 2023-09-21T13:10:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 -- 172.21.15.142:0/4139120030 learned_addr learned my addr 172.21.15.142:0/4139120030 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 -- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f99c0 msgr2=0x55a42d2fa730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:10:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f99c0 0x55a42d2fa730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 -- 172.21.15.142:0/4139120030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 msgr2=0x55a42d2fac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.875+0000 7faeb659c700 1 -- 172.21.15.142:0/4139120030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb8114d10 con 0x55a42d2f90a0 2023-09-21T13:10:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.876+0000 7faeb659c700 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faea802e340 tx=0x7faea8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39ef489b31534e2d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.876+0000 7fae9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:10:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.876+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea801e070 con 0x55a42d2f90a0 2023-09-21T13:10:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.876+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(105..105 src has 1..105) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faea802e9f0 con 0x55a42d2f90a0 2023-09-21T13:10:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.876+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a42d243e00 con 0x55a42d2f90a0 2023-09-21T13:10:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.877+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7faea802c040 con 0x55a42d2f90a0 2023-09-21T13:10:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.877+0000 7faed0969b80 10 client.28075 fetch_fsmap learned FSMap version 48 2023-09-21T13:10:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.877+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55a42d09c1f0 con 0x55a42d2f90a0 2023-09-21T13:10:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.878+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a42d243e00 con 0x55a42d2f90a0 2023-09-21T13:10:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.878+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 48) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faea803e020 con 0x55a42d2f90a0 2023-09-21T13:10:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 10 client.28075 fetch_fsmap finished waiting for FSMap version 48 2023-09-21T13:10:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 10 client.28075 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 20 client.28075 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d378cf0 0x55a42d37b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 4 client.28075 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:10:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a42d243b20 con 0x55a42d378cf0 2023-09-21T13:10:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.879+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d378cf0 0x55a42d37b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.881+0000 7faeb5d9b700 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d378cf0 0x55a42d37b110 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97996509d10db9f0 server_cookie=de999e21f45690a6 in_seq=0 out_seq=0 2023-09-21T13:10:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:16.881+0000 7fae9dffb700 10 client.28075 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:17.022 INFO:tasks.workunit.client.0.smithi142.stdout: 10 32889 34.17 MB/sec warmup 57 sec latency 124.908 ms 2023-09-21T13:10:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.137+0000 7fae9dffb700 1 -- 172.21.15.142:0/4139120030 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a42d243b20 con 0x55a42d378cf0 2023-09-21T13:10:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.137+0000 7fae9dffb700 10 client.28075 handle_command_reply: tid=0 2023-09-21T13:10:17.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.137+0000 7faed0969b80 1 client.28075 shutdown 2023-09-21T13:10:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.145+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 msgr2=0x55a42d304f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.145+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7faea802e340 tx=0x7faea8009310 comp rx=0 tx=0).stop 2023-09-21T13:10:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 shutdown_connections 2023-09-21T13:10:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a42d378cf0 0x55a42d37b110 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a42d2fde50 0x55a42d2fac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a42d2f90a0 0x55a42d304f70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 --2- 172.21.15.142:0/4139120030 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a42d2f99c0 0x55a42d2fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.147+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 >> 172.21.15.142:0/4139120030 conn(0x55a42d225fa0 msgr2=0x55a42d2fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.151+0000 7fae9dffb700 0 client.28075 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:17.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.151+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 shutdown_connections 2023-09-21T13:10:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.151+0000 7faed0969b80 1 -- 172.21.15.142:0/4139120030 wait complete. 2023-09-21T13:10:17.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.152+0000 7faed0969b80 20 client.28075 trim_cache size 0 max 16384 2023-09-21T13:10:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:10:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:10:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:10:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:10:17.152 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.157+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 msgr2=0x7faea00a2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.157+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 0x7faea00a2e00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7faea8006010 tx=0x7faea8005c00 comp rx=0 tx=0).stop 2023-09-21T13:10:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.157+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 msgr2=0x7faeb8114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.157+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faeac00e9a0 tx=0x7faeac00ed60 comp rx=0 tx=0).stop 2023-09-21T13:10:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 shutdown_connections 2023-09-21T13:10:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faea00a0940 0x7faea00a2e00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faeb8068710 0x7faeb8113ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faeb8105cf0 0x7faeb810cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 --2- 172.21.15.142:0/559159587 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faeb81037f0 0x7faeb8114570 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.158+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 >> 172.21.15.142:0/559159587 conn(0x7faeb8076800 msgr2=0x7faeb80fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.160+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 shutdown_connections 2023-09-21T13:10:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:17.161+0000 7faebcfff700 1 -- 172.21.15.142:0/559159587 wait complete. 2023-09-21T13:10:17.682 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:10:17.683 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:10:17.683 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/3402361958 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b6fecd1e0 con 0x558b6fea2800 2023-09-21T13:10:17.683 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:10:18.019 INFO:tasks.workunit.client.0.smithi142.stdout: 10 33759 34.23 MB/sec warmup 58 sec latency 234.257 ms 2023-09-21T13:10:18.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-mon[134450]: pgmap v442: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:10:18.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:17 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:10:18.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:17 smithi156 ceph-mon[134078]: pgmap v442: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:10:18.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:17 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:10:18.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:17 smithi142 ceph-mon[97663]: pgmap v442: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:10:18.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:17 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:10:19.020 INFO:tasks.workunit.client.0.smithi142.stdout: 10 34833 34.76 MB/sec warmup 59 sec latency 85.843 ms 2023-09-21T13:10:19.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:18 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:10:19.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:18 smithi160 ceph-mon[134450]: osdmap e106: 12 total, 12 up, 12 in 2023-09-21T13:10:19.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:18 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/497997469,v1:172.21.15.160:6839/497997469] up:boot 2023-09-21T13:10:19.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:18 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:10:19.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:18 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:10:19.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:18 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:10:19.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:18 smithi156 ceph-mon[134078]: osdmap e106: 12 total, 12 up, 12 in 2023-09-21T13:10:19.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:18 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/497997469,v1:172.21.15.160:6839/497997469] up:boot 2023-09-21T13:10:19.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:18 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:10:19.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:18 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:10:19.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:18 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:10:19.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:18 smithi142 ceph-mon[97663]: osdmap e106: 12 total, 12 up, 12 in 2023-09-21T13:10:19.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:18 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/497997469,v1:172.21.15.160:6839/497997469] up:boot 2023-09-21T13:10:19.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:18 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:10:19.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:18 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:10:20.019 INFO:tasks.workunit.client.0.smithi142.stdout: 10 35650 35.01 MB/sec warmup 60 sec latency 101.949 ms 2023-09-21T13:10:20.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:19 smithi156 ceph-mon[134078]: pgmap v444: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 14 MiB/s wr, 696 op/s 2023-09-21T13:10:20.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:19 smithi142 ceph-mon[97663]: pgmap v444: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 14 MiB/s wr, 696 op/s 2023-09-21T13:10:20.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:19 smithi160 ceph-mon[134450]: pgmap v444: 97 pgs: 97 active+clean; 745 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 MiB/s rd, 14 MiB/s wr, 696 op/s 2023-09-21T13:10:20.720 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:10:21.020 INFO:tasks.workunit.client.0.smithi142.stdout: 10 36343 34.91 MB/sec warmup 61 sec latency 53.838 ms 2023-09-21T13:10:21.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 -- 172.21.15.142:0/2819156572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 msgr2=0x7f5e90100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 --2- 172.21.15.142:0/2819156572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e90100270 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000dd20 tx=0x7f5e8000f330 comp rx=0 tx=0).stop 2023-09-21T13:10:21.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 -- 172.21.15.142:0/2819156572 shutdown_connections 2023-09-21T13:10:21.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 --2- 172.21.15.142:0/2819156572 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e90104fb0 0x7f5e9010cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 --2- 172.21.15.142:0/2819156572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e90100270 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 --2- 172.21.15.142:0/2819156572 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e90100840 0x7f5e90104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 -- 172.21.15.142:0/2819156572 >> 172.21.15.142:0/2819156572 conn(0x7f5e900fb730 msgr2=0x7f5e900fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.072+0000 7f5e967ff700 1 -- 172.21.15.142:0/2819156572 shutdown_connections 2023-09-21T13:10:21.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.073+0000 7f5e967ff700 1 -- 172.21.15.142:0/2819156572 wait complete. 2023-09-21T13:10:21.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.074+0000 7f5e967ff700 1 Processor -- start 2023-09-21T13:10:21.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.074+0000 7f5e967ff700 1 -- start start 2023-09-21T13:10:21.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e90104fb0 0x7f5e901a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e901aa800 0x7f5e901aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901ab280 con 0x7f5e901aa800 2023-09-21T13:10:21.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901ab3f0 con 0x7f5e90104fb0 2023-09-21T13:10:21.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e967ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e901ab5b0 con 0x7f5e900ffe90 2023-09-21T13:10:21.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.075+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:41852/0 (socket says 172.21.15.142:41852) 2023-09-21T13:10:21.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1749383632 learned_addr learned my addr 172.21.15.142:0/1749383632 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:21.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e901aa800 0x7f5e901aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1749383632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e90104fb0 msgr2=0x7f5e901a63a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T13:10:21.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e90104fb0 0x7f5e901a63a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e901aa800 msgr2=0x7f5e901aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e901aa800 0x7f5e901aac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1749383632 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8000da00 con 0x7f5e900ffe90 2023-09-21T13:10:21.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.076+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000fec0 tx=0x7f5e8000d960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.079+0000 7f5e8d7fa700 1 -- 172.21.15.142:0/1749383632 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80012040 con 0x7f5e900ffe90 2023-09-21T13:10:21.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.079+0000 7f5e8d7fa700 1 -- 172.21.15.142:0/1749383632 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e80003d40 con 0x7f5e900ffe90 2023-09-21T13:10:21.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.079+0000 7f5e8d7fa700 1 -- 172.21.15.142:0/1749383632 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80016dc0 con 0x7f5e900ffe90 2023-09-21T13:10:21.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.079+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9019a250 con 0x7f5e900ffe90 2023-09-21T13:10:21.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.080+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9019a710 con 0x7f5e900ffe90 2023-09-21T13:10:21.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.086+0000 7f5e8d7fa700 1 -- 172.21.15.142:0/1749383632 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5e800164c0 con 0x7f5e900ffe90 2023-09-21T13:10:21.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.088+0000 7f5e8d7fa700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 0x7f5e780a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.088+0000 7f5e8d7fa700 1 -- 172.21.15.142:0/1749383632 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e800cc9d0 con 0x7f5e900ffe90 2023-09-21T13:10:21.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 Processor -- start 2023-09-21T13:10:21.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 -- start start 2023-09-21T13:10:21.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e35360 0x5625c3e357c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3da4ca0 con 0x5625c3e35360 2023-09-21T13:10:21.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3d88c70 con 0x5625c3e30610 2023-09-21T13:10:21.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.089+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3d86590 con 0x5625c3e30f30 2023-09-21T13:10:21.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59728/0 (socket says 172.21.15.142:59728) 2023-09-21T13:10:21.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1126177564 learned_addr learned my addr 172.21.15.142:0/1126177564 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:21.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1126177564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 msgr2=0x5625c3e34e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:21.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1126177564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e35360 msgr2=0x5625c3e357c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e35360 0x5625c3e357c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.090+0000 7f5e8ffff700 1 -- 172.21.15.142:0/1126177564 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c3bacde0 con 0x5625c3e30610 2023-09-21T13:10:21.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.091+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e800a1990 tx=0x7f5e8000d8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0b21dc038cc194 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.091+0000 7f5e767fc700 1 -- 172.21.15.142:0/1126177564 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e80099ee0 con 0x5625c3e30610 2023-09-21T13:10:21.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.091+0000 7f5e767fc700 1 -- 172.21.15.142:0/1126177564 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e8009dd10 con 0x5625c3e30610 2023-09-21T13:10:21.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.091+0000 7f5e767fc700 1 -- 172.21.15.142:0/1126177564 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e800993d0 con 0x5625c3e30610 2023-09-21T13:10:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.091+0000 7f5e8f7fe700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 0x7f5e780a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.092+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1126177564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 msgr2=0x5625c3e309f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.092+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5e800a1990 tx=0x7f5e8000d8c0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1126177564 shutdown_connections 2023-09-21T13:10:21.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e35360 0x5625c3e357c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e30610 0x5625c3e309f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1126177564 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1126177564 >> 172.21.15.142:0/1126177564 conn(0x5625c3d5d000 msgr2=0x5625c3e2b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1126177564 shutdown_connections 2023-09-21T13:10:21.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5e8f7fe700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 0x7f5e780a2e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e901a7470 tx=0x7f5e84009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.093+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1126177564 wait complete. 2023-09-21T13:10:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.094+0000 7f5eaa14bb80 1 -- start start 2023-09-21T13:10:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.095+0000 7f5eaa14bb80 1 Processor -- start 2023-09-21T13:10:21.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.095+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e39e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.095+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e3a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.095+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.095+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3d81e80 con 0x5625c3e30610 2023-09-21T13:10:21.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3d1e740 con 0x5625c3e35360 2023-09-21T13:10:21.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3d1e3e0 con 0x5625c3e30f30 2023-09-21T13:10:21.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5eaa14bb80 10 client.0 _ll_register_callbacks cb 0x5625c3c68a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:21.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59738/0 (socket says 172.21.15.142:59738) 2023-09-21T13:10:21.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.096+0000 7f5e94d9c700 1 -- 172.21.15.142:0/20497059 learned_addr learned my addr 172.21.15.142:0/20497059 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:21.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.097+0000 7f5e94d9c700 1 -- 172.21.15.142:0/20497059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 msgr2=0x5625c3e3a350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:10:21.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.097+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e3a350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.097+0000 7f5e94d9c700 1 -- 172.21.15.142:0/20497059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 msgr2=0x5625c3e39e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.097+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e39e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.096 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.097+0000 7f5e94d9c700 1 -- 172.21.15.142:0/20497059 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9019a710 con 0x5625c3e35360 2023-09-21T13:10:21.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009920 tx=0x7f5e8800acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f9b231a25f28b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5e6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:21.097 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88010040 con 0x5625c3e35360 2023-09-21T13:10:21.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625c3cf2bb0 con 0x5625c3e35360 2023-09-21T13:10:21.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e8800e940 con 0x5625c3e35360 2023-09-21T13:10:21.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e88009b20 con 0x5625c3e35360 2023-09-21T13:10:21.098 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.099+0000 7f5eaa14bb80 10 client.28145 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:21.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.100+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5625c3b95c60 con 0x5625c3e35360 2023-09-21T13:10:21.099 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.100+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5625c3cf2bb0 con 0x5625c3e35360 2023-09-21T13:10:21.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5e88008030 con 0x5625c3e35360 2023-09-21T13:10:21.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 10 client.28145 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:21.100 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 10 client.28145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:21.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 20 client.28145 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:21.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3e5b410 0x5625c3e5d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 4 client.28145 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:21.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625c3dff020 con 0x5625c3e5b410 2023-09-21T13:10:21.101 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.105+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3e5b410 0x5625c3e5d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.106+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3e5b410 0x5625c3e5d830 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94dc2b7eb1e8f3f3 server_cookie=bc8ce5df9a5ee159 in_seq=0 out_seq=0 2023-09-21T13:10:21.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.106+0000 7f5e6f7fe700 10 client.28145 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:21.102 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.107+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/20497059 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625c3dff020 con 0x5625c3e5b410 2023-09-21T13:10:21.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.107+0000 7f5e6f7fe700 10 client.28145 handle_command_reply: tid=0 2023-09-21T13:10:21.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.107+0000 7f5eaa14bb80 1 client.28145 shutdown 2023-09-21T13:10:21.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 msgr2=0x5625c3e3a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5e88009920 tx=0x7f5e8800acb0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 shutdown_connections 2023-09-21T13:10:21.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3e5b410 0x5625c3e5d830 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e39e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a890 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/20497059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e3a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 >> 172.21.15.142:0/20497059 conn(0x5625c3d5d000 msgr2=0x5625c3e2b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.110+0000 7f5e6f7fe700 0 client.28145 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:21.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.111+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 shutdown_connections 2023-09-21T13:10:21.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.111+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/20497059 wait complete. 2023-09-21T13:10:21.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.111+0000 7f5eaa14bb80 20 client.28145 trim_cache size 0 max 16384 2023-09-21T13:10:21.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 Processor -- start 2023-09-21T13:10:21.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 -- start start 2023-09-21T13:10:21.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e412f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3c02920 con 0x5625c3e30610 2023-09-21T13:10:21.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3e231a0 con 0x5625c3e35360 2023-09-21T13:10:21.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.134+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3e41830 con 0x5625c3e30f30 2023-09-21T13:10:21.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59750/0 (socket says 172.21.15.142:59750) 2023-09-21T13:10:21.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 -- 172.21.15.142:0/3939919645 learned_addr learned my addr 172.21.15.142:0/3939919645 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:21.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e412f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 -- 172.21.15.142:0/3939919645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 msgr2=0x5625c3e34b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 -- 172.21.15.142:0/3939919645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 msgr2=0x5625c3e412f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e412f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.135+0000 7f5e94d9c700 1 -- 172.21.15.142:0/3939919645 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c3bd3250 con 0x5625c3e35360 2023-09-21T13:10:21.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.136+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5e880098f0 tx=0x7f5e8800e440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b55ce442f5ab8ef server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.136+0000 7f5e76ffd700 1 -- 172.21.15.142:0/3939919645 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802b070 con 0x5625c3e35360 2023-09-21T13:10:21.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.136+0000 7f5e76ffd700 1 -- 172.21.15.142:0/3939919645 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e88014400 con 0x5625c3e35360 2023-09-21T13:10:21.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.136+0000 7f5e76ffd700 1 -- 172.21.15.142:0/3939919645 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e88010070 con 0x5625c3e35360 2023-09-21T13:10:21.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/3939919645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 msgr2=0x5625c3e36ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5e880098f0 tx=0x7f5e8800e440 comp rx=0 tx=0).stop 2023-09-21T13:10:21.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/3939919645 shutdown_connections 2023-09-21T13:10:21.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30610 0x5625c3e412f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e36ff0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/3939919645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30f30 0x5625c3e34b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/3939919645 >> 172.21.15.142:0/3939919645 conn(0x5625c3d5d000 msgr2=0x5625c3e34420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.137+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/3939919645 shutdown_connections 2023-09-21T13:10:21.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.139+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/3939919645 wait complete. 2023-09-21T13:10:21.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.139+0000 7f5eaa14bb80 1 -- start start 2023-09-21T13:10:21.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.139+0000 7f5eaa14bb80 1 Processor -- start 2023-09-21T13:10:21.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30610 0x5625c3e396b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30f30 0x5625c3e39bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3e416e0 con 0x5625c3e30f30 2023-09-21T13:10:21.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3eaf270 con 0x5625c3e35360 2023-09-21T13:10:21.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3eaf430 con 0x5625c3e30610 2023-09-21T13:10:21.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5eaa14bb80 10 client.0 _ll_register_callbacks cb 0x5625c3c68a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:21.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5e94d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:59766/0 (socket says 172.21.15.142:59766) 2023-09-21T13:10:21.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5e94d9c700 1 -- 172.21.15.142:0/1632827692 learned_addr learned my addr 172.21.15.142:0/1632827692 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:21.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.140+0000 7f5e8f7fe700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30f30 0x5625c3e39bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30610 0x5625c3e396b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 -- 172.21.15.142:0/1632827692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30610 msgr2=0x5625c3e396b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30610 0x5625c3e396b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 -- 172.21.15.142:0/1632827692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30f30 msgr2=0x5625c3e39bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:21.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30f30 0x5625c3e39bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 -- 172.21.15.142:0/1632827692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625c3b95c60 con 0x5625c3e35360 2023-09-21T13:10:21.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e94d9c700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e880145b0 tx=0x7f5e88003df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c5db080c46accf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:21.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.141+0000 7f5e6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:21.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8802b070 con 0x5625c3e35360 2023-09-21T13:10:21.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f5e88014ac0 con 0x5625c3e35360 2023-09-21T13:10:21.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e8009dd10 con 0x5625c3e35360 2023-09-21T13:10:21.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e88010040 con 0x5625c3e35360 2023-09-21T13:10:21.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5eaa14bb80 10 client.28151 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:21.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.142+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5625c3bab2b0 con 0x5625c3e35360 2023-09-21T13:10:21.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5e8009dd10 con 0x5625c3e35360 2023-09-21T13:10:21.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5e88037070 con 0x5625c3e35360 2023-09-21T13:10:21.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 10 client.28151 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:21.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 10 client.28151 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:21.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 20 client.28151 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:21.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3eb09a0 0x5625c3eb2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:21.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 4 client.28151 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:10:21.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5625c3d7ae60 con 0x5625c3eb09a0 2023-09-21T13:10:21.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.143+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3eb09a0 0x5625c3eb2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:21.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.144+0000 7f5e8ffff700 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3eb09a0 0x5625c3eb2dc0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a0cc06d2e4f513 server_cookie=e2584ab69bc4b690 in_seq=0 out_seq=0 2023-09-21T13:10:21.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.144+0000 7f5e6f7fe700 10 client.28151 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:21.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.144+0000 7f5e6f7fe700 1 -- 172.21.15.142:0/1632827692 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5625c3d7ae60 con 0x5625c3eb09a0 2023-09-21T13:10:21.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.144+0000 7f5e6f7fe700 10 client.28151 handle_command_reply: tid=0 2023-09-21T13:10:21.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.144+0000 7f5eaa14bb80 1 client.28151 shutdown 2023-09-21T13:10:21.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 msgr2=0x5625c3e3a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e880145b0 tx=0x7f5e88003df0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 shutdown_connections 2023-09-21T13:10:21.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5625c3eb09a0 0x5625c3eb2dc0 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5625c3e35360 0x5625c3e3a130 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5625c3e30610 0x5625c3e396b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5e6f7fe700 0 client.28151 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 --2- 172.21.15.142:0/1632827692 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5625c3e30f30 0x5625c3e39bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 >> 172.21.15.142:0/1632827692 conn(0x5625c3d5d000 msgr2=0x5625c3e2f410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 shutdown_connections 2023-09-21T13:10:21.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.145+0000 7f5eaa14bb80 1 -- 172.21.15.142:0/1632827692 wait complete. 2023-09-21T13:10:21.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.146+0000 7f5eaa14bb80 20 client.28151 trim_cache size 0 max 16384 2023-09-21T13:10:21.149 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:10:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:10:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:10:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:10:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:10:21.150 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:10:21.151 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:10:21.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:10:21.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:10:21.151 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:10:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.146+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 msgr2=0x7f5e780a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.146+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 0x7f5e780a2e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e901a7470 tx=0x7f5e84009260 comp rx=0 tx=0).stop 2023-09-21T13:10:21.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.146+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 msgr2=0x7f5e901a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.146+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f5e8000fec0 tx=0x7f5e8000d960 comp rx=0 tx=0).stop 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 shutdown_connections 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5e780a09c0 0x7f5e780a2e80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5e901aa800 0x7f5e901aac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e900ffe90 0x7f5e901a5e60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 --2- 172.21.15.142:0/1749383632 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5e90104fb0 0x7f5e901a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:21.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 >> 172.21.15.142:0/1749383632 conn(0x7f5e900fb730 msgr2=0x7f5e90103960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:21.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 shutdown_connections 2023-09-21T13:10:21.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:21.147+0000 7f5e967ff700 1 -- 172.21.15.142:0/1749383632 wait complete. 2023-09-21T13:10:21.169 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:10:22.020 INFO:tasks.workunit.client.0.smithi142.stdout: 10 37394 35.10 MB/sec warmup 62 sec latency 65.083 ms 2023-09-21T13:10:22.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:21 smithi156 ceph-mon[134078]: pgmap v445: 97 pgs: 97 active+clean; 742 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 12 MiB/s wr, 784 op/s 2023-09-21T13:10:22.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:21 smithi142 ceph-mon[97663]: pgmap v445: 97 pgs: 97 active+clean; 742 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 12 MiB/s wr, 784 op/s 2023-09-21T13:10:22.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:21 smithi160 ceph-mon[134450]: pgmap v445: 97 pgs: 97 active+clean; 742 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 12 MiB/s wr, 784 op/s 2023-09-21T13:10:23.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 38523 35.78 MB/sec warmup 63 sec latency 81.042 ms 2023-09-21T13:10:24.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 39183 35.72 MB/sec warmup 64 sec latency 62.600 ms 2023-09-21T13:10:24.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:23 smithi156 ceph-mon[134078]: pgmap v446: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:24.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:23 smithi142 ceph-mon[97663]: pgmap v446: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:24.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:23 smithi160 ceph-mon[134450]: pgmap v446: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:25.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 39959 35.77 MB/sec warmup 65 sec latency 79.732 ms 2023-09-21T13:10:26.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 41249 36.28 MB/sec warmup 66 sec latency 40.982 ms 2023-09-21T13:10:26.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:25 smithi156 ceph-mon[134078]: pgmap v447: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:26.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:25 smithi142 ceph-mon[97663]: pgmap v447: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:26.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:25 smithi160 ceph-mon[134450]: pgmap v447: 97 pgs: 97 active+clean; 755 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 MiB/s rd, 12 MiB/s wr, 862 op/s 2023-09-21T13:10:27.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 42139 36.57 MB/sec warmup 67 sec latency 66.950 ms 2023-09-21T13:10:28.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 42934 36.54 MB/sec warmup 68 sec latency 58.862 ms 2023-09-21T13:10:28.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:27 smithi156 ceph-mon[134078]: pgmap v448: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 8.0 MiB/s wr, 730 op/s 2023-09-21T13:10:28.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:27 smithi142 ceph-mon[97663]: pgmap v448: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 8.0 MiB/s wr, 730 op/s 2023-09-21T13:10:28.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:27 smithi160 ceph-mon[134450]: pgmap v448: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 MiB/s rd, 8.0 MiB/s wr, 730 op/s 2023-09-21T13:10:29.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 43971 36.71 MB/sec warmup 69 sec latency 38.130 ms 2023-09-21T13:10:30.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 44896 37.10 MB/sec warmup 70 sec latency 95.304 ms 2023-09-21T13:10:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 -- 172.21.15.142:0/1834454903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9524101cd0 msgr2=0x7f95240681d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 --2- 172.21.15.142:0/1834454903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9524101cd0 0x7f95240681d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9514009990 tx=0x7f9514009ca0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 -- 172.21.15.142:0/1834454903 shutdown_connections 2023-09-21T13:10:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 --2- 172.21.15.142:0/1834454903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f952410d650 0x7f952410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 --2- 172.21.15.142:0/1834454903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9524101cd0 0x7f95240681d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 --2- 172.21.15.142:0/1834454903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f95240687a0 0x7f9524068c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.390+0000 7f95293ff700 1 -- 172.21.15.142:0/1834454903 >> 172.21.15.142:0/1834454903 conn(0x7f9524076800 msgr2=0x7f9524076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.391+0000 7f95293ff700 1 -- 172.21.15.142:0/1834454903 shutdown_connections 2023-09-21T13:10:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.393+0000 7f95293ff700 1 -- 172.21.15.142:0/1834454903 wait complete. 2023-09-21T13:10:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.394+0000 7f95293ff700 1 Processor -- start 2023-09-21T13:10:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.395+0000 7f95293ff700 1 -- start start 2023-09-21T13:10:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.395+0000 7f95293ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.395+0000 7f95293ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 0x7f9524199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95293ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 0x7f952419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95293ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419e710 con 0x7f952419dc90 2023-09-21T13:10:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95293ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419e880 con 0x7f952410d650 2023-09-21T13:10:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95293ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419ea40 con 0x7f95240687a0 2023-09-21T13:10:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f9522ffd700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:34636/0 (socket says 172.21.15.142:34636) 2023-09-21T13:10:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f9522ffd700 1 -- 172.21.15.142:0/3697784057 learned_addr learned my addr 172.21.15.142:0/3697784057 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95227fc700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 0x7f9524199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f95237fe700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 0x7f952419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f9522ffd700 1 -- 172.21.15.142:0/3697784057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 msgr2=0x7f9524199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.396+0000 7f9522ffd700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 0x7f9524199620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f9522ffd700 1 -- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 msgr2=0x7f952419e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f9522ffd700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 0x7f952419e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f9522ffd700 1 -- 172.21.15.142:0/3697784057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95140095f0 con 0x7f95240687a0 2023-09-21T13:10:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f95237fe700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 0x7f952419e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:10:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f95227fc700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 0x7f9524199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:10:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f9522ffd700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f95140098e0 tx=0x7f951400f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f950bfff700 1 -- 172.21.15.142:0/3697784057 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951401d070 con 0x7f95240687a0 2023-09-21T13:10:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f950bfff700 1 -- 172.21.15.142:0/3697784057 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9514005510 con 0x7f95240687a0 2023-09-21T13:10:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.397+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95241020c0 con 0x7f95240687a0 2023-09-21T13:10:30.395 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.398+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9524102560 con 0x7f95240687a0 2023-09-21T13:10:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.398+0000 7f950bfff700 1 -- 172.21.15.142:0/3697784057 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9514004bd0 con 0x7f95240687a0 2023-09-21T13:10:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f950bfff700 1 -- 172.21.15.142:0/3697784057 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f9514004d30 con 0x7f95240687a0 2023-09-21T13:10:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 Processor -- start 2023-09-21T13:10:30.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 -- start start 2023-09-21T13:10:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb512d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb512e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb509dc40 con 0x55fdb51299c0 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb5081c10 con 0x55fdb51290a0 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.404+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb507f530 con 0x55fdb512de50 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37600/0 (socket says 172.21.15.142:37600) 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 -- 172.21.15.142:0/3246828198 learned_addr learned my addr 172.21.15.142:0/3246828198 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:30.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95227fc700 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb512e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:29 smithi156 ceph-mon[134078]: pgmap v449: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-09-21T13:10:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 -- 172.21.15.142:0/3246828198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 msgr2=0x55fdb512e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb512e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 -- 172.21.15.142:0/3246828198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 msgr2=0x55fdb512d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb512d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.405+0000 7f95237fe700 1 -- 172.21.15.142:0/3246828198 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdb4ea5d80 con 0x55fdb51290a0 2023-09-21T13:10:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.406+0000 7f95237fe700 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f951c009e60 tx=0x7f951c0077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f24bd8b8d9e328a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.406+0000 7f95097fa700 1 -- 172.21.15.142:0/3246828198 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c014610 con 0x55fdb51290a0 2023-09-21T13:10:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.406+0000 7f95097fa700 1 -- 172.21.15.142:0/3246828198 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f951c00f050 con 0x55fdb51290a0 2023-09-21T13:10:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.406+0000 7f95097fa700 1 -- 172.21.15.142:0/3246828198 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c0139b0 con 0x55fdb51290a0 2023-09-21T13:10:30.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.406+0000 7f950bfff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 0x7f950c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.407+0000 7f950bfff700 1 -- 172.21.15.142:0/3697784057 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f95140ccca0 con 0x7f95240687a0 2023-09-21T13:10:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.407+0000 7f953cc5ab80 1 -- 172.21.15.142:0/3246828198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 msgr2=0x55fdb5129480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.407+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f951c009e60 tx=0x7f951c0077e0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 -- 172.21.15.142:0/3246828198 shutdown_connections 2023-09-21T13:10:30.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb512e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5129480 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/3246828198 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb512d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 -- 172.21.15.142:0/3246828198 >> 172.21.15.142:0/3246828198 conn(0x55fdb5055fa0 msgr2=0x55fdb51240c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f9522ffd700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 0x7f950c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 -- 172.21.15.142:0/3246828198 shutdown_connections 2023-09-21T13:10:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.408+0000 7f953cc5ab80 1 -- 172.21.15.142:0/3246828198 wait complete. 2023-09-21T13:10:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.409+0000 7f953cc5ab80 1 -- start start 2023-09-21T13:10:30.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.409+0000 7f953cc5ab80 1 Processor -- start 2023-09-21T13:10:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51290a0 0x55fdb5135660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5133040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb507ae20 con 0x55fdb51290a0 2023-09-21T13:10:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb50176e0 con 0x55fdb51299c0 2023-09-21T13:10:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb5017380 con 0x55fdb512de50 2023-09-21T13:10:30.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.410+0000 7f953cc5ab80 10 client.0 _ll_register_callbacks cb 0x55fdb4f61a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.411+0000 7f95227fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f9522ffd700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 0x7f950c0a2cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f95140095c0 tx=0x7f9514009ca0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f95227fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37608/0 (socket says 172.21.15.142:37608) 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f95227fc700 1 -- 172.21.15.142:0/799877289 learned_addr learned my addr 172.21.15.142:0/799877289 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f95227fc700 1 -- 172.21.15.142:0/799877289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 msgr2=0x55fdb5133040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f95227fc700 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5133040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.412+0000 7f95227fc700 1 -- 172.21.15.142:0/799877289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51290a0 msgr2=0x55fdb5135660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f95227fc700 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51290a0 0x55fdb5135660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f95227fc700 1 -- 172.21.15.142:0/799877289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c009a90 con 0x55fdb51299c0 2023-09-21T13:10:30.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f95227fc700 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9518011a00 tx=0x7f9518011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94e857cdf01d855 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f9506ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800f940 con 0x55fdb51299c0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdb4febb50 con 0x55fdb51299c0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.413+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f951800faa0 con 0x55fdb51299c0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f951800fc60 con 0x55fdb51299c0 2023-09-21T13:10:30.413 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 10 client.28163 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55fdb4e8ec00 con 0x55fdb51299c0 2023-09-21T13:10:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fdb4febb50 con 0x55fdb51299c0 2023-09-21T13:10:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f951801b020 con 0x55fdb51299c0 2023-09-21T13:10:30.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 10 client.28163 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 10 client.28163 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 20 client.28163 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb51431c0 0x55fdb51455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 4 client.28163 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:30.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.414+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdb50f7fc0 con 0x55fdb51431c0 2023-09-21T13:10:30.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.416+0000 7f95237fe700 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb51431c0 0x55fdb51455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:29 smithi142 ceph-mon[97663]: pgmap v449: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-09-21T13:10:30.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.417+0000 7f95237fe700 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb51431c0 0x55fdb51455e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=450092783d1f0c10 server_cookie=c678ad451f8fc104 in_seq=0 out_seq=0 2023-09-21T13:10:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.417+0000 7f9506ff5700 10 client.28163 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f9506ff5700 1 -- 172.21.15.142:0/799877289 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fdb50f7fc0 con 0x55fdb51431c0 2023-09-21T13:10:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f9506ff5700 10 client.28163 handle_command_reply: tid=0 2023-09-21T13:10:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 client.28163 shutdown 2023-09-21T13:10:30.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 msgr2=0x55fdb5132950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9518011a00 tx=0x7f9518011dc0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 shutdown_connections 2023-09-21T13:10:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb51431c0 0x55fdb51455e0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51290a0 0x55fdb5135660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5133040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f9506ff5700 0 client.28163 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/799877289 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51299c0 0x55fdb5132950 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.421+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 >> 172.21.15.142:0/799877289 conn(0x55fdb5055fa0 msgr2=0x55fdb5123cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.422+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 shutdown_connections 2023-09-21T13:10:30.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.422+0000 7f953cc5ab80 1 -- 172.21.15.142:0/799877289 wait complete. 2023-09-21T13:10:30.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.422+0000 7f953cc5ab80 20 client.28163 trim_cache size 0 max 16384 2023-09-21T13:10:30.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:29 smithi160 ceph-mon[134450]: pgmap v449: 97 pgs: 97 active+clean; 787 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 7.5 MiB/s wr, 682 op/s 2023-09-21T13:10:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.444+0000 7f953cc5ab80 1 Processor -- start 2023-09-21T13:10:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.444+0000 7f953cc5ab80 1 -- start start 2023-09-21T13:10:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb5132190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5135200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb4efb8c0 con 0x55fdb51299c0 2023-09-21T13:10:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb5122ef0 con 0x55fdb51290a0 2023-09-21T13:10:30.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb51326d0 con 0x55fdb512de50 2023-09-21T13:10:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37612/0 (socket says 172.21.15.142:37612) 2023-09-21T13:10:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 -- 172.21.15.142:0/1822065829 learned_addr learned my addr 172.21.15.142:0/1822065829 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95227fc700 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb5132190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 -- 172.21.15.142:0/1822065829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 msgr2=0x55fdb5135200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5135200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 -- 172.21.15.142:0/1822065829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 msgr2=0x55fdb5132190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:30.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb5132190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.445+0000 7f95237fe700 1 -- 172.21.15.142:0/1822065829 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdb4ecc1f0 con 0x55fdb51290a0 2023-09-21T13:10:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.446+0000 7f95237fe700 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f951c000f80 tx=0x7f951c01f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b2625509e1ffc63 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.446+0000 7f9509ffb700 1 -- 172.21.15.142:0/1822065829 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c02b070 con 0x55fdb51290a0 2023-09-21T13:10:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.446+0000 7f9509ffb700 1 -- 172.21.15.142:0/1822065829 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f951c025290 con 0x55fdb51290a0 2023-09-21T13:10:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.446+0000 7f9509ffb700 1 -- 172.21.15.142:0/1822065829 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c005050 con 0x55fdb51290a0 2023-09-21T13:10:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1822065829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 msgr2=0x55fdb512b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f951c000f80 tx=0x7f951c01f040 comp rx=0 tx=0).stop 2023-09-21T13:10:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1822065829 shutdown_connections 2023-09-21T13:10:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5135200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb512b740 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1822065829 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb5132190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.447+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1822065829 >> 172.21.15.142:0/1822065829 conn(0x55fdb5055fa0 msgr2=0x55fdb513e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.446 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.448+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1822065829 shutdown_connections 2023-09-21T13:10:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.448+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1822065829 wait complete. 2023-09-21T13:10:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.448+0000 7f953cc5ab80 1 -- start start 2023-09-21T13:10:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.449+0000 7f953cc5ab80 1 Processor -- start 2023-09-21T13:10:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5190380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5138050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb5138730 con 0x55fdb51299c0 2023-09-21T13:10:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb51388a0 con 0x55fdb51290a0 2023-09-21T13:10:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdb5138a60 con 0x55fdb512de50 2023-09-21T13:10:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f953cc5ab80 10 client.0 _ll_register_callbacks cb 0x7f95180112c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f95227fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f95227fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:54438/0 (socket says 172.21.15.142:54438) 2023-09-21T13:10:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.451+0000 7f95227fc700 1 -- 172.21.15.142:0/1106575458 learned_addr learned my addr 172.21.15.142:0/1106575458 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 -- 172.21.15.142:0/1106575458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 msgr2=0x55fdb5138050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5138050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 -- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 msgr2=0x55fdb5190380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:10:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5190380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 -- 172.21.15.142:0/1106575458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdb4ea5d80 con 0x55fdb51299c0 2023-09-21T13:10:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f95227fc700 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55fdb5133e90 tx=0x7f951800ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fb41ee17613564 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:30.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f9506ff5700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951801d7d0 con 0x55fdb51299c0 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9518000e40 con 0x55fdb51299c0 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.452+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f951c00f050 con 0x55fdb51299c0 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.453+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f951801d930 con 0x55fdb51299c0 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.453+0000 7f953cc5ab80 10 client.18021 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:30.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.453+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55fdb4ea4250 con 0x55fdb51299c0 2023-09-21T13:10:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.453+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f951c00f050 con 0x55fdb51299c0 2023-09-21T13:10:30.452 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.453+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f9518011ae0 con 0x55fdb51299c0 2023-09-21T13:10:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 10 client.18021 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 10 client.18021 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 20 client.18021 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb5198110 0x55fdb519a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:30.453 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 4 client.18021 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:10:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fdb5073e00 con 0x55fdb5198110 2023-09-21T13:10:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.454+0000 7f95237fe700 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb5198110 0x55fdb519a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.455+0000 7f9506ff5700 10 client.18021 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:30.454 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.455+0000 7f95237fe700 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb5198110 0x55fdb519a530 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=deb836e1a558f846 server_cookie=695ea3c9e32f365 in_seq=0 out_seq=0 2023-09-21T13:10:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.819+0000 7f9506ff5700 1 -- 172.21.15.142:0/1106575458 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fdb5073e00 con 0x55fdb5198110 2023-09-21T13:10:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.819+0000 7f9506ff5700 10 client.18021 handle_command_reply: tid=0 2023-09-21T13:10:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.820+0000 7f953cc5ab80 1 client.18021 shutdown 2023-09-21T13:10:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.829+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 msgr2=0x55fdb51908c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.823 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.829+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x55fdb5133e90 tx=0x7f951800ffc0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 shutdown_connections 2023-09-21T13:10:30.824 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdb5198110 0x55fdb519a530 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdb512de50 0x55fdb5138050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdb51290a0 0x55fdb5190380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 --2- 172.21.15.142:0/1106575458 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdb51299c0 0x55fdb51908c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.831+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 >> 172.21.15.142:0/1106575458 conn(0x55fdb5055fa0 msgr2=0x55fdb512c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.834+0000 7f9506ff5700 0 client.18021 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.834+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 shutdown_connections 2023-09-21T13:10:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.834+0000 7f953cc5ab80 1 -- 172.21.15.142:0/1106575458 wait complete. 2023-09-21T13:10:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.835+0000 7f953cc5ab80 20 client.18021 trim_cache size 0 max 16384 2023-09-21T13:10:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:10:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:10:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:10:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:10:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.836+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 msgr2=0x7f950c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.836+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 0x7f950c0a2cf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f95140095c0 tx=0x7f9514009ca0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.836+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 msgr2=0x7f95241990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.836+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f95140098e0 tx=0x7f951400f670 comp rx=0 tx=0).stop 2023-09-21T13:10:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 shutdown_connections 2023-09-21T13:10:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f950c0a0830 0x7f950c0a2cf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f952419dc90 0x7f952419e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95240687a0 0x7f95241990e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 --2- 172.21.15.142:0/3697784057 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f952410d650 0x7f9524199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.837+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 >> 172.21.15.142:0/3697784057 conn(0x7f9524076800 msgr2=0x7f95240feea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.839+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 shutdown_connections 2023-09-21T13:10:30.833 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:30.839+0000 7f95293ff700 1 -- 172.21.15.142:0/3697784057 wait complete. 2023-09-21T13:10:31.021 INFO:tasks.workunit.client.0.smithi142.stdout: 10 45417 36.97 MB/sec warmup 71 sec latency 284.721 ms 2023-09-21T13:10:32.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 46084 36.88 MB/sec warmup 72 sec latency 145.203 ms 2023-09-21T13:10:32.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:32 smithi156 ceph-mon[134078]: pgmap v450: 97 pgs: 97 active+clean; 795 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 7.4 MiB/s wr, 664 op/s 2023-09-21T13:10:32.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:32 smithi142 ceph-mon[97663]: pgmap v450: 97 pgs: 97 active+clean; 795 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 7.4 MiB/s wr, 664 op/s 2023-09-21T13:10:32.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:32 smithi160 ceph-mon[134450]: pgmap v450: 97 pgs: 97 active+clean; 795 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 7.4 MiB/s wr, 664 op/s 2023-09-21T13:10:33.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 47063 36.97 MB/sec warmup 73 sec latency 63.373 ms 2023-09-21T13:10:34.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 47293 36.70 MB/sec warmup 74 sec latency 654.672 ms 2023-09-21T13:10:34.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:34 smithi156 ceph-mon[134078]: pgmap v451: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 7.7 MiB/s wr, 700 op/s 2023-09-21T13:10:34.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:34 smithi142 ceph-mon[97663]: pgmap v451: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 7.7 MiB/s wr, 700 op/s 2023-09-21T13:10:34.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:34 smithi160 ceph-mon[134450]: pgmap v451: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 7.7 MiB/s wr, 700 op/s 2023-09-21T13:10:35.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 48006 36.89 MB/sec warmup 75 sec latency 65.479 ms 2023-09-21T13:10:36.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 48633 36.84 MB/sec warmup 76 sec latency 179.427 ms 2023-09-21T13:10:36.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:36 smithi156 ceph-mon[134078]: pgmap v452: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.4 MiB/s wr, 566 op/s 2023-09-21T13:10:36.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:36 smithi142 ceph-mon[97663]: pgmap v452: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.4 MiB/s wr, 566 op/s 2023-09-21T13:10:36.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:36 smithi160 ceph-mon[134450]: pgmap v452: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 6.4 MiB/s wr, 566 op/s 2023-09-21T13:10:37.023 INFO:tasks.workunit.client.0.smithi142.stdout: 10 49416 36.83 MB/sec warmup 77 sec latency 67.020 ms 2023-09-21T13:10:38.024 INFO:tasks.workunit.client.0.smithi142.stdout: 10 50193 36.84 MB/sec warmup 78 sec latency 66.804 ms 2023-09-21T13:10:38.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:38 smithi156 ceph-mon[134078]: pgmap v453: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-09-21T13:10:38.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:38 smithi142 ceph-mon[97663]: pgmap v453: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-09-21T13:10:38.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:38 smithi160 ceph-mon[134450]: pgmap v453: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-09-21T13:10:39.024 INFO:tasks.workunit.client.0.smithi142.stdout: 10 50884 36.90 MB/sec warmup 79 sec latency 323.941 ms 2023-09-21T13:10:40.025 INFO:tasks.workunit.client.0.smithi142.stdout: 10 51112 36.61 MB/sec warmup 80 sec latency 1049.602 ms 2023-09-21T13:10:40.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:40 smithi156 ceph-mon[134078]: pgmap v454: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 13 MiB/s wr, 808 op/s 2023-09-21T13:10:40.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:40 smithi142 ceph-mon[97663]: pgmap v454: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 13 MiB/s wr, 808 op/s 2023-09-21T13:10:40.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:40 smithi160 ceph-mon[134450]: pgmap v454: 97 pgs: 97 active+clean; 820 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 13 MiB/s wr, 808 op/s 2023-09-21T13:10:41.025 INFO:tasks.workunit.client.0.smithi142.stdout: 10 51574 36.47 MB/sec warmup 81 sec latency 160.048 ms 2023-09-21T13:10:42.026 INFO:tasks.workunit.client.0.smithi142.stdout: 10 52120 36.36 MB/sec warmup 82 sec latency 445.227 ms 2023-09-21T13:10:42.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:42 smithi156 ceph-mon[134078]: pgmap v455: 97 pgs: 97 active+clean; 834 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 16 MiB/s wr, 926 op/s 2023-09-21T13:10:42.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:42 smithi142 ceph-mon[97663]: pgmap v455: 97 pgs: 97 active+clean; 834 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 16 MiB/s wr, 926 op/s 2023-09-21T13:10:42.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:42 smithi160 ceph-mon[134450]: pgmap v455: 97 pgs: 97 active+clean; 834 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 MiB/s rd, 16 MiB/s wr, 926 op/s 2023-09-21T13:10:43.026 INFO:tasks.workunit.client.0.smithi142.stdout: 10 53159 36.56 MB/sec warmup 83 sec latency 40.520 ms 2023-09-21T13:10:44.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 54057 36.69 MB/sec warmup 84 sec latency 108.079 ms 2023-09-21T13:10:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 -- 172.21.15.142:0/1422730588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424111d80 msgr2=0x7f9424114170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 --2- 172.21.15.142:0/1422730588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424111d80 0x7f9424114170 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f941c00b0a0 tx=0x7f941c00b3b0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 -- 172.21.15.142:0/1422730588 shutdown_connections 2023-09-21T13:10:44.068 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 --2- 172.21.15.142:0/1422730588 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424073180 0x7f9424073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 --2- 172.21.15.142:0/1422730588 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424111d80 0x7f9424114170 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 --2- 172.21.15.142:0/1422730588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 0x7f9424111840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 -- 172.21.15.142:0/1422730588 >> 172.21.15.142:0/1422730588 conn(0x7f94240fc840 msgr2=0x7f94240fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.069 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 -- 172.21.15.142:0/1422730588 shutdown_connections 2023-09-21T13:10:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.074+0000 7f9429bff700 1 -- 172.21.15.142:0/1422730588 wait complete. 2023-09-21T13:10:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.075+0000 7f9429bff700 1 Processor -- start 2023-09-21T13:10:44.070 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 -- start start 2023-09-21T13:10:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.071 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 0x7f9424072990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 0x7f942406b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942406bb40 con 0x7f9424111d80 2023-09-21T13:10:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942406bcb0 con 0x7f9424073180 2023-09-21T13:10:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f9429bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942406be70 con 0x7f9424073aa0 2023-09-21T13:10:44.072 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f94237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f94237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43096/0 (socket says 172.21.15.142:43096) 2023-09-21T13:10:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.076+0000 7f94237fe700 1 -- 172.21.15.142:0/193512982 learned_addr learned my addr 172.21.15.142:0/193512982 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9422ffd700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 0x7f9424072990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.073 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 -- 172.21.15.142:0/193512982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 msgr2=0x7f9424072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 0x7f9424072990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 -- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 msgr2=0x7f942406b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9423fff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 0x7f942406b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.074 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 0x7f942406b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 -- 172.21.15.142:0/193512982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c009d00 con 0x7f9424073180 2023-09-21T13:10:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9423fff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 0x7f942406b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f94237fe700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f941400d950 tx=0x7f941400dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9420ff9700 1 -- 172.21.15.142:0/193512982 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414009b40 con 0x7f9424073180 2023-09-21T13:10:44.075 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9420ff9700 1 -- 172.21.15.142:0/193512982 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414009ca0 con 0x7f9424073180 2023-09-21T13:10:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.077+0000 7f9420ff9700 1 -- 172.21.15.142:0/193512982 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400f620 con 0x7f9424073180 2023-09-21T13:10:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.080+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942406ffa0 con 0x7f9424073180 2023-09-21T13:10:44.076 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.080+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424070430 con 0x7f9424073180 2023-09-21T13:10:44.080 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.087+0000 7f943d473b80 1 Processor -- start 2023-09-21T13:10:44.082 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.089+0000 7f9420ff9700 1 -- 172.21.15.142:0/193512982 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f9414010460 con 0x7f9424073180 2023-09-21T13:10:44.085 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.091+0000 7f943d473b80 1 -- start start 2023-09-21T13:10:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 0x564d47734480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.086 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d47738e50 0x564d477392b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d476a8c40 con 0x564d477340a0 2023-09-21T13:10:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4768cc10 con 0x564d47738e50 2023-09-21T13:10:44.087 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.092+0000 7f943d473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4768a530 con 0x564d477349c0 2023-09-21T13:10:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.093+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.093+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53250/0 (socket says 172.21.15.142:53250) 2023-09-21T13:10:44.088 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.093+0000 7f94237fe700 1 -- 172.21.15.142:0/2369248306 learned_addr learned my addr 172.21.15.142:0/2369248306 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.093+0000 7f9422ffd700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d47738e50 0x564d477392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.093+0000 7f9420ff9700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 0x7f940c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f9420ff9700 1 -- 172.21.15.142:0/193512982 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f94140cbe90 con 0x7f9424073180 2023-09-21T13:10:44.089 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f9423fff700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 0x564d47734480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f94237fe700 1 -- 172.21.15.142:0/2369248306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d47738e50 msgr2=0x564d477392b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f94237fe700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d47738e50 0x564d477392b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f94237fe700 1 -- 172.21.15.142:0/2369248306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 msgr2=0x564d47734480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f94237fe700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 0x564d47734480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.090 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f94237fe700 1 -- 172.21.15.142:0/2369248306 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d474b0d80 con 0x564d477349c0 2023-09-21T13:10:44.091 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.094+0000 7f9423fff700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 0x564d47734480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.095+0000 7f94237fe700 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9414099010 tx=0x7f9414010c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58333556b31a5138 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.095+0000 7f9423fff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 0x7f940c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.095+0000 7f9409ffb700 1 -- 172.21.15.142:0/2369248306 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414098c70 con 0x564d477349c0 2023-09-21T13:10:44.092 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.095+0000 7f9409ffb700 1 -- 172.21.15.142:0/2369248306 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414099a10 con 0x564d477349c0 2023-09-21T13:10:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.095+0000 7f9409ffb700 1 -- 172.21.15.142:0/2369248306 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414010710 con 0x564d477349c0 2023-09-21T13:10:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f9423fff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 0x7f940c0a2cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f942406a380 tx=0x7f941c0099e0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 -- 172.21.15.142:0/2369248306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 msgr2=0x564d47738910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f9414099010 tx=0x7f9414010c40 comp rx=0 tx=0).stop 2023-09-21T13:10:44.093 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 -- 172.21.15.142:0/2369248306 shutdown_connections 2023-09-21T13:10:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477340a0 0x564d47734480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d47738e50 0x564d477392b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 --2- 172.21.15.142:0/2369248306 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477349c0 0x564d47738910 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 -- 172.21.15.142:0/2369248306 >> 172.21.15.142:0/2369248306 conn(0x564d47660fa0 msgr2=0x564d4772f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.094 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.097+0000 7f943d473b80 1 -- 172.21.15.142:0/2369248306 shutdown_connections 2023-09-21T13:10:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.098+0000 7f943d473b80 1 -- 172.21.15.142:0/2369248306 wait complete. 2023-09-21T13:10:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.098+0000 7f943d473b80 1 -- start start 2023-09-21T13:10:44.095 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.099+0000 7f943d473b80 1 Processor -- start 2023-09-21T13:10:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477349c0 0x564d4773d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d47738e50 0x564d4773de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.101 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47685e20 con 0x564d477349c0 2023-09-21T13:10:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d476226e0 con 0x564d477340a0 2023-09-21T13:10:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47622380 con 0x564d47738e50 2023-09-21T13:10:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f943d473b80 10 client.0 _ll_register_callbacks cb 0x564d4756ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:44.102 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f94237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f94237fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:43110/0 (socket says 172.21.15.142:43110) 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.102+0000 7f94237fe700 1 -- 172.21.15.142:0/2226279473 learned_addr learned my addr 172.21.15.142:0/2226279473 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f9422ffd700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477349c0 0x564d4773d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 -- 172.21.15.142:0/2226279473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d47738e50 msgr2=0x564d4773de40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d47738e50 0x564d4773de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 -- 172.21.15.142:0/2226279473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477349c0 msgr2=0x564d4773d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477349c0 0x564d4773d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 -- 172.21.15.142:0/2226279473 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424070430 con 0x564d477340a0 2023-09-21T13:10:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f94237fe700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9414095d80 tx=0x7f9414098d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2d56454a409a6ad server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f9402ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:44.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94140a1380 con 0x564d477340a0 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.103+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d475f6b50 con 0x564d477340a0 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.104+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9414010920 con 0x564d477340a0 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.104+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94140b72e0 con 0x564d477340a0 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f943d473b80 10 client.28178 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x564d47499c00 con 0x564d477340a0 2023-09-21T13:10:44.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414063080 con 0x564d477340a0 2023-09-21T13:10:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f94140a0ef0 con 0x564d477340a0 2023-09-21T13:10:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f943d473b80 10 client.28178 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f943d473b80 10 client.28178 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.105+0000 7f943d473b80 20 client.28178 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:44.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.106+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d4774dac0 0x564d4774fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.106+0000 7f943d473b80 4 client.28178 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.106+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d47702fc0 con 0x564d4774dac0 2023-09-21T13:10:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.106+0000 7f9422ffd700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d4774dac0 0x564d4774fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.107+0000 7f9422ffd700 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d4774dac0 0x564d4774fee0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c57383a52fc4d7b8 server_cookie=25096c9b074d5f18 in_seq=0 out_seq=0 2023-09-21T13:10:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.107+0000 7f9402ffd700 10 client.28178 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f9402ffd700 1 -- 172.21.15.142:0/2226279473 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564d47702fc0 con 0x564d4774dac0 2023-09-21T13:10:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f9402ffd700 10 client.28178 handle_command_reply: tid=0 2023-09-21T13:10:44.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 client.28178 shutdown 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 msgr2=0x564d47740600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9414095d80 tx=0x7f9414098d20 comp rx=0 tx=0).stop 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 shutdown_connections 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d4774dac0 0x564d4774fee0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d47738e50 0x564d4773de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.108+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477340a0 0x564d47740600 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f943d473b80 1 --2- 172.21.15.142:0/2226279473 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d477349c0 0x564d4773d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 >> 172.21.15.142:0/2226279473 conn(0x564d47660fa0 msgr2=0x564d4772ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f9402ffd700 0 client.28178 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 shutdown_connections 2023-09-21T13:10:44.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f943d473b80 1 -- 172.21.15.142:0/2226279473 wait complete. 2023-09-21T13:10:44.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.109+0000 7f943d473b80 20 client.28178 trim_cache size 0 max 16384 2023-09-21T13:10:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.135+0000 7f943d473b80 1 Processor -- start 2023-09-21T13:10:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.135+0000 7f943d473b80 1 -- start start 2023-09-21T13:10:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.135+0000 7f943d473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47744fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.135+0000 7f943d473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d47740130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.135+0000 7f943d473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d47736ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f943d473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d475068c0 con 0x564d47738e50 2023-09-21T13:10:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f943d473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d4772b920 con 0x564d477349c0 2023-09-21T13:10:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f943d473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47735160 con 0x564d477340a0 2023-09-21T13:10:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47744fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47744fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53270/0 (socket says 172.21.15.142:53270) 2023-09-21T13:10:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f94237fe700 1 -- 172.21.15.142:0/484338768 learned_addr learned my addr 172.21.15.142:0/484338768 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.136+0000 7f9423fff700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d47736ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9422ffd700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d47740130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9423fff700 1 -- 172.21.15.142:0/484338768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 msgr2=0x564d47744fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9423fff700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47744fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9423fff700 1 -- 172.21.15.142:0/484338768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 msgr2=0x564d47740130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9423fff700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d47740130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9423fff700 1 -- 172.21.15.142:0/484338768 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d47754b10 con 0x564d47738e50 2023-09-21T13:10:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.137+0000 7f9422ffd700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d47740130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:10:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.138+0000 7f9423fff700 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d47736ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f941c00b070 tx=0x7f941c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9d5bca297690b6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.138+0000 7f940a7fc700 1 -- 172.21.15.142:0/484338768 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c00e040 con 0x564d47738e50 2023-09-21T13:10:44.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.138+0000 7f940a7fc700 1 -- 172.21.15.142:0/484338768 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f941c004e30 con 0x564d47738e50 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.138+0000 7f940a7fc700 1 -- 172.21.15.142:0/484338768 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c005040 con 0x564d47738e50 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 -- 172.21.15.142:0/484338768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 msgr2=0x564d47736ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d47736ea0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f941c00b070 tx=0x7f941c01c000 comp rx=0 tx=0).stop 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 -- 172.21.15.142:0/484338768 shutdown_connections 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d47736ea0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47744fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 --2- 172.21.15.142:0/484338768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d47740130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.139+0000 7f943d473b80 1 -- 172.21.15.142:0/484338768 >> 172.21.15.142:0/484338768 conn(0x564d47660fa0 msgr2=0x564d47749700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.140+0000 7f943d473b80 1 -- 172.21.15.142:0/484338768 shutdown_connections 2023-09-21T13:10:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.140+0000 7f943d473b80 1 -- 172.21.15.142:0/484338768 wait complete. 2023-09-21T13:10:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.140+0000 7f943d473b80 1 -- start start 2023-09-21T13:10:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.141+0000 7f943d473b80 1 Processor -- start 2023-09-21T13:10:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d477434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d477a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47743c40 con 0x564d47738e50 2023-09-21T13:10:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d47743db0 con 0x564d477349c0 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d477a0e30 con 0x564d477340a0 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f943d473b80 10 client.0 _ll_register_callbacks cb 0x564d4756ca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f94237fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53280/0 (socket says 172.21.15.142:53280) 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.142+0000 7f94237fe700 1 -- 172.21.15.142:0/4269006093 learned_addr learned my addr 172.21.15.142:0/4269006093 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f9423fff700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d477a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f94237fe700 1 -- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 msgr2=0x564d477434d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f94237fe700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d477434d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f94237fe700 1 -- 172.21.15.142:0/4269006093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 msgr2=0x564d477a08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f94237fe700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d477a08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.143+0000 7f94237fe700 1 -- 172.21.15.142:0/4269006093 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941800e9a0 con 0x564d477340a0 2023-09-21T13:10:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.144+0000 7f94237fe700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9414009520 tx=0x7f941400dfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c72204b5f85c038 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.144+0000 7f9402ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:10:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.144+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414065020 con 0x564d477340a0 2023-09-21T13:10:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.145+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f9414010920 con 0x564d477340a0 2023-09-21T13:10:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.145+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9414099a10 con 0x564d477340a0 2023-09-21T13:10:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.145+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94140a1380 con 0x564d477340a0 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.145+0000 7f943d473b80 10 client.28114 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.145+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f9424114b20 con 0x564d477340a0 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9414099a10 con 0x564d477340a0 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f9414095180 con 0x564d477340a0 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 10 client.28114 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:44.143 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 10 client.28114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 20 client.28114 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d477a2250 0x564d477a4670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 4 client.28114 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:10:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.146+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564d4767ee00 con 0x564d477a2250 2023-09-21T13:10:44.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.147+0000 7f9422ffd700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d477a2250 0x564d477a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.148+0000 7f9402ffd700 10 client.28114 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:44.145 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.148+0000 7f9422ffd700 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d477a2250 0x564d477a4670 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b995787f21e0dee9 server_cookie=7976172a89ff369e in_seq=0 out_seq=0 2023-09-21T13:10:44.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:44 smithi156 ceph-mon[134078]: pgmap v456: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 22 MiB/s wr, 1.17k op/s 2023-09-21T13:10:44.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:44 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:10:44.402 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.409+0000 7f9402ffd700 1 -- 172.21.15.142:0/4269006093 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564d4767ee00 con 0x564d477a2250 2023-09-21T13:10:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.409+0000 7f9402ffd700 10 client.28114 handle_command_reply: tid=0 2023-09-21T13:10:44.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.409+0000 7f943d473b80 1 client.28114 shutdown 2023-09-21T13:10:44.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.415+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 msgr2=0x564d47742f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.415+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9414009520 tx=0x7f941400dfa0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:44 smithi142 ceph-mon[97663]: pgmap v456: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 22 MiB/s wr, 1.17k op/s 2023-09-21T13:10:44.412 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:44 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:10:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 shutdown_connections 2023-09-21T13:10:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x564d477a2250 0x564d477a4670 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x564d47738e50 0x564d477a08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x564d477340a0 0x564d47742f90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 --2- 172.21.15.142:0/4269006093 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x564d477349c0 0x564d477434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 >> 172.21.15.142:0/4269006093 conn(0x564d47660fa0 msgr2=0x564d47736ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.421+0000 7f9402ffd700 0 client.28114 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.423+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 shutdown_connections 2023-09-21T13:10:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.423+0000 7f943d473b80 1 -- 172.21.15.142:0/4269006093 wait complete. 2023-09-21T13:10:44.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.423+0000 7f943d473b80 20 client.28114 trim_cache size 0 max 16384 2023-09-21T13:10:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:10:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:10:44.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:10:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:10:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 msgr2=0x7f940c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 0x7f940c0a2cf0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f942406a380 tx=0x7f941c0099e0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 msgr2=0x7f9424072410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f941400d950 tx=0x7f941400dd10 comp rx=0 tx=0).stop 2023-09-21T13:10:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 shutdown_connections 2023-09-21T13:10:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f940c0a0830 0x7f940c0a2cf0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f9424111d80 0x7f942406b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f9424073180 0x7f9424072410 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 --2- 172.21.15.142:0/193512982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9424073aa0 0x7f9424072990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 >> 172.21.15.142:0/193512982 conn(0x7f94240fc840 msgr2=0x7f94240fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 shutdown_connections 2023-09-21T13:10:44.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:44.424+0000 7f9429bff700 1 -- 172.21.15.142:0/193512982 wait complete. 2023-09-21T13:10:44.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:44 smithi160 ceph-mon[134450]: pgmap v456: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 22 MiB/s wr, 1.17k op/s 2023-09-21T13:10:44.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:44 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:10:45.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 54779 36.88 MB/sec warmup 85 sec latency 202.768 ms 2023-09-21T13:10:45.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:45 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:10:45.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:45 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:10:45.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:45 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:10:45.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:45 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:10:45.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:45 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:10:45.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:45 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:10:45.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:45 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:10:45.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:45 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:10:45.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:45 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:10:46.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 55526 36.84 MB/sec warmup 86 sec latency 83.951 ms 2023-09-21T13:10:46.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:46 smithi156 ceph-mon[134078]: pgmap v457: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 20 MiB/s wr, 906 op/s 2023-09-21T13:10:46.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:46 smithi142 ceph-mon[97663]: pgmap v457: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 20 MiB/s wr, 906 op/s 2023-09-21T13:10:46.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:46 smithi160 ceph-mon[134450]: pgmap v457: 97 pgs: 97 active+clean; 854 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 20 MiB/s wr, 906 op/s 2023-09-21T13:10:47.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 56434 36.91 MB/sec warmup 87 sec latency 41.633 ms 2023-09-21T13:10:48.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 57560 37.21 MB/sec warmup 88 sec latency 50.103 ms 2023-09-21T13:10:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:48 smithi156 ceph-mon[134078]: pgmap v458: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 22 MiB/s wr, 1.24k op/s 2023-09-21T13:10:48.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:48 smithi142 ceph-mon[97663]: pgmap v458: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 22 MiB/s wr, 1.24k op/s 2023-09-21T13:10:48.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:48 smithi160 ceph-mon[134450]: pgmap v458: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 22 MiB/s wr, 1.24k op/s 2023-09-21T13:10:49.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 58491 37.38 MB/sec warmup 89 sec latency 82.171 ms 2023-09-21T13:10:50.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 59343 37.41 MB/sec warmup 90 sec latency 88.693 ms 2023-09-21T13:10:50.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:50 smithi156 ceph-mon[134078]: pgmap v459: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 752 op/s 2023-09-21T13:10:50.413 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:50 smithi142 ceph-mon[97663]: pgmap v459: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 752 op/s 2023-09-21T13:10:50.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:50 smithi160 ceph-mon[134450]: pgmap v459: 97 pgs: 97 active+clean; 830 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 12 MiB/s wr, 752 op/s 2023-09-21T13:10:51.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 60231 37.56 MB/sec warmup 91 sec latency 46.061 ms 2023-09-21T13:10:51.170 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:10:51.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.488+0000 7f7afc1ff700 1 -- 172.21.15.142:0/2008250987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4100fa0 msgr2=0x7f7af4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.488+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/2008250987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4100fa0 0x7f7af4101380 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7af001a9a0 tx=0x7f7af001acb0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 -- 172.21.15.142:0/2008250987 shutdown_connections 2023-09-21T13:10:51.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/2008250987 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7af41060c0 0x7f7af410dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/2008250987 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4100fa0 0x7f7af4101380 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/2008250987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4101950 0x7f7af4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 -- 172.21.15.142:0/2008250987 >> 172.21.15.142:0/2008250987 conn(0x7f7af40fc860 msgr2=0x7f7af40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 -- 172.21.15.142:0/2008250987 shutdown_connections 2023-09-21T13:10:51.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.489+0000 7f7afc1ff700 1 -- 172.21.15.142:0/2008250987 wait complete. 2023-09-21T13:10:51.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.490+0000 7f7afc1ff700 1 Processor -- start 2023-09-21T13:10:51.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 -- start start 2023-09-21T13:10:51.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7af41060c0 0x7f7af4109990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4198440 0x7f7af419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af419ad70 con 0x7f7af41060c0 2023-09-21T13:10:51.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.492+0000 7f7afc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af419aeb0 con 0x7f7af4198440 2023-09-21T13:10:51.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53308/0 (socket says 172.21.15.142:53308) 2023-09-21T13:10:51.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 -- 172.21.15.142:0/1603201036 learned_addr learned my addr 172.21.15.142:0/1603201036 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:51.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af419b070 con 0x7f7af4100fa0 2023-09-21T13:10:51.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7afa79c700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4198440 0x7f7af419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 -- 172.21.15.142:0/1603201036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4198440 msgr2=0x7f7af419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4198440 0x7f7af419a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 -- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7af41060c0 msgr2=0x7f7af4109990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7af41060c0 0x7f7af4109990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.493+0000 7f7af9f9b700 1 -- 172.21.15.142:0/1603201036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af001a600 con 0x7f7af4100fa0 2023-09-21T13:10:51.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.494+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af0028a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.495+0000 7f7aeaffd700 1 -- 172.21.15.142:0/1603201036 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af002d070 con 0x7f7af4100fa0 2023-09-21T13:10:51.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.495+0000 7f7aeaffd700 1 -- 172.21.15.142:0/1603201036 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7af0003680 con 0x7f7af4100fa0 2023-09-21T13:10:51.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.495+0000 7f7aeaffd700 1 -- 172.21.15.142:0/1603201036 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00303b0 con 0x7f7af4100fa0 2023-09-21T13:10:51.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.497+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af419b2f0 con 0x7f7af4100fa0 2023-09-21T13:10:51.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.497+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af419b720 con 0x7f7af4100fa0 2023-09-21T13:10:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.503+0000 7f7b0fb6eb80 1 Processor -- start 2023-09-21T13:10:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.504+0000 7f7aeaffd700 1 -- 172.21.15.142:0/1603201036 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f7af0031410 con 0x7f7af4100fa0 2023-09-21T13:10:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.504+0000 7f7b0fb6eb80 1 -- start start 2023-09-21T13:10:51.499 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8905d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd88ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd7feca0 con 0x55ecdd88a9b0 2023-09-21T13:10:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd7e2c70 con 0x55ecdd8901f0 2023-09-21T13:10:51.500 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.505+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd7e0590 con 0x55ecdd890b10 2023-09-21T13:10:51.501 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.506+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.506+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53316/0 (socket says 172.21.15.142:53316) 2023-09-21T13:10:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.506+0000 7f7af9f9b700 1 -- 172.21.15.142:0/3065583 learned_addr learned my addr 172.21.15.142:0/3065583 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.506+0000 7f7afa79c700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 -- 172.21.15.142:0/3065583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 msgr2=0x55ecdd8905d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.502 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af979a700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd88ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8905d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 -- 172.21.15.142:0/3065583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 msgr2=0x55ecdd88ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd88ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 -- 172.21.15.142:0/3065583 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecdd606de0 con 0x55ecdd890b10 2023-09-21T13:10:51.503 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7afa79c700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af979a700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd88ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7aeaffd700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 0x7f7ae00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7aeaffd700 1 -- 172.21.15.142:0/1603201036 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7af00dd610 con 0x7f7af4100fa0 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.507+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7af00dac70 tx=0x7f7af00e3860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31e71e6fb1666a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.508+0000 7f7adffff700 1 -- 172.21.15.142:0/3065583 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00a6e60 con 0x55ecdd890b10 2023-09-21T13:10:51.504 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.508+0000 7f7adffff700 1 -- 172.21.15.142:0/3065583 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7af00e31f0 con 0x55ecdd890b10 2023-09-21T13:10:51.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.508+0000 7f7adffff700 1 -- 172.21.15.142:0/3065583 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00aa8f0 con 0x55ecdd890b10 2023-09-21T13:10:51.505 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.508+0000 7f7afa79c700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 0x7f7ae00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.509+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/3065583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 msgr2=0x55ecdd88a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.509+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7af00dac70 tx=0x7f7af00e3860 comp rx=0 tx=0).stop 2023-09-21T13:10:51.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.509+0000 7f7afa79c700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 0x7f7ae00a2cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009e60 tx=0x7f7aec009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.506 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/3065583 shutdown_connections 2023-09-21T13:10:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd88ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/3065583 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd88a420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/3065583 >> 172.21.15.142:0/3065583 conn(0x55ecdd7b7000 msgr2=0x55ecdd885270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.507 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/3065583 shutdown_connections 2023-09-21T13:10:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.511+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/3065583 wait complete. 2023-09-21T13:10:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.512+0000 7f7b0fb6eb80 1 -- start start 2023-09-21T13:10:51.508 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.512+0000 7f7b0fb6eb80 1 Processor -- start 2023-09-21T13:10:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.509 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd7dbe80 con 0x55ecdd890b10 2023-09-21T13:10:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd778740 con 0x55ecdd8901f0 2023-09-21T13:10:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd7783e0 con 0x55ecdd88a9b0 2023-09-21T13:10:51.510 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7b0fb6eb80 10 client.0 _ll_register_callbacks cb 0x55ecdd6c2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.513+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53326/0 (socket says 172.21.15.142:53326) 2023-09-21T13:10:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af9f9b700 1 -- 172.21.15.142:0/2833003324 learned_addr learned my addr 172.21.15.142:0/2833003324 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.511 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7afa79c700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 -- 172.21.15.142:0/2833003324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 msgr2=0x55ecdd8a5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 -- 172.21.15.142:0/2833003324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd890b10 msgr2=0x55ecdd8a97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.512 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af979a700 1 -- 172.21.15.142:0/2833003324 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec009860 con 0x55ecdd8901f0 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.514+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.515+0000 7f7af979a700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7af410aa60 tx=0x7f7ae40108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd0b49eb8c1a4363 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.515+0000 7f7add7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.516+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4004230 con 0x55ecdd8901f0 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.516+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7ae4016030 con 0x55ecdd8901f0 2023-09-21T13:10:51.513 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.516+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecdd859020 con 0x55ecdd8901f0 2023-09-21T13:10:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.518+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ae4004390 con 0x55ecdd8901f0 2023-09-21T13:10:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.518+0000 7f7b0fb6eb80 10 client.28190 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:51.514 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.518+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f7af419b720 con 0x55ecdd8901f0 2023-09-21T13:10:51.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ecdd859020 con 0x55ecdd8901f0 2023-09-21T13:10:51.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7ae4005420 con 0x55ecdd8901f0 2023-09-21T13:10:51.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 10 client.28190 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:51.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 10 client.28190 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:51.515 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 20 client.28190 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:51.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd8b50f0 0x55ecdd8b7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 4 client.28190 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:51.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ecdd7d4e60 con 0x55ecdd8b50f0 2023-09-21T13:10:51.516 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.519+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd8b50f0 0x55ecdd8b7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.523+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd8b50f0 0x55ecdd8b7510 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=182de6657a2ae44b server_cookie=599dbd5e1f817b57 in_seq=0 out_seq=0 2023-09-21T13:10:51.517 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.523+0000 7f7add7fa700 10 client.28190 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:51.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.529+0000 7f7add7fa700 1 -- 172.21.15.142:0/2833003324 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ecdd7d4e60 con 0x55ecdd8b50f0 2023-09-21T13:10:51.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.529+0000 7f7add7fa700 10 client.28190 handle_command_reply: tid=0 2023-09-21T13:10:51.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.529+0000 7f7b0fb6eb80 1 client.28190 shutdown 2023-09-21T13:10:51.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.530+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 msgr2=0x55ecdd8a5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.530+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5760 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7af410aa60 tx=0x7f7ae40108d0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 shutdown_connections 2023-09-21T13:10:51.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd8b50f0 0x55ecdd8b7510 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8a5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7add7fa700 0 client.28190 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:51.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/2833003324 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5760 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 >> 172.21.15.142:0/2833003324 conn(0x55ecdd7b7000 msgr2=0x55ecdd884880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 shutdown_connections 2023-09-21T13:10:51.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.532+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/2833003324 wait complete. 2023-09-21T13:10:51.528 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.533+0000 7f7b0fb6eb80 20 client.28190 trim_cache size 0 max 16384 2023-09-21T13:10:51.556 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 Processor -- start 2023-09-21T13:10:51.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 -- start start 2023-09-21T13:10:51.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.558 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd65c920 con 0x55ecdd8901f0 2023-09-21T13:10:51.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd88b670 con 0x55ecdd890b10 2023-09-21T13:10:51.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.563+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd885d60 con 0x55ecdd88a9b0 2023-09-21T13:10:51.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7afa79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.559 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53334/0 (socket says 172.21.15.142:53334) 2023-09-21T13:10:51.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 -- 172.21.15.142:0/260667694 learned_addr learned my addr 172.21.15.142:0/260667694 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:51.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af979a700 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 -- 172.21.15.142:0/260667694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd890b10 msgr2=0x55ecdd8a97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.560 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 -- 172.21.15.142:0/260667694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 msgr2=0x55ecdd8a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af9f9b700 1 -- 172.21.15.142:0/260667694 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ecdd5efc60 con 0x55ecdd88a9b0 2023-09-21T13:10:51.561 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.564+0000 7f7af979a700 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:10:51.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.565+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7af0028fd0 tx=0x7f7af001acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dbe318e4c579509 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.566+0000 7f7ae8ff9700 1 -- 172.21.15.142:0/260667694 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00e0bb0 con 0x55ecdd88a9b0 2023-09-21T13:10:51.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.566+0000 7f7ae8ff9700 1 -- 172.21.15.142:0/260667694 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7af00aa660 con 0x55ecdd88a9b0 2023-09-21T13:10:51.562 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.566+0000 7f7ae8ff9700 1 -- 172.21.15.142:0/260667694 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af00e31d0 con 0x55ecdd88a9b0 2023-09-21T13:10:51.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/260667694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 msgr2=0x55ecdd891f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7af0028fd0 tx=0x7f7af001acb0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/260667694 shutdown_connections 2023-09-21T13:10:51.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd890b10 0x55ecdd8a97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.563 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd88a9b0 0x55ecdd891f00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/260667694 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd8901f0 0x55ecdd8a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/260667694 >> 172.21.15.142:0/260667694 conn(0x55ecdd7b7000 msgr2=0x55ecdd8a5030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/260667694 shutdown_connections 2023-09-21T13:10:51.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.567+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/260667694 wait complete. 2023-09-21T13:10:51.564 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.568+0000 7f7b0fb6eb80 1 -- start start 2023-09-21T13:10:51.565 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.568+0000 7f7b0fb6eb80 1 Processor -- start 2023-09-21T13:10:51.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8b1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.566 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8b1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd8ac7e0 con 0x55ecdd88a9b0 2023-09-21T13:10:51.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd8ac950 con 0x55ecdd8901f0 2023-09-21T13:10:51.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ecdd8acb10 con 0x55ecdd890b10 2023-09-21T13:10:51.567 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7b0fb6eb80 10 client.0 _ll_register_callbacks cb 0x55ecdd6c2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53340/0 (socket says 172.21.15.142:53340) 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 -- 172.21.15.142:0/333076879 learned_addr learned my addr 172.21.15.142:0/333076879 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7af979a700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8b1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.568 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 -- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 msgr2=0x55ecdd8b1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8b1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 -- 172.21.15.142:0/333076879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 msgr2=0x55ecdd8b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:51.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7afa79c700 1 -- 172.21.15.142:0/333076879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ecdd606de0 con 0x55ecdd890b10 2023-09-21T13:10:51.569 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.569+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:51.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7afa79c700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7aec016c10 tx=0x7f7aec004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ace0de030ac4ebb server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:51.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7add7fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:10:51.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aec004bb0 con 0x55ecdd890b10 2023-09-21T13:10:51.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f7aec004d10 con 0x55ecdd890b10 2023-09-21T13:10:51.570 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ecdd74cbb0 con 0x55ecdd890b10 2023-09-21T13:10:51.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.570+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7aec017850 con 0x55ecdd890b10 2023-09-21T13:10:51.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.571+0000 7f7b0fb6eb80 10 client.28132 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:51.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.571+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55ecdd62d250 con 0x55ecdd890b10 2023-09-21T13:10:51.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.571+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ecdd74cbb0 con 0x55ecdd890b10 2023-09-21T13:10:51.571 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.572+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f7aec02b030 con 0x55ecdd890b10 2023-09-21T13:10:51.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.573+0000 7f7b0fb6eb80 10 client.28132 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:51.572 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.573+0000 7f7b0fb6eb80 10 client.28132 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:51.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.573+0000 7f7b0fb6eb80 20 client.28132 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:51.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.573+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd90a070 0x55ecdd90c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:51.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.574+0000 7f7b0fb6eb80 4 client.28132 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:10:51.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.574+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ecdd7d4b80 con 0x55ecdd90a070 2023-09-21T13:10:51.573 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.574+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd90a070 0x55ecdd90c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:51.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.576+0000 7f7af9f9b700 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd90a070 0x55ecdd90c490 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ecd8f0c77e2c4 server_cookie=15b141f8f9ffd4e1 in_seq=0 out_seq=0 2023-09-21T13:10:51.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.576+0000 7f7add7fa700 10 client.28132 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:51.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.576+0000 7f7add7fa700 1 -- 172.21.15.142:0/333076879 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ecdd7d4b80 con 0x55ecdd90a070 2023-09-21T13:10:51.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.576+0000 7f7add7fa700 10 client.28132 handle_command_reply: tid=0 2023-09-21T13:10:51.574 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 client.28132 shutdown 2023-09-21T13:10:51.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 msgr2=0x55ecdd8ac0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7aec016c10 tx=0x7f7aec004b40 comp rx=0 tx=0).stop 2023-09-21T13:10:51.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 shutdown_connections 2023-09-21T13:10:51.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ecdd90a070 0x55ecdd90c490 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.575 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ecdd88a9b0 0x55ecdd8b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ecdd890b10 0x55ecdd8ac0d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 --2- 172.21.15.142:0/333076879 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ecdd8901f0 0x55ecdd8b1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 >> 172.21.15.142:0/333076879 conn(0x55ecdd7b7000 msgr2=0x55ecdd88f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.577+0000 7f7add7fa700 0 client.28132 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.578+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 shutdown_connections 2023-09-21T13:10:51.576 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.578+0000 7f7b0fb6eb80 1 -- 172.21.15.142:0/333076879 wait complete. 2023-09-21T13:10:51.577 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.578+0000 7f7b0fb6eb80 20 client.28132 trim_cache size 0 max 16384 2023-09-21T13:10:51.577 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:10:51.577 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:10:51.577 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:10:51.578 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:10:51.578 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:10:51.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:10:51.578 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:10:51.578 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:10:51.579 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:10:51.579 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:10:51.579 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 msgr2=0x7f7ae00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 0x7f7ae00a2cf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7aec009e60 tx=0x7f7aec009040 comp rx=0 tx=0).stop 2023-09-21T13:10:51.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 msgr2=0x7f7af4109450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:51.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7af0000c00 tx=0x7f7af0028a40 comp rx=0 tx=0).stop 2023-09-21T13:10:51.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 shutdown_connections 2023-09-21T13:10:51.580 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f7ae00a0830 0x7f7ae00a2cf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7af4198440 0x7f7af419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7af4100fa0 0x7f7af4109450 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 --2- 172.21.15.142:0/1603201036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7af41060c0 0x7f7af4109990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 >> 172.21.15.142:0/1603201036 conn(0x7f7af40fc860 msgr2=0x7f7af41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 shutdown_connections 2023-09-21T13:10:51.581 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:10:51.579+0000 7f7afc1ff700 1 -- 172.21.15.142:0/1603201036 wait complete. 2023-09-21T13:10:51.597 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:10:52.028 INFO:tasks.workunit.client.0.smithi142.stdout: 10 61007 37.58 MB/sec warmup 92 sec latency 100.232 ms 2023-09-21T13:10:52.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:52 smithi156 ceph-mon[134078]: pgmap v460: 97 pgs: 97 active+clean; 849 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-21T13:10:52.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:52 smithi142 ceph-mon[97663]: pgmap v460: 97 pgs: 97 active+clean; 849 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-21T13:10:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:52 smithi160 ceph-mon[134450]: pgmap v460: 97 pgs: 97 active+clean; 849 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-21T13:10:53.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 61986 37.84 MB/sec warmup 93 sec latency 59.695 ms 2023-09-21T13:10:54.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 62734 37.84 MB/sec warmup 94 sec latency 47.436 ms 2023-09-21T13:10:54.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:54 smithi156 ceph-mon[134078]: pgmap v461: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 880 op/s 2023-09-21T13:10:54.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:54 smithi142 ceph-mon[97663]: pgmap v461: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 880 op/s 2023-09-21T13:10:54.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:54 smithi160 ceph-mon[134450]: pgmap v461: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 12 MiB/s wr, 880 op/s 2023-09-21T13:10:55.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 63376 37.78 MB/sec warmup 95 sec latency 85.106 ms 2023-09-21T13:10:56.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 64246 37.80 MB/sec warmup 96 sec latency 73.211 ms 2023-09-21T13:10:56.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:56 smithi156 ceph-mon[134078]: pgmap v462: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.5 MiB/s wr, 582 op/s 2023-09-21T13:10:56.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:56 smithi142 ceph-mon[97663]: pgmap v462: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.5 MiB/s wr, 582 op/s 2023-09-21T13:10:56.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:56 smithi160 ceph-mon[134450]: pgmap v462: 97 pgs: 97 active+clean; 863 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 5.5 MiB/s wr, 582 op/s 2023-09-21T13:10:57.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 65212 38.03 MB/sec warmup 97 sec latency 80.357 ms 2023-09-21T13:10:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 -- 172.21.15.142:0/4142908465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85010d5b0 msgr2=0x7fe85010fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 --2- 172.21.15.142:0/4142908465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85010d5b0 0x7fe85010fa20 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe840009990 tx=0x7fe840009ca0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 -- 172.21.15.142:0/4142908465 shutdown_connections 2023-09-21T13:10:57.640 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 --2- 172.21.15.142:0/4142908465 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe85010d5b0 0x7fe85010fa20 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 --2- 172.21.15.142:0/4142908465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8500735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 --2- 172.21.15.142:0/4142908465 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe850073b30 0x7fe85010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.641 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.646+0000 7fe8573ff700 1 -- 172.21.15.142:0/4142908465 >> 172.21.15.142:0/4142908465 conn(0x7fe8500fc840 msgr2=0x7fe8500fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.648+0000 7fe8573ff700 1 -- 172.21.15.142:0/4142908465 shutdown_connections 2023-09-21T13:10:57.642 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.648+0000 7fe8573ff700 1 -- 172.21.15.142:0/4142908465 wait complete. 2023-09-21T13:10:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.650+0000 7fe8573ff700 1 Processor -- start 2023-09-21T13:10:57.643 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.650+0000 7fe8573ff700 1 -- start start 2023-09-21T13:10:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe850073b30 0x7fe8501995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.644 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85010d5b0 0x7fe85019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019e290 con 0x7fe85010d5b0 2023-09-21T13:10:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019e400 con 0x7fe850073b30 2023-09-21T13:10:57.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe8573ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85019e5c0 con 0x7fe850073210 2023-09-21T13:10:57.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe85519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe85519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38052/0 (socket says 172.21.15.142:38052) 2023-09-21T13:10:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe85499a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe850073b30 0x7fe8501995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe85519b700 1 -- 172.21.15.142:0/3169713710 learned_addr learned my addr 172.21.15.142:0/3169713710 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.651+0000 7fe85599c700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85010d5b0 0x7fe85019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 -- 172.21.15.142:0/3169713710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe850073b30 msgr2=0x7fe8501995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe850073b30 0x7fe8501995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 -- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85010d5b0 msgr2=0x7fe85019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85010d5b0 0x7fe85019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 -- 172.21.15.142:0/3169713710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c009520 con 0x7fe850073210 2023-09-21T13:10:57.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.652+0000 7fe85519b700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00eb30 tx=0x7fe84c00ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.653+0000 7fe8467fc700 1 -- 172.21.15.142:0/3169713710 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c009880 con 0x7fe850073210 2023-09-21T13:10:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.653+0000 7fe8467fc700 1 -- 172.21.15.142:0/3169713710 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe84c0044e0 con 0x7fe850073210 2023-09-21T13:10:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.653+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8400095f0 con 0x7fe850073210 2023-09-21T13:10:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.653+0000 7fe8467fc700 1 -- 172.21.15.142:0/3169713710 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c003d80 con 0x7fe850073210 2023-09-21T13:10:57.649 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.653+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe850100c00 con 0x7fe850073210 2023-09-21T13:10:57.652 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.659+0000 7fe8467fc700 1 -- 172.21.15.142:0/3169713710 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fe84c003f20 con 0x7fe850073210 2023-09-21T13:10:57.653 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.659+0000 7fe86ad37b80 1 Processor -- start 2023-09-21T13:10:57.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.660+0000 7fe86ad37b80 1 -- start start 2023-09-21T13:10:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ad7480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71adb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71adc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71a4bc40 con 0x556d71ad70a0 2023-09-21T13:10:57.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71a2fc10 con 0x556d71adbe50 2023-09-21T13:10:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71a2d530 con 0x556d71ad79c0 2023-09-21T13:10:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe85519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71adb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe85519b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71adb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38062/0 (socket says 172.21.15.142:38062) 2023-09-21T13:10:57.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.661+0000 7fe85519b700 1 -- 172.21.15.142:0/831792078 learned_addr learned my addr 172.21.15.142:0/831792078 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71adc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85599c700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ad7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 -- 172.21.15.142:0/831792078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 msgr2=0x556d71adb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71adb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 -- 172.21.15.142:0/831792078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 msgr2=0x556d71ad7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ad7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 -- 172.21.15.142:0/831792078 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d71853d80 con 0x556d71adbe50 2023-09-21T13:10:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85599c700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ad7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:10:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.662+0000 7fe85499a700 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71adc2b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe848009fc0 tx=0x7fe8480096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=869ab81c94f2235a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.663+0000 7fe8467fc700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 0x7fe83c0a2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.663+0000 7fe8467fc700 1 -- 172.21.15.142:0/3169713710 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe84c014070 con 0x7fe850073210 2023-09-21T13:10:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.664+0000 7fe85599c700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 0x7fe83c0a2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.664+0000 7fe83b7fe700 1 -- 172.21.15.142:0/831792078 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848010040 con 0x556d71adbe50 2023-09-21T13:10:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.664+0000 7fe83b7fe700 1 -- 172.21.15.142:0/831792078 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe848014ae0 con 0x556d71adbe50 2023-09-21T13:10:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.664+0000 7fe83b7fe700 1 -- 172.21.15.142:0/831792078 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848013a70 con 0x556d71adbe50 2023-09-21T13:10:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.665+0000 7fe85599c700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 0x7fe83c0a2dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe840006010 tx=0x7fe84000b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.665+0000 7fe86ad37b80 1 -- 172.21.15.142:0/831792078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 msgr2=0x556d71adc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.665+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71adc2b0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fe848009fc0 tx=0x7fe8480096d0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 -- 172.21.15.142:0/831792078 shutdown_connections 2023-09-21T13:10:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ad7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71adc2b0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/831792078 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71adb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 -- 172.21.15.142:0/831792078 >> 172.21.15.142:0/831792078 conn(0x556d71a03fa0 msgr2=0x556d71ad20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 -- 172.21.15.142:0/831792078 shutdown_connections 2023-09-21T13:10:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.666+0000 7fe86ad37b80 1 -- 172.21.15.142:0/831792078 wait complete. 2023-09-21T13:10:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.667+0000 7fe86ad37b80 1 -- start start 2023-09-21T13:10:57.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.667+0000 7fe86ad37b80 1 Processor -- start 2023-09-21T13:10:57.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad70a0 0x556d71ae3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad79c0 0x556d71ae0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71a28e20 con 0x556d71ad79c0 2023-09-21T13:10:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d719c56e0 con 0x556d71adbe50 2023-09-21T13:10:57.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d719c5380 con 0x556d71ad70a0 2023-09-21T13:10:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe86ad37b80 10 client.0 _ll_register_callbacks cb 0x556d7190fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.668+0000 7fe85599c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56648/0 (socket says 172.21.15.142:56648) 2023-09-21T13:10:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 -- 172.21.15.142:0/3259862357 learned_addr learned my addr 172.21.15.142:0/3259862357 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:57.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85519b700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad70a0 0x556d71ae3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 -- 172.21.15.142:0/3259862357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad70a0 msgr2=0x556d71ae3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad70a0 0x556d71ae3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 -- 172.21.15.142:0/3259862357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad79c0 msgr2=0x556d71ae0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad79c0 0x556d71ae0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.669+0000 7fe85599c700 1 -- 172.21.15.142:0/3259862357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe848009c20 con 0x556d71adbe50 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.670+0000 7fe85599c700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe8400052c0 tx=0x7fe840009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b522325adbb5b22 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.670+0000 7fe838ff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.670+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84002b070 con 0x556d71adbe50 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.670+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d71999b50 con 0x556d71adbe50 2023-09-21T13:10:57.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.670+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe840004b20 con 0x556d71adbe50 2023-09-21T13:10:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe840004d20 con 0x556d71adbe50 2023-09-21T13:10:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 10 client.28208 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556d7183cc00 con 0x556d71adbe50 2023-09-21T13:10:57.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe84003d020 con 0x556d71adbe50 2023-09-21T13:10:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe84000f460 con 0x556d71adbe50 2023-09-21T13:10:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 10 client.28208 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 10 client.28208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:57.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 20 client.28208 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b01fa0 0x556d71b043e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 4 client.28208 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.671+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d71aa5fc0 con 0x556d71b01fa0 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.672+0000 7fe85519b700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b01fa0 0x556d71b043e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.672+0000 7fe838ff9700 10 client.28208 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:57.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.672+0000 7fe85519b700 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b01fa0 0x556d71b043e0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a93e4eb7ce66424 server_cookie=455320ad93c1885c in_seq=0 out_seq=0 2023-09-21T13:10:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.673+0000 7fe838ff9700 1 -- 172.21.15.142:0/3259862357 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556d71aa5fc0 con 0x556d71b01fa0 2023-09-21T13:10:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.673+0000 7fe838ff9700 10 client.28208 handle_command_reply: tid=0 2023-09-21T13:10:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.673+0000 7fe86ad37b80 1 client.28208 shutdown 2023-09-21T13:10:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 msgr2=0x556d71ae0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe8400052c0 tx=0x7fe840009ca0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 shutdown_connections 2023-09-21T13:10:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b01fa0 0x556d71b043e0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae0f60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad70a0 0x556d71ae3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3259862357 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad79c0 0x556d71ae0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 >> 172.21.15.142:0/3259862357 conn(0x556d71a03fa0 msgr2=0x556d71ad1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.674+0000 7fe838ff9700 0 client.28208 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.675+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 shutdown_connections 2023-09-21T13:10:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.675+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3259862357 wait complete. 2023-09-21T13:10:57.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.675+0000 7fe86ad37b80 20 client.28208 trim_cache size 0 max 16384 2023-09-21T13:10:57.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.699+0000 7fe86ad37b80 1 Processor -- start 2023-09-21T13:10:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.700+0000 7fe86ad37b80 1 -- start start 2023-09-21T13:10:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 0x556d71ae8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71add240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71adbe50 0x556d71ad9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d718a98c0 con 0x556d71adbe50 2023-09-21T13:10:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71ac9ba0 con 0x556d71ad70a0 2023-09-21T13:10:57.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71ad0ef0 con 0x556d71ad79c0 2023-09-21T13:10:57.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe85499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71add240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe85519b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 0x556d71ae8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe85519b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 0x556d71ae8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:56658/0 (socket says 172.21.15.142:56658) 2023-09-21T13:10:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.701+0000 7fe85519b700 1 -- 172.21.15.142:0/3280502152 learned_addr learned my addr 172.21.15.142:0/3280502152 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 -- 172.21.15.142:0/3280502152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 msgr2=0x556d71ae8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 0x556d71ae8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 -- 172.21.15.142:0/3280502152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71adbe50 msgr2=0x556d71ad9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71adbe50 0x556d71ad9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 -- 172.21.15.142:0/3280502152 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d71ae03e0 con 0x556d71ad79c0 2023-09-21T13:10:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe85499a700 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71add240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x556d71ae3bc0 tx=0x7fe848004be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc9ec4d04503f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.702+0000 7fe83bfff700 1 -- 172.21.15.142:0/3280502152 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848010070 con 0x556d71ad79c0 2023-09-21T13:10:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.703+0000 7fe83bfff700 1 -- 172.21.15.142:0/3280502152 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe848026400 con 0x556d71ad79c0 2023-09-21T13:10:57.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.703+0000 7fe83bfff700 1 -- 172.21.15.142:0/3280502152 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848009390 con 0x556d71ad79c0 2023-09-21T13:10:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.703+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3280502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 msgr2=0x556d71add240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.703+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71add240 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x556d71ae3bc0 tx=0x7fe848004be0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3280502152 shutdown_connections 2023-09-21T13:10:57.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71adbe50 0x556d71ad9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71ad70a0 0x556d71ae8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3280502152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71add240 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3280502152 >> 172.21.15.142:0/3280502152 conn(0x556d71a03fa0 msgr2=0x556d71afe250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3280502152 shutdown_connections 2023-09-21T13:10:57.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3280502152 wait complete. 2023-09-21T13:10:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.704+0000 7fe86ad37b80 1 -- start start 2023-09-21T13:10:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.705+0000 7fe86ad37b80 1 Processor -- start 2023-09-21T13:10:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ae3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71ae2cc0 con 0x556d71ad70a0 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71ae2e30 con 0x556d71adbe50 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d71ae2ff0 con 0x556d71ad79c0 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.706+0000 7fe86ad37b80 10 client.0 _ll_register_callbacks cb 0x556d7190fa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85499a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:38094/0 (socket says 172.21.15.142:38094) 2023-09-21T13:10:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85499a700 1 -- 172.21.15.142:0/3175306461 learned_addr learned my addr 172.21.15.142:0/3175306461 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:10:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ae3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85599c700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 -- 172.21.15.142:0/3175306461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 msgr2=0x556d71ae2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 -- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 msgr2=0x556d71ae26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:10:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85519b700 1 -- 172.21.15.142:0/3175306461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d71853d80 con 0x556d71ad70a0 2023-09-21T13:10:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85499a700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:10:57.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.707+0000 7fe85599c700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:10:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe85519b700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ae3420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe84c000c00 tx=0x7fe84c003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b10ab6b1a8a4f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:10:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe838ff9700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:10:57.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c099400 con 0x556d71ad70a0 2023-09-21T13:10:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe848014ae0 con 0x556d71ad70a0 2023-09-21T13:10:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fe84c00cbd0 con 0x556d71ad70a0 2023-09-21T13:10:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe84c0b5070 con 0x556d71ad70a0 2023-09-21T13:10:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe86ad37b80 10 client.18048 fetch_fsmap learned FSMap version 50 2023-09-21T13:10:57.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.708+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556d7187a1f0 con 0x556d71ad70a0 2023-09-21T13:10:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe848014ae0 con 0x556d71ad70a0 2023-09-21T13:10:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe84c0c9de0 con 0x556d71ad70a0 2023-09-21T13:10:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 10 client.18048 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:10:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 10 client.18048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:10:57.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 20 client.18048 populate_metadata read hostname 'smithi142' 2023-09-21T13:10:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b57400 0x556d71b59820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:10:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 4 client.18048 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:10:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.709+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556d71a21e00 con 0x556d71b57400 2023-09-21T13:10:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.710+0000 7fe85499a700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b57400 0x556d71b59820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:10:57.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.711+0000 7fe85499a700 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b57400 0x556d71b59820 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb64bb2616e64e93 server_cookie=ff42f1b58b0dd895 in_seq=0 out_seq=0 2023-09-21T13:10:57.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:57.711+0000 7fe838ff9700 10 client.18048 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:58.030 INFO:tasks.workunit.client.0.smithi142.stdout: 10 65925 38.08 MB/sec warmup 98 sec latency 237.372 ms 2023-09-21T13:10:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.045+0000 7fe838ff9700 1 -- 172.21.15.142:0/3175306461 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556d71a21e00 con 0x556d71b57400 2023-09-21T13:10:58.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.045+0000 7fe838ff9700 10 client.18048 handle_command_reply: tid=0 2023-09-21T13:10:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.045+0000 7fe86ad37b80 1 client.18048 shutdown 2023-09-21T13:10:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.045+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 msgr2=0x556d71ae3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.045+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ae3420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe84c000c00 tx=0x7fe84c003680 comp rx=0 tx=0).stop 2023-09-21T13:10:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 shutdown_connections 2023-09-21T13:10:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x556d71b57400 0x556d71b59820 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x556d71ad70a0 0x556d71ae3420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x556d71adbe50 0x556d71ae26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 --2- 172.21.15.142:0/3175306461 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x556d71ad79c0 0x556d71ae2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe838ff9700 0 client.18048 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:10:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 >> 172.21.15.142:0/3175306461 conn(0x556d71a03fa0 msgr2=0x556d71ad9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.046+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 shutdown_connections 2023-09-21T13:10:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.047+0000 7fe86ad37b80 1 -- 172.21.15.142:0/3175306461 wait complete. 2023-09-21T13:10:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.047+0000 7fe86ad37b80 20 client.18048 trim_cache size 0 max 16384 2023-09-21T13:10:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:10:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:10:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:10:58.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:10:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.051+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 msgr2=0x7fe83c0a2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.051+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 0x7fe83c0a2dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe840006010 tx=0x7fe84000b260 comp rx=0 tx=0).stop 2023-09-21T13:10:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.051+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 msgr2=0x7fe8501990a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:10:58.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.051+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00eb30 tx=0x7fe84c00ee40 comp rx=0 tx=0).stop 2023-09-21T13:10:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 shutdown_connections 2023-09-21T13:10:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fe83c0a0900 0x7fe83c0a2dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fe85010d5b0 0x7fe85019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe850073210 0x7fe8501990a0 secure :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe84c00eb30 tx=0x7fe84c00ee40 comp rx=0 tx=0).stop 2023-09-21T13:10:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 --2- 172.21.15.142:0/3169713710 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fe850073b30 0x7fe8501995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:10:58.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.052+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 >> 172.21.15.142:0/3169713710 conn(0x7fe8500fc840 msgr2=0x7fe85010f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:10:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.055+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 shutdown_connections 2023-09-21T13:10:58.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:10:58.056+0000 7fe8573ff700 1 -- 172.21.15.142:0/3169713710 wait complete. 2023-09-21T13:10:58.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:10:58 smithi156 ceph-mon[134078]: pgmap v463: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 8.4 MiB/s wr, 801 op/s 2023-09-21T13:10:58.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:10:58 smithi142 ceph-mon[97663]: pgmap v463: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 8.4 MiB/s wr, 801 op/s 2023-09-21T13:10:58.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:10:58 smithi160 ceph-mon[134450]: pgmap v463: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 MiB/s rd, 8.4 MiB/s wr, 801 op/s 2023-09-21T13:10:59.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 66536 38.00 MB/sec warmup 99 sec latency 183.335 ms 2023-09-21T13:11:00.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 67335 37.98 MB/sec warmup 100 sec latency 69.533 ms 2023-09-21T13:11:00.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:00 smithi156 ceph-mon[134078]: pgmap v464: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 463 op/s 2023-09-21T13:11:00.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:00 smithi142 ceph-mon[97663]: pgmap v464: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 463 op/s 2023-09-21T13:11:00.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:00 smithi160 ceph-mon[134450]: pgmap v464: 97 pgs: 97 active+clean; 893 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 463 op/s 2023-09-21T13:11:01.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 68388 38.10 MB/sec warmup 101 sec latency 90.861 ms 2023-09-21T13:11:02.029 INFO:tasks.workunit.client.0.smithi142.stdout: 10 68692 37.94 MB/sec warmup 102 sec latency 129.384 ms 2023-09-21T13:11:02.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:02 smithi156 ceph-mon[134078]: pgmap v465: 97 pgs: 97 active+clean; 899 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.9 MiB/s wr, 603 op/s 2023-09-21T13:11:02.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:02 smithi142 ceph-mon[97663]: pgmap v465: 97 pgs: 97 active+clean; 899 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.9 MiB/s wr, 603 op/s 2023-09-21T13:11:02.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:02 smithi160 ceph-mon[134450]: pgmap v465: 97 pgs: 97 active+clean; 899 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 6.9 MiB/s wr, 603 op/s 2023-09-21T13:11:03.030 INFO:tasks.workunit.client.0.smithi142.stdout: 10 68880 37.75 MB/sec warmup 103 sec latency 552.351 ms 2023-09-21T13:11:03.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:03 smithi156 ceph-mon[134078]: osdmap e107: 12 total, 12 up, 12 in 2023-09-21T13:11:03.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:03 smithi156 ceph-mon[134078]: pgmap v467: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:03.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:03 smithi142 ceph-mon[97663]: osdmap e107: 12 total, 12 up, 12 in 2023-09-21T13:11:03.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:03 smithi142 ceph-mon[97663]: pgmap v467: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:03.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:03 smithi160 ceph-mon[134450]: osdmap e107: 12 total, 12 up, 12 in 2023-09-21T13:11:03.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:03 smithi160 ceph-mon[134450]: pgmap v467: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:04.030 INFO:tasks.workunit.client.0.smithi142.stdout: 10 69109 37.53 MB/sec warmup 104 sec latency 508.260 ms 2023-09-21T13:11:05.030 INFO:tasks.workunit.client.0.smithi142.stdout: 10 69562 37.43 MB/sec warmup 105 sec latency 206.553 ms 2023-09-21T13:11:06.030 INFO:tasks.workunit.client.0.smithi142.stdout: 10 69623 37.10 MB/sec warmup 106 sec latency 554.557 ms 2023-09-21T13:11:06.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:05 smithi156 ceph-mon[134078]: pgmap v468: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:06.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:05 smithi142 ceph-mon[97663]: pgmap v468: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:06.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:05 smithi160 ceph-mon[134450]: pgmap v468: 97 pgs: 97 active+clean; 884 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.6 MiB/s wr, 690 op/s 2023-09-21T13:11:07.031 INFO:tasks.workunit.client.0.smithi142.stdout: 10 69978 36.89 MB/sec warmup 107 sec latency 604.765 ms 2023-09-21T13:11:08.031 INFO:tasks.workunit.client.0.smithi142.stdout: 10 70586 36.79 MB/sec warmup 108 sec latency 89.338 ms 2023-09-21T13:11:08.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:07 smithi156 ceph-mon[134078]: pgmap v469: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:08.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:07 smithi142 ceph-mon[97663]: pgmap v469: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:08.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:07 smithi160 ceph-mon[134450]: pgmap v469: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:09.031 INFO:tasks.workunit.client.0.smithi142.stdout: 10 71678 36.96 MB/sec warmup 109 sec latency 83.484 ms 2023-09-21T13:11:10.031 INFO:tasks.workunit.client.0.smithi142.stdout: 10 72765 37.28 MB/sec warmup 110 sec latency 63.329 ms 2023-09-21T13:11:10.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:09 smithi156 ceph-mon[134078]: pgmap v470: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:10.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:09 smithi142 ceph-mon[97663]: pgmap v470: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:10.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:09 smithi160 ceph-mon[134450]: pgmap v470: 97 pgs: 97 active+clean; 993 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 16 MiB/s wr, 947 op/s 2023-09-21T13:11:11.031 INFO:tasks.workunit.client.0.smithi142.stdout: 10 73069 37.10 MB/sec warmup 111 sec latency 558.570 ms 2023-09-21T13:11:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.335+0000 7f4defbff700 1 -- 172.21.15.142:0/3596300975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 msgr2=0x7f4de8105620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:11.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.335+0000 7f4defbff700 1 --2- 172.21.15.142:0/3596300975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de8105620 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4de000b0a0 tx=0x7f4de000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.343+0000 7f4defbff700 1 -- 172.21.15.142:0/3596300975 shutdown_connections 2023-09-21T13:11:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.343+0000 7f4defbff700 1 --2- 172.21.15.142:0/3596300975 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de80ffd70 0x7f4de8100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.343+0000 7f4defbff700 1 --2- 172.21.15.142:0/3596300975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de8105620 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.343+0000 7f4defbff700 1 --2- 172.21.15.142:0/3596300975 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de8100690 0x7f4de8104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.343+0000 7f4defbff700 1 -- 172.21.15.142:0/3596300975 >> 172.21.15.142:0/3596300975 conn(0x7f4de80fb7c0 msgr2=0x7f4de80fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.349+0000 7f4defbff700 1 -- 172.21.15.142:0/3596300975 shutdown_connections 2023-09-21T13:11:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.353+0000 7f4defbff700 1 -- 172.21.15.142:0/3596300975 wait complete. 2023-09-21T13:11:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.355+0000 7f4defbff700 1 Processor -- start 2023-09-21T13:11:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.356+0000 7f4defbff700 1 -- start start 2023-09-21T13:11:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de80ffd70 0x7f4de8071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de8100690 0x7f4de8071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de810b8e0 con 0x7f4de8100690 2023-09-21T13:11:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de810ba50 con 0x7f4de80ffd70 2023-09-21T13:11:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.357+0000 7f4defbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de810bc10 con 0x7f4de8105170 2023-09-21T13:11:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.358+0000 7f4dee19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.358+0000 7f4dee19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33972/0 (socket says 172.21.15.142:33972) 2023-09-21T13:11:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.358+0000 7f4dee19c700 1 -- 172.21.15.142:0/1780617958 learned_addr learned my addr 172.21.15.142:0/1780617958 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.359+0000 7f4dee19c700 1 -- 172.21.15.142:0/1780617958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de80ffd70 msgr2=0x7f4de8071300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-21T13:11:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.359+0000 7f4dee19c700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de80ffd70 0x7f4de8071300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.359+0000 7f4dee19c700 1 -- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de8100690 msgr2=0x7f4de8071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.359+0000 7f4dee19c700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de8100690 0x7f4de8071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.359+0000 7f4dee19c700 1 -- 172.21.15.142:0/1780617958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de0009d00 con 0x7f4de8105170 2023-09-21T13:11:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.365+0000 7f4dee19c700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009fd0 tx=0x7f4de0004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.370+0000 7f4ddaffd700 1 -- 172.21.15.142:0/1780617958 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de000e040 con 0x7f4de8105170 2023-09-21T13:11:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.370+0000 7f4ddaffd700 1 -- 172.21.15.142:0/1780617958 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4de00079d0 con 0x7f4de8105170 2023-09-21T13:11:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.370+0000 7f4ddaffd700 1 -- 172.21.15.142:0/1780617958 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de001b790 con 0x7f4de8105170 2023-09-21T13:11:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.370+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de810be90 con 0x7f4de8105170 2023-09-21T13:11:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.370+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de810c110 con 0x7f4de8105170 2023-09-21T13:11:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.377+0000 7f4e034fab80 1 Processor -- start 2023-09-21T13:11:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.379+0000 7f4e034fab80 1 -- start start 2023-09-21T13:11:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.379+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41ba480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.379+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.380+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41bee50 0x5642d41bf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.380+0000 7f4e034fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d412ec40 con 0x5642d41ba0a0 2023-09-21T13:11:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.380+0000 7f4e034fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d4112c10 con 0x5642d41bee50 2023-09-21T13:11:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.380+0000 7f4e034fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d4110530 con 0x5642d41ba9c0 2023-09-21T13:11:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.380+0000 7f4ddaffd700 1 -- 172.21.15.142:0/1780617958 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4de001b8f0 con 0x7f4de8105170 2023-09-21T13:11:11.379 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.382+0000 7f4ddaffd700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 0x7f4dd40a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.380 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.382+0000 7f4ddaffd700 1 -- 172.21.15.142:0/1780617958 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4de00cd060 con 0x7f4de8105170 2023-09-21T13:11:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.386+0000 7f4ded99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.386+0000 7f4ded99b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33984/0 (socket says 172.21.15.142:33984) 2023-09-21T13:11:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.386+0000 7f4ded99b700 1 -- 172.21.15.142:0/4061538063 learned_addr learned my addr 172.21.15.142:0/4061538063 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.389+0000 7f4dee19c700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 0x7f4dd40a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.390+0000 7f4dee19c700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 0x7f4dd40a2e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009750 tx=0x7f4de000b3b0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.392+0000 7f4ded99b700 1 -- 172.21.15.142:0/4061538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41bee50 msgr2=0x5642d41bf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.392+0000 7f4ded99b700 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41bee50 0x5642d41bf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.392+0000 7f4ded99b700 1 -- 172.21.15.142:0/4061538063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 msgr2=0x5642d41ba480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.392+0000 7f4ded99b700 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.392+0000 7f4ded99b700 1 -- 172.21.15.142:0/4061538063 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d3f36d80 con 0x5642d41ba9c0 2023-09-21T13:11:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.394+0000 7f4ded99b700 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009810 tx=0x7f4de4009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5141dbb230a0ffc server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.394+0000 7f4dd3fff700 1 -- 172.21.15.142:0/4061538063 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4011830 con 0x5642d41ba9c0 2023-09-21T13:11:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.394+0000 7f4dd3fff700 1 -- 172.21.15.142:0/4061538063 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4de4011e50 con 0x5642d41ba9c0 2023-09-21T13:11:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.394+0000 7f4dd3fff700 1 -- 172.21.15.142:0/4061538063 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4010380 con 0x5642d41ba9c0 2023-09-21T13:11:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.395+0000 7f4e034fab80 1 -- 172.21.15.142:0/4061538063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 msgr2=0x5642d41be910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.395+0000 7f4e034fab80 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009810 tx=0x7f4de4009b20 comp rx=0 tx=0).stop 2023-09-21T13:11:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.398+0000 7f4e034fab80 1 -- 172.21.15.142:0/4061538063 shutdown_connections 2023-09-21T13:11:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.398+0000 7f4e034fab80 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41ba480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.398+0000 7f4e034fab80 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41bee50 0x5642d41bf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.398+0000 7f4e034fab80 1 --2- 172.21.15.142:0/4061538063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41be910 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.398+0000 7f4e034fab80 1 -- 172.21.15.142:0/4061538063 >> 172.21.15.142:0/4061538063 conn(0x5642d40e6fa0 msgr2=0x5642d41b50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.404+0000 7f4e034fab80 1 -- 172.21.15.142:0/4061538063 shutdown_connections 2023-09-21T13:11:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.405+0000 7f4e034fab80 1 -- 172.21.15.142:0/4061538063 wait complete. 2023-09-21T13:11:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.406+0000 7f4e034fab80 1 -- start start 2023-09-21T13:11:11.400 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.406+0000 7f4e034fab80 1 Processor -- start 2023-09-21T13:11:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41c3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41bee50 0x5642d41c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d410be20 con 0x5642d41bee50 2023-09-21T13:11:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d40a86e0 con 0x5642d41ba0a0 2023-09-21T13:11:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d40a8380 con 0x5642d41ba9c0 2023-09-21T13:11:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.407+0000 7f4e034fab80 10 client.0 _ll_register_callbacks cb 0x5642d3ff2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.408+0000 7f4ded19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.408+0000 7f4ded19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39544/0 (socket says 172.21.15.142:39544) 2023-09-21T13:11:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.408+0000 7f4ded19a700 1 -- 172.21.15.142:0/1456176186 learned_addr learned my addr 172.21.15.142:0/1456176186 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.408+0000 7f4ded19a700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41bee50 0x5642d41c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.410+0000 7f4ded19a700 1 -- 172.21.15.142:0/1456176186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 msgr2=0x5642d41c3850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:11:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.410+0000 7f4ded19a700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41c3850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.410+0000 7f4ded19a700 1 -- 172.21.15.142:0/1456176186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41bee50 msgr2=0x5642d41c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.410+0000 7f4ded19a700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41bee50 0x5642d41c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.410+0000 7f4ded19a700 1 -- 172.21.15.142:0/1456176186 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4009440 con 0x5642d41ba0a0 2023-09-21T13:11:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.412+0000 7f4ded19a700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009d50 tx=0x7f4ddc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59215e9cd7111268 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.412+0000 7f4dd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.412+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc013300 con 0x5642d41ba0a0 2023-09-21T13:11:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.412+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4ddc00e8e0 con 0x5642d41ba0a0 2023-09-21T13:11:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.412+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d407cb50 con 0x5642d41ba0a0 2023-09-21T13:11:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.413+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ddc00eaa0 con 0x5642d41ba0a0 2023-09-21T13:11:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.414+0000 7f4e034fab80 10 client.28220 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.414+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5642d3f1fc00 con 0x5642d41ba0a0 2023-09-21T13:11:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.415+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5642d407cb50 con 0x5642d41ba0a0 2023-09-21T13:11:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.415+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4ddc011cd0 con 0x5642d41ba0a0 2023-09-21T13:11:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 10 client.28220 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 10 client.28220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 20 client.28220 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d41d4030 0x5642d41d6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 4 client.28220 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:11.411 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.416+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642d4188fc0 con 0x5642d41d4030 2023-09-21T13:11:11.412 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.417+0000 7f4ded99b700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d41d4030 0x5642d41d6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.422+0000 7f4ded99b700 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d41d4030 0x5642d41d6450 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee65787855fe4301 server_cookie=b811e1a05ba323e5 in_seq=0 out_seq=0 2023-09-21T13:11:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.422+0000 7f4dd17fa700 10 client.28220 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.424+0000 7f4dd17fa700 1 -- 172.21.15.142:0/1456176186 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5642d4188fc0 con 0x5642d41d4030 2023-09-21T13:11:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.424+0000 7f4dd17fa700 10 client.28220 handle_command_reply: tid=0 2023-09-21T13:11:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.425+0000 7f4e034fab80 1 client.28220 shutdown 2023-09-21T13:11:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.425+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 msgr2=0x5642d41c6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.425+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009d50 tx=0x7f4ddc009780 comp rx=0 tx=0).stop 2023-09-21T13:11:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 shutdown_connections 2023-09-21T13:11:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d41d4030 0x5642d41d6450 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41bee50 0x5642d41c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba0a0 0x5642d41c6640 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1456176186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41ba9c0 0x5642d41c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.420 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.426+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 >> 172.21.15.142:0/1456176186 conn(0x5642d40e6fa0 msgr2=0x5642d41b4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:11.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.427+0000 7f4dd17fa700 0 client.28220 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:11.421 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.427+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 shutdown_connections 2023-09-21T13:11:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.427+0000 7f4e034fab80 1 -- 172.21.15.142:0/1456176186 wait complete. 2023-09-21T13:11:11.422 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.427+0000 7f4e034fab80 20 client.28220 trim_cache size 0 max 16384 2023-09-21T13:11:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 Processor -- start 2023-09-21T13:11:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 -- start start 2023-09-21T13:11:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41c3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41be570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d3f8c8c0 con 0x5642d41ba0a0 2023-09-21T13:11:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d41b69b0 con 0x5642d41ba9c0 2023-09-21T13:11:11.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.462+0000 7f4e034fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d41b5320 con 0x5642d41bee50 2023-09-21T13:11:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.463+0000 7f4ded19a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41be570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.463+0000 7f4ded99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.463+0000 7f4ded99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39558/0 (socket says 172.21.15.142:39558) 2023-09-21T13:11:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.463+0000 7f4ded99b700 1 -- 172.21.15.142:0/1372696062 learned_addr learned my addr 172.21.15.142:0/1372696062 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 -- 172.21.15.142:0/1372696062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 msgr2=0x5642d41be570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41be570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 -- 172.21.15.142:0/1372696062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 msgr2=0x5642d41c3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41c3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 -- 172.21.15.142:0/1372696062 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d3f5d1f0 con 0x5642d41ba9c0 2023-09-21T13:11:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.464+0000 7f4ded99b700 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009f20 tx=0x7f4de4009b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7086501341fbfdf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.465+0000 7f4dd8bff700 1 -- 172.21.15.142:0/1372696062 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4020040 con 0x5642d41ba9c0 2023-09-21T13:11:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.465+0000 7f4dd8bff700 1 -- 172.21.15.142:0/1372696062 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4de400b8a0 con 0x5642d41ba9c0 2023-09-21T13:11:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.465+0000 7f4dd8bff700 1 -- 172.21.15.142:0/1372696062 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4024730 con 0x5642d41ba9c0 2023-09-21T13:11:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 -- 172.21.15.142:0/1372696062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 msgr2=0x5642d41cb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009f20 tx=0x7f4de4009b20 comp rx=0 tx=0).stop 2023-09-21T13:11:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 -- 172.21.15.142:0/1372696062 shutdown_connections 2023-09-21T13:11:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41c3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41be570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 --2- 172.21.15.142:0/1372696062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41cb0a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 -- 172.21.15.142:0/1372696062 >> 172.21.15.142:0/1372696062 conn(0x5642d40e6fa0 msgr2=0x5642d41bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:11.463 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.466+0000 7f4e034fab80 1 -- 172.21.15.142:0/1372696062 shutdown_connections 2023-09-21T13:11:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.467+0000 7f4e034fab80 1 -- 172.21.15.142:0/1372696062 wait complete. 2023-09-21T13:11:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.467+0000 7f4e034fab80 1 -- start start 2023-09-21T13:11:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.467+0000 7f4e034fab80 1 Processor -- start 2023-09-21T13:11:11.464 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41c9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d41c9c20 con 0x5642d41ba0a0 2023-09-21T13:11:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d41c9d90 con 0x5642d41ba9c0 2023-09-21T13:11:11.465 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d41c9f50 con 0x5642d41bee50 2023-09-21T13:11:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.468+0000 7f4e034fab80 10 client.0 _ll_register_callbacks cb 0x5642d3ff2a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.469+0000 7f4ded19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.469+0000 7f4ded19a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:41394/0 (socket says 172.21.15.142:41394) 2023-09-21T13:11:11.466 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.469+0000 7f4ded19a700 1 -- 172.21.15.142:0/3537571480 learned_addr learned my addr 172.21.15.142:0/3537571480 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:11.467 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.469+0000 7f4ded99b700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.470+0000 7f4ded19a700 1 -- 172.21.15.142:0/3537571480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 msgr2=0x5642d41c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.470+0000 7f4ded19a700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.470+0000 7f4ded19a700 1 -- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 msgr2=0x5642d41c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.470+0000 7f4ded19a700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.470+0000 7f4ded19a700 1 -- 172.21.15.142:0/3537571480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642d3f36d80 con 0x5642d41ba0a0 2023-09-21T13:11:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.471+0000 7f4ded19a700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc013a50 tx=0x7f4ddc005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe364cdac535b77 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.471+0000 7f4dd17fa700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:11:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.472+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc010930 con 0x5642d41ba0a0 2023-09-21T13:11:11.469 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.472+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f4ddc000e40 con 0x5642d41ba0a0 2023-09-21T13:11:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.472+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4de4011e50 con 0x5642d41ba0a0 2023-09-21T13:11:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.473+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ddc010a90 con 0x5642d41ba0a0 2023-09-21T13:11:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.473+0000 7f4e034fab80 10 client.18054 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.473+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5642d3f35250 con 0x5642d41ba0a0 2023-09-21T13:11:11.470 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4de4011e50 con 0x5642d41ba0a0 2023-09-21T13:11:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4ddc00e810 con 0x5642d41ba0a0 2023-09-21T13:11:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 10 client.18054 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 10 client.18054 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 20 client.18054 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:11.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d4229430 0x5642d422b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 4 client.18054 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:11:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.474+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5642d4104e00 con 0x5642d4229430 2023-09-21T13:11:11.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.475+0000 7f4ded99b700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d4229430 0x5642d422b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.477+0000 7f4ded99b700 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d4229430 0x5642d422b850 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b38c495eb02f987 server_cookie=526fd5cb0ebc08d6 in_seq=0 out_seq=0 2023-09-21T13:11:11.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:11.477+0000 7f4dd17fa700 10 client.18054 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:12.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 73121 36.80 MB/sec warmup 112 sec latency 895.334 ms 2023-09-21T13:11:12.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:11 smithi156 ceph-mon[134078]: pgmap v471: 97 pgs: 97 active+clean; 990 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 785 op/s 2023-09-21T13:11:12.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:11 smithi156 ceph-mon[134078]: osdmap e108: 12 total, 12 up, 12 in 2023-09-21T13:11:12.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:11 smithi142 ceph-mon[97663]: pgmap v471: 97 pgs: 97 active+clean; 990 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 785 op/s 2023-09-21T13:11:12.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:11 smithi142 ceph-mon[97663]: osdmap e108: 12 total, 12 up, 12 in 2023-09-21T13:11:12.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:11 smithi160 ceph-mon[134450]: pgmap v471: 97 pgs: 97 active+clean; 990 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 785 op/s 2023-09-21T13:11:12.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:11 smithi160 ceph-mon[134450]: osdmap e108: 12 total, 12 up, 12 in 2023-09-21T13:11:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.197+0000 7f4dd17fa700 1 -- 172.21.15.142:0/3537571480 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5642d4104e00 con 0x5642d4229430 2023-09-21T13:11:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.197+0000 7f4dd17fa700 10 client.18054 handle_command_reply: tid=0 2023-09-21T13:11:12.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.197+0000 7f4e034fab80 1 client.18054 shutdown 2023-09-21T13:11:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 msgr2=0x5642d41cade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc013a50 tx=0x7f4ddc005d90 comp rx=0 tx=0).stop 2023-09-21T13:11:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 shutdown_connections 2023-09-21T13:11:12.198 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5642d4229430 0x5642d422b850 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5642d41ba0a0 0x5642d41cade0 secure :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc013a50 tx=0x7f4ddc005d90 comp rx=0 tx=0).stop 2023-09-21T13:11:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5642d41bee50 0x5642d41c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 --2- 172.21.15.142:0/3537571480 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5642d41ba9c0 0x5642d41c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.199 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 >> 172.21.15.142:0/3537571480 conn(0x5642d40e6fa0 msgr2=0x5642d41be6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.199+0000 7f4dd17fa700 0 client.18054 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.205+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 shutdown_connections 2023-09-21T13:11:12.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.207+0000 7f4e034fab80 1 -- 172.21.15.142:0/3537571480 wait complete. 2023-09-21T13:11:12.203 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.210+0000 7f4e034fab80 20 client.18054 trim_cache size 0 max 16384 2023-09-21T13:11:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:11:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:11:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:11:12.207 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:11:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 msgr2=0x7f4dd40a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 0x7f4dd40a2e80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009750 tx=0x7f4de000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 msgr2=0x7f4de810b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:12.208 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009fd0 tx=0x7f4de0004d30 comp rx=0 tx=0).stop 2023-09-21T13:11:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 shutdown_connections 2023-09-21T13:11:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4dd40a09c0 0x7f4dd40a2e80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4de8105170 0x7f4de810b290 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4de80ffd70 0x7f4de8071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.209 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 --2- 172.21.15.142:0/1780617958 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4de8100690 0x7f4de8071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.214+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 >> 172.21.15.142:0/1780617958 conn(0x7f4de80fb7c0 msgr2=0x7f4de8102b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:12.210 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.217+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 shutdown_connections 2023-09-21T13:11:12.212 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:12.218+0000 7f4defbff700 1 -- 172.21.15.142:0/1780617958 wait complete. 2023-09-21T13:11:13.032 INFO:tasks.workunit.client.0.smithi142.stdout: 10 73459 36.61 MB/sec warmup 113 sec latency 547.778 ms 2023-09-21T13:11:14.032 INFO:tasks.workunit.client.0.smithi142.stdout: 10 74150 36.50 MB/sec warmup 114 sec latency 73.666 ms 2023-09-21T13:11:14.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:13 smithi156 ceph-mon[134078]: pgmap v473: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:14.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:13 smithi142 ceph-mon[97663]: pgmap v473: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:14.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:13 smithi160 ceph-mon[134450]: pgmap v473: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:15.032 INFO:tasks.workunit.client.0.smithi142.stdout: 10 75303 36.78 MB/sec warmup 115 sec latency 53.049 ms 2023-09-21T13:11:16.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 76215 36.94 MB/sec warmup 116 sec latency 76.569 ms 2023-09-21T13:11:16.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:15 smithi156 ceph-mon[134078]: pgmap v474: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:16.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:15 smithi142 ceph-mon[97663]: pgmap v474: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:16.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:15 smithi160 ceph-mon[134450]: pgmap v474: 97 pgs: 97 active+clean; 982 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 MiB/s rd, 22 MiB/s wr, 1.01k op/s 2023-09-21T13:11:17.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 76838 36.89 MB/sec warmup 117 sec latency 124.326 ms 2023-09-21T13:11:18.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 77684 36.88 MB/sec warmup 118 sec latency 74.764 ms 2023-09-21T13:11:18.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:17 smithi156 ceph-mon[134078]: pgmap v475: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:18.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:17 smithi142 ceph-mon[97663]: pgmap v475: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:18.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:17 smithi160 ceph-mon[134450]: pgmap v475: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:19.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 78814 37.10 MB/sec warmup 119 sec latency 78.174 ms 2023-09-21T13:11:20.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:19 smithi156 ceph-mon[134078]: pgmap v476: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:20.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:19 smithi142 ceph-mon[97663]: pgmap v476: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:20.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:19 smithi160 ceph-mon[134450]: pgmap v476: 97 pgs: 97 active+clean; 911 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 17 MiB/s wr, 1.04k op/s 2023-09-21T13:11:21.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 80347 31.24 MB/sec execute 1 sec latency 60.885 ms 2023-09-21T13:11:21.599 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:11:21.928 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/1063342887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4073aa0 msgr2=0x7fdbe4111800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/1063342887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4073aa0 0x7fdbe4111800 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009990 tx=0x7fdbd4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/1063342887 shutdown_connections 2023-09-21T13:11:21.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/1063342887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4111d40 0x7fdbe4114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.929 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/1063342887 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 0x7fdbe4073560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/1063342887 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4073aa0 0x7fdbe4111800 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/1063342887 >> 172.21.15.142:0/1063342887 conn(0x7fdbe40fc860 msgr2=0x7fdbe40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:21.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/1063342887 shutdown_connections 2023-09-21T13:11:21.930 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.934+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/1063342887 wait complete. 2023-09-21T13:11:21.931 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.936+0000 7fdbeb7ff700 1 Processor -- start 2023-09-21T13:11:21.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.936+0000 7fdbeb7ff700 1 -- start start 2023-09-21T13:11:21.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 0x7fdbe419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4111d40 0x7fdbe41a1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.932 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe41a2500 con 0x7fdbe4111d40 2023-09-21T13:11:21.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe41a2670 con 0x7fdbe4073180 2023-09-21T13:11:21.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbeb7ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe41a2830 con 0x7fdbe4073aa0 2023-09-21T13:11:21.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbe8d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbe8d9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:55996/0 (socket says 172.21.15.142:55996) 2023-09-21T13:11:21.933 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.937+0000 7fdbe8d9a700 1 -- 172.21.15.142:0/3839906091 learned_addr learned my addr 172.21.15.142:0/3839906091 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:21.934 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe959b700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 0x7fdbe419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4111d40 0x7fdbe41a1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe8d9a700 1 -- 172.21.15.142:0/3839906091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 msgr2=0x7fdbe419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 0x7fdbe419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.935 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe8d9a700 1 -- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4111d40 msgr2=0x7fdbe41a1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4111d40 0x7fdbe41a1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.938+0000 7fdbe8d9a700 1 -- 172.21.15.142:0/3839906091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd40095f0 con 0x7fdbe4073aa0 2023-09-21T13:11:21.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.939+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c00 tx=0x7fdbd4005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.939+0000 7fdbda7fc700 1 -- 172.21.15.142:0/3839906091 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd401d070 con 0x7fdbe4073aa0 2023-09-21T13:11:21.936 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.939+0000 7fdbda7fc700 1 -- 172.21.15.142:0/3839906091 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbd4021400 con 0x7fdbe4073aa0 2023-09-21T13:11:21.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.939+0000 7fdbda7fc700 1 -- 172.21.15.142:0/3839906091 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd4017650 con 0x7fdbe4073aa0 2023-09-21T13:11:21.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.940+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe41a2ab0 con 0x7fdbe4073aa0 2023-09-21T13:11:21.937 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.940+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe41aa170 con 0x7fdbe4073aa0 2023-09-21T13:11:21.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.946+0000 7fdbda7fc700 1 -- 172.21.15.142:0/3839906091 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdbd4021570 con 0x7fdbe4073aa0 2023-09-21T13:11:21.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.946+0000 7fdbff14ab80 1 Processor -- start 2023-09-21T13:11:21.941 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.946+0000 7fdbff14ab80 1 -- start start 2023-09-21T13:11:21.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e6ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.942 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e6d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6ddcca0 con 0x5638e6e68f30 2023-09-21T13:11:21.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6dc0c70 con 0x5638e6e6d360 2023-09-21T13:11:21.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.947+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6dbe590 con 0x5638e6e68610 2023-09-21T13:11:21.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.948+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.943 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.948+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56012/0 (socket says 172.21.15.142:56012) 2023-09-21T13:11:21.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.948+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/2182385929 learned_addr learned my addr 172.21.15.142:0/2182385929 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:21.944 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.948+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e6d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.948+0000 7fdbe959b700 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e6ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/2182385929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 msgr2=0x5638e6e6d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.945 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e6d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/2182385929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 msgr2=0x5638e6e6ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e6ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/2182385929 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e6be4de0 con 0x5638e6e68610 2023-09-21T13:11:21.946 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.949+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009ef0 tx=0x7fdbdc009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a9e68a421588523 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbda7fc700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 0x7fdbd00a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbcf7fe700 1 -- 172.21.15.142:0/2182385929 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011070 con 0x5638e6e68610 2023-09-21T13:11:21.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbcf7fe700 1 -- 172.21.15.142:0/2182385929 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbdc00ce90 con 0x5638e6e68610 2023-09-21T13:11:21.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbcf7fe700 1 -- 172.21.15.142:0/2182385929 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc015e50 con 0x5638e6e68610 2023-09-21T13:11:21.947 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbda7fc700 1 -- 172.21.15.142:0/3839906091 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdbd40cd260 con 0x7fdbe4073aa0 2023-09-21T13:11:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbe959b700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 0x7fdbd00a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2182385929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 msgr2=0x5638e6e689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.950+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009ef0 tx=0x7fdbdc009f20 comp rx=0 tx=0).stop 2023-09-21T13:11:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2182385929 shutdown_connections 2023-09-21T13:11:21.948 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e6d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e689f0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2182385929 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e6ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2182385929 >> 172.21.15.142:0/2182385929 conn(0x5638e6d95000 msgr2=0x5638e6e636a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:21.949 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2182385929 shutdown_connections 2023-09-21T13:11:21.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2182385929 wait complete. 2023-09-21T13:11:21.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.951+0000 7fdbe959b700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 0x7fdbd00a2d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009da0 tx=0x7fdbe0014040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.951 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.952+0000 7fdbff14ab80 1 -- start start 2023-09-21T13:11:21.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.952+0000 7fdbff14ab80 1 Processor -- start 2023-09-21T13:11:21.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.952+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e71e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e723d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.952 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6db9e80 con 0x5638e6e68f30 2023-09-21T13:11:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6d56740 con 0x5638e6e6d360 2023-09-21T13:11:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6d563e0 con 0x5638e6e68610 2023-09-21T13:11:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbff14ab80 10 client.0 _ll_register_callbacks cb 0x5638e6ca0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.953 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54472/0 (socket says 172.21.15.142:54472) 2023-09-21T13:11:21.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.953+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3751041157 learned_addr learned my addr 172.21.15.142:0/3751041157 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:21.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3751041157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 msgr2=0x5638e6e71e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:11:21.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e71e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.954 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3751041157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 msgr2=0x5638e6e723d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e723d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3751041157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc009ba0 con 0x5638e6e6d360 2023-09-21T13:11:21.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc015640 tx=0x7fdbdc00ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d527791550626bd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.954+0000 7fdbccff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:21.955 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011050 con 0x5638e6e6d360 2023-09-21T13:11:21.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdbdc006e40 con 0x5638e6e6d360 2023-09-21T13:11:21.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5638e6d2abb0 con 0x5638e6e6d360 2023-09-21T13:11:21.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbdc0157f0 con 0x5638e6e6d360 2023-09-21T13:11:21.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbff14ab80 10 client.28238 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:21.956 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.955+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5638e6bcdc60 con 0x5638e6e6d360 2023-09-21T13:11:21.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5638e6d2abb0 con 0x5638e6e6d360 2023-09-21T13:11:21.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdbdc01e5b0 con 0x5638e6e6d360 2023-09-21T13:11:21.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 10 client.28238 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:21.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 10 client.28238 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:21.957 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 20 client.28238 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6e93460 0x5638e6e95880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 4 client.28238 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5638e6e37020 con 0x5638e6e93460 2023-09-21T13:11:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.956+0000 7fdbe959b700 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6e93460 0x5638e6e95880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.958 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.957+0000 7fdbe959b700 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6e93460 0x5638e6e95880 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=664f999bce9eaaa3 server_cookie=384722532b2163aa in_seq=0 out_seq=0 2023-09-21T13:11:21.959 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.957+0000 7fdbccff9700 10 client.28238 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.960+0000 7fdbccff9700 1 -- 172.21.15.142:0/3751041157 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5638e6e37020 con 0x5638e6e93460 2023-09-21T13:11:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.960+0000 7fdbccff9700 10 client.28238 handle_command_reply: tid=0 2023-09-21T13:11:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.960+0000 7fdbff14ab80 1 client.28238 shutdown 2023-09-21T13:11:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.961+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 msgr2=0x5638e6e72910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.960 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.961+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc015640 tx=0x7fdbdc00ce00 comp rx=0 tx=0).stop 2023-09-21T13:11:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 shutdown_connections 2023-09-21T13:11:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6e93460 0x5638e6e95880 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e72910 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.961 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e71e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3751041157 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e723d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 >> 172.21.15.142:0/3751041157 conn(0x5638e6d95000 msgr2=0x5638e6e63290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.962+0000 7fdbccff9700 0 client.28238 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.963+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 shutdown_connections 2023-09-21T13:11:21.962 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.963+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3751041157 wait complete. 2023-09-21T13:11:21.963 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.963+0000 7fdbff14ab80 20 client.28238 trim_cache size 0 max 16384 2023-09-21T13:11:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 Processor -- start 2023-09-21T13:11:21.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 -- start start 2023-09-21T13:11:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e6ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e79510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6c3a920 con 0x5638e6e68f30 2023-09-21T13:11:21.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6e75300 con 0x5638e6e6d360 2023-09-21T13:11:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.986+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6e79ad0 con 0x5638e6e68610 2023-09-21T13:11:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe959b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e6ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe959b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e6ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:56030/0 (socket says 172.21.15.142:56030) 2023-09-21T13:11:21.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54476/0 (socket says 172.21.15.142:54476) 2023-09-21T13:11:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe959b700 1 -- 172.21.15.142:0/3725882523 learned_addr learned my addr 172.21.15.142:0/3725882523 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e79510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3725882523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 msgr2=0x5638e6e6ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e6ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3725882523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 msgr2=0x5638e6e79510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e79510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 -- 172.21.15.142:0/3725882523 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638e6e9a4d0 con 0x5638e6e6d360 2023-09-21T13:11:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e79510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:11:21.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.987+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc002230 tx=0x7fdbdc00c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f423a5b4d040f71 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.988+0000 7fdbcffff700 1 -- 172.21.15.142:0/3725882523 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc011040 con 0x5638e6e6d360 2023-09-21T13:11:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.988+0000 7fdbcffff700 1 -- 172.21.15.142:0/3725882523 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbdc012040 con 0x5638e6e6d360 2023-09-21T13:11:21.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.988+0000 7fdbcffff700 1 -- 172.21.15.142:0/3725882523 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc020970 con 0x5638e6e6d360 2023-09-21T13:11:21.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.988+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3725882523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 msgr2=0x5638e6e7dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:21.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.988+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc002230 tx=0x7fdbdc00c2e0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3725882523 shutdown_connections 2023-09-21T13:11:21.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e6d360 0x5638e6e7dc70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68610 0x5638e6e6ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/3725882523 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e68f30 0x5638e6e79510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3725882523 >> 172.21.15.142:0/3725882523 conn(0x5638e6d95000 msgr2=0x5638e6e8f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:21.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3725882523 shutdown_connections 2023-09-21T13:11:21.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 -- 172.21.15.142:0/3725882523 wait complete. 2023-09-21T13:11:21.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 -- start start 2023-09-21T13:11:21.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.990+0000 7fdbff14ab80 1 Processor -- start 2023-09-21T13:11:21.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68f30 0x5638e6e77a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e6d360 0x5638e6e77f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6e79850 con 0x5638e6e6d360 2023-09-21T13:11:21.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6ee62b0 con 0x5638e6e68610 2023-09-21T13:11:21.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638e6ee63f0 con 0x5638e6e68f30 2023-09-21T13:11:21.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbff14ab80 10 client.0 _ll_register_callbacks cb 0x5638e6ca0a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:21.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbe959b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbe959b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:54482/0 (socket says 172.21.15.142:54482) 2023-09-21T13:11:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.991+0000 7fdbe959b700 1 -- 172.21.15.142:0/2068071956 learned_addr learned my addr 172.21.15.142:0/2068071956 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68f30 0x5638e6e77a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe9d9c700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e6d360 0x5638e6e77f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 -- 172.21.15.142:0/2068071956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68f30 msgr2=0x5638e6e77a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68f30 0x5638e6e77a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 -- 172.21.15.142:0/2068071956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e6d360 msgr2=0x5638e6e77f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e6d360 0x5638e6e77f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 -- 172.21.15.142:0/2068071956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638e6bcdc60 con 0x5638e6e68610 2023-09-21T13:11:21.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbe959b700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0027530 tx=0x7fdbe00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e831272c45543ba server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.992+0000 7fdbccff9700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0027b10 con 0x5638e6e68610 2023-09-21T13:11:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdbe0024040 con 0x5638e6e68610 2023-09-21T13:11:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdbdc00ce90 con 0x5638e6e68610 2023-09-21T13:11:21.995 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbe0027c70 con 0x5638e6e68610 2023-09-21T13:11:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbff14ab80 10 client.28244 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x5638e6c0b250 con 0x5638e6e68610 2023-09-21T13:11:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.993+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdbe003c020 con 0x5638e6e68610 2023-09-21T13:11:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdbe001f5e0 con 0x5638e6e68610 2023-09-21T13:11:21.996 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 10 client.28244 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 10 client.28244 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 20 client.28244 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6ee7bb0 0x5638e6ee9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 4 client.28244 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:11:21.997 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5638e6db2e60 con 0x5638e6ee7bb0 2023-09-21T13:11:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.994+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6ee7bb0 0x5638e6ee9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbccff9700 10 client.28244 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:21.998 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbe8d9a700 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6ee7bb0 0x5638e6ee9fd0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=399c6bc4325d72b2 server_cookie=a44a7b0d1a81ee78 in_seq=0 out_seq=0 2023-09-21T13:11:21.999 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbccff9700 1 -- 172.21.15.142:0/2068071956 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x5638e6db2e60 con 0x5638e6ee7bb0 2023-09-21T13:11:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbccff9700 10 client.28244 handle_command_reply: tid=0 2023-09-21T13:11:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbff14ab80 1 client.28244 shutdown 2023-09-21T13:11:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 msgr2=0x5638e6e77500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:22.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.995+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0027530 tx=0x7fdbe00047c0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 shutdown_connections 2023-09-21T13:11:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5638e6ee7bb0 0x5638e6ee9fd0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5638e6e6d360 0x5638e6e77f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5638e6e68610 0x5638e6e77500 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbccff9700 0 client.28244 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 --2- 172.21.15.142:0/2068071956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5638e6e68f30 0x5638e6e77a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 >> 172.21.15.142:0/2068071956 conn(0x5638e6d95000 msgr2=0x5638e6e7dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 shutdown_connections 2023-09-21T13:11:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 1 -- 172.21.15.142:0/2068071956 wait complete. 2023-09-21T13:11:22.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.996+0000 7fdbff14ab80 20 client.28244 trim_cache size 0 max 16384 2023-09-21T13:11:22.003 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:11:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:11:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:11:22.003 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:11:22.004 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:11:22.004 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:11:22.004 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:11:22.004 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:11:22.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:11:22.005 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:11:22.005 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 msgr2=0x7fdbd00a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 0x7fdbd00a2d30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009da0 tx=0x7fdbe0014040 comp rx=0 tx=0).stop 2023-09-21T13:11:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 msgr2=0x7fdbe419da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4000c00 tx=0x7fdbd4005740 comp rx=0 tx=0).stop 2023-09-21T13:11:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 shutdown_connections 2023-09-21T13:11:22.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdbd00a0870 0x7fdbd00a2d30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdbe4111d40 0x7fdbe41a1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdbe4073180 0x7fdbe419d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 --2- 172.21.15.142:0/3839906091 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe4073aa0 0x7fdbe419da60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.998+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 >> 172.21.15.142:0/3839906091 conn(0x7fdbe40fc860 msgr2=0x7fdbe40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:22.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.999+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 shutdown_connections 2023-09-21T13:11:22.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:21.999+0000 7fdbeb7ff700 1 -- 172.21.15.142:0/3839906091 wait complete. 2023-09-21T13:11:22.015 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:21 smithi142 ceph-mon[97663]: pgmap v477: 97 pgs: 97 active+clean; 913 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 17 MiB/s wr, 1.05k op/s 2023-09-21T13:11:22.018 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:11:22.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 81335 37.71 MB/sec execute 2 sec latency 49.345 ms 2023-09-21T13:11:22.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:21 smithi156 ceph-mon[134078]: pgmap v477: 97 pgs: 97 active+clean; 913 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 17 MiB/s wr, 1.05k op/s 2023-09-21T13:11:22.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:21 smithi160 ceph-mon[134450]: pgmap v477: 97 pgs: 97 active+clean; 913 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 17 MiB/s wr, 1.05k op/s 2023-09-21T13:11:23.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 82328 46.53 MB/sec execute 3 sec latency 60.699 ms 2023-09-21T13:11:24.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 83031 44.78 MB/sec execute 4 sec latency 116.565 ms 2023-09-21T13:11:24.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:23 smithi156 ceph-mon[134078]: pgmap v478: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 11 MiB/s wr, 776 op/s 2023-09-21T13:11:24.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:23 smithi142 ceph-mon[97663]: pgmap v478: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 11 MiB/s wr, 776 op/s 2023-09-21T13:11:24.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:23 smithi160 ceph-mon[134450]: pgmap v478: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 11 MiB/s wr, 776 op/s 2023-09-21T13:11:25.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 83663 41.65 MB/sec execute 5 sec latency 44.200 ms 2023-09-21T13:11:25.471 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.478+0000 7fcc111ff700 1 -- 172.21.15.142:0/2565446069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c069160 msgr2=0x7fcc0c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.478+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2565446069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c069160 0x7fcc0c0695e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400b0a0 tx=0x7fcc0400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.472 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.479+0000 7fcc111ff700 1 -- 172.21.15.142:0/2565446069 shutdown_connections 2023-09-21T13:11:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.479+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2565446069 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc0c105d40 0x7fcc0c1037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.479+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2565446069 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c069160 0x7fcc0c0695e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.479+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2565446069 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c103d00 0x7fcc0c104180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.473 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.479+0000 7fcc111ff700 1 -- 172.21.15.142:0/2565446069 >> 172.21.15.142:0/2565446069 conn(0x7fcc0c076de0 msgr2=0x7fcc0c0771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.480+0000 7fcc111ff700 1 -- 172.21.15.142:0/2565446069 shutdown_connections 2023-09-21T13:11:25.474 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.480+0000 7fcc111ff700 1 -- 172.21.15.142:0/2565446069 wait complete. 2023-09-21T13:11:25.475 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.482+0000 7fcc111ff700 1 Processor -- start 2023-09-21T13:11:25.476 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.483+0000 7fcc111ff700 1 -- start start 2023-09-21T13:11:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c069160 0x7fcc0c19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc0c105d40 0x7fcc0c1a0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c1a15d0 con 0x7fcc0c105d40 2023-09-21T13:11:25.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c1a1740 con 0x7fcc0c069160 2023-09-21T13:11:25.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc111ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c1a1900 con 0x7fcc0c103d00 2023-09-21T13:11:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57468/0 (socket says 172.21.15.142:57468) 2023-09-21T13:11:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 -- 172.21.15.142:0/2687552575 learned_addr learned my addr 172.21.15.142:0/2687552575 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:25.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c069160 0x7fcc0c19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 -- 172.21.15.142:0/2687552575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c069160 msgr2=0x7fcc0c19d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c069160 0x7fcc0c19d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 -- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc0c105d40 msgr2=0x7fcc0c1a0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc0c105d40 0x7fcc0c1a0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.484+0000 7fcc0a59c700 1 -- 172.21.15.142:0/2687552575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc04009d00 con 0x7fcc0c103d00 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.485+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000d980 tx=0x7fcc0000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.485+0000 7fcbf3fff700 1 -- 172.21.15.142:0/2687552575 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00004220 con 0x7fcc0c103d00 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.485+0000 7fcbf3fff700 1 -- 172.21.15.142:0/2687552575 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc00007640 con 0x7fcc0c103d00 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.485+0000 7fcbf3fff700 1 -- 172.21.15.142:0/2687552575 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00004e60 con 0x7fcc0c103d00 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.485+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c1a1be0 con 0x7fcc0c103d00 2023-09-21T13:11:25.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.486+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c1aa540 con 0x7fcc0c103d00 2023-09-21T13:11:25.485 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.492+0000 7fcc24a58b80 1 Processor -- start 2023-09-21T13:11:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcbf3fff700 1 -- 172.21.15.142:0/2687552575 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcc0000b8e0 con 0x7fcc0c103d00 2023-09-21T13:11:25.486 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 -- start start 2023-09-21T13:11:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd502b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.487 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dcbfc40 con 0x56469dd4b9c0 2023-09-21T13:11:25.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dca3c10 con 0x56469dd4fe50 2023-09-21T13:11:25.488 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.493+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dca1530 con 0x56469dd4b0a0 2023-09-21T13:11:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.494+0000 7fcc0b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.494+0000 7fcc0b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57480/0 (socket says 172.21.15.142:57480) 2023-09-21T13:11:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.494+0000 7fcc0b59e700 1 -- 172.21.15.142:0/3591526725 learned_addr learned my addr 172.21.15.142:0/3591526725 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:25.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.494+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 -- 172.21.15.142:0/3591526725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 msgr2=0x56469dd502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 -- 172.21.15.142:0/3591526725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 msgr2=0x56469dd4f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 -- 172.21.15.142:0/3591526725 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56469dac7d80 con 0x56469dd4b0a0 2023-09-21T13:11:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcbf3fff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 0x7fcbf40a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcbf3fff700 1 -- 172.21.15.142:0/2687552575 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcc000cbdc0 con 0x7fcc0c103d00 2023-09-21T13:11:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.495+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009fd0 tx=0x7fcc0400cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d480215a7e1e5e1f server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.491 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.496+0000 7fcbf17fa700 1 -- 172.21.15.142:0/3591526725 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400e040 con 0x56469dd4b0a0 2023-09-21T13:11:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.496+0000 7fcbf17fa700 1 -- 172.21.15.142:0/3591526725 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc04004a50 con 0x56469dd4b0a0 2023-09-21T13:11:25.492 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.496+0000 7fcbf17fa700 1 -- 172.21.15.142:0/3591526725 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0401d480 con 0x56469dd4b0a0 2023-09-21T13:11:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.496+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 0x7fcbf40a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.497+0000 7fcc24a58b80 1 -- 172.21.15.142:0/3591526725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 msgr2=0x56469dd4b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.497+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fcc04009fd0 tx=0x7fcc0400cda0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.497+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 0x7fcbf40a2d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc005fd0 tx=0x7fcbfc005e30 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 -- 172.21.15.142:0/3591526725 shutdown_connections 2023-09-21T13:11:25.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd4b480 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/3591526725 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 -- 172.21.15.142:0/3591526725 >> 172.21.15.142:0/3591526725 conn(0x56469dc77fa0 msgr2=0x56469dd460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 -- 172.21.15.142:0/3591526725 shutdown_connections 2023-09-21T13:11:25.496 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.498+0000 7fcc24a58b80 1 -- 172.21.15.142:0/3591526725 wait complete. 2023-09-21T13:11:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.499+0000 7fcc24a58b80 1 -- start start 2023-09-21T13:11:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 Processor -- start 2023-09-21T13:11:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b9c0 0x56469dd54e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.497 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dc9ce20 con 0x56469dd4b0a0 2023-09-21T13:11:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dc396e0 con 0x56469dd4b9c0 2023-09-21T13:11:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dc39380 con 0x56469dd4fe50 2023-09-21T13:11:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.500+0000 7fcc24a58b80 10 client.0 _ll_register_callbacks cb 0x56469db83a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:25.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57494/0 (socket says 172.21.15.142:57494) 2023-09-21T13:11:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56984/0 (socket says 172.21.15.142:56984) 2023-09-21T13:11:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 -- 172.21.15.142:0/1709023849 learned_addr learned my addr 172.21.15.142:0/1709023849 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:25.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b9c0 0x56469dd54e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 -- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b9c0 msgr2=0x56469dd54e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b9c0 0x56469dd54e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 -- 172.21.15.142:0/1709023849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 msgr2=0x56469dd54950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.500 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 -- 172.21.15.142:0/1709023849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c114bf0 con 0x56469dd4fe50 2023-09-21T13:11:25.501 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:11:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400b0a0 tx=0x7fcc04007a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17fd4c800d5df742 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.501+0000 7fcbeeff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:11:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0400e040 con 0x56469dd4fe50 2023-09-21T13:11:25.503 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcc04009460 con 0x56469dd4fe50 2023-09-21T13:11:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56469dc0db50 con 0x56469dd4fe50 2023-09-21T13:11:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc04003a00 con 0x56469dd4fe50 2023-09-21T13:11:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcc24a58b80 10 client.28186 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.502+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x56469dab0c00 con 0x56469dd4fe50 2023-09-21T13:11:25.504 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56469dc0db50 con 0x56469dd4fe50 2023-09-21T13:11:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcc04019070 con 0x56469dd4fe50 2023-09-21T13:11:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 10 client.28186 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 10 client.28186 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 20 client.28186 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:25.505 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469dd64bf0 0x56469dd67010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 4 client.28186 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56469dd19fc0 con 0x56469dd64bf0 2023-09-21T13:11:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.503+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469dd64bf0 0x56469dd67010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.504+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469dd64bf0 0x56469dd67010 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fa575b0910f6358 server_cookie=631c5a0a2846d2cc in_seq=0 out_seq=0 2023-09-21T13:11:25.506 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.504+0000 7fcbeeff5700 10 client.28186 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.505+0000 7fcbeeff5700 1 -- 172.21.15.142:0/1709023849 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56469dd19fc0 con 0x56469dd64bf0 2023-09-21T13:11:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.505+0000 7fcbeeff5700 10 client.28186 handle_command_reply: tid=0 2023-09-21T13:11:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.505+0000 7fcc24a58b80 1 client.28186 shutdown 2023-09-21T13:11:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 msgr2=0x56469dd553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.507 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400b0a0 tx=0x7fcc04007a00 comp rx=0 tx=0).stop 2023-09-21T13:11:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 shutdown_connections 2023-09-21T13:11:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469dd64bf0 0x56469dd67010 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b0a0 0x56469dd54950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd553d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.508 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1709023849 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b9c0 0x56469dd54e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 >> 172.21.15.142:0/1709023849 conn(0x56469dc77fa0 msgr2=0x56469dd45cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.506+0000 7fcbeeff5700 0 client.28186 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.507+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 shutdown_connections 2023-09-21T13:11:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.507+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1709023849 wait complete. 2023-09-21T13:11:25.509 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.507+0000 7fcc24a58b80 20 client.28186 trim_cache size 0 max 16384 2023-09-21T13:11:25.526 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.531+0000 7fcc24a58b80 1 Processor -- start 2023-09-21T13:11:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.531+0000 7fcc24a58b80 1 -- start start 2023-09-21T13:11:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd4e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.527 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469db1d8c0 con 0x56469dd4b9c0 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dd479b0 con 0x56469dd4b0a0 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469dd55f60 con 0x56469dd4fe50 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:42958/0 (socket says 172.21.15.142:42958) 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/1039739226 learned_addr learned my addr 172.21.15.142:0/1039739226 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:25.528 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd4e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.532+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/1039739226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 msgr2=0x56469dd4e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd4e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.529 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/1039739226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 msgr2=0x56469dd4dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/1039739226 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56469dd6bc00 con 0x56469dd4b0a0 2023-09-21T13:11:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00eb40 tx=0x7fcbfc014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa6d6e70633fe22 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcbf1ffb700 1 -- 172.21.15.142:0/1039739226 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc0243b0 con 0x56469dd4b0a0 2023-09-21T13:11:25.530 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcbf1ffb700 1 -- 172.21.15.142:0/1039739226 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcbfc024040 con 0x56469dd4b0a0 2023-09-21T13:11:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.533+0000 7fcbf1ffb700 1 -- 172.21.15.142:0/1039739226 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc024d00 con 0x56469dd4b0a0 2023-09-21T13:11:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.534+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1039739226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 msgr2=0x56469dd5bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.531 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.534+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00eb40 tx=0x7fcbfc014000 comp rx=0 tx=0).stop 2023-09-21T13:11:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1039739226 shutdown_connections 2023-09-21T13:11:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4fe50 0x56469dd4e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4b0a0 0x56469dd5bfd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/1039739226 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd4dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.532 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1039739226 >> 172.21.15.142:0/1039739226 conn(0x56469dc77fa0 msgr2=0x56469dd66c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1039739226 shutdown_connections 2023-09-21T13:11:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.535+0000 7fcc24a58b80 1 -- 172.21.15.142:0/1039739226 wait complete. 2023-09-21T13:11:25.533 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.536+0000 7fcc24a58b80 1 -- start start 2023-09-21T13:11:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 Processor -- start 2023-09-21T13:11:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.534 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd584f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd58a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ddb79d0 con 0x56469dd4b9c0 2023-09-21T13:11:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ddb7b10 con 0x56469dd4fe50 2023-09-21T13:11:25.535 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.538+0000 7fcc24a58b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ddb7c50 con 0x56469dd4b0a0 2023-09-21T13:11:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc24a58b80 10 client.0 _ll_register_callbacks cb 0x56469db83a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57526/0 (socket says 172.21.15.142:57526) 2023-09-21T13:11:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/702039338 learned_addr learned my addr 172.21.15.142:0/702039338 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:25.536 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0b59e700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd58a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 msgr2=0x56469dd58a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd58a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/702039338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 msgr2=0x56469dd584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:25.537 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.539+0000 7fcc0ad9d700 1 -- 172.21.15.142:0/702039338 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbfc00e8f0 con 0x56469dd4b0a0 2023-09-21T13:11:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:11:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcc0ad9d700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc005ea0 tx=0x7fcbfc00e880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c55bb788ff37c7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcbeeff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:11:25.538 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbfc024d90 con 0x56469dd4b0a0 2023-09-21T13:11:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcbfc01e840 con 0x56469dd4b0a0 2023-09-21T13:11:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.540+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc04004a50 con 0x56469dd4b0a0 2023-09-21T13:11:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.541+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcbfc01ea00 con 0x56469dd4b0a0 2023-09-21T13:11:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.541+0000 7fcc24a58b80 10 client.28192 fetch_fsmap learned FSMap version 50 2023-09-21T13:11:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.541+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x56469daee1f0 con 0x56469dd4b0a0 2023-09-21T13:11:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.541+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc04004a50 con 0x56469dd4b0a0 2023-09-21T13:11:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 50) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fcbfc02a020 con 0x56469dd4b0a0 2023-09-21T13:11:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 10 client.28192 fetch_fsmap finished waiting for FSMap version 50 2023-09-21T13:11:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 10 client.28192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 20 client.28192 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469ddb92a0 0x56469ddbb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 4 client.28192 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:11:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.542+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56469dc95e00 con 0x56469ddb92a0 2023-09-21T13:11:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.543+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469ddb92a0 0x56469ddbb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.543+0000 7fcc0a59c700 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469ddb92a0 0x56469ddbb6c0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6cf0cfdab8338aa server_cookie=695bb67de2e6eebd in_seq=0 out_seq=0 2023-09-21T13:11:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.543+0000 7fcbeeff5700 10 client.28192 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.898+0000 7fcbeeff5700 1 -- 172.21.15.142:0/702039338 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56469dc95e00 con 0x56469ddb92a0 2023-09-21T13:11:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.898+0000 7fcbeeff5700 10 client.28192 handle_command_reply: tid=0 2023-09-21T13:11:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.898+0000 7fcc24a58b80 1 client.28192 shutdown 2023-09-21T13:11:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.898+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 msgr2=0x56469dd57fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.898+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc005ea0 tx=0x7fcbfc00e880 comp rx=0 tx=0).stop 2023-09-21T13:11:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 shutdown_connections 2023-09-21T13:11:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56469ddb92a0 0x56469ddbb6c0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56469dd4fe50 0x56469dd58a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56469dd4b0a0 0x56469dd57fb0 secure :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc005ea0 tx=0x7fcbfc00e880 comp rx=0 tx=0).stop 2023-09-21T13:11:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 --2- 172.21.15.142:0/702039338 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56469dd4b9c0 0x56469dd584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 >> 172.21.15.142:0/702039338 conn(0x56469dc77fa0 msgr2=0x56469dd52240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.899+0000 7fcbeeff5700 0 client.28192 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.900+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 shutdown_connections 2023-09-21T13:11:25.896 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.900+0000 7fcc24a58b80 1 -- 172.21.15.142:0/702039338 wait complete. 2023-09-21T13:11:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:11:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:11:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:11:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:11:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.905+0000 7fcc24a58b80 20 client.28192 trim_cache size 0 max 16384 2023-09-21T13:11:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.906+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 msgr2=0x7fcbf40a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.906+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 0x7fcbf40a2d30 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc005fd0 tx=0x7fcbfc005e30 comp rx=0 tx=0).stop 2023-09-21T13:11:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.906+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 msgr2=0x7fcc0c19da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.906+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000d980 tx=0x7fcc0000dd40 comp rx=0 tx=0).stop 2023-09-21T13:11:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 shutdown_connections 2023-09-21T13:11:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcbf40a0870 0x7fcbf40a2d30 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcc0c105d40 0x7fcc0c1a0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcc0c069160 0x7fcc0c19d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 --2- 172.21.15.142:0/2687552575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc0c103d00 0x7fcc0c19da80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.907+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 >> 172.21.15.142:0/2687552575 conn(0x7fcc0c076de0 msgr2=0x7fcc0c1027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.908+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 shutdown_connections 2023-09-21T13:11:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:25.908+0000 7fcc111ff700 1 -- 172.21.15.142:0/2687552575 wait complete. 2023-09-21T13:11:26.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 84225 38.78 MB/sec execute 6 sec latency 219.445 ms 2023-09-21T13:11:26.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:25 smithi156 ceph-mon[134078]: pgmap v479: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2023-09-21T13:11:26.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:25 smithi142 ceph-mon[97663]: pgmap v479: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2023-09-21T13:11:26.183 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:25 smithi160 ceph-mon[134450]: pgmap v479: 97 pgs: 97 active+clean; 946 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 9.7 MiB/s wr, 706 op/s 2023-09-21T13:11:27.033 INFO:tasks.workunit.client.0.smithi142.stdout: 10 85346 42.35 MB/sec execute 7 sec latency 111.353 ms 2023-09-21T13:11:28.034 INFO:tasks.workunit.client.0.smithi142.stdout: 10 86273 44.84 MB/sec execute 8 sec latency 35.156 ms 2023-09-21T13:11:28.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:27 smithi156 ceph-mon[134078]: pgmap v480: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-09-21T13:11:28.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:27 smithi142 ceph-mon[97663]: pgmap v480: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-09-21T13:11:28.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:27 smithi160 ceph-mon[134450]: pgmap v480: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 13 MiB/s wr, 1.04k op/s 2023-09-21T13:11:29.034 INFO:tasks.workunit.client.0.smithi142.stdout: 10 87010 42.87 MB/sec execute 9 sec latency 79.323 ms 2023-09-21T13:11:30.034 INFO:tasks.workunit.client.0.smithi142.stdout: 10 88034 43.84 MB/sec execute 10 sec latency 63.793 ms 2023-09-21T13:11:30.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:29 smithi156 ceph-mon[134078]: pgmap v481: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.8 MiB/s wr, 586 op/s 2023-09-21T13:11:30.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:29 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:30.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:29 smithi142 ceph-mon[97663]: pgmap v481: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.8 MiB/s wr, 586 op/s 2023-09-21T13:11:30.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:29 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:30.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:29 smithi160 ceph-mon[134450]: pgmap v481: 97 pgs: 97 active+clean; 973 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 6.8 MiB/s wr, 586 op/s 2023-09-21T13:11:30.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:29 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:31.034 INFO:tasks.workunit.client.0.smithi142.stdout: 10 89010 46.05 MB/sec execute 11 sec latency 77.863 ms 2023-09-21T13:11:32.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 89620 44.64 MB/sec execute 12 sec latency 54.885 ms 2023-09-21T13:11:32.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:31 smithi156 ceph-mon[134078]: pgmap v482: 97 pgs: 97 active+clean; 973 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.2 MiB/s wr, 632 op/s 2023-09-21T13:11:32.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:31 smithi142 ceph-mon[97663]: pgmap v482: 97 pgs: 97 active+clean; 973 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.2 MiB/s wr, 632 op/s 2023-09-21T13:11:32.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:31 smithi160 ceph-mon[134450]: pgmap v482: 97 pgs: 97 active+clean; 973 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 7.2 MiB/s wr, 632 op/s 2023-09-21T13:11:33.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 90391 43.68 MB/sec execute 13 sec latency 37.746 ms 2023-09-21T13:11:34.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 91488 44.31 MB/sec execute 14 sec latency 105.609 ms 2023-09-21T13:11:34.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:33 smithi156 ceph-mon[134078]: pgmap v483: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2023-09-21T13:11:34.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:33 smithi142 ceph-mon[97663]: pgmap v483: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2023-09-21T13:11:34.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:33 smithi160 ceph-mon[134450]: pgmap v483: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 9.6 MiB/s wr, 823 op/s 2023-09-21T13:11:35.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 92556 46.48 MB/sec execute 15 sec latency 73.694 ms 2023-09-21T13:11:36.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 93125 45.19 MB/sec execute 16 sec latency 42.742 ms 2023-09-21T13:11:36.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:35 smithi156 ceph-mon[134078]: pgmap v484: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-09-21T13:11:36.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:35 smithi142 ceph-mon[97663]: pgmap v484: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-09-21T13:11:36.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:35 smithi160 ceph-mon[134450]: pgmap v484: 97 pgs: 97 active+clean; 977 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 5.9 MiB/s wr, 587 op/s 2023-09-21T13:11:37.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 93980 44.72 MB/sec execute 17 sec latency 57.251 ms 2023-09-21T13:11:38.035 INFO:tasks.workunit.client.0.smithi142.stdout: 10 95197 45.76 MB/sec execute 18 sec latency 45.974 ms 2023-09-21T13:11:38.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:37 smithi156 ceph-mon[134078]: pgmap v485: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 805 op/s 2023-09-21T13:11:38.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:37 smithi142 ceph-mon[97663]: pgmap v485: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 805 op/s 2023-09-21T13:11:38.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:37 smithi160 ceph-mon[134450]: pgmap v485: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 8.8 MiB/s wr, 805 op/s 2023-09-21T13:11:39.036 INFO:tasks.workunit.client.0.smithi142.stdout: 10 96131 47.10 MB/sec execute 19 sec latency 77.349 ms 2023-09-21T13:11:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 -- 172.21.15.142:0/2240973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 msgr2=0x7f017010fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.223 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 --2- 172.21.15.142:0/2240973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f017010fb00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0168009f90 tx=0x7f016800b330 comp rx=0 tx=0).stop 2023-09-21T13:11:39.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 -- 172.21.15.142:0/2240973789 shutdown_connections 2023-09-21T13:11:39.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 --2- 172.21.15.142:0/2240973789 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f017010fb00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 --2- 172.21.15.142:0/2240973789 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f01700ffb60 0x7f01700fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.224 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 --2- 172.21.15.142:0/2240973789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f017010d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.230+0000 7f01753ff700 1 -- 172.21.15.142:0/2240973789 >> 172.21.15.142:0/2240973789 conn(0x7f01700fb7c0 msgr2=0x7f01700fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.232+0000 7f01753ff700 1 -- 172.21.15.142:0/2240973789 shutdown_connections 2023-09-21T13:11:39.226 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.233+0000 7f01753ff700 1 -- 172.21.15.142:0/2240973789 wait complete. 2023-09-21T13:11:39.229 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.235+0000 7f01753ff700 1 Processor -- start 2023-09-21T13:11:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.236+0000 7f01753ff700 1 -- start start 2023-09-21T13:11:39.230 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f0170103910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f0170103e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01701097d0 con 0x7f017010d710 2023-09-21T13:11:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170109940 con 0x7f0170108e10 2023-09-21T13:11:39.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.237+0000 7f01753ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0170109b00 con 0x7f0170100510 2023-09-21T13:11:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.238+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.238+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39292/0 (socket says 172.21.15.142:39292) 2023-09-21T13:11:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.238+0000 7f016f7fe700 1 -- 172.21.15.142:0/3342152145 learned_addr learned my addr 172.21.15.142:0/3342152145 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:39.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.238+0000 7f016effd700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f0170103910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.239+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f0170103e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.239+0000 7f016f7fe700 1 -- 172.21.15.142:0/3342152145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 msgr2=0x7f0170103910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016f7fe700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f0170103910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016f7fe700 1 -- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 msgr2=0x7f0170103e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016f7fe700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f0170103e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.234 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016f7fe700 1 -- 172.21.15.142:0/3342152145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168009c40 con 0x7f0170108e10 2023-09-21T13:11:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016effd700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f0170103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:11:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.240+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f0170103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:11:39.235 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.241+0000 7f016f7fe700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0168009af0 tx=0x7f016800bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.244+0000 7f0157fff700 1 -- 172.21.15.142:0/3342152145 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800e040 con 0x7f0170108e10 2023-09-21T13:11:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.244+0000 7f0157fff700 1 -- 172.21.15.142:0/3342152145 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0168004e90 con 0x7f0170108e10 2023-09-21T13:11:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.245+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017010bf00 con 0x7f0170108e10 2023-09-21T13:11:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.245+0000 7f0157fff700 1 -- 172.21.15.142:0/3342152145 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016801b6c0 con 0x7f0170108e10 2023-09-21T13:11:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.245+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017010c3b0 con 0x7f0170108e10 2023-09-21T13:11:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.251+0000 7f0188ca6b80 1 Processor -- start 2023-09-21T13:11:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.255+0000 7f0157fff700 1 -- 172.21.15.142:0/3342152145 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f016801d470 con 0x7f0170108e10 2023-09-21T13:11:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.255+0000 7f0188ca6b80 1 -- start start 2023-09-21T13:11:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761120f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x5576112142b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611183c40 con 0x55761120f0a0 2023-09-21T13:11:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611167c10 con 0x55761120f9c0 2023-09-21T13:11:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.256+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611165530 con 0x557611213e50 2023-09-21T13:11:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.257+0000 7f016effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.257+0000 7f016effd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39308/0 (socket says 172.21.15.142:39308) 2023-09-21T13:11:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.257+0000 7f016effd700 1 -- 172.21.15.142:0/293182904 learned_addr learned my addr 172.21.15.142:0/293182904 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:39.251 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016e7fc700 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x5576112142b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f0157fff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 0x7f01580a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016effd700 1 -- 172.21.15.142:0/293182904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 msgr2=0x5576112142b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.252 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016effd700 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x5576112142b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016effd700 1 -- 172.21.15.142:0/293182904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 msgr2=0x55761120f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016effd700 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761120f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f0157fff700 1 -- 172.21.15.142:0/3342152145 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f01680cce10 con 0x7f0170108e10 2023-09-21T13:11:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.258+0000 7f016effd700 1 -- 172.21.15.142:0/293182904 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557610f8bd80 con 0x55761120f9c0 2023-09-21T13:11:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.259+0000 7f016effd700 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e10 tx=0x7f016000e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861a2e4d29451e5b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.260+0000 7f016f7fe700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 0x7f01580a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.261+0000 7f016f7fe700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 0x7f01580a2e00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01680ca560 tx=0x7f01680a0040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.263+0000 7f01557fa700 1 -- 172.21.15.142:0/293182904 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160009960 con 0x55761120f9c0 2023-09-21T13:11:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.263+0000 7f01557fa700 1 -- 172.21.15.142:0/293182904 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f016000ec20 con 0x55761120f9c0 2023-09-21T13:11:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.263+0000 7f01557fa700 1 -- 172.21.15.142:0/293182904 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01600126c0 con 0x55761120f9c0 2023-09-21T13:11:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.264+0000 7f0188ca6b80 1 -- 172.21.15.142:0/293182904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 msgr2=0x557611213910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.264+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0160009e10 tx=0x7f016000e4b0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.265+0000 7f0188ca6b80 1 -- 172.21.15.142:0/293182904 shutdown_connections 2023-09-21T13:11:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.265+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761120f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.265+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x5576112142b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.265+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/293182904 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611213910 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.259 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.265+0000 7f0188ca6b80 1 -- 172.21.15.142:0/293182904 >> 172.21.15.142:0/293182904 conn(0x55761113bfa0 msgr2=0x55761120a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.261 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.268+0000 7f0188ca6b80 1 -- 172.21.15.142:0/293182904 shutdown_connections 2023-09-21T13:11:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.268+0000 7f0188ca6b80 1 -- 172.21.15.142:0/293182904 wait complete. 2023-09-21T13:11:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.269+0000 7f0188ca6b80 1 -- start start 2023-09-21T13:11:39.262 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.269+0000 7f0188ca6b80 1 Processor -- start 2023-09-21T13:11:39.263 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f9c0 0x557611218870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x557611218ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611160e20 con 0x55761120f9c0 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576110fd6e0 con 0x55761120f0a0 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5576110fd380 con 0x557611213e50 2023-09-21T13:11:39.264 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.270+0000 7f0188ca6b80 10 client.0 _ll_register_callbacks cb 0x557611047a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.271+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.271+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:39314/0 (socket says 172.21.15.142:39314) 2023-09-21T13:11:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.271+0000 7f016e7fc700 1 -- 172.21.15.142:0/3948250908 learned_addr learned my addr 172.21.15.142:0/3948250908 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:39.265 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.271+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x557611218ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.272+0000 7f016e7fc700 1 -- 172.21.15.142:0/3948250908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 msgr2=0x557611218ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.266 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.272+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x557611218ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.272+0000 7f016e7fc700 1 -- 172.21.15.142:0/3948250908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f9c0 msgr2=0x557611218870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:11:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.272+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f9c0 0x557611218870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.272+0000 7f016e7fc700 1 -- 172.21.15.142:0/3948250908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0160009ac0 con 0x55761120f0a0 2023-09-21T13:11:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.273+0000 7f016e7fc700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f016400f8f0 tx=0x7f0164004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efb8e99ceb0ba02 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.267 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.273+0000 7f0152ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.273+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164004a30 con 0x55761120f0a0 2023-09-21T13:11:39.268 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.273+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0164004b90 con 0x55761120f0a0 2023-09-21T13:11:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.275+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5576110d1b50 con 0x55761120f0a0 2023-09-21T13:11:39.269 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.276+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0164004d50 con 0x55761120f0a0 2023-09-21T13:11:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.277+0000 7f0188ca6b80 10 client.28271 fetch_fsmap learned FSMap version 51 2023-09-21T13:11:39.270 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.277+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x557610f74c00 con 0x55761120f0a0 2023-09-21T13:11:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.281+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5576110d1b50 con 0x55761120f0a0 2023-09-21T13:11:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.281+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 51) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f016400e810 con 0x55761120f0a0 2023-09-21T13:11:39.279 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 10 client.28271 fetch_fsmap finished waiting for FSMap version 51 2023-09-21T13:11:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 10 client.28271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 20 client.28271 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576112290f0 0x55761122b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 4 client.28271 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:39.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.286+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5576111ddfc0 con 0x5576112290f0 2023-09-21T13:11:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.290+0000 7f016effd700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576112290f0 0x55761122b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.295+0000 7f016effd700 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576112290f0 0x55761122b510 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ca947c128a88a8d server_cookie=a2d3812d4c401237 in_seq=0 out_seq=0 2023-09-21T13:11:39.288 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.295+0000 7f0152ff5700 10 client.28271 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:39.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.297+0000 7f0152ff5700 1 -- 172.21.15.142:0/3948250908 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5576111ddfc0 con 0x5576112290f0 2023-09-21T13:11:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.297+0000 7f0152ff5700 10 client.28271 handle_command_reply: tid=0 2023-09-21T13:11:39.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.298+0000 7f0188ca6b80 1 client.28271 shutdown 2023-09-21T13:11:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.303+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 msgr2=0x55761121b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.303+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f016400f8f0 tx=0x7f0164004750 comp rx=0 tx=0).stop 2023-09-21T13:11:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 shutdown_connections 2023-09-21T13:11:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5576112290f0 0x55761122b510 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x557611218ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f0a0 0x55761121b5f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/3948250908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f9c0 0x557611218870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.306+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 >> 172.21.15.142:0/3948250908 conn(0x55761113bfa0 msgr2=0x557611209c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.307+0000 7f0152ff5700 0 client.28271 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.309+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 shutdown_connections 2023-09-21T13:11:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.309+0000 7f0188ca6b80 1 -- 172.21.15.142:0/3948250908 wait complete. 2023-09-21T13:11:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.312+0000 7f0188ca6b80 20 client.28271 trim_cache size 0 max 16384 2023-09-21T13:11:39.336 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.343+0000 7f0188ca6b80 1 Processor -- start 2023-09-21T13:11:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 -- start start 2023-09-21T13:11:39.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x557611211740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611218090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x55761121b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557610fe18c0 con 0x55761120f0a0 2023-09-21T13:11:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611219870 con 0x55761120f9c0 2023-09-21T13:11:39.338 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.344+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611210160 con 0x557611213e50 2023-09-21T13:11:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.345+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x55761121b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.345+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x55761121b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33074/0 (socket says 172.21.15.142:33074) 2023-09-21T13:11:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.345+0000 7f016e7fc700 1 -- 172.21.15.142:0/288866505 learned_addr learned my addr 172.21.15.142:0/288866505 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:39.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.345+0000 7f016e7fc700 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x557611211740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.340 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611218090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 -- 172.21.15.142:0/288866505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 msgr2=0x55761121b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x55761121b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 -- 172.21.15.142:0/288866505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 msgr2=0x557611211740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x557611211740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 -- 172.21.15.142:0/288866505 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557611230100 con 0x55761120f9c0 2023-09-21T13:11:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.346+0000 7f016effd700 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611218090 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f016000e800 tx=0x7f0160013dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8540add11da685a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.347+0000 7f0155ffb700 1 -- 172.21.15.142:0/288866505 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160022040 con 0x55761120f9c0 2023-09-21T13:11:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.347+0000 7f0155ffb700 1 -- 172.21.15.142:0/288866505 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01600265b0 con 0x55761120f9c0 2023-09-21T13:11:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.348+0000 7f0155ffb700 1 -- 172.21.15.142:0/288866505 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160026730 con 0x55761120f9c0 2023-09-21T13:11:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.348+0000 7f0188ca6b80 1 -- 172.21.15.142:0/288866505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 msgr2=0x557611218090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.348+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611218090 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f016000e800 tx=0x7f0160013dd0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.349+0000 7f0188ca6b80 1 -- 172.21.15.142:0/288866505 shutdown_connections 2023-09-21T13:11:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.349+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x557611211740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.349+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557611213e50 0x55761121b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.349+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/288866505 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55761120f9c0 0x557611218090 secure :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f016000e800 tx=0x7f0160013dd0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.349+0000 7f0188ca6b80 1 -- 172.21.15.142:0/288866505 >> 172.21.15.142:0/288866505 conn(0x55761113bfa0 msgr2=0x557611216240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.352+0000 7f0188ca6b80 1 -- 172.21.15.142:0/288866505 shutdown_connections 2023-09-21T13:11:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.352+0000 7f0188ca6b80 1 -- 172.21.15.142:0/288866505 wait complete. 2023-09-21T13:11:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.352+0000 7f0188ca6b80 1 -- start start 2023-09-21T13:11:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.353+0000 7f0188ca6b80 1 Processor -- start 2023-09-21T13:11:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761121ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 0x55761121e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 0x55761121ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557611220620 con 0x55761120f0a0 2023-09-21T13:11:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761127cef0 con 0x557611213e50 2023-09-21T13:11:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55761127d0b0 con 0x55761121e9a0 2023-09-21T13:11:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f0188ca6b80 10 client.0 _ll_register_callbacks cb 0x557611047a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 0x55761121ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f016e7fc700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 0x55761121ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:33076/0 (socket says 172.21.15.142:33076) 2023-09-21T13:11:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.354+0000 7f016e7fc700 1 -- 172.21.15.142:0/680733703 learned_addr learned my addr 172.21.15.142:0/680733703 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 0x55761121e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 -- 172.21.15.142:0/680733703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 msgr2=0x55761121ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 0x55761121ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 -- 172.21.15.142:0/680733703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 msgr2=0x55761121ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761121ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.355+0000 7f016effd700 1 -- 172.21.15.142:0/680733703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557610f8bd80 con 0x557611213e50 2023-09-21T13:11:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.356+0000 7f016effd700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 0x55761121e460 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x557611225090 tx=0x7f0160013470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb70bd077f78810 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.356+0000 7f0152ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.359+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0160022070 con 0x557611213e50 2023-09-21T13:11:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.359+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0160000e40 con 0x557611213e50 2023-09-21T13:11:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.360+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557611159e00 con 0x557611213e50 2023-09-21T13:11:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.361+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0160013ae0 con 0x557611213e50 2023-09-21T13:11:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.361+0000 7f0188ca6b80 10 client.28277 fetch_fsmap learned FSMap version 51 2023-09-21T13:11:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.361+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x557610fb21f0 con 0x557611213e50 2023-09-21T13:11:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557611159e00 con 0x557611213e50 2023-09-21T13:11:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 51) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0160025070 con 0x557611213e50 2023-09-21T13:11:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 10 client.28277 fetch_fsmap finished waiting for FSMap version 51 2023-09-21T13:11:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 10 client.28277 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 20 client.28277 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55761127e2f0 0x557611280710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 4 client.28277 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:11:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.363+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557611159b20 con 0x55761127e2f0 2023-09-21T13:11:39.358 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.364+0000 7f016e7fc700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55761127e2f0 0x557611280710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.369+0000 7f016e7fc700 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55761127e2f0 0x557611280710 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=805f4bda5f5eca3c server_cookie=5524b5aee5966f85 in_seq=0 out_seq=0 2023-09-21T13:11:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.369+0000 7f0152ff5700 10 client.28277 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.778+0000 7f0152ff5700 1 -- 172.21.15.142:0/680733703 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557611159b20 con 0x55761127e2f0 2023-09-21T13:11:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.778+0000 7f0152ff5700 10 client.28277 handle_command_reply: tid=0 2023-09-21T13:11:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.778+0000 7f0188ca6b80 1 client.28277 shutdown 2023-09-21T13:11:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.779+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 msgr2=0x55761121e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.772 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.779+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 0x55761121e460 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x557611225090 tx=0x7f0160013470 comp rx=0 tx=0).stop 2023-09-21T13:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 shutdown_connections 2023-09-21T13:11:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55761127e2f0 0x557611280710 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55761120f0a0 0x55761121ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55761121e9a0 0x55761121ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 --2- 172.21.15.142:0/680733703 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557611213e50 0x55761121e460 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 >> 172.21.15.142:0/680733703 conn(0x55761113bfa0 msgr2=0x557611212ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.782+0000 7f0152ff5700 0 client.28277 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.784+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 shutdown_connections 2023-09-21T13:11:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.786+0000 7f0188ca6b80 1 -- 172.21.15.142:0/680733703 wait complete. 2023-09-21T13:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.787+0000 7f0188ca6b80 20 client.28277 trim_cache size 0 max 16384 2023-09-21T13:11:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:11:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 msgr2=0x7f01580a2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 0x7f01580a2e00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01680ca560 tx=0x7f01680a0040 comp rx=0 tx=0).stop 2023-09-21T13:11:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 msgr2=0x7f0170109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0168009af0 tx=0x7f016800bc20 comp rx=0 tx=0).stop 2023-09-21T13:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 shutdown_connections 2023-09-21T13:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f01580a0940 0x7f01580a2e00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0170108e10 0x7f0170109290 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0170100510 0x7f0170103910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 --2- 172.21.15.142:0/3342152145 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f017010d710 0x7f0170103e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 >> 172.21.15.142:0/3342152145 conn(0x7f01700fb7c0 msgr2=0x7f017010ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.788+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 shutdown_connections 2023-09-21T13:11:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:39.789+0000 7f01753ff700 1 -- 172.21.15.142:0/3342152145 wait complete. 2023-09-21T13:11:40.038 INFO:tasks.workunit.client.0.smithi142.stdout: 10 96449 45.12 MB/sec execute 20 sec latency 269.070 ms 2023-09-21T13:11:40.155 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:39 smithi156 ceph-mon[134078]: pgmap v486: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2023-09-21T13:11:40.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:39 smithi160 ceph-mon[134450]: pgmap v486: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2023-09-21T13:11:41.044 INFO:tasks.workunit.client.0.smithi142.stdout: 10 96482 43.12 MB/sec execute 21 sec latency 987.955 ms 2023-09-21T13:11:41.437 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:39 smithi142 ceph-mon[97663]: pgmap v486: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 6.0 MiB/s wr, 466 op/s 2023-09-21T13:11:42.042 INFO:tasks.workunit.client.0.smithi142.stdout: 10 96501 41.17 MB/sec execute 22 sec latency 1325.476 ms 2023-09-21T13:11:42.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:41 smithi156 ceph-mon[134078]: pgmap v487: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-09-21T13:11:42.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:41 smithi142 ceph-mon[97663]: pgmap v487: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-09-21T13:11:42.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:41 smithi160 ceph-mon[134450]: pgmap v487: 97 pgs: 97 active+clean; 1009 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 MiB/s rd, 5.9 MiB/s wr, 466 op/s 2023-09-21T13:11:43.042 INFO:tasks.workunit.client.0.smithi142.stdout: 10 96644 39.69 MB/sec execute 23 sec latency 1206.944 ms 2023-09-21T13:11:44.042 INFO:tasks.workunit.client.0.smithi142.stdout: 10 97044 38.62 MB/sec execute 24 sec latency 1241.248 ms 2023-09-21T13:11:44.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:43 smithi156 ceph-mon[134078]: pgmap v488: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 21 MiB/s wr, 976 op/s 2023-09-21T13:11:44.163 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:43 smithi142 ceph-mon[97663]: pgmap v488: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 21 MiB/s wr, 976 op/s 2023-09-21T13:11:44.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:43 smithi160 ceph-mon[134450]: pgmap v488: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 21 MiB/s wr, 976 op/s 2023-09-21T13:11:45.046 INFO:tasks.workunit.client.0.smithi142.stdout: 10 97593 38.20 MB/sec execute 25 sec latency 156.453 ms 2023-09-21T13:11:46.046 INFO:tasks.workunit.client.0.smithi142.stdout: 10 98625 38.76 MB/sec execute 26 sec latency 101.532 ms 2023-09-21T13:11:46.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:45 smithi156 ceph-mon[134078]: pgmap v489: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 19 MiB/s wr, 775 op/s 2023-09-21T13:11:46.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:45 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:11:46.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:45 smithi142 ceph-mon[97663]: pgmap v489: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 19 MiB/s wr, 775 op/s 2023-09-21T13:11:46.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:45 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:11:46.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:45 smithi160 ceph-mon[134450]: pgmap v489: 97 pgs: 97 active+clean; 1.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 MiB/s rd, 19 MiB/s wr, 775 op/s 2023-09-21T13:11:46.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:45 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:11:47.046 INFO:tasks.workunit.client.0.smithi142.stdout: 10 99488 39.51 MB/sec execute 27 sec latency 89.385 ms 2023-09-21T13:11:48.046 INFO:tasks.workunit.client.0.smithi142.stdout: 10 100194 39.25 MB/sec execute 28 sec latency 149.195 ms 2023-09-21T13:11:48.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:47 smithi156 ceph-mon[134078]: pgmap v490: 97 pgs: 97 active+clean; 1017 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 27 MiB/s wr, 1.25k op/s 2023-09-21T13:11:48.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:47 smithi142 ceph-mon[97663]: pgmap v490: 97 pgs: 97 active+clean; 1017 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 27 MiB/s wr, 1.25k op/s 2023-09-21T13:11:48.186 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:47 smithi160 ceph-mon[134450]: pgmap v490: 97 pgs: 97 active+clean; 1017 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 27 MiB/s wr, 1.25k op/s 2023-09-21T13:11:49.047 INFO:tasks.workunit.client.0.smithi142.stdout: 10 100491 38.39 MB/sec execute 29 sec latency 320.979 ms 2023-09-21T13:11:50.048 INFO:tasks.workunit.client.0.smithi142.stdout: 10 101208 38.50 MB/sec execute 30 sec latency 93.405 ms 2023-09-21T13:11:50.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:49 smithi156 ceph-mon[134078]: pgmap v491: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2023-09-21T13:11:50.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:49 smithi142 ceph-mon[97663]: pgmap v491: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2023-09-21T13:11:50.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:49 smithi160 ceph-mon[134450]: pgmap v491: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 25 MiB/s wr, 1.09k op/s 2023-09-21T13:11:51.047 INFO:tasks.workunit.client.0.smithi142.stdout: 10 102006 38.32 MB/sec execute 31 sec latency 119.170 ms 2023-09-21T13:11:51.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:50 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:11:51.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:50 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:11:51.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:50 smithi156 ceph-mon[134078]: pgmap v492: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2023-09-21T13:11:51.149 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:50 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:11:51.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:50 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:11:51.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:50 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:11:51.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:50 smithi142 ceph-mon[97663]: pgmap v492: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2023-09-21T13:11:51.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:50 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:11:51.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:50 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:11:51.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:50 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:11:51.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:50 smithi160 ceph-mon[134450]: pgmap v492: 97 pgs: 97 active+clean; 1004 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 26 MiB/s wr, 1.16k op/s 2023-09-21T13:11:51.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:50 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:11:52.019 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:11:52.047 INFO:tasks.workunit.client.0.smithi142.stdout: 10 102847 39.12 MB/sec execute 32 sec latency 72.452 ms 2023-09-21T13:11:52.152 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:51 smithi156 ceph-mon[134078]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-09-21T13:11:52.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:51 smithi142 ceph-mon[97663]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-09-21T13:11:52.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:51 smithi160 ceph-mon[134450]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-09-21T13:11:53.047 INFO:tasks.workunit.client.0.smithi142.stdout: 10 103262 38.56 MB/sec execute 33 sec latency 402.710 ms 2023-09-21T13:11:53.151 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:52 smithi156 ceph-mon[134078]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 34 MiB/s wr, 1.50k op/s 2023-09-21T13:11:53.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:52 smithi142 ceph-mon[97663]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 34 MiB/s wr, 1.50k op/s 2023-09-21T13:11:53.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:52 smithi160 ceph-mon[134450]: pgmap v493: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 34 MiB/s wr, 1.50k op/s 2023-09-21T13:11:54.047 INFO:tasks.workunit.client.0.smithi142.stdout: 10 103823 38.14 MB/sec execute 34 sec latency 82.566 ms 2023-09-21T13:11:55.048 INFO:tasks.workunit.client.0.smithi142.stdout: 10 104596 38.16 MB/sec execute 35 sec latency 117.484 ms 2023-09-21T13:11:55.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:55 smithi156 ceph-mon[134078]: pgmap v494: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 904 op/s 2023-09-21T13:11:55.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:55 smithi142 ceph-mon[97663]: pgmap v494: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 904 op/s 2023-09-21T13:11:55.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:55 smithi160 ceph-mon[134450]: pgmap v494: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 904 op/s 2023-09-21T13:11:55.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.648+0000 7f44ddfff700 1 -- 172.21.15.142:0/364822479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 msgr2=0x7f44d8073520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.648+0000 7f44ddfff700 1 --2- 172.21.15.142:0/364822479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d8073520 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f44c8009990 tx=0x7f44c8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 -- 172.21.15.142:0/364822479 shutdown_connections 2023-09-21T13:11:55.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 --2- 172.21.15.142:0/364822479 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d8104c30 0x7f44d8113e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 --2- 172.21.15.142:0/364822479 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d8073520 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 --2- 172.21.15.142:0/364822479 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8073af0 0x7f44d8111870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 -- 172.21.15.142:0/364822479 >> 172.21.15.142:0/364822479 conn(0x7f44d80fc850 msgr2=0x7f44d80fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 -- 172.21.15.142:0/364822479 shutdown_connections 2023-09-21T13:11:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 -- 172.21.15.142:0/2471615489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c068b90 msgr2=0x7f451c10dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 --2- 172.21.15.142:0/2471615489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c068b90 0x7f451c10dc30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4514009fc0 tx=0x7f451400b330 comp rx=0 tx=0).stop 2023-09-21T13:11:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 -- 172.21.15.142:0/2471615489 shutdown_connections 2023-09-21T13:11:55.645 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 --2- 172.21.15.142:0/2471615489 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c106140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 --2- 172.21.15.142:0/2471615489 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c068b90 0x7f451c10dc30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 --2- 172.21.15.142:0/2471615489 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f451c0681d0 0x7f451c068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.646 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.651+0000 7f4520fff700 1 -- 172.21.15.142:0/2471615489 >> 172.21.15.142:0/2471615489 conn(0x7f451c076800 msgr2=0x7f451c076c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.650+0000 7f44ddfff700 1 -- 172.21.15.142:0/364822479 wait complete. 2023-09-21T13:11:55.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 Processor -- start 2023-09-21T13:11:55.647 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f4520fff700 1 -- 172.21.15.142:0/2471615489 shutdown_connections 2023-09-21T13:11:55.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 -- start start 2023-09-21T13:11:55.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8073af0 0x7f44d806b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 0x7f44d81b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81b23a0 con 0x7f44d8073af0 2023-09-21T13:11:55.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81b2510 con 0x7f44d81af970 2023-09-21T13:11:55.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f44ddfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d81b26d0 con 0x7f44d8073140 2023-09-21T13:11:55.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39450/0 (socket says 172.21.15.142:39450) 2023-09-21T13:11:55.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 -- 172.21.15.142:0/2074290008 learned_addr learned my addr 172.21.15.142:0/2074290008 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d7fff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 0x7f44d81b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 -- 172.21.15.142:0/2074290008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 msgr2=0x7f44d81b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 0x7f44d81b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f44d77fe700 1 -- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8073af0 msgr2=0x7f44d806b820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-21T13:11:55.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.654+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8073af0 0x7f44d806b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.654+0000 7f44d77fe700 1 -- 172.21.15.142:0/2074290008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80095f0 con 0x7f44d8073140 2023-09-21T13:11:55.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.654+0000 7f44d7fff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 0x7f44d81b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:11:55.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.654+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005910 tx=0x7f44c80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.654+0000 7f44d4ff9700 1 -- 172.21.15.142:0/2074290008 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c801d070 con 0x7f44d8073140 2023-09-21T13:11:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.655+0000 7f44d4ff9700 1 -- 172.21.15.142:0/2074290008 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44c8022470 con 0x7f44d8073140 2023-09-21T13:11:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.655+0000 7f44d4ff9700 1 -- 172.21.15.142:0/2074290008 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c8017650 con 0x7f44d8073140 2023-09-21T13:11:55.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.655+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d81b2950 con 0x7f44d8073140 2023-09-21T13:11:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.652+0000 7f4520fff700 1 -- 172.21.15.142:0/2471615489 wait complete. 2023-09-21T13:11:55.654 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.653+0000 7f4520fff700 1 Processor -- start 2023-09-21T13:11:55.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d81b2d20 con 0x7f44d8073140 2023-09-21T13:11:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 -- start start 2023-09-21T13:11:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f451c068b90 0x7f451c19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1954a0 con 0x7f451c105d60 2023-09-21T13:11:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c195610 con 0x7f451c0681d0 2023-09-21T13:11:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f4520fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451c1957d0 con 0x7f451c068b90 2023-09-21T13:11:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.656+0000 7f451a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50412/0 (socket says 172.21.15.142:50412) 2023-09-21T13:11:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 -- 172.21.15.142:0/3380138774 learned_addr learned my addr 172.21.15.142:0/3380138774 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 -- 172.21.15.142:0/3380138774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f451c068b90 msgr2=0x7f451c19c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f451c068b90 0x7f451c19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 -- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 msgr2=0x7f451c194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c194cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451a59c700 1 -- 172.21.15.142:0/3380138774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f450c009520 con 0x7f451c0681d0 2023-09-21T13:11:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.657+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:11:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.658+0000 7f451a59c700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f450400e9f0 tx=0x7f450400edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.659 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.659+0000 7f45137fe700 1 -- 172.21.15.142:0/3380138774 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450400cbd0 con 0x7f451c0681d0 2023-09-21T13:11:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.660+0000 7f45137fe700 1 -- 172.21.15.142:0/3380138774 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f450400cd30 con 0x7f451c0681d0 2023-09-21T13:11:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.660+0000 7f45137fe700 1 -- 172.21.15.142:0/3380138774 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040056c0 con 0x7f451c0681d0 2023-09-21T13:11:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.660+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4514009c40 con 0x7f451c0681d0 2023-09-21T13:11:55.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.660+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451c199b80 con 0x7f451c0681d0 2023-09-21T13:11:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.663+0000 7f44f19cfb80 1 Processor -- start 2023-09-21T13:11:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.663+0000 7f44d4ff9700 1 -- 172.21.15.142:0/2074290008 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f44c80225e0 con 0x7f44d8073140 2023-09-21T13:11:55.661 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.663+0000 7f44f19cfb80 1 -- start start 2023-09-21T13:11:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfdb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.662 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5df4fca0 con 0x55ed5dfdb610 2023-09-21T13:11:55.663 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5df33c70 con 0x55ed5dfe0360 2023-09-21T13:11:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.664+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5df31590 con 0x55ed5dfdbf30 2023-09-21T13:11:55.664 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.666+0000 7f44d4ff9700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 0x7f44c00a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.666+0000 7f45348d8b80 1 Processor -- start 2023-09-21T13:11:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.666+0000 7f44d4ff9700 1 -- 172.21.15.142:0/2074290008 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f44c80ccf90 con 0x7f44d8073140 2023-09-21T13:11:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39472/0 (socket says 172.21.15.142:39472) 2023-09-21T13:11:55.666 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 -- 172.21.15.142:0/3978765201 learned_addr learned my addr 172.21.15.142:0/3978765201 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 -- 172.21.15.142:0/3978765201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 msgr2=0x55ed5dfe07c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:11:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe07c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 -- 172.21.15.142:0/3978765201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 msgr2=0x55ed5dfdb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfdb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.667 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.667+0000 7f44d77fe700 1 -- 172.21.15.142:0/3978765201 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed5dd57de0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f44d7fff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 0x7f44c00a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f44d77fe700 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005f50 tx=0x7f44c809a3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=279ba17c169fcdc5 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f44bdffb700 1 -- 172.21.15.142:0/3978765201 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c809ac90 con 0x55ed5dfdbf30 2023-09-21T13:11:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f44bdffb700 1 -- 172.21.15.142:0/3978765201 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44c809a590 con 0x55ed5dfdbf30 2023-09-21T13:11:55.668 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f44bdffb700 1 -- 172.21.15.142:0/3978765201 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c809a7f0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.668+0000 7f45137fe700 1 -- 172.21.15.142:0/3380138774 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4504004750 con 0x7f451c0681d0 2023-09-21T13:11:55.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 -- start start 2023-09-21T13:11:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f44f19cfb80 1 -- 172.21.15.142:0/3978765201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 msgr2=0x55ed5dfdfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f44d7fff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 0x7f44c00a2d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44d000f4b0 tx=0x7f44d000d040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.670 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005f50 tx=0x7f44c809a3e0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5836480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c57aac40 con 0x5561c583ae50 2023-09-21T13:11:55.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c578ec10 con 0x5561c58369c0 2023-09-21T13:11:55.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.669+0000 7f45348d8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c578c530 con 0x5561c58360a0 2023-09-21T13:11:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f44f19cfb80 1 -- 172.21.15.142:0/3978765201 shutdown_connections 2023-09-21T13:11:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfdb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.672 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/3978765201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfdfe20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f44f19cfb80 1 -- 172.21.15.142:0/3978765201 >> 172.21.15.142:0/3978765201 conn(0x55ed5df08000 msgr2=0x55ed5dfd66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.673 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f44f19cfb80 1 -- 172.21.15.142:0/3978765201 shutdown_connections 2023-09-21T13:11:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f4513fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f4513fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40590/0 (socket says 172.21.15.142:40590) 2023-09-21T13:11:55.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f4513fff700 1 -- 172.21.15.142:0/4266964937 learned_addr learned my addr 172.21.15.142:0/4266964937 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.670+0000 7f451a59c700 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 -- 172.21.15.142:0/4266964937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 msgr2=0x5561c5836480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:11:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5836480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 -- 172.21.15.142:0/4266964937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 msgr2=0x5561c583a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 -- 172.21.15.142:0/4266964937 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561c55b2d80 con 0x5561c583ae50 2023-09-21T13:11:55.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.671+0000 7f4513fff700 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d40 tx=0x7f450c00e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6081a8e43f26732 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.676 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.673+0000 7f44f19cfb80 1 -- 172.21.15.142:0/3978765201 wait complete. 2023-09-21T13:11:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.673+0000 7f44f19cfb80 1 -- start start 2023-09-21T13:11:55.677 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f44f19cfb80 1 Processor -- start 2023-09-21T13:11:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f4510ff9700 1 -- 172.21.15.142:0/4266964937 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c00ee40 con 0x5561c583ae50 2023-09-21T13:11:55.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f45137fe700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 0x7f45080a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f4510ff9700 1 -- 172.21.15.142:0/4266964937 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f450c009e90 con 0x5561c583ae50 2023-09-21T13:11:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f4510ff9700 1 -- 172.21.15.142:0/4266964937 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f450c018840 con 0x5561c583ae50 2023-09-21T13:11:55.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.674+0000 7f45137fe700 1 -- 172.21.15.142:0/3380138774 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4504014070 con 0x7f451c0681d0 2023-09-21T13:11:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdb610 0x55ed5dfe7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5df2ce80 con 0x55ed5dfe0360 2023-09-21T13:11:55.679 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dec9740 con 0x55ed5dfdbf30 2023-09-21T13:11:55.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dec93e0 con 0x55ed5dfdb610 2023-09-21T13:11:55.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44f19cfb80 10 client.0 _ll_register_callbacks cb 0x55ed5de13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:55.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44d6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44d6ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50446/0 (socket says 172.21.15.142:50446) 2023-09-21T13:11:55.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.675+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2547573368 learned_addr learned my addr 172.21.15.142:0/2547573368 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.676+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2547573368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdb610 msgr2=0x55ed5dfe7b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:11:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.676+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdb610 0x55ed5dfe7b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.676+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2547573368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfe0360 msgr2=0x55ed5dfe5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.676+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.676+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2547573368 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d81b2d20 con 0x55ed5dfdbf30 2023-09-21T13:11:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.677+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 0x7f45080a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.677+0000 7f45348d8b80 1 -- 172.21.15.142:0/4266964937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 msgr2=0x5561c583b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.677+0000 7f45348d8b80 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f450c009d40 tx=0x7f450c00e630 comp rx=0 tx=0).stop 2023-09-21T13:11:55.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.677+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00e5d0 tx=0x7f44cc00e990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d57a94556f7eb87 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.677+0000 7f44b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:11:55.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc0097c0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f44cc014070 con 0x55ed5dfdbf30 2023-09-21T13:11:55.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed5de9dbb0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f45348d8b80 1 -- 172.21.15.142:0/4266964937 shutdown_connections 2023-09-21T13:11:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f45348d8b80 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c583b2b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f45348d8b80 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5836480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f45348d8b80 1 --2- 172.21.15.142:0/4266964937 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.678+0000 7f45348d8b80 1 -- 172.21.15.142:0/4266964937 >> 172.21.15.142:0/4266964937 conn(0x5561c5762fa0 msgr2=0x5561c58310c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44cc004a30 con 0x55ed5dfdbf30 2023-09-21T13:11:55.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f44f19cfb80 10 client.28292 fetch_fsmap learned FSMap version 52 2023-09-21T13:11:55.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55ed5dd40c60 con 0x55ed5dfdbf30 2023-09-21T13:11:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 0x7f45080a2da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f90 tx=0x7f4514006040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f45348d8b80 1 -- 172.21.15.142:0/4266964937 shutdown_connections 2023-09-21T13:11:55.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f45348d8b80 1 -- 172.21.15.142:0/4266964937 wait complete. 2023-09-21T13:11:55.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.679+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ed5de9dbb0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44cc022a70 con 0x55ed5dfdbf30 2023-09-21T13:11:55.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 10 client.28292 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:11:55.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 10 client.28292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:55.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 20 client.28292 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:55.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e0061b0 0x55ed5e0085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 4 client.28292 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:55.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed5dfaa020 con 0x55ed5e0061b0 2023-09-21T13:11:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f45348d8b80 1 -- start start 2023-09-21T13:11:55.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.680+0000 7f45348d8b80 1 Processor -- start 2023-09-21T13:11:55.690 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e0061b0 0x55ed5e0085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e0061b0 0x55ed5e0085d0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b46e0b727a12d3 server_cookie=f2c35d7fa5551081 in_seq=0 out_seq=0 2023-09-21T13:11:55.691 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f44b6ffd700 10 client.28292 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c5840390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5787e20 con 0x5561c583ae50 2023-09-21T13:11:55.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c57246e0 con 0x5561c58369c0 2023-09-21T13:11:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5724380 con 0x5561c58360a0 2023-09-21T13:11:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.681+0000 7f45348d8b80 10 client.0 _ll_register_callbacks cb 0x5561c566ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39486/0 (socket says 172.21.15.142:39486) 2023-09-21T13:11:55.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 -- 172.21.15.142:0/3613602577 learned_addr learned my addr 172.21.15.142:0/3613602577 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 -- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 msgr2=0x5561c583fe50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:11:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583fe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451a59c700 1 -- 172.21.15.142:0/3613602577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 msgr2=0x5561c5840390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.682+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c5840390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f451a59c700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c5840390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f451a59c700 1 -- 172.21.15.142:0/3613602577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450c0099f0 con 0x5561c58360a0 2023-09-21T13:11:55.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c5840390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:11:55.695 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2547573368 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ed5dfaa020 con 0x55ed5e0061b0 2023-09-21T13:11:55.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f44b6ffd700 10 client.28292 handle_command_reply: tid=0 2023-09-21T13:11:55.696 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.683+0000 7f44f19cfb80 1 client.28292 shutdown 2023-09-21T13:11:55.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f451a59c700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f450400e9c0 tx=0x7f45040994b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=378585b6e0060826 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f4501ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:11:55.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040cc070 con 0x5561c58360a0 2023-09-21T13:11:55.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 msgr2=0x55ed5dfe4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f44cc00e5d0 tx=0x7f44cc00e990 comp rx=0 tx=0).stop 2023-09-21T13:11:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4504099de0 con 0x5561c58360a0 2023-09-21T13:11:55.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561c56f8b50 con 0x5561c58360a0 2023-09-21T13:11:55.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45040996e0 con 0x5561c58360a0 2023-09-21T13:11:55.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 shutdown_connections 2023-09-21T13:11:55.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e0061b0 0x55ed5e0085d0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfe0360 0x55ed5dfe5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdb610 0x55ed5dfe7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2547573368 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe4d20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.684+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 >> 172.21.15.142:0/2547573368 conn(0x55ed5df08000 msgr2=0x55ed5dfd6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f44b6ffd700 0 client.28292 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f45348d8b80 10 client.28225 fetch_fsmap learned FSMap version 52 2023-09-21T13:11:55.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5561c559bc00 con 0x5561c58360a0 2023-09-21T13:11:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 shutdown_connections 2023-09-21T13:11:55.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2547573368 wait complete. 2023-09-21T13:11:55.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45040b5020 con 0x5561c58360a0 2023-09-21T13:11:55.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.685+0000 7f44f19cfb80 20 client.28292 trim_cache size 0 max 16384 2023-09-21T13:11:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f45040ce170 con 0x5561c58360a0 2023-09-21T13:11:55.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 10 client.28225 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:11:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 10 client.28225 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 20 client.28225 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c5850050 0x5561c5852470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 4 client.28225 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:11:55.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.686+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561c5804fc0 con 0x5561c5850050 2023-09-21T13:11:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.687+0000 7f4513fff700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c5850050 0x5561c5852470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.688+0000 7f4501ffb700 10 client.28225 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.687+0000 7f4513fff700 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c5850050 0x5561c5852470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386d1734a2699180 server_cookie=fbf182fc69dae70e in_seq=0 out_seq=0 2023-09-21T13:11:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f4501ffb700 1 -- 172.21.15.142:0/3613602577 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561c5804fc0 con 0x5561c5850050 2023-09-21T13:11:55.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f4501ffb700 10 client.28225 handle_command_reply: tid=0 2023-09-21T13:11:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 client.28225 shutdown 2023-09-21T13:11:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 msgr2=0x5561c583f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f450400e9c0 tx=0x7f45040994b0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 shutdown_connections 2023-09-21T13:11:55.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c5850050 0x5561c5852470 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c5840390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c583f910 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f4501ffb700 0 client.28225 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3613602577 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c583fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 >> 172.21.15.142:0/3613602577 conn(0x5561c5762fa0 msgr2=0x5561c5830cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.690+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 shutdown_connections 2023-09-21T13:11:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.691+0000 7f45348d8b80 1 -- 172.21.15.142:0/3613602577 wait complete. 2023-09-21T13:11:55.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.691+0000 7f45348d8b80 20 client.28225 trim_cache size 0 max 16384 2023-09-21T13:11:55.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.710+0000 7f44f19cfb80 1 Processor -- start 2023-09-21T13:11:55.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.710+0000 7f44f19cfb80 1 -- start start 2023-09-21T13:11:55.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.710+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.710+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 0x55ed5dfde3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5ddad920 con 0x55ed5dfdb610 2023-09-21T13:11:55.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dfd6890 con 0x55ed5dfdbf30 2023-09-21T13:11:55.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dfec7a0 con 0x55ed5dfe0360 2023-09-21T13:11:55.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.714 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 0x55ed5dfde3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44d77fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:40620/0 (socket says 172.21.15.142:40620) 2023-09-21T13:11:55.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.711+0000 7f44d77fe700 1 -- 172.21.15.142:0/2644556122 learned_addr learned my addr 172.21.15.142:0/2644556122 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 -- 172.21.15.142:0/2644556122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 msgr2=0x55ed5dfde3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 0x55ed5dfde3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 -- 172.21.15.142:0/2644556122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 msgr2=0x55ed5dfe7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 -- 172.21.15.142:0/2644556122 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed5dd7e250 con 0x55ed5dfdb610 2023-09-21T13:11:55.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d7fff700 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 0x55ed5dfde3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:11:55.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.712+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44c8097000 tx=0x7f44c801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f00748cd1dd1c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.713+0000 7f44be7fc700 1 -- 172.21.15.142:0/2644556122 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80a2570 con 0x55ed5dfdb610 2023-09-21T13:11:55.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.713+0000 7f44be7fc700 1 -- 172.21.15.142:0/2644556122 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44c8098930 con 0x55ed5dfdb610 2023-09-21T13:11:55.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.713+0000 7f44be7fc700 1 -- 172.21.15.142:0/2644556122 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c809a7f0 con 0x55ed5dfdb610 2023-09-21T13:11:55.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2644556122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 msgr2=0x55ed5dfec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44c8097000 tx=0x7f44c801a040 comp rx=0 tx=0).stop 2023-09-21T13:11:55.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2644556122 shutdown_connections 2023-09-21T13:11:55.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfec260 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfe0360 0x55ed5dfde3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2644556122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfe7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.718 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2644556122 >> 172.21.15.142:0/2644556122 conn(0x55ed5df08000 msgr2=0x55ed5e0081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2644556122 shutdown_connections 2023-09-21T13:11:55.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.714+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2644556122 wait complete. 2023-09-21T13:11:55.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.715+0000 7f44f19cfb80 1 -- start start 2023-09-21T13:11:55.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.715+0000 7f44f19cfb80 1 Processor -- start 2023-09-21T13:11:55.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfeb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfebe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfea250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dfea8d0 con 0x55ed5dfdb610 2023-09-21T13:11:55.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dfeaa40 con 0x55ed5dfe0360 2023-09-21T13:11:55.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed5dfeac00 con 0x55ed5dfdbf30 2023-09-21T13:11:55.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44f19cfb80 10 client.0 _ll_register_callbacks cb 0x55ed5de13a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:55.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfea250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44d7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfea250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50478/0 (socket says 172.21.15.142:50478) 2023-09-21T13:11:55.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44d7fff700 1 -- 172.21.15.142:0/2920237671 learned_addr learned my addr 172.21.15.142:0/2920237671 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfeb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.716+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfebe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 msgr2=0x55ed5dfea250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfea250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2920237671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 msgr2=0x55ed5dfeb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfeb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 -- 172.21.15.142:0/2920237671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d000fd30 con 0x55ed5dfdbf30 2023-09-21T13:11:55.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfeb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:11:55.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44d6ffd700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfebe90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f44cc022ed0 tx=0x7f44cc019af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67328959b0e63278 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.717+0000 7f44b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:11:55.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44cc004240 con 0x55ed5dfdbf30 2023-09-21T13:11:55.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f44c809a590 con 0x55ed5dfdbf30 2023-09-21T13:11:55.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f44cc000e40 con 0x55ed5dfdbf30 2023-09-21T13:11:55.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44cc0043a0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44f19cfb80 10 client.28231 fetch_fsmap learned FSMap version 52 2023-09-21T13:11:55.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.718+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55ed5dd57de0 con 0x55ed5dfdbf30 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44cc038080 con 0x55ed5dfdbf30 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f44cc032030 con 0x55ed5dfdbf30 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 10 client.28231 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 10 client.28231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 20 client.28231 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:55.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e05b0c0 0x55ed5e05d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 4 client.28231 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:11:55.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ed5df25e60 con 0x55ed5e05b0c0 2023-09-21T13:11:55.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.719+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e05b0c0 0x55ed5e05d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.720+0000 7f44d77fe700 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e05b0c0 0x55ed5e05d4e0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a6832c03452a5e server_cookie=f88a0e6e7d4e8884 in_seq=0 out_seq=0 2023-09-21T13:11:55.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.720+0000 7f44b6ffd700 10 client.28231 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 Processor -- start 2023-09-21T13:11:55.728 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 -- start start 2023-09-21T13:11:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c5847000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c58401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c56088c0 con 0x5561c583ae50 2023-09-21T13:11:55.729 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5840700 con 0x5561c58369c0 2023-09-21T13:11:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f45348d8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c58408c0 con 0x5561c58360a0 2023-09-21T13:11:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.722+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39500/0 (socket says 172.21.15.142:39500) 2023-09-21T13:11:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 -- 172.21.15.142:0/3031438398 learned_addr learned my addr 172.21.15.142:0/3031438398 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.730 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f4513fff700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c5847000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 -- 172.21.15.142:0/3031438398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 msgr2=0x5561c5847000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c5847000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 -- 172.21.15.142:0/3031438398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 msgr2=0x5561c58401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c58401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c58401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451a59c700 1 -- 172.21.15.142:0/3031438398 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561c55d91f0 con 0x5561c58360a0 2023-09-21T13:11:55.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.723+0000 7f451ad9d700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c58401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:11:55.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44b6ffd700 1 -- 172.21.15.142:0/2920237671 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ed5df25e60 con 0x55ed5e05b0c0 2023-09-21T13:11:55.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44b6ffd700 10 client.28231 handle_command_reply: tid=0 2023-09-21T13:11:55.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 client.28231 shutdown 2023-09-21T13:11:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f451a59c700 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4504095be0 tx=0x7f4504099d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b77339befdf2383 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f45117fa700 1 -- 172.21.15.142:0/3031438398 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040cc040 con 0x5561c58360a0 2023-09-21T13:11:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f45117fa700 1 -- 172.21.15.142:0/3031438398 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45040b5070 con 0x5561c58360a0 2023-09-21T13:11:55.734 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f45117fa700 1 -- 172.21.15.142:0/3031438398 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040ce0d0 con 0x5561c58360a0 2023-09-21T13:11:55.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 msgr2=0x55ed5dfebe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfebe90 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f44cc022ed0 tx=0x7f44cc019af0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 shutdown_connections 2023-09-21T13:11:55.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ed5e05b0c0 0x55ed5e05d4e0 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ed5dfdb610 0x55ed5dfeb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ed5dfe0360 0x55ed5dfea250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 --2- 172.21.15.142:0/2920237671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ed5dfdbf30 0x55ed5dfebe90 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.724+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 >> 172.21.15.142:0/2920237671 conn(0x55ed5df08000 msgr2=0x55ed5dfde3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f44b6ffd700 0 client.28231 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 shutdown_connections 2023-09-21T13:11:55.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f44f19cfb80 1 -- 172.21.15.142:0/2920237671 wait complete. 2023-09-21T13:11:55.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f44f19cfb80 20 client.28231 trim_cache size 0 max 16384 2023-09-21T13:11:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f45348d8b80 1 -- 172.21.15.142:0/3031438398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 msgr2=0x5561c5838740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.737 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.725+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f4504095be0 tx=0x7f4504099d00 comp rx=0 tx=0).stop 2023-09-21T13:11:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 -- 172.21.15.142:0/3031438398 shutdown_connections 2023-09-21T13:11:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c583ae50 0x5561c58401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5838740 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.738 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 --2- 172.21.15.142:0/3031438398 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c58369c0 0x5561c5847000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 -- 172.21.15.142:0/3031438398 >> 172.21.15.142:0/3031438398 conn(0x5561c5762fa0 msgr2=0x5561c5838f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 -- 172.21.15.142:0/3031438398 shutdown_connections 2023-09-21T13:11:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 -- 172.21.15.142:0/3031438398 wait complete. 2023-09-21T13:11:55.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f45348d8b80 1 -- start start 2023-09-21T13:11:55.740 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:11:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:11:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:11:55.740 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:11:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:11:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:11:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:11:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:11:55.741 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:11:55.742 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:11:55.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 msgr2=0x7f44c00a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 0x7f44c00a2d70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44d000f4b0 tx=0x7f44d000d040 comp rx=0 tx=0).stop 2023-09-21T13:11:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 msgr2=0x7f44d806b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f44c8005910 tx=0x7f44c80047c0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 shutdown_connections 2023-09-21T13:11:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f44c00a08b0 0x7f44c00a2d70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f44d81af970 0x7f44d81b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44d8073140 0x7f44d806b2e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 --2- 172.21.15.142:0/2074290008 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f44d8073af0 0x7f44d806b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.726+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 >> 172.21.15.142:0/2074290008 conn(0x7f44d80fc850 msgr2=0x7f44d8105020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.727+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 shutdown_connections 2023-09-21T13:11:55.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.727+0000 7f45348d8b80 1 Processor -- start 2023-09-21T13:11:55.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:11:55.727+0000 7f44ddfff700 1 -- 172.21.15.142:0/2074290008 wait complete. 2023-09-21T13:11:55.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.727+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.727+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 0x5561c5846d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f45348d8b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c583ae50 0x5561c5844d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f45348d8b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5845310 con 0x5561c58369c0 2023-09-21T13:11:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f45348d8b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5845480 con 0x5561c583ae50 2023-09-21T13:11:55.748 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f45348d8b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561c5845640 con 0x5561c58360a0 2023-09-21T13:11:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f45348d8b80 10 client.0 _ll_register_callbacks cb 0x5561c566ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:11:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f451a59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:39514/0 (socket says 172.21.15.142:39514) 2023-09-21T13:11:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f451a59c700 1 -- 172.21.15.142:0/2889439724 learned_addr learned my addr 172.21.15.142:0/2889439724 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:11:55.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.728+0000 7f451ad9d700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c583ae50 0x5561c5844d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f4513fff700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 0x5561c5846d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f451a59c700 1 -- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c583ae50 msgr2=0x5561c5844d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f451a59c700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c583ae50 0x5561c5844d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f451a59c700 1 -- 172.21.15.142:0/2889439724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 msgr2=0x5561c5846d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:11:55.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f451a59c700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 0x5561c5846d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.729+0000 7f451a59c700 1 -- 172.21.15.142:0/2889439724 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561c559bc00 con 0x5561c58360a0 2023-09-21T13:11:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.730+0000 7f4513fff700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 0x5561c5846d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:11:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.730+0000 7f451a59c700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f45040993e0 tx=0x7f45040cc220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8cfd8a067f21e5e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:11:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.730+0000 7f4501ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:11:55.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45040cc040 con 0x5561c58360a0 2023-09-21T13:11:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f45040b6030 con 0x5561c58360a0 2023-09-21T13:11:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f450c009e90 con 0x5561c58360a0 2023-09-21T13:11:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45040ce2e0 con 0x5561c58360a0 2023-09-21T13:11:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f45348d8b80 10 client.28237 fetch_fsmap learned FSMap version 52 2023-09-21T13:11:55.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.731+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x5561c55b1250 con 0x5561c58360a0 2023-09-21T13:11:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f450c009e90 con 0x5561c58360a0 2023-09-21T13:11:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4504004a00 con 0x5561c58360a0 2023-09-21T13:11:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 10 client.28237 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:11:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 10 client.28237 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:11:55.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 20 client.28237 populate_metadata read hostname 'smithi142' 2023-09-21T13:11:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c58a4ac0 0x5561c58a6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:11:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 4 client.28237 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:11:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5561c5780e00 con 0x5561c58a4ac0 2023-09-21T13:11:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.732+0000 7f4513fff700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c58a4ac0 0x5561c58a6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:11:55.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.733+0000 7f4501ffb700 10 client.28237 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.733+0000 7f4513fff700 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c58a4ac0 0x5561c58a6eb0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a9d00d148ce307b server_cookie=ff0e23ba76629b2b in_seq=0 out_seq=0 2023-09-21T13:11:55.771 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:11:55.980 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f4501ffb700 1 -- 172.21.15.142:0/2889439724 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5561c5780e00 con 0x5561c58a4ac0 2023-09-21T13:11:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f4501ffb700 10 client.28237 handle_command_reply: tid=0 2023-09-21T13:11:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f45348d8b80 1 client.28237 shutdown 2023-09-21T13:11:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 msgr2=0x5561c5846850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.981 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f45040993e0 tx=0x7f45040cc220 comp rx=0 tx=0).stop 2023-09-21T13:11:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 shutdown_connections 2023-09-21T13:11:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.987+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5561c58a4ac0 0x5561c58a6eb0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5561c583ae50 0x5561c5844d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f4501ffb700 0 client.28237 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:11:55.982 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5561c58360a0 0x5561c5846850 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 --2- 172.21.15.142:0/2889439724 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5561c58369c0 0x5561c5846d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 >> 172.21.15.142:0/2889439724 conn(0x5561c5762fa0 msgr2=0x5561c583fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.983 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 shutdown_connections 2023-09-21T13:11:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.988+0000 7f45348d8b80 1 -- 172.21.15.142:0/2889439724 wait complete. 2023-09-21T13:11:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.989+0000 7f45348d8b80 20 client.28237 trim_cache size 0 max 16384 2023-09-21T13:11:55.984 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:11:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:11:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:11:55.985 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:11:55.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 msgr2=0x7f45080a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 0x7f45080a2da0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4514009f90 tx=0x7f4514006040 comp rx=0 tx=0).stop 2023-09-21T13:11:55.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 msgr2=0x7f451c19bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:11:55.986 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f450400e9f0 tx=0x7f450400edb0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 shutdown_connections 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f45080a08e0 0x7f45080a2da0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f451c105d60 0x7f451c194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f451c0681d0 0x7f451c19bdb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 --2- 172.21.15.142:0/3380138774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f451c068b90 0x7f451c19c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:11:55.987 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 >> 172.21.15.142:0/3380138774 conn(0x7f451c076800 msgr2=0x7f451c0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:11:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 shutdown_connections 2023-09-21T13:11:55.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:11:55.990+0000 7f4520fff700 1 -- 172.21.15.142:0/3380138774 wait complete. 2023-09-21T13:11:56.048 INFO:tasks.workunit.client.0.smithi142.stdout: 10 105451 38.14 MB/sec execute 36 sec latency 171.585 ms 2023-09-21T13:11:56.065 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:56 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:56.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:56 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:56.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:56 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:11:57.048 INFO:tasks.workunit.client.0.smithi142.stdout: 10 106462 39.10 MB/sec execute 37 sec latency 64.928 ms 2023-09-21T13:11:57.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:57 smithi156 ceph-mon[134078]: pgmap v495: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 20 MiB/s wr, 1.02k op/s 2023-09-21T13:11:57.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:57 smithi142 ceph-mon[97663]: pgmap v495: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 20 MiB/s wr, 1.02k op/s 2023-09-21T13:11:57.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:57 smithi160 ceph-mon[134450]: pgmap v495: 97 pgs: 97 active+clean; 1.0 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 MiB/s rd, 20 MiB/s wr, 1.02k op/s 2023-09-21T13:11:58.050 INFO:tasks.workunit.client.0.smithi142.stdout: 10 107033 38.76 MB/sec execute 38 sec latency 173.246 ms 2023-09-21T13:11:59.050 INFO:tasks.workunit.client.0.smithi142.stdout: 10 107488 38.40 MB/sec execute 39 sec latency 389.822 ms 2023-09-21T13:11:59.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:11:59 smithi156 ceph-mon[134078]: pgmap v496: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 15 MiB/s wr, 763 op/s 2023-09-21T13:11:59.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:11:59 smithi142 ceph-mon[97663]: pgmap v496: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 15 MiB/s wr, 763 op/s 2023-09-21T13:11:59.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:11:59 smithi160 ceph-mon[134450]: pgmap v496: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 MiB/s rd, 15 MiB/s wr, 763 op/s 2023-09-21T13:12:00.050 INFO:tasks.workunit.client.0.smithi142.stdout: 10 108326 38.31 MB/sec execute 40 sec latency 56.584 ms 2023-09-21T13:12:01.050 INFO:tasks.workunit.client.0.smithi142.stdout: 10 109199 38.66 MB/sec execute 41 sec latency 101.027 ms 2023-09-21T13:12:01.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:01 smithi156 ceph-mon[134078]: pgmap v497: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 14 MiB/s wr, 694 op/s 2023-09-21T13:12:01.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:01 smithi142 ceph-mon[97663]: pgmap v497: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 14 MiB/s wr, 694 op/s 2023-09-21T13:12:01.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:01 smithi160 ceph-mon[134450]: pgmap v497: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 14 MiB/s wr, 694 op/s 2023-09-21T13:12:02.050 INFO:tasks.workunit.client.0.smithi142.stdout: 10 109651 38.11 MB/sec execute 42 sec latency 152.181 ms 2023-09-21T13:12:03.053 INFO:tasks.workunit.client.0.smithi142.stdout: 10 109710 37.35 MB/sec execute 43 sec latency 570.154 ms 2023-09-21T13:12:03.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:02 smithi156 ceph-mon[134078]: pgmap v498: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:03.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:02 smithi156 ceph-mon[134078]: osdmap e109: 12 total, 12 up, 12 in 2023-09-21T13:12:03.161 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:02 smithi142 ceph-mon[97663]: pgmap v498: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:03.162 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:02 smithi142 ceph-mon[97663]: osdmap e109: 12 total, 12 up, 12 in 2023-09-21T13:12:03.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:02 smithi160 ceph-mon[134450]: pgmap v498: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:03.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:02 smithi160 ceph-mon[134450]: osdmap e109: 12 total, 12 up, 12 in 2023-09-21T13:12:04.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 109747 36.55 MB/sec execute 44 sec latency 681.158 ms 2023-09-21T13:12:05.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 109980 36.17 MB/sec execute 45 sec latency 687.718 ms 2023-09-21T13:12:05.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:05 smithi156 ceph-mon[134078]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-21T13:12:05.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:05 smithi142 ceph-mon[97663]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-21T13:12:05.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:05 smithi160 ceph-mon[134450]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-21T13:12:06.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 110498 36.08 MB/sec execute 46 sec latency 103.798 ms 2023-09-21T13:12:07.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 111179 36.00 MB/sec execute 47 sec latency 109.972 ms 2023-09-21T13:12:07.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:07 smithi156 ceph-mon[134078]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 13 MiB/s wr, 777 op/s 2023-09-21T13:12:07.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:07 smithi142 ceph-mon[97663]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 13 MiB/s wr, 777 op/s 2023-09-21T13:12:07.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:07 smithi160 ceph-mon[134450]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 13 MiB/s wr, 777 op/s 2023-09-21T13:12:08.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 111950 36.00 MB/sec execute 48 sec latency 95.133 ms 2023-09-21T13:12:09.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 112966 36.33 MB/sec execute 49 sec latency 47.457 ms 2023-09-21T13:12:09.385 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.390+0000 7f090cbff700 1 -- 172.21.15.142:0/415438810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0908108050 msgr2=0x7f0908108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.386 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.390+0000 7f090cbff700 1 --2- 172.21.15.142:0/415438810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0908108050 0x7f0908108430 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009990 tx=0x7f08f8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 -- 172.21.15.142:0/415438810 shutdown_connections 2023-09-21T13:12:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 --2- 172.21.15.142:0/415438810 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 0x7f09080790d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 --2- 172.21.15.142:0/415438810 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0908108050 0x7f0908108430 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.387 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 --2- 172.21.15.142:0/415438810 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108a00 0x7f090810c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 -- 172.21.15.142:0/415438810 >> 172.21.15.142:0/415438810 conn(0x7f090806cea0 msgr2=0x7f090806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 -- 172.21.15.142:0/415438810 shutdown_connections 2023-09-21T13:12:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.391+0000 7f090cbff700 1 -- 172.21.15.142:0/415438810 wait complete. 2023-09-21T13:12:09.388 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.392+0000 7f090cbff700 1 Processor -- start 2023-09-21T13:12:09.389 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 -- start start 2023-09-21T13:12:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 0x7f090807d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f090807d9c0 0x7f090807de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908136260 con 0x7f090810c6f0 2023-09-21T13:12:09.390 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09081363d0 con 0x7f0908108050 2023-09-21T13:12:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.393+0000 7f090cbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0908136590 con 0x7f090807d9c0 2023-09-21T13:12:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33796/0 (socket says 172.21.15.142:33796) 2023-09-21T13:12:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 -- 172.21.15.142:0/2896395518 learned_addr learned my addr 172.21.15.142:0/2896395518 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:09.391 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f0905d9b700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 0x7f090807d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 -- 172.21.15.142:0/2896395518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f090807d9c0 msgr2=0x7f090807de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f090807d9c0 0x7f090807de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 -- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 msgr2=0x7f090807d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 0x7f090807d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.392 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.394+0000 7f090659c700 1 -- 172.21.15.142:0/2896395518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f80095f0 con 0x7f0908108050 2023-09-21T13:12:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.396+0000 7f090659c700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.396+0000 7f08f77fe700 1 -- 172.21.15.142:0/2896395518 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f801d070 con 0x7f0908108050 2023-09-21T13:12:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.396+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0908136810 con 0x7f0908108050 2023-09-21T13:12:09.393 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.396+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0908136d10 con 0x7f0908108050 2023-09-21T13:12:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.397+0000 7f08f77fe700 1 -- 172.21.15.142:0/2896395518 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08f800fe90 con 0x7f0908108050 2023-09-21T13:12:09.394 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.397+0000 7f08f77fe700 1 -- 172.21.15.142:0/2896395518 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f80173f0 con 0x7f0908108050 2023-09-21T13:12:09.398 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.404+0000 7f08f77fe700 1 -- 172.21.15.142:0/2896395518 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f08f8017650 con 0x7f0908108050 2023-09-21T13:12:09.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:09 smithi156 ceph-mon[134078]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.406+0000 7f08f77fe700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 0x7f08f00a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.407+0000 7f08f77fe700 1 -- 172.21.15.142:0/2896395518 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f08f80cd690 con 0x7f0908108050 2023-09-21T13:12:09.404 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.411+0000 7f0905d9b700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 0x7f08f00a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.405 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.412+0000 7f0905d9b700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 0x7f08f00a2d70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f090807ee80 tx=0x7f08fc009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.416 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:09 smithi142 ceph-mon[97663]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:09.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:09 smithi160 ceph-mon[134450]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 Processor -- start 2023-09-21T13:12:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 -- start start 2023-09-21T13:12:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e09b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e00fc40 con 0x55a21e09b0a0 2023-09-21T13:12:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21dff3c10 con 0x55a21e09fe50 2023-09-21T13:12:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.663+0000 7f09205bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21dff1530 con 0x55a21e09b9c0 2023-09-21T13:12:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.665+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.665+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53866/0 (socket says 172.21.15.142:53866) 2023-09-21T13:12:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.665+0000 7f0905d9b700 1 -- 172.21.15.142:0/958966877 learned_addr learned my addr 172.21.15.142:0/958966877 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.667+0000 7f0905d9b700 1 -- 172.21.15.142:0/958966877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 msgr2=0x55a21e0a02b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:12:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.667+0000 7f0905d9b700 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a02b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.667+0000 7f0905d9b700 1 -- 172.21.15.142:0/958966877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 msgr2=0x55a21e09b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.667+0000 7f0905d9b700 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e09b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.667+0000 7f0905d9b700 1 -- 172.21.15.142:0/958966877 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a21de17d80 con 0x55a21e09b9c0 2023-09-21T13:12:09.666 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.674+0000 7f0905d9b700 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08fc011cf0 tx=0x7f08fc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d1f23155a21a66 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.674+0000 7f08f4ff9700 1 -- 172.21.15.142:0/958966877 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc00ebb0 con 0x55a21e09b9c0 2023-09-21T13:12:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.674+0000 7f08f4ff9700 1 -- 172.21.15.142:0/958966877 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc021070 con 0x55a21e09b9c0 2023-09-21T13:12:09.667 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.674+0000 7f08f4ff9700 1 -- 172.21.15.142:0/958966877 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01d670 con 0x55a21e09b9c0 2023-09-21T13:12:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.675+0000 7f09205bab80 1 -- 172.21.15.142:0/958966877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 msgr2=0x55a21e09f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.675+0000 7f09205bab80 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f08fc011cf0 tx=0x7f08fc014000 comp rx=0 tx=0).stop 2023-09-21T13:12:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.681+0000 7f09205bab80 1 -- 172.21.15.142:0/958966877 shutdown_connections 2023-09-21T13:12:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.681+0000 7f09205bab80 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e09b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.681+0000 7f09205bab80 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.681+0000 7f09205bab80 1 --2- 172.21.15.142:0/958966877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e09f910 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.682+0000 7f09205bab80 1 -- 172.21.15.142:0/958966877 >> 172.21.15.142:0/958966877 conn(0x55a21dfc7fa0 msgr2=0x55a21e0960c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:09.677 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.684+0000 7f09205bab80 1 -- 172.21.15.142:0/958966877 shutdown_connections 2023-09-21T13:12:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.684+0000 7f09205bab80 1 -- 172.21.15.142:0/958966877 wait complete. 2023-09-21T13:12:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.685+0000 7f09205bab80 1 -- start start 2023-09-21T13:12:09.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.685+0000 7f09205bab80 1 Processor -- start 2023-09-21T13:12:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e0a7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b9c0 0x55a21e0a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21dfece20 con 0x55a21e09b0a0 2023-09-21T13:12:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21df896e0 con 0x55a21e09b9c0 2023-09-21T13:12:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21df89380 con 0x55a21e09fe50 2023-09-21T13:12:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.686+0000 7f09205bab80 10 client.0 _ll_register_callbacks cb 0x55a21ded3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.687+0000 7f0906d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.687+0000 7f0906d9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53876/0 (socket says 172.21.15.142:53876) 2023-09-21T13:12:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.687+0000 7f0906d9d700 1 -- 172.21.15.142:0/1628418084 learned_addr learned my addr 172.21.15.142:0/1628418084 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.687+0000 7f0905d9b700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b9c0 0x55a21e0a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 -- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b9c0 msgr2=0x55a21e0a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b9c0 0x55a21e0a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 -- 172.21.15.142:0/1628418084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 msgr2=0x55a21e0a7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e0a7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 -- 172.21.15.142:0/1628418084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc017070 con 0x55a21e09fe50 2023-09-21T13:12:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f0906d9d700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f090000b440 tx=0x7f090000b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbdfc927d2cc79d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.688+0000 7f08edffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.690+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000e070 con 0x55a21e09fe50 2023-09-21T13:12:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.690+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f09000115a0 con 0x55a21e09fe50 2023-09-21T13:12:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.690+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a21df5db50 con 0x55a21e09fe50 2023-09-21T13:12:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.691+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0900009730 con 0x55a21e09fe50 2023-09-21T13:12:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.692+0000 7f09205bab80 10 client.28246 fetch_fsmap learned FSMap version 52 2023-09-21T13:12:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.692+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55a21de00c00 con 0x55a21e09fe50 2023-09-21T13:12:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.697+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a21df5db50 con 0x55a21e09fe50 2023-09-21T13:12:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.697+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f090001cad0 con 0x55a21e09fe50 2023-09-21T13:12:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 10 client.28246 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:12:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 10 client.28246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 20 client.28246 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e0b51e0 0x55a21e0b7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 4 client.28246 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.698+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a21e069fc0 con 0x55a21e0b51e0 2023-09-21T13:12:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.700+0000 7f090659c700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e0b51e0 0x55a21e0b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.702+0000 7f090659c700 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e0b51e0 0x55a21e0b7600 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d0f8aa11a6f791e server_cookie=41f9e731f38c7314 in_seq=0 out_seq=0 2023-09-21T13:12:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.703+0000 7f08edffb700 10 client.28246 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.712+0000 7f08edffb700 1 -- 172.21.15.142:0/1628418084 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a21e069fc0 con 0x55a21e0b51e0 2023-09-21T13:12:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.712+0000 7f08edffb700 10 client.28246 handle_command_reply: tid=0 2023-09-21T13:12:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.712+0000 7f09205bab80 1 client.28246 shutdown 2023-09-21T13:12:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.715+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 msgr2=0x55a21e0a50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.715+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f090000b440 tx=0x7f090000b800 comp rx=0 tx=0).stop 2023-09-21T13:12:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 shutdown_connections 2023-09-21T13:12:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e0b51e0 0x55a21e0b7600 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b0a0 0x55a21e0a7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09fe50 0x55a21e0a50b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 --2- 172.21.15.142:0/1628418084 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b9c0 0x55a21e0a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.712 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.718+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 >> 172.21.15.142:0/1628418084 conn(0x55a21dfc7fa0 msgr2=0x55a21e095c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.721+0000 7f08edffb700 0 client.28246 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:09.715 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.723+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 shutdown_connections 2023-09-21T13:12:09.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.724+0000 7f09205bab80 1 -- 172.21.15.142:0/1628418084 wait complete. 2023-09-21T13:12:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.733+0000 7f09205bab80 20 client.28246 trim_cache size 0 max 16384 2023-09-21T13:12:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 Processor -- start 2023-09-21T13:12:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 -- start start 2023-09-21T13:12:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b0a0 0x55a21e09d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09fe50 0x55a21e09dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21de6d8c0 con 0x55a21e09fe50 2023-09-21T13:12:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e0a5ee0 con 0x55a21e09b0a0 2023-09-21T13:12:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.752+0000 7f09205bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e09bf20 con 0x55a21e09b9c0 2023-09-21T13:12:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.753+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.753+0000 7f0905d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53884/0 (socket says 172.21.15.142:53884) 2023-09-21T13:12:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.753+0000 7f0905d9b700 1 -- 172.21.15.142:0/4237391467 learned_addr learned my addr 172.21.15.142:0/4237391467 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.753+0000 7f090659c700 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b0a0 0x55a21e09d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 -- 172.21.15.142:0/4237391467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b0a0 msgr2=0x55a21e09d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b0a0 0x55a21e09d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 -- 172.21.15.142:0/4237391467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09fe50 msgr2=0x55a21e09dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09fe50 0x55a21e09dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 -- 172.21.15.142:0/4237391467 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a21e0bc230 con 0x55a21e09b9c0 2023-09-21T13:12:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.754+0000 7f0905d9b700 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08fc011cf0 tx=0x7f08fc011850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62773b8b79f14612 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.755+0000 7f08f57fa700 1 -- 172.21.15.142:0/4237391467 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc01ce60 con 0x55a21e09b9c0 2023-09-21T13:12:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.755+0000 7f08f57fa700 1 -- 172.21.15.142:0/4237391467 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc00ee70 con 0x55a21e09b9c0 2023-09-21T13:12:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.755+0000 7f08f57fa700 1 -- 172.21.15.142:0/4237391467 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08fc005260 con 0x55a21e09b9c0 2023-09-21T13:12:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.756+0000 7f09205bab80 1 -- 172.21.15.142:0/4237391467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 msgr2=0x55a21e0ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.756+0000 7f09205bab80 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f08fc011cf0 tx=0x7f08fc011850 comp rx=0 tx=0).stop 2023-09-21T13:12:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 -- 172.21.15.142:0/4237391467 shutdown_connections 2023-09-21T13:12:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09fe50 0x55a21e09dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09b0a0 0x55a21e09d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 --2- 172.21.15.142:0/4237391467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b9c0 0x55a21e0ac060 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 -- 172.21.15.142:0/4237391467 >> 172.21.15.142:0/4237391467 conn(0x55a21dfc7fa0 msgr2=0x55a21e0a72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 -- 172.21.15.142:0/4237391467 shutdown_connections 2023-09-21T13:12:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.757+0000 7f09205bab80 1 -- 172.21.15.142:0/4237391467 wait complete. 2023-09-21T13:12:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.758+0000 7f09205bab80 1 -- start start 2023-09-21T13:12:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.759+0000 7f09205bab80 1 Processor -- start 2023-09-21T13:12:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.760+0000 7f09205bab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 0x55a21e0a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.760+0000 7f09205bab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b9c0 0x55a21e0a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.760+0000 7f09205bab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.761+0000 7f09205bab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e0a3660 con 0x55a21e09b9c0 2023-09-21T13:12:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.761+0000 7f09205bab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e0a37d0 con 0x55a21e09fe50 2023-09-21T13:12:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.761+0000 7f09205bab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a21e0a3990 con 0x55a21e09b0a0 2023-09-21T13:12:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.761+0000 7f09205bab80 10 client.0 _ll_register_callbacks cb 0x55a21ded3a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.762+0000 7f0906d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.762+0000 7f0906d9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:33832/0 (socket says 172.21.15.142:33832) 2023-09-21T13:12:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.762+0000 7f0906d9d700 1 -- 172.21.15.142:0/762227146 learned_addr learned my addr 172.21.15.142:0/762227146 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.762+0000 7f090659c700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 0x55a21e0a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 -- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 msgr2=0x55a21e0a3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 -- 172.21.15.142:0/762227146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b9c0 msgr2=0x55a21e0a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b9c0 0x55a21e0a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 -- 172.21.15.142:0/762227146 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc02a040 con 0x55a21e09b0a0 2023-09-21T13:12:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f090659c700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 0x55a21e0a4280 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08f80cad60 tx=0x7f08f8009910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3605b59c89c8d44 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.763+0000 7f08edffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f809b0d0 con 0x55a21e09b0a0 2023-09-21T13:12:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f08f809ac70 con 0x55a21e09b0a0 2023-09-21T13:12:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08fc021070 con 0x55a21e09b0a0 2023-09-21T13:12:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08f809eaa0 con 0x55a21e09b0a0 2023-09-21T13:12:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f09205bab80 10 client.28252 fetch_fsmap learned FSMap version 52 2023-09-21T13:12:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55a21de3e1f0 con 0x55a21e09b0a0 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.764+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f08fc021070 con 0x55a21e09b0a0 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 52) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f08f80a2850 con 0x55a21e09b0a0 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 10 client.28252 fetch_fsmap finished waiting for FSMap version 52 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 10 client.28252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 20 client.28252 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e109cf0 0x55a21e10c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 4 client.28252 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:12:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a21dfe5e00 con 0x55a21e109cf0 2023-09-21T13:12:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.765+0000 7f0905d9b700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e109cf0 0x55a21e10c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.766+0000 7f0905d9b700 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e109cf0 0x55a21e10c110 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=effd9b7025dd06ae server_cookie=1bd62e6da5ac1401 in_seq=0 out_seq=0 2023-09-21T13:12:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:09.766+0000 7f08edffb700 10 client.28252 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:10.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 113382 36.25 MB/sec execute 50 sec latency 373.924 ms 2023-09-21T13:12:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f08edffb700 1 -- 172.21.15.142:0/762227146 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a21dfe5e00 con 0x55a21e109cf0 2023-09-21T13:12:10.103 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f08edffb700 10 client.28252 handle_command_reply: tid=0 2023-09-21T13:12:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 client.28252 shutdown 2023-09-21T13:12:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 msgr2=0x55a21e0a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 0x55a21e0a4280 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f08f80cad60 tx=0x7f08f8009910 comp rx=0 tx=0).stop 2023-09-21T13:12:10.104 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 shutdown_connections 2023-09-21T13:12:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a21e109cf0 0x55a21e10c110 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a21e09fe50 0x55a21e0a3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.105 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f08edffb700 0 client.28252 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a21e09b0a0 0x55a21e0a4280 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.106 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 --2- 172.21.15.142:0/762227146 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a21e09b9c0 0x55a21e0a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 >> 172.21.15.142:0/762227146 conn(0x55a21dfc7fa0 msgr2=0x55a21e09dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 shutdown_connections 2023-09-21T13:12:10.107 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.110+0000 7f09205bab80 1 -- 172.21.15.142:0/762227146 wait complete. 2023-09-21T13:12:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.111+0000 7f09205bab80 20 client.28252 trim_cache size 0 max 16384 2023-09-21T13:12:10.108 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:12:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:12:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:12:10.109 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:12:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.111+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 msgr2=0x7f08f00a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:10.110 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.111+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 0x7f08f00a2d70 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f090807ee80 tx=0x7f08fc009260 comp rx=0 tx=0).stop 2023-09-21T13:12:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.111+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 msgr2=0x7f09080836b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.111+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f08f8006010 tx=0x7f08f800f690 comp rx=0 tx=0).stop 2023-09-21T13:12:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 shutdown_connections 2023-09-21T13:12:10.111 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f08f00a08b0 0x7f08f00a2d70 secure :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f090807ee80 tx=0x7f08fc009260 comp rx=0 tx=0).stop 2023-09-21T13:12:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f090807d9c0 0x7f090807de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0908108050 0x7f09080836b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 --2- 172.21.15.142:0/2896395518 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f090810c6f0 0x7f090807d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.112+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 >> 172.21.15.142:0/2896395518 conn(0x7f090806cea0 msgr2=0x7f09080709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:10.112 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.114+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 shutdown_connections 2023-09-21T13:12:10.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:10.114+0000 7f090cbff700 1 -- 172.21.15.142:0/2896395518 wait complete. 2023-09-21T13:12:11.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 114049 36.39 MB/sec execute 51 sec latency 143.160 ms 2023-09-21T13:12:11.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:11 smithi160 ceph-mon[134450]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:11.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:11 smithi160 ceph-mon[134450]: daemon mds.i restarted 2023-09-21T13:12:11.182 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:12:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:12:11.182 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:12:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:12:11.183 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:12:10 smithi160 ceph-mds[172188]: -- 172.21.15.160:0/151011873 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561f9e5af1e0 con 0x561f9e584800 2023-09-21T13:12:11.183 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:12:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:12:11.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:11 smithi156 ceph-mon[134078]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:11.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:11 smithi156 ceph-mon[134078]: daemon mds.i restarted 2023-09-21T13:12:11.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:11 smithi142 ceph-mon[97663]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 12 MiB/s wr, 732 op/s 2023-09-21T13:12:11.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:11 smithi142 ceph-mon[97663]: daemon mds.i restarted 2023-09-21T13:12:12.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 114616 36.13 MB/sec execute 52 sec latency 60.961 ms 2023-09-21T13:12:12.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: osdmap e110: 12 total, 12 up, 12 in 2023-09-21T13:12:12.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6838/3000866200,v1:172.21.15.160:6839/3000866200] up:boot 2023-09-21T13:12:12.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:12:12.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:12:12.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:12.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:12 smithi156 ceph-mon[134078]: osdmap e111: 12 total, 12 up, 12 in 2023-09-21T13:12:12.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: osdmap e110: 12 total, 12 up, 12 in 2023-09-21T13:12:12.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6838/3000866200,v1:172.21.15.160:6839/3000866200] up:boot 2023-09-21T13:12:12.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:12:12.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:12:12.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:12.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:12 smithi142 ceph-mon[97663]: osdmap e111: 12 total, 12 up, 12 in 2023-09-21T13:12:12.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: osdmap e110: 12 total, 12 up, 12 in 2023-09-21T13:12:12.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6838/3000866200,v1:172.21.15.160:6839/3000866200] up:boot 2023-09-21T13:12:12.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:12:12.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 2 up:standby-replay 7 up:standby 2023-09-21T13:12:12.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:12.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:12 smithi160 ceph-mon[134450]: osdmap e111: 12 total, 12 up, 12 in 2023-09-21T13:12:13.054 INFO:tasks.workunit.client.0.smithi142.stdout: 10 115391 36.06 MB/sec execute 53 sec latency 75.519 ms 2023-09-21T13:12:13.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:13 smithi156 ceph-mon[134078]: pgmap v506: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 15 MiB/s wr, 956 op/s 2023-09-21T13:12:13.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:13 smithi142 ceph-mon[97663]: pgmap v506: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 15 MiB/s wr, 956 op/s 2023-09-21T13:12:13.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:13 smithi160 ceph-mon[134450]: pgmap v506: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 MiB/s rd, 15 MiB/s wr, 956 op/s 2023-09-21T13:12:14.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 116428 36.54 MB/sec execute 54 sec latency 58.334 ms 2023-09-21T13:12:15.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 117057 36.68 MB/sec execute 55 sec latency 246.683 ms 2023-09-21T13:12:15.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:15 smithi156 ceph-mon[134078]: pgmap v507: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 14 MiB/s wr, 815 op/s 2023-09-21T13:12:15.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:15 smithi142 ceph-mon[97663]: pgmap v507: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 14 MiB/s wr, 815 op/s 2023-09-21T13:12:15.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:15 smithi160 ceph-mon[134450]: pgmap v507: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 MiB/s rd, 14 MiB/s wr, 815 op/s 2023-09-21T13:12:16.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 117621 36.38 MB/sec execute 56 sec latency 123.585 ms 2023-09-21T13:12:17.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 118409 36.49 MB/sec execute 57 sec latency 86.335 ms 2023-09-21T13:12:17.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:17 smithi156 ceph-mon[134078]: pgmap v508: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 701 op/s 2023-09-21T13:12:17.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:17 smithi142 ceph-mon[97663]: pgmap v508: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 701 op/s 2023-09-21T13:12:17.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:17 smithi160 ceph-mon[134450]: pgmap v508: 97 pgs: 97 active+clean; 1.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 MiB/s rd, 13 MiB/s wr, 701 op/s 2023-09-21T13:12:18.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 119391 36.71 MB/sec execute 58 sec latency 51.113 ms 2023-09-21T13:12:19.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 120338 37.25 MB/sec execute 59 sec latency 146.463 ms 2023-09-21T13:12:19.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:19 smithi156 ceph-mon[134078]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:19.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:19 smithi142 ceph-mon[97663]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:19.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:19 smithi160 ceph-mon[134450]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 19 MiB/s wr, 981 op/s 2023-09-21T13:12:20.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 120826 36.89 MB/sec execute 60 sec latency 110.870 ms 2023-09-21T13:12:21.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 121630 37.03 MB/sec execute 61 sec latency 71.060 ms 2023-09-21T13:12:21.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:21 smithi156 ceph-mon[134078]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 13 MiB/s wr, 642 op/s 2023-09-21T13:12:21.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:21 smithi142 ceph-mon[97663]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 13 MiB/s wr, 642 op/s 2023-09-21T13:12:21.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:21 smithi160 ceph-mon[134450]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 13 MiB/s wr, 642 op/s 2023-09-21T13:12:22.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 122584 37.08 MB/sec execute 62 sec latency 67.744 ms 2023-09-21T13:12:23.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 123530 37.57 MB/sec execute 63 sec latency 49.254 ms 2023-09-21T13:12:23.150 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:22 smithi156 ceph-mon[134078]: pgmap v511: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 665 op/s 2023-09-21T13:12:23.160 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:22 smithi142 ceph-mon[97663]: pgmap v511: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 665 op/s 2023-09-21T13:12:23.182 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:22 smithi160 ceph-mon[134450]: pgmap v511: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 12 MiB/s wr, 665 op/s 2023-09-21T13:12:24.055 INFO:tasks.workunit.client.0.smithi142.stdout: 10 123682 37.14 MB/sec execute 64 sec latency 780.424 ms 2023-09-21T13:12:25.059 INFO:tasks.workunit.client.0.smithi142.stdout: 10 124128 36.76 MB/sec execute 65 sec latency 167.314 ms 2023-09-21T13:12:25.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:25 smithi156 ceph-mon[134078]: pgmap v512: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 10 MiB/s wr, 552 op/s 2023-09-21T13:12:25.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:25 smithi142 ceph-mon[97663]: pgmap v512: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 10 MiB/s wr, 552 op/s 2023-09-21T13:12:25.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:25 smithi160 ceph-mon[134450]: pgmap v512: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 MiB/s rd, 10 MiB/s wr, 552 op/s 2023-09-21T13:12:25.773 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:12:26.056 INFO:tasks.workunit.client.0.smithi142.stdout: 10 124884 36.80 MB/sec execute 66 sec latency 109.763 ms 2023-09-21T13:12:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 -- 172.21.15.142:0/3552372206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92811a5c0 msgr2=0x7ff92811c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 --2- 172.21.15.142:0/3552372206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92811a5c0 0x7ff92811c9b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7ff918009990 tx=0x7ff918009ca0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 -- 172.21.15.142:0/3552372206 shutdown_connections 2023-09-21T13:12:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 --2- 172.21.15.142:0/3552372206 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92811a5c0 0x7ff92811c9b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 --2- 172.21.15.142:0/3552372206 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92810f530 0x7ff928107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 --2- 172.21.15.142:0/3552372206 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff92810f9a0 0x7ff928108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.971+0000 7ff92fbff700 1 -- 172.21.15.142:0/3552372206 >> 172.21.15.142:0/3552372206 conn(0x7ff92806cea0 msgr2=0x7ff92806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.972+0000 7ff92fbff700 1 -- 172.21.15.142:0/3552372206 shutdown_connections 2023-09-21T13:12:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.972+0000 7ff92fbff700 1 -- 172.21.15.142:0/3552372206 wait complete. 2023-09-21T13:12:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.973+0000 7ff92fbff700 1 Processor -- start 2023-09-21T13:12:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.973+0000 7ff92fbff700 1 -- start start 2023-09-21T13:12:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92810f530 0x7ff9281abcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff92810f9a0 0x7ff9281ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a61a0 con 0x7ff92810f9a0 2023-09-21T13:12:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a6310 con 0x7ff92810f530 2023-09-21T13:12:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92fbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9281a64d0 con 0x7ff92811a5c0 2023-09-21T13:12:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92e19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92e19c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57486/0 (socket says 172.21.15.142:57486) 2023-09-21T13:12:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92e19c700 1 -- 172.21.15.142:0/2129556425 learned_addr learned my addr 172.21.15.142:0/2129556425 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.974+0000 7ff92d99b700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92810f530 0x7ff9281abcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 -- 172.21.15.142:0/2129556425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92810f530 msgr2=0x7ff9281abcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92810f530 0x7ff9281abcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 -- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff92810f9a0 msgr2=0x7ff9281ac210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff92810f9a0 0x7ff9281ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 -- 172.21.15.142:0/2129556425 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180095f0 con 0x7ff92811a5c0 2023-09-21T13:12:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92e19c700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff918004730 tx=0x7ff918004760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff91effd700 1 -- 172.21.15.142:0/2129556425 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91801d070 con 0x7ff92811a5c0 2023-09-21T13:12:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff91effd700 1 -- 172.21.15.142:0/2129556425 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff918004060 con 0x7ff92811a5c0 2023-09-21T13:12:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff91effd700 1 -- 172.21.15.142:0/2129556425 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918005290 con 0x7ff92811a5c0 2023-09-21T13:12:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.975+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9281a6750 con 0x7ff92811a5c0 2023-09-21T13:12:26.972 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.976+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281b2cc0 con 0x7ff92811a5c0 2023-09-21T13:12:26.973 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.980+0000 7ff91effd700 1 -- 172.21.15.142:0/2129556425 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff9180047d0 con 0x7ff92811a5c0 2023-09-21T13:12:26.975 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.983+0000 7ff91effd700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 0x7ff9140a2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.983+0000 7ff91effd700 1 -- 172.21.15.142:0/2129556425 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff9180cd2b0 con 0x7ff92811a5c0 2023-09-21T13:12:26.978 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.986+0000 7ff92d99b700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 0x7ff9140a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:26.979 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:26.987+0000 7ff92d99b700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 0x7ff9140a2d70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff920005950 tx=0x7ff92000a300 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:26.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.001+0000 7ff9434c7b80 1 Processor -- start 2023-09-21T13:12:26.995 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 -- start start 2023-09-21T13:12:26.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:26.996 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4debc40 con 0x5613f4e8ce60 2023-09-21T13:12:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4dcfc10 con 0x5613f4e880b0 2023-09-21T13:12:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.002+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4dcd530 con 0x5613f4e889d0 2023-09-21T13:12:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.003+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.003+0000 7ff92d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:26.997 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.003+0000 7ff92d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40036/0 (socket says 172.21.15.142:40036) 2023-09-21T13:12:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.003+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57492/0 (socket says 172.21.15.142:57492) 2023-09-21T13:12:26.998 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.003+0000 7ff92d99b700 1 -- 172.21.15.142:0/1747606922 learned_addr learned my addr 172.21.15.142:0/1747606922 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.004+0000 7ff92d99b700 1 -- 172.21.15.142:0/1747606922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 msgr2=0x5613f4e8c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.004+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:26.999 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.004+0000 7ff92d99b700 1 -- 172.21.15.142:0/1747606922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 msgr2=0x5613f4e8d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.004+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.004+0000 7ff92d99b700 1 -- 172.21.15.142:0/1747606922 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613f4bf3d80 con 0x5613f4e880b0 2023-09-21T13:12:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.005+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff92000fde0 tx=0x7ff920012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9c037640dec0139 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.005+0000 7ff913fff700 1 -- 172.21.15.142:0/1747606922 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200108c0 con 0x5613f4e880b0 2023-09-21T13:12:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.006+0000 7ff913fff700 1 -- 172.21.15.142:0/1747606922 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff920020070 con 0x5613f4e880b0 2023-09-21T13:12:27.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.006+0000 7ff913fff700 1 -- 172.21.15.142:0/1747606922 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920025de0 con 0x5613f4e880b0 2023-09-21T13:12:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1747606922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 msgr2=0x5613f4e88490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff92000fde0 tx=0x7ff920012000 comp rx=0 tx=0).stop 2023-09-21T13:12:27.002 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1747606922 shutdown_connections 2023-09-21T13:12:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e88490 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1747606922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.007+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1747606922 >> 172.21.15.142:0/1747606922 conn(0x5613f4da3fa0 msgr2=0x5613f4e720c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.003 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.008+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1747606922 shutdown_connections 2023-09-21T13:12:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.008+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1747606922 wait complete. 2023-09-21T13:12:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.009+0000 7ff9434c7b80 1 -- start start 2023-09-21T13:12:27.004 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 Processor -- start 2023-09-21T13:12:27.005 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e919a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e8ce60 0x5613f4e92420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4dc8e20 con 0x5613f4e880b0 2023-09-21T13:12:27.006 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4d656e0 con 0x5613f4e889d0 2023-09-21T13:12:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.010+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4d65380 con 0x5613f4e8ce60 2023-09-21T13:12:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff9434c7b80 10 client.0 _ll_register_callbacks cb 0x5613f4cafa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40048/0 (socket says 172.21.15.142:40048) 2023-09-21T13:12:27.007 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 -- 172.21.15.142:0/1827057245 learned_addr learned my addr 172.21.15.142:0/1827057245 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92e19c700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e8ce60 0x5613f4e92420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 -- 172.21.15.142:0/1827057245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e8ce60 msgr2=0x5613f4e92420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.008 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e8ce60 0x5613f4e92420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 -- 172.21.15.142:0/1827057245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 msgr2=0x5613f4e919a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e919a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.011+0000 7ff92d19a700 1 -- 172.21.15.142:0/1827057245 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff92000fa90 con 0x5613f4e889d0 2023-09-21T13:12:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff92d19a700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ab00 tx=0x7ff92400aec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc39ec520caf13f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.009 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff9117fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:12:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff924010040 con 0x5613f4e889d0 2023-09-21T13:12:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5613f4d39b50 con 0x5613f4e889d0 2023-09-21T13:12:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff92400ea80 con 0x5613f4e889d0 2023-09-21T13:12:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.012+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff92400ec40 con 0x5613f4e889d0 2023-09-21T13:12:27.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.013+0000 7ff9434c7b80 10 client.28334 fetch_fsmap learned FSMap version 54 2023-09-21T13:12:27.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.013+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5613f4bdcc00 con 0x5613f4e889d0 2023-09-21T13:12:27.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.013+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5613f4d39b50 con 0x5613f4e889d0 2023-09-21T13:12:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.013+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff924008030 con 0x5613f4e889d0 2023-09-21T13:12:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 10 client.28334 fetch_fsmap finished waiting for FSMap version 54 2023-09-21T13:12:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 10 client.28334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 20 client.28334 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:27.013 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ea2130 0x5613f4ea4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 4 client.28334 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5613f4e45fc0 con 0x5613f4ea2130 2023-09-21T13:12:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.014+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ea2130 0x5613f4ea4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.015+0000 7ff92d99b700 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ea2130 0x5613f4ea4550 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21792d26af226643 server_cookie=9efaa2d835cc57f in_seq=0 out_seq=0 2023-09-21T13:12:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.015+0000 7ff9117fa700 10 client.28334 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.018+0000 7ff9117fa700 1 -- 172.21.15.142:0/1827057245 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5613f4e45fc0 con 0x5613f4ea2130 2023-09-21T13:12:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.018+0000 7ff9117fa700 10 client.28334 handle_command_reply: tid=0 2023-09-21T13:12:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.018+0000 7ff9434c7b80 1 client.28334 shutdown 2023-09-21T13:12:27.015 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.018+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 msgr2=0x5613f4e91ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.018+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7ff92400ab00 tx=0x7ff92400aec0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 shutdown_connections 2023-09-21T13:12:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ea2130 0x5613f4ea4550 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e919a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.016 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e8ce60 0x5613f4e92420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/1827057245 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e889d0 0x5613f4e91ee0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 >> 172.21.15.142:0/1827057245 conn(0x5613f4da3fa0 msgr2=0x5613f4e71cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9117fa700 0 client.28334 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 shutdown_connections 2023-09-21T13:12:27.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.019+0000 7ff9434c7b80 1 -- 172.21.15.142:0/1827057245 wait complete. 2023-09-21T13:12:27.018 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.020+0000 7ff9434c7b80 20 client.28334 trim_cache size 0 max 16384 2023-09-21T13:12:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.042+0000 7ff9434c7b80 1 Processor -- start 2023-09-21T13:12:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 -- start start 2023-09-21T13:12:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e99010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4c498c0 con 0x5613f4e880b0 2023-09-21T13:12:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4e72ef0 con 0x5613f4e8ce60 2023-09-21T13:12:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4e99550 con 0x5613f4e889d0 2023-09-21T13:12:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92e19c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.038 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92e19c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40052/0 (socket says 172.21.15.142:40052) 2023-09-21T13:12:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92d19a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57510/0 (socket says 172.21.15.142:57510) 2023-09-21T13:12:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92e19c700 1 -- 172.21.15.142:0/4172378038 learned_addr learned my addr 172.21.15.142:0/4172378038 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.043+0000 7ff92d99b700 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e99010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.039 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 -- 172.21.15.142:0/4172378038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 msgr2=0x5613f4e8bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 -- 172.21.15.142:0/4172378038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 msgr2=0x5613f4e99010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e99010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 -- 172.21.15.142:0/4172378038 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613f4ea9180 con 0x5613f4e8ce60 2023-09-21T13:12:27.040 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff92e19c700 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff918096db0 tx=0x7ff91809a470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c96efd7407702 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff91cbff700 1 -- 172.21.15.142:0/4172378038 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91809afb0 con 0x5613f4e8ce60 2023-09-21T13:12:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff91cbff700 1 -- 172.21.15.142:0/4172378038 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff9180af070 con 0x5613f4e8ce60 2023-09-21T13:12:27.041 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.044+0000 7ff91cbff700 1 -- 172.21.15.142:0/4172378038 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91809ad70 con 0x5613f4e8ce60 2023-09-21T13:12:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 -- 172.21.15.142:0/4172378038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 msgr2=0x5613f4e8c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7ff918096db0 tx=0x7ff91809a470 comp rx=0 tx=0).stop 2023-09-21T13:12:27.043 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 -- 172.21.15.142:0/4172378038 shutdown_connections 2023-09-21T13:12:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e880b0 0x5613f4e99010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e8ce60 0x5613f4e8c4c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/4172378038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 -- 172.21.15.142:0/4172378038 >> 172.21.15.142:0/4172378038 conn(0x5613f4da3fa0 msgr2=0x5613f4e8b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.044 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 -- 172.21.15.142:0/4172378038 shutdown_connections 2023-09-21T13:12:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.045+0000 7ff9434c7b80 1 -- 172.21.15.142:0/4172378038 wait complete. 2023-09-21T13:12:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.046+0000 7ff9434c7b80 1 -- start start 2023-09-21T13:12:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.046+0000 7ff9434c7b80 1 Processor -- start 2023-09-21T13:12:27.045 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4e8aaa0 con 0x5613f4e8ce60 2023-09-21T13:12:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4e8d780 con 0x5613f4e880b0 2023-09-21T13:12:27.046 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613f4e8d940 con 0x5613f4e889d0 2023-09-21T13:12:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff9434c7b80 10 client.0 _ll_register_callbacks cb 0x5613f4cafa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff92d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff92d99b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40068/0 (socket says 172.21.15.142:40068) 2023-09-21T13:12:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.047+0000 7ff92d99b700 1 -- 172.21.15.142:0/978510866 learned_addr learned my addr 172.21.15.142:0/978510866 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.047 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 -- 172.21.15.142:0/978510866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 msgr2=0x5613f4e8a2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:12:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8a2c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 -- 172.21.15.142:0/978510866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 msgr2=0x5613f4e8d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 -- 172.21.15.142:0/978510866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9281b2cc0 con 0x5613f4e880b0 2023-09-21T13:12:27.048 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff92d99b700 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff92000fd80 tx=0x7ff920025540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f60369d8dc46e93 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff9117fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:12:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.048+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920011c80 con 0x5613f4e880b0 2023-09-21T13:12:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.049+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff920011de0 con 0x5613f4e880b0 2023-09-21T13:12:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.049+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff920020070 con 0x5613f4e880b0 2023-09-21T13:12:27.049 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.049+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff920030980 con 0x5613f4e880b0 2023-09-21T13:12:27.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.051+0000 7ff9434c7b80 10 client.28340 fetch_fsmap learned FSMap version 54 2023-09-21T13:12:27.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.051+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x5613f4c1a1f0 con 0x5613f4e880b0 2023-09-21T13:12:27.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff920020070 con 0x5613f4e880b0 2023-09-21T13:12:27.051 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 54) v1 ==== 7890+0+0 (secure 0 0 0) 0x7ff920025710 con 0x5613f4e880b0 2023-09-21T13:12:27.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 10 client.28340 fetch_fsmap finished waiting for FSMap version 54 2023-09-21T13:12:27.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 10 client.28340 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:27.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 20 client.28340 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:27.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ef6d40 0x5613f4ef91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.052 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 4 client.28340 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:12:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.052+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5613f4dc1e00 con 0x5613f4ef6d40 2023-09-21T13:12:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.053+0000 7ff92d19a700 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ef6d40 0x5613f4ef91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.053+0000 7ff92d19a700 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ef6d40 0x5613f4ef91a0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=977d3c6c602163cc server_cookie=20e22aafbd38ca42 in_seq=0 out_seq=0 2023-09-21T13:12:27.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.053+0000 7ff9117fa700 10 client.28340 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.056 INFO:tasks.workunit.client.0.smithi142.stdout: 10 125772 36.82 MB/sec execute 67 sec latency 76.039 ms 2023-09-21T13:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.298+0000 7ff9117fa700 1 -- 172.21.15.142:0/978510866 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5613f4dc1e00 con 0x5613f4ef6d40 2023-09-21T13:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.298+0000 7ff9117fa700 10 client.28340 handle_command_reply: tid=0 2023-09-21T13:12:27.291 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.298+0000 7ff9434c7b80 1 client.28340 shutdown 2023-09-21T13:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.298+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 msgr2=0x5613f4e89d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.292 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.298+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff92000fd80 tx=0x7ff920025540 comp rx=0 tx=0).stop 2023-09-21T13:12:27.293 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 shutdown_connections 2023-09-21T13:12:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5613f4ef6d40 0x5613f4ef91a0 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5613f4e8ce60 0x5613f4e8d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.294 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5613f4e880b0 0x5613f4e89d80 secure :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7ff92000fd80 tx=0x7ff920025540 comp rx=0 tx=0).stop 2023-09-21T13:12:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 --2- 172.21.15.142:0/978510866 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5613f4e889d0 0x5613f4e8a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 >> 172.21.15.142:0/978510866 conn(0x5613f4da3fa0 msgr2=0x5613f4e8bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.295 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.301+0000 7ff9117fa700 0 client.28340 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.302+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 shutdown_connections 2023-09-21T13:12:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.302+0000 7ff9434c7b80 1 -- 172.21.15.142:0/978510866 wait complete. 2023-09-21T13:12:27.296 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.302+0000 7ff9434c7b80 20 client.28340 trim_cache size 0 max 16384 2023-09-21T13:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:12:27.297 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.303+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 msgr2=0x7ff9140a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.303+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 0x7ff9140a2d70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff920005950 tx=0x7ff92000a300 comp rx=0 tx=0).stop 2023-09-21T13:12:27.298 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.303+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 msgr2=0x7ff9281a5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.303+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff918004730 tx=0x7ff918004760 comp rx=0 tx=0).stop 2023-09-21T13:12:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.303+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 shutdown_connections 2023-09-21T13:12:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff9140a08b0 0x7ff9140a2d70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff92811a5c0 0x7ff9281a5b30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff92810f530 0x7ff9281abcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 --2- 172.21.15.142:0/2129556425 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff92810f9a0 0x7ff9281ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 >> 172.21.15.142:0/2129556425 conn(0x7ff92806cea0 msgr2=0x7ff9281185b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 shutdown_connections 2023-09-21T13:12:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:27.304+0000 7ff92fbff700 1 -- 172.21.15.142:0/2129556425 wait complete. 2023-09-21T13:12:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 -- 172.21.15.142:0/4036387316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac1082f0 msgr2=0x7f5fac10fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/4036387316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac1082f0 0x7f5fac10fe70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4009990 tx=0x7f5fa4009ca0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 -- 172.21.15.142:0/4036387316 shutdown_connections 2023-09-21T13:12:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/4036387316 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac1082f0 0x7f5fac10fe70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/4036387316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1031d0 0x7f5fac1035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/4036387316 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fac103b80 0x7f5fac107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.309+0000 7f5fb09ff700 1 -- 172.21.15.142:0/4036387316 >> 172.21.15.142:0/4036387316 conn(0x7f5fac0fea30 msgr2=0x7f5fac100e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.310+0000 7f5fb09ff700 1 -- 172.21.15.142:0/4036387316 shutdown_connections 2023-09-21T13:12:27.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.311+0000 7f5fb09ff700 1 -- 172.21.15.142:0/4036387316 wait complete. 2023-09-21T13:12:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.312+0000 7f5fb09ff700 1 Processor -- start 2023-09-21T13:12:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 -- start start 2023-09-21T13:12:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fac1031d0 0x7f5fac0752f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 0x7f5fac075830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 0x7f5fac1a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1a9b30 con 0x7f5fac1031d0 2023-09-21T13:12:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1a9c70 con 0x7f5fac075d70 2023-09-21T13:12:27.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.313+0000 7f5fb09ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1a9de0 con 0x7f5fac1082f0 2023-09-21T13:12:27.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 0x7f5fac1a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5faad9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 0x7f5fac1a95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40090/0 (socket says 172.21.15.142:40090) 2023-09-21T13:12:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 0x7f5fac075830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5faad9d700 1 -- 172.21.15.142:0/736289535 learned_addr learned my addr 172.21.15.142:0/736289535 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/736289535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 msgr2=0x7f5fac1a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 0x7f5fac1a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fac1031d0 msgr2=0x7f5fac0752f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fac1031d0 0x7f5fac0752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.314+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/736289535 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa40095f0 con 0x7f5fac1082f0 2023-09-21T13:12:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.315+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 0x7f5fac075830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400c940 tx=0x7f5f9400cc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.315+0000 7f5fa37fe700 1 -- 172.21.15.142:0/736289535 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94004440 con 0x7f5fac1082f0 2023-09-21T13:12:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.315+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac1aa0c0 con 0x7f5fac1082f0 2023-09-21T13:12:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.315+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac1aa620 con 0x7f5fac1082f0 2023-09-21T13:12:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.316+0000 7f5fa37fe700 1 -- 172.21.15.142:0/736289535 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9400ce30 con 0x7f5fac1082f0 2023-09-21T13:12:27.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.316+0000 7f5fa37fe700 1 -- 172.21.15.142:0/736289535 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f94007c60 con 0x7f5fac1082f0 2023-09-21T13:12:27.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.320+0000 7f5fa37fe700 1 -- 172.21.15.142:0/736289535 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f5f94003680 con 0x7f5fac1082f0 2023-09-21T13:12:27.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.321+0000 7f5fc4245b80 1 Processor -- start 2023-09-21T13:12:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.321+0000 7f5fc4245b80 1 -- start start 2023-09-21T13:12:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681f610 0x55a29681f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 0x55a296823e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 0x55a2968247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296793ca0 con 0x55a29681f610 2023-09-21T13:12:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296777c70 con 0x55a296824360 2023-09-21T13:12:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296775590 con 0x55a29681ff30 2023-09-21T13:12:27.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fa9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 0x55a2968247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fa9d9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 0x55a2968247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40106/0 (socket says 172.21.15.142:40106) 2023-09-21T13:12:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.322+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/1632362095 learned_addr learned my addr 172.21.15.142:0/1632362095 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.323+0000 7f5fa37fe700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 0x7f5f980a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.323+0000 7f5fa37fe700 1 -- 172.21.15.142:0/736289535 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5f940cbdf0 con 0x7f5fac1082f0 2023-09-21T13:12:27.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.323+0000 7f5faa59c700 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 0x55a296823e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faad9d700 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681f610 0x55a29681f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 -- 172.21.15.142:0/1632362095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 msgr2=0x55a2968247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 0x55a2968247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 -- 172.21.15.142:0/1632362095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681f610 msgr2=0x55a29681f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681f610 0x55a29681f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 -- 172.21.15.142:0/1632362095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a29659bde0 con 0x55a29681ff30 2023-09-21T13:12:27.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.324+0000 7f5faa59c700 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 0x55a296823e20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009d40 tx=0x7f5f9c00b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1d5d863958edefd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.325+0000 7f5fa0ff9700 1 -- 172.21.15.142:0/1632362095 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c009e90 con 0x55a29681ff30 2023-09-21T13:12:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.325+0000 7f5fa0ff9700 1 -- 172.21.15.142:0/1632362095 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c0138d0 con 0x55a29681ff30 2023-09-21T13:12:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.325+0000 7f5fa0ff9700 1 -- 172.21.15.142:0/1632362095 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0128b0 con 0x55a29681ff30 2023-09-21T13:12:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.325+0000 7f5fc4245b80 1 -- 172.21.15.142:0/1632362095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 msgr2=0x55a296823e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.325+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 0x55a296823e20 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009d40 tx=0x7f5f9c00b6f0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.326+0000 7f5faad9d700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 0x7f5f980a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.327+0000 7f5fc4245b80 1 -- 172.21.15.142:0/1632362095 shutdown_connections 2023-09-21T13:12:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.327+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681f610 0x55a29681f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.327+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a296824360 0x55a2968247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.327+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/1632362095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681ff30 0x55a296823e20 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.327+0000 7f5fc4245b80 1 -- 172.21.15.142:0/1632362095 >> 172.21.15.142:0/1632362095 conn(0x55a29674c000 msgr2=0x55a29681a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.328+0000 7f5faad9d700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 0x7f5f980a2db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b5c0 tx=0x7f5fa401a040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.328+0000 7f5fc4245b80 1 -- 172.21.15.142:0/1632362095 shutdown_connections 2023-09-21T13:12:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.328+0000 7f5fc4245b80 1 -- 172.21.15.142:0/1632362095 wait complete. 2023-09-21T13:12:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.329+0000 7f5fc4245b80 1 -- start start 2023-09-21T13:12:27.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.329+0000 7f5fc4245b80 1 Processor -- start 2023-09-21T13:12:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a29682ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.326 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296829210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296770e80 con 0x55a29681ff30 2023-09-21T13:12:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a29670d740 con 0x55a29681f610 2023-09-21T13:12:27.327 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a29670d3e0 con 0x55a296824360 2023-09-21T13:12:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fc4245b80 10 client.0 _ll_register_callbacks cb 0x55a296657a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a29682ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a29682ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40116/0 (socket says 172.21.15.142:40116) 2023-09-21T13:12:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5faa59c700 1 -- 172.21.15.142:0/753229051 learned_addr learned my addr 172.21.15.142:0/753229051 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.328 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.331+0000 7f5faad9d700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296829210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 -- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 msgr2=0x55a29682ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a29682ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 -- 172.21.15.142:0/753229051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 msgr2=0x55a296828c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.329 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 -- 172.21.15.142:0/753229051 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c009970 con 0x55a296824360 2023-09-21T13:12:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5faad9d700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296829210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4005910 tx=0x7f5fa4005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1647373a61d93eea server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.332+0000 7f5f91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa401d030 con 0x55a296824360 2023-09-21T13:12:27.330 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5fa401e070 con 0x55a296824360 2023-09-21T13:12:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2966e1bb0 con 0x55a296824360 2023-09-21T13:12:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fa4009ee0 con 0x55a296824360 2023-09-21T13:12:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5fc4245b80 10 client.28279 fetch_fsmap learned FSMap version 55 2023-09-21T13:12:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.333+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55a296584c60 con 0x55a296824360 2023-09-21T13:12:27.331 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5fa403b020 con 0x55a296824360 2023-09-21T13:12:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 55) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f5fa402e810 con 0x55a296824360 2023-09-21T13:12:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 10 client.28279 fetch_fsmap finished waiting for FSMap version 55 2023-09-21T13:12:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 10 client.28279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 20 client.28279 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:27.332 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29684a420 0x55a29684c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 4 client.28279 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:27.333 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.334+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2967ee020 con 0x55a29684a420 2023-09-21T13:12:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.335+0000 7f5faa59c700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29684a420 0x55a29684c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.334 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.336+0000 7f5faa59c700 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29684a420 0x55a29684c860 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37bf12a7e3c8190b server_cookie=e169155aee513502 in_seq=0 out_seq=0 2023-09-21T13:12:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.337+0000 7f5f91ffb700 10 client.28279 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5f91ffb700 1 -- 172.21.15.142:0/753229051 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a2967ee020 con 0x55a29684a420 2023-09-21T13:12:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5f91ffb700 10 client.28279 handle_command_reply: tid=0 2023-09-21T13:12:27.335 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 client.28279 shutdown 2023-09-21T13:12:27.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 msgr2=0x55a296829210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296829210 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4005910 tx=0x7f5fa4005fd0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 shutdown_connections 2023-09-21T13:12:27.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29684a420 0x55a29684c860 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.336 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296829210 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a29682ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/753229051 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 >> 172.21.15.142:0/753229051 conn(0x55a29674c000 msgr2=0x55a29681a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.339+0000 7f5f91ffb700 0 client.28279 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.337 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.340+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 shutdown_connections 2023-09-21T13:12:27.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.340+0000 7f5fc4245b80 1 -- 172.21.15.142:0/753229051 wait complete. 2023-09-21T13:12:27.338 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.340+0000 7f5fc4245b80 20 client.28279 trim_cache size 0 max 16384 2023-09-21T13:12:27.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.363+0000 7f5fc4245b80 1 Processor -- start 2023-09-21T13:12:27.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.363+0000 7f5fc4245b80 1 -- start start 2023-09-21T13:12:27.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296825750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2965f1920 con 0x55a29681ff30 2023-09-21T13:12:27.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296814a00 con 0x55a29681f610 2023-09-21T13:12:27.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a29681b470 con 0x55a296824360 2023-09-21T13:12:27.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:40130/0 (socket says 172.21.15.142:40130) 2023-09-21T13:12:27.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5faa59c700 1 -- 172.21.15.142:0/4176093190 learned_addr learned my addr 172.21.15.142:0/4176093190 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5faad9d700 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296825750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.364+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 -- 172.21.15.142:0/4176093190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 msgr2=0x55a296825750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296825750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 -- 172.21.15.142:0/4176093190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 msgr2=0x55a296828480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.360 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 -- 172.21.15.142:0/4176093190 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a296846a30 con 0x55a29681f610 2023-09-21T13:12:27.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.365+0000 7f5faa59c700 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c000f80 tx=0x7f5f9c00b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a44195640a6a1095 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.366+0000 7f5fa17fa700 1 -- 172.21.15.142:0/4176093190 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c013d00 con 0x55a29681f610 2023-09-21T13:12:27.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.366+0000 7f5fa17fa700 1 -- 172.21.15.142:0/4176093190 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c013a40 con 0x55a29681f610 2023-09-21T13:12:27.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.366+0000 7f5fa17fa700 1 -- 172.21.15.142:0/4176093190 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0249e0 con 0x55a29681f610 2023-09-21T13:12:27.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 -- 172.21.15.142:0/4176093190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 msgr2=0x55a296841580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c000f80 tx=0x7f5f9c00b6f0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 -- 172.21.15.142:0/4176093190 shutdown_connections 2023-09-21T13:12:27.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a296824360 0x55a296825750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681f610 0x55a296841580 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/4176093190 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a29681ff30 0x55a296828480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.367+0000 7f5fc4245b80 1 -- 172.21.15.142:0/4176093190 >> 172.21.15.142:0/4176093190 conn(0x55a29674c000 msgr2=0x55a296828c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.369+0000 7f5fc4245b80 1 -- 172.21.15.142:0/4176093190 shutdown_connections 2023-09-21T13:12:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.370+0000 7f5fc4245b80 1 -- 172.21.15.142:0/4176093190 wait complete. 2023-09-21T13:12:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.370+0000 7f5fc4245b80 1 -- start start 2023-09-21T13:12:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 Processor -- start 2023-09-21T13:12:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 0x55a29683d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 0x55a29683df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a296824360 0x55a29683e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a296841930 con 0x55a296824360 2023-09-21T13:12:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a29689e2b0 con 0x55a29681ff30 2023-09-21T13:12:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a29689e470 con 0x55a29681f610 2023-09-21T13:12:27.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.371+0000 7f5fc4245b80 10 client.0 _ll_register_callbacks cb 0x55a296657a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.372+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 0x55a29683d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.372+0000 7f5faa59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 0x55a29683d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:57572/0 (socket says 172.21.15.142:57572) 2023-09-21T13:12:27.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.372+0000 7f5faa59c700 1 -- 172.21.15.142:0/599513550 learned_addr learned my addr 172.21.15.142:0/599513550 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.373+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 0x55a29683df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.373+0000 7f5faad9d700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a296824360 0x55a29683e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/599513550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 msgr2=0x55a29683d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 0x55a29683d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.369 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/599513550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a296824360 msgr2=0x55a29683e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a296824360 0x55a29683e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 -- 172.21.15.142:0/599513550 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a29659bde0 con 0x55a29681ff30 2023-09-21T13:12:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5fa9d9b700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 0x55a29683df10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f94098f40 tx=0x7f5f94098d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6cc81c5dd884bdf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5f91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:12:27.370 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.374+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940996a0 con 0x55a29681ff30 2023-09-21T13:12:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f5f94099240 con 0x55a29681ff30 2023-09-21T13:12:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f9c0138d0 con 0x55a29681ff30 2023-09-21T13:12:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f9409d070 con 0x55a29681ff30 2023-09-21T13:12:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5fc4245b80 10 client.28358 fetch_fsmap learned FSMap version 55 2023-09-21T13:12:27.371 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55a2965c2250 con 0x55a29681ff30 2023-09-21T13:12:27.372 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.375+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f9c0138d0 con 0x55a29681ff30 2023-09-21T13:12:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 55) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f5f940a0e20 con 0x55a29681ff30 2023-09-21T13:12:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 10 client.28358 fetch_fsmap finished waiting for FSMap version 55 2023-09-21T13:12:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 10 client.28358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:27.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 20 client.28358 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29689fc20 0x55a2968a2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 4 client.28358 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:12:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.376+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a296769e60 con 0x55a29689fc20 2023-09-21T13:12:27.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.377+0000 7f5faa59c700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29689fc20 0x55a2968a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.378+0000 7f5faa59c700 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29689fc20 0x55a2968a2040 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cdcdfb63e5528a4 server_cookie=e51bdb77fb5f95d5 in_seq=0 out_seq=0 2023-09-21T13:12:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.378+0000 7f5f91ffb700 10 client.28358 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.379+0000 7f5f91ffb700 1 -- 172.21.15.142:0/599513550 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a296769e60 con 0x55a29689fc20 2023-09-21T13:12:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.379+0000 7f5f91ffb700 10 client.28358 handle_command_reply: tid=0 2023-09-21T13:12:27.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.379+0000 7f5fc4245b80 1 client.28358 shutdown 2023-09-21T13:12:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 msgr2=0x55a29683df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 0x55a29683df10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f94098f40 tx=0x7f5f94098d80 comp rx=0 tx=0).stop 2023-09-21T13:12:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 shutdown_connections 2023-09-21T13:12:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a29689fc20 0x55a2968a2040 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a296824360 0x55a29683e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a29681f610 0x55a29683d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 --2- 172.21.15.142:0/599513550 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a29681ff30 0x55a29683df10 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5f94098f40 tx=0x7f5f94098d80 comp rx=0 tx=0).stop 2023-09-21T13:12:27.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 >> 172.21.15.142:0/599513550 conn(0x55a29674c000 msgr2=0x55a29681e410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.380+0000 7f5f91ffb700 0 client.28358 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:27.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.381+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 shutdown_connections 2023-09-21T13:12:27.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.382+0000 7f5fc4245b80 1 -- 172.21.15.142:0/599513550 wait complete. 2023-09-21T13:12:27.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.382+0000 7f5fc4245b80 20 client.28358 trim_cache size 0 max 16384 2023-09-21T13:12:27.379 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:12:27.379 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:12:27.379 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:12:27.379 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:12:27.380 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:12:27.380 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:12:27.380 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:12:27.380 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:12:27.381 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:12:27.381 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:12:27.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 msgr2=0x7f5f980a2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 0x7f5f980a2db0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5fa400b5c0 tx=0x7f5fa401a040 comp rx=0 tx=0).stop 2023-09-21T13:12:27.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 msgr2=0x7f5fac075830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:27.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 0x7f5fac075830 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f9400c940 tx=0x7f5f9400cc50 comp rx=0 tx=0).stop 2023-09-21T13:12:27.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 shutdown_connections 2023-09-21T13:12:27.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f5f980a08f0 0x7f5f980a2db0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f5fac1031d0 0x7f5fac0752f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f5fac075d70 0x7f5fac1a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 --2- 172.21.15.142:0/736289535 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5fac1082f0 0x7f5fac075830 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:27.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 >> 172.21.15.142:0/736289535 conn(0x7f5fac0fea30 msgr2=0x7f5fac1004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:27.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.383+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 shutdown_connections 2023-09-21T13:12:27.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:27.384+0000 7f5fb09ff700 1 -- 172.21.15.142:0/736289535 wait complete. 2023-09-21T13:12:27.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:27 smithi156 ceph-mon[134078]: pgmap v513: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 12 MiB/s wr, 639 op/s 2023-09-21T13:12:27.399 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:27 smithi142 ceph-mon[97663]: pgmap v513: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 12 MiB/s wr, 639 op/s 2023-09-21T13:12:27.402 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:12:27.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:27 smithi160 ceph-mon[134450]: pgmap v513: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 12 MiB/s wr, 639 op/s 2023-09-21T13:12:28.057 INFO:tasks.workunit.client.0.smithi142.stdout: 10 126472 37.00 MB/sec execute 68 sec latency 222.214 ms 2023-09-21T13:12:28.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:28 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:28.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:28 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:28.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:28 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:29.057 INFO:tasks.workunit.client.0.smithi142.stdout: 10 127039 37.08 MB/sec execute 69 sec latency 260.738 ms 2023-09-21T13:12:29.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:29 smithi156 ceph-mon[134078]: pgmap v514: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 790 op/s 2023-09-21T13:12:29.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:29 smithi142 ceph-mon[97663]: pgmap v514: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 790 op/s 2023-09-21T13:12:29.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:29 smithi160 ceph-mon[134450]: pgmap v514: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 16 MiB/s wr, 790 op/s 2023-09-21T13:12:30.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 127534 36.79 MB/sec execute 70 sec latency 100.761 ms 2023-09-21T13:12:31.057 INFO:tasks.workunit.client.0.smithi142.stdout: 10 128304 36.84 MB/sec execute 71 sec latency 80.409 ms 2023-09-21T13:12:31.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:31 smithi156 ceph-mon[134078]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 604 op/s 2023-09-21T13:12:31.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:31 smithi142 ceph-mon[97663]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 604 op/s 2023-09-21T13:12:31.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:31 smithi160 ceph-mon[134450]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 MiB/s rd, 12 MiB/s wr, 604 op/s 2023-09-21T13:12:32.057 INFO:tasks.workunit.client.0.smithi142.stdout: 10 129116 36.82 MB/sec execute 72 sec latency 66.854 ms 2023-09-21T13:12:33.057 INFO:tasks.workunit.client.0.smithi142.stdout: 10 130008 37.15 MB/sec execute 73 sec latency 43.678 ms 2023-09-21T13:12:33.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:33 smithi156 ceph-mon[134078]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 18 MiB/s wr, 943 op/s 2023-09-21T13:12:33.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:33 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:33.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:33 smithi142 ceph-mon[97663]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 18 MiB/s wr, 943 op/s 2023-09-21T13:12:33.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:33 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:33.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:33 smithi160 ceph-mon[134450]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 18 MiB/s wr, 943 op/s 2023-09-21T13:12:33.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:33 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:12:34.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 130707 37.13 MB/sec execute 74 sec latency 83.391 ms 2023-09-21T13:12:35.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 131490 37.08 MB/sec execute 75 sec latency 93.807 ms 2023-09-21T13:12:35.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:35 smithi156 ceph-mon[134078]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 14 MiB/s wr, 691 op/s 2023-09-21T13:12:35.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:35 smithi142 ceph-mon[97663]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 14 MiB/s wr, 691 op/s 2023-09-21T13:12:35.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:35 smithi160 ceph-mon[134450]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 MiB/s rd, 14 MiB/s wr, 691 op/s 2023-09-21T13:12:36.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 132490 37.32 MB/sec execute 76 sec latency 114.755 ms 2023-09-21T13:12:37.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 133032 37.30 MB/sec execute 77 sec latency 246.632 ms 2023-09-21T13:12:37.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:37 smithi156 ceph-mon[134078]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 15 MiB/s wr, 762 op/s 2023-09-21T13:12:37.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:37 smithi142 ceph-mon[97663]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 15 MiB/s wr, 762 op/s 2023-09-21T13:12:37.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:37 smithi160 ceph-mon[134450]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 15 MiB/s wr, 762 op/s 2023-09-21T13:12:38.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 133828 37.47 MB/sec execute 78 sec latency 55.172 ms 2023-09-21T13:12:39.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 134403 37.28 MB/sec execute 79 sec latency 136.219 ms 2023-09-21T13:12:39.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:39 smithi156 ceph-mon[134078]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 828 op/s 2023-09-21T13:12:39.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:39 smithi142 ceph-mon[97663]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 828 op/s 2023-09-21T13:12:39.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:39 smithi160 ceph-mon[134450]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 MiB/s rd, 15 MiB/s wr, 828 op/s 2023-09-21T13:12:40.058 INFO:tasks.workunit.client.0.smithi142.stdout: 10 135283 37.30 MB/sec execute 80 sec latency 67.132 ms 2023-09-21T13:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.632+0000 7faf943ff700 1 -- 172.21.15.142:0/4054931122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c11a5c0 msgr2=0x7faf8c11c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.626 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.632+0000 7faf943ff700 1 --2- 172.21.15.142:0/4054931122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c11a5c0 0x7faf8c11c9b0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faf8400b0a0 tx=0x7faf8400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.636+0000 7faf943ff700 1 -- 172.21.15.142:0/4054931122 shutdown_connections 2023-09-21T13:12:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.636+0000 7faf943ff700 1 --2- 172.21.15.142:0/4054931122 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f530 0x7faf8c107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.636+0000 7faf943ff700 1 --2- 172.21.15.142:0/4054931122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c11a5c0 0x7faf8c11c9b0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.636+0000 7faf943ff700 1 --2- 172.21.15.142:0/4054931122 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c10f9a0 0x7faf8c108320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.636+0000 7faf943ff700 1 -- 172.21.15.142:0/4054931122 >> 172.21.15.142:0/4054931122 conn(0x7faf8c06cea0 msgr2=0x7faf8c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:40.648 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.655+0000 7faf943ff700 1 -- 172.21.15.142:0/4054931122 shutdown_connections 2023-09-21T13:12:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.666+0000 7faf943ff700 1 -- 172.21.15.142:0/4054931122 wait complete. 2023-09-21T13:12:40.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.668+0000 7faf943ff700 1 Processor -- start 2023-09-21T13:12:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.668+0000 7faf943ff700 1 -- start start 2023-09-21T13:12:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f9a0 0x7faf8c1ac120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c11a5c0 0x7faf8c1a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1a60b0 con 0x7faf8c10f9a0 2023-09-21T13:12:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1a6220 con 0x7faf8c11a5c0 2023-09-21T13:12:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.669+0000 7faf943ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c1a63e0 con 0x7faf8c10f530 2023-09-21T13:12:40.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.679+0000 7faf9219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.679+0000 7faf9219b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:55740/0 (socket says 172.21.15.142:55740) 2023-09-21T13:12:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.679+0000 7faf9219b700 1 -- 172.21.15.142:0/2258577154 learned_addr learned my addr 172.21.15.142:0/2258577154 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:40.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.679+0000 7faf9299c700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c11a5c0 0x7faf8c1a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.678 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.685+0000 7faf9199a700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f9a0 0x7faf8c1ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.693+0000 7faf9219b700 1 -- 172.21.15.142:0/2258577154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c11a5c0 msgr2=0x7faf8c1a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.693+0000 7faf9219b700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c11a5c0 0x7faf8c1a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.693+0000 7faf9219b700 1 -- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f9a0 msgr2=0x7faf8c1ac120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.693+0000 7faf9219b700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f9a0 0x7faf8c1ac120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.693+0000 7faf9219b700 1 -- 172.21.15.142:0/2258577154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf84009d00 con 0x7faf8c10f530 2023-09-21T13:12:40.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.705+0000 7faf9219b700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faf8800b530 tx=0x7faf8800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.716+0000 7faf837fe700 1 -- 172.21.15.142:0/2258577154 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88011830 con 0x7faf8c10f530 2023-09-21T13:12:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.716+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8c1a66c0 con 0x7faf8c10f530 2023-09-21T13:12:40.718 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.717+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c110000 con 0x7faf8c10f530 2023-09-21T13:12:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.723+0000 7fafa7cebb80 1 Processor -- start 2023-09-21T13:12:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.723+0000 7fafa7cebb80 1 -- start start 2023-09-21T13:12:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.719 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8da910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8dae50 0x56241a8db2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a84ac40 con 0x56241a8dae50 2023-09-21T13:12:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a82ec10 con 0x56241a8d69c0 2023-09-21T13:12:40.720 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.724+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a82c530 con 0x56241a8d60a0 2023-09-21T13:12:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.725+0000 7faf9299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.725+0000 7faf9299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:55750/0 (socket says 172.21.15.142:55750) 2023-09-21T13:12:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.725+0000 7faf9299c700 1 -- 172.21.15.142:0/3295534094 learned_addr learned my addr 172.21.15.142:0/3295534094 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:40.721 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.726+0000 7faf837fe700 1 -- 172.21.15.142:0/2258577154 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf88011e50 con 0x7faf8c10f530 2023-09-21T13:12:40.722 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.726+0000 7faf837fe700 1 -- 172.21.15.142:0/2258577154 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800f2e0 con 0x7faf8c10f530 2023-09-21T13:12:40.731 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.738+0000 7faf9219b700 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8da910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.738+0000 7faf9299c700 1 -- 172.21.15.142:0/3295534094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 msgr2=0x56241a8da910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.738+0000 7faf9299c700 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8da910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.739+0000 7faf9299c700 1 -- 172.21.15.142:0/3295534094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8dae50 msgr2=0x56241a8db2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.732 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.739+0000 7faf9299c700 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8dae50 0x56241a8db2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.733 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.739+0000 7faf9299c700 1 -- 172.21.15.142:0/3295534094 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241a652d80 con 0x56241a8d60a0 2023-09-21T13:12:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.743+0000 7faf837fe700 1 -- 172.21.15.142:0/2258577154 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7faf88011a50 con 0x7faf8c10f530 2023-09-21T13:12:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.746+0000 7faf837fe700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 0x7faf780a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.739 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.746+0000 7faf837fe700 1 -- 172.21.15.142:0/2258577154 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faf880cb900 con 0x7faf8c10f530 2023-09-21T13:12:40.740 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.747+0000 7faf9299c700 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faf8c06a150 tx=0x7faf840091e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4ae8712c9a598b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:40.765 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.771+0000 7faf80bfe700 1 -- 172.21.15.142:0/3295534094 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400e040 con 0x56241a8d60a0 2023-09-21T13:12:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.771+0000 7faf80bfe700 1 -- 172.21.15.142:0/3295534094 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf840074e0 con 0x56241a8d60a0 2023-09-21T13:12:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.771+0000 7faf80bfe700 1 -- 172.21.15.142:0/3295534094 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf840054b0 con 0x56241a8d60a0 2023-09-21T13:12:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3295534094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 msgr2=0x56241a8d6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faf8c06a150 tx=0x7faf840091e0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3295534094 shutdown_connections 2023-09-21T13:12:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8dae50 0x56241a8db2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a8d6480 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3295534094 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8da910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.772+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3295534094 >> 172.21.15.142:0/3295534094 conn(0x56241a802fa0 msgr2=0x56241a8d10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.773+0000 7faf9219b700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 0x7faf780a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.773+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3295534094 shutdown_connections 2023-09-21T13:12:40.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.773+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3295534094 wait complete. 2023-09-21T13:12:40.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.774+0000 7fafa7cebb80 1 -- start start 2023-09-21T13:12:40.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.782+0000 7fafa7cebb80 1 Processor -- start 2023-09-21T13:12:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8df8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8e0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a827e20 con 0x56241a8d60a0 2023-09-21T13:12:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a7c46e0 con 0x56241a8d69c0 2023-09-21T13:12:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a7c4380 con 0x56241a8dae50 2023-09-21T13:12:40.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7fafa7cebb80 10 client.0 _ll_register_callbacks cb 0x56241a70ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.783+0000 7faf9199a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8df8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.785+0000 7faf9199a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8df8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45610/0 (socket says 172.21.15.142:45610) 2023-09-21T13:12:40.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.785+0000 7faf9199a700 1 -- 172.21.15.142:0/790177314 learned_addr learned my addr 172.21.15.142:0/790177314 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.785+0000 7faf9299c700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.786+0000 7faf9299c700 1 -- 172.21.15.142:0/790177314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 msgr2=0x56241a8e0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.786+0000 7faf9299c700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.786+0000 7faf9299c700 1 -- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 msgr2=0x56241a8df8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.786+0000 7faf9299c700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8df8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.780 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.786+0000 7faf9299c700 1 -- 172.21.15.142:0/790177314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8c11d2e0 con 0x56241a8d60a0 2023-09-21T13:12:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.787+0000 7faf9299c700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e2650 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf84009750 tx=0x7faf84007650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d64f538e8b02bd server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:40.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.788+0000 7faf9219b700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 0x7faf780a2db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf88004790 tx=0x7faf88009380 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:40.786 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.794+0000 7faf75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:12:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.798+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400e040 con 0x56241a8d60a0 2023-09-21T13:12:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.798+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faf84007a00 con 0x56241a8d60a0 2023-09-21T13:12:40.791 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.798+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56241a798b50 con 0x56241a8d60a0 2023-09-21T13:12:40.795 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.803+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf840052b0 con 0x56241a8d60a0 2023-09-21T13:12:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.804+0000 7fafa7cebb80 10 client.18132 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:40.797 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.804+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x56241a63bc00 con 0x56241a8d60a0 2023-09-21T13:12:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.813+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56241a798b50 con 0x56241a8d60a0 2023-09-21T13:12:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf8400b0d0 con 0x56241a8d60a0 2023-09-21T13:12:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 10 client.18132 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 10 client.18132 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 20 client.18132 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a911ab0 0x56241a913ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 4 client.18132 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.814+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56241a8a4fc0 con 0x56241a911ab0 2023-09-21T13:12:40.815 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.823+0000 7faf9199a700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a911ab0 0x56241a913ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.845 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.853+0000 7faf9199a700 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a911ab0 0x56241a913ea0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d94774b65fdddc server_cookie=cfe9873019b209a1 in_seq=0 out_seq=0 2023-09-21T13:12:40.846 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.853+0000 7faf75ffb700 10 client.18132 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:40.865 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.873+0000 7faf75ffb700 1 -- 172.21.15.142:0/790177314 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56241a8a4fc0 con 0x56241a911ab0 2023-09-21T13:12:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.873+0000 7faf75ffb700 10 client.18132 handle_command_reply: tid=0 2023-09-21T13:12:40.866 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.873+0000 7fafa7cebb80 1 client.18132 shutdown 2023-09-21T13:12:40.872 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 msgr2=0x56241a8e2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e2650 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faf84009750 tx=0x7faf84007650 comp rx=0 tx=0).stop 2023-09-21T13:12:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 shutdown_connections 2023-09-21T13:12:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a911ab0 0x56241a913ea0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e2650 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.873 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/790177314 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8df8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.874 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.879+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 >> 172.21.15.142:0/790177314 conn(0x56241a802fa0 msgr2=0x56241a8d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.881+0000 7faf75ffb700 0 client.18132 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.881+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 shutdown_connections 2023-09-21T13:12:40.875 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.881+0000 7fafa7cebb80 1 -- 172.21.15.142:0/790177314 wait complete. 2023-09-21T13:12:40.881 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.889+0000 7fafa7cebb80 20 client.18132 trim_cache size 0 max 16384 2023-09-21T13:12:40.918 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 Processor -- start 2023-09-21T13:12:40.919 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 -- start start 2023-09-21T13:12:40.924 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8d9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a8cffa0 con 0x56241a8d60a0 2023-09-21T13:12:40.925 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a6a88c0 con 0x56241a8d69c0 2023-09-21T13:12:40.926 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.926+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a8e0910 con 0x56241a8dae50 2023-09-21T13:12:40.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.935+0000 7faf9299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8d9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.935+0000 7faf9299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.935+0000 7faf9299c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:56280/0 (socket says 172.21.15.142:56280) 2023-09-21T13:12:40.928 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.935+0000 7faf9299c700 1 -- 172.21.15.142:0/3060089684 learned_addr learned my addr 172.21.15.142:0/3060089684 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:40.931 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.939+0000 7faf9199a700 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.944+0000 7faf9199a700 1 -- 172.21.15.142:0/3060089684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 msgr2=0x56241a8d9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.937 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.944+0000 7faf9199a700 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8d9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.944+0000 7faf9199a700 1 -- 172.21.15.142:0/3060089684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 msgr2=0x56241a8e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:40.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.944+0000 7faf9199a700 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.938 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.944+0000 7faf9199a700 1 -- 172.21.15.142:0/3060089684 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56241a6791f0 con 0x56241a8d69c0 2023-09-21T13:12:40.951 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.959+0000 7faf9199a700 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8d8f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x56241a914710 tx=0x7faf7c00a500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5beb883c98cdfd85 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.971+0000 7faf813ff700 1 -- 172.21.15.142:0/3060089684 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c017040 con 0x56241a8d69c0 2023-09-21T13:12:40.963 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.971+0000 7faf813ff700 1 -- 172.21.15.142:0/3060089684 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf7c0192b0 con 0x56241a8d69c0 2023-09-21T13:12:40.964 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.971+0000 7faf813ff700 1 -- 172.21.15.142:0/3060089684 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c010430 con 0x56241a8d69c0 2023-09-21T13:12:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.974+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3060089684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 msgr2=0x56241a8d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:40.966 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.974+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8d8f40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x56241a914710 tx=0x7faf7c00a500 comp rx=0 tx=0).stop 2023-09-21T13:12:40.976 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.984+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3060089684 shutdown_connections 2023-09-21T13:12:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.984+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d60a0 0x56241a8e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.984+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8dae50 0x56241a8d9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.984+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/3060089684 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8d69c0 0x56241a8d8f40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:40.977 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.984+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3060089684 >> 172.21.15.142:0/3060089684 conn(0x56241a802fa0 msgr2=0x56241a90d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:40.988 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.996+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3060089684 shutdown_connections 2023-09-21T13:12:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.996+0000 7fafa7cebb80 1 -- 172.21.15.142:0/3060089684 wait complete. 2023-09-21T13:12:40.989 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.997+0000 7fafa7cebb80 1 -- start start 2023-09-21T13:12:40.990 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.997+0000 7fafa7cebb80 1 Processor -- start 2023-09-21T13:12:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d69c0 0x56241a907730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8dae50 0x56241a95e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:40.991 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a95ed80 con 0x56241a8d69c0 2023-09-21T13:12:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a95eef0 con 0x56241a8dae50 2023-09-21T13:12:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x56241a95f0b0 con 0x56241a8d60a0 2023-09-21T13:12:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7fafa7cebb80 10 client.0 _ll_register_callbacks cb 0x56241a70ea20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7faf9299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:40.992 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7faf9299c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:55782/0 (socket says 172.21.15.142:55782) 2023-09-21T13:12:40.993 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:40.998+0000 7faf9299c700 1 -- 172.21.15.142:0/400826386 learned_addr learned my addr 172.21.15.142:0/400826386 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.006+0000 7faf9299c700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8dae50 0x56241a95e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.007+0000 7faf9299c700 1 -- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8dae50 msgr2=0x56241a95e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.007+0000 7faf9299c700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8dae50 0x56241a95e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.000 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.007+0000 7faf9299c700 1 -- 172.21.15.142:0/400826386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d69c0 msgr2=0x56241a907730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.007+0000 7faf9299c700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d69c0 0x56241a907730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.001 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.007+0000 7faf9299c700 1 -- 172.21.15.142:0/400826386 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7c00a980 con 0x56241a8d60a0 2023-09-21T13:12:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.012+0000 7faf9299c700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faf84032010 tx=0x7faf84003f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=702ba9c0c47e9018 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.018+0000 7faf75ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.018+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400e070 con 0x56241a8d60a0 2023-09-21T13:12:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.018+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7faf84030880 con 0x56241a8d60a0 2023-09-21T13:12:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.018+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf840074e0 con 0x56241a8d60a0 2023-09-21T13:12:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.020+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8401c4e0 con 0x56241a8d60a0 2023-09-21T13:12:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.021+0000 7fafa7cebb80 10 client.28300 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.021+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x56241a651250 con 0x56241a8d60a0 2023-09-21T13:12:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.024+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf840074e0 con 0x56241a8d60a0 2023-09-21T13:12:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.024+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faf8400b4d0 con 0x56241a8d60a0 2023-09-21T13:12:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 10 client.28300 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 10 client.28300 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:41.020 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 20 client.28300 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a966390 0x56241a9687b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 4 client.28300 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:12:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.026+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56241a820e00 con 0x56241a966390 2023-09-21T13:12:41.021 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.027+0000 7faf9199a700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a966390 0x56241a9687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.060+0000 7faf9199a700 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a966390 0x56241a9687b0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34ae5e7274bc9def server_cookie=47c7b5f4f1d8480c in_seq=0 out_seq=0 2023-09-21T13:12:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.060+0000 7faf75ffb700 10 client.28300 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:41.066 INFO:tasks.workunit.client.0.smithi142.stdout: 10 135822 37.26 MB/sec execute 81 sec latency 507.767 ms 2023-09-21T13:12:41.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:41 smithi156 ceph-mon[134078]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 8.9 MiB/s wr, 563 op/s 2023-09-21T13:12:41.413 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:41 smithi142 ceph-mon[97663]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 8.9 MiB/s wr, 563 op/s 2023-09-21T13:12:41.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:41 smithi160 ceph-mon[134450]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 MiB/s rd, 8.9 MiB/s wr, 563 op/s 2023-09-21T13:12:41.766 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.773+0000 7faf75ffb700 1 -- 172.21.15.142:0/400826386 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56241a820e00 con 0x56241a966390 2023-09-21T13:12:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.773+0000 7faf75ffb700 10 client.28300 handle_command_reply: tid=0 2023-09-21T13:12:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.773+0000 7fafa7cebb80 1 client.28300 shutdown 2023-09-21T13:12:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.773+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 msgr2=0x56241a9071f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faf84032010 tx=0x7faf84003f60 comp rx=0 tx=0).stop 2023-09-21T13:12:41.767 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 shutdown_connections 2023-09-21T13:12:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x56241a966390 0x56241a9687b0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x56241a8dae50 0x56241a95e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56241a8d60a0 0x56241a9071f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 --2- 172.21.15.142:0/400826386 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x56241a8d69c0 0x56241a907730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.768 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 >> 172.21.15.142:0/400826386 conn(0x56241a802fa0 msgr2=0x56241a8d8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:41.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7faf75ffb700 0 client.28300 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:41.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 shutdown_connections 2023-09-21T13:12:41.769 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.774+0000 7fafa7cebb80 1 -- 172.21.15.142:0/400826386 wait complete. 2023-09-21T13:12:41.774 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.782+0000 7fafa7cebb80 20 client.28300 trim_cache size 0 max 16384 2023-09-21T13:12:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:12:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:12:41.775 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:12:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:12:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 msgr2=0x7faf780a2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:41.776 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 0x7faf780a2db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf88004790 tx=0x7faf88009380 comp rx=0 tx=0).stop 2023-09-21T13:12:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 msgr2=0x7faf8c1abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faf8800b530 tx=0x7faf8800b840 comp rx=0 tx=0).stop 2023-09-21T13:12:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 shutdown_connections 2023-09-21T13:12:41.777 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7faf780a08f0 0x7faf780a2db0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faf88004790 tx=0x7faf88009380 comp rx=0 tx=0).stop 2023-09-21T13:12:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7faf8c11a5c0 0x7faf8c1a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faf8c10f530 0x7faf8c1abbe0 secure :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faf8800b530 tx=0x7faf8800b840 comp rx=0 tx=0).stop 2023-09-21T13:12:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 --2- 172.21.15.142:0/2258577154 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7faf8c10f9a0 0x7faf8c1ac120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:41.778 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.783+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 >> 172.21.15.142:0/2258577154 conn(0x7faf8c06cea0 msgr2=0x7faf8c1185b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:41.779 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.787+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 shutdown_connections 2023-09-21T13:12:41.781 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:41.789+0000 7faf943ff700 1 -- 172.21.15.142:0/2258577154 wait complete. 2023-09-21T13:12:42.065 INFO:tasks.workunit.client.0.smithi142.stdout: 10 136082 37.02 MB/sec execute 82 sec latency 704.497 ms 2023-09-21T13:12:43.070 INFO:tasks.workunit.client.0.smithi142.stdout: 10 136553 36.89 MB/sec execute 83 sec latency 250.034 ms 2023-09-21T13:12:43.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:42 smithi156 ceph-mon[134078]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 17 MiB/s wr, 908 op/s 2023-09-21T13:12:43.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:42 smithi142 ceph-mon[97663]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 17 MiB/s wr, 908 op/s 2023-09-21T13:12:43.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:42 smithi160 ceph-mon[134450]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 MiB/s rd, 17 MiB/s wr, 908 op/s 2023-09-21T13:12:44.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 137199 36.84 MB/sec execute 84 sec latency 132.985 ms 2023-09-21T13:12:45.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 137980 36.85 MB/sec execute 85 sec latency 90.631 ms 2023-09-21T13:12:45.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:45 smithi156 ceph-mon[134078]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 12 MiB/s wr, 568 op/s 2023-09-21T13:12:45.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:45 smithi142 ceph-mon[97663]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 12 MiB/s wr, 568 op/s 2023-09-21T13:12:45.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:45 smithi160 ceph-mon[134450]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 MiB/s rd, 12 MiB/s wr, 568 op/s 2023-09-21T13:12:46.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 138909 37.03 MB/sec execute 86 sec latency 87.408 ms 2023-09-21T13:12:47.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 139714 37.17 MB/sec execute 87 sec latency 78.862 ms 2023-09-21T13:12:47.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:47 smithi156 ceph-mon[134078]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 13 MiB/s wr, 660 op/s 2023-09-21T13:12:47.413 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:47 smithi142 ceph-mon[97663]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 13 MiB/s wr, 660 op/s 2023-09-21T13:12:47.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:47 smithi160 ceph-mon[134450]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 MiB/s rd, 13 MiB/s wr, 660 op/s 2023-09-21T13:12:48.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 140376 37.14 MB/sec execute 88 sec latency 67.550 ms 2023-09-21T13:12:49.070 INFO:tasks.workunit.client.0.smithi142.stdout: 10 141159 37.19 MB/sec execute 89 sec latency 65.709 ms 2023-09-21T13:12:49.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:49 smithi156 ceph-mon[134078]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 15 MiB/s wr, 883 op/s 2023-09-21T13:12:49.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:49 smithi142 ceph-mon[97663]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 15 MiB/s wr, 883 op/s 2023-09-21T13:12:49.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:49 smithi160 ceph-mon[134450]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 15 MiB/s wr, 883 op/s 2023-09-21T13:12:50.067 INFO:tasks.workunit.client.0.smithi142.stdout: 10 141994 37.24 MB/sec execute 90 sec latency 63.216 ms 2023-09-21T13:12:51.068 INFO:tasks.workunit.client.0.smithi142.stdout: 10 142697 37.26 MB/sec execute 91 sec latency 86.539 ms 2023-09-21T13:12:51.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:51 smithi156 ceph-mon[134078]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 13 MiB/s wr, 730 op/s 2023-09-21T13:12:51.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:51 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:12:51.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:51 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:12:51.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:51 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:12:51.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:51 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:12:51.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:51 smithi142 ceph-mon[97663]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 13 MiB/s wr, 730 op/s 2023-09-21T13:12:51.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:51 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:12:51.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:51 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:12:51.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:51 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:12:51.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:51 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:12:51.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:51 smithi160 ceph-mon[134450]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 MiB/s rd, 13 MiB/s wr, 730 op/s 2023-09-21T13:12:51.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:51 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:12:51.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:51 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:12:51.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:51 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:12:51.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:51 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:12:52.068 INFO:tasks.workunit.client.0.smithi142.stdout: 10 143524 37.36 MB/sec execute 92 sec latency 77.552 ms 2023-09-21T13:12:52.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:52 smithi156 ceph-mon[134078]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-21T13:12:52.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:52 smithi156 ceph-mon[134078]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-09-21T13:12:52.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:52 smithi156 ceph-mon[134078]: Cluster is now healthy 2023-09-21T13:12:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:52 smithi142 ceph-mon[97663]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-21T13:12:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:52 smithi142 ceph-mon[97663]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-09-21T13:12:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:52 smithi142 ceph-mon[97663]: Cluster is now healthy 2023-09-21T13:12:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:52 smithi160 ceph-mon[134450]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-21T13:12:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:52 smithi160 ceph-mon[134450]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-09-21T13:12:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:52 smithi160 ceph-mon[134450]: Cluster is now healthy 2023-09-21T13:12:53.069 INFO:tasks.workunit.client.0.smithi142.stdout: 10 144240 37.31 MB/sec execute 93 sec latency 102.512 ms 2023-09-21T13:12:54.069 INFO:tasks.workunit.client.0.smithi142.stdout: 10 145040 37.46 MB/sec execute 94 sec latency 69.190 ms 2023-09-21T13:12:54.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:54 smithi156 ceph-mon[134078]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:54.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:54 smithi142 ceph-mon[97663]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:54.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:54 smithi160 ceph-mon[134450]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:55.078 INFO:tasks.workunit.client.0.smithi142.stdout: 10 145796 37.36 MB/sec execute 95 sec latency 83.452 ms 2023-09-21T13:12:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.120+0000 7f543a5ff700 1 -- 172.21.15.142:0/2249682768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f543410c010 msgr2=0x7f543410c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.113 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.120+0000 7f543a5ff700 1 --2- 172.21.15.142:0/2249682768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f543410c010 0x7f543410c490 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f54280099c0 tx=0x7f5428009cd0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 -- 172.21.15.142:0/2249682768 shutdown_connections 2023-09-21T13:12:55.130 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 --2- 172.21.15.142:0/2249682768 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c9d0 0x7f543407a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 --2- 172.21.15.142:0/2249682768 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f54341084a0 0x7f5434108880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 --2- 172.21.15.142:0/2249682768 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f543410c010 0x7f543410c490 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 -- 172.21.15.142:0/2249682768 >> 172.21.15.142:0/2249682768 conn(0x7f543406cea0 msgr2=0x7f543406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 -- 172.21.15.142:0/2249682768 shutdown_connections 2023-09-21T13:12:55.131 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.131+0000 7f543a5ff700 1 -- 172.21.15.142:0/2249682768 wait complete. 2023-09-21T13:12:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.132+0000 7f543a5ff700 1 Processor -- start 2023-09-21T13:12:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 -- start start 2023-09-21T13:12:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.132 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c010 0x7f543407d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543410c9d0 0x7f543407d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543407de30 con 0x7f543410c010 2023-09-21T13:12:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543407dfa0 con 0x7f543410c9d0 2023-09-21T13:12:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.133+0000 7f543a5ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543407e160 con 0x7f54341084a0 2023-09-21T13:12:55.133 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.137+0000 7f5433fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.137+0000 7f5433fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54422/0 (socket says 172.21.15.142:54422) 2023-09-21T13:12:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.137+0000 7f5433fff700 1 -- 172.21.15.142:0/353300984 learned_addr learned my addr 172.21.15.142:0/353300984 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:55.134 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.142+0000 7f54337fe700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c010 0x7f543407d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.144 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.151+0000 7f5438b9c700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543410c9d0 0x7f543407d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.153+0000 7f5433fff700 1 -- 172.21.15.142:0/353300984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543410c9d0 msgr2=0x7f543407d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.153+0000 7f5433fff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543410c9d0 0x7f543407d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.146 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.154+0000 7f5433fff700 1 -- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c010 msgr2=0x7f543407d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.154+0000 7f5433fff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c010 0x7f543407d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.147 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.154+0000 7f5433fff700 1 -- 172.21.15.142:0/353300984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280095f0 con 0x7f54341084a0 2023-09-21T13:12:55.157 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.165+0000 7f5433fff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f542c0060b0 tx=0x7f542c00d6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.168 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.176+0000 7f54317fa700 1 -- 172.21.15.142:0/353300984 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c004db0 con 0x7f54341084a0 2023-09-21T13:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.176+0000 7f54317fa700 1 -- 172.21.15.142:0/353300984 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f542c005020 con 0x7f54341084a0 2023-09-21T13:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.176+0000 7f54317fa700 1 -- 172.21.15.142:0/353300984 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c016600 con 0x7f54341084a0 2023-09-21T13:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.176+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54341cbfe0 con 0x7f54341084a0 2023-09-21T13:12:55.169 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.176+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54341cc410 con 0x7f54341084a0 2023-09-21T13:12:55.179 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.183+0000 7f544df78b80 1 Processor -- start 2023-09-21T13:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 -- start start 2023-09-21T13:12:55.181 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa637c40 con 0x55fdaa6c39c0 2023-09-21T13:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa61bc10 con 0x55fdaa6c30a0 2023-09-21T13:12:55.182 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.188+0000 7f544df78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa619530 con 0x55fdaa6c7e50 2023-09-21T13:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.198+0000 7f5438b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.190 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.198+0000 7f5438b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:36978/0 (socket says 172.21.15.142:36978) 2023-09-21T13:12:55.191 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.198+0000 7f5438b9c700 1 -- 172.21.15.142:0/3907026700 learned_addr learned my addr 172.21.15.142:0/3907026700 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:55.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.204+0000 7f5433fff700 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.205+0000 7f54337fe700 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.200 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.205+0000 7f54317fa700 1 -- 172.21.15.142:0/353300984 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f542c008af0 con 0x7f54341084a0 2023-09-21T13:12:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.207+0000 7f54317fa700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 0x7f541c0a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.201 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.207+0000 7f54317fa700 1 -- 172.21.15.142:0/353300984 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f542c0cda60 con 0x7f54341084a0 2023-09-21T13:12:55.202 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.210+0000 7f5438b9c700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 0x7f541c0a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 0x7f541c0a2e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f542400bfd0 tx=0x7f542400b8f0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 -- 172.21.15.142:0/3907026700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 msgr2=0x55fdaa6c82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6c82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.204 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 -- 172.21.15.142:0/3907026700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 msgr2=0x55fdaa6c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.205 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.211+0000 7f5438b9c700 1 -- 172.21.15.142:0/3907026700 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdaa43fd80 con 0x55fdaa6c30a0 2023-09-21T13:12:55.225 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.232+0000 7f5438b9c700 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f542400bcd0 tx=0x7f5424010000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9ed1de574dad6ed server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.237+0000 7f541a7fc700 1 -- 172.21.15.142:0/3907026700 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424023070 con 0x55fdaa6c30a0 2023-09-21T13:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.237+0000 7f541a7fc700 1 -- 172.21.15.142:0/3907026700 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54240189e0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.237+0000 7f541a7fc700 1 -- 172.21.15.142:0/3907026700 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424006240 con 0x55fdaa6c30a0 2023-09-21T13:12:55.231 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.238+0000 7f544df78b80 1 -- 172.21.15.142:0/3907026700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 msgr2=0x55fdaa6c3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.238+0000 7f544df78b80 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f542400bcd0 tx=0x7f5424010000 comp rx=0 tx=0).stop 2023-09-21T13:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.239+0000 7f544df78b80 1 -- 172.21.15.142:0/3907026700 shutdown_connections 2023-09-21T13:12:55.232 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.239+0000 7f544df78b80 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6c82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.239+0000 7f544df78b80 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c3480 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.239+0000 7f544df78b80 1 --2- 172.21.15.142:0/3907026700 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.233 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.239+0000 7f544df78b80 1 -- 172.21.15.142:0/3907026700 >> 172.21.15.142:0/3907026700 conn(0x55fdaa5effa0 msgr2=0x55fdaa6be0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:55.245 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.253+0000 7f544df78b80 1 -- 172.21.15.142:0/3907026700 shutdown_connections 2023-09-21T13:12:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.256+0000 7f544df78b80 1 -- 172.21.15.142:0/3907026700 wait complete. 2023-09-21T13:12:55.256 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.257+0000 7f544df78b80 1 -- start start 2023-09-21T13:12:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.257+0000 7f544df78b80 1 Processor -- start 2023-09-21T13:12:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.257 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa614e20 con 0x55fdaa6c7e50 2023-09-21T13:12:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa5b16e0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa5b1380 con 0x55fdaa6c39c0 2023-09-21T13:12:55.258 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.258+0000 7f544df78b80 10 client.0 _ll_register_callbacks cb 0x55fdaa4fba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:55.272 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.273+0000 7f54337fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.272 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.273+0000 7f54337fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54452/0 (socket says 172.21.15.142:54452) 2023-09-21T13:12:55.273 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.273+0000 7f54337fe700 1 -- 172.21.15.142:0/413274971 learned_addr learned my addr 172.21.15.142:0/413274971 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.282+0000 7f5433fff700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.274 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.282+0000 7f5438b9c700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.288+0000 7f54337fe700 1 -- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 msgr2=0x55fdaa6cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.280 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.288+0000 7f54337fe700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.288+0000 7f54337fe700 1 -- 172.21.15.142:0/413274971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c7e50 msgr2=0x55fdaa6cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.288+0000 7f54337fe700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.281 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.288+0000 7f54337fe700 1 -- 172.21.15.142:0/413274971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542400e040 con 0x55fdaa6c39c0 2023-09-21T13:12:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.297+0000 7f54337fe700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f542800d790 tx=0x7f542800dda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7111d86dd0ea9606 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.290 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.297+0000 7f54137fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:55.301 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.309+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542801b040 con 0x55fdaa6c39c0 2023-09-21T13:12:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.309+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f542800d220 con 0x55fdaa6c39c0 2023-09-21T13:12:55.302 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.310+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdaa585b50 con 0x55fdaa6c39c0 2023-09-21T13:12:55.313 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.320+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5428005390 con 0x55fdaa6c39c0 2023-09-21T13:12:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.322+0000 7f544df78b80 10 client.28312 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:55.314 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.322+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55fdaa428c00 con 0x55fdaa6c39c0 2023-09-21T13:12:55.315 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fdaa585b50 con 0x55fdaa6c39c0 2023-09-21T13:12:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5428003cc0 con 0x55fdaa6c39c0 2023-09-21T13:12:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 10 client.28312 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 10 client.28312 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:55.316 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 20 client.28312 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa6fefd0 0x55fdaa7013f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 4 client.28312 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:55.317 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.323+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdaa691fc0 con 0x55fdaa6fefd0 2023-09-21T13:12:55.325 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.333+0000 7f5433fff700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa6fefd0 0x55fdaa7013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.346 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.354+0000 7f5433fff700 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa6fefd0 0x55fdaa7013f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d087e925d3d94d server_cookie=f058fb458250fb43 in_seq=0 out_seq=0 2023-09-21T13:12:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.360+0000 7f54137fe700 10 client.28312 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.360+0000 7f54137fe700 1 -- 172.21.15.142:0/413274971 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fdaa691fc0 con 0x55fdaa6fefd0 2023-09-21T13:12:55.363 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.360+0000 7f54137fe700 10 client.28312 handle_command_reply: tid=0 2023-09-21T13:12:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.361+0000 7f544df78b80 1 client.28312 shutdown 2023-09-21T13:12:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.371+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 msgr2=0x55fdaa6cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.364 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.371+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f542800d790 tx=0x7f542800dda0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 shutdown_connections 2023-09-21T13:12:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa6fefd0 0x55fdaa7013f0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.370 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 --2- 172.21.15.142:0/413274971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6cc820 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.371 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 >> 172.21.15.142:0/413274971 conn(0x55fdaa5effa0 msgr2=0x55fdaa6bdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:55.372 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.378+0000 7f54137fe700 0 client.28312 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:55.374 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.382+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 shutdown_connections 2023-09-21T13:12:55.378 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.382+0000 7f544df78b80 1 -- 172.21.15.142:0/413274971 wait complete. 2023-09-21T13:12:55.381 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.387+0000 7f544df78b80 20 client.28312 trim_cache size 0 max 16384 2023-09-21T13:12:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.420+0000 7f544df78b80 1 Processor -- start 2023-09-21T13:12:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.420+0000 7f544df78b80 1 -- start start 2023-09-21T13:12:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.420+0000 7f544df78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.414 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.421+0000 7f544df78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.421+0000 7f544df78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.421+0000 7f544df78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa4958c0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.421+0000 7f544df78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa6cde00 con 0x55fdaa6c39c0 2023-09-21T13:12:55.415 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.421+0000 7f544df78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa6d98c0 con 0x55fdaa6c7e50 2023-09-21T13:12:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.424+0000 7f5438b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.416 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.424+0000 7f5438b9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54462/0 (socket says 172.21.15.142:54462) 2023-09-21T13:12:55.417 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.424+0000 7f5438b9c700 1 -- 172.21.15.142:0/132166447 learned_addr learned my addr 172.21.15.142:0/132166447 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.434+0000 7f54337fe700 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.435+0000 7f5433fff700 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 -- 172.21.15.142:0/132166447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c39c0 msgr2=0x55fdaa6d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.430 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6d4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 -- 172.21.15.142:0/132166447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c30a0 msgr2=0x55fdaa6c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 -- 172.21.15.142:0/132166447 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdaa4661f0 con 0x55fdaa6c7e50 2023-09-21T13:12:55.431 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.437+0000 7f5438b9c700 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f54240189b0 tx=0x7f542400b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3885b820c3e0d9d1 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.441+0000 7f541affd700 1 -- 172.21.15.142:0/132166447 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424023040 con 0x55fdaa6c7e50 2023-09-21T13:12:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.441+0000 7f541affd700 1 -- 172.21.15.142:0/132166447 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5424018e10 con 0x55fdaa6c7e50 2023-09-21T13:12:55.440 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.441+0000 7f541affd700 1 -- 172.21.15.142:0/132166447 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424006a70 con 0x55fdaa6c7e50 2023-09-21T13:12:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 -- 172.21.15.142:0/132166447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 msgr2=0x55fdaa6cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f54240189b0 tx=0x7f542400b650 comp rx=0 tx=0).stop 2023-09-21T13:12:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 -- 172.21.15.142:0/132166447 shutdown_connections 2023-09-21T13:12:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.441 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6cc060 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 --2- 172.21.15.142:0/132166447 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6d4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.442 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.445+0000 7f544df78b80 1 -- 172.21.15.142:0/132166447 >> 172.21.15.142:0/132166447 conn(0x55fdaa5effa0 msgr2=0x55fdaa6c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.463+0000 7f544df78b80 1 -- 172.21.15.142:0/132166447 shutdown_connections 2023-09-21T13:12:55.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.468+0000 7f544df78b80 1 -- 172.21.15.142:0/132166447 wait complete. 2023-09-21T13:12:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.468+0000 7f544df78b80 1 -- start start 2023-09-21T13:12:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.469+0000 7f544df78b80 1 Processor -- start 2023-09-21T13:12:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6ce670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa6cec90 con 0x55fdaa6c39c0 2023-09-21T13:12:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa6cee00 con 0x55fdaa6c30a0 2023-09-21T13:12:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdaa6cefc0 con 0x55fdaa6c7e50 2023-09-21T13:12:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.481+0000 7f544df78b80 10 client.0 _ll_register_callbacks cb 0x55fdaa4fba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.482+0000 7f5433fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.482+0000 7f5433fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37000/0 (socket says 172.21.15.142:37000) 2023-09-21T13:12:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.482+0000 7f5433fff700 1 -- 172.21.15.142:0/2556221246 learned_addr learned my addr 172.21.15.142:0/2556221246 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.485+0000 7f54337fe700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.485+0000 7f5433fff700 1 -- 172.21.15.142:0/2556221246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 msgr2=0x55fdaa6ce670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:12:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.485+0000 7f5433fff700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6ce670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.485+0000 7f5433fff700 1 -- 172.21.15.142:0/2556221246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 msgr2=0x55fdaa6ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.485+0000 7f5433fff700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.486+0000 7f5433fff700 1 -- 172.21.15.142:0/2556221246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdaa43fd80 con 0x55fdaa6c30a0 2023-09-21T13:12:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.489+0000 7f5433fff700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f542c0086d0 tx=0x7f542c0cdc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c43ea50fc895fec4 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.489+0000 7f54137fe700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:12:55.489 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.497+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542c09aeb0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.497+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f542c09ece0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.498+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f54240189e0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.494 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.499+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f542c0a2f20 con 0x55fdaa6c30a0 2023-09-21T13:12:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.503+0000 7f544df78b80 10 client.28391 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:55.495 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.503+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55fdaa43e250 con 0x55fdaa6c30a0 2023-09-21T13:12:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.504+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f54240189e0 con 0x55fdaa6c30a0 2023-09-21T13:12:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.504+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f542c09b110 con 0x55fdaa6c30a0 2023-09-21T13:12:55.498 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 10 client.28391 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 10 client.28391 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 20 client.28391 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa7543e0 0x55fdaa756800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 4 client.28391 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:12:55.499 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.506+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fdaa60de00 con 0x55fdaa7543e0 2023-09-21T13:12:55.519 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.514+0000 7f54337fe700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa7543e0 0x55fdaa756800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.536+0000 7f54337fe700 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa7543e0 0x55fdaa756800 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4b58445bf2b26da server_cookie=7c7c06cf7357ee6a in_seq=0 out_seq=0 2023-09-21T13:12:55.540 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:55.537+0000 7f54137fe700 10 client.28391 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:56.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 145869 37.02 MB/sec execute 96 sec latency 840.338 ms 2023-09-21T13:12:56.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:56 smithi156 ceph-mon[134078]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:56.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:56 smithi142 ceph-mon[97663]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:56.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:56 smithi160 ceph-mon[134450]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 MiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-09-21T13:12:56.450 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.458+0000 7f54137fe700 1 -- 172.21.15.142:0/2556221246 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fdaa60de00 con 0x55fdaa7543e0 2023-09-21T13:12:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.458+0000 7f54137fe700 10 client.28391 handle_command_reply: tid=0 2023-09-21T13:12:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.458+0000 7f544df78b80 1 client.28391 shutdown 2023-09-21T13:12:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.462+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 msgr2=0x55fdaa6cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:56.455 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.462+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f542c0086d0 tx=0x7f542c0cdc70 comp rx=0 tx=0).stop 2023-09-21T13:12:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 shutdown_connections 2023-09-21T13:12:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdaa7543e0 0x55fdaa756800 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdaa6c7e50 0x55fdaa6ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.456 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdaa6c30a0 0x55fdaa6cf410 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f54137fe700 0 client.28391 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 --2- 172.21.15.142:0/2556221246 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdaa6c39c0 0x55fdaa6ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 >> 172.21.15.142:0/2556221246 conn(0x55fdaa5effa0 msgr2=0x55fdaa6c6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:56.457 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 shutdown_connections 2023-09-21T13:12:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.463+0000 7f544df78b80 1 -- 172.21.15.142:0/2556221246 wait complete. 2023-09-21T13:12:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.464+0000 7f544df78b80 20 client.28391 trim_cache size 0 max 16384 2023-09-21T13:12:56.458 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:12:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:12:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:12:56.459 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:12:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.466+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 msgr2=0x7f541c0a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.466+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 0x7f541c0a2e80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f542400bfd0 tx=0x7f542400b8f0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.460 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.466+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 msgr2=0x7f54340835e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.466+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f542c0060b0 tx=0x7f542c00d6d0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 shutdown_connections 2023-09-21T13:12:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f541c0a09c0 0x7f541c0a2e80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f543410c9d0 0x7f543407d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.461 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f54341084a0 0x7f54340835e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 --2- 172.21.15.142:0/353300984 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f543410c010 0x7f543407d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 >> 172.21.15.142:0/353300984 conn(0x7f543406cea0 msgr2=0x7f5434109e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 shutdown_connections 2023-09-21T13:12:56.462 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:12:56.467+0000 7f543a5ff700 1 -- 172.21.15.142:0/353300984 wait complete. 2023-09-21T13:12:57.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 146276 36.97 MB/sec execute 97 sec latency 286.904 ms 2023-09-21T13:12:57.404 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:12:58.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 146878 36.92 MB/sec execute 98 sec latency 292.353 ms 2023-09-21T13:12:58.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:57 smithi156 ceph-mon[134078]: pgmap v529: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 18 MiB/s wr, 928 op/s 2023-09-21T13:12:58.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:57 smithi142 ceph-mon[97663]: pgmap v529: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 18 MiB/s wr, 928 op/s 2023-09-21T13:12:58.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:57 smithi160 ceph-mon[134450]: pgmap v529: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 MiB/s rd, 18 MiB/s wr, 928 op/s 2023-09-21T13:12:58.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 -- 172.21.15.142:0/3159915782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 msgr2=0x7f4f8c107980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.680 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 --2- 172.21.15.142:0/3159915782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c107980 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009990 tx=0x7f4f7c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 -- 172.21.15.142:0/3159915782 shutdown_connections 2023-09-21T13:12:58.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 --2- 172.21.15.142:0/3159915782 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 0x7f4f8c114220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 --2- 172.21.15.142:0/3159915782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c10d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 --2- 172.21.15.142:0/3159915782 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c107980 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.681 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 -- 172.21.15.142:0/3159915782 >> 172.21.15.142:0/3159915782 conn(0x7f4f8c076c80 msgr2=0x7f4f8c105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 -- 172.21.15.142:0/3159915782 shutdown_connections 2023-09-21T13:12:58.682 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.687+0000 7f4f92bff700 1 -- 172.21.15.142:0/3159915782 wait complete. 2023-09-21T13:12:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.689+0000 7f4f92bff700 1 Processor -- start 2023-09-21T13:12:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.689+0000 7f4f92bff700 1 -- start start 2023-09-21T13:12:58.683 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c19d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 0x7f4f8c19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1a23c0 con 0x7f4f8c107500 2023-09-21T13:12:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1a2530 con 0x7f4f8c107ec0 2023-09-21T13:12:58.684 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f92bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c1a26f0 con 0x7f4f8c10d480 2023-09-21T13:12:58.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54476/0 (socket says 172.21.15.142:54476) 2023-09-21T13:12:58.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f9119c700 1 -- 172.21.15.142:0/645242421 learned_addr learned my addr 172.21.15.142:0/645242421 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:58.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.690+0000 7f4f83fff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 0x7f4f8c19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.685 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9099b700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c19d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.686 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 -- 172.21.15.142:0/645242421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 msgr2=0x7f4f8c19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 0x7f4f8c19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 -- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 msgr2=0x7f4f8c19d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c19d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 -- 172.21.15.142:0/645242421 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f7c0095f0 con 0x7f4f8c10d480 2023-09-21T13:12:58.687 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9099b700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:12:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.691+0000 7f4f9119c700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400d750 tx=0x7f4f8400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.692+0000 7f4f81ffb700 1 -- 172.21.15.142:0/645242421 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84004220 con 0x7f4f8c10d480 2023-09-21T13:12:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.692+0000 7f4f81ffb700 1 -- 172.21.15.142:0/645242421 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f84004cf0 con 0x7f4f8c10d480 2023-09-21T13:12:58.688 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.692+0000 7f4f81ffb700 1 -- 172.21.15.142:0/645242421 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84005680 con 0x7f4f8c10d480 2023-09-21T13:12:58.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.692+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c1a29d0 con 0x7f4f8c10d480 2023-09-21T13:12:58.689 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.692+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c1aa210 con 0x7f4f8c10d480 2023-09-21T13:12:58.692 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.700+0000 7f4f81ffb700 1 -- 172.21.15.142:0/645242421 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4f84004380 con 0x7f4f8c10d480 2023-09-21T13:12:58.693 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.701+0000 7f4fa6591b80 1 Processor -- start 2023-09-21T13:12:58.694 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.701+0000 7f4fa6591b80 1 -- start start 2023-09-21T13:12:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.697 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d32e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d337c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370ca2ca0 con 0x55a370d2ef30 2023-09-21T13:12:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370c86c70 con 0x55a370d2e610 2023-09-21T13:12:58.698 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370c84590 con 0x55a370d33360 2023-09-21T13:12:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37034/0 (socket says 172.21.15.142:37034) 2023-09-21T13:12:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4f83fff700 1 -- 172.21.15.142:0/2016441736 learned_addr learned my addr 172.21.15.142:0/2016441736 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:58.699 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.705+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d337c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 -- 172.21.15.142:0/2016441736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 msgr2=0x55a370d337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d337c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.700 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 -- 172.21.15.142:0/2016441736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 msgr2=0x55a370d32e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-21T13:12:58.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d32e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 -- 172.21.15.142:0/2016441736 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a370aaade0 con 0x55a370d2e610 2023-09-21T13:12:58.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.706+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009990 tx=0x7f4f7c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a0706ce1e83ff8b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.707+0000 7f4f81ffb700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 0x7f4f740a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.707+0000 7f4f81ffb700 1 -- 172.21.15.142:0/645242421 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4f840cbbc0 con 0x7f4f8c10d480 2023-09-21T13:12:58.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.707+0000 7f4f72ffd700 1 -- 172.21.15.142:0/2016441736 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c005110 con 0x55a370d2e610 2023-09-21T13:12:58.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.707+0000 7f4f72ffd700 1 -- 172.21.15.142:0/2016441736 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7c01e070 con 0x55a370d2e610 2023-09-21T13:12:58.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.707+0000 7f4f72ffd700 1 -- 172.21.15.142:0/2016441736 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00f460 con 0x55a370d2e610 2023-09-21T13:12:58.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2016441736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 msgr2=0x55a370d2e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c009990 tx=0x7f4f7c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2016441736 shutdown_connections 2023-09-21T13:12:58.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d337c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d2e9f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2016441736 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d32e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2016441736 >> 172.21.15.142:0/2016441736 conn(0x55a370c5b000 msgr2=0x55a370d296a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2016441736 shutdown_connections 2023-09-21T13:12:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.709+0000 7f4f9099b700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 0x7f4f740a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.705 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.710+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2016441736 wait complete. 2023-09-21T13:12:58.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.710+0000 7f4fa6591b80 1 -- start start 2023-09-21T13:12:58.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 Processor -- start 2023-09-21T13:12:58.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4f9099b700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 0x7f4f740a2d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4f88007fa0 tx=0x7f4f88009040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d2ef30 0x55a370d37df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370c7fe80 con 0x55a370d33360 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370c1c740 con 0x55a370d2e610 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.711+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370c1c3e0 con 0x55a370d2ef30 2023-09-21T13:12:58.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.712+0000 7f4fa6591b80 10 client.0 _ll_register_callbacks cb 0x55a370b66a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:58.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:53394/0 (socket says 172.21.15.142:53394) 2023-09-21T13:12:58.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 -- 172.21.15.142:0/228882003 learned_addr learned my addr 172.21.15.142:0/228882003 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:58.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 -- 172.21.15.142:0/228882003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d2ef30 msgr2=0x55a370d37df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:12:58.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d2ef30 0x55a370d37df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 -- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 msgr2=0x55a370d3ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.713+0000 7f4f9119c700 1 -- 172.21.15.142:0/228882003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c114b10 con 0x55a370d33360 2023-09-21T13:12:58.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.714+0000 7f4f9119c700 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f840a0b50 tx=0x7f4f84099710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d5b954d79f1f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.714+0000 7f4f6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:12:58.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.715+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840b0070 con 0x55a370d33360 2023-09-21T13:12:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.715+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4f84021500 con 0x55a370d33360 2023-09-21T13:12:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.716+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a370bf0bb0 con 0x55a370d33360 2023-09-21T13:12:58.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.718+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f8409ce40 con 0x55a370d33360 2023-09-21T13:12:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.720+0000 7f4fa6591b80 10 client.18159 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:58.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.720+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55a370a93c60 con 0x55a370d33360 2023-09-21T13:12:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a370bf0bb0 con 0x55a370d33360 2023-09-21T13:12:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f84061030 con 0x55a370d33360 2023-09-21T13:12:58.715 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 10 client.18159 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 10 client.18159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 20 client.18159 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:58.716 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d48400 0x55a370d4a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 4 client.18159 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:12:58.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.721+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a370cfd020 con 0x55a370d48400 2023-09-21T13:12:58.717 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.724+0000 7f4f9099b700 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d48400 0x55a370d4a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.729+0000 7f4f9099b700 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d48400 0x55a370d4a840 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=334fb69a9f7c9017 server_cookie=d7e48684d8e85f63 in_seq=0 out_seq=0 2023-09-21T13:12:58.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.730+0000 7f4f6bfff700 10 client.18159 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:58.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.736+0000 7f4f6bfff700 1 -- 172.21.15.142:0/228882003 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a370cfd020 con 0x55a370d48400 2023-09-21T13:12:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.736+0000 7f4f6bfff700 10 client.18159 handle_command_reply: tid=0 2023-09-21T13:12:58.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.737+0000 7f4fa6591b80 1 client.18159 shutdown 2023-09-21T13:12:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.743+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 msgr2=0x55a370d384e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.743+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4f840a0b50 tx=0x7f4f84099710 comp rx=0 tx=0).stop 2023-09-21T13:12:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 shutdown_connections 2023-09-21T13:12:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d48400 0x55a370d4a840 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d33360 0x55a370d384e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/228882003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d2ef30 0x55a370d37df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.744+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 >> 172.21.15.142:0/228882003 conn(0x55a370c5b000 msgr2=0x55a370d29290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.747+0000 7f4f6bfff700 0 client.18159 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.747+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 shutdown_connections 2023-09-21T13:12:58.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.747+0000 7f4fa6591b80 1 -- 172.21.15.142:0/228882003 wait complete. 2023-09-21T13:12:58.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.748+0000 7f4fa6591b80 20 client.18159 trim_cache size 0 max 16384 2023-09-21T13:12:58.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.780+0000 7f4fa6591b80 1 Processor -- start 2023-09-21T13:12:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 -- start start 2023-09-21T13:12:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2e610 0x55a370d30c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d31530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370b00920 con 0x55a370d2e610 2023-09-21T13:12:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370d23c20 con 0x55a370d2ef30 2023-09-21T13:12:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.784+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370d23990 con 0x55a370d33360 2023-09-21T13:12:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.785+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.781 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.785+0000 7f4f83fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:37066/0 (socket says 172.21.15.142:37066) 2023-09-21T13:12:58.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.785+0000 7f4f83fff700 1 -- 172.21.15.142:0/2909074980 learned_addr learned my addr 172.21.15.142:0/2909074980 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:58.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.785+0000 7f4f9119c700 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d31530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 -- 172.21.15.142:0/2909074980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 msgr2=0x55a370d31530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.782 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d31530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 -- 172.21.15.142:0/2909074980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2e610 msgr2=0x55a370d30c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2e610 0x55a370d30c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 -- 172.21.15.142:0/2909074980 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a370d4f4b0 con 0x55a370d2ef30 2023-09-21T13:12:58.783 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f83fff700 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c003680 tx=0x7f4f7c0036b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450c538d44529b2e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.786+0000 7f4f737fe700 1 -- 172.21.15.142:0/2909074980 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c009ee0 con 0x55a370d2ef30 2023-09-21T13:12:58.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.787+0000 7f4f737fe700 1 -- 172.21.15.142:0/2909074980 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f7c003d50 con 0x55a370d2ef30 2023-09-21T13:12:58.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.787+0000 7f4f737fe700 1 -- 172.21.15.142:0/2909074980 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c00f6c0 con 0x55a370d2ef30 2023-09-21T13:12:58.784 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.787+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2909074980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 msgr2=0x55a370d4a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.785 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.787+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c003680 tx=0x7f4f7c0036b0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2909074980 shutdown_connections 2023-09-21T13:12:58.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2e610 0x55a370d30c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d31530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/2909074980 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2ef30 0x55a370d4a410 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.787 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2909074980 >> 172.21.15.142:0/2909074980 conn(0x55a370c5b000 msgr2=0x55a370d43c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2909074980 shutdown_connections 2023-09-21T13:12:58.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 -- 172.21.15.142:0/2909074980 wait complete. 2023-09-21T13:12:58.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.788+0000 7f4fa6591b80 1 -- start start 2023-09-21T13:12:58.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 Processor -- start 2023-09-21T13:12:58.788 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d3dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370d3e370 con 0x55a370d2ef30 2023-09-21T13:12:58.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370d9b7d0 con 0x55a370d2e610 2023-09-21T13:12:58.789 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a370d9b960 con 0x55a370d33360 2023-09-21T13:12:58.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.789+0000 7f4fa6591b80 10 client.0 _ll_register_callbacks cb 0x7f4f84098e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:12:58.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.790+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.790+0000 7f4f9119c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:54510/0 (socket says 172.21.15.142:54510) 2023-09-21T13:12:58.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.790+0000 7f4f9119c700 1 -- 172.21.15.142:0/1041843062 learned_addr learned my addr 172.21.15.142:0/1041843062 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:12:58.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.790+0000 7f4f9099b700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f83fff700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d3dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 -- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 msgr2=0x55a370d3d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 -- 172.21.15.142:0/1041843062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 msgr2=0x55a370d3dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:12:58.791 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d3dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 -- 172.21.15.142:0/1041843062 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a370aaade0 con 0x55a370d33360 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f83fff700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f9119c700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f84097360 tx=0x7f4f840985c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d84d8f8336df34e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.791+0000 7f4f6bfff700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840b0070 con 0x55a370d33360 2023-09-21T13:12:58.792 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(111..111 src has 1..111) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4f8409ce40 con 0x55a370d33360 2023-09-21T13:12:58.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f7c01e070 con 0x55a370d33360 2023-09-21T13:12:58.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f840a1080 con 0x55a370d33360 2023-09-21T13:12:58.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 10 client.28327 fetch_fsmap learned FSMap version 56 2023-09-21T13:12:58.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55a370ad1250 con 0x55a370d33360 2023-09-21T13:12:58.793 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f8407c070 con 0x55a370d33360 2023-09-21T13:12:58.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f84095720 con 0x55a370d33360 2023-09-21T13:12:58.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 10 client.28327 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:12:58.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 10 client.28327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:12:58.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 20 client.28327 populate_metadata read hostname 'smithi142' 2023-09-21T13:12:58.794 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.792+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d9cd10 0x55a370d9f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:12:58.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.793+0000 7f4fa6591b80 4 client.28327 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:12:58.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.793+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a370c78e60 con 0x55a370d9cd10 2023-09-21T13:12:58.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.793+0000 7f4f9099b700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d9cd10 0x55a370d9f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:12:58.795 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.793+0000 7f4f6bfff700 10 client.28327 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:58.796 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.794+0000 7f4f9099b700 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d9cd10 0x55a370d9f130 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cca843d8435e86da server_cookie=d9a83a8700976fc6 in_seq=0 out_seq=0 2023-09-21T13:12:58.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.795+0000 7f4f6bfff700 1 -- 172.21.15.142:0/1041843062 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a370c78e60 con 0x55a370d9cd10 2023-09-21T13:12:58.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.795+0000 7f4f6bfff700 10 client.28327 handle_command_reply: tid=0 2023-09-21T13:12:58.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.795+0000 7f4fa6591b80 1 client.28327 shutdown 2023-09-21T13:12:58.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 msgr2=0x55a370d9b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.797 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4f84097360 tx=0x7f4f840985c0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 shutdown_connections 2023-09-21T13:12:58.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55a370d9cd10 0x55a370d9f130 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a370d33360 0x55a370d9b290 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55a370d2e610 0x55a370d3d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.798 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 --2- 172.21.15.142:0/1041843062 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55a370d2ef30 0x55a370d3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 >> 172.21.15.142:0/1041843062 conn(0x55a370c5b000 msgr2=0x55a370d43c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4f6bfff700 0 client.28327 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:12:58.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 shutdown_connections 2023-09-21T13:12:58.799 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.796+0000 7f4fa6591b80 1 -- 172.21.15.142:0/1041843062 wait complete. 2023-09-21T13:12:58.800 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.797+0000 7f4fa6591b80 20 client.28327 trim_cache size 0 max 16384 2023-09-21T13:12:58.800 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:12:58.800 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:12:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:12:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:12:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:12:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:12:58.801 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:12:58.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:12:58.802 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:12:58.802 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:12:58.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 msgr2=0x7f4f740a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 0x7f4f740a2d30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f4f88007fa0 tx=0x7f4f88009040 comp rx=0 tx=0).stop 2023-09-21T13:12:58.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 msgr2=0x7f4f8c1a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:12:58.806 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400d750 tx=0x7f4f8400da60 comp rx=0 tx=0).stop 2023-09-21T13:12:58.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 shutdown_connections 2023-09-21T13:12:58.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4f740a0870 0x7f4f740a2d30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4f8c107500 0x7f4f8c19d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f8c10d480 0x7f4f8c1a1d80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.807 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 --2- 172.21.15.142:0/645242421 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4f8c107ec0 0x7f4f8c19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:12:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 >> 172.21.15.142:0/645242421 conn(0x7f4f8c076c80 msgr2=0x7f4f8c10b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:12:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 shutdown_connections 2023-09-21T13:12:58.808 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:12:58.798+0000 7f4f92bff700 1 -- 172.21.15.142:0/645242421 wait complete. 2023-09-21T13:12:58.817 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:12:59.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 147476 36.84 MB/sec execute 99 sec latency 179.585 ms 2023-09-21T13:13:00.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 148232 36.97 MB/sec execute 100 sec latency 57.682 ms 2023-09-21T13:13:00.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:12:59 smithi156 ceph-mon[134078]: pgmap v530: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:00.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:12:59 smithi142 ceph-mon[97663]: pgmap v530: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:00.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:12:59 smithi160 ceph-mon[134450]: pgmap v530: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:01.079 INFO:tasks.workunit.client.0.smithi142.stdout: 10 148675 36.75 MB/sec execute 101 sec latency 160.140 ms 2023-09-21T13:13:02.081 INFO:tasks.workunit.client.0.smithi142.stdout: 10 149098 36.58 MB/sec execute 102 sec latency 194.551 ms 2023-09-21T13:13:02.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:02 smithi156 ceph-mon[134078]: pgmap v531: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:02.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:02 smithi142 ceph-mon[97663]: pgmap v531: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:02.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:02 smithi160 ceph-mon[134450]: pgmap v531: 97 pgs: 97 active+clean; 1.2 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 MiB/s rd, 15 MiB/s wr, 604 op/s 2023-09-21T13:13:03.081 INFO:tasks.workunit.client.0.smithi142.stdout: 10 149339 36.40 MB/sec execute 103 sec latency 442.740 ms 2023-09-21T13:13:03.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:03 smithi156 ceph-mon[134078]: osdmap e112: 12 total, 12 up, 12 in 2023-09-21T13:13:03.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:03 smithi142 ceph-mon[97663]: osdmap e112: 12 total, 12 up, 12 in 2023-09-21T13:13:03.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:03 smithi160 ceph-mon[134450]: osdmap e112: 12 total, 12 up, 12 in 2023-09-21T13:13:04.082 INFO:tasks.workunit.client.0.smithi142.stdout: 10 149552 36.15 MB/sec execute 104 sec latency 748.276 ms 2023-09-21T13:13:04.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:04 smithi156 ceph-mon[134078]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:04.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:04 smithi142 ceph-mon[97663]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:04.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:04 smithi160 ceph-mon[134450]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:05.082 INFO:tasks.workunit.client.0.smithi142.stdout: 10 149843 35.97 MB/sec execute 105 sec latency 556.053 ms 2023-09-21T13:13:06.082 INFO:tasks.workunit.client.0.smithi142.stdout: 10 150471 35.94 MB/sec execute 106 sec latency 294.847 ms 2023-09-21T13:13:06.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:06 smithi156 ceph-mon[134078]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:06.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:06 smithi142 ceph-mon[97663]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:06.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:06 smithi160 ceph-mon[134450]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 MiB/s rd, 18 MiB/s wr, 920 op/s 2023-09-21T13:13:07.082 INFO:tasks.workunit.client.0.smithi142.stdout: 10 151430 36.13 MB/sec execute 107 sec latency 1138.862 ms 2023-09-21T13:13:07.206 INFO:tasks.workunit.client.0.smithi142.stdout:[157618] write failed on handle 14036 (Resource temporarily unavailable) 2023-09-21T13:13:07.207 INFO:tasks.workunit.client.0.smithi142.stdout:Child failed with status 1 2023-09-21T13:13:07.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:13:08.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:07 smithi156 ceph-mon[134078]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:08.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:07 smithi142 ceph-mon[97663]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:08.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:07 smithi160 ceph-mon[134450]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:09.655 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 -- 172.21.15.142:0/2730720047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c4103230 msgr2=0x7f81c4103610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.656 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 --2- 172.21.15.142:0/2730720047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c4103230 0x7f81c4103610 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f81b40098f0 tx=0x7f81b4009c00 comp rx=0 tx=0).stop 2023-09-21T13:13:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 -- 172.21.15.142:0/2730720047 shutdown_connections 2023-09-21T13:13:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 --2- 172.21.15.142:0/2730720047 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4108350 0x7f81c410fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 --2- 172.21.15.142:0/2730720047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c4103230 0x7f81c4103610 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.657 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 --2- 172.21.15.142:0/2730720047 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4103be0 0x7f81c4107c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.662+0000 7f81c97ff700 1 -- 172.21.15.142:0/2730720047 >> 172.21.15.142:0/2730720047 conn(0x7f81c40fea90 msgr2=0x7f81c4100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.663+0000 7f81c97ff700 1 -- 172.21.15.142:0/2730720047 shutdown_connections 2023-09-21T13:13:09.658 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.663+0000 7f81c97ff700 1 -- 172.21.15.142:0/2730720047 wait complete. 2023-09-21T13:13:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 Processor -- start 2023-09-21T13:13:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 -- start start 2023-09-21T13:13:09.660 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4108350 0x7f81c41996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c419dd20 0x7f81c419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c419e7a0 con 0x7f81c4108350 2023-09-21T13:13:09.661 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c419e910 con 0x7f81c4103230 2023-09-21T13:13:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c97ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c419ead0 con 0x7f81c419dd20 2023-09-21T13:13:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.664+0000 7f81c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47146/0 (socket says 172.21.15.142:47146) 2023-09-21T13:13:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c27fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4108350 0x7f81c41996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.662 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 -- 172.21.15.142:0/916246742 learned_addr learned my addr 172.21.15.142:0/916246742 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c37fe700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c419dd20 0x7f81c419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 -- 172.21.15.142:0/916246742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c419dd20 msgr2=0x7f81c419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c419dd20 0x7f81c419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 -- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4108350 msgr2=0x7f81c41996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.663 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4108350 0x7f81c41996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 -- 172.21.15.142:0/916246742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc009d00 con 0x7f81c4103230 2023-09-21T13:13:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009810 tx=0x7f81b400fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.665+0000 7f81abfff700 1 -- 172.21.15.142:0/916246742 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b401c070 con 0x7f81c4103230 2023-09-21T13:13:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.666+0000 7f81abfff700 1 -- 172.21.15.142:0/916246742 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81b400ba40 con 0x7f81c4103230 2023-09-21T13:13:09.664 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.666+0000 7f81abfff700 1 -- 172.21.15.142:0/916246742 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004930 con 0x7f81c4103230 2023-09-21T13:13:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.666+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b4009520 con 0x7f81c4103230 2023-09-21T13:13:09.665 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.666+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c41a61b0 con 0x7f81c4103230 2023-09-21T13:13:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.672+0000 7f81abfff700 1 -- 172.21.15.142:0/916246742 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f81b4020070 con 0x7f81c4103230 2023-09-21T13:13:09.668 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.672+0000 7f81dd080b80 1 Processor -- start 2023-09-21T13:13:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.672+0000 7f81dd080b80 1 -- start start 2023-09-21T13:13:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c9419910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c941a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.669 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9389c40 con 0x5631c9419e50 2023-09-21T13:13:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c936dc10 con 0x5631c94150a0 2023-09-21T13:13:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81dd080b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c936b530 con 0x5631c94159c0 2023-09-21T13:13:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.670 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47158/0 (socket says 172.21.15.142:47158) 2023-09-21T13:13:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 -- 172.21.15.142:0/233554664 learned_addr learned my addr 172.21.15.142:0/233554664 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c9419910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c27fc700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c941a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 -- 172.21.15.142:0/233554664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 msgr2=0x5631c9419910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.671 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c9419910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 -- 172.21.15.142:0/233554664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 msgr2=0x5631c941a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c941a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c37fe700 1 -- 172.21.15.142:0/233554664 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631c9191d80 con 0x5631c94150a0 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.673+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c9419910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81c37fe700 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009530 tx=0x7f81bc0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4befca12a7b93556 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.672 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81a97fa700 1 -- 172.21.15.142:0/233554664 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00e070 con 0x5631c94150a0 2023-09-21T13:13:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81a97fa700 1 -- 172.21.15.142:0/233554664 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81bc00f040 con 0x5631c94150a0 2023-09-21T13:13:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81a97fa700 1 -- 172.21.15.142:0/233554664 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc004290 con 0x5631c94150a0 2023-09-21T13:13:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81abfff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 0x7f81ac0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81abfff700 1 -- 172.21.15.142:0/916246742 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f81b40ccc80 con 0x7f81c4103230 2023-09-21T13:13:09.673 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.674+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 0x7f81ac0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- 172.21.15.142:0/233554664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 msgr2=0x5631c9415480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f81bc009530 tx=0x7f81bc0099e0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81c2ffd700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 0x7f81ac0a2cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009fd0 tx=0x7f81b40a0040 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- 172.21.15.142:0/233554664 shutdown_connections 2023-09-21T13:13:09.674 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c941a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9415480 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 --2- 172.21.15.142:0/233554664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c9419910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- 172.21.15.142:0/233554664 >> 172.21.15.142:0/233554664 conn(0x5631c9341fa0 msgr2=0x5631c94100c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- 172.21.15.142:0/233554664 shutdown_connections 2023-09-21T13:13:09.675 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- 172.21.15.142:0/233554664 wait complete. 2023-09-21T13:13:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.675+0000 7f81dd080b80 1 -- start start 2023-09-21T13:13:09.676 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 Processor -- start 2023-09-21T13:13:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 0x5631c9421570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.679 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c9419e50 0x5631c941ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9366e20 con 0x5631c94150a0 2023-09-21T13:13:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c93036e0 con 0x5631c94159c0 2023-09-21T13:13:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9303380 con 0x5631c9419e50 2023-09-21T13:13:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.676+0000 7f81dd080b80 10 client.0 _ll_register_callbacks cb 0x5631c924da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:09.680 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c37fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 0x5631c9421570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47160/0 (socket says 172.21.15.142:47160) 2023-09-21T13:13:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 -- 172.21.15.142:0/1306187174 learned_addr learned my addr 172.21.15.142:0/1306187174 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c37fe700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c9419e50 0x5631c941ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 -- 172.21.15.142:0/1306187174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c9419e50 msgr2=0x5631c941ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c9419e50 0x5631c941ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 -- 172.21.15.142:0/1306187174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 msgr2=0x5631c9421570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 0x5631c9421570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 -- 172.21.15.142:0/1306187174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc0091e0 con 0x5631c94159c0 2023-09-21T13:13:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c37fe700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 0x5631c9421570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81c27fc700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f81b80116d0 tx=0x7f81b80119e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6e05c74ec4289a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.677+0000 7f81a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:13:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8016070 con 0x5631c94159c0 2023-09-21T13:13:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5631c92d7b50 con 0x5631c94159c0 2023-09-21T13:13:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f81b8004260 con 0x5631c94159c0 2023-09-21T13:13:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81b8004420 con 0x5631c94159c0 2023-09-21T13:13:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 10 client.28418 fetch_fsmap learned FSMap version 56 2023-09-21T13:13:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5631c917ac00 con 0x5631c94159c0 2023-09-21T13:13:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81b8027020 con 0x5631c94159c0 2023-09-21T13:13:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f81b800f7b0 con 0x5631c94159c0 2023-09-21T13:13:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 10 client.28418 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:13:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 10 client.28418 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 20 client.28418 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c942ef30 0x5631c9431350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 4 client.28418 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:13:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.678+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631c93e3fc0 con 0x5631c942ef30 2023-09-21T13:13:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.679+0000 7f81c37fe700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c942ef30 0x5631c9431350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.679+0000 7f81c37fe700 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c942ef30 0x5631c9431350 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1086da4048aa6ac0 server_cookie=457a31029c67c016 in_seq=0 out_seq=0 2023-09-21T13:13:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.679+0000 7f81a6ff5700 10 client.28418 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81a6ff5700 1 -- 172.21.15.142:0/1306187174 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5631c93e3fc0 con 0x5631c942ef30 2023-09-21T13:13:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81a6ff5700 10 client.28418 handle_command_reply: tid=0 2023-09-21T13:13:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 client.28418 shutdown 2023-09-21T13:13:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 msgr2=0x5631c941e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f81b80116d0 tx=0x7f81b80119e0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 shutdown_connections 2023-09-21T13:13:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c942ef30 0x5631c9431350 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c94150a0 0x5631c9421570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c9419e50 0x5631c941ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81a6ff5700 0 client.28418 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 --2- 172.21.15.142:0/1306187174 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c941e7f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 >> 172.21.15.142:0/1306187174 conn(0x5631c9341fa0 msgr2=0x5631c940f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 shutdown_connections 2023-09-21T13:13:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.680+0000 7f81dd080b80 1 -- 172.21.15.142:0/1306187174 wait complete. 2023-09-21T13:13:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.681+0000 7f81dd080b80 20 client.28418 trim_cache size 0 max 16384 2023-09-21T13:13:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 Processor -- start 2023-09-21T13:13:09.691 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 -- start start 2023-09-21T13:13:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c941dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.692 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c94145b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c91e78c0 con 0x5631c9419e50 2023-09-21T13:13:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9416160 con 0x5631c94150a0 2023-09-21T13:13:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.699+0000 7f81dd080b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c941fdd0 con 0x5631c94159c0 2023-09-21T13:13:09.693 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47162/0 (socket says 172.21.15.142:47162) 2023-09-21T13:13:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 -- 172.21.15.142:0/4034725399 learned_addr learned my addr 172.21.15.142:0/4034725399 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c94145b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 -- 172.21.15.142:0/4034725399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 msgr2=0x5631c941dfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-21T13:13:09.696 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c941dfb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 -- 172.21.15.142:0/4034725399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 msgr2=0x5631c94145b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.697 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c94145b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.700+0000 7f81c37fe700 1 -- 172.21.15.142:0/4034725399 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5631c91b81f0 con 0x5631c94150a0 2023-09-21T13:13:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.701+0000 7f81c37fe700 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5631c9416090 tx=0x7f81bc006210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=224a0ec24ef6308c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.698 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.701+0000 7f81a9ffb700 1 -- 172.21.15.142:0/4034725399 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc00e040 con 0x5631c94150a0 2023-09-21T13:13:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.701+0000 7f81a9ffb700 1 -- 172.21.15.142:0/4034725399 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81bc02b070 con 0x5631c94150a0 2023-09-21T13:13:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.701+0000 7f81a9ffb700 1 -- 172.21.15.142:0/4034725399 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc023430 con 0x5631c94150a0 2023-09-21T13:13:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 -- 172.21.15.142:0/4034725399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 msgr2=0x5631c9426000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x5631c9416090 tx=0x7f81bc006210 comp rx=0 tx=0).stop 2023-09-21T13:13:09.699 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 -- 172.21.15.142:0/4034725399 shutdown_connections 2023-09-21T13:13:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c94145b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94150a0 0x5631c9426000 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 --2- 172.21.15.142:0/4034725399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94159c0 0x5631c941dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.700 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 -- 172.21.15.142:0/4034725399 >> 172.21.15.142:0/4034725399 conn(0x5631c9341fa0 msgr2=0x5631c9413ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 -- 172.21.15.142:0/4034725399 shutdown_connections 2023-09-21T13:13:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.702+0000 7f81dd080b80 1 -- 172.21.15.142:0/4034725399 wait complete. 2023-09-21T13:13:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.703+0000 7f81dd080b80 1 -- start start 2023-09-21T13:13:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.703+0000 7f81dd080b80 1 Processor -- start 2023-09-21T13:13:09.701 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94150a0 0x5631c9417820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c9416730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9416c70 con 0x5631c9419e50 2023-09-21T13:13:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9416de0 con 0x5631c94159c0 2023-09-21T13:13:09.702 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631c9416fa0 con 0x5631c94150a0 2023-09-21T13:13:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81dd080b80 10 client.0 _ll_register_callbacks cb 0x5631c924da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81c27fc700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47168/0 (socket says 172.21.15.142:47168) 2023-09-21T13:13:09.703 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81c27fc700 1 -- 172.21.15.142:0/3749075152 learned_addr learned my addr 172.21.15.142:0/3749075152 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.704+0000 7f81c37fe700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c9416730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 -- 172.21.15.142:0/3749075152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94150a0 msgr2=0x5631c9417820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94150a0 0x5631c9417820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 -- 172.21.15.142:0/3749075152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 msgr2=0x5631c9416730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c9416730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 -- 172.21.15.142:0/3749075152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5631c9191d80 con 0x5631c94159c0 2023-09-21T13:13:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81c27fc700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f81b800fc10 tx=0x7f81b8005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0102e82ac7e019a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81a6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:13:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8016070 con 0x5631c94159c0 2023-09-21T13:13:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.705+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8557+0+0 (secure 0 0 0) 0x7f81b8000e40 con 0x5631c94159c0 2023-09-21T13:13:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81bc00f040 con 0x5631c94159c0 2023-09-21T13:13:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81b800f690 con 0x5631c94159c0 2023-09-21T13:13:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 10 client.28424 fetch_fsmap learned FSMap version 56 2023-09-21T13:13:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x5631c9190250 con 0x5631c94159c0 2023-09-21T13:13:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81bc00f040 con 0x5631c94159c0 2023-09-21T13:13:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f81b8023430 con 0x5631c94159c0 2023-09-21T13:13:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 10 client.28424 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:13:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 10 client.28424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 20 client.28424 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c9483ce0 0x5631c9486100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 4 client.28424 mds_command: new command op to 24578 tid=0[{"prefix": "flush journal"}] 2023-09-21T13:13:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.706+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5631c935fe00 con 0x5631c9483ce0 2023-09-21T13:13:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.707+0000 7f81c37fe700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c9483ce0 0x5631c9486100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.707+0000 7f81a6ff5700 10 client.28424 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:09.707+0000 7f81c37fe700 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c9483ce0 0x5631c9486100 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ff468724e4232d server_cookie=ac396a1329e32057 in_seq=0 out_seq=0 2023-09-21T13:13:10.327 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.335+0000 7f81a6ff5700 1 -- 172.21.15.142:0/3749075152 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5631c935fe00 con 0x5631c9483ce0 2023-09-21T13:13:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.335+0000 7f81a6ff5700 10 client.28424 handle_command_reply: tid=0 2023-09-21T13:13:10.328 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.335+0000 7f81dd080b80 1 client.28424 shutdown 2023-09-21T13:13:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.335+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 msgr2=0x5631c9417d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.335+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f81b800fc10 tx=0x7f81b8005fa0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.329 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 shutdown_connections 2023-09-21T13:13:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x5631c9483ce0 0x5631c9486100 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x5631c9419e50 0x5631c9416730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5631c94150a0 0x5631c9417820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.330 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 --2- 172.21.15.142:0/3749075152 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x5631c94159c0 0x5631c9417d60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 >> 172.21.15.142:0/3749075152 conn(0x5631c9341fa0 msgr2=0x5631c9414730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81a6ff5700 0 client.28424 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 shutdown_connections 2023-09-21T13:13:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.336+0000 7f81dd080b80 1 -- 172.21.15.142:0/3749075152 wait complete. 2023-09-21T13:13:10.334 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.342+0000 7f81dd080b80 20 client.28424 trim_cache size 0 max 16384 2023-09-21T13:13:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:{ 2023-09-21T13:13:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "message": "", 2023-09-21T13:13:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout: "return_code": 0 2023-09-21T13:13:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stdout:} 2023-09-21T13:13:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.344+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 msgr2=0x7f81ac0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.344+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 0x7f81ac0a2cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009fd0 tx=0x7f81b40a0040 comp rx=0 tx=0).stop 2023-09-21T13:13:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.344+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 msgr2=0x7f81c4199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:10.337 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.344+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009810 tx=0x7f81b400fa00 comp rx=0 tx=0).stop 2023-09-21T13:13:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 shutdown_connections 2023-09-21T13:13:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f81ac0a0830 0x7f81ac0a2cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.344 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f81c419dd20 0x7f81c419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f81c4103230 0x7f81c4199170 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 --2- 172.21.15.142:0/916246742 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f81c4108350 0x7f81c41996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:10.345 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.345+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 >> 172.21.15.142:0/916246742 conn(0x7f81c40fea90 msgr2=0x7f81c4106c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.354+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 shutdown_connections 2023-09-21T13:13:10.349 INFO:teuthology.task.background_exec.ubuntu@smithi142.front.sepia.ceph.com.smithi142.stderr:2023-09-21T13:13:10.356+0000 7f81c97ff700 1 -- 172.21.15.142:0/916246742 wait complete. 2023-09-21T13:13:10.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:09 smithi156 ceph-mon[134078]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:10.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:09 smithi142 ceph-mon[97663]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:10.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:09 smithi160 ceph-mon[134450]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:12.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:12 smithi156 ceph-mon[134078]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:12.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:12 smithi156 ceph-mon[134078]: osdmap e113: 12 total, 12 up, 12 in 2023-09-21T13:13:12.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:12 smithi142 ceph-mon[97663]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:12.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:12 smithi142 ceph-mon[97663]: osdmap e113: 12 total, 12 up, 12 in 2023-09-21T13:13:12.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:12 smithi160 ceph-mon[134450]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 MiB/s rd, 7.5 MiB/s wr, 769 op/s 2023-09-21T13:13:12.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:12 smithi160 ceph-mon[134450]: osdmap e113: 12 total, 12 up, 12 in 2023-09-21T13:13:14.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:14 smithi156 ceph-mon[134078]: pgmap v539: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:14.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:14 smithi142 ceph-mon[97663]: pgmap v539: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:14.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:14 smithi160 ceph-mon[134450]: pgmap v539: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:16.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:16 smithi156 ceph-mon[134078]: pgmap v540: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:16.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:16 smithi142 ceph-mon[97663]: pgmap v540: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:16.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:16 smithi160 ceph-mon[134450]: pgmap v540: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.6 MiB/s wr, 495 op/s 2023-09-21T13:13:18.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:17 smithi156 ceph-mon[134078]: pgmap v541: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:18.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:17 smithi142 ceph-mon[97663]: pgmap v541: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:18.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:17 smithi160 ceph-mon[134450]: pgmap v541: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:18.389 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-09-21T13:13:18.390 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-21T13:13:19.485 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=41c9e835c3f621102ade35dd597317a42116a491 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2023-09-21T13:13:19.616 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3371da1716f44c12965f94e5d3f47138 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_41c9e835c3f621102ade35dd597317a42116a491/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test suites/dbench.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=41c9e835c3f621102ade35dd597317a42116a491 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh' 2023-09-21T13:13:19.620 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-09-21T13:13:19.629 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T13:13:19.642 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-09-21T13:13:19.653 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-09-21T13:13:19.655 INFO:teuthology.task.exec:Executing custom commands... 2023-09-21T13:13:19.656 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T13:13:19.656 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-09-21T13:13:19.760 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-09-21T13:13:19.850 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-09-21T13:13:20.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 -- 172.21.15.142:0/1556933917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf8106c90 msgr2=0x7fdaf8107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 --2- 172.21.15.142:0/1556933917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf8106c90 0x7fdaf8107070 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009990 tx=0x7fdae8009ca0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 -- 172.21.15.142:0/1556933917 shutdown_connections 2023-09-21T13:13:20.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 --2- 172.21.15.142:0/1556933917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8068b90 0x7fdaf810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 --2- 172.21.15.142:0/1556933917 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf8106c90 0x7fdaf8107070 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 --2- 172.21.15.142:0/1556933917 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf80681d0 0x7fdaf8068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 -- 172.21.15.142:0/1556933917 >> 172.21.15.142:0/1556933917 conn(0x7fdaf80765a0 msgr2=0x7fdaf80769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:20.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 -- 172.21.15.142:0/1556933917 shutdown_connections 2023-09-21T13:13:20.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.077+0000 7fdafc99d700 1 -- 172.21.15.142:0/1556933917 wait complete. 2023-09-21T13:13:20.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.078+0000 7fdafc99d700 1 Processor -- start 2023-09-21T13:13:20.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.078+0000 7fdafc99d700 1 -- start start 2023-09-21T13:13:20.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf8068b90 0x7fdaf8199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8106c90 0x7fdaf819d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819de10 con 0x7fdaf8068b90 2023-09-21T13:13:20.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819df80 con 0x7fdaf80681d0 2023-09-21T13:13:20.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdafc99d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf819e140 con 0x7fdaf8106c90 2023-09-21T13:13:20.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:45992/0 (socket says 172.21.15.142:45992) 2023-09-21T13:13:20.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 -- 172.21.15.142:0/3429089317 learned_addr learned my addr 172.21.15.142:0/3429089317 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:20.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf6ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf8068b90 0x7fdaf8199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf7fff700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8106c90 0x7fdaf819d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 -- 172.21.15.142:0/3429089317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8106c90 msgr2=0x7fdaf819d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8106c90 0x7fdaf819d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 -- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf8068b90 msgr2=0x7fdaf8199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf8068b90 0x7fdaf8199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.079+0000 7fdaf77fe700 1 -- 172.21.15.142:0/3429089317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80095f0 con 0x7fdaf80681d0 2023-09-21T13:13:20.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdaf77fe700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdae8005910 tx=0x7fdae8004710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:20.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae801d070 con 0x7fdaf80681d0 2023-09-21T13:13:20.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdae8022470 con 0x7fdaf80681d0 2023-09-21T13:13:20.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8017650 con 0x7fdaf80681d0 2023-09-21T13:13:20.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf819e3c0 con 0x7fdaf80681d0 2023-09-21T13:13:20.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.080+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf819e640 con 0x7fdaf80681d0 2023-09-21T13:13:20.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.081+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf804eae0 con 0x7fdaf80681d0 2023-09-21T13:13:20.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.083+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fdae80225e0 con 0x7fdaf80681d0 2023-09-21T13:13:20.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.084+0000 7fdaf4ff9700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 0x7fdae00a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.084+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fdae80cd2c0 con 0x7fdaf80681d0 2023-09-21T13:13:20.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.085+0000 7fdaf6ffd700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 0x7fdae00a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.085+0000 7fdaf6ffd700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 0x7fdae00a2cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaf819a440 tx=0x7fdaec009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:20.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.087+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fdae8096ae0 con 0x7fdaf80681d0 2023-09-21T13:13:20.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:19 smithi142 ceph-mon[97663]: pgmap v542: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:20.344 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.352+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fdaf8110dc0 con 0x7fdae00a0830 2023-09-21T13:13:20.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.365+0000 7fdaf4ff9700 1 -- 172.21.15.142:0/3429089317 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7fdaf8110dc0 con 0x7fdae00a0830 2023-09-21T13:13:20.358 INFO:teuthology.orchestra.run.smithi142.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2023-09-21T00:00:00", "created": "2023-09-21T12:56:15", "first": "2023-09-21T12:57:00", "last": "2023-09-21T13:13:00", "last_pruned": "2023-09-21T13:13:00", "created_count": 17, "pruned_count": 10, "active": true} 2023-09-21T13:13:20.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 msgr2=0x7fdae00a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 0x7fdae00a2cf0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdaf819a440 tx=0x7fdaec009260 comp rx=0 tx=0).stop 2023-09-21T13:13:20.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 msgr2=0x7fdaf8198e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdae8005910 tx=0x7fdae8004710 comp rx=0 tx=0).stop 2023-09-21T13:13:20.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 shutdown_connections 2023-09-21T13:13:20.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fdae00a0830 0x7fdae00a2cf0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaf8106c90 0x7fdaf819d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fdaf80681d0 0x7fdaf8198e30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 --2- 172.21.15.142:0/3429089317 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fdaf8068b90 0x7fdaf8199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 >> 172.21.15.142:0/3429089317 conn(0x7fdaf80765a0 msgr2=0x7fdaf80fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 shutdown_connections 2023-09-21T13:13:20.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.368+0000 7fdafc99d700 1 -- 172.21.15.142:0/3429089317 wait complete. 2023-09-21T13:13:20.379 DEBUG:teuthology.orchestra.run.smithi142:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-09-21T13:13:20.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:19 smithi156 ceph-mon[134078]: pgmap v542: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:20.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:19 smithi160 ceph-mon[134450]: pgmap v542: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:20.612 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/311279898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 msgr2=0x7f8e98107070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/311279898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98107070 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f8e940098f0 tx=0x7f8e94009c00 comp rx=0 tx=0).stop 2023-09-21T13:13:20.613 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/311279898 shutdown_connections 2023-09-21T13:13:20.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/311279898 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9810da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/311279898 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98107070 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.614 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/311279898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e98068650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/311279898 >> 172.21.15.142:0/311279898 conn(0x7f8e980765a0 msgr2=0x7f8e980769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:20.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/311279898 shutdown_connections 2023-09-21T13:13:20.615 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.620+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/311279898 wait complete. 2023-09-21T13:13:20.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.621+0000 7f8e9ef9d700 1 Processor -- start 2023-09-21T13:13:20.617 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.621+0000 7f8e9ef9d700 1 -- start start 2023-09-21T13:13:20.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.621+0000 7f8e9ef9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e9819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.621+0000 7f8e9ef9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.618 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9ef9d700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9ef9d700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98197120 con 0x7f8e98068b90 2023-09-21T13:13:20.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9ef9d700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98197290 con 0x7f8e98106c90 2023-09-21T13:13:20.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9ef9d700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98197450 con 0x7f8e980681d0 2023-09-21T13:13:20.619 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e9819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9e79c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:46024/0 (socket says 172.21.15.142:46024) 2023-09-21T13:13:20.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9e79c700 1 -- 172.21.15.142:0/1714245781 learned_addr learned my addr 172.21.15.142:0/1714245781 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:20.620 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9d79a700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 -- 172.21.15.142:0/1714245781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 msgr2=0x7f8e98196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 -- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 msgr2=0x7f8e9819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.621 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9819cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9df9b700 1 -- 172.21.15.142:0/1714245781 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e90009d00 con 0x7f8e980681d0 2023-09-21T13:13:20.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.622+0000 7f8e9d79a700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:13:20.622 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e9df9b700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e9819ca40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009810 tx=0x7f8e9400fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:20.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9401c070 con 0x7f8e980681d0 2023-09-21T13:13:20.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e94009520 con 0x7f8e980681d0 2023-09-21T13:13:20.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e981a3850 con 0x7f8e980681d0 2023-09-21T13:13:20.623 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e9400bbd0 con 0x7f8e980681d0 2023-09-21T13:13:20.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.623+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940038c0 con 0x7f8e980681d0 2023-09-21T13:13:20.624 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.624+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c005320 con 0x7f8e980681d0 2023-09-21T13:13:20.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.626+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8e94020030 con 0x7f8e980681d0 2023-09-21T13:13:20.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.628+0000 7f8e8effd700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 0x7f8e840a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:20.625 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.628+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8e940cd3f0 con 0x7f8e980681d0 2023-09-21T13:13:20.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.628+0000 7f8e9d79a700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 0x7f8e840a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:20.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.628+0000 7f8e9d79a700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 0x7f8e840a2cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e98076fb0 tx=0x7f8e88009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:20.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.630+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8e94096c70 con 0x7f8e980681d0 2023-09-21T13:13:20.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.871+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 --> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8e7c000bf0 con 0x7f8e840a0830 2023-09-21T13:13:20.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.884+0000 7f8e8effd700 1 -- 172.21.15.142:0/1714245781 <== mgr.15303 v2:172.21.15.142:6800/373173545 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f8e7c000bf0 con 0x7f8e840a0830 2023-09-21T13:13:20.876 INFO:teuthology.orchestra.run.smithi142.stdout:/ 1m 6m3h 2023-09-21T13:13:20.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 msgr2=0x7f8e840a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 0x7f8e840a2cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e98076fb0 tx=0x7f8e88009260 comp rx=0 tx=0).stop 2023-09-21T13:13:20.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 msgr2=0x7f8e9819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:20.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e9819ca40 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f8e94009810 tx=0x7f8e9400fa00 comp rx=0 tx=0).stop 2023-09-21T13:13:20.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 shutdown_connections 2023-09-21T13:13:20.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8e840a0830 0x7f8e840a2cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8e98106c90 0x7f8e98196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e980681d0 0x7f8e9819ca40 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 --2- 172.21.15.142:0/1714245781 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8e98068b90 0x7f8e9819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:20.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 >> 172.21.15.142:0/1714245781 conn(0x7f8e980765a0 msgr2=0x7f8e980fe840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:20.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 shutdown_connections 2023-09-21T13:13:20.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:20.887+0000 7f8e9ef9d700 1 -- 172.21.15.142:0/1714245781 wait complete. 2023-09-21T13:13:20.903 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-09-21T13:13:20.913 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-09-21T13:13:22.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:21 smithi156 ceph-mon[134078]: from='client.28430 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:21 smithi156 ceph-mon[134078]: from='client.28351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:21 smithi156 ceph-mon[134078]: pgmap v543: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:22.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:21 smithi142 ceph-mon[97663]: from='client.28430 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:21 smithi142 ceph-mon[97663]: from='client.28351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:21 smithi142 ceph-mon[97663]: pgmap v543: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:22.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:21 smithi160 ceph-mon[134450]: from='client.28430 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:21 smithi160 ceph-mon[134450]: from='client.28351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-21T13:13:22.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:21 smithi160 ceph-mon[134450]: pgmap v543: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.2 MiB/s wr, 281 op/s 2023-09-21T13:13:24.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:23 smithi156 ceph-mon[134078]: pgmap v544: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 775 KiB/s wr, 69 op/s 2023-09-21T13:13:24.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:23 smithi142 ceph-mon[97663]: pgmap v544: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 775 KiB/s wr, 69 op/s 2023-09-21T13:13:24.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:23 smithi160 ceph-mon[134450]: pgmap v544: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 459 KiB/s rd, 775 KiB/s wr, 69 op/s 2023-09-21T13:13:26.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:25 smithi156 ceph-mon[134078]: pgmap v545: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 138 KiB/s wr, 43 op/s 2023-09-21T13:13:26.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:25 smithi142 ceph-mon[97663]: pgmap v545: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 138 KiB/s wr, 43 op/s 2023-09-21T13:13:26.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:25 smithi160 ceph-mon[134450]: pgmap v545: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 138 KiB/s wr, 43 op/s 2023-09-21T13:13:28.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:27 smithi156 ceph-mon[134078]: pgmap v546: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 152 KiB/s wr, 47 op/s 2023-09-21T13:13:28.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:27 smithi142 ceph-mon[97663]: pgmap v546: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 152 KiB/s wr, 47 op/s 2023-09-21T13:13:28.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:27 smithi160 ceph-mon[134450]: pgmap v546: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 152 KiB/s wr, 47 op/s 2023-09-21T13:13:28.819 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:13:29.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2558791003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed41060c0 msgr2=0x7f0ed410dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2558791003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed41060c0 0x7f0ed410dc40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00b0a0 tx=0x7f0ecc00b3b0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2558791003 shutdown_connections 2023-09-21T13:13:29.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2558791003 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed4100fa0 0x7f0ed4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2558791003 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed41060c0 0x7f0ed410dc40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2558791003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4101950 0x7f0ed4105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2558791003 >> 172.21.15.142:0/2558791003 conn(0x7f0ed40fc860 msgr2=0x7f0ed40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2558791003 shutdown_connections 2023-09-21T13:13:29.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.054+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2558791003 wait complete. 2023-09-21T13:13:29.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 Processor -- start 2023-09-21T13:13:29.052 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 -- start start 2023-09-21T13:13:29.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed41060c0 0x7f0ed4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4073b60 0x7f0ed41a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.053 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41a55c0 con 0x7f0ed41060c0 2023-09-21T13:13:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41a5730 con 0x7f0ed4100fa0 2023-09-21T13:13:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.056+0000 7f0edc1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41a58f0 con 0x7f0ed4073b60 2023-09-21T13:13:29.054 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47640/0 (socket says 172.21.15.142:47640) 2023-09-21T13:13:29.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2639570818 learned_addr learned my addr 172.21.15.142:0/2639570818 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:29.055 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed979a700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed41060c0 0x7f0ed4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4073b60 0x7f0ed41a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2639570818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4073b60 msgr2=0x7f0ed41a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4073b60 0x7f0ed41a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.056 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed41060c0 msgr2=0x7f0ed4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed41060c0 0x7f0ed4073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2639570818 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc009d00 con 0x7f0ed4100fa0 2023-09-21T13:13:29.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000e9a0 tx=0x7f0ed000ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.057 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ecaffd700 1 -- 172.21.15.142:0/2639570818 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0009790 con 0x7f0ed4100fa0 2023-09-21T13:13:29.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0ecaffd700 1 -- 172.21.15.142:0/2639570818 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed000cbd0 con 0x7f0ed4100fa0 2023-09-21T13:13:29.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.057+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed41a5bd0 con 0x7f0ed4100fa0 2023-09-21T13:13:29.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.058+0000 7f0ecaffd700 1 -- 172.21.15.142:0/2639570818 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed0018680 con 0x7f0ed4100fa0 2023-09-21T13:13:29.058 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.058+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed41a60e0 con 0x7f0ed4100fa0 2023-09-21T13:13:29.064 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.062+0000 7f0ecaffd700 1 -- 172.21.15.142:0/2639570818 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f0ed000cd40 con 0x7f0ed4100fa0 2023-09-21T13:13:29.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.062+0000 7f0eefae9b80 1 Processor -- start 2023-09-21T13:13:29.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.062+0000 7f0eefae9b80 1 -- start start 2023-09-21T13:13:29.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee0c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee10fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.066 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ed77ca0 con 0x55ec6ee0be20 2023-09-21T13:13:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ed5bc70 con 0x55ec6ee0c740 2023-09-21T13:13:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ed59590 con 0x55ec6ee10b70 2023-09-21T13:13:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.067 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47654/0 (socket says 172.21.15.142:47654) 2023-09-21T13:13:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2846299856 learned_addr learned my addr 172.21.15.142:0/2846299856 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.063+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee0c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed979a700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee10fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.068 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2846299856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 msgr2=0x55ec6ee10fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee10fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2846299856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 msgr2=0x55ec6ee0c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.069 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee0c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2846299856 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec6eb7fde0 con 0x55ec6ee0c740 2023-09-21T13:13:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee0c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:13:29.070 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00c9950 tx=0x7f0ed00d4440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad84999f030784c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ebffff700 1 -- 172.21.15.142:0/2846299856 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00ce0d0 con 0x55ec6ee0c740 2023-09-21T13:13:29.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ecaffd700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 0x7f0ec00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ebffff700 1 -- 172.21.15.142:0/2846299856 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed00cfce0 con 0x55ec6ee0c740 2023-09-21T13:13:29.072 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ebffff700 1 -- 172.21.15.142:0/2846299856 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00da6f0 con 0x55ec6ee0c740 2023-09-21T13:13:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.064+0000 7f0ecaffd700 1 -- 172.21.15.142:0/2639570818 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0ed0014070 con 0x7f0ed4100fa0 2023-09-21T13:13:29.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 0x7f0ec00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2846299856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 msgr2=0x55ec6ee10630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00c9950 tx=0x7f0ed00d4440 comp rx=0 tx=0).stop 2023-09-21T13:13:29.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2846299856 shutdown_connections 2023-09-21T13:13:29.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee0c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee10fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2846299856 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10630 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.065+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2846299856 >> 172.21.15.142:0/2846299856 conn(0x55ec6ed30000 msgr2=0x55ec6edfe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.077 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.066+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 0x7f0ec00a2c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009610 tx=0x7f0ecc006210 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.066+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2846299856 shutdown_connections 2023-09-21T13:13:29.078 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.066+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2846299856 wait complete. 2023-09-21T13:13:29.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.066+0000 7f0eefae9b80 1 -- start start 2023-09-21T13:13:29.079 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.066+0000 7f0eefae9b80 1 Processor -- start 2023-09-21T13:13:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee155b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.080 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee10b70 0x55ec6ee15c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ed54e80 con 0x55ec6ee10b70 2023-09-21T13:13:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ecf1740 con 0x55ec6ee0c740 2023-09-21T13:13:29.081 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ecf13e0 con 0x55ec6ee0be20 2023-09-21T13:13:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eefae9b80 10 client.0 _ll_register_callbacks cb 0x55ec6ec3ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.082 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:45078/0 (socket says 172.21.15.142:45078) 2023-09-21T13:13:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/1051710176 learned_addr learned my addr 172.21.15.142:0/1051710176 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0ed979a700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee155b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.067+0000 7f0eda79c700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee10b70 0x55ec6ee15c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 msgr2=0x55ec6ee155b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee155b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/1051710176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee10b70 msgr2=0x55ec6ee15c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee10b70 0x55ec6ee15c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/1051710176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed41a60e0 con 0x55ec6ee0be20 2023-09-21T13:13:29.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0099700 tx=0x7f0ed00d4840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=350e108608861274 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.085 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ebd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:13:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00ccea0 con 0x55ec6ee0be20 2023-09-21T13:13:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec6edd2020 con 0x55ec6ee0be20 2023-09-21T13:13:29.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.068+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0ed0099e70 con 0x55ec6ee0be20 2023-09-21T13:13:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed00ccc60 con 0x55ec6ee0be20 2023-09-21T13:13:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 10 client.28363 fetch_fsmap learned FSMap version 56 2023-09-21T13:13:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55ec6eb68c60 con 0x55ec6ee0be20 2023-09-21T13:13:29.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ec6edd2020 con 0x55ec6ee0be20 2023-09-21T13:13:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ed00c9c90 con 0x55ec6ee0be20 2023-09-21T13:13:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 10 client.28363 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:13:29.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 10 client.28363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:29.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 20 client.28363 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:29.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee258f0 0x55ec6ee27d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 4 client.28363 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:13:29.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec6ed4de60 con 0x55ec6ee258f0 2023-09-21T13:13:29.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.069+0000 7f0ed979a700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee258f0 0x55ec6ee27d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.070+0000 7f0ed979a700 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee258f0 0x55ec6ee27d10 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96d98f18ef58be2 server_cookie=888593b3d133e3f7 in_seq=0 out_seq=0 2023-09-21T13:13:29.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.070+0000 7f0ebd7fa700 10 client.28363 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:29.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.070+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/1051710176 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec6ed4de60 con 0x55ec6ee258f0 2023-09-21T13:13:29.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.070+0000 7f0ebd7fa700 10 client.28363 handle_command_reply: tid=0 2023-09-21T13:13:29.091 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 client.28363 shutdown 2023-09-21T13:13:29.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 msgr2=0x55ec6ee18330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0099700 tx=0x7f0ed00d4840 comp rx=0 tx=0).stop 2023-09-21T13:13:29.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 shutdown_connections 2023-09-21T13:13:29.092 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee258f0 0x55ec6ee27d10 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee10b70 0x55ec6ee15c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0ebd7fa700 0 client.28363 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:29.093 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee0be20 0x55ec6ee18330 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/1051710176 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee155b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 >> 172.21.15.142:0/1051710176 conn(0x55ec6ed30000 msgr2=0x55ec6edfe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 shutdown_connections 2023-09-21T13:13:29.094 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 1 -- 172.21.15.142:0/1051710176 wait complete. 2023-09-21T13:13:29.095 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.071+0000 7f0eefae9b80 20 client.28363 trim_cache size 0 max 16384 2023-09-21T13:13:29.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 Processor -- start 2023-09-21T13:13:29.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 -- start start 2023-09-21T13:13:29.103 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee1cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee17ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.104 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ebd5920 con 0x55ec6ee0be20 2023-09-21T13:13:29.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ee0cc70 con 0x55ec6ee0c740 2023-09-21T13:13:29.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.091+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ee15a20 con 0x55ec6ee10b70 2023-09-21T13:13:29.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.105 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47672/0 (socket says 172.21.15.142:47672) 2023-09-21T13:13:29.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 -- 172.21.15.142:0/3991405816 learned_addr learned my addr 172.21.15.142:0/3991405816 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:29.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee1cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.106 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0eda79c700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee17ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 -- 172.21.15.142:0/3991405816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 msgr2=0x55ec6ee17ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee17ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.107 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 -- 172.21.15.142:0/3991405816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 msgr2=0x55ec6ee1cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee1cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.108 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 -- 172.21.15.142:0/3991405816 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec6ee2c900 con 0x55ec6ee0c740 2023-09-21T13:13:29.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:13:29.109 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ed979a700 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55ec6ee16b60 tx=0x7f0ec401cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec8508b271f6e86 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.092+0000 7f0ec8ff9700 1 -- 172.21.15.142:0/3991405816 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017040 con 0x55ec6ee0c740 2023-09-21T13:13:29.110 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0ec8ff9700 1 -- 172.21.15.142:0/3991405816 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ec4020070 con 0x55ec6ee0c740 2023-09-21T13:13:29.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0ec8ff9700 1 -- 172.21.15.142:0/3991405816 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4010690 con 0x55ec6ee0c740 2023-09-21T13:13:29.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 -- 172.21.15.142:0/3991405816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 msgr2=0x55ec6ee10290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.111 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x55ec6ee16b60 tx=0x7f0ec401cbe0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 -- 172.21.15.142:0/3991405816 shutdown_connections 2023-09-21T13:13:29.112 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0be20 0x55ec6ee1cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee17ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.113 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/3991405816 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0c740 0x55ec6ee10290 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 -- 172.21.15.142:0/3991405816 >> 172.21.15.142:0/3991405816 conn(0x55ec6ed30000 msgr2=0x55ec6ee0fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.093+0000 7f0eefae9b80 1 -- 172.21.15.142:0/3991405816 shutdown_connections 2023-09-21T13:13:29.114 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.094+0000 7f0eefae9b80 1 -- 172.21.15.142:0/3991405816 wait complete. 2023-09-21T13:13:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.094+0000 7f0eefae9b80 1 -- start start 2023-09-21T13:13:29.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.094+0000 7f0eefae9b80 1 Processor -- start 2023-09-21T13:13:29.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0c740 0x55ec6ee73560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee6d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ee6dd50 con 0x55ec6ee0c740 2023-09-21T13:13:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ee6dec0 con 0x55ec6ee0be20 2023-09-21T13:13:29.118 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec6ee6e080 con 0x55ec6ee10b70 2023-09-21T13:13:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eefae9b80 10 client.0 _ll_register_callbacks cb 0x55ec6ec3ba80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:29.119 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:47676/0 (socket says 172.21.15.142:47676) 2023-09-21T13:13:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed979a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0c740 0x55ec6ee73560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2311073748 learned_addr learned my addr 172.21.15.142:0/2311073748 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:29.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0eda79c700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee6d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2311073748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 msgr2=0x55ec6ee6d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee6d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2311073748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0c740 msgr2=0x55ec6ee73560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:29.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0c740 0x55ec6ee73560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.095+0000 7f0ed9f9b700 1 -- 172.21.15.142:0/2311073748 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40099b0 con 0x55ec6ee0be20 2023-09-21T13:13:29.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ed9f9b700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0095c70 tx=0x7f0ed00954b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd7ca6820f66b36 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:29.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:13:29.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed00af020 con 0x55ec6ee0be20 2023-09-21T13:13:29.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f0ed00d48b0 con 0x55ec6ee0be20 2023-09-21T13:13:29.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec6ecc5bb0 con 0x55ec6ee0be20 2023-09-21T13:13:29.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed009d5f0 con 0x55ec6ee0be20 2023-09-21T13:13:29.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0eefae9b80 10 client.28454 fetch_fsmap learned FSMap version 56 2023-09-21T13:13:29.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x55ec6eba6250 con 0x55ec6ee0be20 2023-09-21T13:13:29.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0ed00b7020 con 0x55ec6ee0be20 2023-09-21T13:13:29.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 56) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ed00a1350 con 0x55ec6ee0be20 2023-09-21T13:13:29.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0eefae9b80 10 client.28454 fetch_fsmap finished waiting for FSMap version 56 2023-09-21T13:13:29.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.096+0000 7f0eefae9b80 10 client.28454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:29.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0eefae9b80 20 client.28454 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:29.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee7a940 0x55ec6ee7cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:29.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0eefae9b80 4 client.28454 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:13:29.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec6ed4db80 con 0x55ec6ee7a940 2023-09-21T13:13:29.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0ed979a700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee7a940 0x55ec6ee7cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:29.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0ebd7fa700 10 client.28454 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:29.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.097+0000 7f0ed979a700 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee7a940 0x55ec6ee7cd30 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f020c10eac460223 server_cookie=1772403c3de5e0b1 in_seq=0 out_seq=0 2023-09-21T13:13:29.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0ebd7fa700 1 -- 172.21.15.142:0/2311073748 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ec6ed4db80 con 0x55ec6ee7a940 2023-09-21T13:13:29.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0ebd7fa700 10 client.28454 handle_command_reply: tid=0 2023-09-21T13:13:29.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 client.28454 shutdown 2023-09-21T13:13:29.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 msgr2=0x55ec6ee73020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0095c70 tx=0x7f0ed00954b0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 shutdown_connections 2023-09-21T13:13:29.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55ec6ee7a940 0x55ec6ee7cd30 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55ec6ee10b70 0x55ec6ee6d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55ec6ee0be20 0x55ec6ee73020 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0ebd7fa700 0 client.28454 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:29.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 --2- 172.21.15.142:0/2311073748 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55ec6ee0c740 0x55ec6ee73560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 >> 172.21.15.142:0/2311073748 conn(0x55ec6ed30000 msgr2=0x55ec6ee10410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 shutdown_connections 2023-09-21T13:13:29.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 1 -- 172.21.15.142:0/2311073748 wait complete. 2023-09-21T13:13:29.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.098+0000 7f0eefae9b80 20 client.28454 trim_cache size 0 max 16384 2023-09-21T13:13:29.134 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:13:29.134 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "scrub active (1 inodes in the stack)", 2023-09-21T13:13:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": { 2023-09-21T13:13:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "972c099a-d5d8-456b-b462-4b2773d37e90": { 2023-09-21T13:13:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "path": "/", 2023-09-21T13:13:29.135 INFO:teuthology.orchestra.run.smithi142.stdout: "tag": "972c099a-d5d8-456b-b462-4b2773d37e90", 2023-09-21T13:13:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: "options": "recursive,force" 2023-09-21T13:13:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:13:29.136 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:13:29.136 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:13:29.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 msgr2=0x7f0ec00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 0x7f0ec00a2c70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009610 tx=0x7f0ecc006210 comp rx=0 tx=0).stop 2023-09-21T13:13:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 msgr2=0x7f0ed40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000e9a0 tx=0x7f0ed000ed60 comp rx=0 tx=0).stop 2023-09-21T13:13:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 shutdown_connections 2023-09-21T13:13:29.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0ec00a07b0 0x7f0ec00a2c70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ed4073b60 0x7f0ed41a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0ed4100fa0 0x7f0ed40730e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 --2- 172.21.15.142:0/2639570818 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0ed41060c0 0x7f0ed4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 >> 172.21.15.142:0/2639570818 conn(0x7f0ed40fc860 msgr2=0x7f0ed40fd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 shutdown_connections 2023-09-21T13:13:29.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:29.099+0000 7f0edc1ff700 1 -- 172.21.15.142:0/2639570818 wait complete. 2023-09-21T13:13:29.141 INFO:tasks.cephfs.filesystem:scrub status for tag:972c099a-d5d8-456b-b462-4b2773d37e90 - {'path': '/', 'tag': '972c099a-d5d8-456b-b462-4b2773d37e90', 'options': 'recursive,force'} 2023-09-21T13:13:30.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:29 smithi156 ceph-mon[134078]: pgmap v547: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:30.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:29 smithi142 ceph-mon[97663]: pgmap v547: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:30.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:29 smithi160 ceph-mon[134450]: pgmap v547: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:32.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:31 smithi156 ceph-mon[134078]: pgmap v548: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:32.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:31 smithi142 ceph-mon[97663]: pgmap v548: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:32.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:31 smithi160 ceph-mon[134450]: pgmap v548: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 76 KiB/s wr, 14 op/s 2023-09-21T13:13:34.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:33 smithi156 ceph-mon[134078]: pgmap v549: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-09-21T13:13:34.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:33 smithi142 ceph-mon[97663]: pgmap v549: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-09-21T13:13:34.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:33 smithi160 ceph-mon[134450]: pgmap v549: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 177 KiB/s wr, 27 op/s 2023-09-21T13:13:36.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:35 smithi156 ceph-mon[134078]: pgmap v550: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 115 KiB/s wr, 16 op/s 2023-09-21T13:13:36.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:35 smithi142 ceph-mon[97663]: pgmap v550: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 115 KiB/s wr, 16 op/s 2023-09-21T13:13:36.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:35 smithi160 ceph-mon[134450]: pgmap v550: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 115 KiB/s wr, 16 op/s 2023-09-21T13:13:38.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:37 smithi156 ceph-mon[134078]: pgmap v551: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 21 op/s 2023-09-21T13:13:38.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:37 smithi142 ceph-mon[97663]: pgmap v551: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 21 op/s 2023-09-21T13:13:38.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:37 smithi160 ceph-mon[134450]: pgmap v551: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 128 KiB/s wr, 21 op/s 2023-09-21T13:13:40.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:39 smithi156 ceph-mon[134078]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:40.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:39 smithi142 ceph-mon[97663]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:40.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:39 smithi160 ceph-mon[134450]: pgmap v552: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:42.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:41 smithi156 ceph-mon[134078]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:42.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:41 smithi142 ceph-mon[97663]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:42.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:41 smithi160 ceph-mon[134450]: pgmap v553: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 115 KiB/s wr, 17 op/s 2023-09-21T13:13:43.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:43 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:43.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:43 smithi156 ceph-mon[134078]: scrub summary: active paths [/] 2023-09-21T13:13:43.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:43 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:43.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:43 smithi156 ceph-mon[134078]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:43.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:43 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:43.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:43 smithi142 ceph-mon[97663]: scrub summary: active paths [/] 2023-09-21T13:13:43.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:43 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:43.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:43 smithi142 ceph-mon[97663]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:43.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:43 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:43.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:43 smithi160 ceph-mon[134450]: scrub summary: active paths [/] 2023-09-21T13:13:43.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:43 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:43.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:43 smithi160 ceph-mon[134450]: scrub summary: idle+waiting paths [/] 2023-09-21T13:13:44.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:44 smithi156 ceph-mon[134078]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 132 KiB/s wr, 21 op/s 2023-09-21T13:13:44.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:44 smithi142 ceph-mon[97663]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 132 KiB/s wr, 21 op/s 2023-09-21T13:13:44.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:44 smithi160 ceph-mon[134450]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 132 KiB/s wr, 21 op/s 2023-09-21T13:13:46.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:46 smithi156 ceph-mon[134078]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-09-21T13:13:46.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:46 smithi142 ceph-mon[97663]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-09-21T13:13:46.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:46 smithi160 ceph-mon[134450]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 31 KiB/s wr, 9 op/s 2023-09-21T13:13:48.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:48 smithi156 ceph-mon[134078]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 14 op/s 2023-09-21T13:13:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:48 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:48.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:48 smithi142 ceph-mon[97663]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 14 op/s 2023-09-21T13:13:48.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:48 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:48.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:48 smithi160 ceph-mon[134450]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 81 KiB/s wr, 14 op/s 2023-09-21T13:13:48.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:48 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:13:50.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:50 smithi156 ceph-mon[134078]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:50.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:50 smithi142 ceph-mon[97663]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:50.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:50 smithi160 ceph-mon[134450]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:52.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:52.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:13:52.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:13:52.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:13:52.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: scrub summary: idle 2023-09-21T13:13:52.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:13:52.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:13:52.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:52 smithi156 ceph-mon[134078]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:13:52.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:52.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:13:52.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:13:52.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:13:52.410 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: scrub summary: idle 2023-09-21T13:13:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:13:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:13:52.411 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:52 smithi142 ceph-mon[97663]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:13:52.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 67 KiB/s wr, 9 op/s 2023-09-21T13:13:52.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-21T13:13:52.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:13:52.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:13:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: scrub summary: idle 2023-09-21T13:13:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-21T13:13:52.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-21T13:13:52.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:52 smithi160 ceph-mon[134450]: from='mgr.15303 ' entity='mgr.x' 2023-09-21T13:13:54.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:54 smithi156 ceph-mon[134078]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 14 op/s 2023-09-21T13:13:54.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:54 smithi142 ceph-mon[97663]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 14 op/s 2023-09-21T13:13:54.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:54 smithi160 ceph-mon[134450]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 92 KiB/s wr, 14 op/s 2023-09-21T13:13:56.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:56 smithi156 ceph-mon[134078]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 75 KiB/s wr, 10 op/s 2023-09-21T13:13:56.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:56 smithi142 ceph-mon[97663]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 75 KiB/s wr, 10 op/s 2023-09-21T13:13:56.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:56 smithi160 ceph-mon[134450]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 75 KiB/s wr, 10 op/s 2023-09-21T13:13:58.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:57 smithi156 ceph-mon[134078]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 90 KiB/s wr, 15 op/s 2023-09-21T13:13:58.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:57 smithi142 ceph-mon[97663]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 90 KiB/s wr, 15 op/s 2023-09-21T13:13:58.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:57 smithi160 ceph-mon[134450]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 90 KiB/s wr, 15 op/s 2023-09-21T13:13:59.143 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-21T13:13:59.356 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/2656871908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f381060e0 msgr2=0x7f8f3810dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/2656871908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f381060e0 0x7f8f3810dc60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000b0a0 tx=0x7f8f3000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.357 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/2656871908 shutdown_connections 2023-09-21T13:13:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/2656871908 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f381060e0 0x7f8f3810dc60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/2656871908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f38100fc0 0x7f8f381013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.358 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/2656871908 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f38101970 0x7f8f381059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/2656871908 >> 172.21.15.142:0/2656871908 conn(0x7f8f380fc840 msgr2=0x7f8f380fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/2656871908 shutdown_connections 2023-09-21T13:13:59.359 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.364+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/2656871908 wait complete. 2023-09-21T13:13:59.361 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.365+0000 7f8f3e9ff700 1 Processor -- start 2023-09-21T13:13:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.365+0000 7f8f3e9ff700 1 -- start start 2023-09-21T13:13:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 0x7f8f38199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.362 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 0x7f8f381997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3819dc00 0x7f8f3819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819e680 con 0x7f8f38100fc0 2023-09-21T13:13:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819e7f0 con 0x7f8f381060e0 2023-09-21T13:13:59.363 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3e9ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3819e9b0 con 0x7f8f3819dc00 2023-09-21T13:13:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 0x7f8f38199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 0x7f8f381997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 0x7f8f38199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57660/0 (socket says 172.21.15.142:57660) 2023-09-21T13:13:59.364 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f37fff700 1 -- 172.21.15.142:0/3262498943 learned_addr learned my addr 172.21.15.142:0/3262498943 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3819dc00 0x7f8f3819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 -- 172.21.15.142:0/3262498943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3819dc00 msgr2=0x7f8f3819e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.365 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3819dc00 0x7f8f3819e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 -- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 msgr2=0x7f8f38199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 0x7f8f38199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.366 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.366+0000 7f8f377fe700 1 -- 172.21.15.142:0/3262498943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009d00 con 0x7f8f381060e0 2023-09-21T13:13:59.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 0x7f8f381997a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00e9c0 tx=0x7f8f2c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f357fa700 1 -- 172.21.15.142:0/3262498943 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00c9c0 con 0x7f8f381060e0 2023-09-21T13:13:59.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f381a5f10 con 0x7f8f381060e0 2023-09-21T13:13:59.367 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f357fa700 1 -- 172.21.15.142:0/3262498943 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f2c010430 con 0x7f8f381060e0 2023-09-21T13:13:59.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f357fa700 1 -- 172.21.15.142:0/3262498943 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c018680 con 0x7f8f381060e0 2023-09-21T13:13:59.368 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.367+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f381a63e0 con 0x7f8f381060e0 2023-09-21T13:13:59.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.370+0000 7f8f357fa700 1 -- 172.21.15.142:0/3262498943 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f8f2c00cb20 con 0x7f8f381060e0 2023-09-21T13:13:59.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.371+0000 7f8f52311b80 1 Processor -- start 2023-09-21T13:13:59.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 -- start start 2023-09-21T13:13:59.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f357fa700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 0x7f8f200a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f357fa700 1 -- 172.21.15.142:0/3262498943 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8f2c014070 con 0x7f8f381060e0 2023-09-21T13:13:59.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa892be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.375 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa892c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa889bca0 con 0x557fa892c360 2023-09-21T13:13:59.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa887fc70 con 0x557fa8927610 2023-09-21T13:13:59.376 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f52311b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa887d590 con 0x557fa8927f30 2023-09-21T13:13:59.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 0x7f8f200a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50826/0 (socket says 172.21.15.142:50826) 2023-09-21T13:13:59.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f3cf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa892c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.372+0000 7f8f37fff700 1 -- 172.21.15.142:0/46669669 learned_addr learned my addr 172.21.15.142:0/46669669 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f377fe700 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa892be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 -- 172.21.15.142:0/46669669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 msgr2=0x557fa892be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa892be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 -- 172.21.15.142:0/46669669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 msgr2=0x557fa892c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa892c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 -- 172.21.15.142:0/46669669 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fa86a3de0 con 0x557fa8927610 2023-09-21T13:13:59.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 0x7f8f200a2c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f300062a0 tx=0x7f8f300094c0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f37fff700 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e50 tx=0x7f8f28011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afe77d90ce2e408a server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f1e7fc700 1 -- 172.21.15.142:0/46669669 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28019630 con 0x557fa8927610 2023-09-21T13:13:59.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f1e7fc700 1 -- 172.21.15.142:0/46669669 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f28019c50 con 0x557fa8927610 2023-09-21T13:13:59.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.373+0000 7f8f1e7fc700 1 -- 172.21.15.142:0/46669669 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800ebb0 con 0x557fa8927610 2023-09-21T13:13:59.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 -- 172.21.15.142:0/46669669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 msgr2=0x557fa89279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.381 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009e50 tx=0x7f8f28011720 comp rx=0 tx=0).stop 2023-09-21T13:13:59.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 -- 172.21.15.142:0/46669669 shutdown_connections 2023-09-21T13:13:59.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa892c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa89279f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.382 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 --2- 172.21.15.142:0/46669669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa892be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 -- 172.21.15.142:0/46669669 >> 172.21.15.142:0/46669669 conn(0x557fa8854000 msgr2=0x557fa89226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 -- 172.21.15.142:0/46669669 shutdown_connections 2023-09-21T13:13:59.383 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.374+0000 7f8f52311b80 1 -- 172.21.15.142:0/46669669 wait complete. 2023-09-21T13:13:59.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.375+0000 7f8f52311b80 1 -- start start 2023-09-21T13:13:59.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.375+0000 7f8f52311b80 1 Processor -- start 2023-09-21T13:13:59.384 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa8933b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa8931480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.385 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa8878e80 con 0x557fa892c360 2023-09-21T13:13:59.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa8815740 con 0x557fa8927610 2023-09-21T13:13:59.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa88153e0 con 0x557fa8927f30 2023-09-21T13:13:59.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f52311b80 10 client.0 _ll_register_callbacks cb 0x557fa875fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:59.386 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f3cf9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa8931480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa8933b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.387 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53134/0 (socket says 172.21.15.142:53134) 2023-09-21T13:13:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.376+0000 7f8f377fe700 1 -- 172.21.15.142:0/3705326991 learned_addr learned my addr 172.21.15.142:0/3705326991 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 -- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 msgr2=0x557fa8933b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa8933b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.388 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 -- 172.21.15.142:0/3705326991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 msgr2=0x557fa8931480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa8931480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 -- 172.21.15.142:0/3705326991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f28009a80 con 0x557fa8927f30 2023-09-21T13:13:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa8931480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:59.389 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa8933b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:59.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c099460 tx=0x7f8f2c098e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb45fc2af248361 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f177fe700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:13:59.390 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c099c50 con 0x557fa8927f30 2023-09-21T13:13:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557fa87e9bb0 con 0x557fa8927f30 2023-09-21T13:13:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.377+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8f2c0994d0 con 0x557fa8927f30 2023-09-21T13:13:59.391 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f2c09d300 con 0x557fa8927f30 2023-09-21T13:13:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 10 client.28381 fetch_fsmap learned FSMap version 59 2023-09-21T13:13:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x557fa868cc60 con 0x557fa8927f30 2023-09-21T13:13:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f2c063080 con 0x557fa8927f30 2023-09-21T13:13:59.392 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f2c0989c0 con 0x557fa8927f30 2023-09-21T13:13:59.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 10 client.28381 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:13:59.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 10 client.28381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:59.393 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 20 client.28381 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa89413f0 0x557fa8943810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 4 client.28381 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:13:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.378+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557fa88f6020 con 0x557fa89413f0 2023-09-21T13:13:59.394 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.379+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa89413f0 0x557fa8943810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.379+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa89413f0 0x557fa8943810 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31cd0d62531ffc5b server_cookie=58536918b6e58d6d in_seq=0 out_seq=0 2023-09-21T13:13:59.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.379+0000 7f8f177fe700 10 client.28381 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:59.395 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f177fe700 1 -- 172.21.15.142:0/3705326991 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557fa88f6020 con 0x557fa89413f0 2023-09-21T13:13:59.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f177fe700 10 client.28381 handle_command_reply: tid=0 2023-09-21T13:13:59.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 client.28381 shutdown 2023-09-21T13:13:59.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 msgr2=0x557fa8930d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.396 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c099460 tx=0x7f8f2c098e80 comp rx=0 tx=0).stop 2023-09-21T13:13:59.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 shutdown_connections 2023-09-21T13:13:59.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa89413f0 0x557fa8943810 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.397 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa892c360 0x557fa8931480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927610 0x557fa8933b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3705326991 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa8930d40 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f177fe700 0 client.28381 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:59.398 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 >> 172.21.15.142:0/3705326991 conn(0x557fa8854000 msgr2=0x557fa8922230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 shutdown_connections 2023-09-21T13:13:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.380+0000 7f8f52311b80 1 -- 172.21.15.142:0/3705326991 wait complete. 2023-09-21T13:13:59.399 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.381+0000 7f8f52311b80 20 client.28381 trim_cache size 0 max 16384 2023-09-21T13:13:59.404 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 Processor -- start 2023-09-21T13:13:59.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 -- start start 2023-09-21T13:13:59.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.405 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa893d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 0x557fa8933660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa86f9920 con 0x557fa8927610 2023-09-21T13:13:59.406 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa892ade0 con 0x557fa892c360 2023-09-21T13:13:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f52311b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa892dd10 con 0x557fa8927f30 2023-09-21T13:13:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa893d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.407 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f3cf9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 0x557fa8933660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57698/0 (socket says 172.21.15.142:57698) 2023-09-21T13:13:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.398+0000 7f8f37fff700 1 -- 172.21.15.142:0/3351898648 learned_addr learned my addr 172.21.15.142:0/3351898648 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.408 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 -- 172.21.15.142:0/3351898648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 msgr2=0x557fa8933660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 0x557fa8933660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 -- 172.21.15.142:0/3351898648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 msgr2=0x557fa892d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.409 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 -- 172.21.15.142:0/3351898648 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557fa86ca250 con 0x557fa8927f30 2023-09-21T13:13:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 0x557fa8933660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:59.410 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa893d700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c098fa0 tx=0x7f8f2c097a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1398f3bfeef20b41 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f1effd700 1 -- 172.21.15.142:0/3351898648 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c065270 con 0x557fa8927f30 2023-09-21T13:13:59.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f1effd700 1 -- 172.21.15.142:0/3351898648 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557fa87e9bb0 con 0x557fa8927f30 2023-09-21T13:13:59.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.399+0000 7f8f1effd700 1 -- 172.21.15.142:0/3351898648 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c09d300 con 0x557fa8927f30 2023-09-21T13:13:59.411 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- 172.21.15.142:0/3351898648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 msgr2=0x557fa893d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa893d700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c098fa0 tx=0x7f8f2c097a80 comp rx=0 tx=0).stop 2023-09-21T13:13:59.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- 172.21.15.142:0/3351898648 shutdown_connections 2023-09-21T13:13:59.412 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa892d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa892c360 0x557fa8933660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3351898648 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa8927f30 0x557fa893d700 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- 172.21.15.142:0/3351898648 >> 172.21.15.142:0/3351898648 conn(0x557fa8854000 msgr2=0x557fa891e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.413 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- 172.21.15.142:0/3351898648 shutdown_connections 2023-09-21T13:13:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- 172.21.15.142:0/3351898648 wait complete. 2023-09-21T13:13:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 -- start start 2023-09-21T13:13:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.400+0000 7f8f52311b80 1 Processor -- start 2023-09-21T13:13:59.414 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927f30 0x557fa8937c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa892c360 0x557fa8994220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.415 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa8938590 con 0x557fa8927610 2023-09-21T13:13:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa8994760 con 0x557fa8927f30 2023-09-21T13:13:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x557fa89948a0 con 0x557fa892c360 2023-09-21T13:13:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f52311b80 10 client.0 _ll_register_callbacks cb 0x557fa875fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:13:59.416 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57710/0 (socket says 172.21.15.142:57710) 2023-09-21T13:13:59.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 -- 172.21.15.142:0/3479611354 learned_addr learned my addr 172.21.15.142:0/3479611354 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927f30 0x557fa8937c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f3cf9c700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa892c360 0x557fa8994220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 -- 172.21.15.142:0/3479611354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa892c360 msgr2=0x557fa8994220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa892c360 0x557fa8994220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 -- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927f30 msgr2=0x557fa8937c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:13:59.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927f30 0x557fa8937c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.401+0000 7f8f37fff700 1 -- 172.21.15.142:0/3479611354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557fa86a3de0 con 0x557fa8927610 2023-09-21T13:13:59.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f37fff700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8f280095e0 tx=0x7f8f28009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d950ca4f2c66e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f177fe700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:13:59.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2802c070 con 0x557fa8927610 2023-09-21T13:13:59.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f8f28019640 con 0x557fa8927610 2023-09-21T13:13:59.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f28019c50 con 0x557fa8927610 2023-09-21T13:13:59.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f2800e5d0 con 0x557fa8927610 2023-09-21T13:13:59.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f52311b80 10 client.18225 fetch_fsmap learned FSMap version 59 2023-09-21T13:13:59.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.402+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x7f8f3810e4d0 con 0x557fa8927610 2023-09-21T13:13:59.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f28019c50 con 0x557fa8927610 2023-09-21T13:13:59.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f8f2800e850 con 0x557fa8927610 2023-09-21T13:13:59.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 10 client.18225 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:13:59.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 10 client.18225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:13:59.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 20 client.18225 populate_metadata read hostname 'smithi142' 2023-09-21T13:13:59.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa8995ff0 0x557fa8998410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 4 client.18225 mds_command: new command op to 24578 tid=0[{"prefix": "scrub status"}] 2023-09-21T13:13:59.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557fa8871e60 con 0x557fa8995ff0 2023-09-21T13:13:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa8995ff0 0x557fa8998410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f177fe700 10 client.18225 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.403+0000 7f8f377fe700 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa8995ff0 0x557fa8998410 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97dddd5bee6a77ea server_cookie=ae5c8938c0fa53df in_seq=0 out_seq=0 2023-09-21T13:13:59.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f177fe700 1 -- 172.21.15.142:0/3479611354 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x557fa8871e60 con 0x557fa8995ff0 2023-09-21T13:13:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f177fe700 10 client.18225 handle_command_reply: tid=0 2023-09-21T13:13:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 client.18225 shutdown 2023-09-21T13:13:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 msgr2=0x557fa8937710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f8f280095e0 tx=0x7f8f28009610 comp rx=0 tx=0).stop 2023-09-21T13:13:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 shutdown_connections 2023-09-21T13:13:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x557fa8995ff0 0x557fa8998410 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x557fa8927610 0x557fa8937710 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x557fa892c360 0x557fa8994220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f177fe700 0 client.18225 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:13:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 --2- 172.21.15.142:0/3479611354 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x557fa8927f30 0x557fa8937c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 >> 172.21.15.142:0/3479611354 conn(0x557fa8854000 msgr2=0x557fa893d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 shutdown_connections 2023-09-21T13:13:59.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.404+0000 7f8f52311b80 1 -- 172.21.15.142:0/3479611354 wait complete. 2023-09-21T13:13:59.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f52311b80 20 client.18225 trim_cache size 0 max 16384 2023-09-21T13:13:59.429 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:13:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "status": "no active scrubs running", 2023-09-21T13:13:59.429 INFO:teuthology.orchestra.run.smithi142.stdout: "scrubs": {} 2023-09-21T13:13:59.430 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:13:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 msgr2=0x7f8f200a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 0x7f8f200a2c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8f300062a0 tx=0x7f8f300094c0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 msgr2=0x7f8f381997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 0x7f8f381997a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00e9c0 tx=0x7f8f2c00ecd0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 shutdown_connections 2023-09-21T13:13:59.432 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f8f200a07b0 0x7f8f200a2c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f8f38100fc0 0x7f8f38199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3819dc00 0x7f8f3819e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.433 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 --2- 172.21.15.142:0/3262498943 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f8f381060e0 0x7f8f381997a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 >> 172.21.15.142:0/3262498943 conn(0x7f8f380fc840 msgr2=0x7f8f380fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 shutdown_connections 2023-09-21T13:13:59.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.405+0000 7f8f3e9ff700 1 -- 172.21.15.142:0/3262498943 wait complete. 2023-09-21T13:13:59.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-21T13:13:59.435 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:13:59.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 -- 172.21.15.142:0/1022115375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec101980 msgr2=0x7f49ec1059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 --2- 172.21.15.142:0/1022115375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec101980 0x7f49ec1059c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009990 tx=0x7f49dc009ca0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 -- 172.21.15.142:0/1022115375 shutdown_connections 2023-09-21T13:13:59.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 --2- 172.21.15.142:0/1022115375 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec1060f0 0x7f49ec10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 --2- 172.21.15.142:0/1022115375 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 0x7f49ec1013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.636 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 --2- 172.21.15.142:0/1022115375 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec101980 0x7f49ec1059c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 -- 172.21.15.142:0/1022115375 >> 172.21.15.142:0/1022115375 conn(0x7f49ec0fc890 msgr2=0x7f49ec0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 -- 172.21.15.142:0/1022115375 shutdown_connections 2023-09-21T13:13:59.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.642+0000 7f49f37ff700 1 -- 172.21.15.142:0/1022115375 wait complete. 2023-09-21T13:13:59.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.644+0000 7f49f37ff700 1 Processor -- start 2023-09-21T13:13:59.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.644+0000 7f49f37ff700 1 -- start start 2023-09-21T13:13:59.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.644+0000 7f49f37ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 0x7f49ec196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f37ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 0x7f49ec1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f37ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f37ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19c2b0 con 0x7f49ec1060f0 2023-09-21T13:13:59.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f37ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19c420 con 0x7f49ec100fd0 2023-09-21T13:13:59.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f37ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ec19c5e0 con 0x7f49ec19b830 2023-09-21T13:13:59.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f0d9a700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 0x7f49ec1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53182/0 (socket says 172.21.15.142:53182) 2023-09-21T13:13:59.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 -- 172.21.15.142:0/3155395653 learned_addr learned my addr 172.21.15.142:0/3155395653 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:13:59.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f159b700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 0x7f49ec196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 -- 172.21.15.142:0/3155395653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 msgr2=0x7f49ec196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 0x7f49ec196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 -- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 msgr2=0x7f49ec1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 0x7f49ec1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f1d9c700 1 -- 172.21.15.142:0/3155395653 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0095f0 con 0x7f49ec19b830 2023-09-21T13:13:59.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.645+0000 7f49f0d9a700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 0x7f49ec1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:13:59.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49f1d9c700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49e4007ee0 tx=0x7f49e400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4017070 con 0x7f49ec19b830 2023-09-21T13:13:59.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49e400f040 con 0x7f49ec19b830 2023-09-21T13:13:59.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ec1a3b40 con 0x7f49ec19b830 2023-09-21T13:13:59.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e4005580 con 0x7f49ec19b830 2023-09-21T13:13:59.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.646+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ec1a4070 con 0x7f49ec19b830 2023-09-21T13:13:59.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.647+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ec067bd0 con 0x7f49ec19b830 2023-09-21T13:13:59.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.649+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f49e400db20 con 0x7f49ec19b830 2023-09-21T13:13:59.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.651+0000 7f49e27fc700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 0x7f49d80a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:13:59.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.651+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f49e40cbc60 con 0x7f49ec19b830 2023-09-21T13:13:59.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.651+0000 7f49f159b700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 0x7f49d80a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:13:59.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.652+0000 7f49f159b700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 0x7f49d80a2d30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009c60 tx=0x7f49e8009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:13:59.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.653+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f49e40953f0 con 0x7f49ec19b830 2023-09-21T13:13:59.892 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.900+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49ec101bd0 con 0x7f49ec19b830 2023-09-21T13:13:59.893 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.901+0000 7f49e27fc700 1 -- 172.21.15.142:0/3155395653 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+11342 (secure 0 0 0) 0x7f49ec101bd0 con 0x7f49ec19b830 2023-09-21T13:13:59.893 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:13:59.894 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":59,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:13:58.329655+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_28258":{"gid":28258,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/3000866200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":3000866200},{"type":"v1","addr":"172.21.15.160:6839","nonce":3000866200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:13:59.895 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 msgr2=0x7f49d80a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 0x7f49d80a2d30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009c60 tx=0x7f49e8009260 comp rx=0 tx=0).stop 2023-09-21T13:13:59.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 msgr2=0x7f49ec19bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:13:59.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f49e4007ee0 tx=0x7f49e400d3b0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 shutdown_connections 2023-09-21T13:13:59.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f49d80a0870 0x7f49d80a2d30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49ec19b830 0x7f49ec19bcb0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f49ec100fd0 0x7f49ec196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 --2- 172.21.15.142:0/3155395653 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f49ec1060f0 0x7f49ec1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:13:59.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 >> 172.21.15.142:0/3155395653 conn(0x7f49ec0fc890 msgr2=0x7f49ec0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:13:59.898 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 shutdown_connections 2023-09-21T13:13:59.899 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:13:59.903+0000 7f49f37ff700 1 -- 172.21.15.142:0/3155395653 wait complete. 2023-09-21T13:13:59.899 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 59 2023-09-21T13:13:59.915 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-21T13:14:00.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 -- 172.21.15.142:0/2758630990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 msgr2=0x7f6b60101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.115 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 --2- 172.21.15.142:0/2758630990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60101380 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009990 tx=0x7f6b5c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 -- 172.21.15.142:0/2758630990 shutdown_connections 2023-09-21T13:14:00.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 --2- 172.21.15.142:0/2758630990 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60101380 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.116 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 --2- 172.21.15.142:0/2758630990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 0x7f6b6010dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 --2- 172.21.15.142:0/2758630990 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b60101950 0x7f6b60105990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 -- 172.21.15.142:0/2758630990 >> 172.21.15.142:0/2758630990 conn(0x7f6b600fc860 msgr2=0x7f6b600fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.122+0000 7f6b685ff700 1 -- 172.21.15.142:0/2758630990 shutdown_connections 2023-09-21T13:14:00.117 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.123+0000 7f6b685ff700 1 -- 172.21.15.142:0/2758630990 wait complete. 2023-09-21T13:14:00.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.123+0000 7f6b685ff700 1 Processor -- start 2023-09-21T13:14:00.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 -- start start 2023-09-21T13:14:00.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 0x7f6b60197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 0x7f6b6019bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019c320 con 0x7f6b60100fa0 2023-09-21T13:14:00.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019c490 con 0x7f6b6019b8a0 2023-09-21T13:14:00.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b685ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6019c650 con 0x7f6b601060c0 2023-09-21T13:14:00.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57752/0 (socket says 172.21.15.142:57752) 2023-09-21T13:14:00.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b6639b700 1 -- 172.21.15.142:0/1561040726 learned_addr learned my addr 172.21.15.142:0/1561040726 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 0x7f6b60197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.124+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 0x7f6b6019bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 -- 172.21.15.142:0/1561040726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 msgr2=0x7f6b60197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.124 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 0x7f6b60197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 -- 172.21.15.142:0/1561040726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 msgr2=0x7f6b6019bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 0x7f6b6019bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 -- 172.21.15.142:0/1561040726 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c0095f0 con 0x7f6b60100fa0 2023-09-21T13:14:00.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 0x7f6b6019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:14:00.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c005910 tx=0x7f6b5c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b577fe700 1 -- 172.21.15.142:0/1561040726 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c01d070 con 0x7f6b60100fa0 2023-09-21T13:14:00.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b601a3b50 con 0x7f6b60100fa0 2023-09-21T13:14:00.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b577fe700 1 -- 172.21.15.142:0/1561040726 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b5c022470 con 0x7f6b60100fa0 2023-09-21T13:14:00.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b577fe700 1 -- 172.21.15.142:0/1561040726 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c017650 con 0x7f6b60100fa0 2023-09-21T13:14:00.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.125+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b601a3fd0 con 0x7f6b60100fa0 2023-09-21T13:14:00.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.129+0000 7f6b577fe700 1 -- 172.21.15.142:0/1561040726 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f6b5c0225e0 con 0x7f6b60100fa0 2023-09-21T13:14:00.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 Processor -- start 2023-09-21T13:14:00.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 -- start start 2023-09-21T13:14:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b577fe700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 0x7f6b4c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660c340 0x55dc26610230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.135 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc26610bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc2657bca0 con 0x55dc26610770 2023-09-21T13:14:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc2655fc70 con 0x55dc2660c340 2023-09-21T13:14:00.136 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc2655d590 con 0x55dc2660ba20 2023-09-21T13:14:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b577fe700 1 -- 172.21.15.142:0/1561040726 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6b5c0cd250 con 0x7f6b60100fa0 2023-09-21T13:14:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 0x7f6b4c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.137 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.131+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53214/0 (socket says 172.21.15.142:53214) 2023-09-21T13:14:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 -- 172.21.15.142:0/1504688867 learned_addr learned my addr 172.21.15.142:0/1504688867 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.138 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc26610bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660c340 0x55dc26610230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 -- 172.21.15.142:0/1504688867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660c340 msgr2=0x55dc26610230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.139 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660c340 0x55dc26610230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 -- 172.21.15.142:0/1504688867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 msgr2=0x55dc26610bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc26610bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.140 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 -- 172.21.15.142:0/1504688867 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc26383de0 con 0x55dc2660ba20 2023-09-21T13:14:00.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 0x7f6b4c0a2c70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b58015e20 tx=0x7f6b58015420 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0a21e0 tx=0x7f6b5c09a630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5330767fd8d231e server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.132+0000 7f6b54bfe700 1 -- 172.21.15.142:0/1504688867 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c09ae30 con 0x55dc2660ba20 2023-09-21T13:14:00.141 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b54bfe700 1 -- 172.21.15.142:0/1504688867 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b5c09a730 con 0x55dc2660ba20 2023-09-21T13:14:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b54bfe700 1 -- 172.21.15.142:0/1504688867 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c098ba0 con 0x55dc2660ba20 2023-09-21T13:14:00.142 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1504688867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 msgr2=0x55dc2660be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0a21e0 tx=0x7f6b5c09a630 comp rx=0 tx=0).stop 2023-09-21T13:14:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1504688867 shutdown_connections 2023-09-21T13:14:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc26610bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.143 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660ba20 0x55dc2660be00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1504688867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660c340 0x55dc26610230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1504688867 >> 172.21.15.142:0/1504688867 conn(0x55dc26534000 msgr2=0x55dc266026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.144 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1504688867 shutdown_connections 2023-09-21T13:14:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.133+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1504688867 wait complete. 2023-09-21T13:14:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.134+0000 7f6b7bec6b80 1 -- start start 2023-09-21T13:14:00.145 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.134+0000 7f6b7bec6b80 1 Processor -- start 2023-09-21T13:14:00.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.146 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc266150a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc26615660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc26558e80 con 0x55dc2660ba20 2023-09-21T13:14:00.147 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc264f5740 con 0x55dc26610770 2023-09-21T13:14:00.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc264f53e0 con 0x55dc2660c340 2023-09-21T13:14:00.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b7bec6b80 10 client.0 _ll_register_callbacks cb 0x55dc2643fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.148 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57764/0 (socket says 172.21.15.142:57764) 2023-09-21T13:14:00.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 -- 172.21.15.142:0/1329684442 learned_addr learned my addr 172.21.15.142:0/1329684442 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc26615660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.149 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc266150a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 -- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 msgr2=0x55dc266150a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc266150a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.150 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 -- 172.21.15.142:0/1329684442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 msgr2=0x55dc26615660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc26615660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.135+0000 7f6b6639b700 1 -- 172.21.15.142:0/1329684442 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b601a3fd0 con 0x55dc2660ba20 2023-09-21T13:14:00.151 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c005f50 tx=0x7f6b5c096ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa82ad8e4899e9ca server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:14:00.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c09ae30 con 0x55dc2660ba20 2023-09-21T13:14:00.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc264c9bb0 con 0x55dc2660ba20 2023-09-21T13:14:00.152 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6b5c09e560 con 0x55dc2660ba20 2023-09-21T13:14:00.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5c09e170 con 0x55dc2660ba20 2023-09-21T13:14:00.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b7bec6b80 10 client.18243 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.153 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55dc2636cc60 con 0x55dc2660ba20 2023-09-21T13:14:00.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b5c07d080 con 0x55dc2660ba20 2023-09-21T13:14:00.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.136+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6b5c09a990 con 0x55dc2660ba20 2023-09-21T13:14:00.154 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 10 client.18243 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 10 client.18243 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:14:00.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 20 client.18243 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.155 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc26625080 0x55dc266274a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 4 client.18243 mds_command: new command op to 24514 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:14:00.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc265d6020 con 0x55dc26625080 2023-09-21T13:14:00.156 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.137+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc26625080 0x55dc266274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.138+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc26625080 0x55dc266274a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d1178da57e4e094e server_cookie=d8e5b92e402dc1ea in_seq=0 out_seq=0 2023-09-21T13:14:00.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.138+0000 7f6b49ffb700 10 client.18243 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:14:00.157 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.138+0000 7f6b49ffb700 1 -- 172.21.15.142:0/1329684442 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc265d6020 con 0x55dc26625080 2023-09-21T13:14:00.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.138+0000 7f6b49ffb700 10 client.18243 handle_command_reply: tid=0 2023-09-21T13:14:00.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.138+0000 7f6b7bec6b80 1 client.18243 shutdown 2023-09-21T13:14:00.158 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 msgr2=0x55dc26617e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c005f50 tx=0x7f6b5c096ae0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 shutdown_connections 2023-09-21T13:14:00.159 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc26625080 0x55dc266274a0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc26617e90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc26615660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.160 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b49ffb700 0 client.18243 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:14:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1329684442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc266150a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 >> 172.21.15.142:0/1329684442 conn(0x55dc26534000 msgr2=0x55dc26602290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 shutdown_connections 2023-09-21T13:14:00.161 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1329684442 wait complete. 2023-09-21T13:14:00.162 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.139+0000 7f6b7bec6b80 20 client.18243 trim_cache size 0 max 16384 2023-09-21T13:14:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:59 smithi156 ceph-mon[134078]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:14:00.163 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:13:59 smithi156 ceph-mon[134078]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.152+0000 7f6b7bec6b80 1 Processor -- start 2023-09-21T13:14:00.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.152+0000 7f6b7bec6b80 1 -- start start 2023-09-21T13:14:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660ba20 0x55dc2661c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26611b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc263d9920 con 0x55dc26610770 2023-09-21T13:14:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc2660ca80 con 0x55dc2660ba20 2023-09-21T13:14:00.170 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc2660be30 con 0x55dc2660c340 2023-09-21T13:14:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57772/0 (socket says 172.21.15.142:57772) 2023-09-21T13:14:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 -- 172.21.15.142:0/1463512342 learned_addr learned my addr 172.21.15.142:0/1463512342 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.171 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26611b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b6639b700 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660ba20 0x55dc2661c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 -- 172.21.15.142:0/1463512342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 msgr2=0x55dc26611b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.172 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26611b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 -- 172.21.15.142:0/1463512342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660ba20 msgr2=0x55dc2661c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660ba20 0x55dc2661c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.173 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.153+0000 7f6b66b9c700 1 -- 172.21.15.142:0/1463512342 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc2662c0d0 con 0x55dc26610770 2023-09-21T13:14:00.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b66b9c700 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b580093a0 tx=0x7f6b5801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc34f54d00d81d80 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b553ff700 1 -- 172.21.15.142:0/1463512342 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5800e040 con 0x55dc26610770 2023-09-21T13:14:00.174 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b553ff700 1 -- 172.21.15.142:0/1463512342 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b58015770 con 0x55dc26610770 2023-09-21T13:14:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b553ff700 1 -- 172.21.15.142:0/1463512342 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b58026b40 con 0x55dc26610770 2023-09-21T13:14:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1463512342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 msgr2=0x55dc266179c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f6b580093a0 tx=0x7f6b5801c000 comp rx=0 tx=0).stop 2023-09-21T13:14:00.175 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.154+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1463512342 shutdown_connections 2023-09-21T13:14:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc26610770 0x55dc266179c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc2660ba20 0x55dc2661c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.176 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/1463512342 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26611b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1463512342 >> 172.21.15.142:0/1463512342 conn(0x55dc26534000 msgr2=0x55dc2660e780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1463512342 shutdown_connections 2023-09-21T13:14:00.177 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/1463512342 wait complete. 2023-09-21T13:14:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 -- start start 2023-09-21T13:14:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.155+0000 7f6b7bec6b80 1 Processor -- start 2023-09-21T13:14:00.178 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26618aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc266191e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc266198e0 con 0x55dc2660ba20 2023-09-21T13:14:00.179 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc26678eb0 con 0x55dc26610770 2023-09-21T13:14:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc26678ff0 con 0x55dc2660c340 2023-09-21T13:14:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b7bec6b80 10 client.0 _ll_register_callbacks cb 0x55dc2643fa80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.180 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b65b9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26618aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b66b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc266191e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.181 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57774/0 (socket says 172.21.15.142:57774) 2023-09-21T13:14:00.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 -- 172.21.15.142:0/385872168 learned_addr learned my addr 172.21.15.142:0/385872168 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 -- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 msgr2=0x55dc26618aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.182 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26618aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 -- 172.21.15.142:0/385872168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 msgr2=0x55dc266191e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc266191e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 -- 172.21.15.142:0/385872168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b58009110 con 0x55dc2660ba20 2023-09-21T13:14:00.183 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b6639b700 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c09a430 tx=0x7f6b5c09a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b956edcb10a9bf server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.156+0000 7f6b49ffb700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:14:00.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c09e380 con 0x55dc2660ba20 2023-09-21T13:14:00.184 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6b5c0853d0 con 0x55dc2660ba20 2023-09-21T13:14:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc26551e60 con 0x55dc2660ba20 2023-09-21T13:14:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b5c099ee0 con 0x55dc2660ba20 2023-09-21T13:14:00.185 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 10 client.18249 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55dc263aa250 con 0x55dc2660ba20 2023-09-21T13:14:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc26551e60 con 0x55dc2660ba20 2023-09-21T13:14:00.186 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6b5c0cabc0 con 0x55dc2660ba20 2023-09-21T13:14:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 10 client.18249 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 10 client.18249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2023-09-21T13:14:00.187 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 20 client.18249 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc2667a1f0 0x55dc2667c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 4 client.18249 mds_command: new command op to 24514 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:14:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.157+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 --> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dc26551b80 con 0x55dc2667a1f0 2023-09-21T13:14:00.188 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc2667a1f0 0x55dc2667c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b49ffb700 10 client.18249 ms_handle_connect on v2:172.21.15.160:6836/1554558585 2023-09-21T13:14:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b65b9a700 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc2667a1f0 0x55dc2667c5e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a0cf43728b86183 server_cookie=8adc9ede0913e027 in_seq=0 out_seq=0 2023-09-21T13:14:00.189 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b49ffb700 1 -- 172.21.15.142:0/385872168 <== mds.2 v2:172.21.15.160:6836/1554558585 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dc26551b80 con 0x55dc2667a1f0 2023-09-21T13:14:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b49ffb700 10 client.18249 handle_command_reply: tid=0 2023-09-21T13:14:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.158+0000 7f6b7bec6b80 1 client.18249 shutdown 2023-09-21T13:14:00.190 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 msgr2=0x55dc2661c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c09a430 tx=0x7f6b5c09a630 comp rx=0 tx=0).stop 2023-09-21T13:14:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 shutdown_connections 2023-09-21T13:14:00.191 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:6836/1554558585,v1:172.21.15.160:6837/1554558585] conn(0x55dc2667a1f0 0x55dc2667c5e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55dc2660ba20 0x55dc2661c610 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55dc26610770 0x55dc266191e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b49ffb700 0 client.18249 ms_handle_reset on v2:172.21.15.160:6836/1554558585 2023-09-21T13:14:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 --2- 172.21.15.142:0/385872168 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55dc2660c340 0x55dc26618aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 >> 172.21.15.142:0/385872168 conn(0x55dc26534000 msgr2=0x55dc26612b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 shutdown_connections 2023-09-21T13:14:00.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 1 -- 172.21.15.142:0/385872168 wait complete. 2023-09-21T13:14:00.194 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b7bec6b80 20 client.18249 trim_cache size 0 max 16384 2023-09-21T13:14:00.194 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:14:00.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 msgr2=0x7f6b4c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 0x7f6b4c0a2c70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b58015e20 tx=0x7f6b58015420 comp rx=0 tx=0).stop 2023-09-21T13:14:00.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 msgr2=0x7f6b60196f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.159+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c005910 tx=0x7f6b5c004730 comp rx=0 tx=0).stop 2023-09-21T13:14:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 shutdown_connections 2023-09-21T13:14:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6b4c0a07b0 0x7f6b4c0a2c70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6b60100fa0 0x7f6b60196f00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6b6019b8a0 0x7f6b6019bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 --2- 172.21.15.142:0/1561040726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b601060c0 0x7f6b60197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 >> 172.21.15.142:0/1561040726 conn(0x7f6b600fc860 msgr2=0x7f6b600fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 shutdown_connections 2023-09-21T13:14:00.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.160+0000 7f6b685ff700 1 -- 172.21.15.142:0/1561040726 wait complete. 2023-09-21T13:14:00.199 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:59 smithi142 ceph-mon[97663]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:14:00.200 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:13:59 smithi142 ceph-mon[97663]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:00.201 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-21T13:14:00.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:59 smithi160 ceph-mon[134450]: fsmap cephfs:3 {0=b=up:active,1=a=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2023-09-21T13:14:00.202 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:13:59 smithi160 ceph-mon[134450]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:00.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 -- 172.21.15.142:0/3400630482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d680 msgr2=0x7f4e6010fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 --2- 172.21.15.142:0/3400630482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d680 0x7f4e6010fa70 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800b0a0 tx=0x7f4e5800b3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 -- 172.21.15.142:0/3400630482 shutdown_connections 2023-09-21T13:14:00.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 --2- 172.21.15.142:0/3400630482 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e6010d680 0x7f4e6010fa70 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 --2- 172.21.15.142:0/3400630482 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e600ffad0 0x7f4e600ffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 --2- 172.21.15.142:0/3400630482 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e60100480 0x7f4e6010d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 -- 172.21.15.142:0/3400630482 >> 172.21.15.142:0/3400630482 conn(0x7f4e600fb730 msgr2=0x7f4e600fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.426+0000 7f4e651ff700 1 -- 172.21.15.142:0/3400630482 shutdown_connections 2023-09-21T13:14:00.421 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.427+0000 7f4e651ff700 1 -- 172.21.15.142:0/3400630482 wait complete. 2023-09-21T13:14:00.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.427+0000 7f4e651ff700 1 Processor -- start 2023-09-21T13:14:00.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 -- start start 2023-09-21T13:14:00.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60100480 0x7f4e60199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e6010d680 0x7f4e6019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e1a0 con 0x7f4e6010d680 2023-09-21T13:14:00.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e310 con 0x7f4e60100480 2023-09-21T13:14:00.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e651ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6019e4d0 con 0x7f4e600ffad0 2023-09-21T13:14:00.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53266/0 (socket says 172.21.15.142:53266) 2023-09-21T13:14:00.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e5f59e700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e6010d680 0x7f4e6019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/58156175 learned_addr learned my addr 172.21.15.142:0/58156175 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.428+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60100480 0x7f4e60199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/58156175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60100480 msgr2=0x7f4e60199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60100480 0x7f4e60199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e6010d680 msgr2=0x7f4e6019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e6010d680 0x7f4e6019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/58156175 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e58009d00 con 0x7f4e600ffad0 2023-09-21T13:14:00.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e9a0 tx=0x7f4e5000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.429+0000 7f4e47fff700 1 -- 172.21.15.142:0/58156175 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50009790 con 0x7f4e600ffad0 2023-09-21T13:14:00.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.430+0000 7f4e47fff700 1 -- 172.21.15.142:0/58156175 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e50010430 con 0x7f4e600ffad0 2023-09-21T13:14:00.429 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.430+0000 7f4e47fff700 1 -- 172.21.15.142:0/58156175 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50018680 con 0x7f4e600ffad0 2023-09-21T13:14:00.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.430+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6019e7b0 con 0x7f4e600ffad0 2023-09-21T13:14:00.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.430+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601a5ff0 con 0x7f4e600ffad0 2023-09-21T13:14:00.434 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.434+0000 7f4e47fff700 1 -- 172.21.15.142:0/58156175 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f4e500105a0 con 0x7f4e600ffad0 2023-09-21T13:14:00.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.435+0000 7f4e47fff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 0x7f4e480a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.435+0000 7f4e78c1ab80 1 Processor -- start 2023-09-21T13:14:00.435 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.435+0000 7f4e47fff700 1 -- 172.21.15.142:0/58156175 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4e50014070 con 0x7f4e600ffad0 2023-09-21T13:14:00.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.435+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 0x7f4e480a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.435+0000 7f4e78c1ab80 1 -- start start 2023-09-21T13:14:00.436 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 0x7f4e480a2cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e6019a7d0 tx=0x7f4e54009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 0x562f60b98630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b98b70 0x562f60b98fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.437 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60affca0 con 0x562f60b98b70 2023-09-21T13:14:00.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60ae3c70 con 0x562f60b94740 2023-09-21T13:14:00.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60ae1590 con 0x562f60b93e20 2023-09-21T13:14:00.438 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.436+0000 7f4e5e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 0x562f60b98630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53282/0 (socket says 172.21.15.142:53282) 2023-09-21T13:14:00.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5e59c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 0x562f60b98630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:50968/0 (socket says 172.21.15.142:50968) 2023-09-21T13:14:00.439 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/407684251 learned_addr learned my addr 172.21.15.142:0/407684251 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b98b70 0x562f60b98fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/407684251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 msgr2=0x562f60b98630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 0x562f60b98630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/407684251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b98b70 msgr2=0x562f60b98fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b98b70 0x562f60b98fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/407684251 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f60907de0 con 0x562f60b93e20 2023-09-21T13:14:00.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e50096010 tx=0x7f4e50098fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c87f88e537f239c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e457fa700 1 -- 172.21.15.142:0/407684251 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500995a0 con 0x562f60b93e20 2023-09-21T13:14:00.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e457fa700 1 -- 172.21.15.142:0/407684251 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e5009d3d0 con 0x562f60b93e20 2023-09-21T13:14:00.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.437+0000 7f4e457fa700 1 -- 172.21.15.142:0/407684251 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50099800 con 0x562f60b93e20 2023-09-21T13:14:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/407684251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 msgr2=0x562f60b94200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4e50096010 tx=0x7f4e50098fd0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/407684251 shutdown_connections 2023-09-21T13:14:00.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b98b70 0x562f60b98fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b93e20 0x562f60b94200 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.444 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/407684251 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b94740 0x562f60b98630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.438+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/407684251 >> 172.21.15.142:0/407684251 conn(0x562f60ab8000 msgr2=0x562f60b866a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.439+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/407684251 shutdown_connections 2023-09-21T13:14:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.439+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/407684251 wait complete. 2023-09-21T13:14:00.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.439+0000 7f4e78c1ab80 1 -- start start 2023-09-21T13:14:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.439+0000 7f4e78c1ab80 1 Processor -- start 2023-09-21T13:14:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b93e20 0x562f60b9d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 0x562f60b9db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60adce80 con 0x562f60b94740 2023-09-21T13:14:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60a79740 con 0x562f60b93e20 2023-09-21T13:14:00.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60a793e0 con 0x562f60b98b70 2023-09-21T13:14:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e78c1ab80 10 client.0 _ll_register_callbacks cb 0x562f609c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e5f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e5f59e700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53294/0 (socket says 172.21.15.142:53294) 2023-09-21T13:14:00.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.440+0000 7f4e5f59e700 1 -- 172.21.15.142:0/2833572794 learned_addr learned my addr 172.21.15.142:0/2833572794 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b93e20 0x562f60b9d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 0x562f60b9db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 -- 172.21.15.142:0/2833572794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b93e20 msgr2=0x562f60b9d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b93e20 0x562f60b9d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 -- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 msgr2=0x562f60b9db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 0x562f60b9db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 -- 172.21.15.142:0/2833572794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e601a5ff0 con 0x562f60b98b70 2023-09-21T13:14:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 0x562f60b9db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-21T13:14:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e6006a510 tx=0x7f4e58004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a75e25af8e826c19 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:14:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800e040 con 0x562f60b98b70 2023-09-21T13:14:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f60a4dbb0 con 0x562f60b98b70 2023-09-21T13:14:00.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.441+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4e580076e0 con 0x562f60b98b70 2023-09-21T13:14:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e580078a0 con 0x562f60b98b70 2023-09-21T13:14:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 10 client.28423 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x562f608f0c60 con 0x562f60b98b70 2023-09-21T13:14:00.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562f60a4dbb0 con 0x562f60b98b70 2023-09-21T13:14:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4e58025030 con 0x562f60b98b70 2023-09-21T13:14:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 10 client.28423 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 10 client.28423 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:14:00.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 20 client.28423 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60badcd0 0x562f60bb00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 4 client.28423 mds_command: new command op to 24559 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:14:00.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.442+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f60b5a020 con 0x562f60badcd0 2023-09-21T13:14:00.456 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.443+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60badcd0 0x562f60bb00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.461 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.443+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60badcd0 0x562f60bb00f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ae09b089c42623f4 server_cookie=356a4cba55fe5780 in_seq=0 out_seq=0 2023-09-21T13:14:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.443+0000 7f4e42ff5700 10 client.28423 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:14:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.444+0000 7f4e42ff5700 1 -- 172.21.15.142:0/2833572794 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f60b5a020 con 0x562f60badcd0 2023-09-21T13:14:00.462 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.444+0000 7f4e42ff5700 10 client.28423 handle_command_reply: tid=0 2023-09-21T13:14:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.444+0000 7f4e78c1ab80 1 client.28423 shutdown 2023-09-21T13:14:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.444+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 msgr2=0x562f60b9e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.463 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.444+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4e6006a510 tx=0x7f4e58004ac0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 shutdown_connections 2023-09-21T13:14:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60badcd0 0x562f60bb00f0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b98b70 0x562f60b9e0b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.464 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e42ff5700 0 client.28423 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:14:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b93e20 0x562f60b9d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/2833572794 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b94740 0x562f60b9db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 >> 172.21.15.142:0/2833572794 conn(0x562f60ab8000 msgr2=0x562f60b86230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.465 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 shutdown_connections 2023-09-21T13:14:00.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/2833572794 wait complete. 2023-09-21T13:14:00.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.445+0000 7f4e78c1ab80 20 client.28423 trim_cache size 0 max 16384 2023-09-21T13:14:00.466 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 Processor -- start 2023-09-21T13:14:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 -- start start 2023-09-21T13:14:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60ba4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.467 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60b96ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f6095d920 con 0x562f60b93e20 2023-09-21T13:14:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60ba0230 con 0x562f60b98b70 2023-09-21T13:14:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.461+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60b80c20 con 0x562f60b94740 2023-09-21T13:14:00.468 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60ba4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.469 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5e59c700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60ba4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53296/0 (socket says 172.21.15.142:53296) 2023-09-21T13:14:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5e59c700 1 -- 172.21.15.142:0/3091986868 learned_addr learned my addr 172.21.15.142:0/3091986868 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57834/0 (socket says 172.21.15.142:57834) 2023-09-21T13:14:00.470 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60b96ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/3091986868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 msgr2=0x562f60ba4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60ba4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.471 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/3091986868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 msgr2=0x562f60b96ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60b96ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/3091986868 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f6092e250 con 0x562f60b93e20 2023-09-21T13:14:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.462+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60b96ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:00.472 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.463+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4e50099530 tx=0x7f4e50010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b56de161ac2762c server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.463+0000 7f4e45ffb700 1 -- 172.21.15.142:0/3091986868 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5009d1e0 con 0x562f60b93e20 2023-09-21T13:14:00.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.463+0000 7f4e45ffb700 1 -- 172.21.15.142:0/3091986868 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e50010880 con 0x562f60b93e20 2023-09-21T13:14:00.473 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.463+0000 7f4e45ffb700 1 -- 172.21.15.142:0/3091986868 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50098cf0 con 0x562f60b93e20 2023-09-21T13:14:00.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/3091986868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 msgr2=0x562f60b96460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4e50099530 tx=0x7f4e50010c80 comp rx=0 tx=0).stop 2023-09-21T13:14:00.474 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/3091986868 shutdown_connections 2023-09-21T13:14:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60b96460 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60b96ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/3091986868 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60ba4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.475 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/3091986868 >> 172.21.15.142:0/3091986868 conn(0x562f60ab8000 msgr2=0x562f60baa000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/3091986868 shutdown_connections 2023-09-21T13:14:00.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/3091986868 wait complete. 2023-09-21T13:14:00.476 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 -- start start 2023-09-21T13:14:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.464+0000 7f4e78c1ab80 1 Processor -- start 2023-09-21T13:14:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60bfa420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.477 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60bf5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60bf6170 con 0x562f60b93e20 2023-09-21T13:14:00.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60bf62e0 con 0x562f60b98b70 2023-09-21T13:14:00.478 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f60bf64a0 con 0x562f60b94740 2023-09-21T13:14:00.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e78c1ab80 10 client.0 _ll_register_callbacks cb 0x562f609c3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e5ed9d700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57840/0 (socket says 172.21.15.142:57840) 2023-09-21T13:14:00.479 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/132925921 learned_addr learned my addr 172.21.15.142:0/132925921 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.465+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60bfa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60bf5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.480 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/132925921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 msgr2=0x562f60bfa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60bfa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/132925921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 msgr2=0x562f60bf5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60bf5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.481 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 -- 172.21.15.142:0/132925921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f608f0c60 con 0x562f60b93e20 2023-09-21T13:14:00.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5f59e700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60bf5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:14:00.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60bfa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:00.482 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e5ed9d700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c2d0 tx=0x7f4e5000c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a888b36b2b5657fe server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.142:3300/0 2023-09-21T13:14:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500109f0 con 0x562f60b93e20 2023-09-21T13:14:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mon.0 v2:172.21.15.142:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f4e50099800 con 0x562f60b93e20 2023-09-21T13:14:00.483 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.466+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e5009d3d0 con 0x562f60b93e20 2023-09-21T13:14:00.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e500999c0 con 0x562f60b93e20 2023-09-21T13:14:00.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 10 client.18264 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.484 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x562f60907de0 con 0x562f60b93e20 2023-09-21T13:14:00.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mon.0 v2:172.21.15.142:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e5009d3d0 con 0x562f60b93e20 2023-09-21T13:14:00.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mon.0 v2:172.21.15.142:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4e500b1ba0 con 0x562f60b93e20 2023-09-21T13:14:00.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 10 client.18264 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.485 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 10 client.18264 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.a 2023-09-21T13:14:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 20 client.18264 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60c02800 0x562f60c04bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.486 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 4 client.18264 mds_command: new command op to 24559 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:14:00.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.467+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 --> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f60ad5e60 con 0x562f60c02800 2023-09-21T13:14:00.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60c02800 0x562f60c04bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.487 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e42ff5700 10 client.18264 ms_handle_connect on v2:172.21.15.142:6840/3027031872 2023-09-21T13:14:00.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e5e59c700 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60c02800 0x562f60c04bf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=227ec688d841392 server_cookie=50de49711fd9f7c in_seq=0 out_seq=0 2023-09-21T13:14:00.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e42ff5700 1 -- 172.21.15.142:0/132925921 <== mds.1 v2:172.21.15.142:6840/3027031872 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f60ad5e60 con 0x562f60c02800 2023-09-21T13:14:00.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e42ff5700 10 client.18264 handle_command_reply: tid=0 2023-09-21T13:14:00.488 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.468+0000 7f4e78c1ab80 1 client.18264 shutdown 2023-09-21T13:14:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 msgr2=0x562f60bf9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c2d0 tx=0x7f4e5000c400 comp rx=0 tx=0).stop 2023-09-21T13:14:00.489 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 shutdown_connections 2023-09-21T13:14:00.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x562f60b93e20 0x562f60bf9ee0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.142:6840/3027031872,v1:172.21.15.142:6841/3027031872] conn(0x562f60c02800 0x562f60c04bf0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.490 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x562f60b98b70 0x562f60bf5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 --2- 172.21.15.142:0/132925921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562f60b94740 0x562f60bfa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e42ff5700 0 client.18264 ms_handle_reset on v2:172.21.15.142:6840/3027031872 2023-09-21T13:14:00.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 >> 172.21.15.142:0/132925921 conn(0x562f60ab8000 msgr2=0x562f60b96ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.491 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 shutdown_connections 2023-09-21T13:14:00.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 1 -- 172.21.15.142:0/132925921 wait complete. 2023-09-21T13:14:00.492 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.469+0000 7f4e78c1ab80 20 client.18264 trim_cache size 0 max 16384 2023-09-21T13:14:00.493 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:14:00.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 msgr2=0x7f4e480a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.494 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 0x7f4e480a2cf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4e6019a7d0 tx=0x7f4e54009260 comp rx=0 tx=0).stop 2023-09-21T13:14:00.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 msgr2=0x7f4e601991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000e9a0 tx=0x7f4e5000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.495 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 shutdown_connections 2023-09-21T13:14:00.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f4e480a0830 0x7f4e480a2cf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4e6010d680 0x7f4e6019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e600ffad0 0x7f4e601991c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.496 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 --2- 172.21.15.142:0/58156175 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4e60100480 0x7f4e60199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 >> 172.21.15.142:0/58156175 conn(0x7f4e600fb730 msgr2=0x7f4e6010ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 shutdown_connections 2023-09-21T13:14:00.497 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.470+0000 7f4e651ff700 1 -- 172.21.15.142:0/58156175 wait complete. 2023-09-21T13:14:00.498 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-21T13:14:00.701 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 -- 172.21.15.142:0/352376136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38481060e0 msgr2=0x7f384810dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 --2- 172.21.15.142:0/352376136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38481060e0 0x7f384810dc60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f384000b0a0 tx=0x7f384000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 -- 172.21.15.142:0/352376136 shutdown_connections 2023-09-21T13:14:00.702 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 --2- 172.21.15.142:0/352376136 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f38481060e0 0x7f384810dc60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 --2- 172.21.15.142:0/352376136 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f3848100fc0 0x7f38481013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 --2- 172.21.15.142:0/352376136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3848101970 0x7f38481059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.703 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 -- 172.21.15.142:0/352376136 >> 172.21.15.142:0/352376136 conn(0x7f38480fc840 msgr2=0x7f38480fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 -- 172.21.15.142:0/352376136 shutdown_connections 2023-09-21T13:14:00.704 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.709+0000 7f38507ff700 1 -- 172.21.15.142:0/352376136 wait complete. 2023-09-21T13:14:00.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.710+0000 7f38507ff700 1 Processor -- start 2023-09-21T13:14:00.706 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.710+0000 7f38507ff700 1 -- start start 2023-09-21T13:14:00.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.710+0000 7f38507ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f38507ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38481060e0 0x7f3848199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f38507ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 0x7f384819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.707 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f38507ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e600 con 0x7f3848100fc0 2023-09-21T13:14:00.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f38507ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e770 con 0x7f38481060e0 2023-09-21T13:14:00.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f38507ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384819e930 con 0x7f384819db80 2023-09-21T13:14:00.708 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57864/0 (socket says 172.21.15.142:57864) 2023-09-21T13:14:00.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 -- 172.21.15.142:0/2095241706 learned_addr learned my addr 172.21.15.142:0/2095241706 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.709 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384ed9c700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 0x7f384819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384dd9a700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38481060e0 0x7f3848199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 -- 172.21.15.142:0/2095241706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 msgr2=0x7f384819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.710 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 0x7f384819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 -- 172.21.15.142:0/2095241706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38481060e0 msgr2=0x7f3848199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38481060e0 0x7f3848199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 -- 172.21.15.142:0/2095241706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840009d00 con 0x7f3848100fc0 2023-09-21T13:14:00.711 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384ed9c700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 0x7f384819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:00.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.711+0000 7f384e59b700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f384400e9a0 tx=0x7f384400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.712+0000 7f383f7fe700 1 -- 172.21.15.142:0/2095241706 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844009790 con 0x7f3848100fc0 2023-09-21T13:14:00.712 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.712+0000 7f383f7fe700 1 -- 172.21.15.142:0/2095241706 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3844010430 con 0x7f3848100fc0 2023-09-21T13:14:00.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.712+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38481a5e90 con 0x7f3848100fc0 2023-09-21T13:14:00.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.712+0000 7f383f7fe700 1 -- 172.21.15.142:0/2095241706 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844018680 con 0x7f3848100fc0 2023-09-21T13:14:00.713 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.712+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38481a6310 con 0x7f3848100fc0 2023-09-21T13:14:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.716+0000 7f383f7fe700 1 -- 172.21.15.142:0/2095241706 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f38440105a0 con 0x7f3848100fc0 2023-09-21T13:14:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.717+0000 7f386408cb80 1 Processor -- start 2023-09-21T13:14:00.719 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.717+0000 7f386408cb80 1 -- start start 2023-09-21T13:14:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.720 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf45ccca0 con 0x55fdf4658610 2023-09-21T13:14:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf45b0c70 con 0x55fdf465d360 2023-09-21T13:14:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f386408cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf45ae590 con 0x55fdf4658f30 2023-09-21T13:14:00.721 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f383f7fe700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 0x7f38340a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f383f7fe700 1 -- 172.21.15.142:0/2095241706 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3844014070 con 0x7f3848100fc0 2023-09-21T13:14:00.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384e59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384dd9a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.722 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384e59b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53322/0 (socket says 172.21.15.142:53322) 2023-09-21T13:14:00.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384e59b700 1 -- 172.21.15.142:0/25610310 learned_addr learned my addr 172.21.15.142:0/25610310 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.723 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57876/0 (socket says 172.21.15.142:57876) 2023-09-21T13:14:00.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.718+0000 7f384ed9c700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 0x7f38340a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 -- 172.21.15.142:0/25610310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 msgr2=0x55fdf465ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.724 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 -- 172.21.15.142:0/25610310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 msgr2=0x55fdf46589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 -- 172.21.15.142:0/25610310 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdf43d4de0 con 0x55fdf465d360 2023-09-21T13:14:00.725 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384ed9c700 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:14:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384dd9a700 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465d7c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f384806a350 tx=0x7f3838009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e8820221bcc6973 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f383cff9700 1 -- 172.21.15.142:0/25610310 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838011c80 con 0x55fdf465d360 2023-09-21T13:14:00.726 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f384ed9c700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 0x7f38340a2c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38400062a0 tx=0x7f3840006210 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f383cff9700 1 -- 172.21.15.142:0/25610310 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3838004510 con 0x55fdf465d360 2023-09-21T13:14:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.719+0000 7f383cff9700 1 -- 172.21.15.142:0/25610310 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838005280 con 0x55fdf465d360 2023-09-21T13:14:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 -- 172.21.15.142:0/25610310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 msgr2=0x55fdf465d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.727 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465d7c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f384806a350 tx=0x7f3838009f60 comp rx=0 tx=0).stop 2023-09-21T13:14:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 -- 172.21.15.142:0/25610310 shutdown_connections 2023-09-21T13:14:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf46589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465d7c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.728 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 --2- 172.21.15.142:0/25610310 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 -- 172.21.15.142:0/25610310 >> 172.21.15.142:0/25610310 conn(0x55fdf4585000 msgr2=0x55fdf46536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 -- 172.21.15.142:0/25610310 shutdown_connections 2023-09-21T13:14:00.729 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.720+0000 7f386408cb80 1 -- 172.21.15.142:0/25610310 wait complete. 2023-09-21T13:14:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 -- start start 2023-09-21T13:14:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 Processor -- start 2023-09-21T13:14:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4664a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.730 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf4661d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf465d360 0x55fdf4662390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf45a9e80 con 0x55fdf465d360 2023-09-21T13:14:00.731 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf4546740 con 0x55fdf4658610 2023-09-21T13:14:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf45463e0 con 0x55fdf4658f30 2023-09-21T13:14:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.721+0000 7f386408cb80 10 client.0 _ll_register_callbacks cb 0x55fdf4490a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4664a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.732 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf4661d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384ed9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf465d360 0x55fdf4662390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4664a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51056/0 (socket says 172.21.15.142:51056) 2023-09-21T13:14:00.733 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384e59b700 1 -- 172.21.15.142:0/3101252143 learned_addr learned my addr 172.21.15.142:0/3101252143 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 -- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 msgr2=0x55fdf4664a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4664a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 -- 172.21.15.142:0/3101252143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf465d360 msgr2=0x55fdf4662390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.734 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf465d360 0x55fdf4662390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 -- 172.21.15.142:0/3101252143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38380098e0 con 0x55fdf4658f30 2023-09-21T13:14:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f384dd9a700 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf4661d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f383800a010 tx=0x7f3838005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc6e3d91816888b server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.735 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.722+0000 7f3831ffb700 10 client.0 ms_handle_connect on v2:172.21.15.160:3300/0 2023-09-21T13:14:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3838026070 con 0x55fdf4658f30 2023-09-21T13:14:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fdf451abb0 con 0x55fdf4658f30 2023-09-21T13:14:00.736 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mon.1 v2:172.21.15.160:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f3838011a80 con 0x55fdf4658f30 2023-09-21T13:14:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3838011c80 con 0x55fdf4658f30 2023-09-21T13:14:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 10 client.28441 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x55fdf43bdc60 con 0x55fdf4658f30 2023-09-21T13:14:00.737 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mon.1 v2:172.21.15.160:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fdf451abb0 con 0x55fdf4658f30 2023-09-21T13:14:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mon.1 v2:172.21.15.160:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3838029020 con 0x55fdf4658f30 2023-09-21T13:14:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 10 client.28441 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.738 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 10 client.28441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:14:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 20 client.28441 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.723+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf4672320 0x55fdf4674740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.739 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.724+0000 7f386408cb80 4 client.28441 mds_command: new command op to 24578 tid=0[{"prefix": "get_command_descriptions"}] 2023-09-21T13:14:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.724+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fdf4627020 con 0x55fdf4672320 2023-09-21T13:14:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.724+0000 7f384e59b700 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf4672320 0x55fdf4674740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.724+0000 7f384e59b700 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf4672320 0x55fdf4674740 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=371e6eff81999031 server_cookie=1395c2ac4be8e11b in_seq=0 out_seq=0 2023-09-21T13:14:00.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.724+0000 7f3831ffb700 10 client.28441 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:14:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f3831ffb700 1 -- 172.21.15.142:0/3101252143 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fdf4627020 con 0x55fdf4672320 2023-09-21T13:14:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f3831ffb700 10 client.28441 handle_command_reply: tid=0 2023-09-21T13:14:00.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 client.28441 shutdown 2023-09-21T13:14:00.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 msgr2=0x55fdf4661d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf4661d80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f383800a010 tx=0x7f3838005ce0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 shutdown_connections 2023-09-21T13:14:00.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf4672320 0x55fdf4674740 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf465d360 0x55fdf4662390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4664a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.743 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 --2- 172.21.15.142:0/3101252143 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf4661d80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f3831ffb700 0 client.28441 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:14:00.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 >> 172.21.15.142:0/3101252143 conn(0x55fdf4585000 msgr2=0x55fdf4652880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.725+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 shutdown_connections 2023-09-21T13:14:00.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.726+0000 7f386408cb80 1 -- 172.21.15.142:0/3101252143 wait complete. 2023-09-21T13:14:00.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.726+0000 7f386408cb80 20 client.28441 trim_cache size 0 max 16384 2023-09-21T13:14:00.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.739+0000 7f386408cb80 1 Processor -- start 2023-09-21T13:14:00.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.739+0000 7f386408cb80 1 -- start start 2023-09-21T13:14:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf442a920 con 0x55fdf4658610 2023-09-21T13:14:00.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf46596e0 con 0x55fdf465d360 2023-09-21T13:14:00.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f386408cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf464d990 con 0x55fdf4658f30 2023-09-21T13:14:00.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57894/0 (socket says 172.21.15.142:57894) 2023-09-21T13:14:00.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 -- 172.21.15.142:0/3119727443 learned_addr learned my addr 172.21.15.142:0/3119727443 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384dd9a700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384ed9c700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 -- 172.21.15.142:0/3119727443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 msgr2=0x55fdf465fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 -- 172.21.15.142:0/3119727443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 msgr2=0x55fdf465c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 -- 172.21.15.142:0/3119727443 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdf43fb250 con 0x55fdf4658610 2023-09-21T13:14:00.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384dd9a700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:00.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.740+0000 7f384e59b700 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3844099560 tx=0x7f3844010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df6ba50eaaab565 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f383d7fa700 1 -- 172.21.15.142:0/3119727443 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f384409d400 con 0x55fdf4658610 2023-09-21T13:14:00.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f383d7fa700 1 -- 172.21.15.142:0/3119727443 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38440a1640 con 0x55fdf4658610 2023-09-21T13:14:00.756 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f383d7fa700 1 -- 172.21.15.142:0/3119727443 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38440c9af0 con 0x55fdf4658610 2023-09-21T13:14:00.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 -- 172.21.15.142:0/3119727443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 msgr2=0x55fdf465f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f3844099560 tx=0x7f3844010c80 comp rx=0 tx=0).stop 2023-09-21T13:14:00.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 -- 172.21.15.142:0/3119727443 shutdown_connections 2023-09-21T13:14:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658610 0x55fdf465f720 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf465d360 0x55fdf465c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 --2- 172.21.15.142:0/3119727443 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf4658f30 0x55fdf465fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 -- 172.21.15.142:0/3119727443 >> 172.21.15.142:0/3119727443 conn(0x55fdf4585000 msgr2=0x55fdf465b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 -- 172.21.15.142:0/3119727443 shutdown_connections 2023-09-21T13:14:00.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.741+0000 7f386408cb80 1 -- 172.21.15.142:0/3119727443 wait complete. 2023-09-21T13:14:00.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.742+0000 7f386408cb80 1 -- start start 2023-09-21T13:14:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.742+0000 7f386408cb80 1 Processor -- start 2023-09-21T13:14:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 0x55fdf4667920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf465d360 0x55fdf4667e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf4668510 con 0x55fdf4658f30 2023-09-21T13:14:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf4668680 con 0x55fdf4658610 2023-09-21T13:14:00.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdf46c6120 con 0x55fdf465d360 2023-09-21T13:14:00.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f386408cb80 10 client.0 _ll_register_callbacks cb 0x55fdf4490a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-21T13:14:00.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.762 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384e59b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:51080/0 (socket says 172.21.15.142:51080) 2023-09-21T13:14:00.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384e59b700 1 -- 172.21.15.142:0/370760766 learned_addr learned my addr 172.21.15.142:0/370760766 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:00.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384dd9a700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 0x55fdf4667920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384ed9c700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf465d360 0x55fdf4667e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.763 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384e59b700 1 -- 172.21.15.142:0/370760766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf465d360 msgr2=0x55fdf4667e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.743+0000 7f384e59b700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf465d360 0x55fdf4667e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f384e59b700 1 -- 172.21.15.142:0/370760766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 msgr2=0x55fdf4667920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-21T13:14:00.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f384e59b700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 0x55fdf4667920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.764 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f384e59b700 1 -- 172.21.15.142:0/370760766 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdf43bdc60 con 0x55fdf4658610 2023-09-21T13:14:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f384dd9a700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 0x55fdf4667920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f384e59b700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f38440a1110 tx=0x7f38440959c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a81f1f728619683d server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:00.765 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f3831ffb700 10 client.0 ms_handle_connect on v2:172.21.15.156:3300/0 2023-09-21T13:14:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3844010880 con 0x55fdf4658610 2023-09-21T13:14:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mon.2 v2:172.21.15.156:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f38440c9af0 con 0x55fdf4658610 2023-09-21T13:14:00.766 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3838004510 con 0x55fdf4658610 2023-09-21T13:14:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38440109e0 con 0x55fdf4658610 2023-09-21T13:14:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f386408cb80 10 client.28532 fetch_fsmap learned FSMap version 59 2023-09-21T13:14:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) v3 -- 0x7f38481a6310 con 0x55fdf4658610 2023-09-21T13:14:00.767 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.744+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mon.2 v2:172.21.15.156:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3838004510 con 0x55fdf4658610 2023-09-21T13:14:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mon.2 v2:172.21.15.156:3300/0 5 ==== fsmap(e 59) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3844099830 con 0x55fdf4658610 2023-09-21T13:14:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 10 client.28532 fetch_fsmap finished waiting for FSMap version 59 2023-09-21T13:14:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 10 client.28532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-21T13:14:00.768 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 20 client.28532 populate_metadata read hostname 'smithi142' 2023-09-21T13:14:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf46c74a0 0x55fdf46c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 4 client.28532 mds_command: new command op to 24578 tid=0[{"prefix": "damage ls"}] 2023-09-21T13:14:00.769 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 --> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fdf45a2e60 con 0x55fdf46c74a0 2023-09-21T13:14:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f384dd9a700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf46c74a0 0x55fdf46c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f384dd9a700 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf46c74a0 0x55fdf46c98c0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e35cf5524a6b9b0e server_cookie=d135ad2ef12683ac in_seq=0 out_seq=0 2023-09-21T13:14:00.770 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f3831ffb700 10 client.28532 ms_handle_connect on v2:172.21.15.156:6838/1981914736 2023-09-21T13:14:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f3831ffb700 1 -- 172.21.15.142:0/370760766 <== mds.0 v2:172.21.15.156:6838/1981914736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fdf45a2e60 con 0x55fdf46c74a0 2023-09-21T13:14:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f3831ffb700 10 client.28532 handle_command_reply: tid=0 2023-09-21T13:14:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.745+0000 7f386408cb80 1 client.28532 shutdown 2023-09-21T13:14:00.771 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 msgr2=0x55fdf4669530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f38440a1110 tx=0x7f38440959c0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 shutdown_connections 2023-09-21T13:14:00.772 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:6838/1981914736,v1:172.21.15.156:6839/1981914736] conn(0x55fdf46c74a0 0x55fdf46c98c0 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fdf465d360 0x55fdf4667e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f3831ffb700 0 client.28532 ms_handle_reset on v2:172.21.15.156:6838/1981914736 2023-09-21T13:14:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x55fdf4658610 0x55fdf4669530 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.773 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 --2- 172.21.15.142:0/370760766 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x55fdf4658f30 0x55fdf4667920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 >> 172.21.15.142:0/370760766 conn(0x55fdf4585000 msgr2=0x55fdf465d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 shutdown_connections 2023-09-21T13:14:00.774 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 1 -- 172.21.15.142:0/370760766 wait complete. 2023-09-21T13:14:00.775 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f386408cb80 20 client.28532 trim_cache size 0 max 16384 2023-09-21T13:14:00.775 INFO:teuthology.orchestra.run.smithi142.stdout:[] 2023-09-21T13:14:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 msgr2=0x7f38340a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 0x7f38340a2c70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f38400062a0 tx=0x7f3840006210 comp rx=0 tx=0).stop 2023-09-21T13:14:00.777 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 msgr2=0x7f38481991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.746+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f384400e9a0 tx=0x7f384400ecb0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 shutdown_connections 2023-09-21T13:14:00.778 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f38340a07b0 0x7f38340a2c70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f3848100fc0 0x7f38481991e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f384819db80 0x7f384819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.779 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 --2- 172.21.15.142:0/2095241706 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f38481060e0 0x7f3848199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 >> 172.21.15.142:0/2095241706 conn(0x7f38480fc840 msgr2=0x7f38480fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 shutdown_connections 2023-09-21T13:14:00.780 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:00.747+0000 7f38507ff700 1 -- 172.21.15.142:0/2095241706 wait complete. 2023-09-21T13:14:01.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:00 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3155395653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:01.158 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:00 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3155395653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:01.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:00 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3155395653' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:01.782 INFO:tasks.fwd_scrub.fs.[cephfs]:end scrubbing fs: cephfs 2023-09-21T13:14:01.782 INFO:tasks.fwd_scrub:done joining 2023-09-21T13:14:01.783 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-09-21T13:14:01.796 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T13:14:02.000 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 -- 172.21.15.142:0/2797495881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c100fd0 msgr2=0x7f6f1c1013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 --2- 172.21.15.142:0/2797495881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c1013b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009990 tx=0x7f6f18009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.001 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 -- 172.21.15.142:0/2797495881 shutdown_connections 2023-09-21T13:14:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 --2- 172.21.15.142:0/2797495881 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c1013b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 --2- 172.21.15.142:0/2797495881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c1060f0 0x7f6f1c10dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.002 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 --2- 172.21.15.142:0/2797495881 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c101980 0x7f6f1c1059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 -- 172.21.15.142:0/2797495881 >> 172.21.15.142:0/2797495881 conn(0x7f6f1c0fc890 msgr2=0x7f6f1c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 -- 172.21.15.142:0/2797495881 shutdown_connections 2023-09-21T13:14:02.003 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.008+0000 7f6f239ff700 1 -- 172.21.15.142:0/2797495881 wait complete. 2023-09-21T13:14:02.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 Processor -- start 2023-09-21T13:14:02.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 -- start start 2023-09-21T13:14:02.006 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c1060f0 0x7f6f1c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 0x7f6f1c19df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c19e570 con 0x7f6f1c19daf0 2023-09-21T13:14:02.007 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c19e6e0 con 0x7f6f1c1060f0 2023-09-21T13:14:02.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.009+0000 7f6f239ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c19e8a0 con 0x7f6f1c100fd0 2023-09-21T13:14:02.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f2179b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.008 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 0x7f6f1c19df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f2179b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:53358/0 (socket says 172.21.15.142:53358) 2023-09-21T13:14:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f2179b700 1 -- 172.21.15.142:0/1983864349 learned_addr learned my addr 172.21.15.142:0/1983864349 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f20f9a700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c1060f0 0x7f6f1c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.009 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 -- 172.21.15.142:0/1983864349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 msgr2=0x7f6f1c199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 -- 172.21.15.142:0/1983864349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c1060f0 msgr2=0x7f6f1c199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c1060f0 0x7f6f1c199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 -- 172.21.15.142:0/1983864349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180095f0 con 0x7f6f1c19daf0 2023-09-21T13:14:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f2179b700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:02.011 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.010+0000 7f6f21f9c700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 0x7f6f1c19df70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f14007f10 tx=0x7f6f1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.011+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14004db0 con 0x7f6f1c19daf0 2023-09-21T13:14:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.011+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c1a5e00 con 0x7f6f1c19daf0 2023-09-21T13:14:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.011+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6f1400f040 con 0x7f6f1c19daf0 2023-09-21T13:14:02.012 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.011+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14005990 con 0x7f6f1c19daf0 2023-09-21T13:14:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.011+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c1a62e0 con 0x7f6f1c19daf0 2023-09-21T13:14:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.012+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c067bd0 con 0x7f6f1c19daf0 2023-09-21T13:14:02.013 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.014+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f6f1400db20 con 0x7f6f1c19daf0 2023-09-21T13:14:02.014 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.015+0000 7f6f127fc700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 0x7f6f080a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.015+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f6f140cb7d0 con 0x7f6f1c19daf0 2023-09-21T13:14:02.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.015+0000 7f6f2179b700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 0x7f6f080a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.015 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.016+0000 7f6f2179b700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 0x7f6f080a2cb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6f18006010 tx=0x7f6f1800b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.016 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.019+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6f1404ee10 con 0x7f6f1c19daf0 2023-09-21T13:14:02.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:01 smithi156 ceph-mon[134078]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:02.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:01 smithi142 ceph-mon[97663]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:02.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:01 smithi160 ceph-mon[134450]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 40 KiB/s wr, 10 op/s 2023-09-21T13:14:02.214 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.222+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f1c101b90 con 0x7f6f1c19daf0 2023-09-21T13:14:02.216 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.224+0000 7f6f127fc700 1 -- 172.21.15.142:0/1983864349 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+23078 (secure 0 0 0) 0x7f6f14094f60 con 0x7f6f1c19daf0 2023-09-21T13:14:02.217 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:02.217 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":113,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T13:13:11.757373+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":28,"snap_epoch":112,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6800/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/969325249":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/3896559715":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2723441093":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1844445290":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":15,"length":1},{"begin":28,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T13:14:02.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 msgr2=0x7f6f080a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 0x7f6f080a2cb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6f18006010 tx=0x7f6f1800b260 comp rx=0 tx=0).stop 2023-09-21T13:14:02.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 msgr2=0x7f6f1c19df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.219 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 0x7f6f1c19df70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f14007f10 tx=0x7f6f1400d3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 shutdown_connections 2023-09-21T13:14:02.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f6f080a07f0 0x7f6f080a2cb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.220 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f6f1c19daf0 0x7f6f1c19df70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f1c100fd0 0x7f6f1c199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 --2- 172.21.15.142:0/1983864349 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f6f1c1060f0 0x7f6f1c199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.226+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 >> 172.21.15.142:0/1983864349 conn(0x7f6f1c0fc890 msgr2=0x7f6f1c0fd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:02.221 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.227+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 shutdown_connections 2023-09-21T13:14:02.222 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.227+0000 7f6f239ff700 1 -- 172.21.15.142:0/1983864349 wait complete. 2023-09-21T13:14:02.238 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 28, 'snap_epoch': 112, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T13:14:02.239 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T13:14:02.440 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 -- 172.21.15.142:0/3991183067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc1060e0 msgr2=0x7fd6fc10dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 --2- 172.21.15.142:0/3991183067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc10dc60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009f90 tx=0x7fd6f400b330 comp rx=0 tx=0).stop 2023-09-21T13:14:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 -- 172.21.15.142:0/3991183067 shutdown_connections 2023-09-21T13:14:02.441 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 --2- 172.21.15.142:0/3991183067 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc1013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 --2- 172.21.15.142:0/3991183067 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc10dc60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 --2- 172.21.15.142:0/3991183067 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc101970 0x7fd6fc1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.442 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 -- 172.21.15.142:0/3991183067 >> 172.21.15.142:0/3991183067 conn(0x7fd6fc0fc840 msgr2=0x7fd6fc0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:02.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 -- 172.21.15.142:0/3991183067 shutdown_connections 2023-09-21T13:14:02.443 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.448+0000 7fd7035ff700 1 -- 172.21.15.142:0/3991183067 wait complete. 2023-09-21T13:14:02.445 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 Processor -- start 2023-09-21T13:14:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 -- start start 2023-09-21T13:14:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc198fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.446 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc19e3e0 con 0x7fd6fc19d960 2023-09-21T13:14:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc19e550 con 0x7fd6fc100fc0 2023-09-21T13:14:02.447 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.449+0000 7fd7035ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc19e710 con 0x7fd6fc1060e0 2023-09-21T13:14:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd70139b700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc198fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57948/0 (socket says 172.21.15.142:57948) 2023-09-21T13:14:02.448 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 -- 172.21.15.142:0/28088926 learned_addr learned my addr 172.21.15.142:0/28088926 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd700b9a700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 -- 172.21.15.142:0/28088926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc1060e0 msgr2=0x7fd6fc199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.449 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 -- 172.21.15.142:0/28088926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 msgr2=0x7fd6fc198fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc198fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 -- 172.21.15.142:0/28088926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80095f0 con 0x7fd6fc19d960 2023-09-21T13:14:02.450 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd70139b700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:02.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.450+0000 7fd701b9c700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d010 tx=0x7fd6f4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.451+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400e040 con 0x7fd6fc19d960 2023-09-21T13:14:02.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.451+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f4009c40 con 0x7fd6fc19d960 2023-09-21T13:14:02.451 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.451+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6f400bbf0 con 0x7fd6fc19d960 2023-09-21T13:14:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.451+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f401b6b0 con 0x7fd6fc19d960 2023-09-21T13:14:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.451+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc1a5f00 con 0x7fd6fc19d960 2023-09-21T13:14:02.452 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.452+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc067b60 con 0x7fd6fc19d960 2023-09-21T13:14:02.453 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.454+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fd6f401d480 con 0x7fd6fc19d960 2023-09-21T13:14:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.455+0000 7fd6f27fc700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 0x7fd6e80a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.454 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.455+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fd6f40cdc50 con 0x7fd6fc19d960 2023-09-21T13:14:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.456+0000 7fd70139b700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 0x7fd6e80a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.456+0000 7fd70139b700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 0x7fd6e80a2c70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8005fd0 tx=0x7fd6f8009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.455 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.457+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd6f4097470 con 0x7fd6fc19d960 2023-09-21T13:14:02.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.656+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6fc19a310 con 0x7fd6fc19d960 2023-09-21T13:14:02.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.657+0000 7fd6f27fc700 1 -- 172.21.15.142:0/28088926 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6f409aa90 con 0x7fd6fc19d960 2023-09-21T13:14:02.649 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T13:14:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 msgr2=0x7fd6e80a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 0x7fd6e80a2c70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8005fd0 tx=0x7fd6f8009310 comp rx=0 tx=0).stop 2023-09-21T13:14:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 msgr2=0x7fd6fc19dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd6f400d010 tx=0x7fd6f4004ad0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 shutdown_connections 2023-09-21T13:14:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fd6e80a07b0 0x7fd6e80a2c70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fd6fc19d960 0x7fd6fc19dde0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fd6fc100fc0 0x7fd6fc198fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 --2- 172.21.15.142:0/28088926 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6fc1060e0 0x7fd6fc199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 >> 172.21.15.142:0/28088926 conn(0x7fd6fc0fc840 msgr2=0x7fd6fc0fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 shutdown_connections 2023-09-21T13:14:02.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.659+0000 7fd7035ff700 1 -- 172.21.15.142:0/28088926 wait complete. 2023-09-21T13:14:02.670 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T13:14:02.873 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 -- 172.21.15.142:0/2335568072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc980100fc0 msgr2=0x7fc9801013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 --2- 172.21.15.142:0/2335568072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc980100fc0 0x7fc9801013a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009990 tx=0x7fc97c009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.874 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 -- 172.21.15.142:0/2335568072 shutdown_connections 2023-09-21T13:14:02.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 --2- 172.21.15.142:0/2335568072 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc980100fc0 0x7fc9801013a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 --2- 172.21.15.142:0/2335568072 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc98010dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 --2- 172.21.15.142:0/2335568072 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980101970 0x7fc9801059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.875 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 -- 172.21.15.142:0/2335568072 >> 172.21.15.142:0/2335568072 conn(0x7fc9800fc840 msgr2=0x7fc9800fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 -- 172.21.15.142:0/2335568072 shutdown_connections 2023-09-21T13:14:02.876 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.881+0000 7fc987bff700 1 -- 172.21.15.142:0/2335568072 wait complete. 2023-09-21T13:14:02.878 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.882+0000 7fc987bff700 1 Processor -- start 2023-09-21T13:14:02.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.882+0000 7fc987bff700 1 -- start start 2023-09-21T13:14:02.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.882+0000 7fc987bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980100fc0 0x7fc980199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.879 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc987bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc980199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc987bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc987bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98019e560 con 0x7fc98019dae0 2023-09-21T13:14:02.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc987bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98019e6d0 con 0x7fc980100fc0 2023-09-21T13:14:02.880 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc987bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98019e890 con 0x7fc9801060e0 2023-09-21T13:14:02.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98619c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98619c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57956/0 (socket says 172.21.15.142:57956) 2023-09-21T13:14:02.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98619c700 1 -- 172.21.15.142:0/612412077 learned_addr learned my addr 172.21.15.142:0/612412077 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:02.881 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc980199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98599b700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980100fc0 0x7fc980199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 -- 172.21.15.142:0/612412077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980100fc0 msgr2=0x7fc980199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.882 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980100fc0 0x7fc980199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 -- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 msgr2=0x7fc98019df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98519a700 1 -- 172.21.15.142:0/612412077 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c0095f0 con 0x7fc9801060e0 2023-09-21T13:14:02.883 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.883+0000 7fc98619c700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:02.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc98519a700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc980199680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc97000e9c0 tx=0x7fc97000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000c9c0 con 0x7fc9801060e0 2023-09-21T13:14:02.884 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc970010430 con 0x7fc9801060e0 2023-09-21T13:14:02.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9801a5df0 con 0x7fc9801060e0 2023-09-21T13:14:02.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970018680 con 0x7fc9801060e0 2023-09-21T13:14:02.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.884+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9801a6270 con 0x7fc9801060e0 2023-09-21T13:14:02.885 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.885+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc980067b60 con 0x7fc9801060e0 2023-09-21T13:14:02.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.887+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc97000cb20 con 0x7fc9801060e0 2023-09-21T13:14:02.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.888+0000 7fc976ffd700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 0x7fc96c0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:02.887 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.888+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc970014070 con 0x7fc9801060e0 2023-09-21T13:14:02.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.888+0000 7fc98599b700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 0x7fc96c0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:02.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.889+0000 7fc98599b700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 0x7fc96c0a2c70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00b2e0 tx=0x7fc97c005fd0 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:02.888 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:02.890+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc970095ba0 con 0x7fc9801060e0 2023-09-21T13:14:03.083 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.091+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc980101b90 con 0x7fc9801060e0 2023-09-21T13:14:03.084 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.092+0000 7fc976ffd700 1 -- 172.21.15.142:0/612412077 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc9700991c0 con 0x7fc9801060e0 2023-09-21T13:14:03.085 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T13:14:03.086 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 msgr2=0x7fc96c0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 0x7fc96c0a2c70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00b2e0 tx=0x7fc97c005fd0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 msgr2=0x7fc980199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc980199680 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc97000e9c0 tx=0x7fc97000ecd0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.087 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 shutdown_connections 2023-09-21T13:14:03.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc96c0a07b0 0x7fc96c0a2c70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc98019dae0 0x7fc98019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.088 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc980100fc0 0x7fc980199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 --2- 172.21.15.142:0/612412077 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc9801060e0 0x7fc980199680 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 >> 172.21.15.142:0/612412077 conn(0x7fc9800fc840 msgr2=0x7fc9800fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:03.089 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 shutdown_connections 2023-09-21T13:14:03.090 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.094+0000 7fc987bff700 1 -- 172.21.15.142:0/612412077 wait complete. 2023-09-21T13:14:03.103 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:02 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1983864349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:03.103 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:02 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/28088926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:03.105 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T13:14:03.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:02 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1983864349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:03.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:02 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/28088926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:03.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:02 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1983864349' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:03.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:02 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/28088926' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:03.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 -- 172.21.15.142:0/1052772872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff0073210 msgr2=0x7fcff00735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1052772872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff0073210 0x7fcff00735f0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0098f0 tx=0x7fcfec009c00 comp rx=0 tx=0).stop 2023-09-21T13:14:03.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 -- 172.21.15.142:0/1052772872 shutdown_connections 2023-09-21T13:14:03.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1052772872 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff010d590 0x7fcff010fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1052772872 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff0073210 0x7fcff00735f0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1052772872 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 0x7fcff010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 -- 172.21.15.142:0/1052772872 >> 172.21.15.142:0/1052772872 conn(0x7fcff00fc840 msgr2=0x7fcff00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:03.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 -- 172.21.15.142:0/1052772872 shutdown_connections 2023-09-21T13:14:03.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.313+0000 7fcff85ff700 1 -- 172.21.15.142:0/1052772872 wait complete. 2023-09-21T13:14:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.314+0000 7fcff85ff700 1 Processor -- start 2023-09-21T13:14:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.314+0000 7fcff85ff700 1 -- start start 2023-09-21T13:14:03.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 0x7fcff0199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff010d590 0x7fcff019da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff019e0d0 con 0x7fcff0073210 2023-09-21T13:14:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff019e240 con 0x7fcff010d590 2023-09-21T13:14:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff85ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff019e400 con 0x7fcff0073b30 2023-09-21T13:14:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff6b9c700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff010d590 0x7fcff019da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57964/0 (socket says 172.21.15.142:57964) 2023-09-21T13:14:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 -- 172.21.15.142:0/1218215867 learned_addr learned my addr 172.21.15.142:0/1218215867 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:03.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff5b9a700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 0x7fcff0199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 -- 172.21.15.142:0/1218215867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 msgr2=0x7fcff0199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 0x7fcff0199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 -- 172.21.15.142:0/1218215867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff010d590 msgr2=0x7fcff019da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff010d590 0x7fcff019da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.315+0000 7fcff639b700 1 -- 172.21.15.142:0/1218215867 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec009520 con 0x7fcff0073210 2023-09-21T13:14:03.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcff639b700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009230 tx=0x7fcfec00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:03.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec01c070 con 0x7fcff0073210 2023-09-21T13:14:03.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff019e680 con 0x7fcff0073210 2023-09-21T13:14:03.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcfec005040 con 0x7fcff0073210 2023-09-21T13:14:03.317 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0038e0 con 0x7fcff0073210 2023-09-21T13:14:03.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.316+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff01a5f20 con 0x7fcff0073210 2023-09-21T13:14:03.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.317+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff0067b60 con 0x7fcff0073210 2023-09-21T13:14:03.318 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.319+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fcfec020030 con 0x7fcff0073210 2023-09-21T13:14:03.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.320+0000 7fcfe77fe700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 0x7fcfdc0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.319 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.320+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fcfec0ccf90 con 0x7fcff0073210 2023-09-21T13:14:03.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.320+0000 7fcff5b9a700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 0x7fcfdc0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.321+0000 7fcff5b9a700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 0x7fcfdc0a2c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcff019a700 tx=0x7fcfe0009310 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:03.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.324+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcfec0967b0 con 0x7fcff0073210 2023-09-21T13:14:03.519 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.527+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcff0112f40 con 0x7fcff0073210 2023-09-21T13:14:03.520 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.527+0000 7fcfe77fe700 1 -- 172.21.15.142:0/1218215867 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfec0051b0 con 0x7fcff0073210 2023-09-21T13:14:03.520 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T13:14:03.522 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 msgr2=0x7fcfdc0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 0x7fcfdc0a2c70 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcff019a700 tx=0x7fcfe0009310 comp rx=0 tx=0).stop 2023-09-21T13:14:03.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 msgr2=0x7fcff01990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.523 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009230 tx=0x7fcfec00fa00 comp rx=0 tx=0).stop 2023-09-21T13:14:03.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 shutdown_connections 2023-09-21T13:14:03.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fcfdc0a07b0 0x7fcfdc0a2c70 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.524 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fcff0073210 0x7fcff01990f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fcff010d590 0x7fcff019da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 --2- 172.21.15.142:0/1218215867 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff0073b30 0x7fcff0199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 >> 172.21.15.142:0/1218215867 conn(0x7fcff00fc840 msgr2=0x7fcff010f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:03.525 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 shutdown_connections 2023-09-21T13:14:03.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.530+0000 7fcff85ff700 1 -- 172.21.15.142:0/1218215867 wait complete. 2023-09-21T13:14:03.541 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-09-21T13:14:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 -- 172.21.15.142:0/3701163272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 msgr2=0x7fc3b01013b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/3701163272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b01013b0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac009990 tx=0x7fc3ac009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.740 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 -- 172.21.15.142:0/3701163272 shutdown_connections 2023-09-21T13:14:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/3701163272 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b01013b0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/3701163272 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b01060f0 0x7fc3b010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.741 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/3701163272 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b0101980 0x7fc3b01059c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 -- 172.21.15.142:0/3701163272 >> 172.21.15.142:0/3701163272 conn(0x7fc3b00fc890 msgr2=0x7fc3b00fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:03.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.747+0000 7fc3b7fff700 1 -- 172.21.15.142:0/3701163272 shutdown_connections 2023-09-21T13:14:03.742 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.748+0000 7fc3b7fff700 1 -- 172.21.15.142:0/3701163272 wait complete. 2023-09-21T13:14:03.744 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.748+0000 7fc3b7fff700 1 Processor -- start 2023-09-21T13:14:03.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 -- start start 2023-09-21T13:14:03.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b01060f0 0x7fc3b01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.745 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b019b840 0x7fc3b019bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b019c2c0 con 0x7fc3b0100fd0 2023-09-21T13:14:03.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b019c430 con 0x7fc3b019b840 2023-09-21T13:14:03.746 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b7fff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3b019c5f0 con 0x7fc3b01060f0 2023-09-21T13:14:03.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b559a700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b01060f0 0x7fc3b01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b5d9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:57990/0 (socket says 172.21.15.142:57990) 2023-09-21T13:14:03.747 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b5d9b700 1 -- 172.21.15.142:0/2940264690 learned_addr learned my addr 172.21.15.142:0/2940264690 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:03.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.749+0000 7fc3b659c700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b019b840 0x7fc3b019bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 -- 172.21.15.142:0/2940264690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b01060f0 msgr2=0x7fc3b01973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b01060f0 0x7fc3b01973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 -- 172.21.15.142:0/2940264690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b019b840 msgr2=0x7fc3b019bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:03.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b019b840 0x7fc3b019bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:03.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 -- 172.21.15.142:0/2940264690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0095f0 con 0x7fc3b0100fd0 2023-09-21T13:14:03.749 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b5d9b700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac005770 tx=0x7fc3ac0057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:03.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac01d070 con 0x7fc3b0100fd0 2023-09-21T13:14:03.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3ac022470 con 0x7fc3b0100fd0 2023-09-21T13:14:03.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3b01a3af0 con 0x7fc3b0100fd0 2023-09-21T13:14:03.750 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ac017650 con 0x7fc3b0100fd0 2023-09-21T13:14:03.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.750+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3b01a3f70 con 0x7fc3b0100fd0 2023-09-21T13:14:03.751 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.751+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b0067bd0 con 0x7fc3b0100fd0 2023-09-21T13:14:03.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.753+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc3ac00fb40 con 0x7fc3b0100fd0 2023-09-21T13:14:03.752 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.754+0000 7fc3a6ffd700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 0x7fc39c0a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:03.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.755+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc3ac0cd250 con 0x7fc3b0100fd0 2023-09-21T13:14:03.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.755+0000 7fc3b559a700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 0x7fc39c0a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:03.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.755+0000 7fc3b559a700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 0x7fc39c0a2d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc3b01984b0 tx=0x7fc3a0009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:03.754 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:03.758+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc3ac096ad0 con 0x7fc3b0100fd0 2023-09-21T13:14:04.010 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.018+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fc3b0101b80 con 0x7fc3b0100fd0 2023-09-21T13:14:04.020 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.028+0000 7fc3a6ffd700 1 -- 172.21.15.142:0/2940264690 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) v1 ==== 81+0+730431 (secure 0 0 0) 0x7fc3ac09a0f0 con 0x7fc3b0100fd0 2023-09-21T13:14:04.031 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:04.031 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:14:04.032 INFO:teuthology.orchestra.run.smithi142.stdout: "epoch": 26, 2023-09-21T13:14:04.032 INFO:teuthology.orchestra.run.smithi142.stdout: "active_gid": 15303, 2023-09-21T13:14:04.032 INFO:teuthology.orchestra.run.smithi142.stdout: "active_name": "x", 2023-09-21T13:14:04.032 INFO:teuthology.orchestra.run.smithi142.stdout: "active_addrs": { 2023-09-21T13:14:04.033 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:04.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.033 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:04.033 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6800", 2023-09-21T13:14:04.034 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 373173545 2023-09-21T13:14:04.034 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.034 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v1", 2023-09-21T13:14:04.035 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:6801", 2023-09-21T13:14:04.035 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 373173545 2023-09-21T13:14:04.035 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.036 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:04.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.036 INFO:teuthology.orchestra.run.smithi142.stdout: "active_addr": "172.21.15.142:6801/373173545", 2023-09-21T13:14:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: "active_change": "2023-09-21T12:56:14.398154+0000", 2023-09-21T13:14:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: "active_mgr_features": 4540138322906710015, 2023-09-21T13:14:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: "available": true, 2023-09-21T13:14:04.037 INFO:teuthology.orchestra.run.smithi142.stdout: "standbys": [ 2023-09-21T13:14:04.038 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.038 INFO:teuthology.orchestra.run.smithi142.stdout: "gid": 25312, 2023-09-21T13:14:04.038 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "z", 2023-09-21T13:14:04.039 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_features": 4540138322906710015, 2023-09-21T13:14:04.039 INFO:teuthology.orchestra.run.smithi142.stdout: "available_modules": [ 2023-09-21T13:14:04.039 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.040 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "alerts", 2023-09-21T13:14:04.040 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.040 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.040 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.041 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:04.041 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:04.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.041 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.042 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.042 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:04.042 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.043 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.043 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.043 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How frequently to reexamine health status", 2023-09-21T13:14:04.043 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.044 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.044 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.045 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.045 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.045 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.045 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.046 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.046 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.046 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.047 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.047 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.047 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.047 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.048 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.048 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.048 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.049 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.049 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.049 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.049 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.050 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.050 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.051 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.051 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.051 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.051 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.052 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.052 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.052 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.052 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.053 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.053 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.053 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.054 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.054 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.054 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.055 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.055 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.055 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.056 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.056 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.056 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.056 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.057 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.057 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.057 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.058 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.058 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.058 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.058 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.059 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.059 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.059 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.060 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.060 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.060 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.061 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.061 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.062 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.062 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.062 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.063 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.063 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.063 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.064 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.064 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.064 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.064 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_destination": { 2023-09-21T13:14:04.065 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_destination", 2023-09-21T13:14:04.065 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.065 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.066 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.066 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.066 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.066 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.067 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.067 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email address to send alerts to", 2023-09-21T13:14:04.067 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.068 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.068 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_from_name": { 2023-09-21T13:14:04.069 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_from_name", 2023-09-21T13:14:04.069 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.069 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.070 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "Ceph", 2023-09-21T13:14:04.070 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.070 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.071 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.071 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email From: name", 2023-09-21T13:14:04.071 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.071 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.072 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.072 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_host": { 2023-09-21T13:14:04.072 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_host", 2023-09-21T13:14:04.073 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.073 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.073 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.074 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.074 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.074 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.074 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.075 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP server", 2023-09-21T13:14:04.075 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.075 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.076 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.076 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_password": { 2023-09-21T13:14:04.076 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_password", 2023-09-21T13:14:04.077 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.077 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.078 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.078 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.078 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.079 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.079 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Password to authenticate with", 2023-09-21T13:14:04.079 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.080 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.080 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_port": { 2023-09-21T13:14:04.081 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_port", 2023-09-21T13:14:04.081 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.081 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.081 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.082 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "465", 2023-09-21T13:14:04.082 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.082 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.083 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.083 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP port", 2023-09-21T13:14:04.083 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.083 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.084 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.084 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_sender": { 2023-09-21T13:14:04.085 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_sender", 2023-09-21T13:14:04.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.085 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.086 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.086 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.086 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.087 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.087 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP envelope sender", 2023-09-21T13:14:04.087 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.088 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.088 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_ssl": { 2023-09-21T13:14:04.089 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_ssl", 2023-09-21T13:14:04.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.089 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.089 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.090 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.090 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.090 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.091 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.091 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-21T13:14:04.091 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.091 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.092 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.092 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_user": { 2023-09-21T13:14:04.092 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_user", 2023-09-21T13:14:04.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.093 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.093 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.094 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.094 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.094 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.095 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.095 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "User to authenticate as", 2023-09-21T13:14:04.095 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.095 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.096 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.096 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.097 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.097 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "balancer", 2023-09-21T13:14:04.097 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.098 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.098 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.098 INFO:teuthology.orchestra.run.smithi142.stdout: "active": { 2023-09-21T13:14:04.099 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "active", 2023-09-21T13:14:04.099 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.099 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.099 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.100 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.100 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.100 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.101 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.101 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically balance PGs across cluster", 2023-09-21T13:14:04.101 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.101 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.102 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.102 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_time": { 2023-09-21T13:14:04.102 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_time", 2023-09-21T13:14:04.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.103 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.104 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0000", 2023-09-21T13:14:04.104 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.104 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.104 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.105 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "beginning time of day to automatically balance", 2023-09-21T13:14:04.105 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:04.105 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.106 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.106 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_weekday": { 2023-09-21T13:14:04.106 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_weekday", 2023-09-21T13:14:04.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:04.107 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.108 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:04.108 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:04.108 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:04.108 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.109 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-21T13:14:04.109 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:04.109 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.110 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.110 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_max_iterations": { 2023-09-21T13:14:04.110 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_max_iterations", 2023-09-21T13:14:04.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:04.111 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.111 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.112 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "25", 2023-09-21T13:14:04.112 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:04.112 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "250", 2023-09-21T13:14:04.112 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.113 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-21T13:14:04.113 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.113 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.114 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.114 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_metrics": { 2023-09-21T13:14:04.114 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_metrics", 2023-09-21T13:14:04.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.115 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.116 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "pgs,objects,bytes", 2023-09-21T13:14:04.116 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.116 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.116 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.117 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-21T13:14:04.117 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-21T13:14:04.117 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.118 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.118 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_step": { 2023-09-21T13:14:04.118 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_step", 2023-09-21T13:14:04.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:04.119 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.120 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.5", 2023-09-21T13:14:04.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0.001", 2023-09-21T13:14:04.120 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "0.999", 2023-09-21T13:14:04.120 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.121 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "aggressiveness of optimization", 2023-09-21T13:14:04.121 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-21T13:14:04.121 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.122 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.122 INFO:teuthology.orchestra.run.smithi142.stdout: "end_time": { 2023-09-21T13:14:04.122 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_time", 2023-09-21T13:14:04.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.123 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.123 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.124 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2359", 2023-09-21T13:14:04.124 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.124 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.124 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.125 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ending time of day to automatically balance", 2023-09-21T13:14:04.125 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:04.125 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.126 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.126 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.126 INFO:teuthology.orchestra.run.smithi142.stdout: "end_weekday": { 2023-09-21T13:14:04.126 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_weekday", 2023-09-21T13:14:04.127 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:04.127 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.128 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:04.128 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:04.128 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:04.128 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.129 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-21T13:14:04.129 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:04.129 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.129 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.130 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.130 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.130 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.131 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.131 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.131 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.131 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.132 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.132 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.132 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.133 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.133 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.133 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.133 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.134 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.134 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.134 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.135 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.135 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.135 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.135 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.136 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.136 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.137 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.137 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.137 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.138 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.138 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.138 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.139 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.139 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.139 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.139 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.140 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.141 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.142 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.142 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.142 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.143 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.143 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.143 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.143 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.144 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.144 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.144 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.144 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.145 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.145 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.145 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.146 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.146 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.146 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.147 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.147 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.147 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.148 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.148 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.148 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.148 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.149 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.149 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.149 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.150 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.150 INFO:teuthology.orchestra.run.smithi142.stdout: "min_score": { 2023-09-21T13:14:04.150 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_score", 2023-09-21T13:14:04.150 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:04.151 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.151 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.151 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:04.152 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.152 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.152 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.152 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-21T13:14:04.153 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.153 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.153 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.154 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:04.154 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:04.154 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.155 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.155 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.155 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "upmap", 2023-09-21T13:14:04.155 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.156 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.156 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.156 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-compat", 2023-09-21T13:14:04.157 INFO:teuthology.orchestra.run.smithi142.stdout: "none", 2023-09-21T13:14:04.157 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap" 2023-09-21T13:14:04.157 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.157 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Balancer mode", 2023-09-21T13:14:04.158 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.158 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.158 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.159 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_ids": { 2023-09-21T13:14:04.159 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_ids", 2023-09-21T13:14:04.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.160 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.160 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.161 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.161 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.161 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.161 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-21T13:14:04.162 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.162 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.163 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:04.163 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:04.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.164 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.164 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.164 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:04.165 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.165 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.165 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.165 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-21T13:14:04.166 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.166 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.166 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.167 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_deviation": { 2023-09-21T13:14:04.167 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_deviation", 2023-09-21T13:14:04.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.168 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.168 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:04.169 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:04.169 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.169 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.169 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-21T13:14:04.170 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-21T13:14:04.170 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.170 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.171 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_optimizations": { 2023-09-21T13:14:04.171 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_optimizations", 2023-09-21T13:14:04.171 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:04.172 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.172 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.172 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.173 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.173 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.173 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-21T13:14:04.174 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.174 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.174 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.175 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.176 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cephadm", 2023-09-21T13:14:04.177 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.177 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.178 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.178 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_down_multiplier": { 2023-09-21T13:14:04.178 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_down_multiplier", 2023-09-21T13:14:04.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:04.179 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.179 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.179 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:04.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.180 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.180 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.180 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-21T13:14:04.181 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.181 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.181 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.181 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.182 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_refresh_rate": { 2023-09-21T13:14:04.182 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_refresh_rate", 2023-09-21T13:14:04.182 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.183 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.183 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.183 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "20", 2023-09-21T13:14:04.183 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.184 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.184 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.184 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-21T13:14:04.185 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.185 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.185 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.186 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_starting_port": { 2023-09-21T13:14:04.186 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_starting_port", 2023-09-21T13:14:04.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.187 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.187 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.187 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4721", 2023-09-21T13:14:04.187 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.188 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.188 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.188 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-21T13:14:04.189 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.189 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.189 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.190 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.190 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_ptrace": { 2023-09-21T13:14:04.190 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_ptrace", 2023-09-21T13:14:04.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.191 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.191 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.191 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.192 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.192 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.192 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.192 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-21T13:14:04.193 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-21T13:14:04.193 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.193 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.194 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_interval": { 2023-09-21T13:14:04.194 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_interval", 2023-09-21T13:14:04.194 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.195 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.195 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.195 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:04.196 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.196 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.196 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.197 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-21T13:14:04.197 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.197 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.197 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.198 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_memory_target_ratio": { 2023-09-21T13:14:04.198 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_memory_target_ratio", 2023-09-21T13:14:04.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:04.199 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.199 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.199 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.7", 2023-09-21T13:14:04.200 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.200 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.200 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.200 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-21T13:14:04.201 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.201 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.201 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.202 INFO:teuthology.orchestra.run.smithi142.stdout: "cgroups_split": { 2023-09-21T13:14:04.202 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cgroups_split", 2023-09-21T13:14:04.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.203 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.203 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.203 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.204 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.204 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.204 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.204 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-21T13:14:04.205 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.205 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.205 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.206 INFO:teuthology.orchestra.run.smithi142.stdout: "config_checks_enabled": { 2023-09-21T13:14:04.206 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_checks_enabled", 2023-09-21T13:14:04.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.207 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.207 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.207 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.208 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.208 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.208 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.208 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-21T13:14:04.209 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.209 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.209 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.210 INFO:teuthology.orchestra.run.smithi142.stdout: "config_dashboard": { 2023-09-21T13:14:04.210 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_dashboard", 2023-09-21T13:14:04.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.211 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.211 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.212 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.212 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.212 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.212 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-21T13:14:04.213 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.213 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.213 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.214 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_alertmanager": { 2023-09-21T13:14:04.214 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_alertmanager", 2023-09-21T13:14:04.214 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.215 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.215 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-21T13:14:04.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.216 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.216 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.216 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:04.217 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.217 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.218 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.218 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_base": { 2023-09-21T13:14:04.219 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_base", 2023-09-21T13:14:04.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.219 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.220 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.220 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-21T13:14:04.220 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.220 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.221 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.221 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Container image name, without the tag", 2023-09-21T13:14:04.221 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.222 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.222 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.222 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_elasticsearch": { 2023-09-21T13:14:04.223 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_elasticsearch", 2023-09-21T13:14:04.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.223 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.224 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-21T13:14:04.224 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.224 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.225 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.225 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "elasticsearch container image", 2023-09-21T13:14:04.225 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.226 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.226 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.226 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_grafana": { 2023-09-21T13:14:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_grafana", 2023-09-21T13:14:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.227 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.228 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-21T13:14:04.228 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.228 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.229 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.229 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:04.229 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.229 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.230 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.230 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_haproxy": { 2023-09-21T13:14:04.231 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_haproxy", 2023-09-21T13:14:04.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.231 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.231 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.232 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-21T13:14:04.232 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.232 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.233 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.233 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "HAproxy container image", 2023-09-21T13:14:04.233 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.233 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.234 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.234 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.234 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_agent": { 2023-09-21T13:14:04.235 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_agent", 2023-09-21T13:14:04.235 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.235 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.236 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-21T13:14:04.236 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.236 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.237 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.237 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger agent container image", 2023-09-21T13:14:04.237 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.238 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.238 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.238 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.238 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_collector": { 2023-09-21T13:14:04.239 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_collector", 2023-09-21T13:14:04.239 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.239 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.240 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.240 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-21T13:14:04.240 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.240 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.241 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.241 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger collector container image", 2023-09-21T13:14:04.241 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.242 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.242 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.242 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_query": { 2023-09-21T13:14:04.243 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_query", 2023-09-21T13:14:04.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.243 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.244 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-21T13:14:04.244 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.244 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.245 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.245 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger query container image", 2023-09-21T13:14:04.245 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.245 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.246 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.246 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_keepalived": { 2023-09-21T13:14:04.247 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_keepalived", 2023-09-21T13:14:04.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.247 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.248 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-21T13:14:04.248 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.248 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.249 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.249 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Keepalived container image", 2023-09-21T13:14:04.249 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.249 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.250 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.250 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_loki": { 2023-09-21T13:14:04.250 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_loki", 2023-09-21T13:14:04.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.251 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.251 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.251 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-21T13:14:04.252 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.252 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.252 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.252 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Loki container image", 2023-09-21T13:14:04.253 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.253 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.253 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.254 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_node_exporter": { 2023-09-21T13:14:04.254 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_node_exporter", 2023-09-21T13:14:04.254 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.255 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.255 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.255 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-21T13:14:04.256 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.256 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.256 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.256 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:04.257 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.257 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.257 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.258 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_nvmeof": { 2023-09-21T13:14:04.258 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_nvmeof", 2023-09-21T13:14:04.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.259 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.259 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-21T13:14:04.260 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.260 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.260 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.260 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Nvme-of container image", 2023-09-21T13:14:04.261 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.261 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.261 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.262 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_prometheus": { 2023-09-21T13:14:04.262 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_prometheus", 2023-09-21T13:14:04.262 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.263 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.263 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.263 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-21T13:14:04.263 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.264 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.264 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.264 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:04.265 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.265 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.265 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.266 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_promtail": { 2023-09-21T13:14:04.266 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_promtail", 2023-09-21T13:14:04.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.267 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.267 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.267 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-21T13:14:04.268 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.268 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.268 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.268 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Promtail container image", 2023-09-21T13:14:04.269 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.269 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.269 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_snmp_gateway": { 2023-09-21T13:14:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_snmp_gateway", 2023-09-21T13:14:04.270 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.271 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-21T13:14:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.272 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SNMP Gateway container image", 2023-09-21T13:14:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.273 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: "container_init": { 2023-09-21T13:14:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_init", 2023-09-21T13:14:04.274 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.275 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.276 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.276 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.276 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.276 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Run podman/docker with `--init`", 2023-09-21T13:14:04.277 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.277 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.277 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.278 INFO:teuthology.orchestra.run.smithi142.stdout: "daemon_cache_timeout": { 2023-09-21T13:14:04.278 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "daemon_cache_timeout", 2023-09-21T13:14:04.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.279 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.279 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.279 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:04.279 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.280 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.280 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.280 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-21T13:14:04.281 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.281 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.281 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.282 INFO:teuthology.orchestra.run.smithi142.stdout: "default_cephadm_command_timeout": { 2023-09-21T13:14:04.282 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_cephadm_command_timeout", 2023-09-21T13:14:04.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.282 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.283 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.283 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "900", 2023-09-21T13:14:04.283 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.283 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.284 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.284 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-21T13:14:04.284 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.285 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.285 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.285 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.286 INFO:teuthology.orchestra.run.smithi142.stdout: "default_registry": { 2023-09-21T13:14:04.286 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_registry", 2023-09-21T13:14:04.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.286 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.287 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.287 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io", 2023-09-21T13:14:04.287 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.288 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.288 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.288 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-21T13:14:04.288 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.289 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.289 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.289 INFO:teuthology.orchestra.run.smithi142.stdout: "device_cache_timeout": { 2023-09-21T13:14:04.290 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_cache_timeout", 2023-09-21T13:14:04.290 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.290 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.291 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1800", 2023-09-21T13:14:04.291 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.291 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.292 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.292 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache device inventory", 2023-09-21T13:14:04.292 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.292 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.293 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.293 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.293 INFO:teuthology.orchestra.run.smithi142.stdout: "device_enhanced_scan": { 2023-09-21T13:14:04.294 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_enhanced_scan", 2023-09-21T13:14:04.294 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.294 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.294 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.295 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.295 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.295 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.296 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.296 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-21T13:14:04.296 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.297 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.297 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.297 INFO:teuthology.orchestra.run.smithi142.stdout: "facts_cache_timeout": { 2023-09-21T13:14:04.298 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "facts_cache_timeout", 2023-09-21T13:14:04.298 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.298 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.299 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:04.299 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.299 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.300 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.300 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache host facts data", 2023-09-21T13:14:04.300 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.300 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.301 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.301 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.301 INFO:teuthology.orchestra.run.smithi142.stdout: "host_check_interval": { 2023-09-21T13:14:04.301 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "host_check_interval", 2023-09-21T13:14:04.302 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.302 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.302 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.303 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:04.303 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.303 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.303 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.304 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to perform a host check", 2023-09-21T13:14:04.304 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.304 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.305 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.305 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.305 INFO:teuthology.orchestra.run.smithi142.stdout: "inventory_list_all": { 2023-09-21T13:14:04.305 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "inventory_list_all", 2023-09-21T13:14:04.306 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.306 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.306 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.307 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.307 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.307 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.307 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.308 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-21T13:14:04.308 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.308 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.308 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.309 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.309 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.309 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.310 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.310 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.310 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.311 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.311 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.311 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.311 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.312 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.312 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.312 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.312 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.313 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.313 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.313 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.314 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.314 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.314 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.315 INFO:teuthology.orchestra.run.smithi142.stdout: "log_refresh_metadata": { 2023-09-21T13:14:04.315 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_refresh_metadata", 2023-09-21T13:14:04.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.316 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.317 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.317 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.317 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-21T13:14:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.320 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-21T13:14:04.321 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.323 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.324 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.325 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.326 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.327 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.328 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.329 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.330 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.331 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.332 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-21T13:14:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-21T13:14:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.333 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.334 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-21T13:14:04.335 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-21T13:14:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-21T13:14:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.337 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "*", 2023-09-21T13:14:04.338 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-21T13:14:04.339 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "max_count_per_host": { 2023-09-21T13:14:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_count_per_host", 2023-09-21T13:14:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.341 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.342 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of daemons per service per host", 2023-09-21T13:14:04.343 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.344 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd_draining_count": { 2023-09-21T13:14:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_osd_draining_count", 2023-09-21T13:14:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.345 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.346 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.347 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-21T13:14:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "migration_current": { 2023-09-21T13:14:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "migration_current", 2023-09-21T13:14:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.349 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.350 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "internal - do not modify", 2023-09-21T13:14:04.351 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.352 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.353 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "root", 2023-09-21T13:14:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.354 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm-package", 2023-09-21T13:14:04.355 INFO:teuthology.orchestra.run.smithi142.stdout: "root" 2023-09-21T13:14:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "mode for remote execution of cephadm", 2023-09-21T13:14:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.356 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.357 INFO:teuthology.orchestra.run.smithi142.stdout: "prometheus_alerts_path": { 2023-09-21T13:14:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus_alerts_path", 2023-09-21T13:14:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-21T13:14:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.359 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-21T13:14:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.360 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.361 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_insecure": { 2023-09-21T13:14:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_insecure", 2023-09-21T13:14:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.363 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-21T13:14:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.364 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.365 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_password": { 2023-09-21T13:14:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_password", 2023-09-21T13:14:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.366 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.367 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-21T13:14:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.368 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.369 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_url": { 2023-09-21T13:14:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_url", 2023-09-21T13:14:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.370 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.371 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-21T13:14:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.372 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.373 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_username": { 2023-09-21T13:14:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_username", 2023-09-21T13:14:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.374 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.375 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-21T13:14:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.376 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "secure_monitoring_stack": { 2023-09-21T13:14:04.377 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "secure_monitoring_stack", 2023-09-21T13:14:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.378 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.379 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-21T13:14:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.380 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.381 INFO:teuthology.orchestra.run.smithi142.stdout: "service_discovery_port": { 2023-09-21T13:14:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "service_discovery_port", 2023-09-21T13:14:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.382 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8765", 2023-09-21T13:14:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.383 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "cephadm service discovery port", 2023-09-21T13:14:04.384 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.385 INFO:teuthology.orchestra.run.smithi142.stdout: "ssh_config_file": { 2023-09-21T13:14:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssh_config_file", 2023-09-21T13:14:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.386 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.387 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-21T13:14:04.388 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.389 INFO:teuthology.orchestra.run.smithi142.stdout: "use_agent": { 2023-09-21T13:14:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_agent", 2023-09-21T13:14:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.390 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.391 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-21T13:14:04.392 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.393 INFO:teuthology.orchestra.run.smithi142.stdout: "use_repo_digest": { 2023-09-21T13:14:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_repo_digest", 2023-09-21T13:14:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.394 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.395 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-21T13:14:04.396 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_failed_host_check": { 2023-09-21T13:14:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_failed_host_check", 2023-09-21T13:14:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.398 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.399 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.400 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if the host check fails", 2023-09-21T13:14:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_daemons": { 2023-09-21T13:14:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_daemons", 2023-09-21T13:14:04.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.403 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.404 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-21T13:14:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_hosts": { 2023-09-21T13:14:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_hosts", 2023-09-21T13:14:04.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.407 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.408 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-21T13:14:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.409 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.410 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crash", 2023-09-21T13:14:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.411 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.413 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.414 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.415 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.416 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.417 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.418 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.419 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.420 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.421 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.422 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.423 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.424 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.425 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.426 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.428 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.429 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.430 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "retain_interval": { 2023-09-21T13:14:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retain_interval", 2023-09-21T13:14:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.432 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "31536000", 2023-09-21T13:14:04.433 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.434 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-21T13:14:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.435 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_recent_interval": { 2023-09-21T13:14:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_recent_interval", 2023-09-21T13:14:04.436 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1209600", 2023-09-21T13:14:04.437 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.438 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-21T13:14:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.439 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.440 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dashboard", 2023-09-21T13:14:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.441 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-21T13:14:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-21T13:14:04.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.443 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.444 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_HOST": { 2023-09-21T13:14:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-21T13:14:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.446 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.447 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.448 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.449 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-21T13:14:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-21T13:14:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.450 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.451 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.452 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.452 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.452 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.453 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_ENABLED": { 2023-09-21T13:14:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_ENABLED", 2023-09-21T13:14:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.454 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.455 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.456 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.457 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-21T13:14:04.458 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-21T13:14:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.459 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.460 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.461 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "ENABLE_BROWSABLE_API": { 2023-09-21T13:14:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-21T13:14:04.462 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.463 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.464 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.464 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.464 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.465 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.465 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.465 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.465 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-21T13:14:04.466 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-21T13:14:04.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.467 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.467 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.468 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.469 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-21T13:14:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-21T13:14:04.470 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.471 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.472 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.473 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-21T13:14:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-21T13:14:04.474 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.475 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.476 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.477 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-21T13:14:04.478 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-21T13:14:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.479 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.480 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.481 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-21T13:14:04.482 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-21T13:14:04.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.483 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.484 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.485 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-21T13:14:04.486 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-21T13:14:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.487 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.488 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-21T13:14:04.490 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-21T13:14:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.491 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.492 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-21T13:14:04.494 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-21T13:14:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.496 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.497 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_PASSWORD": { 2023-09-21T13:14:04.498 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-21T13:14:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.499 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.500 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.501 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-21T13:14:04.502 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-21T13:14:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.503 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.504 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.505 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_URL": { 2023-09-21T13:14:04.506 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_URL", 2023-09-21T13:14:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.507 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.508 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.509 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.510 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_USERNAME": { 2023-09-21T13:14:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-21T13:14:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.511 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.512 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.513 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.514 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-21T13:14:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-21T13:14:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.515 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.516 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.517 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.518 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-21T13:14:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-21T13:14:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.519 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.520 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.521 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.522 INFO:teuthology.orchestra.run.smithi142.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-21T13:14:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-21T13:14:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.523 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.524 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.525 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.525 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.525 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.525 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.526 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.526 INFO:teuthology.orchestra.run.smithi142.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-21T13:14:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-21T13:14:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.527 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.528 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.529 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_HOST": { 2023-09-21T13:14:04.530 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-21T13:14:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.531 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.532 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.533 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-21T13:14:04.534 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-21T13:14:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.535 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.536 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.536 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.536 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.537 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-21T13:14:04.538 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-21T13:14:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.540 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.541 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.542 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-21T13:14:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-21T13:14:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.544 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.544 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.544 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.545 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.546 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-21T13:14:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-21T13:14:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.547 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.548 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.549 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.550 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-21T13:14:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-21T13:14:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.551 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.552 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.553 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.554 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-21T13:14:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-21T13:14:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.556 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-21T13:14:04.558 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-21T13:14:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.559 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.560 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.561 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-21T13:14:04.562 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-21T13:14:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.563 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.564 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.565 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_ENABLED": { 2023-09-21T13:14:04.566 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-21T13:14:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.568 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.569 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.570 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.573 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-21T13:14:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-21T13:14:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-21T13:14:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.575 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.576 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.577 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-21T13:14:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-21T13:14:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.578 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.579 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.580 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.581 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-21T13:14:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-21T13:14:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.582 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8", 2023-09-21T13:14:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.583 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.585 INFO:teuthology.orchestra.run.smithi142.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-21T13:14:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-21T13:14:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.586 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "45", 2023-09-21T13:14:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.587 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.588 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.589 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ACCESS_KEY": { 2023-09-21T13:14:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-21T13:14:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.590 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.591 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.592 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.593 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-21T13:14:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-21T13:14:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.594 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.595 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.596 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SECRET_KEY": { 2023-09-21T13:14:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-21T13:14:04.598 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.599 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.600 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.601 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SSL_VERIFY": { 2023-09-21T13:14:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-21T13:14:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.602 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.603 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.604 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-21T13:14:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-21T13:14:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.606 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:04.607 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.608 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-21T13:14:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-21T13:14:04.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.611 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.612 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.613 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-21T13:14:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-21T13:14:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.614 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.615 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.616 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.617 INFO:teuthology.orchestra.run.smithi142.stdout: "cross_origin_url": { 2023-09-21T13:14:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cross_origin_url", 2023-09-21T13:14:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.618 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.619 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.620 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.621 INFO:teuthology.orchestra.run.smithi142.stdout: "crt_file": { 2023-09-21T13:14:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crt_file", 2023-09-21T13:14:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.622 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.623 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.624 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "debug": { 2023-09-21T13:14:04.625 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "debug", 2023-09-21T13:14:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.626 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.627 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable/disable debug options", 2023-09-21T13:14:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.629 INFO:teuthology.orchestra.run.smithi142.stdout: "jwt_token_ttl": { 2023-09-21T13:14:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "jwt_token_ttl", 2023-09-21T13:14:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.630 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "28800", 2023-09-21T13:14:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.631 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.632 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:04.633 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.634 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.635 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.636 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.637 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.638 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.639 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.640 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.641 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.642 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.643 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.644 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.645 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.646 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.647 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.648 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.649 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.650 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.651 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.652 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.654 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.655 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "motd": { 2023-09-21T13:14:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "motd", 2023-09-21T13:14:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.657 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.658 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.659 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "The message of the day", 2023-09-21T13:14:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect_resolve_ip_addr": { 2023-09-21T13:14:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "redirect_resolve_ip_addr", 2023-09-21T13:14:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.661 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.662 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.663 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.664 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.665 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.666 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.667 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.668 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.669 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8080", 2023-09-21T13:14:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.670 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.671 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.672 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.673 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.674 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.675 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.676 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl_server_port": { 2023-09-21T13:14:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl_server_port", 2023-09-21T13:14:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.677 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8443", 2023-09-21T13:14:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.678 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.679 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.680 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.681 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "redirect", 2023-09-21T13:14:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.682 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect" 2023-09-21T13:14:04.683 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.684 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:04.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.686 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.687 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.688 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "url_prefix": { 2023-09-21T13:14:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url_prefix", 2023-09-21T13:14:04.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.690 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.691 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.693 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "devicehealth", 2023-09-21T13:14:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.694 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_monitoring": { 2023-09-21T13:14:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_monitoring", 2023-09-21T13:14:04.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.696 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.697 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "monitor device health metrics", 2023-09-21T13:14:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.700 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.701 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.702 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.702 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.702 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.703 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.703 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.703 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.703 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.704 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.704 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.704 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.705 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.705 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.705 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.706 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.706 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.706 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.707 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.707 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.707 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.708 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.708 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.708 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.708 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.709 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.709 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.710 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.710 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.710 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.711 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.711 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.711 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.712 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.712 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.712 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.712 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.713 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.713 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.713 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.713 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.714 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.714 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.714 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.715 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.715 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.715 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.716 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.716 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.716 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.717 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.717 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.717 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.717 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.718 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.718 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.718 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.719 INFO:teuthology.orchestra.run.smithi142.stdout: "mark_out_threshold": { 2023-09-21T13:14:04.719 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mark_out_threshold", 2023-09-21T13:14:04.720 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.720 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.720 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2419200", 2023-09-21T13:14:04.721 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.721 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.721 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.722 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-21T13:14:04.722 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.722 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.722 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.723 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": { 2023-09-21T13:14:04.723 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_name", 2023-09-21T13:14:04.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.724 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.724 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.724 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "device_health_metrics", 2023-09-21T13:14:04.725 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.725 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.725 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.726 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-21T13:14:04.726 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.726 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.727 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.727 INFO:teuthology.orchestra.run.smithi142.stdout: "retention_period": { 2023-09-21T13:14:04.727 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retention_period", 2023-09-21T13:14:04.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.728 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.729 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15552000", 2023-09-21T13:14:04.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.729 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.730 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.730 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain device health metrics", 2023-09-21T13:14:04.730 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.730 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.731 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.731 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_frequency": { 2023-09-21T13:14:04.732 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_frequency", 2023-09-21T13:14:04.732 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.732 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.732 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.733 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:04.733 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.733 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.734 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.734 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-21T13:14:04.734 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.735 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.735 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.735 INFO:teuthology.orchestra.run.smithi142.stdout: "self_heal": { 2023-09-21T13:14:04.736 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "self_heal", 2023-09-21T13:14:04.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.736 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.737 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.737 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:04.737 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.737 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.738 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.738 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-21T13:14:04.738 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.739 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.739 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.739 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:04.740 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:04.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.740 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.741 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.741 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:04.741 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.741 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.742 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.742 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and check device health", 2023-09-21T13:14:04.742 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.743 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.743 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.743 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_threshold": { 2023-09-21T13:14:04.744 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_threshold", 2023-09-21T13:14:04.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.744 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.745 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.745 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7257600", 2023-09-21T13:14:04.745 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.745 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.746 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.746 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-21T13:14:04.746 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.747 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.747 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.747 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.747 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.748 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.748 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.748 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "diskprediction_local", 2023-09-21T13:14:04.748 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.749 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.749 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.749 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.750 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.750 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.750 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.751 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.751 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.751 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.752 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.752 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.752 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.752 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.753 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.753 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.753 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.753 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.754 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.754 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.754 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.755 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.755 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.755 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.755 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.756 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.756 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.756 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.757 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.757 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.757 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.758 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.758 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.758 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.758 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.759 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.759 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.759 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.760 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.760 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.760 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.760 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.761 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.761 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.761 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.762 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.762 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.762 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.762 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.763 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.763 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.763 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.764 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.764 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.764 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.764 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.765 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.765 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.765 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.766 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.766 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.766 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.767 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.767 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.767 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.768 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.768 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.768 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.768 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.769 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.769 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.769 INFO:teuthology.orchestra.run.smithi142.stdout: "predict_interval": { 2023-09-21T13:14:04.770 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predict_interval", 2023-09-21T13:14:04.770 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.770 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.770 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.771 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:04.771 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.771 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.772 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.772 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.772 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.773 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.773 INFO:teuthology.orchestra.run.smithi142.stdout: "predictor_model": { 2023-09-21T13:14:04.773 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predictor_model", 2023-09-21T13:14:04.774 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.774 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.774 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.774 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "prophetstor", 2023-09-21T13:14:04.775 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.775 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.775 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.775 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.776 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.776 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.776 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.777 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.777 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:04.777 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:04.777 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.778 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.778 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.778 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:04.778 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.779 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.779 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.779 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.779 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.780 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.780 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.781 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.781 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.781 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "influx", 2023-09-21T13:14:04.781 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": false, 2023-09-21T13:14:04.782 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "influxdb python module not found", 2023-09-21T13:14:04.782 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.782 INFO:teuthology.orchestra.run.smithi142.stdout: "batch_size": { 2023-09-21T13:14:04.783 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "batch_size", 2023-09-21T13:14:04.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.783 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.783 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.784 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5000", 2023-09-21T13:14:04.784 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.784 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.785 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.785 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-21T13:14:04.785 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.785 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.786 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.786 INFO:teuthology.orchestra.run.smithi142.stdout: "database": { 2023-09-21T13:14:04.787 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "database", 2023-09-21T13:14:04.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.787 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.787 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.788 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "ceph", 2023-09-21T13:14:04.788 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.788 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.788 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.789 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-21T13:14:04.789 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.789 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.789 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.790 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": { 2023-09-21T13:14:04.793 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "hostname", 2023-09-21T13:14:04.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.794 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.794 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.795 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.795 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.795 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.796 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.796 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server hostname", 2023-09-21T13:14:04.796 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.796 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.797 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.797 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:04.798 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:04.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:04.798 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.799 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "30", 2023-09-21T13:14:04.799 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "5", 2023-09-21T13:14:04.799 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.800 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.800 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-21T13:14:04.800 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.800 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.801 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.801 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.802 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.802 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.803 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.803 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.803 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.803 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.804 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.804 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.804 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.805 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.805 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.805 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.805 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.806 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.806 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.807 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.807 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.807 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.808 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.809 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.809 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.809 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.809 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.810 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.810 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.810 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.811 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.811 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.811 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.812 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.812 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.812 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.813 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.813 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.813 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.814 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.814 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.814 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.814 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.815 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.815 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.815 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.816 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.816 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.816 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.816 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.817 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.817 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.818 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.818 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.818 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.818 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.819 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.819 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.819 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.820 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.820 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.820 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.820 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.821 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.821 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.821 INFO:teuthology.orchestra.run.smithi142.stdout: "password": { 2023-09-21T13:14:04.821 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "password", 2023-09-21T13:14:04.822 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.822 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.823 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.823 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.823 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.823 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.824 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "password of InfluxDB server user", 2023-09-21T13:14:04.824 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.824 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.825 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.825 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.825 INFO:teuthology.orchestra.run.smithi142.stdout: "port": { 2023-09-21T13:14:04.825 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "port", 2023-09-21T13:14:04.826 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.826 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.826 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.827 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8086", 2023-09-21T13:14:04.827 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.827 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.827 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.828 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server port", 2023-09-21T13:14:04.828 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.828 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.828 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.829 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.829 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:04.829 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:04.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.830 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.830 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.831 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "false", 2023-09-21T13:14:04.831 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.831 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.831 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.832 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:04.832 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.832 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.832 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.833 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.833 INFO:teuthology.orchestra.run.smithi142.stdout: "threads": { 2023-09-21T13:14:04.833 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threads", 2023-09-21T13:14:04.834 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.834 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.834 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.834 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:04.835 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:04.835 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "32", 2023-09-21T13:14:04.835 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.836 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-21T13:14:04.836 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.836 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.836 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.837 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.837 INFO:teuthology.orchestra.run.smithi142.stdout: "username": { 2023-09-21T13:14:04.837 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "username", 2023-09-21T13:14:04.837 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.838 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.838 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.838 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.839 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.839 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.839 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.839 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "username of InfluxDB server user", 2023-09-21T13:14:04.840 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.840 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.840 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: "verify_ssl": { 2023-09-21T13:14:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "verify_ssl", 2023-09-21T13:14:04.841 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.842 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.842 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.842 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "true", 2023-09-21T13:14:04.842 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.843 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.843 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.843 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:04.844 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.844 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.844 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.844 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.845 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.845 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.845 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.846 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "insights", 2023-09-21T13:14:04.846 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.846 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.846 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.847 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.847 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.847 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.847 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.848 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.848 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.848 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.848 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.849 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.849 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.849 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.849 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.850 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.850 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.850 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.850 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.851 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.851 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.851 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.852 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.852 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.852 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.853 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.853 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.853 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.854 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.854 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.854 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.855 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.855 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.855 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.855 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.856 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.856 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.857 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.857 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.858 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.858 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.858 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.859 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.859 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.859 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.859 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.860 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.860 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.860 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.861 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.861 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.861 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.861 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.862 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.862 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.862 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.863 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.863 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.863 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.863 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.864 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.864 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.864 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.865 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.865 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.865 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.866 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.866 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.866 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.867 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.867 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "iostat", 2023-09-21T13:14:04.868 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.868 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.868 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.868 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.869 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.869 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.870 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.870 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.870 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.870 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.871 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.871 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.871 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.872 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.872 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.872 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.872 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.873 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.873 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.873 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.874 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.874 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.874 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.875 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.875 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.875 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.876 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.876 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.876 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.876 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.877 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.877 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.877 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.877 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.878 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.878 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.878 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.879 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.879 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.880 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.880 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.880 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.880 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.881 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.881 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.881 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.882 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.882 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.882 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.882 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.883 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.883 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.883 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.884 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.884 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.884 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.885 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.885 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.885 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.886 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.886 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.886 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.887 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.887 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.887 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.887 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.888 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.888 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.888 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.889 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.889 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "k8sevents", 2023-09-21T13:14:04.889 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.890 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.890 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.890 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_event_retention_days": { 2023-09-21T13:14:04.890 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ceph_event_retention_days", 2023-09-21T13:14:04.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.891 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7", 2023-09-21T13:14:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.892 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.893 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-21T13:14:04.893 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.893 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.894 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.894 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.894 INFO:teuthology.orchestra.run.smithi142.stdout: "config_check_secs": { 2023-09-21T13:14:04.894 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_check_secs", 2023-09-21T13:14:04.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.895 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.895 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:04.895 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:04.896 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "10", 2023-09-21T13:14:04.896 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.896 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.897 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-21T13:14:04.897 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.897 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.897 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.898 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.898 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.899 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.899 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.899 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.900 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.900 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.900 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.900 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.901 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.901 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.901 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.902 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.902 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.902 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.902 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.903 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.903 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.903 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.904 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.904 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.904 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.904 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.904 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.905 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.905 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.906 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.906 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.906 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.907 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.907 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.907 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.908 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.908 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.908 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.908 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.909 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.909 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.910 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.910 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.910 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.910 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.911 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.911 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.911 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.912 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.912 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.912 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.912 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.913 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.913 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.913 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.914 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.914 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.914 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.915 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.915 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.915 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.916 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.916 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.916 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.917 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.917 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.917 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.918 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.918 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "localpool", 2023-09-21T13:14:04.918 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.919 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.919 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.919 INFO:teuthology.orchestra.run.smithi142.stdout: "failure_domain": { 2023-09-21T13:14:04.920 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "failure_domain", 2023-09-21T13:14:04.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.920 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.920 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.921 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "host", 2023-09-21T13:14:04.921 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.921 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.922 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.922 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "failure domain for any created local pool", 2023-09-21T13:14:04.922 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-21T13:14:04.922 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.923 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.923 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.924 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.924 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.925 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.925 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.925 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.925 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.926 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.926 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.926 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.927 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.928 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.928 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.928 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.928 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.929 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.929 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.930 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.930 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.930 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.930 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.931 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.931 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.931 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.931 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.932 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.932 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.932 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.933 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.933 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.933 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.934 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.934 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.934 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.934 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.935 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.935 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.935 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.936 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.936 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.936 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.936 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.937 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.937 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.937 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.938 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.938 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.938 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.939 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.939 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.939 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.940 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.940 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.940 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.941 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.941 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.941 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.941 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.942 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.942 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.943 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": { 2023-09-21T13:14:04.943 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_size", 2023-09-21T13:14:04.943 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.943 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.944 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.944 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.944 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.944 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.945 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.945 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default min_size for any created local pool", 2023-09-21T13:14:04.945 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-21T13:14:04.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.946 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.946 INFO:teuthology.orchestra.run.smithi142.stdout: "num_rep": { 2023-09-21T13:14:04.947 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "num_rep", 2023-09-21T13:14:04.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.947 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.948 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3", 2023-09-21T13:14:04.948 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.948 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.948 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.949 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default replica count for any created local pool", 2023-09-21T13:14:04.949 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.950 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.950 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": { 2023-09-21T13:14:04.950 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_num", 2023-09-21T13:14:04.951 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:04.951 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.952 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "128", 2023-09-21T13:14:04.952 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.952 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.952 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.953 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default pg_num for any created local pool", 2023-09-21T13:14:04.953 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.953 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.954 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.954 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.954 INFO:teuthology.orchestra.run.smithi142.stdout: "prefix": { 2023-09-21T13:14:04.954 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prefix", 2023-09-21T13:14:04.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.955 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.956 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.956 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.956 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.956 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.957 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name prefix for any created local pool", 2023-09-21T13:14:04.957 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.957 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.958 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.958 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.958 INFO:teuthology.orchestra.run.smithi142.stdout: "subtree": { 2023-09-21T13:14:04.958 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "subtree", 2023-09-21T13:14:04.959 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.959 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "rack", 2023-09-21T13:14:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.960 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.961 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-21T13:14:04.961 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-21T13:14:04.961 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.962 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.962 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.962 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.963 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.963 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mds_autoscaler", 2023-09-21T13:14:04.963 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.964 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.964 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.964 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.964 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.965 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.965 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.965 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.965 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.966 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.966 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.966 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.967 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.967 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.967 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.967 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.968 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.968 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.968 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.969 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.969 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.969 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.969 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.970 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.970 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.970 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.971 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.971 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.971 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.972 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.972 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.972 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.972 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.973 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.973 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.973 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.973 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.974 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.974 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.974 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.974 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.975 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.975 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.975 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.976 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.976 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.976 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.976 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.977 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.977 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.977 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.978 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.978 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.978 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.978 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.979 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.979 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.980 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:04.980 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:04.980 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.981 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.981 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.982 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.982 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.982 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.982 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.983 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.983 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.983 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.983 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.984 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:04.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.984 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:04.985 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirroring", 2023-09-21T13:14:04.985 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:04.985 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:04.985 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:04.986 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:04.986 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:04.986 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.987 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.987 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.987 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:04.987 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.988 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.988 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.988 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.989 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.989 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.989 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.989 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.990 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:04.990 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:04.990 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.990 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.991 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.991 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.992 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:04.992 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:04.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:04.992 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.993 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.994 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:04.994 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:04.994 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:04.995 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:04.995 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:04.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:04.995 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:04.996 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:04.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:04.996 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:04.997 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:04.997 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:04.997 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:04.997 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:04.998 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:04.998 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:04.998 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:04.999 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:04.999 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:04.999 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:04.999 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.000 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.000 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.000 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.001 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.001 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.001 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.002 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.002 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.003 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.003 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.003 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.003 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.004 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.005 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.006 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "nfs", 2023-09-21T13:14:05.007 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.007 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.007 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.007 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.008 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.008 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.009 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.009 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.009 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.010 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.010 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.010 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.011 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.011 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.011 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.011 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.012 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.012 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.012 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.013 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.013 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.013 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.014 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.014 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.014 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.015 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.015 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.015 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.016 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.016 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.016 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.017 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.017 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.017 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.018 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.019 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.019 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.019 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.019 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.020 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.020 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.020 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.021 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.021 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.021 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.021 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.022 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.022 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.023 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.023 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.023 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.023 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.024 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.024 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.024 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.025 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.025 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.025 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.025 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.026 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.026 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.026 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.027 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.027 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.028 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.028 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:05.029 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.029 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.029 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.029 INFO:teuthology.orchestra.run.smithi142.stdout: "fail_fs": { 2023-09-21T13:14:05.030 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "fail_fs", 2023-09-21T13:14:05.030 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.030 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.031 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.031 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.031 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.032 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.032 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-21T13:14:05.032 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.033 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.033 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.033 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.034 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.034 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.034 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.035 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.035 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.035 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.035 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.036 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.036 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.036 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.036 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.037 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.037 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.037 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.038 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.038 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.038 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.039 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.039 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.039 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.039 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.040 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.040 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.040 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.041 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.041 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.041 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.041 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.042 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.042 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.042 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.043 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.043 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.043 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.044 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.044 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.045 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.045 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.045 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.045 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.046 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.046 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.046 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.047 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.047 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.047 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.047 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.048 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.048 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.048 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.048 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.049 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.049 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.049 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.050 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.050 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.050 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.051 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.051 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.051 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.052 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.052 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.052 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.052 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.053 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator": { 2023-09-21T13:14:05.053 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:05.053 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.054 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.054 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.054 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.055 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.055 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.055 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.056 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm", 2023-09-21T13:14:05.056 INFO:teuthology.orchestra.run.smithi142.stdout: "rook", 2023-09-21T13:14:05.056 INFO:teuthology.orchestra.run.smithi142.stdout: "test_orchestrator" 2023-09-21T13:14:05.056 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.057 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Orchestrator backend", 2023-09-21T13:14:05.057 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.057 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.057 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.058 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.058 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.058 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.059 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.059 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_perf_query", 2023-09-21T13:14:05.059 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.059 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.060 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.060 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.060 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.061 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.061 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.061 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.061 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.062 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.062 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.062 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.062 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.063 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.064 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.065 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.067 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.068 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.069 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.071 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.072 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.073 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.074 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.075 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.077 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.078 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.079 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.080 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_support", 2023-09-21T13:14:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.081 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.082 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.083 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.084 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.085 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.086 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.087 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.088 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.089 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.090 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.091 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.092 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.093 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.094 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.095 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.096 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.097 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.098 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.099 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.100 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.101 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.102 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_autoscaler", 2023-09-21T13:14:05.102 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.102 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.104 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.105 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.106 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.107 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.108 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.109 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.110 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.111 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.113 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.114 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.115 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.116 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.117 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.118 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.120 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.121 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "noautoscale": { 2023-09-21T13:14:05.122 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "noautoscale", 2023-09-21T13:14:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.123 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.124 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "global autoscale flag", 2023-09-21T13:14:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-21T13:14:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.125 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:05.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:05.127 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.128 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.129 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "threshold": { 2023-09-21T13:14:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threshold", 2023-09-21T13:14:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.130 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:05.131 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1.0", 2023-09-21T13:14:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "scaling threshold", 2023-09-21T13:14:05.132 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-21T13:14:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.133 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "progress", 2023-09-21T13:14:05.134 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.135 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_pg_recovery_event": { 2023-09-21T13:14:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_pg_recovery_event", 2023-09-21T13:14:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.136 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.137 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-21T13:14:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.138 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:05.139 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.140 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.141 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.142 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.143 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.144 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.145 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.146 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.147 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.149 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.150 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.150 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.150 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.151 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.151 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.151 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.151 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.152 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.152 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.153 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.153 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.153 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.153 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.154 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.154 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.154 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.155 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.155 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.155 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.155 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.156 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.156 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.156 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.156 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.157 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.157 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.157 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.158 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.158 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.158 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.158 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.159 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.159 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.159 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.160 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.160 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.160 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.161 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.161 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.161 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.161 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.161 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "max_completed_events": { 2023-09-21T13:14:05.162 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_completed_events", 2023-09-21T13:14:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.163 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "50", 2023-09-21T13:14:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.164 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "number of past completed events to remember", 2023-09-21T13:14:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.165 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:05.166 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.167 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.168 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long the module is going to sleep", 2023-09-21T13:14:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.169 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.170 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus", 2023-09-21T13:14:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.171 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "cache": { 2023-09-21T13:14:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cache", 2023-09-21T13:14:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.172 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.174 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "exclude_perf_counters": { 2023-09-21T13:14:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "exclude_perf_counters", 2023-09-21T13:14:05.176 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.177 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-21T13:14:05.178 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-21T13:14:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.180 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.181 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.182 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.183 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.183 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.183 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.184 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.185 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.186 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.187 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.188 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.189 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.190 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.191 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.192 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.193 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.194 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.195 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.196 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.197 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.198 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.201 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.202 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools": { 2023-09-21T13:14:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools", 2023-09-21T13:14:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.203 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.204 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.205 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-21T13:14:05.206 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-21T13:14:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.207 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300", 2023-09-21T13:14:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.208 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.209 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_interval": { 2023-09-21T13:14:05.210 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_interval", 2023-09-21T13:14:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15.0", 2023-09-21T13:14:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.212 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.213 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:05.214 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.216 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-21T13:14:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.217 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:05.218 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.219 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "9283", 2023-09-21T13:14:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.220 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.221 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-21T13:14:05.221 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.221 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.221 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: "stale_cache_strategy": { 2023-09-21T13:14:05.222 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stale_cache_strategy", 2023-09-21T13:14:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.223 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "log", 2023-09-21T13:14:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.224 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.225 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:05.226 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "default", 2023-09-21T13:14:05.227 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.228 INFO:teuthology.orchestra.run.smithi142.stdout: "default", 2023-09-21T13:14:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "error" 2023-09-21T13:14:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.229 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.230 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.231 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:05.232 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.233 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.234 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.235 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_support", 2023-09-21T13:14:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.236 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.237 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.238 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.239 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.240 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.241 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.242 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.243 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.245 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.246 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.247 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.248 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.249 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.250 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.251 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.252 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.253 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.254 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.255 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.256 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.257 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.258 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_snap_create": { 2023-09-21T13:14:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_snap_create", 2023-09-21T13:14:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.259 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.260 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.261 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "mirror_snapshot_schedule": { 2023-09-21T13:14:05.262 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirror_snapshot_schedule", 2023-09-21T13:14:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.263 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.264 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.265 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "trash_purge_schedule": { 2023-09-21T13:14:05.266 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "trash_purge_schedule", 2023-09-21T13:14:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.267 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.268 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.269 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "restful", 2023-09-21T13:14:05.271 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_auth": { 2023-09-21T13:14:05.272 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_auth", 2023-09-21T13:14:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.273 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.274 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.275 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:05.276 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.277 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.278 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.279 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.280 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.281 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.282 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.283 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.284 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.285 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.286 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.287 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.288 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.289 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.290 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.291 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.292 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.293 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.294 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.295 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.296 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.297 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.298 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.299 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:05.300 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.301 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.302 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.303 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:05.304 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.305 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.306 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.307 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.308 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rgw", 2023-09-21T13:14:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.309 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.310 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.311 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.312 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.313 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.314 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.315 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.316 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.317 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.318 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.319 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.320 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.321 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.322 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.323 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.324 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.325 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.326 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.327 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.328 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.329 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.330 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rook", 2023-09-21T13:14:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.331 INFO:teuthology.orchestra.run.smithi142.stdout: "drive_group_interval": { 2023-09-21T13:14:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "drive_group_interval", 2023-09-21T13:14:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.332 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300.0", 2023-09-21T13:14:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.333 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-21T13:14:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.334 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.335 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.336 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.337 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.338 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.339 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.340 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.341 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.342 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.343 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.344 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.345 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.346 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.347 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.348 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.349 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.350 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.351 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.352 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.353 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.354 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "storage_class": { 2023-09-21T13:14:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "storage_class", 2023-09-21T13:14:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.355 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "local", 2023-09-21T13:14:05.356 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-21T13:14:05.357 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.358 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.359 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "selftest", 2023-09-21T13:14:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.360 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.361 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.362 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.363 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.364 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.365 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.367 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.368 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.369 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.370 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.371 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.372 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.373 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.374 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.376 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.377 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.378 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.379 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.380 INFO:teuthology.orchestra.run.smithi142.stdout: "roption1": { 2023-09-21T13:14:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption1", 2023-09-21T13:14:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.381 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.382 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.383 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.384 INFO:teuthology.orchestra.run.smithi142.stdout: "roption2": { 2023-09-21T13:14:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption2", 2023-09-21T13:14:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.385 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "xyz", 2023-09-21T13:14:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.386 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.387 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption1": { 2023-09-21T13:14:05.388 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption1", 2023-09-21T13:14:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.390 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.391 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption2": { 2023-09-21T13:14:05.392 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption2", 2023-09-21T13:14:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.393 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.394 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.395 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption3": { 2023-09-21T13:14:05.396 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption3", 2023-09-21T13:14:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.397 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.398 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.399 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption4": { 2023-09-21T13:14:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption4", 2023-09-21T13:14:05.400 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.401 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.405 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.406 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption5": { 2023-09-21T13:14:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption5", 2023-09-21T13:14:05.407 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.408 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.409 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.410 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption6": { 2023-09-21T13:14:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption6", 2023-09-21T13:14:05.411 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.412 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.413 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.414 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption7": { 2023-09-21T13:14:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption7", 2023-09-21T13:14:05.415 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.416 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "42", 2023-09-21T13:14:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.417 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.418 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "testkey": { 2023-09-21T13:14:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testkey", 2023-09-21T13:14:05.419 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.420 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.421 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.422 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "testlkey": { 2023-09-21T13:14:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testlkey", 2023-09-21T13:14:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.423 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.424 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.425 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.426 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "testnewline": { 2023-09-21T13:14:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testnewline", 2023-09-21T13:14:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.427 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.428 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.429 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.430 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.431 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snap_schedule", 2023-09-21T13:14:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.432 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_m_granularity": { 2023-09-21T13:14:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_m_granularity", 2023-09-21T13:14:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.433 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.434 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow minute scheduled snapshots", 2023-09-21T13:14:05.435 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.436 INFO:teuthology.orchestra.run.smithi142.stdout: "dump_on_update": { 2023-09-21T13:14:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dump_on_update", 2023-09-21T13:14:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.437 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.438 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "dump database to debug log on update", 2023-09-21T13:14:05.439 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.440 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.441 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.442 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.443 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.444 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.445 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.446 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.447 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.448 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.449 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.450 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.451 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.452 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.453 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.454 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.455 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.456 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.457 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.458 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.459 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.460 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stats", 2023-09-21T13:14:05.461 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.462 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.464 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.465 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.466 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.467 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.468 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.469 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.470 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.471 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.472 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.473 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.474 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.475 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.476 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.477 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.478 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.479 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.480 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.481 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.482 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "status", 2023-09-21T13:14:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.483 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.484 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.485 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.486 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.487 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.488 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.489 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.490 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.491 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.492 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.493 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.493 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.493 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.494 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.495 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.496 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.497 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.498 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.499 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.500 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.501 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.502 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telegraf", 2023-09-21T13:14:05.504 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "address": { 2023-09-21T13:14:05.505 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "address", 2023-09-21T13:14:05.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.506 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-21T13:14:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.507 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.508 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:05.509 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.510 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15", 2023-09-21T13:14:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.511 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.512 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.513 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.514 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.515 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.516 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.517 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.518 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.519 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.520 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.521 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.522 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.524 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.525 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.526 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.527 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.528 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.529 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.530 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.531 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.532 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.533 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telemetry", 2023-09-21T13:14:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.534 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_basic": { 2023-09-21T13:14:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_basic", 2023-09-21T13:14:05.535 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.536 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-21T13:14:05.537 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_crash": { 2023-09-21T13:14:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_crash", 2023-09-21T13:14:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.539 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.540 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-21T13:14:05.541 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.542 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_device": { 2023-09-21T13:14:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_device", 2023-09-21T13:14:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.543 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.544 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.544 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.544 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.544 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.545 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.545 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-21T13:14:05.545 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.546 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.546 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.546 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.546 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_ident": { 2023-09-21T13:14:05.547 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_ident", 2023-09-21T13:14:05.547 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.547 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.548 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.548 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.548 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.548 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.549 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.549 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-21T13:14:05.549 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.549 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.550 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.550 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.550 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_perf": { 2023-09-21T13:14:05.551 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_perf", 2023-09-21T13:14:05.551 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.551 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.551 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.552 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.552 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.552 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.552 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.553 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-21T13:14:05.553 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.553 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.554 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.554 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.554 INFO:teuthology.orchestra.run.smithi142.stdout: "contact": { 2023-09-21T13:14:05.554 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "contact", 2023-09-21T13:14:05.555 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.555 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.556 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.556 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.556 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.556 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.557 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.557 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.557 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.558 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.558 INFO:teuthology.orchestra.run.smithi142.stdout: "description": { 2023-09-21T13:14:05.558 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "description", 2023-09-21T13:14:05.559 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.559 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.559 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.559 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.560 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.560 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.560 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.561 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.561 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.561 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.561 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.562 INFO:teuthology.orchestra.run.smithi142.stdout: "device_url": { 2023-09-21T13:14:05.562 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_url", 2023-09-21T13:14:05.563 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.563 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.563 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.563 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-21T13:14:05.564 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.564 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.564 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.564 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.565 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.565 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.565 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.566 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:05.566 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:05.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.567 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.567 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.567 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.568 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.568 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.568 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.568 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.569 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.569 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.569 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.570 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:05.570 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:05.570 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.570 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.571 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.571 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "24", 2023-09-21T13:14:05.571 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "8", 2023-09-21T13:14:05.571 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.572 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.572 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.572 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.573 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.573 INFO:teuthology.orchestra.run.smithi142.stdout: "last_opt_revision": { 2023-09-21T13:14:05.574 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "last_opt_revision", 2023-09-21T13:14:05.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.574 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.575 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1", 2023-09-21T13:14:05.575 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.575 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.576 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.576 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.576 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.576 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.577 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.577 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard": { 2023-09-21T13:14:05.577 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard", 2023-09-21T13:14:05.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.578 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.578 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.579 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.579 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.579 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.579 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.580 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.580 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.580 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.581 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard_description": { 2023-09-21T13:14:05.581 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard_description", 2023-09-21T13:14:05.581 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.582 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.582 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.582 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.582 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.583 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.583 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.583 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.584 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.584 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.585 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.585 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.586 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.586 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.586 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.586 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.587 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.588 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.589 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.590 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.591 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.592 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.593 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.594 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.595 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.596 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.597 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.598 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.599 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.600 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.601 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.602 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.603 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "organization": { 2023-09-21T13:14:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "organization", 2023-09-21T13:14:05.604 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.605 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.606 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.607 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "proxy": { 2023-09-21T13:14:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "proxy", 2023-09-21T13:14:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.608 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.609 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.610 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.614 INFO:teuthology.orchestra.run.smithi142.stdout: "url": { 2023-09-21T13:14:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url", 2023-09-21T13:14:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-21T13:14:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.616 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.618 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "test_orchestrator", 2023-09-21T13:14:05.619 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.620 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.621 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.622 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.623 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.624 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.625 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.626 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.627 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.628 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.629 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.630 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.631 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.632 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.633 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.634 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.635 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.636 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.637 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.638 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.639 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.640 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "volumes", 2023-09-21T13:14:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.641 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.642 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.643 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.644 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.645 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.646 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.649 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.650 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.651 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.653 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.654 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.655 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.656 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.657 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.658 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.659 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.660 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.661 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_clones": { 2023-09-21T13:14:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_clones", 2023-09-21T13:14:05.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.663 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4", 2023-09-21T13:14:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.664 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-21T13:14:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.665 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "snapshot_clone_delay": { 2023-09-21T13:14:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snapshot_clone_delay", 2023-09-21T13:14:05.666 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:05.667 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-21T13:14:05.668 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.669 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.670 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix", 2023-09-21T13:14:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.671 INFO:teuthology.orchestra.run.smithi142.stdout: "discovery_interval": { 2023-09-21T13:14:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "discovery_interval", 2023-09-21T13:14:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.672 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "100", 2023-09-21T13:14:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.673 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "identifier": { 2023-09-21T13:14:05.675 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "identifier", 2023-09-21T13:14:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.676 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.677 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.678 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:05.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:05.680 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.681 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.684 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.685 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.686 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.687 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.688 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.689 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.690 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.691 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.692 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.693 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.694 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.695 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.696 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.697 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.698 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.699 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.700 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.701 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.702 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_host": { 2023-09-21T13:14:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_host", 2023-09-21T13:14:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.703 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.704 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.705 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_port": { 2023-09-21T13:14:05.706 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_port", 2023-09-21T13:14:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.707 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10051", 2023-09-21T13:14:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.708 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.709 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_sender": { 2023-09-21T13:14:05.710 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_sender", 2023-09-21T13:14:05.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.711 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.711 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.711 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-21T13:14:05.712 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.712 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.712 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.713 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.713 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.713 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.713 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.714 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.715 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:05.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.715 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.715 INFO:teuthology.orchestra.run.smithi142.stdout: "gid": 25349, 2023-09-21T13:14:05.716 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "y", 2023-09-21T13:14:05.716 INFO:teuthology.orchestra.run.smithi142.stdout: "mgr_features": 4540138322906710015, 2023-09-21T13:14:05.716 INFO:teuthology.orchestra.run.smithi142.stdout: "available_modules": [ 2023-09-21T13:14:05.717 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.717 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "alerts", 2023-09-21T13:14:05.717 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.717 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.718 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.718 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:05.718 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:05.719 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.719 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.719 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.719 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:05.720 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.720 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.720 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.721 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How frequently to reexamine health status", 2023-09-21T13:14:05.721 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.721 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.721 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.722 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.722 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.722 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.723 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.723 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.723 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.723 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.724 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.724 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.724 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.724 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.725 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.725 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.725 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.725 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.726 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.726 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.726 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.727 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.727 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.728 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.728 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.728 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.729 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.729 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.730 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.730 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.730 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.730 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.731 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.731 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.732 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.732 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.732 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.732 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.733 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.733 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.733 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.733 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.734 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.734 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.734 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.735 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.735 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.735 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.735 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.736 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.736 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.736 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.737 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.737 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.737 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.738 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.738 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.738 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.739 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.739 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.739 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.740 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.740 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.740 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.740 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.741 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.741 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.741 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_destination": { 2023-09-21T13:14:05.742 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_destination", 2023-09-21T13:14:05.742 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.742 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.743 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.743 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.743 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.743 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.744 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.744 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email address to send alerts to", 2023-09-21T13:14:05.744 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.744 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.745 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.745 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.745 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_from_name": { 2023-09-21T13:14:05.746 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_from_name", 2023-09-21T13:14:05.746 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.746 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.747 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.747 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "Ceph", 2023-09-21T13:14:05.747 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.747 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.748 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.748 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email From: name", 2023-09-21T13:14:05.748 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.749 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.749 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.749 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_host": { 2023-09-21T13:14:05.750 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_host", 2023-09-21T13:14:05.750 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.750 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.751 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.751 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.751 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.751 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.752 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.752 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP server", 2023-09-21T13:14:05.752 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.752 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.753 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.753 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.753 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_password": { 2023-09-21T13:14:05.754 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_password", 2023-09-21T13:14:05.754 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.754 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.754 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.755 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.755 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.755 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.756 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.756 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Password to authenticate with", 2023-09-21T13:14:05.756 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.756 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.757 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.757 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.757 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_port": { 2023-09-21T13:14:05.757 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_port", 2023-09-21T13:14:05.758 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.758 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.758 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.759 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "465", 2023-09-21T13:14:05.759 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.759 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.759 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.760 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP port", 2023-09-21T13:14:05.760 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.760 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.760 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.761 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.761 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_sender": { 2023-09-21T13:14:05.761 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_sender", 2023-09-21T13:14:05.761 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.762 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.762 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.762 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.763 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.763 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.763 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.763 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP envelope sender", 2023-09-21T13:14:05.764 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.764 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.764 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.765 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_ssl": { 2023-09-21T13:14:05.765 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_ssl", 2023-09-21T13:14:05.765 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.766 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.766 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.766 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.767 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.767 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.767 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.767 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-21T13:14:05.768 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.768 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.768 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.769 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_user": { 2023-09-21T13:14:05.769 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_user", 2023-09-21T13:14:05.769 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.770 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.770 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.770 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.770 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.771 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.771 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.771 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "User to authenticate as", 2023-09-21T13:14:05.772 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.772 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.772 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.772 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.773 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.773 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.773 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.773 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "balancer", 2023-09-21T13:14:05.774 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.774 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.774 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.775 INFO:teuthology.orchestra.run.smithi142.stdout: "active": { 2023-09-21T13:14:05.775 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "active", 2023-09-21T13:14:05.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.775 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.776 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.776 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.776 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.777 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.777 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.777 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically balance PGs across cluster", 2023-09-21T13:14:05.777 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.778 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.778 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.779 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_time": { 2023-09-21T13:14:05.779 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_time", 2023-09-21T13:14:05.779 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.779 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.780 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.780 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0000", 2023-09-21T13:14:05.780 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.781 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.781 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.781 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "beginning time of day to automatically balance", 2023-09-21T13:14:05.781 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:05.782 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.782 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.782 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_weekday": { 2023-09-21T13:14:05.783 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_weekday", 2023-09-21T13:14:05.783 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:05.783 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.784 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.784 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:05.784 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:05.784 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:05.785 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.785 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-21T13:14:05.785 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:05.785 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.786 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.786 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.786 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_max_iterations": { 2023-09-21T13:14:05.787 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_max_iterations", 2023-09-21T13:14:05.787 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:05.787 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.788 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.788 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "25", 2023-09-21T13:14:05.788 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:05.788 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "250", 2023-09-21T13:14:05.789 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.789 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-21T13:14:05.789 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.789 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.790 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.790 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_metrics": { 2023-09-21T13:14:05.791 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_metrics", 2023-09-21T13:14:05.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.791 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.792 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "pgs,objects,bytes", 2023-09-21T13:14:05.792 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.792 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.793 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.793 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-21T13:14:05.793 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-21T13:14:05.793 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.794 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.794 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_step": { 2023-09-21T13:14:05.795 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_step", 2023-09-21T13:14:05.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.795 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.796 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.5", 2023-09-21T13:14:05.796 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0.001", 2023-09-21T13:14:05.796 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "0.999", 2023-09-21T13:14:05.797 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.797 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "aggressiveness of optimization", 2023-09-21T13:14:05.797 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-21T13:14:05.797 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.798 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.798 INFO:teuthology.orchestra.run.smithi142.stdout: "end_time": { 2023-09-21T13:14:05.799 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_time", 2023-09-21T13:14:05.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.799 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.799 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.800 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2359", 2023-09-21T13:14:05.800 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.800 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.801 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.801 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ending time of day to automatically balance", 2023-09-21T13:14:05.801 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:05.801 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.802 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.802 INFO:teuthology.orchestra.run.smithi142.stdout: "end_weekday": { 2023-09-21T13:14:05.803 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_weekday", 2023-09-21T13:14:05.803 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:05.803 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.803 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.804 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:05.804 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:05.804 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:05.805 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.805 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-21T13:14:05.805 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:05.805 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.806 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.806 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.807 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.807 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.807 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.808 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.808 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.808 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.808 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.809 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.809 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.809 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.810 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.810 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.810 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.810 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.811 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.811 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.811 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.812 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.812 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.812 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.813 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.813 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.814 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.814 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.814 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.814 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.815 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.815 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.815 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.815 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.816 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.816 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.817 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.817 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.817 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.818 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.818 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.818 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.819 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.819 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.819 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.819 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.820 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.820 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.820 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.821 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.821 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.821 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.821 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.822 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:05.822 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:05.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.823 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.823 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.824 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.824 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.824 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.825 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.825 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.825 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.825 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.826 INFO:teuthology.orchestra.run.smithi142.stdout: "min_score": { 2023-09-21T13:14:05.826 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_score", 2023-09-21T13:14:05.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.827 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.827 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.827 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:05.828 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.828 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.828 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.828 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-21T13:14:05.829 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.829 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.829 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.830 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:05.830 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:05.830 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.831 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.831 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.831 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "upmap", 2023-09-21T13:14:05.832 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.832 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.832 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.832 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-compat", 2023-09-21T13:14:05.833 INFO:teuthology.orchestra.run.smithi142.stdout: "none", 2023-09-21T13:14:05.833 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap" 2023-09-21T13:14:05.833 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.834 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Balancer mode", 2023-09-21T13:14:05.834 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.834 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.834 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.835 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_ids": { 2023-09-21T13:14:05.835 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_ids", 2023-09-21T13:14:05.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.836 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.836 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.836 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.837 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.837 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.837 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.837 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-21T13:14:05.838 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.838 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.838 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.839 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:05.839 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:05.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.840 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.840 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.840 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:05.841 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.841 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.841 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.841 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-21T13:14:05.842 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.842 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.842 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.843 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_deviation": { 2023-09-21T13:14:05.843 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_deviation", 2023-09-21T13:14:05.843 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.844 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.844 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.844 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:05.844 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:05.845 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.845 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.845 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-21T13:14:05.846 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-21T13:14:05.846 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.846 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.847 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_optimizations": { 2023-09-21T13:14:05.847 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_optimizations", 2023-09-21T13:14:05.847 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:05.848 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.848 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.848 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:05.848 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.849 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.849 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.849 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-21T13:14:05.849 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.850 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.850 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.850 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.851 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:05.851 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.851 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:05.852 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cephadm", 2023-09-21T13:14:05.852 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:05.852 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:05.852 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:05.853 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_down_multiplier": { 2023-09-21T13:14:05.853 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_down_multiplier", 2023-09-21T13:14:05.853 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.853 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.854 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:05.854 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.855 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.855 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.855 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-21T13:14:05.855 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.856 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.856 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.857 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_refresh_rate": { 2023-09-21T13:14:05.857 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_refresh_rate", 2023-09-21T13:14:05.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.857 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.858 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.858 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "20", 2023-09-21T13:14:05.858 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.859 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.859 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.859 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-21T13:14:05.859 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.860 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.860 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.860 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_starting_port": { 2023-09-21T13:14:05.861 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_starting_port", 2023-09-21T13:14:05.861 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:05.861 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.861 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.862 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4721", 2023-09-21T13:14:05.862 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.862 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.863 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.863 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-21T13:14:05.863 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.864 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.864 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.864 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_ptrace": { 2023-09-21T13:14:05.865 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_ptrace", 2023-09-21T13:14:05.865 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.865 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.866 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.866 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.866 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.867 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.867 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-21T13:14:05.867 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-21T13:14:05.867 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.868 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.868 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_interval": { 2023-09-21T13:14:05.868 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_interval", 2023-09-21T13:14:05.869 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.869 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.869 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.869 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:05.870 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.870 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.870 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.870 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-21T13:14:05.871 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.871 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.871 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.871 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.872 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_memory_target_ratio": { 2023-09-21T13:14:05.872 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_memory_target_ratio", 2023-09-21T13:14:05.872 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:05.872 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.873 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.873 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.7", 2023-09-21T13:14:05.873 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.874 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.874 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.874 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-21T13:14:05.874 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.875 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.875 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.875 INFO:teuthology.orchestra.run.smithi142.stdout: "cgroups_split": { 2023-09-21T13:14:05.876 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cgroups_split", 2023-09-21T13:14:05.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.876 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.877 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.877 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.877 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.877 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.878 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.878 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-21T13:14:05.878 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.878 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.879 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.879 INFO:teuthology.orchestra.run.smithi142.stdout: "config_checks_enabled": { 2023-09-21T13:14:05.880 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_checks_enabled", 2023-09-21T13:14:05.880 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.880 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.880 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.881 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.882 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-21T13:14:05.882 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.882 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: "config_dashboard": { 2023-09-21T13:14:05.883 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_dashboard", 2023-09-21T13:14:05.884 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.884 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.884 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.885 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.885 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.885 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.885 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.886 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-21T13:14:05.886 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.886 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.887 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.887 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_alertmanager": { 2023-09-21T13:14:05.887 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_alertmanager", 2023-09-21T13:14:05.888 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.888 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.888 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.889 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-21T13:14:05.889 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.889 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.889 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.890 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:05.890 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.890 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.891 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.891 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_base": { 2023-09-21T13:14:05.891 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_base", 2023-09-21T13:14:05.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.892 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.892 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.893 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-21T13:14:05.893 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.893 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.893 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.894 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Container image name, without the tag", 2023-09-21T13:14:05.894 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.894 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.894 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.895 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_elasticsearch": { 2023-09-21T13:14:05.895 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_elasticsearch", 2023-09-21T13:14:05.896 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.896 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.896 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-21T13:14:05.897 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.897 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.897 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.898 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "elasticsearch container image", 2023-09-21T13:14:05.898 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.898 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.898 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.899 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_grafana": { 2023-09-21T13:14:05.899 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_grafana", 2023-09-21T13:14:05.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.900 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.900 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.900 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-21T13:14:05.901 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.901 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.901 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.901 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:05.902 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.902 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.902 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.903 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.903 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_haproxy": { 2023-09-21T13:14:05.903 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_haproxy", 2023-09-21T13:14:05.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.904 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.904 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-21T13:14:05.904 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.905 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.905 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.905 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "HAproxy container image", 2023-09-21T13:14:05.906 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.906 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.906 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.907 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_agent": { 2023-09-21T13:14:05.907 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_agent", 2023-09-21T13:14:05.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.908 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.908 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.908 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-21T13:14:05.908 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.909 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.909 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.909 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger agent container image", 2023-09-21T13:14:05.909 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.910 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.910 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.911 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_collector": { 2023-09-21T13:14:05.911 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_collector", 2023-09-21T13:14:05.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.911 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.912 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.912 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-21T13:14:05.912 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.913 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.913 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.913 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger collector container image", 2023-09-21T13:14:05.913 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.914 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.914 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.914 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_query": { 2023-09-21T13:14:05.915 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_query", 2023-09-21T13:14:05.915 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.915 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.916 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.916 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-21T13:14:05.916 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.916 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.917 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.917 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger query container image", 2023-09-21T13:14:05.917 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.918 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.918 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.918 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_keepalived": { 2023-09-21T13:14:05.919 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_keepalived", 2023-09-21T13:14:05.919 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.919 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.920 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.920 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-21T13:14:05.920 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.920 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.921 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.921 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Keepalived container image", 2023-09-21T13:14:05.921 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.921 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.922 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.922 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_loki": { 2023-09-21T13:14:05.923 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_loki", 2023-09-21T13:14:05.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.923 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.924 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-21T13:14:05.924 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.924 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.924 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.925 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Loki container image", 2023-09-21T13:14:05.925 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.925 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.926 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.926 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_node_exporter": { 2023-09-21T13:14:05.926 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_node_exporter", 2023-09-21T13:14:05.927 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.927 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.928 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-21T13:14:05.928 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.928 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.928 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.929 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:05.929 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.929 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.930 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.930 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.930 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_nvmeof": { 2023-09-21T13:14:05.930 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_nvmeof", 2023-09-21T13:14:05.931 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.931 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.931 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.931 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-21T13:14:05.932 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.932 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.932 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.933 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Nvme-of container image", 2023-09-21T13:14:05.933 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.933 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.934 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.934 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.934 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_prometheus": { 2023-09-21T13:14:05.934 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_prometheus", 2023-09-21T13:14:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.935 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-21T13:14:05.936 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.936 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.936 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.937 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:05.937 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.937 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.937 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.938 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.938 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_promtail": { 2023-09-21T13:14:05.938 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_promtail", 2023-09-21T13:14:05.939 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.939 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.939 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.939 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-21T13:14:05.940 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.940 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.940 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.940 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Promtail container image", 2023-09-21T13:14:05.941 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.941 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.941 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.942 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.942 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_snmp_gateway": { 2023-09-21T13:14:05.942 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_snmp_gateway", 2023-09-21T13:14:05.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.943 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.943 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.943 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-21T13:14:05.944 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.944 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.944 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.944 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SNMP Gateway container image", 2023-09-21T13:14:05.945 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.945 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.946 INFO:teuthology.orchestra.run.smithi142.stdout: "container_init": { 2023-09-21T13:14:05.946 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_init", 2023-09-21T13:14:05.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.947 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.947 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.948 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.948 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.948 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.948 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Run podman/docker with `--init`", 2023-09-21T13:14:05.949 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.949 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.950 INFO:teuthology.orchestra.run.smithi142.stdout: "daemon_cache_timeout": { 2023-09-21T13:14:05.950 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "daemon_cache_timeout", 2023-09-21T13:14:05.950 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.951 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.951 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.951 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:05.951 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.952 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.952 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.952 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-21T13:14:05.953 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.953 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.953 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.954 INFO:teuthology.orchestra.run.smithi142.stdout: "default_cephadm_command_timeout": { 2023-09-21T13:14:05.954 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_cephadm_command_timeout", 2023-09-21T13:14:05.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.955 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.955 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.955 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "900", 2023-09-21T13:14:05.955 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.956 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.956 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.956 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-21T13:14:05.956 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.957 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.957 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.958 INFO:teuthology.orchestra.run.smithi142.stdout: "default_registry": { 2023-09-21T13:14:05.958 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_registry", 2023-09-21T13:14:05.958 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.958 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.959 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.959 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io", 2023-09-21T13:14:05.959 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.960 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.960 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.960 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-21T13:14:05.960 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.961 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.961 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.961 INFO:teuthology.orchestra.run.smithi142.stdout: "device_cache_timeout": { 2023-09-21T13:14:05.962 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_cache_timeout", 2023-09-21T13:14:05.962 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.962 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.963 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.963 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1800", 2023-09-21T13:14:05.963 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.963 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.964 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.964 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache device inventory", 2023-09-21T13:14:05.964 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.965 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.965 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.965 INFO:teuthology.orchestra.run.smithi142.stdout: "device_enhanced_scan": { 2023-09-21T13:14:05.966 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_enhanced_scan", 2023-09-21T13:14:05.966 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.966 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.967 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.967 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.967 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.968 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.968 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-21T13:14:05.968 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.969 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.969 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.969 INFO:teuthology.orchestra.run.smithi142.stdout: "facts_cache_timeout": { 2023-09-21T13:14:05.970 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "facts_cache_timeout", 2023-09-21T13:14:05.970 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.970 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.970 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.971 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:05.971 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.971 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.972 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.972 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache host facts data", 2023-09-21T13:14:05.972 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.972 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.973 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.973 INFO:teuthology.orchestra.run.smithi142.stdout: "host_check_interval": { 2023-09-21T13:14:05.973 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "host_check_interval", 2023-09-21T13:14:05.974 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:05.974 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.974 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.975 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.976 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to perform a host check", 2023-09-21T13:14:05.976 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.976 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.977 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.977 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.977 INFO:teuthology.orchestra.run.smithi142.stdout: "inventory_list_all": { 2023-09-21T13:14:05.977 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "inventory_list_all", 2023-09-21T13:14:05.978 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.978 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.979 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.979 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.979 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.980 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.980 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-21T13:14:05.980 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.980 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.981 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.981 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:05.982 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:05.982 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.982 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.982 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.983 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:05.983 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.983 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.984 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.984 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.984 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.984 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.985 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.985 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.985 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:05.986 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:05.986 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:05.986 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.987 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.987 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.987 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.987 INFO:teuthology.orchestra.run.smithi142.stdout: "log_refresh_metadata": { 2023-09-21T13:14:05.988 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_refresh_metadata", 2023-09-21T13:14:05.988 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.988 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.989 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.989 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:05.989 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.989 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.990 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.990 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-21T13:14:05.990 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.991 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.991 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.991 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:05.992 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:05.992 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:05.992 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.993 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:05.993 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:05.993 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.993 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.994 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:05.994 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-21T13:14:05.994 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:05.994 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:05.995 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:05.995 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:05.995 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:05.996 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:05.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:05.996 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:05.997 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:05.997 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:05.997 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:05.997 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:05.998 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:05.998 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:05.998 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:05.998 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:05.999 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:05.999 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:05.999 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.000 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.000 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.000 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.000 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.001 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.001 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.002 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.002 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.002 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.003 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.003 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.003 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.004 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.005 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.005 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-21T13:14:06.005 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-21T13:14:06.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.006 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.006 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.007 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.007 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.007 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.007 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.008 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-21T13:14:06.008 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.008 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.009 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.009 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-21T13:14:06.009 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-21T13:14:06.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.010 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.010 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.011 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "*", 2023-09-21T13:14:06.011 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.011 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.011 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.012 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-21T13:14:06.012 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.012 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.013 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.013 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.013 INFO:teuthology.orchestra.run.smithi142.stdout: "max_count_per_host": { 2023-09-21T13:14:06.013 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_count_per_host", 2023-09-21T13:14:06.014 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.014 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.014 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.015 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.015 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.015 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.015 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.016 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of daemons per service per host", 2023-09-21T13:14:06.016 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.017 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.017 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd_draining_count": { 2023-09-21T13:14:06.017 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_osd_draining_count", 2023-09-21T13:14:06.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.018 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.019 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.019 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.019 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.019 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.020 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-21T13:14:06.020 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.021 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.021 INFO:teuthology.orchestra.run.smithi142.stdout: "migration_current": { 2023-09-21T13:14:06.021 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "migration_current", 2023-09-21T13:14:06.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.022 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.023 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.023 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.023 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.023 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.024 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "internal - do not modify", 2023-09-21T13:14:06.024 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.024 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.025 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.025 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:06.025 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:06.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.026 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.027 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "root", 2023-09-21T13:14:06.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.027 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.027 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.028 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm-package", 2023-09-21T13:14:06.028 INFO:teuthology.orchestra.run.smithi142.stdout: "root" 2023-09-21T13:14:06.028 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.029 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "mode for remote execution of cephadm", 2023-09-21T13:14:06.029 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.029 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.029 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.030 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.030 INFO:teuthology.orchestra.run.smithi142.stdout: "prometheus_alerts_path": { 2023-09-21T13:14:06.030 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus_alerts_path", 2023-09-21T13:14:06.030 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.031 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.031 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.031 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-21T13:14:06.032 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.032 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.032 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.032 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-21T13:14:06.033 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.033 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.033 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.034 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_insecure": { 2023-09-21T13:14:06.034 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_insecure", 2023-09-21T13:14:06.034 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.035 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.035 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.035 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.035 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.036 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.036 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.036 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-21T13:14:06.037 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.037 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.037 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.037 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.038 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_password": { 2023-09-21T13:14:06.038 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_password", 2023-09-21T13:14:06.038 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.039 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.039 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.039 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.039 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.040 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.040 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.040 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-21T13:14:06.040 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.041 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.041 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.042 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_url": { 2023-09-21T13:14:06.042 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_url", 2023-09-21T13:14:06.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.042 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.043 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.043 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.043 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.044 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.044 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.044 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-21T13:14:06.044 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.045 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.045 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.045 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_username": { 2023-09-21T13:14:06.046 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_username", 2023-09-21T13:14:06.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.046 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.047 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.047 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.047 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.047 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.048 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.048 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-21T13:14:06.048 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.049 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.049 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.049 INFO:teuthology.orchestra.run.smithi142.stdout: "secure_monitoring_stack": { 2023-09-21T13:14:06.050 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "secure_monitoring_stack", 2023-09-21T13:14:06.050 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.050 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.051 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.051 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.051 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.051 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.052 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.052 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-21T13:14:06.052 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.052 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.053 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.053 INFO:teuthology.orchestra.run.smithi142.stdout: "service_discovery_port": { 2023-09-21T13:14:06.054 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "service_discovery_port", 2023-09-21T13:14:06.054 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.054 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.054 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.055 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8765", 2023-09-21T13:14:06.055 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.055 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.056 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.056 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "cephadm service discovery port", 2023-09-21T13:14:06.056 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.056 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.057 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.057 INFO:teuthology.orchestra.run.smithi142.stdout: "ssh_config_file": { 2023-09-21T13:14:06.058 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssh_config_file", 2023-09-21T13:14:06.058 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.058 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.058 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.059 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.059 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.059 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.060 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.060 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-21T13:14:06.060 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.060 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.061 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.061 INFO:teuthology.orchestra.run.smithi142.stdout: "use_agent": { 2023-09-21T13:14:06.062 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_agent", 2023-09-21T13:14:06.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.062 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.063 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.063 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.063 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.063 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.064 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-21T13:14:06.064 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.064 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.065 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.065 INFO:teuthology.orchestra.run.smithi142.stdout: "use_repo_digest": { 2023-09-21T13:14:06.065 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_repo_digest", 2023-09-21T13:14:06.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.066 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.066 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.067 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.067 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.067 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.067 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.068 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-21T13:14:06.068 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.069 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.069 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_failed_host_check": { 2023-09-21T13:14:06.069 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_failed_host_check", 2023-09-21T13:14:06.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.070 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.070 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.071 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.071 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.071 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.071 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.072 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if the host check fails", 2023-09-21T13:14:06.072 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.072 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.072 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.073 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_daemons": { 2023-09-21T13:14:06.073 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_daemons", 2023-09-21T13:14:06.074 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.074 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.074 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.074 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.075 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.075 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.075 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.076 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-21T13:14:06.076 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.076 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.076 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.077 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.077 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_hosts": { 2023-09-21T13:14:06.077 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_hosts", 2023-09-21T13:14:06.078 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.078 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.078 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.079 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.079 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.079 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.079 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.080 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-21T13:14:06.080 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.080 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.081 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.081 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.082 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.082 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crash", 2023-09-21T13:14:06.082 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.083 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.083 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.083 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.083 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.084 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.085 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.085 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.085 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.085 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.086 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.086 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.086 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.086 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.087 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.087 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.087 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.088 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.088 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.088 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.088 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.089 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.089 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.090 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.090 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.090 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.091 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.091 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.091 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.091 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.092 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.092 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.092 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.093 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.093 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.094 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.094 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.094 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.094 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.095 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.095 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.095 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.096 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.096 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.096 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.096 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.097 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.097 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.097 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.097 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.098 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.098 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.099 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.099 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.099 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.099 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.100 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.100 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.100 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.101 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.101 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.101 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.101 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.102 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.102 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.102 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.102 INFO:teuthology.orchestra.run.smithi142.stdout: "retain_interval": { 2023-09-21T13:14:06.103 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retain_interval", 2023-09-21T13:14:06.103 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.103 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.104 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.104 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "31536000", 2023-09-21T13:14:06.104 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.104 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.105 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.105 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-21T13:14:06.105 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.106 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.106 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.106 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_recent_interval": { 2023-09-21T13:14:06.107 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_recent_interval", 2023-09-21T13:14:06.107 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.107 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.108 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.108 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1209600", 2023-09-21T13:14:06.108 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.108 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.109 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.109 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-21T13:14:06.109 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.110 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.110 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.110 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.111 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.111 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dashboard", 2023-09-21T13:14:06.111 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.112 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.112 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.112 INFO:teuthology.orchestra.run.smithi142.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-21T13:14:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-21T13:14:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.113 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.114 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.115 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.116 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_HOST": { 2023-09-21T13:14:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-21T13:14:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.118 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-21T13:14:06.120 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-21T13:14:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.121 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.122 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.123 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_ENABLED": { 2023-09-21T13:14:06.124 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_ENABLED", 2023-09-21T13:14:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.125 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.126 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.127 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-21T13:14:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-21T13:14:06.128 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.129 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.129 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.130 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.131 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: "ENABLE_BROWSABLE_API": { 2023-09-21T13:14:06.132 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-21T13:14:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.133 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.134 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.135 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-21T13:14:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-21T13:14:06.136 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.137 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.138 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.139 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-21T13:14:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-21T13:14:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.140 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.141 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.142 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.143 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-21T13:14:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-21T13:14:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.144 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.145 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.146 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.147 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-21T13:14:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-21T13:14:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.148 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.149 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.150 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.151 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-21T13:14:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-21T13:14:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.152 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.153 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.154 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-21T13:14:06.155 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-21T13:14:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.156 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.157 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.158 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-21T13:14:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-21T13:14:06.159 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.160 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.161 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.162 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-21T13:14:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-21T13:14:06.163 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.164 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.165 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.166 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_PASSWORD": { 2023-09-21T13:14:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-21T13:14:06.167 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.168 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.169 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.170 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-21T13:14:06.171 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-21T13:14:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.172 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.173 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.174 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_URL": { 2023-09-21T13:14:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_URL", 2023-09-21T13:14:06.175 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.176 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.177 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.178 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_USERNAME": { 2023-09-21T13:14:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-21T13:14:06.179 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:06.180 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.181 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.182 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-21T13:14:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-21T13:14:06.183 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.184 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.185 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.186 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-21T13:14:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-21T13:14:06.187 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.188 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.189 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.190 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-21T13:14:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-21T13:14:06.191 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.192 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.193 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.194 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-21T13:14:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-21T13:14:06.195 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.196 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.197 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.198 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_HOST": { 2023-09-21T13:14:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-21T13:14:06.199 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.200 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.201 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-21T13:14:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-21T13:14:06.203 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.204 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.205 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.206 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-21T13:14:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-21T13:14:06.207 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.208 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.209 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.210 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-21T13:14:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-21T13:14:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.211 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.212 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.213 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-21T13:14:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-21T13:14:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.215 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.217 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-21T13:14:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-21T13:14:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.219 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.220 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.221 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-21T13:14:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-21T13:14:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.223 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.224 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.225 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.226 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-21T13:14:06.229 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-21T13:14:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.230 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.231 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.232 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.233 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.233 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.233 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-21T13:14:06.233 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-21T13:14:06.234 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.234 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.234 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.235 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.235 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.235 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.235 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.236 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.236 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.236 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.237 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.237 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.237 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_ENABLED": { 2023-09-21T13:14:06.237 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-21T13:14:06.238 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.238 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.239 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.239 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.239 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.240 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.240 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.240 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.240 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.241 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.241 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.241 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-21T13:14:06.241 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-21T13:14:06.242 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.242 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.242 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.243 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-21T13:14:06.243 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.243 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.243 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.244 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.244 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.244 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.245 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.245 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.245 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-21T13:14:06.245 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-21T13:14:06.246 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.246 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.246 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.247 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.247 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.247 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.247 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.248 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.248 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.248 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.248 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.249 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.249 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-21T13:14:06.249 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-21T13:14:06.250 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.250 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.250 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.250 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8", 2023-09-21T13:14:06.251 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.251 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.251 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.252 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.252 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.252 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.252 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.253 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.253 INFO:teuthology.orchestra.run.smithi142.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-21T13:14:06.253 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-21T13:14:06.253 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.254 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.254 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.254 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "45", 2023-09-21T13:14:06.255 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.255 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.255 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.255 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.256 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.256 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.256 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.257 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.257 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ACCESS_KEY": { 2023-09-21T13:14:06.257 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-21T13:14:06.257 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.258 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.258 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.258 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.259 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.259 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.259 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.259 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.260 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.260 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.260 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.261 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-21T13:14:06.261 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-21T13:14:06.261 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.262 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.262 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.262 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:06.262 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.263 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.263 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.263 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.264 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.264 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.264 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.264 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.265 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SECRET_KEY": { 2023-09-21T13:14:06.265 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-21T13:14:06.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.266 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.266 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.266 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.267 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.267 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.267 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.267 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.268 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.268 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.268 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.269 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.269 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SSL_VERIFY": { 2023-09-21T13:14:06.269 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-21T13:14:06.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.270 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.270 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.271 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.271 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.271 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.271 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.272 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.272 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.272 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.273 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-21T13:14:06.273 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-21T13:14:06.273 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.273 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.274 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:06.274 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.275 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.275 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.275 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.275 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.276 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.276 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.276 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.277 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-21T13:14:06.277 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-21T13:14:06.277 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.277 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.278 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.278 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.278 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.279 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.279 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.279 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.279 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.280 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-21T13:14:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-21T13:14:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.281 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.282 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.282 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:06.282 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.282 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.283 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.283 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.283 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.284 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.284 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.284 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.284 INFO:teuthology.orchestra.run.smithi142.stdout: "cross_origin_url": { 2023-09-21T13:14:06.285 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cross_origin_url", 2023-09-21T13:14:06.285 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.285 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.286 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.286 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.286 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.287 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.287 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.287 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.287 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.288 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.288 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.288 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.289 INFO:teuthology.orchestra.run.smithi142.stdout: "crt_file": { 2023-09-21T13:14:06.289 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crt_file", 2023-09-21T13:14:06.289 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.289 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.290 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.290 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.290 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.291 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.291 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.291 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.291 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.292 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.292 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.292 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.293 INFO:teuthology.orchestra.run.smithi142.stdout: "debug": { 2023-09-21T13:14:06.293 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "debug", 2023-09-21T13:14:06.293 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.293 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.294 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.294 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.294 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.295 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.295 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.295 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable/disable debug options", 2023-09-21T13:14:06.295 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.296 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.296 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.296 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.297 INFO:teuthology.orchestra.run.smithi142.stdout: "jwt_token_ttl": { 2023-09-21T13:14:06.297 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "jwt_token_ttl", 2023-09-21T13:14:06.297 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.297 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.298 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.298 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "28800", 2023-09-21T13:14:06.298 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.299 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.299 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.299 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.299 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.300 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.300 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.300 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.301 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:06.301 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:06.301 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.301 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.302 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.302 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.302 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.303 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.303 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.303 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.303 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.304 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.304 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.304 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.304 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.305 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.305 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.305 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.305 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.306 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.306 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.306 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.307 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.307 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.307 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.307 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.308 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.308 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.308 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.309 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.309 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.309 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.309 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.310 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.310 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.310 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.311 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.311 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.311 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.311 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.312 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.312 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.312 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.313 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.313 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.313 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.313 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.314 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.314 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.314 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.314 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.315 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.315 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.316 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.316 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.316 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.316 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.317 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.317 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.317 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.318 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.318 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.318 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.318 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.319 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.319 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.320 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.320 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.320 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.320 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.321 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.321 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.321 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.322 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.322 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.322 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.323 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.323 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.323 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.323 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.324 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.324 INFO:teuthology.orchestra.run.smithi142.stdout: "motd": { 2023-09-21T13:14:06.324 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "motd", 2023-09-21T13:14:06.325 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.325 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.325 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.325 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.326 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.326 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.326 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.327 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "The message of the day", 2023-09-21T13:14:06.327 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.327 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.327 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.328 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect_resolve_ip_addr": { 2023-09-21T13:14:06.328 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "redirect_resolve_ip_addr", 2023-09-21T13:14:06.328 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.329 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.329 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.329 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.330 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.330 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.330 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.330 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.331 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.331 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.331 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.332 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:06.332 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:06.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.333 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.333 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.333 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:06.334 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.334 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.334 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.334 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.335 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.335 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.335 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.336 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:06.336 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:06.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.337 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.337 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.337 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8080", 2023-09-21T13:14:06.338 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.338 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.338 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.338 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.339 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.339 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.339 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.339 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.340 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:06.340 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:06.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.341 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.341 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.341 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.342 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.342 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.342 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.342 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.343 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.343 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.343 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.344 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl_server_port": { 2023-09-21T13:14:06.344 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl_server_port", 2023-09-21T13:14:06.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.345 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.345 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8443", 2023-09-21T13:14:06.345 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.346 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.346 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.346 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.347 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.347 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.347 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.348 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:06.348 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:06.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.349 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.349 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "redirect", 2023-09-21T13:14:06.349 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.350 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.350 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.350 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.350 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect" 2023-09-21T13:14:06.351 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.351 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.351 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.352 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.352 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.352 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:06.353 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:06.353 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.353 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.354 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.354 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:06.354 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:06.354 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:06.355 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.355 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.355 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.356 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.356 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.356 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.356 INFO:teuthology.orchestra.run.smithi142.stdout: "url_prefix": { 2023-09-21T13:14:06.357 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url_prefix", 2023-09-21T13:14:06.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.357 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.357 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.358 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.358 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.358 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.359 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.359 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.359 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.359 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.360 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.360 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "devicehealth", 2023-09-21T13:14:06.361 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.362 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_monitoring": { 2023-09-21T13:14:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_monitoring", 2023-09-21T13:14:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.363 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.364 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "monitor device health metrics", 2023-09-21T13:14:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.365 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.366 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.367 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.368 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.369 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.370 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.371 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.372 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.373 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.374 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.375 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.376 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.377 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.378 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.379 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.380 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.381 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.382 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.383 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.384 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.385 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "mark_out_threshold": { 2023-09-21T13:14:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mark_out_threshold", 2023-09-21T13:14:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.386 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2419200", 2023-09-21T13:14:06.387 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-21T13:14:06.388 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.389 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": { 2023-09-21T13:14:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_name", 2023-09-21T13:14:06.390 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "device_health_metrics", 2023-09-21T13:14:06.391 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-21T13:14:06.392 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.393 INFO:teuthology.orchestra.run.smithi142.stdout: "retention_period": { 2023-09-21T13:14:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retention_period", 2023-09-21T13:14:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.394 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15552000", 2023-09-21T13:14:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.395 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain device health metrics", 2023-09-21T13:14:06.396 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.397 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_frequency": { 2023-09-21T13:14:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_frequency", 2023-09-21T13:14:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.398 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.399 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-21T13:14:06.400 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.401 INFO:teuthology.orchestra.run.smithi142.stdout: "self_heal": { 2023-09-21T13:14:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "self_heal", 2023-09-21T13:14:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.402 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.403 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-21T13:14:06.404 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.405 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.406 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.407 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and check device health", 2023-09-21T13:14:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.408 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_threshold": { 2023-09-21T13:14:06.409 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_threshold", 2023-09-21T13:14:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.410 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7257600", 2023-09-21T13:14:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.411 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-21T13:14:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.412 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.413 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "diskprediction_local", 2023-09-21T13:14:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.414 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.415 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.416 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.417 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.418 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.419 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.420 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.421 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.422 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.423 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.424 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.425 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.426 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.429 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.430 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.431 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.432 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.433 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.434 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.435 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.436 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "predict_interval": { 2023-09-21T13:14:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predict_interval", 2023-09-21T13:14:06.437 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.438 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.439 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.440 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "predictor_model": { 2023-09-21T13:14:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predictor_model", 2023-09-21T13:14:06.441 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.442 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "prophetstor", 2023-09-21T13:14:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.443 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.444 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:06.445 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.446 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.447 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.448 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.449 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "influx", 2023-09-21T13:14:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": false, 2023-09-21T13:14:06.450 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "influxdb python module not found", 2023-09-21T13:14:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "batch_size": { 2023-09-21T13:14:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "batch_size", 2023-09-21T13:14:06.451 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.452 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5000", 2023-09-21T13:14:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.453 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-21T13:14:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.454 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "database": { 2023-09-21T13:14:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "database", 2023-09-21T13:14:06.455 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "ceph", 2023-09-21T13:14:06.456 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-21T13:14:06.457 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.458 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": { 2023-09-21T13:14:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "hostname", 2023-09-21T13:14:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.459 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.460 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.460 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.460 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.460 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.461 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.461 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server hostname", 2023-09-21T13:14:06.461 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.462 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.462 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.462 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:06.463 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:06.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.463 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.464 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "30", 2023-09-21T13:14:06.464 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "5", 2023-09-21T13:14:06.464 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.465 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.465 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-21T13:14:06.465 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.465 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.466 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.466 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.467 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.467 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.468 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.468 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.468 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.469 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.469 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.469 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.470 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.470 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.470 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.470 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.471 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.471 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.471 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.471 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.472 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.472 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.473 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.473 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.473 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.474 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.474 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.474 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.475 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.475 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.475 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.476 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.476 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.476 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.477 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.477 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.478 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.478 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.478 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.478 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.479 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.479 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.479 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.480 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.480 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.480 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.480 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.481 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.481 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.481 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.482 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.482 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.482 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.483 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.483 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.483 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.484 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.484 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.484 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.484 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.485 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.485 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.485 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.485 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.486 INFO:teuthology.orchestra.run.smithi142.stdout: "password": { 2023-09-21T13:14:06.486 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "password", 2023-09-21T13:14:06.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.487 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.487 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.487 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.487 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.488 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.488 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.488 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "password of InfluxDB server user", 2023-09-21T13:14:06.489 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.489 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.489 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.489 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.490 INFO:teuthology.orchestra.run.smithi142.stdout: "port": { 2023-09-21T13:14:06.490 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "port", 2023-09-21T13:14:06.490 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.490 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.491 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.491 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8086", 2023-09-21T13:14:06.491 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.492 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.492 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.492 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server port", 2023-09-21T13:14:06.492 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.493 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.493 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.493 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.494 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:06.494 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:06.494 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.494 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.495 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.495 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "false", 2023-09-21T13:14:06.495 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.495 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.496 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.496 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:06.496 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.497 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.497 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.497 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.497 INFO:teuthology.orchestra.run.smithi142.stdout: "threads": { 2023-09-21T13:14:06.498 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threads", 2023-09-21T13:14:06.498 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.498 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.498 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.499 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:06.499 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:06.499 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "32", 2023-09-21T13:14:06.500 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.500 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-21T13:14:06.500 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.500 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.501 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.501 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.501 INFO:teuthology.orchestra.run.smithi142.stdout: "username": { 2023-09-21T13:14:06.501 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "username", 2023-09-21T13:14:06.502 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.502 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.502 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.503 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.503 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.503 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.503 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.504 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "username of InfluxDB server user", 2023-09-21T13:14:06.504 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.504 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: "verify_ssl": { 2023-09-21T13:14:06.505 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "verify_ssl", 2023-09-21T13:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.506 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "true", 2023-09-21T13:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.507 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:06.508 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.508 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.508 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.509 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.509 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.509 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.510 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "insights", 2023-09-21T13:14:06.510 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.510 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.511 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.511 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.511 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.511 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.512 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.512 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.512 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.513 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.513 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.513 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.514 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.514 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.514 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.514 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.515 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.515 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.515 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.515 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.516 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.516 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.517 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.517 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.517 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.518 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.518 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.518 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.519 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.519 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.519 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.519 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.520 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.520 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.521 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.521 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.521 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.521 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.522 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.522 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.522 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.523 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.523 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.523 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.523 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.524 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.524 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.524 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.525 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.525 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.525 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.525 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.526 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.526 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.527 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.527 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.527 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.528 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.528 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.528 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.529 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.529 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.529 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.530 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.530 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.530 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.530 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.531 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.531 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "iostat", 2023-09-21T13:14:06.531 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.532 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.532 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.532 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.533 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.534 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.535 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.536 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.536 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.536 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.536 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.537 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.537 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.537 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.538 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.538 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.538 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.538 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.539 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.539 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.539 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.540 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.540 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.540 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.541 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.541 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.541 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.541 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.542 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.542 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.542 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.542 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.543 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.543 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.543 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.544 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.544 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.544 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.544 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.545 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.545 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.545 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.545 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.546 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.546 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.546 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.547 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.547 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.547 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.548 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.548 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.548 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.549 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.549 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.549 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.550 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.550 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.550 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.550 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.551 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.551 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.551 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.552 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.552 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "k8sevents", 2023-09-21T13:14:06.553 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.553 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.553 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.553 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_event_retention_days": { 2023-09-21T13:14:06.554 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ceph_event_retention_days", 2023-09-21T13:14:06.554 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.554 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.555 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.555 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7", 2023-09-21T13:14:06.555 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.556 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.556 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.556 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-21T13:14:06.556 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.557 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.557 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.557 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.558 INFO:teuthology.orchestra.run.smithi142.stdout: "config_check_secs": { 2023-09-21T13:14:06.558 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_check_secs", 2023-09-21T13:14:06.558 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.558 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.559 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.559 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.559 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "10", 2023-09-21T13:14:06.560 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.560 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.560 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-21T13:14:06.560 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.561 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.561 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.561 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.561 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.562 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.562 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.563 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.564 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.564 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.564 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.564 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.565 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.565 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.565 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.566 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.566 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.566 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.566 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.567 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.567 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.567 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.567 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.568 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.568 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.569 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.569 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.569 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.569 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.570 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.570 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.570 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.571 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.571 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.571 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.571 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.572 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.572 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.572 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.573 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.573 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.573 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.573 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.574 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.574 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.574 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.574 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.575 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.575 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.575 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.576 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.576 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.576 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.576 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.577 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.577 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.578 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.579 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.579 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.579 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.579 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.580 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.580 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.580 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.581 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.582 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "localpool", 2023-09-21T13:14:06.582 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.582 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.582 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.583 INFO:teuthology.orchestra.run.smithi142.stdout: "failure_domain": { 2023-09-21T13:14:06.583 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "failure_domain", 2023-09-21T13:14:06.583 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.584 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.584 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.584 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "host", 2023-09-21T13:14:06.584 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.585 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.585 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.585 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "failure domain for any created local pool", 2023-09-21T13:14:06.585 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-21T13:14:06.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.586 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.586 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.590 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.590 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.590 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.591 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.591 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.591 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.591 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.592 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.592 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.592 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.593 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.593 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.593 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.593 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.594 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.594 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.594 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.595 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.595 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.595 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.596 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.596 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.597 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.597 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.597 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.597 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.598 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.598 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.598 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.598 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.599 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.600 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.600 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.600 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.601 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.601 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.602 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.602 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.602 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.603 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.603 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.603 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.604 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.604 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.604 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.604 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.605 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.605 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.605 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.606 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.606 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.606 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.606 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.607 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.607 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.607 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.608 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.608 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.608 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.609 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.609 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.609 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.609 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": { 2023-09-21T13:14:06.610 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_size", 2023-09-21T13:14:06.610 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.610 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.611 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.611 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.611 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.612 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.612 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default min_size for any created local pool", 2023-09-21T13:14:06.612 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-21T13:14:06.612 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.613 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.613 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.613 INFO:teuthology.orchestra.run.smithi142.stdout: "num_rep": { 2023-09-21T13:14:06.614 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "num_rep", 2023-09-21T13:14:06.614 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.614 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.614 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.615 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3", 2023-09-21T13:14:06.615 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.615 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.616 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.616 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default replica count for any created local pool", 2023-09-21T13:14:06.616 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.616 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.617 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.617 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.617 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": { 2023-09-21T13:14:06.617 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_num", 2023-09-21T13:14:06.618 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.618 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.618 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.619 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "128", 2023-09-21T13:14:06.619 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.619 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.619 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.620 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default pg_num for any created local pool", 2023-09-21T13:14:06.620 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.620 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.621 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.621 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.621 INFO:teuthology.orchestra.run.smithi142.stdout: "prefix": { 2023-09-21T13:14:06.621 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prefix", 2023-09-21T13:14:06.622 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.622 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.622 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.623 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.624 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name prefix for any created local pool", 2023-09-21T13:14:06.624 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.624 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.624 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.625 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.625 INFO:teuthology.orchestra.run.smithi142.stdout: "subtree": { 2023-09-21T13:14:06.625 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "subtree", 2023-09-21T13:14:06.626 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.626 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.626 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "rack", 2023-09-21T13:14:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.627 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-21T13:14:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-21T13:14:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.628 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.629 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.629 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.630 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.630 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mds_autoscaler", 2023-09-21T13:14:06.630 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.630 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.631 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.631 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.631 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.632 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.632 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.633 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.633 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.633 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.633 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.634 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.634 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.634 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.635 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.635 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.635 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.635 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.636 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.636 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.636 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.637 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.637 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.637 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.637 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.638 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.638 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.638 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.639 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.639 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.639 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.639 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.640 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.640 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.640 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.641 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.641 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.641 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.641 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.642 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.642 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.642 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.643 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.643 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.643 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.643 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.644 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.644 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.644 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.645 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.645 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.645 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.645 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.646 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.646 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.646 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.646 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.647 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.647 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.647 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.648 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.648 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.648 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.648 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.649 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.649 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.649 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.649 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.650 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.650 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.650 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.651 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.651 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.651 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirroring", 2023-09-21T13:14:06.652 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.652 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.652 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.653 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.653 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.653 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.653 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.654 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.654 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.654 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.655 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.655 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.655 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.655 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.656 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.656 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.656 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.657 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.657 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.657 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.657 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.658 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.658 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.658 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.659 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.659 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.659 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.659 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.660 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.660 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.660 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.660 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.661 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.661 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.661 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.662 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.662 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.662 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.662 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.663 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.663 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.663 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.664 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.664 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.664 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.664 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.665 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.665 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.665 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.666 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.666 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.666 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.667 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.667 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.667 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.668 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.668 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.668 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.668 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.669 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.669 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.669 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.670 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.670 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.670 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.671 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.671 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.671 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.671 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.672 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.672 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.672 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.672 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.673 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.673 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.673 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.674 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "nfs", 2023-09-21T13:14:06.674 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.674 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.674 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.675 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.676 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.676 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.676 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.676 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.677 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.677 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.677 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.678 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.678 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.678 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.678 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.679 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.679 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.679 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.680 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.680 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.680 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.681 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.681 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.681 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.681 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.682 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.682 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.682 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.683 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.683 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.683 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.683 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.684 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.684 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.684 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.685 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.685 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.685 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.685 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.686 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.687 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.687 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.687 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.687 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.688 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.688 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.688 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.689 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.689 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.689 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.689 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.690 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.690 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.691 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.691 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.691 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.692 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.692 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.692 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.692 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.693 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.693 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.693 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.694 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.694 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.695 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.695 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:06.695 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.696 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.696 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.696 INFO:teuthology.orchestra.run.smithi142.stdout: "fail_fs": { 2023-09-21T13:14:06.696 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "fail_fs", 2023-09-21T13:14:06.697 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.697 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.697 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.697 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.698 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.698 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.698 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.699 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-21T13:14:06.699 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.699 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.699 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.700 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.700 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.700 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.700 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.701 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.701 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.701 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.701 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.702 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.703 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.703 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.703 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.703 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.704 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.704 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.704 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.705 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.705 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.705 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.705 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.706 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.706 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.706 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.707 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.707 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.707 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.707 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.708 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.708 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.708 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.708 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.709 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.709 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.709 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.710 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.710 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.710 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.710 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.711 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.711 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.711 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.711 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.712 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.712 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.712 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.713 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.713 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.713 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.713 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.714 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.714 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.714 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.715 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.715 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.715 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.716 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.716 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.716 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.716 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.717 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.717 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.717 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.718 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.718 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.718 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.719 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.719 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator": { 2023-09-21T13:14:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:06.720 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.721 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.722 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm", 2023-09-21T13:14:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "rook", 2023-09-21T13:14:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: "test_orchestrator" 2023-09-21T13:14:06.723 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Orchestrator backend", 2023-09-21T13:14:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.724 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.725 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_perf_query", 2023-09-21T13:14:06.726 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.727 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.728 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.729 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.730 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.731 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.732 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.733 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.734 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.735 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.736 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.737 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.738 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.739 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.740 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.741 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.742 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.743 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.744 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.745 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.746 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_support", 2023-09-21T13:14:06.747 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.748 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.749 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.750 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.751 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.752 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.753 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.754 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.755 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.756 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.757 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.758 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.759 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.760 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.761 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.762 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.763 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.764 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.765 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.766 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.767 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.768 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_autoscaler", 2023-09-21T13:14:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.769 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.770 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.771 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.772 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.773 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.774 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.775 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.776 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.777 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.778 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.779 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.780 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.781 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.782 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.783 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.784 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.785 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.786 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.787 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.788 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "noautoscale": { 2023-09-21T13:14:06.789 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "noautoscale", 2023-09-21T13:14:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.790 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.791 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "global autoscale flag", 2023-09-21T13:14:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-21T13:14:06.792 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:06.793 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.794 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.795 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.796 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.797 INFO:teuthology.orchestra.run.smithi142.stdout: "threshold": { 2023-09-21T13:14:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threshold", 2023-09-21T13:14:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1.0", 2023-09-21T13:14:06.799 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "scaling threshold", 2023-09-21T13:14:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-21T13:14:06.800 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.801 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "progress", 2023-09-21T13:14:06.802 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_pg_recovery_event": { 2023-09-21T13:14:06.803 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_pg_recovery_event", 2023-09-21T13:14:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.804 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.805 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-21T13:14:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:06.807 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.808 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.809 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.810 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.812 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.813 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.814 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.815 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.816 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.818 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.819 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.821 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.822 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.823 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.824 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.825 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.827 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.828 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.829 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.830 INFO:teuthology.orchestra.run.smithi142.stdout: "max_completed_events": { 2023-09-21T13:14:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_completed_events", 2023-09-21T13:14:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.831 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "50", 2023-09-21T13:14:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.832 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "number of past completed events to remember", 2023-09-21T13:14:06.833 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.834 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.836 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long the module is going to sleep", 2023-09-21T13:14:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.837 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.838 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus", 2023-09-21T13:14:06.841 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: "cache": { 2023-09-21T13:14:06.842 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cache", 2023-09-21T13:14:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.843 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.844 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.845 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.846 INFO:teuthology.orchestra.run.smithi142.stdout: "exclude_perf_counters": { 2023-09-21T13:14:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "exclude_perf_counters", 2023-09-21T13:14:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.847 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.848 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-21T13:14:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-21T13:14:06.849 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.850 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.852 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.853 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.854 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.855 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.856 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.857 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.858 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.859 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.860 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.861 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.862 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.863 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.864 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.865 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.866 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.867 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.868 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools": { 2023-09-21T13:14:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools", 2023-09-21T13:14:06.870 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.871 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.872 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-21T13:14:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-21T13:14:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.874 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.875 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.875 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300", 2023-09-21T13:14:06.875 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.875 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.876 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.877 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_interval": { 2023-09-21T13:14:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_interval", 2023-09-21T13:14:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.878 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15.0", 2023-09-21T13:14:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.879 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.880 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.881 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.881 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:06.882 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:06.882 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.882 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.882 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.883 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:06.883 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.883 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-21T13:14:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.884 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.885 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.885 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.885 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:06.886 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:06.886 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.886 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "9283", 2023-09-21T13:14:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.887 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-21T13:14:06.888 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.889 INFO:teuthology.orchestra.run.smithi142.stdout: "stale_cache_strategy": { 2023-09-21T13:14:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stale_cache_strategy", 2023-09-21T13:14:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.890 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "log", 2023-09-21T13:14:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.891 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.892 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.893 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.894 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "default", 2023-09-21T13:14:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.895 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "default", 2023-09-21T13:14:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: "error" 2023-09-21T13:14:06.896 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.897 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:06.898 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.899 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:06.900 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.901 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_support", 2023-09-21T13:14:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.903 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.904 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.905 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.906 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.907 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.908 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.909 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.910 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.911 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.912 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.913 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.914 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.915 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.915 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.916 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.917 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.918 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.919 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.920 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.921 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.922 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.923 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_snap_create": { 2023-09-21T13:14:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_snap_create", 2023-09-21T13:14:06.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:06.925 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.926 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.928 INFO:teuthology.orchestra.run.smithi142.stdout: "mirror_snapshot_schedule": { 2023-09-21T13:14:06.928 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirror_snapshot_schedule", 2023-09-21T13:14:06.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.929 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.930 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.930 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.930 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "trash_purge_schedule": { 2023-09-21T13:14:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "trash_purge_schedule", 2023-09-21T13:14:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.932 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.933 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.934 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.935 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.936 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "restful", 2023-09-21T13:14:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.937 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_auth": { 2023-09-21T13:14:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_auth", 2023-09-21T13:14:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.938 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.939 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.940 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.941 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.942 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.943 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.944 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.945 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.946 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.947 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.948 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.949 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.950 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.951 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.952 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.953 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.954 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.955 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.956 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.957 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.958 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.959 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.960 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.961 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.962 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.963 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.965 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.966 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.967 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.968 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.968 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:06.969 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:06.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.969 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.970 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.970 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.970 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.970 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.971 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.972 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rgw", 2023-09-21T13:14:06.973 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.974 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.975 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.976 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.977 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.978 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.979 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:06.980 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.981 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.982 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.983 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:06.984 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.985 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:06.986 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:06.987 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:06.988 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:06.990 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:06.991 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.992 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.993 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:06.994 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rook", 2023-09-21T13:14:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:06.995 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "drive_group_interval": { 2023-09-21T13:14:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "drive_group_interval", 2023-09-21T13:14:06.996 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300.0", 2023-09-21T13:14:06.997 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:06.998 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-21T13:14:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:06.999 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.000 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.001 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.002 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.003 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.004 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.005 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.006 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.007 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.007 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.007 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.008 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.009 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.010 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.011 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.011 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.011 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.011 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.012 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.012 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.012 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.013 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.014 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.015 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.016 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.017 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.018 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.019 INFO:teuthology.orchestra.run.smithi142.stdout: "storage_class": { 2023-09-21T13:14:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "storage_class", 2023-09-21T13:14:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.020 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "local", 2023-09-21T13:14:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.021 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-21T13:14:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.022 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.023 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "selftest", 2023-09-21T13:14:07.024 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.025 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.027 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.028 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.029 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.030 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.031 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.032 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.033 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.034 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.035 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.036 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.037 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.038 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.039 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.040 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.041 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.042 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.043 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.044 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: "roption1": { 2023-09-21T13:14:07.045 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption1", 2023-09-21T13:14:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.046 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.049 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.050 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "roption2": { 2023-09-21T13:14:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption2", 2023-09-21T13:14:07.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "xyz", 2023-09-21T13:14:07.053 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.054 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption1": { 2023-09-21T13:14:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption1", 2023-09-21T13:14:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.056 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.057 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.058 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.059 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption2": { 2023-09-21T13:14:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption2", 2023-09-21T13:14:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.060 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.061 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.062 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.063 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption3": { 2023-09-21T13:14:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption3", 2023-09-21T13:14:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.065 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.066 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.067 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption4": { 2023-09-21T13:14:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption4", 2023-09-21T13:14:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.068 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.069 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.070 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption5": { 2023-09-21T13:14:07.071 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption5", 2023-09-21T13:14:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.073 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.074 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.075 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption6": { 2023-09-21T13:14:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption6", 2023-09-21T13:14:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.077 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.078 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption7": { 2023-09-21T13:14:07.079 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption7", 2023-09-21T13:14:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.080 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "42", 2023-09-21T13:14:07.081 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.082 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.082 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.082 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.082 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: "testkey": { 2023-09-21T13:14:07.083 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testkey", 2023-09-21T13:14:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.084 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.085 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.086 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "testlkey": { 2023-09-21T13:14:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testlkey", 2023-09-21T13:14:07.087 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.088 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.089 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.090 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "testnewline": { 2023-09-21T13:14:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testnewline", 2023-09-21T13:14:07.091 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.092 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.093 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.094 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.095 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snap_schedule", 2023-09-21T13:14:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.096 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_m_granularity": { 2023-09-21T13:14:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_m_granularity", 2023-09-21T13:14:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.097 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.098 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow minute scheduled snapshots", 2023-09-21T13:14:07.099 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.100 INFO:teuthology.orchestra.run.smithi142.stdout: "dump_on_update": { 2023-09-21T13:14:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dump_on_update", 2023-09-21T13:14:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.101 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.102 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "dump database to debug log on update", 2023-09-21T13:14:07.103 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.104 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.105 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.106 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.107 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.108 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.109 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.110 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.111 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.112 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.113 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.114 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.115 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.116 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.117 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.118 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.119 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.121 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.122 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.123 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.124 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stats", 2023-09-21T13:14:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.125 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.126 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.127 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.128 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.128 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.128 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.128 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.129 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.130 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.131 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.189 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.190 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.191 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.192 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.193 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.194 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.195 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.196 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.199 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.200 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.201 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.202 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "status", 2023-09-21T13:14:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.203 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.204 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.205 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.206 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.207 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.208 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.209 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.210 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.211 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.212 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.213 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.214 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.215 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.216 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.217 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.218 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.218 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.218 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.219 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.219 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.219 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.219 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.221 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.221 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.221 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.222 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.222 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.222 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.223 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.223 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.223 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.224 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.224 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.224 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.224 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.225 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.225 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.225 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.226 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telegraf", 2023-09-21T13:14:07.226 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.226 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: "address": { 2023-09-21T13:14:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "address", 2023-09-21T13:14:07.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.228 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.228 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-21T13:14:07.229 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.229 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.229 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.229 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.230 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.230 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.230 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.231 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.231 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:07.231 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:07.231 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.232 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.232 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.232 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15", 2023-09-21T13:14:07.233 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.233 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.233 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.234 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.234 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.234 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.234 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.235 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.235 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.235 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.236 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.236 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.236 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.237 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.237 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.237 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.238 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.238 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.239 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.239 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.240 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.240 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.240 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.240 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.241 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.241 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.241 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.242 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.242 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.243 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.244 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.244 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.244 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.245 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.245 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.245 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.245 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.246 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.246 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.249 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.249 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.250 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.250 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.253 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.254 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.254 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.254 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.255 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.255 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.255 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.256 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.256 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.256 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.256 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.257 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.257 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.257 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.258 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.258 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.259 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.259 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.259 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.260 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.260 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.260 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.260 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.261 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.261 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.261 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.262 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.262 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.262 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.262 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.263 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.263 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.263 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.264 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telemetry", 2023-09-21T13:14:07.264 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.264 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.264 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.265 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_basic": { 2023-09-21T13:14:07.265 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_basic", 2023-09-21T13:14:07.265 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.266 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.266 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.266 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.266 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.267 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.267 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.267 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-21T13:14:07.268 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.268 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.268 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.268 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.269 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_crash": { 2023-09-21T13:14:07.269 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_crash", 2023-09-21T13:14:07.269 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.270 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.270 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.270 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.270 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.271 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.271 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.271 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-21T13:14:07.272 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.272 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.272 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.272 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.273 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_device": { 2023-09-21T13:14:07.273 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_device", 2023-09-21T13:14:07.273 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.274 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.274 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.274 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.275 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.275 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.275 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.275 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-21T13:14:07.276 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.276 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.276 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.277 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_ident": { 2023-09-21T13:14:07.277 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_ident", 2023-09-21T13:14:07.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.278 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.278 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.279 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.279 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.279 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.280 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.280 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-21T13:14:07.280 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.281 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.281 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.281 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_perf": { 2023-09-21T13:14:07.282 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_perf", 2023-09-21T13:14:07.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.282 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.282 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.283 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.283 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.283 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.284 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.284 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-21T13:14:07.285 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.285 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.285 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.286 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.286 INFO:teuthology.orchestra.run.smithi142.stdout: "contact": { 2023-09-21T13:14:07.286 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "contact", 2023-09-21T13:14:07.286 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.287 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.287 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.287 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.288 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.288 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.288 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.289 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.289 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.289 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.290 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.290 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.290 INFO:teuthology.orchestra.run.smithi142.stdout: "description": { 2023-09-21T13:14:07.291 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "description", 2023-09-21T13:14:07.291 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.291 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.292 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.292 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.292 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.292 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.293 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.293 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.293 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.294 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.294 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.294 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.295 INFO:teuthology.orchestra.run.smithi142.stdout: "device_url": { 2023-09-21T13:14:07.295 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_url", 2023-09-21T13:14:07.295 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.295 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.296 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.296 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-21T13:14:07.296 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.297 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.297 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.297 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.297 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.298 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.298 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.299 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:07.299 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:07.299 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.300 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.300 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.300 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.300 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.301 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.301 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.301 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.302 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.302 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.302 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.303 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:07.303 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:07.303 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.304 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.304 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.304 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "24", 2023-09-21T13:14:07.305 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "8", 2023-09-21T13:14:07.305 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.305 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.306 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.306 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.306 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.306 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.307 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.307 INFO:teuthology.orchestra.run.smithi142.stdout: "last_opt_revision": { 2023-09-21T13:14:07.307 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "last_opt_revision", 2023-09-21T13:14:07.308 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.308 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.308 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.308 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1", 2023-09-21T13:14:07.309 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.309 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.309 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.310 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.310 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.310 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.311 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.311 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.311 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard": { 2023-09-21T13:14:07.311 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard", 2023-09-21T13:14:07.312 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.312 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.313 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.313 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.313 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.314 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.314 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.314 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.315 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.315 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.315 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.315 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.316 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard_description": { 2023-09-21T13:14:07.316 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard_description", 2023-09-21T13:14:07.316 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.316 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.317 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.317 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.317 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.318 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.318 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.318 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.319 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.319 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.319 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.319 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.320 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.320 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.320 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.320 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.321 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.321 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.321 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.322 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.322 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.322 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.322 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.323 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.324 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.324 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.324 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.325 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.325 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.325 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.326 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.326 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.326 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.327 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.327 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.327 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.327 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.328 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.328 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.328 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.328 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.329 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.329 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.329 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.330 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.330 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.330 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.330 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.331 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.331 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.331 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.332 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.332 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.332 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.332 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.333 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.333 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.333 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.333 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.334 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.334 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.334 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.335 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.335 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.335 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.336 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.336 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.336 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.336 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.337 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.337 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.337 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.338 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.338 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.338 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.338 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.339 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.339 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.339 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.340 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.340 INFO:teuthology.orchestra.run.smithi142.stdout: "organization": { 2023-09-21T13:14:07.340 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "organization", 2023-09-21T13:14:07.340 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.341 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.341 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.341 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.341 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.342 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.342 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.342 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.343 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.343 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.343 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.343 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.344 INFO:teuthology.orchestra.run.smithi142.stdout: "proxy": { 2023-09-21T13:14:07.344 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "proxy", 2023-09-21T13:14:07.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.345 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.345 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.345 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.346 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.346 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.346 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.347 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.347 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.347 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.348 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.348 INFO:teuthology.orchestra.run.smithi142.stdout: "url": { 2023-09-21T13:14:07.348 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url", 2023-09-21T13:14:07.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.349 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.349 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.349 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-21T13:14:07.349 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.350 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.350 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.350 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.351 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.351 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.351 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.351 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.352 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.352 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.352 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.353 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "test_orchestrator", 2023-09-21T13:14:07.353 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.353 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.353 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.354 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.354 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.355 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.355 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.355 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.356 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.356 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.357 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.357 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.357 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.357 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.358 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.358 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.358 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.359 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.360 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.360 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.360 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.360 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.361 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.361 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.361 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.361 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.362 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.362 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.362 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.363 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.363 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.363 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.363 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.364 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.364 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.364 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.365 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.365 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.365 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.365 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.366 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.366 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.366 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.367 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.367 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.367 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.367 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.368 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.368 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.368 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.369 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.369 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.369 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.369 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.370 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.370 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.371 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.371 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.371 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.372 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.372 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.372 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.373 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.373 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.373 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.373 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.374 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.374 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.375 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.375 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.375 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "volumes", 2023-09-21T13:14:07.376 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.376 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.376 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.377 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.377 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.377 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.378 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.378 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.378 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.378 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.379 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.379 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.379 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.380 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.380 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.380 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.380 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.381 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.381 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.381 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.381 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.382 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.382 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.383 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.383 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.383 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.383 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.384 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.384 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.384 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.385 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.385 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.385 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.385 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.386 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.386 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.387 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.387 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.387 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.388 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.388 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.388 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.388 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.389 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.389 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.389 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.390 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.390 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.390 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.391 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.391 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.391 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.391 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.392 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.392 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.392 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.392 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.393 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.393 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.394 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.394 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.394 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.395 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.395 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.395 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.396 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.396 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.396 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.396 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.397 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.397 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_clones": { 2023-09-21T13:14:07.397 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_clones", 2023-09-21T13:14:07.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.398 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.398 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.399 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4", 2023-09-21T13:14:07.399 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.399 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.399 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.400 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-21T13:14:07.400 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.400 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.401 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.401 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.401 INFO:teuthology.orchestra.run.smithi142.stdout: "snapshot_clone_delay": { 2023-09-21T13:14:07.401 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snapshot_clone_delay", 2023-09-21T13:14:07.402 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.402 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.402 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.403 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:07.403 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.403 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.404 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.404 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-21T13:14:07.404 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.404 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.405 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.405 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.406 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.406 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.406 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix", 2023-09-21T13:14:07.406 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.407 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.407 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.407 INFO:teuthology.orchestra.run.smithi142.stdout: "discovery_interval": { 2023-09-21T13:14:07.408 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "discovery_interval", 2023-09-21T13:14:07.408 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:07.408 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "100", 2023-09-21T13:14:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.409 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.410 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.410 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.410 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.411 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.411 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.411 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.411 INFO:teuthology.orchestra.run.smithi142.stdout: "identifier": { 2023-09-21T13:14:07.412 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "identifier", 2023-09-21T13:14:07.412 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.413 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.413 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.413 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.414 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.414 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.414 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.415 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.415 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.415 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.416 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.416 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.416 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:07.417 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:07.417 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.417 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.418 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:07.418 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.418 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.419 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.419 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.419 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.420 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.420 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.420 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.421 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.421 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.421 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.421 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.422 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.422 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.422 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.423 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.423 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.423 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.423 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.424 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.424 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.424 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.425 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.425 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.425 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.426 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.426 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.426 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.427 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.427 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.427 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.428 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.428 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.428 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.428 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.429 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.429 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.429 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.429 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.430 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.430 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.430 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.431 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.431 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.431 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.432 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.432 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.432 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.433 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.433 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.433 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.434 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.434 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.434 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.434 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.435 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.435 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.435 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.436 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.436 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.436 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.436 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.437 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.437 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.438 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.438 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.438 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.439 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.439 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.439 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.439 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.440 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.440 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.440 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.441 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.441 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_host": { 2023-09-21T13:14:07.441 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_host", 2023-09-21T13:14:07.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.442 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.442 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.443 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.443 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.443 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.443 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.444 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.444 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.444 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.444 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.445 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.445 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_port": { 2023-09-21T13:14:07.445 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_port", 2023-09-21T13:14:07.446 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.446 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.446 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.447 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10051", 2023-09-21T13:14:07.447 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.447 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.448 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.448 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.448 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.448 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.449 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.449 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.449 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_sender": { 2023-09-21T13:14:07.450 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_sender", 2023-09-21T13:14:07.450 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.450 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.451 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.451 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-21T13:14:07.451 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.452 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.452 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.452 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.452 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.453 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.453 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.453 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.454 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.457 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:07.457 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.457 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.458 INFO:teuthology.orchestra.run.smithi142.stdout: "modules": [ 2023-09-21T13:14:07.458 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm", 2023-09-21T13:14:07.458 INFO:teuthology.orchestra.run.smithi142.stdout: "dashboard", 2023-09-21T13:14:07.459 INFO:teuthology.orchestra.run.smithi142.stdout: "iostat", 2023-09-21T13:14:07.459 INFO:teuthology.orchestra.run.smithi142.stdout: "nfs", 2023-09-21T13:14:07.459 INFO:teuthology.orchestra.run.smithi142.stdout: "restful", 2023-09-21T13:14:07.459 INFO:teuthology.orchestra.run.smithi142.stdout: "snap_schedule" 2023-09-21T13:14:07.460 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.460 INFO:teuthology.orchestra.run.smithi142.stdout: "available_modules": [ 2023-09-21T13:14:07.460 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.461 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "alerts", 2023-09-21T13:14:07.461 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.461 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.461 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.462 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:07.462 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:07.462 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:07.463 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.464 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How frequently to reexamine health status", 2023-09-21T13:14:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.465 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.466 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.466 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.466 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.467 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.467 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.467 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.468 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.468 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.469 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.469 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.469 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.470 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.470 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.470 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.470 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.471 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.471 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.471 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.472 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.472 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.472 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.473 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.473 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.474 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.474 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.474 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.474 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.475 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.475 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.476 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.476 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.476 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.477 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.478 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.478 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.478 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.479 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.479 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.479 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.479 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.480 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.480 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.480 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.480 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.481 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.481 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.481 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.482 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.482 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.482 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.483 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.483 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.483 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.484 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.484 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.484 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.484 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.485 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.485 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.485 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.486 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.486 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.486 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.486 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_destination": { 2023-09-21T13:14:07.487 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_destination", 2023-09-21T13:14:07.487 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.487 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.488 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.488 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.488 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.489 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.489 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.489 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email address to send alerts to", 2023-09-21T13:14:07.489 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.490 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.490 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.490 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.491 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_from_name": { 2023-09-21T13:14:07.491 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_from_name", 2023-09-21T13:14:07.491 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.491 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.492 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "Ceph", 2023-09-21T13:14:07.492 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.493 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.493 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.493 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Email From: name", 2023-09-21T13:14:07.493 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.494 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.494 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.494 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.495 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_host": { 2023-09-21T13:14:07.495 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_host", 2023-09-21T13:14:07.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.495 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.496 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.496 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.496 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.497 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.497 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.497 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP server", 2023-09-21T13:14:07.498 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.498 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.498 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.498 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.499 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_password": { 2023-09-21T13:14:07.499 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_password", 2023-09-21T13:14:07.499 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.500 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.500 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.500 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.500 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.501 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.501 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.502 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Password to authenticate with", 2023-09-21T13:14:07.502 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.502 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.502 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.503 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.503 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_port": { 2023-09-21T13:14:07.503 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_port", 2023-09-21T13:14:07.504 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.504 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.504 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.504 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "465", 2023-09-21T13:14:07.505 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.505 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.505 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.506 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP port", 2023-09-21T13:14:07.506 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.506 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.507 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.507 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.507 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_sender": { 2023-09-21T13:14:07.507 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_sender", 2023-09-21T13:14:07.508 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.508 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.508 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.509 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.509 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.509 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.510 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SMTP envelope sender", 2023-09-21T13:14:07.510 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.510 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.511 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.511 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.511 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_ssl": { 2023-09-21T13:14:07.511 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_ssl", 2023-09-21T13:14:07.512 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.512 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.512 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.513 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.513 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.513 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.514 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.514 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-21T13:14:07.514 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.515 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.515 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.515 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.515 INFO:teuthology.orchestra.run.smithi142.stdout: "smtp_user": { 2023-09-21T13:14:07.516 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "smtp_user", 2023-09-21T13:14:07.516 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.516 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.517 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.517 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.517 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.518 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.518 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "User to authenticate as", 2023-09-21T13:14:07.518 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.519 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.519 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.519 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.520 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.520 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.520 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.521 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "balancer", 2023-09-21T13:14:07.521 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.521 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.522 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.522 INFO:teuthology.orchestra.run.smithi142.stdout: "active": { 2023-09-21T13:14:07.522 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "active", 2023-09-21T13:14:07.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.523 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.524 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.524 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.524 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.525 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.525 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.525 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically balance PGs across cluster", 2023-09-21T13:14:07.526 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.526 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.526 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.527 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.527 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_time": { 2023-09-21T13:14:07.527 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_time", 2023-09-21T13:14:07.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.528 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.528 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.528 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0000", 2023-09-21T13:14:07.529 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.529 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.529 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.530 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "beginning time of day to automatically balance", 2023-09-21T13:14:07.530 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:07.530 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.530 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.531 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.531 INFO:teuthology.orchestra.run.smithi142.stdout: "begin_weekday": { 2023-09-21T13:14:07.532 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "begin_weekday", 2023-09-21T13:14:07.532 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:07.532 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.532 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.533 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:07.533 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:07.533 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:07.534 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.534 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-21T13:14:07.534 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:07.535 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.535 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.535 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.535 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_max_iterations": { 2023-09-21T13:14:07.536 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_max_iterations", 2023-09-21T13:14:07.536 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:07.536 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.537 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.537 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "25", 2023-09-21T13:14:07.537 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:07.537 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "250", 2023-09-21T13:14:07.538 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.538 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-21T13:14:07.538 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.539 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.539 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.539 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.540 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_metrics": { 2023-09-21T13:14:07.540 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_metrics", 2023-09-21T13:14:07.540 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.540 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.541 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.541 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "pgs,objects,bytes", 2023-09-21T13:14:07.541 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.542 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.542 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.542 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-21T13:14:07.542 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-21T13:14:07.543 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.543 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.544 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.544 INFO:teuthology.orchestra.run.smithi142.stdout: "crush_compat_step": { 2023-09-21T13:14:07.544 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crush_compat_step", 2023-09-21T13:14:07.545 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:07.545 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.545 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.545 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.5", 2023-09-21T13:14:07.546 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0.001", 2023-09-21T13:14:07.546 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "0.999", 2023-09-21T13:14:07.546 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.547 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "aggressiveness of optimization", 2023-09-21T13:14:07.547 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-21T13:14:07.547 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.547 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.548 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.548 INFO:teuthology.orchestra.run.smithi142.stdout: "end_time": { 2023-09-21T13:14:07.548 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_time", 2023-09-21T13:14:07.549 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.549 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.549 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.549 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2359", 2023-09-21T13:14:07.550 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.550 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.550 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.551 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ending time of day to automatically balance", 2023-09-21T13:14:07.551 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-21T13:14:07.551 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.552 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.552 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.552 INFO:teuthology.orchestra.run.smithi142.stdout: "end_weekday": { 2023-09-21T13:14:07.552 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "end_weekday", 2023-09-21T13:14:07.553 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:07.553 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.553 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.553 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:07.554 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "0", 2023-09-21T13:14:07.554 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "6", 2023-09-21T13:14:07.554 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.555 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-21T13:14:07.555 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-21T13:14:07.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.555 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.556 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.556 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.556 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.557 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.557 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.557 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.558 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.558 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.558 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.559 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.559 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.559 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.559 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.560 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.560 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.560 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.561 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.561 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.561 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.562 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.562 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.562 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.562 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.563 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.563 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.563 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.564 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.564 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.564 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.564 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.565 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.565 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.565 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.566 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.566 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.566 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.567 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.567 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.567 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.567 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.568 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.568 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.568 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.569 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.569 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.569 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.569 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.570 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.570 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.570 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.571 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.571 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.572 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.572 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.572 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.573 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.573 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.573 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.573 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.574 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.574 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.574 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.575 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.575 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.575 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.576 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.576 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.576 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.577 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.577 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.577 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.578 INFO:teuthology.orchestra.run.smithi142.stdout: "min_score": { 2023-09-21T13:14:07.578 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_score", 2023-09-21T13:14:07.578 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:07.578 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.579 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.579 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:07.579 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.580 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.580 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.580 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-21T13:14:07.581 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.581 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.581 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.582 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.582 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:07.582 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:07.582 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.583 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.583 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.583 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "upmap", 2023-09-21T13:14:07.584 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.584 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.584 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.585 INFO:teuthology.orchestra.run.smithi142.stdout: "crush-compat", 2023-09-21T13:14:07.585 INFO:teuthology.orchestra.run.smithi142.stdout: "none", 2023-09-21T13:14:07.585 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap" 2023-09-21T13:14:07.585 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.586 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Balancer mode", 2023-09-21T13:14:07.586 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.586 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.586 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.587 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.587 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_ids": { 2023-09-21T13:14:07.587 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_ids", 2023-09-21T13:14:07.588 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.588 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.588 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.589 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.589 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.589 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.589 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.590 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-21T13:14:07.590 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.590 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.591 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.591 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.591 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:07.592 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:07.592 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.592 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.592 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.593 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:07.593 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.593 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.593 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.594 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-21T13:14:07.594 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.594 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.595 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.595 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.595 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_deviation": { 2023-09-21T13:14:07.596 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_deviation", 2023-09-21T13:14:07.596 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.596 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.597 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.597 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:07.597 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:07.597 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.598 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.598 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-21T13:14:07.598 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-21T13:14:07.599 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.599 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.599 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.600 INFO:teuthology.orchestra.run.smithi142.stdout: "upmap_max_optimizations": { 2023-09-21T13:14:07.600 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "upmap_max_optimizations", 2023-09-21T13:14:07.600 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:07.601 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.601 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.601 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:07.602 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.602 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.602 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.602 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-21T13:14:07.603 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.603 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.603 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.604 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.604 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.604 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.605 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cephadm", 2023-09-21T13:14:07.605 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.605 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.605 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.606 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_down_multiplier": { 2023-09-21T13:14:07.606 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_down_multiplier", 2023-09-21T13:14:07.607 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:07.607 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.607 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.607 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:07.608 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.608 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.608 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.609 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-21T13:14:07.609 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.609 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.610 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.610 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.610 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_refresh_rate": { 2023-09-21T13:14:07.610 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_refresh_rate", 2023-09-21T13:14:07.611 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.611 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.611 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.612 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "20", 2023-09-21T13:14:07.612 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.612 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.612 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.613 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-21T13:14:07.613 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.613 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.614 INFO:teuthology.orchestra.run.smithi142.stdout: "agent_starting_port": { 2023-09-21T13:14:07.615 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "agent_starting_port", 2023-09-21T13:14:07.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.615 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.616 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4721", 2023-09-21T13:14:07.616 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.616 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.617 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.617 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-21T13:14:07.617 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.618 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.618 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_ptrace": { 2023-09-21T13:14:07.619 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_ptrace", 2023-09-21T13:14:07.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.619 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.620 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.620 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.620 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-21T13:14:07.621 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-21T13:14:07.622 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.622 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.622 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.623 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_interval": { 2023-09-21T13:14:07.623 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_interval", 2023-09-21T13:14:07.623 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.624 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.624 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.624 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:07.624 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.625 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.625 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.625 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-21T13:14:07.625 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.626 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.626 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.626 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.627 INFO:teuthology.orchestra.run.smithi142.stdout: "autotune_memory_target_ratio": { 2023-09-21T13:14:07.627 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "autotune_memory_target_ratio", 2023-09-21T13:14:07.627 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:07.628 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.628 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.628 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0.7", 2023-09-21T13:14:07.628 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.629 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.629 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.629 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-21T13:14:07.629 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.630 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.630 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.630 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.631 INFO:teuthology.orchestra.run.smithi142.stdout: "cgroups_split": { 2023-09-21T13:14:07.631 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cgroups_split", 2023-09-21T13:14:07.631 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.632 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.632 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.632 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.632 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.633 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.633 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.633 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-21T13:14:07.634 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.634 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.634 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.635 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.635 INFO:teuthology.orchestra.run.smithi142.stdout: "config_checks_enabled": { 2023-09-21T13:14:07.635 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_checks_enabled", 2023-09-21T13:14:07.635 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.636 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.636 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.636 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.637 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.637 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.637 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.638 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-21T13:14:07.638 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.638 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.639 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.639 INFO:teuthology.orchestra.run.smithi142.stdout: "config_dashboard": { 2023-09-21T13:14:07.640 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_dashboard", 2023-09-21T13:14:07.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.640 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.640 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.641 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.641 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.641 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-21T13:14:07.642 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.643 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.643 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.644 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_alertmanager": { 2023-09-21T13:14:07.644 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_alertmanager", 2023-09-21T13:14:07.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.644 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.645 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.645 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-21T13:14:07.645 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.646 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.646 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.646 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:07.646 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.647 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.648 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_base": { 2023-09-21T13:14:07.648 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_base", 2023-09-21T13:14:07.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.648 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.649 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.649 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-21T13:14:07.649 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.649 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.650 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.650 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Container image name, without the tag", 2023-09-21T13:14:07.650 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.651 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_elasticsearch": { 2023-09-21T13:14:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_elasticsearch", 2023-09-21T13:14:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.652 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-21T13:14:07.653 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "elasticsearch container image", 2023-09-21T13:14:07.654 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.655 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_grafana": { 2023-09-21T13:14:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_grafana", 2023-09-21T13:14:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.656 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-21T13:14:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.657 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:07.658 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.659 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_haproxy": { 2023-09-21T13:14:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_haproxy", 2023-09-21T13:14:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.660 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-21T13:14:07.661 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.662 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.665 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "HAproxy container image", 2023-09-21T13:14:07.665 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.666 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.666 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.666 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.667 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_agent": { 2023-09-21T13:14:07.667 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_agent", 2023-09-21T13:14:07.667 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.668 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.668 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.668 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-21T13:14:07.668 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.669 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.669 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.669 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger agent container image", 2023-09-21T13:14:07.670 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.670 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.670 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.670 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.671 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_collector": { 2023-09-21T13:14:07.671 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_collector", 2023-09-21T13:14:07.671 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.672 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.672 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.672 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-21T13:14:07.672 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.673 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.673 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.673 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger collector container image", 2023-09-21T13:14:07.673 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.674 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.674 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.674 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.675 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_jaeger_query": { 2023-09-21T13:14:07.675 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_jaeger_query", 2023-09-21T13:14:07.675 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.676 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.676 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.676 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-21T13:14:07.676 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.677 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.677 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.677 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Jaeger query container image", 2023-09-21T13:14:07.678 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.678 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.678 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.678 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.679 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_keepalived": { 2023-09-21T13:14:07.679 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_keepalived", 2023-09-21T13:14:07.679 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.680 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.680 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.680 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-21T13:14:07.680 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.681 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.681 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.681 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Keepalived container image", 2023-09-21T13:14:07.682 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.682 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.682 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.682 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.683 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_loki": { 2023-09-21T13:14:07.683 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_loki", 2023-09-21T13:14:07.683 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.684 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.684 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.684 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-21T13:14:07.684 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.685 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.685 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.685 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Loki container image", 2023-09-21T13:14:07.686 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.686 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.686 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.686 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.687 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_node_exporter": { 2023-09-21T13:14:07.687 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_node_exporter", 2023-09-21T13:14:07.687 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.688 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.688 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.688 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-21T13:14:07.688 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.689 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.689 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.689 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:07.690 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.690 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.690 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.690 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.691 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_nvmeof": { 2023-09-21T13:14:07.691 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_nvmeof", 2023-09-21T13:14:07.691 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.692 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.692 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.692 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-21T13:14:07.692 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.693 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.693 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.693 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Nvme-of container image", 2023-09-21T13:14:07.694 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.694 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.694 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.694 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.695 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_prometheus": { 2023-09-21T13:14:07.695 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_prometheus", 2023-09-21T13:14:07.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.696 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.696 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-21T13:14:07.696 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.697 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.697 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.697 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Prometheus container image", 2023-09-21T13:14:07.698 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.698 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.698 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.699 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_promtail": { 2023-09-21T13:14:07.699 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_promtail", 2023-09-21T13:14:07.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-21T13:14:07.700 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.701 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.701 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.701 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Promtail container image", 2023-09-21T13:14:07.702 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.702 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.702 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.703 INFO:teuthology.orchestra.run.smithi142.stdout: "container_image_snmp_gateway": { 2023-09-21T13:14:07.703 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_image_snmp_gateway", 2023-09-21T13:14:07.703 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.704 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.704 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.704 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-21T13:14:07.704 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.705 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.705 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.705 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "SNMP Gateway container image", 2023-09-21T13:14:07.706 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.706 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.706 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.706 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.707 INFO:teuthology.orchestra.run.smithi142.stdout: "container_init": { 2023-09-21T13:14:07.707 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "container_init", 2023-09-21T13:14:07.707 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.708 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.708 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.708 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.708 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.709 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.709 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.709 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Run podman/docker with `--init`", 2023-09-21T13:14:07.710 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.710 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.710 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.710 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.711 INFO:teuthology.orchestra.run.smithi142.stdout: "daemon_cache_timeout": { 2023-09-21T13:14:07.711 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "daemon_cache_timeout", 2023-09-21T13:14:07.711 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.712 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.712 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.712 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:07.712 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.713 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.713 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.713 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-21T13:14:07.714 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.714 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.714 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.714 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.715 INFO:teuthology.orchestra.run.smithi142.stdout: "default_cephadm_command_timeout": { 2023-09-21T13:14:07.715 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_cephadm_command_timeout", 2023-09-21T13:14:07.715 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.716 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.716 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.716 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "900", 2023-09-21T13:14:07.717 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.717 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.717 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.718 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-21T13:14:07.718 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.718 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.718 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.719 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.719 INFO:teuthology.orchestra.run.smithi142.stdout: "default_registry": { 2023-09-21T13:14:07.719 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "default_registry", 2023-09-21T13:14:07.720 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.720 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.720 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.720 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "docker.io", 2023-09-21T13:14:07.721 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.721 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.721 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.722 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-21T13:14:07.722 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.722 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.723 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.723 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.723 INFO:teuthology.orchestra.run.smithi142.stdout: "device_cache_timeout": { 2023-09-21T13:14:07.723 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_cache_timeout", 2023-09-21T13:14:07.724 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.724 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.724 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.724 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1800", 2023-09-21T13:14:07.725 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.725 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.725 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.726 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache device inventory", 2023-09-21T13:14:07.726 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.726 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.726 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.727 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.727 INFO:teuthology.orchestra.run.smithi142.stdout: "device_enhanced_scan": { 2023-09-21T13:14:07.727 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_enhanced_scan", 2023-09-21T13:14:07.728 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.728 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.728 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.728 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.729 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.729 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.729 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.730 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-21T13:14:07.730 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.730 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.730 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.731 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.731 INFO:teuthology.orchestra.run.smithi142.stdout: "facts_cache_timeout": { 2023-09-21T13:14:07.731 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "facts_cache_timeout", 2023-09-21T13:14:07.732 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.732 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.732 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.732 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:07.733 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.733 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.733 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.734 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "seconds to cache host facts data", 2023-09-21T13:14:07.734 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.734 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.734 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.735 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.735 INFO:teuthology.orchestra.run.smithi142.stdout: "host_check_interval": { 2023-09-21T13:14:07.735 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "host_check_interval", 2023-09-21T13:14:07.736 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.736 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.736 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.736 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:07.737 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.737 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.737 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.738 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to perform a host check", 2023-09-21T13:14:07.738 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.738 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.738 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.739 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.739 INFO:teuthology.orchestra.run.smithi142.stdout: "inventory_list_all": { 2023-09-21T13:14:07.739 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "inventory_list_all", 2023-09-21T13:14:07.740 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.740 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.740 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.740 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.741 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.741 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.741 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.742 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-21T13:14:07.742 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.742 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.743 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.743 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.743 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.743 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.744 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.744 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.744 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.744 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.745 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.745 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.745 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.746 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.746 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.746 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.746 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.747 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.747 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.747 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.748 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.748 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.748 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.748 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.749 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.749 INFO:teuthology.orchestra.run.smithi142.stdout: "log_refresh_metadata": { 2023-09-21T13:14:07.749 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_refresh_metadata", 2023-09-21T13:14:07.749 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.750 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.750 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.750 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.751 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.751 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.751 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.751 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-21T13:14:07.752 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.752 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.752 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.752 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.753 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.753 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.753 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.754 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.754 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.754 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.755 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.755 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.755 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-21T13:14:07.755 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.756 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.756 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.757 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.757 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.757 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.757 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.758 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.758 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.758 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.759 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.759 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.759 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.759 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.760 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.760 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.760 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.761 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.761 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.761 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.761 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.762 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.762 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.762 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.763 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.763 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.763 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.764 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.764 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.764 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.764 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.765 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.765 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.765 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.766 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.766 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-21T13:14:07.766 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-21T13:14:07.767 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.767 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.767 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.768 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.768 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.768 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.769 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.769 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-21T13:14:07.769 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.769 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.770 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.770 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.770 INFO:teuthology.orchestra.run.smithi142.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-21T13:14:07.771 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-21T13:14:07.771 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.771 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.771 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.772 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "*", 2023-09-21T13:14:07.772 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.772 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.772 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.773 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-21T13:14:07.773 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.773 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.774 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.774 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.774 INFO:teuthology.orchestra.run.smithi142.stdout: "max_count_per_host": { 2023-09-21T13:14:07.774 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_count_per_host", 2023-09-21T13:14:07.775 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.775 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.775 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.775 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:07.776 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.776 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.776 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.777 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of daemons per service per host", 2023-09-21T13:14:07.777 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.777 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.777 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.778 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.778 INFO:teuthology.orchestra.run.smithi142.stdout: "max_osd_draining_count": { 2023-09-21T13:14:07.778 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_osd_draining_count", 2023-09-21T13:14:07.778 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.779 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.779 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.779 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:07.780 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.780 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.780 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.780 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-21T13:14:07.781 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.781 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.781 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.782 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.782 INFO:teuthology.orchestra.run.smithi142.stdout: "migration_current": { 2023-09-21T13:14:07.782 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "migration_current", 2023-09-21T13:14:07.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.783 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.783 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.783 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.784 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.784 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.784 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.784 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "internal - do not modify", 2023-09-21T13:14:07.785 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.785 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.785 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.785 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.786 INFO:teuthology.orchestra.run.smithi142.stdout: "mode": { 2023-09-21T13:14:07.786 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mode", 2023-09-21T13:14:07.786 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.787 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.787 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.787 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "root", 2023-09-21T13:14:07.787 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.788 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.788 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.788 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm-package", 2023-09-21T13:14:07.789 INFO:teuthology.orchestra.run.smithi142.stdout: "root" 2023-09-21T13:14:07.789 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.789 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "mode for remote execution of cephadm", 2023-09-21T13:14:07.789 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.790 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.790 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.790 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.790 INFO:teuthology.orchestra.run.smithi142.stdout: "prometheus_alerts_path": { 2023-09-21T13:14:07.791 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus_alerts_path", 2023-09-21T13:14:07.791 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.791 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.792 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-21T13:14:07.792 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.792 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.793 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.793 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-21T13:14:07.793 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.793 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.794 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.794 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.794 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_insecure": { 2023-09-21T13:14:07.795 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_insecure", 2023-09-21T13:14:07.795 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.795 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.795 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.796 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.796 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.796 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.797 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.797 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-21T13:14:07.797 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.797 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.798 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.798 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.798 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_password": { 2023-09-21T13:14:07.799 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_password", 2023-09-21T13:14:07.799 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.799 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.799 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.800 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.800 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.800 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.801 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.801 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-21T13:14:07.801 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.801 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.802 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.802 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.802 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_url": { 2023-09-21T13:14:07.803 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_url", 2023-09-21T13:14:07.803 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.803 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.804 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.804 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.804 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.805 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.805 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.805 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-21T13:14:07.805 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.806 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: "registry_username": { 2023-09-21T13:14:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "registry_username", 2023-09-21T13:14:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.807 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.808 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.808 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.808 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.808 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.809 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.809 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-21T13:14:07.809 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.809 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.810 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.810 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.810 INFO:teuthology.orchestra.run.smithi142.stdout: "secure_monitoring_stack": { 2023-09-21T13:14:07.811 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "secure_monitoring_stack", 2023-09-21T13:14:07.811 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.811 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.811 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.812 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.812 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.812 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.813 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.813 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-21T13:14:07.813 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.813 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.814 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.814 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.814 INFO:teuthology.orchestra.run.smithi142.stdout: "service_discovery_port": { 2023-09-21T13:14:07.815 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "service_discovery_port", 2023-09-21T13:14:07.815 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.815 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.815 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.816 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8765", 2023-09-21T13:14:07.816 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.816 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.817 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.817 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "cephadm service discovery port", 2023-09-21T13:14:07.817 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.817 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.818 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.818 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.818 INFO:teuthology.orchestra.run.smithi142.stdout: "ssh_config_file": { 2023-09-21T13:14:07.819 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssh_config_file", 2023-09-21T13:14:07.819 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.819 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.819 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.820 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.820 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.820 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.821 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.821 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-21T13:14:07.821 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.821 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.822 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.822 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.822 INFO:teuthology.orchestra.run.smithi142.stdout: "use_agent": { 2023-09-21T13:14:07.822 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_agent", 2023-09-21T13:14:07.823 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.823 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.823 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.824 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.824 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.824 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.824 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.825 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-21T13:14:07.825 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.825 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.826 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.826 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.826 INFO:teuthology.orchestra.run.smithi142.stdout: "use_repo_digest": { 2023-09-21T13:14:07.826 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "use_repo_digest", 2023-09-21T13:14:07.827 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.827 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.827 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.828 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.828 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.828 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.829 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.829 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-21T13:14:07.829 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.829 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.830 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.830 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.830 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_failed_host_check": { 2023-09-21T13:14:07.831 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_failed_host_check", 2023-09-21T13:14:07.831 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.831 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.831 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.832 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.832 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.832 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.833 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.833 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if the host check fails", 2023-09-21T13:14:07.833 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.833 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.834 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.834 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.834 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_daemons": { 2023-09-21T13:14:07.835 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_daemons", 2023-09-21T13:14:07.835 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.835 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.835 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.836 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.836 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.836 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.837 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.837 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-21T13:14:07.837 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.837 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.838 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.838 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.838 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_on_stray_hosts": { 2023-09-21T13:14:07.838 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_on_stray_hosts", 2023-09-21T13:14:07.839 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.839 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.839 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.840 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.840 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.840 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.840 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.841 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-21T13:14:07.841 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.841 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.841 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.842 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.842 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.843 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.843 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crash", 2023-09-21T13:14:07.843 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.843 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.844 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.844 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:07.844 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:07.845 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.845 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.845 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.845 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.846 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.846 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.846 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.846 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.847 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.847 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.847 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.848 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.848 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.848 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.848 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.849 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.849 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.849 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.849 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.850 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:07.850 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:07.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.851 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.851 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.851 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.852 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.852 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.852 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.853 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.853 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.853 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.854 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.854 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:07.854 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:07.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.855 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.855 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.855 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:07.855 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.856 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.856 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:07.856 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:07.857 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:07.857 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:07.857 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:07.857 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:07.858 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:07.858 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:07.858 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.859 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.859 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.859 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.859 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.860 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:07.860 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:07.860 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.861 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.861 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.861 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.861 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.862 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.862 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.862 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.863 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.863 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.863 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.864 INFO:teuthology.orchestra.run.smithi142.stdout: "retain_interval": { 2023-09-21T13:14:07.864 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retain_interval", 2023-09-21T13:14:07.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.864 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.865 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.865 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "31536000", 2023-09-21T13:14:07.865 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.866 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.866 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.866 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-21T13:14:07.866 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.869 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.869 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.869 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.870 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_recent_interval": { 2023-09-21T13:14:07.870 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_recent_interval", 2023-09-21T13:14:07.870 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:07.870 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.871 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:07.871 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1209600", 2023-09-21T13:14:07.871 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.872 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.872 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.872 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-21T13:14:07.872 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.873 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.873 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.873 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.874 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:07.874 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.874 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:07.874 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dashboard", 2023-09-21T13:14:07.875 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:07.875 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:07.875 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:07.875 INFO:teuthology.orchestra.run.smithi142.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-21T13:14:07.876 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-21T13:14:07.876 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:07.876 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.877 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.877 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:07.877 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.877 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.878 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.878 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.878 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.879 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.879 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.879 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.879 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_HOST": { 2023-09-21T13:14:07.880 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-21T13:14:07.880 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.880 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.880 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.881 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.881 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.881 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.881 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.882 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.882 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.882 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.883 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.883 INFO:teuthology.orchestra.run.smithi142.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-21T13:14:07.883 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-21T13:14:07.884 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.884 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.884 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.885 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.885 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.885 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.885 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.886 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.886 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.886 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.887 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.887 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.887 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_ENABLED": { 2023-09-21T13:14:07.887 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_ENABLED", 2023-09-21T13:14:07.888 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.888 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.888 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.888 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.889 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.889 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.889 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.890 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.890 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.890 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.890 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.891 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.891 INFO:teuthology.orchestra.run.smithi142.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-21T13:14:07.891 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-21T13:14:07.892 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.892 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.892 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.892 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.893 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.893 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.893 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.893 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.894 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.894 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.894 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.895 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.895 INFO:teuthology.orchestra.run.smithi142.stdout: "ENABLE_BROWSABLE_API": { 2023-09-21T13:14:07.895 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-21T13:14:07.895 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.896 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.896 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.896 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.897 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.897 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.897 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.897 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.898 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.898 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.898 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.899 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.899 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-21T13:14:07.899 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-21T13:14:07.899 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.900 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.900 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.900 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.900 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.901 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.901 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.901 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.902 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.902 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.902 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.902 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.903 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-21T13:14:07.903 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-21T13:14:07.903 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.903 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.904 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.904 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.904 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.905 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.905 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.905 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.905 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.906 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.906 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.906 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.907 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-21T13:14:07.907 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-21T13:14:07.907 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.907 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.908 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.908 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.908 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.908 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.909 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.909 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.909 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.910 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.910 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.910 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.910 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-21T13:14:07.911 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-21T13:14:07.911 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.911 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.911 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.912 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.912 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.912 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.913 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.913 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.913 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.913 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.914 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.914 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.914 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-21T13:14:07.915 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-21T13:14:07.915 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.915 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.915 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.916 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.916 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.916 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.916 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.917 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.917 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.917 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.918 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.918 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.918 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-21T13:14:07.918 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-21T13:14:07.919 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.919 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.919 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.920 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.920 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.920 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.920 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.921 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.921 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.921 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.921 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.922 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.922 INFO:teuthology.orchestra.run.smithi142.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-21T13:14:07.922 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-21T13:14:07.923 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.923 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.923 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.923 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.924 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.924 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.924 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.924 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.925 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.925 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.925 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-21T13:14:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-21T13:14:07.926 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.927 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.928 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.929 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_PASSWORD": { 2023-09-21T13:14:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-21T13:14:07.930 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:07.931 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.932 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.933 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-21T13:14:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-21T13:14:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.934 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.935 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.936 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.937 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.938 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_URL": { 2023-09-21T13:14:07.938 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_URL", 2023-09-21T13:14:07.938 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.939 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.939 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.939 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.939 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.940 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.940 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.940 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.940 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.941 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_API_USERNAME": { 2023-09-21T13:14:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-21T13:14:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.942 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:07.943 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.944 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.945 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-21T13:14:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-21T13:14:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.946 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.947 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.948 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.949 INFO:teuthology.orchestra.run.smithi142.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-21T13:14:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-21T13:14:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.950 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.951 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.952 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.953 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.953 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.953 INFO:teuthology.orchestra.run.smithi142.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-21T13:14:07.953 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-21T13:14:07.954 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.954 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.954 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.955 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.955 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.955 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.955 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.956 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.956 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.956 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.956 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.957 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.957 INFO:teuthology.orchestra.run.smithi142.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-21T13:14:07.957 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-21T13:14:07.958 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.958 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.958 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.958 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.959 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.959 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.959 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.959 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.960 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.960 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.960 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_HOST": { 2023-09-21T13:14:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-21T13:14:07.961 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.962 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.963 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.964 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-21T13:14:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-21T13:14:07.965 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.966 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.966 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.966 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.966 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.967 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.967 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.967 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.968 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.968 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.968 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.968 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.969 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-21T13:14:07.969 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-21T13:14:07.969 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.970 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.970 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.970 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.970 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.971 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.971 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.971 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.972 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.972 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.972 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.972 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.973 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-21T13:14:07.973 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-21T13:14:07.973 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.974 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.974 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.974 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.974 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.975 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.975 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.975 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.975 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.976 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.976 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.976 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.977 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-21T13:14:07.977 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-21T13:14:07.977 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.977 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.978 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.978 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.978 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.979 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.979 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.979 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.979 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.980 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.980 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.980 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.981 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-21T13:14:07.981 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-21T13:14:07.981 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.981 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.982 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.982 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.982 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.983 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.983 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.983 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.983 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.984 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.984 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.985 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-21T13:14:07.985 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-21T13:14:07.985 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.985 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.986 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.986 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.986 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.987 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.987 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.987 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.987 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.988 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.988 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.988 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.988 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-21T13:14:07.989 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-21T13:14:07.989 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.989 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.990 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.990 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.990 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.990 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.991 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.991 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.991 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.991 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.992 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.992 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.992 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-21T13:14:07.993 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-21T13:14:07.993 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.993 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.993 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.994 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:07.994 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.994 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.995 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.995 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.995 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.995 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:07.996 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:07.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:07.996 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_ENABLED": { 2023-09-21T13:14:07.997 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-21T13:14:07.997 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:07.997 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:07.997 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:07.998 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:07.998 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:07.998 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:07.998 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:07.999 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:07.999 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:07.999 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.000 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.000 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-21T13:14:08.000 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-21T13:14:08.001 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.001 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.001 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.002 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-21T13:14:08.002 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.002 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.003 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.003 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.003 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.003 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.004 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.004 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-21T13:14:08.004 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-21T13:14:08.005 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.005 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.005 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.006 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:08.006 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.006 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.006 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.007 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.007 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.008 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.008 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.008 INFO:teuthology.orchestra.run.smithi142.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-21T13:14:08.008 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-21T13:14:08.009 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.009 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.010 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8", 2023-09-21T13:14:08.010 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.010 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.010 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.011 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.011 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.011 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.012 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.012 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.012 INFO:teuthology.orchestra.run.smithi142.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-21T13:14:08.012 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-21T13:14:08.013 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.013 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.013 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.014 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "45", 2023-09-21T13:14:08.014 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.014 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.014 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.015 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.015 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.015 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.016 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.016 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.016 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ACCESS_KEY": { 2023-09-21T13:14:08.017 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-21T13:14:08.017 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.017 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.017 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.018 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.018 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.018 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.019 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.019 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.019 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.019 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.020 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.020 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.020 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-21T13:14:08.021 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-21T13:14:08.021 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.021 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.021 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.022 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "admin", 2023-09-21T13:14:08.022 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.022 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.023 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.023 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.023 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.023 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.024 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.024 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SECRET_KEY": { 2023-09-21T13:14:08.025 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-21T13:14:08.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.025 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.025 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.026 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.026 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.026 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.026 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.027 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.027 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.027 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.028 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.028 INFO:teuthology.orchestra.run.smithi142.stdout: "RGW_API_SSL_VERIFY": { 2023-09-21T13:14:08.028 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-21T13:14:08.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.029 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.029 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.029 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.030 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.030 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.030 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.031 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.031 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.031 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.031 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.032 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.032 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-21T13:14:08.032 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-21T13:14:08.032 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.033 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.033 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.033 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:08.034 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.034 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.034 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.034 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.035 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.035 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.035 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.036 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.036 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-21T13:14:08.036 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-21T13:14:08.036 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.037 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.037 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.037 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:08.037 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.038 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.038 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.038 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.039 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.039 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.039 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.040 INFO:teuthology.orchestra.run.smithi142.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-21T13:14:08.040 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-21T13:14:08.040 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.041 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.041 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:08.041 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.042 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.042 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.042 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.043 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.043 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.043 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.044 INFO:teuthology.orchestra.run.smithi142.stdout: "cross_origin_url": { 2023-09-21T13:14:08.044 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cross_origin_url", 2023-09-21T13:14:08.044 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.045 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.045 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.045 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.045 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.046 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.046 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.046 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.047 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.047 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.047 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.048 INFO:teuthology.orchestra.run.smithi142.stdout: "crt_file": { 2023-09-21T13:14:08.048 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "crt_file", 2023-09-21T13:14:08.048 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.049 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.049 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.049 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.049 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.050 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.050 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.050 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.050 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.051 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.051 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.052 INFO:teuthology.orchestra.run.smithi142.stdout: "debug": { 2023-09-21T13:14:08.052 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "debug", 2023-09-21T13:14:08.052 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.052 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.053 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.053 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.053 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.054 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.054 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.054 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Enable/disable debug options", 2023-09-21T13:14:08.054 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.055 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.055 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.055 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.055 INFO:teuthology.orchestra.run.smithi142.stdout: "jwt_token_ttl": { 2023-09-21T13:14:08.056 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "jwt_token_ttl", 2023-09-21T13:14:08.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.056 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.057 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.057 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "28800", 2023-09-21T13:14:08.057 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.057 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.058 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.058 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.058 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.059 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.059 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.059 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:08.060 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:08.060 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.060 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.060 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.061 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.061 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.061 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.062 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.062 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.062 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.062 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.063 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.063 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.063 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.064 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.065 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.066 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.066 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.066 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.067 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.067 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.067 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.067 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.068 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.068 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.068 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.068 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.069 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.069 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.070 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.070 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.073 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.073 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.073 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.074 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.074 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.074 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.075 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.075 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.075 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.076 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.076 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.076 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.077 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.077 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.077 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.077 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.078 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.078 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.078 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.078 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.079 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.079 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.079 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.080 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.080 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.080 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.080 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.081 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.081 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.081 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.082 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.082 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.082 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.083 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.083 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.083 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.083 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.084 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.084 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.084 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.085 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.085 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.085 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.085 INFO:teuthology.orchestra.run.smithi142.stdout: "motd": { 2023-09-21T13:14:08.086 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "motd", 2023-09-21T13:14:08.086 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.086 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.087 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.087 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.087 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.088 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.088 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.088 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "The message of the day", 2023-09-21T13:14:08.088 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.089 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.089 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.090 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect_resolve_ip_addr": { 2023-09-21T13:14:08.090 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "redirect_resolve_ip_addr", 2023-09-21T13:14:08.090 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.090 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.091 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.091 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.091 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.092 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.092 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.092 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.092 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.093 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.093 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.093 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:08.094 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:08.094 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.094 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.095 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.095 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:08.095 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.096 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.096 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.096 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.096 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.097 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.097 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.098 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:08.098 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:08.098 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.098 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.099 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.099 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8080", 2023-09-21T13:14:08.099 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.100 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.100 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.100 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.100 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.101 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.101 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.102 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:08.102 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:08.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.102 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.103 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.103 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.104 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.104 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.104 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.104 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.105 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.105 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.105 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl_server_port": { 2023-09-21T13:14:08.106 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl_server_port", 2023-09-21T13:14:08.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.106 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.107 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.107 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8443", 2023-09-21T13:14:08.107 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.107 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.108 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.108 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.108 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.109 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.109 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.109 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.109 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:08.110 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:08.110 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.110 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.111 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.111 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "redirect", 2023-09-21T13:14:08.111 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.111 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.112 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.112 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.112 INFO:teuthology.orchestra.run.smithi142.stdout: "redirect" 2023-09-21T13:14:08.113 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.113 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.113 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.113 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.114 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.114 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:08.115 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:08.115 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.115 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.115 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.116 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:08.116 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:08.116 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:08.117 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.117 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.117 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.117 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.118 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.118 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.118 INFO:teuthology.orchestra.run.smithi142.stdout: "url_prefix": { 2023-09-21T13:14:08.119 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url_prefix", 2023-09-21T13:14:08.119 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.119 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.119 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.120 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.120 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.120 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.121 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.121 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.121 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.121 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.122 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.122 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.123 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.123 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "devicehealth", 2023-09-21T13:14:08.123 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.124 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.124 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.124 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_monitoring": { 2023-09-21T13:14:08.124 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_monitoring", 2023-09-21T13:14:08.125 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.125 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.125 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.126 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.126 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.126 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.127 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.127 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "monitor device health metrics", 2023-09-21T13:14:08.127 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.127 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.128 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.128 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.129 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.129 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.129 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.129 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.130 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.130 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.130 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.131 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.131 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.131 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.131 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.132 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.132 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.132 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.133 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.133 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.133 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.133 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.134 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.134 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.135 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.135 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.135 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.135 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.136 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.136 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.136 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.136 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.137 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.137 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.137 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.138 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.138 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.138 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.138 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.139 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.139 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.139 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.140 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.140 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.140 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.140 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.141 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.141 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.141 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.142 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.142 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.142 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.142 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.143 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.143 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.143 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.144 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.144 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.144 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.144 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.145 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.145 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.145 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.146 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.146 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.146 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.146 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.147 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.147 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.147 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.147 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.148 INFO:teuthology.orchestra.run.smithi142.stdout: "mark_out_threshold": { 2023-09-21T13:14:08.148 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mark_out_threshold", 2023-09-21T13:14:08.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.149 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.149 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.149 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "2419200", 2023-09-21T13:14:08.150 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.150 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.150 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.151 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-21T13:14:08.151 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.151 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.151 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.152 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.152 INFO:teuthology.orchestra.run.smithi142.stdout: "pool_name": { 2023-09-21T13:14:08.152 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pool_name", 2023-09-21T13:14:08.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.153 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.153 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.153 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "device_health_metrics", 2023-09-21T13:14:08.154 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.154 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.154 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.154 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-21T13:14:08.155 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.155 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.155 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.156 INFO:teuthology.orchestra.run.smithi142.stdout: "retention_period": { 2023-09-21T13:14:08.156 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "retention_period", 2023-09-21T13:14:08.156 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.157 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.157 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.157 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15552000", 2023-09-21T13:14:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.158 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long to retain device health metrics", 2023-09-21T13:14:08.159 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.159 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.159 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.160 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.160 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_frequency": { 2023-09-21T13:14:08.160 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_frequency", 2023-09-21T13:14:08.160 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.161 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.161 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.161 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:08.162 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.162 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.162 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.162 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-21T13:14:08.163 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.163 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.163 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.164 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.164 INFO:teuthology.orchestra.run.smithi142.stdout: "self_heal": { 2023-09-21T13:14:08.164 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "self_heal", 2023-09-21T13:14:08.165 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.165 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.165 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.165 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.166 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.166 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.166 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.167 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-21T13:14:08.167 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.167 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.167 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.168 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.168 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:08.168 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:08.168 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.169 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.169 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.169 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:08.170 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.170 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.170 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.170 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how frequently to wake up and check device health", 2023-09-21T13:14:08.171 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.171 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.171 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.172 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.172 INFO:teuthology.orchestra.run.smithi142.stdout: "warn_threshold": { 2023-09-21T13:14:08.172 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "warn_threshold", 2023-09-21T13:14:08.172 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.173 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.173 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.173 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7257600", 2023-09-21T13:14:08.173 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.174 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.174 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.174 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-21T13:14:08.175 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.175 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.175 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.175 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.176 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.176 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.176 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.177 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "diskprediction_local", 2023-09-21T13:14:08.177 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.177 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.177 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.178 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.178 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.178 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.179 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.179 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.179 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.179 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.180 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.180 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.180 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.180 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.181 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.181 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.181 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.182 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.182 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.182 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.182 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.183 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.183 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.183 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.184 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.184 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.184 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.184 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.185 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.185 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.185 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.185 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.186 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.186 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.186 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.187 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.187 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.187 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.187 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.188 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.188 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.188 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.188 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.189 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.189 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.189 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.190 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.190 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.190 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.190 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.191 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.191 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.191 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.192 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.192 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.192 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.192 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.193 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.193 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.193 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.193 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.194 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.195 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.196 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.196 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.196 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.197 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.197 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.197 INFO:teuthology.orchestra.run.smithi142.stdout: "predict_interval": { 2023-09-21T13:14:08.198 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predict_interval", 2023-09-21T13:14:08.198 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.198 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.198 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.199 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "86400", 2023-09-21T13:14:08.199 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.199 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.199 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.200 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.200 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.200 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.201 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.201 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.201 INFO:teuthology.orchestra.run.smithi142.stdout: "predictor_model": { 2023-09-21T13:14:08.201 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "predictor_model", 2023-09-21T13:14:08.202 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.202 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.202 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.203 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "prophetstor", 2023-09-21T13:14:08.203 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.203 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.203 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.204 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.204 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.204 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.204 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.205 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.205 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:08.205 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:08.206 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.206 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.206 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.206 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "600", 2023-09-21T13:14:08.207 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.207 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.207 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.207 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.208 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.208 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.208 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.209 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.209 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.209 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.210 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "influx", 2023-09-21T13:14:08.210 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": false, 2023-09-21T13:14:08.210 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "influxdb python module not found", 2023-09-21T13:14:08.211 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.211 INFO:teuthology.orchestra.run.smithi142.stdout: "batch_size": { 2023-09-21T13:14:08.211 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "batch_size", 2023-09-21T13:14:08.211 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.212 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.212 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.212 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5000", 2023-09-21T13:14:08.212 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.213 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.213 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.213 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-21T13:14:08.214 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.214 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.214 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.214 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.215 INFO:teuthology.orchestra.run.smithi142.stdout: "database": { 2023-09-21T13:14:08.215 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "database", 2023-09-21T13:14:08.215 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.216 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.216 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.216 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "ceph", 2023-09-21T13:14:08.216 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.217 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.217 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.217 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-21T13:14:08.218 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.218 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.218 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.218 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.219 INFO:teuthology.orchestra.run.smithi142.stdout: "hostname": { 2023-09-21T13:14:08.219 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "hostname", 2023-09-21T13:14:08.219 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.220 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.220 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.220 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.220 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.221 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.221 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.221 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server hostname", 2023-09-21T13:14:08.221 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.222 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.222 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.222 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.223 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:08.223 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:08.223 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.223 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.224 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.224 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "30", 2023-09-21T13:14:08.224 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "5", 2023-09-21T13:14:08.225 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.225 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.225 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-21T13:14:08.225 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.226 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.226 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.226 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.227 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.227 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.227 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.227 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.228 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.228 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.228 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.229 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.229 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.229 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.229 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.230 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.230 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.230 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.231 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.231 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.231 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.231 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.232 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.232 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.232 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.233 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.233 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.233 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.233 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.234 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.234 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.234 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.235 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.235 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.235 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.235 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.236 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.237 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.238 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.239 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.239 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.239 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.240 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.241 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.241 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.241 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.242 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.242 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.242 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.242 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.243 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.243 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.243 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.243 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.244 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.244 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.244 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.245 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.245 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.245 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.245 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.246 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.246 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.246 INFO:teuthology.orchestra.run.smithi142.stdout: "password": { 2023-09-21T13:14:08.247 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "password", 2023-09-21T13:14:08.247 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.247 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.247 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.248 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.248 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.248 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.248 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.249 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "password of InfluxDB server user", 2023-09-21T13:14:08.249 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.249 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.250 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.250 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.250 INFO:teuthology.orchestra.run.smithi142.stdout: "port": { 2023-09-21T13:14:08.250 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "port", 2023-09-21T13:14:08.251 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.251 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.251 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.252 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "8086", 2023-09-21T13:14:08.252 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.252 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.252 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.253 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "InfluxDB server port", 2023-09-21T13:14:08.253 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.253 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.253 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.254 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.254 INFO:teuthology.orchestra.run.smithi142.stdout: "ssl": { 2023-09-21T13:14:08.254 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ssl", 2023-09-21T13:14:08.255 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.255 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.255 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.255 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "false", 2023-09-21T13:14:08.256 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.256 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.256 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.257 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:08.257 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.257 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.257 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.258 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.258 INFO:teuthology.orchestra.run.smithi142.stdout: "threads": { 2023-09-21T13:14:08.258 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threads", 2023-09-21T13:14:08.258 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.259 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.259 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.259 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:08.260 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:08.260 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "32", 2023-09-21T13:14:08.260 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.260 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-21T13:14:08.261 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.261 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.261 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.261 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.262 INFO:teuthology.orchestra.run.smithi142.stdout: "username": { 2023-09-21T13:14:08.262 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "username", 2023-09-21T13:14:08.262 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.263 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.263 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.263 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.263 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.264 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.264 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.264 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "username of InfluxDB server user", 2023-09-21T13:14:08.264 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.265 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.265 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.265 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.266 INFO:teuthology.orchestra.run.smithi142.stdout: "verify_ssl": { 2023-09-21T13:14:08.266 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "verify_ssl", 2023-09-21T13:14:08.266 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.266 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.267 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.267 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "true", 2023-09-21T13:14:08.267 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.268 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.268 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.268 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-21T13:14:08.268 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.269 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.270 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.270 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.270 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "insights", 2023-09-21T13:14:08.271 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.271 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.271 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.271 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.272 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.272 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.272 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.272 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.273 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.273 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.273 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.274 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.274 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.274 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.274 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.275 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.275 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.275 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.275 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.276 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.276 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.276 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.277 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.278 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.278 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.279 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.279 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.279 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.279 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.280 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.280 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.280 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.281 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.281 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.281 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.281 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.282 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.282 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.282 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.282 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.283 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.283 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.283 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.284 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.284 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.284 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.284 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.285 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.285 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.285 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.285 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.286 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.286 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.286 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.287 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.287 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.287 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.287 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.288 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.288 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.288 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.288 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.289 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.289 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.289 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.290 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.290 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.290 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.290 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.291 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.291 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.292 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.292 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "iostat", 2023-09-21T13:14:08.292 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.292 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.293 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.293 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.293 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.293 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.294 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.294 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.294 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.295 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.295 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.295 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.295 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.296 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.296 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.296 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.296 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.297 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.297 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.297 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.298 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.298 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.298 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.298 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.299 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.299 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.299 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.300 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.300 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.300 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.300 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.301 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.301 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.301 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.301 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.302 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.302 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.302 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.302 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.303 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.303 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.303 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.304 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.304 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.304 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.304 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.305 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.305 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.305 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.306 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.306 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.306 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.306 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.307 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.307 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.307 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.307 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.308 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.308 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.308 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.309 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.309 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.309 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.309 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.310 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.310 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.310 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.310 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.311 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.311 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.311 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.312 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.312 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.313 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.313 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.313 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "k8sevents", 2023-09-21T13:14:08.314 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.314 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.314 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.314 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_event_retention_days": { 2023-09-21T13:14:08.315 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "ceph_event_retention_days", 2023-09-21T13:14:08.315 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.315 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.316 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.316 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "7", 2023-09-21T13:14:08.316 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.316 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.317 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.317 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-21T13:14:08.317 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.318 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.318 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.318 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.318 INFO:teuthology.orchestra.run.smithi142.stdout: "config_check_secs": { 2023-09-21T13:14:08.319 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "config_check_secs", 2023-09-21T13:14:08.319 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.319 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.319 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.320 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:08.320 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "10", 2023-09-21T13:14:08.320 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.321 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.321 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-21T13:14:08.321 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.321 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.322 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.322 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.322 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.323 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.323 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.323 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.323 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.324 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.324 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.324 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.324 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.325 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.325 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.325 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.326 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.326 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.326 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.326 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.327 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.327 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.327 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.327 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.328 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.328 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.328 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.329 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.329 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.329 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.329 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.330 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.330 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.330 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.330 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.331 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.331 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.331 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.332 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.332 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.332 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.332 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.333 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.333 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.333 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.333 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.334 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.334 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.334 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.335 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.335 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.335 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.335 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.336 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.336 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.336 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.336 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.337 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.338 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.339 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.340 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.341 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.342 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "localpool", 2023-09-21T13:14:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.343 INFO:teuthology.orchestra.run.smithi142.stdout: "failure_domain": { 2023-09-21T13:14:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "failure_domain", 2023-09-21T13:14:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.344 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "host", 2023-09-21T13:14:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.345 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "failure domain for any created local pool", 2023-09-21T13:14:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-21T13:14:08.346 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.347 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.348 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.349 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.350 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.351 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.352 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.353 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.354 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.355 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.356 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.357 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.358 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.359 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.360 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.361 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.362 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.363 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.364 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.365 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.366 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "min_size": { 2023-09-21T13:14:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "min_size", 2023-09-21T13:14:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.367 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.368 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default min_size for any created local pool", 2023-09-21T13:14:08.369 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-21T13:14:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.370 INFO:teuthology.orchestra.run.smithi142.stdout: "num_rep": { 2023-09-21T13:14:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "num_rep", 2023-09-21T13:14:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.371 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3", 2023-09-21T13:14:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.372 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default replica count for any created local pool", 2023-09-21T13:14:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.373 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.374 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_num": { 2023-09-21T13:14:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_num", 2023-09-21T13:14:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.375 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "128", 2023-09-21T13:14:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.376 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "default pg_num for any created local pool", 2023-09-21T13:14:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.377 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "prefix": { 2023-09-21T13:14:08.378 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prefix", 2023-09-21T13:14:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.379 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.380 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "name prefix for any created local pool", 2023-09-21T13:14:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.381 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "subtree": { 2023-09-21T13:14:08.382 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "subtree", 2023-09-21T13:14:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.383 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "rack", 2023-09-21T13:14:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.384 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-21T13:14:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-21T13:14:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.385 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.386 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mds_autoscaler", 2023-09-21T13:14:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.387 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.388 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.389 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.390 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.391 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.392 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.393 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.394 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.395 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.396 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.397 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.398 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.399 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.400 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.401 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.402 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.403 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.404 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.405 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.406 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.407 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.408 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirroring", 2023-09-21T13:14:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.409 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.410 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.411 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.412 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.413 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.414 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.415 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.416 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.417 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.418 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.419 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.420 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.421 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.422 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.423 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.424 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.425 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.426 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.427 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.428 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.429 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.430 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "nfs", 2023-09-21T13:14:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.431 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.432 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.433 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.434 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.435 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.436 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.437 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.438 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.439 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.440 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.441 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.441 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.441 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.441 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.442 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.442 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.442 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.443 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.444 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.445 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.446 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.447 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.448 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.449 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.450 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.451 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.452 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "fail_fs": { 2023-09-21T13:14:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "fail_fs", 2023-09-21T13:14:08.453 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.454 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.455 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-21T13:14:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.456 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.457 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.458 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.459 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.460 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.461 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.462 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.463 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.464 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.465 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.466 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.467 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.468 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.469 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.470 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.471 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.471 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.471 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.471 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.472 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.472 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.472 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.472 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.473 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.473 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.473 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.474 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.474 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.474 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.474 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.475 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.475 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.475 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.476 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.476 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.476 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator": { 2023-09-21T13:14:08.476 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "orchestrator", 2023-09-21T13:14:08.477 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.477 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.477 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.478 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.478 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.478 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.478 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.479 INFO:teuthology.orchestra.run.smithi142.stdout: "cephadm", 2023-09-21T13:14:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "rook", 2023-09-21T13:14:08.481 INFO:teuthology.orchestra.run.smithi142.stdout: "test_orchestrator" 2023-09-21T13:14:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Orchestrator backend", 2023-09-21T13:14:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.482 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.483 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_perf_query", 2023-09-21T13:14:08.484 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.485 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.486 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.487 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.488 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.489 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.489 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.489 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.490 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.491 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.492 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.493 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.494 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.494 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.494 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.495 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.496 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.497 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.498 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.499 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.500 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.501 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.502 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.503 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.504 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.505 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "osd_support", 2023-09-21T13:14:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.506 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.507 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.508 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.509 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.510 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.511 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.512 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.513 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.514 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.515 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.516 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.517 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.518 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.519 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.520 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.521 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.522 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.523 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.523 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.523 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.523 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.524 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.525 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.526 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "pg_autoscaler", 2023-09-21T13:14:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.527 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.528 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.529 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.530 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.531 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.532 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.533 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.534 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.535 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.536 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.537 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.538 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.539 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.540 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.541 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.542 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.543 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.544 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.545 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.546 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.547 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "noautoscale": { 2023-09-21T13:14:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "noautoscale", 2023-09-21T13:14:08.548 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.549 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "global autoscale flag", 2023-09-21T13:14:08.550 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-21T13:14:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.551 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.552 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:08.553 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.554 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.555 INFO:teuthology.orchestra.run.smithi142.stdout: "threshold": { 2023-09-21T13:14:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "threshold", 2023-09-21T13:14:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:08.556 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "3.0", 2023-09-21T13:14:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1.0", 2023-09-21T13:14:08.557 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "scaling threshold", 2023-09-21T13:14:08.558 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-21T13:14:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.559 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "progress", 2023-09-21T13:14:08.560 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_pg_recovery_event": { 2023-09-21T13:14:08.561 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_pg_recovery_event", 2023-09-21T13:14:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.562 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.563 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-21T13:14:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.564 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:08.565 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.566 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.567 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.568 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.569 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.570 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.571 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.572 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.573 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.574 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.575 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.576 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.577 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.578 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.579 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.580 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.581 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.582 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.583 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.584 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.585 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.586 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.587 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.588 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "max_completed_events": { 2023-09-21T13:14:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_completed_events", 2023-09-21T13:14:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.589 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "50", 2023-09-21T13:14:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.590 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "number of past completed events to remember", 2023-09-21T13:14:08.591 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.592 INFO:teuthology.orchestra.run.smithi142.stdout: "sleep_interval": { 2023-09-21T13:14:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "sleep_interval", 2023-09-21T13:14:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.593 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "5", 2023-09-21T13:14:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.594 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "how long the module is going to sleep", 2023-09-21T13:14:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.595 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.596 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "prometheus", 2023-09-21T13:14:08.597 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.598 INFO:teuthology.orchestra.run.smithi142.stdout: "cache": { 2023-09-21T13:14:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "cache", 2023-09-21T13:14:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.599 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.600 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.601 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "exclude_perf_counters": { 2023-09-21T13:14:08.602 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "exclude_perf_counters", 2023-09-21T13:14:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.605 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.606 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-21T13:14:08.607 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-21T13:14:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.608 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.609 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.609 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.609 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.610 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.611 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.612 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.613 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.614 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.615 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.616 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.617 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.618 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.619 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.620 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.621 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.622 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.623 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.624 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.625 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.626 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.627 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools": { 2023-09-21T13:14:08.628 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools", 2023-09-21T13:14:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.629 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.630 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.631 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-21T13:14:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-21T13:14:08.632 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300", 2023-09-21T13:14:08.633 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.634 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.635 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "scrape_interval": { 2023-09-21T13:14:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "scrape_interval", 2023-09-21T13:14:08.636 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15.0", 2023-09-21T13:14:08.637 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.638 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.639 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.640 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "::", 2023-09-21T13:14:08.641 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-21T13:14:08.642 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.643 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.644 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "9283", 2023-09-21T13:14:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.645 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-21T13:14:08.646 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.647 INFO:teuthology.orchestra.run.smithi142.stdout: "stale_cache_strategy": { 2023-09-21T13:14:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stale_cache_strategy", 2023-09-21T13:14:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.648 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "log", 2023-09-21T13:14:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.649 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.650 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.651 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_behaviour": { 2023-09-21T13:14:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_behaviour", 2023-09-21T13:14:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.652 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "default", 2023-09-21T13:14:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.653 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "default", 2023-09-21T13:14:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: "error" 2023-09-21T13:14:08.654 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.655 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "standby_error_status_code": { 2023-09-21T13:14:08.656 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "standby_error_status_code", 2023-09-21T13:14:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.657 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "500", 2023-09-21T13:14:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "400", 2023-09-21T13:14:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "599", 2023-09-21T13:14:08.658 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.659 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.660 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_support", 2023-09-21T13:14:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.661 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.662 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.663 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.664 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.665 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.666 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.667 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.668 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.669 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.670 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.671 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.672 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.673 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.674 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.675 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.676 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.677 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.678 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.679 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.680 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_snap_create": { 2023-09-21T13:14:08.681 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_snap_create", 2023-09-21T13:14:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.682 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10", 2023-09-21T13:14:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.683 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.684 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "mirror_snapshot_schedule": { 2023-09-21T13:14:08.685 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "mirror_snapshot_schedule", 2023-09-21T13:14:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.686 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.687 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.688 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "trash_purge_schedule": { 2023-09-21T13:14:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "trash_purge_schedule", 2023-09-21T13:14:08.689 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.690 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.691 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.692 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.693 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "restful", 2023-09-21T13:14:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.694 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "enable_auth": { 2023-09-21T13:14:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enable_auth", 2023-09-21T13:14:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.695 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.696 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.697 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.698 INFO:teuthology.orchestra.run.smithi142.stdout: "key_file": { 2023-09-21T13:14:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "key_file", 2023-09-21T13:14:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.699 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.700 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.701 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.702 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.703 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.704 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.705 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.706 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.707 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.708 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.709 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.710 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.711 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.712 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.713 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.714 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.715 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.716 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.717 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.718 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.719 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.720 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.721 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "server_addr": { 2023-09-21T13:14:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_addr", 2023-09-21T13:14:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.722 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.723 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.724 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.725 INFO:teuthology.orchestra.run.smithi142.stdout: "server_port": { 2023-09-21T13:14:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "server_port", 2023-09-21T13:14:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.726 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.727 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.728 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.729 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rgw", 2023-09-21T13:14:08.730 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.731 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.732 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.733 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.734 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.735 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.736 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.737 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.738 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.739 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.740 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.741 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.742 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.743 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.744 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.745 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.746 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.747 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.748 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.748 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.748 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.748 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.749 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.750 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.751 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rook", 2023-09-21T13:14:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.752 INFO:teuthology.orchestra.run.smithi142.stdout: "drive_group_interval": { 2023-09-21T13:14:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "drive_group_interval", 2023-09-21T13:14:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:08.753 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "300.0", 2023-09-21T13:14:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.754 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-21T13:14:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.755 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.756 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.757 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.758 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.759 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.759 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.759 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.760 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.761 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.762 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.763 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.764 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.765 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.766 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.767 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.768 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.769 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.770 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.771 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.772 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.773 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.774 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.775 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "storage_class": { 2023-09-21T13:14:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "storage_class", 2023-09-21T13:14:08.776 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.777 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "local", 2023-09-21T13:14:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.778 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-21T13:14:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.779 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.780 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "selftest", 2023-09-21T13:14:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.781 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.782 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.783 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.783 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.783 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.783 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.784 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.785 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.786 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.787 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.788 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.789 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.790 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.791 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.792 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.793 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.794 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.795 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.796 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.797 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.798 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.799 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.800 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "roption1": { 2023-09-21T13:14:08.801 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption1", 2023-09-21T13:14:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.802 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.803 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.804 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "roption2": { 2023-09-21T13:14:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "roption2", 2023-09-21T13:14:08.805 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.806 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "xyz", 2023-09-21T13:14:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.807 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.808 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.809 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption1": { 2023-09-21T13:14:08.809 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption1", 2023-09-21T13:14:08.809 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.810 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.811 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.811 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.811 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.812 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.812 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.812 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.812 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.813 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption2": { 2023-09-21T13:14:08.813 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption2", 2023-09-21T13:14:08.813 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.813 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.814 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.814 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.814 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.815 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.816 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption3": { 2023-09-21T13:14:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption3", 2023-09-21T13:14:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "float", 2023-09-21T13:14:08.817 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.818 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.819 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.820 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption4": { 2023-09-21T13:14:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption4", 2023-09-21T13:14:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.821 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.822 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.823 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption5": { 2023-09-21T13:14:08.824 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption5", 2023-09-21T13:14:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.825 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.826 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.827 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption6": { 2023-09-21T13:14:08.828 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption6", 2023-09-21T13:14:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.829 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.830 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.831 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "rwoption7": { 2023-09-21T13:14:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rwoption7", 2023-09-21T13:14:08.832 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.833 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "1", 2023-09-21T13:14:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "42", 2023-09-21T13:14:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.834 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.835 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: "testkey": { 2023-09-21T13:14:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testkey", 2023-09-21T13:14:08.836 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.837 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.838 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.839 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "testlkey": { 2023-09-21T13:14:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testlkey", 2023-09-21T13:14:08.840 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.841 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.842 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.843 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "testnewline": { 2023-09-21T13:14:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "testnewline", 2023-09-21T13:14:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.844 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.845 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.846 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.847 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.848 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snap_schedule", 2023-09-21T13:14:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.849 INFO:teuthology.orchestra.run.smithi142.stdout: "allow_m_granularity": { 2023-09-21T13:14:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "allow_m_granularity", 2023-09-21T13:14:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.850 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.851 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "allow minute scheduled snapshots", 2023-09-21T13:14:08.852 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.853 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.853 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.853 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.853 INFO:teuthology.orchestra.run.smithi142.stdout: "dump_on_update": { 2023-09-21T13:14:08.854 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "dump_on_update", 2023-09-21T13:14:08.854 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.854 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.854 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.855 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.855 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.855 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.856 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.856 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "dump database to debug log on update", 2023-09-21T13:14:08.856 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.856 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.857 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.857 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.857 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.857 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.858 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.858 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.858 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.859 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.859 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.859 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.859 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.860 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.860 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.860 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.861 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.861 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.861 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.861 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.862 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.862 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.862 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.862 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.863 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.863 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.863 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.864 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.864 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.864 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.864 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.865 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.865 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.865 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.865 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.866 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.866 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.866 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.867 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.867 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.867 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.868 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.868 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.868 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.868 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.869 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.869 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.869 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.870 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.870 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.870 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.870 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.871 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.871 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.871 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.871 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.872 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.872 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.872 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.873 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.873 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.873 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.873 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.874 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.874 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.874 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.875 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.875 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.875 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.875 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.876 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.876 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.876 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.877 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.877 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.877 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "stats", 2023-09-21T13:14:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.878 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.879 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.879 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.879 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.880 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.880 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.880 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.880 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.881 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.881 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.881 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.882 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.882 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.882 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.882 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.883 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.883 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.883 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.883 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.884 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.884 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.885 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.885 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.885 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.885 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.886 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.886 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.886 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.887 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.887 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.889 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.889 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.890 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.890 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.890 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.890 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.891 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.891 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.891 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.892 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.892 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.892 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.892 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.893 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.893 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.893 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.894 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.894 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.894 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.894 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.895 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.895 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.895 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.896 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.896 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.896 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.896 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.897 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.897 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.897 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.897 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.898 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.898 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.898 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.899 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.899 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.899 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.899 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.900 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.900 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.900 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.901 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "status", 2023-09-21T13:14:08.901 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.901 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.902 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.902 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.902 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.902 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.903 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.903 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.903 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.904 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.904 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.904 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.904 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.905 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.905 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.905 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.905 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.906 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.906 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.906 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.907 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.907 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.907 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.907 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.908 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.908 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.908 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.909 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.909 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.909 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.909 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.910 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.910 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.910 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.910 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.911 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.911 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.911 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.912 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.912 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.912 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.912 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.913 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.913 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.913 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.913 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.914 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.914 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.914 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.915 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.915 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.915 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.915 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.916 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.916 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.916 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.917 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.917 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.917 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.917 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.918 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.918 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.918 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.918 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.919 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.919 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.919 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.920 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.920 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.920 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.920 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.921 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.921 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.921 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.922 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.922 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telegraf", 2023-09-21T13:14:08.922 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.923 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.923 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.923 INFO:teuthology.orchestra.run.smithi142.stdout: "address": { 2023-09-21T13:14:08.923 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "address", 2023-09-21T13:14:08.924 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.924 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.924 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.925 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-21T13:14:08.925 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.925 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.925 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.926 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.926 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.926 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.926 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.927 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.927 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:08.927 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:08.928 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:08.928 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.928 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.928 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "15", 2023-09-21T13:14:08.929 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.929 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.929 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.929 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.930 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.930 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.930 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.931 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.931 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:08.931 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:08.931 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.932 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.932 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.932 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.932 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.933 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.933 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.933 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.934 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.934 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.934 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.934 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.935 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.935 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.935 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.935 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.936 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.936 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.936 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.937 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:08.937 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:08.937 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.937 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.938 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.938 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.938 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.938 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.939 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.939 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.939 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.940 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.940 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.940 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.940 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:08.941 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:08.941 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.941 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.941 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.942 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:08.942 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.942 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.943 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:08.943 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:08.943 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:08.943 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:08.944 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:08.944 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:08.944 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:08.944 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:08.945 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.945 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.945 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.946 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.946 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.946 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:08.946 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:08.947 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.947 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.947 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:08.948 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.948 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.948 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.948 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.949 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.950 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:08.950 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.950 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:08.951 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "telemetry", 2023-09-21T13:14:08.951 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:08.951 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:08.952 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:08.952 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_basic": { 2023-09-21T13:14:08.952 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_basic", 2023-09-21T13:14:08.952 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.953 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.953 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.953 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.953 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.954 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.954 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.954 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-21T13:14:08.955 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.955 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.955 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.955 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.956 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_crash": { 2023-09-21T13:14:08.956 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_crash", 2023-09-21T13:14:08.956 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.956 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.957 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.957 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.957 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.958 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.958 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.958 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-21T13:14:08.958 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.959 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.959 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.959 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.960 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_device": { 2023-09-21T13:14:08.960 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_device", 2023-09-21T13:14:08.960 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.960 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.961 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.961 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "True", 2023-09-21T13:14:08.961 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.961 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.962 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.962 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-21T13:14:08.962 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.963 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.963 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.963 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.963 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_ident": { 2023-09-21T13:14:08.964 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_ident", 2023-09-21T13:14:08.964 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.964 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.964 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.965 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.965 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.965 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.966 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.966 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-21T13:14:08.966 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.966 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.967 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.967 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.967 INFO:teuthology.orchestra.run.smithi142.stdout: "channel_perf": { 2023-09-21T13:14:08.967 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "channel_perf", 2023-09-21T13:14:08.968 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.968 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.968 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.969 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.969 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.969 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.969 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-21T13:14:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.970 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "contact": { 2023-09-21T13:14:08.971 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "contact", 2023-09-21T13:14:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.972 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.973 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.974 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "description": { 2023-09-21T13:14:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "description", 2023-09-21T13:14:08.975 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.976 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.977 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.978 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "device_url": { 2023-09-21T13:14:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "device_url", 2023-09-21T13:14:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.979 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-21T13:14:08.980 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.981 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.982 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "enabled": { 2023-09-21T13:14:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "enabled", 2023-09-21T13:14:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.983 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.984 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.985 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.985 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.985 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.985 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.986 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.986 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.986 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:08.987 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:08.987 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.987 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.987 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.988 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "24", 2023-09-21T13:14:08.988 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "8", 2023-09-21T13:14:08.988 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.989 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.989 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.989 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.989 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: "last_opt_revision": { 2023-09-21T13:14:08.990 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "last_opt_revision", 2023-09-21T13:14:08.991 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:08.991 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.991 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.992 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "1", 2023-09-21T13:14:08.992 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.992 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.992 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.993 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.993 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.993 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.993 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.994 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.994 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard": { 2023-09-21T13:14:08.994 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard", 2023-09-21T13:14:08.995 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:08.995 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.995 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.995 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:08.996 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:08.996 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:08.996 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:08.996 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:08.997 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:08.997 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:08.997 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:08.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:08.998 INFO:teuthology.orchestra.run.smithi142.stdout: "leaderboard_description": { 2023-09-21T13:14:08.998 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "leaderboard_description", 2023-09-21T13:14:08.998 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:08.999 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:08.999 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:08.999 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:08.999 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.000 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.000 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.000 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.001 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.001 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.001 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.001 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.002 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:09.002 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:09.002 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.003 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.003 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.003 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.003 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.004 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.004 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.004 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.004 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.005 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.005 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.005 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.006 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.006 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.006 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.006 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.007 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.007 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.007 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:09.008 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:09.008 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.008 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.009 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.009 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.009 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.009 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.010 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.010 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.010 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.011 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.011 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.011 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.011 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:09.012 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:09.012 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.012 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.012 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.013 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:09.013 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.013 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.013 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.014 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.014 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.014 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.015 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.015 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.015 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.015 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.016 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.016 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.016 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.017 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.017 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.017 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:09.017 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:09.018 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.018 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.018 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.019 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.019 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.019 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.019 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.020 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.020 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.020 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.021 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.021 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.021 INFO:teuthology.orchestra.run.smithi142.stdout: "organization": { 2023-09-21T13:14:09.021 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "organization", 2023-09-21T13:14:09.022 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.022 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.022 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.022 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.023 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.023 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.023 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.024 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.024 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.024 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.024 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.025 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.025 INFO:teuthology.orchestra.run.smithi142.stdout: "proxy": { 2023-09-21T13:14:09.025 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "proxy", 2023-09-21T13:14:09.025 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.026 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.026 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.026 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.027 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.027 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.027 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.027 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.028 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.028 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.028 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.028 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.029 INFO:teuthology.orchestra.run.smithi142.stdout: "url": { 2023-09-21T13:14:09.029 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "url", 2023-09-21T13:14:09.029 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.030 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.030 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.030 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-21T13:14:09.030 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.031 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.031 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.031 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.031 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.032 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.032 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.032 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.033 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "test_orchestrator", 2023-09-21T13:14:09.034 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:09.034 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:09.034 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:09.034 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:09.035 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:09.035 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.035 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.035 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.036 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.037 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.038 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.038 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.038 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.038 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.039 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.039 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.039 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.040 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.040 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.040 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:09.040 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:09.041 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.041 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.041 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.041 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.042 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.042 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.042 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.043 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:09.044 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.045 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.046 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.047 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.047 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.047 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.047 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.048 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.048 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.048 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.048 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.049 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.049 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.049 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.050 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:09.050 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:09.050 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.051 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.051 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.051 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.051 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.052 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.052 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.052 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.053 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.053 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.053 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.053 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.054 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.054 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.054 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "volumes", 2023-09-21T13:14:09.055 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:09.055 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:09.055 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:09.056 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:09.056 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:09.056 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.056 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.057 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.057 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.057 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.057 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.058 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.058 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.058 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.059 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.059 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.059 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.059 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.060 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.060 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.060 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.060 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.061 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.061 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.061 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:09.062 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:09.062 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.062 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.062 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.063 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.063 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.063 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.064 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.064 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.064 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.064 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.065 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.065 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:09.065 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:09.066 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.066 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.066 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.067 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:09.067 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.067 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.067 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.068 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.068 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.068 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.068 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.069 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.069 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.069 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.069 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.070 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.070 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.070 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.071 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:09.071 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:09.071 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.072 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.072 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.072 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.072 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.073 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.073 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.073 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.074 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.074 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.074 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.074 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.075 INFO:teuthology.orchestra.run.smithi142.stdout: "max_concurrent_clones": { 2023-09-21T13:14:09.075 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "max_concurrent_clones", 2023-09-21T13:14:09.075 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "4", 2023-09-21T13:14:09.076 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-21T13:14:09.077 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.079 INFO:teuthology.orchestra.run.smithi142.stdout: "snapshot_clone_delay": { 2023-09-21T13:14:09.079 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snapshot_clone_delay", 2023-09-21T13:14:09.079 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:09.079 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.080 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.080 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "0", 2023-09-21T13:14:09.080 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.080 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.081 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.081 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-21T13:14:09.081 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.082 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.082 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.082 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.083 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.083 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix", 2023-09-21T13:14:09.083 INFO:teuthology.orchestra.run.smithi142.stdout: "can_run": true, 2023-09-21T13:14:09.084 INFO:teuthology.orchestra.run.smithi142.stdout: "error_string": "", 2023-09-21T13:14:09.084 INFO:teuthology.orchestra.run.smithi142.stdout: "module_options": { 2023-09-21T13:14:09.084 INFO:teuthology.orchestra.run.smithi142.stdout: "discovery_interval": { 2023-09-21T13:14:09.085 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "discovery_interval", 2023-09-21T13:14:09.085 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "uint", 2023-09-21T13:14:09.085 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.085 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.086 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "100", 2023-09-21T13:14:09.086 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.086 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.086 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.087 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.087 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.087 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.088 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.088 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.088 INFO:teuthology.orchestra.run.smithi142.stdout: "identifier": { 2023-09-21T13:14:09.088 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "identifier", 2023-09-21T13:14:09.089 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.089 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.089 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.089 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.090 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.090 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.090 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.091 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.091 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.091 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.091 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.092 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.092 INFO:teuthology.orchestra.run.smithi142.stdout: "interval": { 2023-09-21T13:14:09.092 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "interval", 2023-09-21T13:14:09.093 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "secs", 2023-09-21T13:14:09.093 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.093 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.093 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "60", 2023-09-21T13:14:09.094 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.094 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.094 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.094 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.095 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.095 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.095 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.096 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.096 INFO:teuthology.orchestra.run.smithi142.stdout: "log_level": { 2023-09-21T13:14:09.096 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_level", 2023-09-21T13:14:09.096 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.097 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.097 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.097 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.097 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.098 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.098 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.098 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.099 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.099 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.099 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.099 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.100 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.100 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.100 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.100 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.101 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.101 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.101 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.102 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster": { 2023-09-21T13:14:09.102 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster", 2023-09-21T13:14:09.102 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.102 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.103 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.103 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.103 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.103 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.104 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.104 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.104 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.105 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.105 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.105 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_cluster_level": { 2023-09-21T13:14:09.106 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_cluster_level", 2023-09-21T13:14:09.106 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.106 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.106 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.107 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "info", 2023-09-21T13:14:09.107 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.107 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.108 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [ 2023-09-21T13:14:09.108 INFO:teuthology.orchestra.run.smithi142.stdout: "", 2023-09-21T13:14:09.108 INFO:teuthology.orchestra.run.smithi142.stdout: "critical", 2023-09-21T13:14:09.109 INFO:teuthology.orchestra.run.smithi142.stdout: "debug", 2023-09-21T13:14:09.109 INFO:teuthology.orchestra.run.smithi142.stdout: "error", 2023-09-21T13:14:09.109 INFO:teuthology.orchestra.run.smithi142.stdout: "info", 2023-09-21T13:14:09.109 INFO:teuthology.orchestra.run.smithi142.stdout: "warning" 2023-09-21T13:14:09.110 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.110 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.110 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.111 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.111 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.112 INFO:teuthology.orchestra.run.smithi142.stdout: "log_to_file": { 2023-09-21T13:14:09.112 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "log_to_file", 2023-09-21T13:14:09.112 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "bool", 2023-09-21T13:14:09.113 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.113 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 1, 2023-09-21T13:14:09.113 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "False", 2023-09-21T13:14:09.113 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.114 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.114 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.114 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.114 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.115 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.115 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.116 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_host": { 2023-09-21T13:14:09.116 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_host", 2023-09-21T13:14:09.116 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.116 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.117 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.117 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "", 2023-09-21T13:14:09.117 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.117 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.118 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.118 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.118 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.119 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.119 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.119 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.119 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_port": { 2023-09-21T13:14:09.120 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_port", 2023-09-21T13:14:09.120 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "int", 2023-09-21T13:14:09.120 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.120 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.121 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "10051", 2023-09-21T13:14:09.121 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.121 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.122 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.122 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.122 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.122 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.123 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.123 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.123 INFO:teuthology.orchestra.run.smithi142.stdout: "zabbix_sender": { 2023-09-21T13:14:09.123 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "zabbix_sender", 2023-09-21T13:14:09.124 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "str", 2023-09-21T13:14:09.124 INFO:teuthology.orchestra.run.smithi142.stdout: "level": "advanced", 2023-09-21T13:14:09.124 INFO:teuthology.orchestra.run.smithi142.stdout: "flags": 0, 2023-09-21T13:14:09.124 INFO:teuthology.orchestra.run.smithi142.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-21T13:14:09.125 INFO:teuthology.orchestra.run.smithi142.stdout: "min": "", 2023-09-21T13:14:09.125 INFO:teuthology.orchestra.run.smithi142.stdout: "max": "", 2023-09-21T13:14:09.125 INFO:teuthology.orchestra.run.smithi142.stdout: "enum_allowed": [], 2023-09-21T13:14:09.126 INFO:teuthology.orchestra.run.smithi142.stdout: "desc": "", 2023-09-21T13:14:09.126 INFO:teuthology.orchestra.run.smithi142.stdout: "long_desc": "", 2023-09-21T13:14:09.126 INFO:teuthology.orchestra.run.smithi142.stdout: "tags": [], 2023-09-21T13:14:09.126 INFO:teuthology.orchestra.run.smithi142.stdout: "see_also": [] 2023-09-21T13:14:09.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.127 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.127 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.128 INFO:teuthology.orchestra.run.smithi142.stdout: "services": { 2023-09-21T13:14:09.128 INFO:teuthology.orchestra.run.smithi142.stdout: "dashboard": "https://172.21.15.142:8443/" 2023-09-21T13:14:09.128 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.129 INFO:teuthology.orchestra.run.smithi142.stdout: "always_on_modules": { 2023-09-21T13:14:09.129 INFO:teuthology.orchestra.run.smithi142.stdout: "octopus": [ 2023-09-21T13:14:09.129 INFO:teuthology.orchestra.run.smithi142.stdout: "balancer", 2023-09-21T13:14:09.129 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2023-09-21T13:14:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "devicehealth", 2023-09-21T13:14:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator", 2023-09-21T13:14:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscaler", 2023-09-21T13:14:09.130 INFO:teuthology.orchestra.run.smithi142.stdout: "progress", 2023-09-21T13:14:09.131 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_support", 2023-09-21T13:14:09.131 INFO:teuthology.orchestra.run.smithi142.stdout: "status", 2023-09-21T13:14:09.131 INFO:teuthology.orchestra.run.smithi142.stdout: "telemetry", 2023-09-21T13:14:09.132 INFO:teuthology.orchestra.run.smithi142.stdout: "volumes" 2023-09-21T13:14:09.132 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.132 INFO:teuthology.orchestra.run.smithi142.stdout: "pacific": [ 2023-09-21T13:14:09.132 INFO:teuthology.orchestra.run.smithi142.stdout: "balancer", 2023-09-21T13:14:09.133 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2023-09-21T13:14:09.133 INFO:teuthology.orchestra.run.smithi142.stdout: "devicehealth", 2023-09-21T13:14:09.133 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator", 2023-09-21T13:14:09.133 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscaler", 2023-09-21T13:14:09.134 INFO:teuthology.orchestra.run.smithi142.stdout: "progress", 2023-09-21T13:14:09.134 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_support", 2023-09-21T13:14:09.134 INFO:teuthology.orchestra.run.smithi142.stdout: "status", 2023-09-21T13:14:09.135 INFO:teuthology.orchestra.run.smithi142.stdout: "telemetry", 2023-09-21T13:14:09.135 INFO:teuthology.orchestra.run.smithi142.stdout: "volumes" 2023-09-21T13:14:09.135 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.135 INFO:teuthology.orchestra.run.smithi142.stdout: "quincy": [ 2023-09-21T13:14:09.136 INFO:teuthology.orchestra.run.smithi142.stdout: "balancer", 2023-09-21T13:14:09.136 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2023-09-21T13:14:09.136 INFO:teuthology.orchestra.run.smithi142.stdout: "devicehealth", 2023-09-21T13:14:09.136 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator", 2023-09-21T13:14:09.137 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscaler", 2023-09-21T13:14:09.137 INFO:teuthology.orchestra.run.smithi142.stdout: "progress", 2023-09-21T13:14:09.137 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_support", 2023-09-21T13:14:09.137 INFO:teuthology.orchestra.run.smithi142.stdout: "status", 2023-09-21T13:14:09.138 INFO:teuthology.orchestra.run.smithi142.stdout: "telemetry", 2023-09-21T13:14:09.138 INFO:teuthology.orchestra.run.smithi142.stdout: "volumes" 2023-09-21T13:14:09.138 INFO:teuthology.orchestra.run.smithi142.stdout: ], 2023-09-21T13:14:09.139 INFO:teuthology.orchestra.run.smithi142.stdout: "reef": [ 2023-09-21T13:14:09.139 INFO:teuthology.orchestra.run.smithi142.stdout: "balancer", 2023-09-21T13:14:09.139 INFO:teuthology.orchestra.run.smithi142.stdout: "crash", 2023-09-21T13:14:09.139 INFO:teuthology.orchestra.run.smithi142.stdout: "devicehealth", 2023-09-21T13:14:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "orchestrator", 2023-09-21T13:14:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "pg_autoscaler", 2023-09-21T13:14:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "progress", 2023-09-21T13:14:09.140 INFO:teuthology.orchestra.run.smithi142.stdout: "rbd_support", 2023-09-21T13:14:09.141 INFO:teuthology.orchestra.run.smithi142.stdout: "status", 2023-09-21T13:14:09.141 INFO:teuthology.orchestra.run.smithi142.stdout: "telemetry", 2023-09-21T13:14:09.141 INFO:teuthology.orchestra.run.smithi142.stdout: "volumes" 2023-09-21T13:14:09.142 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.142 INFO:teuthology.orchestra.run.smithi142.stdout: "last_failure_osd_epoch": 87, 2023-09-21T13:14:09.142 INFO:teuthology.orchestra.run.smithi142.stdout: "active_clients": [ 2023-09-21T13:14:09.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.143 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "devicehealth", 2023-09-21T13:14:09.143 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.143 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.144 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.144 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.144 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1818881519 2023-09-21T13:14:09.145 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.145 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.145 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.145 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.146 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "libcephsqlite", 2023-09-21T13:14:09.146 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.146 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.147 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.147 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.147 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3381960966 2023-09-21T13:14:09.147 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.148 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.148 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.148 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.148 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "rbd_support", 2023-09-21T13:14:09.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.149 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.149 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.149 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.150 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 1870037471 2023-09-21T13:14:09.150 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.150 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.151 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.151 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snap_schedule", 2023-09-21T13:14:09.151 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.152 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.152 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.152 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.153 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 851095652 2023-09-21T13:14:09.153 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.153 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.153 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.154 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "snap_schedule", 2023-09-21T13:14:09.154 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.154 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.155 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.155 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.155 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 3266743451 2023-09-21T13:14:09.155 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.156 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.156 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:09.156 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.157 INFO:teuthology.orchestra.run.smithi142.stdout: "name": "volumes", 2023-09-21T13:14:09.157 INFO:teuthology.orchestra.run.smithi142.stdout: "addrvec": [ 2023-09-21T13:14:09.157 INFO:teuthology.orchestra.run.smithi142.stdout: { 2023-09-21T13:14:09.157 INFO:teuthology.orchestra.run.smithi142.stdout: "type": "v2", 2023-09-21T13:14:09.158 INFO:teuthology.orchestra.run.smithi142.stdout: "addr": "172.21.15.142:0", 2023-09-21T13:14:09.158 INFO:teuthology.orchestra.run.smithi142.stdout: "nonce": 73422795 2023-09-21T13:14:09.158 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.158 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.159 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:09.159 INFO:teuthology.orchestra.run.smithi142.stdout: ] 2023-09-21T13:14:09.159 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:14:09.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:03 smithi160 ceph-mon[134450]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 29 op/s 2023-09-21T13:14:09.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/612412077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.162 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:03 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1218215867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:04 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2940264690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-21T13:14:09.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:05 smithi160 ceph-mon[134450]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 87 KiB/s wr, 24 op/s 2023-09-21T13:14:09.163 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:07 smithi160 ceph-mon[134450]: osdmap e114: 12 total, 12 up, 12 in 2023-09-21T13:14:09.164 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:07 smithi160 ceph-mon[134450]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:09.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:03 smithi156 ceph-mon[134078]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 29 op/s 2023-09-21T13:14:09.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/612412077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.164 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:03 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1218215867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:04 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2940264690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-21T13:14:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:05 smithi156 ceph-mon[134078]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 87 KiB/s wr, 24 op/s 2023-09-21T13:14:09.165 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:07 smithi156 ceph-mon[134078]: osdmap e114: 12 total, 12 up, 12 in 2023-09-21T13:14:09.166 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:07 smithi156 ceph-mon[134078]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:09.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 msgr2=0x7fc39c0a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:09.166 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 0x7fc39c0a2d30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc3b01984b0 tx=0x7fc3a0009260 comp rx=0 tx=0).stop 2023-09-21T13:14:09.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 msgr2=0x7fc3b0196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:09.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac005770 tx=0x7fc3ac0057a0 comp rx=0 tx=0).stop 2023-09-21T13:14:09.167 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 shutdown_connections 2023-09-21T13:14:09.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc39c0a0870 0x7fc39c0a2d30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:09.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc3b0100fd0 0x7fc3b0196ea0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:09.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc3b019b840 0x7fc3b019bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:09.168 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 --2- 172.21.15.142:0/2940264690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc3b01060f0 0x7fc3b01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:09.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 >> 172.21.15.142:0/2940264690 conn(0x7fc3b00fc890 msgr2=0x7fc3b00fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:09.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 shutdown_connections 2023-09-21T13:14:09.169 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:04.036+0000 7fc3b7fff700 1 -- 172.21.15.142:0/2940264690 wait complete. 2023-09-21T13:14:09.179 DEBUG:tasks.check_counter:Getting stats from a 2023-09-21T13:14:09.179 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.a perf dump 2023-09-21T13:14:09.181 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:03 smithi142 ceph-mon[97663]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 112 KiB/s wr, 29 op/s 2023-09-21T13:14:09.181 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/612412077' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.181 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:03 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1218215867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:09.182 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:04 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2940264690' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-21T13:14:09.182 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:05 smithi142 ceph-mon[97663]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 87 KiB/s wr, 24 op/s 2023-09-21T13:14:09.182 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:07 smithi142 ceph-mon[97663]: osdmap e114: 12 total, 12 up, 12 in 2023-09-21T13:14:09.183 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:07 smithi142 ceph-mon[97663]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:10.095 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T13:14:10.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:10 smithi156 ceph-mon[134078]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:10.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:10 smithi142 ceph-mon[97663]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:10.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:10 smithi160 ceph-mon[134450]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:11.976 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:14:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:11.977 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 2421325, 2023-09-21T13:14:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 2509026, 2023-09-21T13:14:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 458074128, 2023-09-21T13:14:11.978 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 863539655, 2023-09-21T13:14:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 14, 2023-09-21T13:14:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 148.516836236, 2023-09-21T13:14:11.979 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 68.049478786, 2023-09-21T13:14:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 101.596592590, 2023-09-21T13:14:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.895587381, 2023-09-21T13:14:11.980 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 2509026, 2023-09-21T13:14:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 115.216270516, 2023-09-21T13:14:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000045920 2023-09-21T13:14:11.981 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 4809935, 2023-09-21T13:14:11.982 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.682180138, 2023-09-21T13:14:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000141 2023-09-21T13:14:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.983 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 1787808, 2023-09-21T13:14:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 213504 2023-09-21T13:14:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:11.984 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 18439, 2023-09-21T13:14:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 18742, 2023-09-21T13:14:11.985 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 4644627, 2023-09-21T13:14:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 141468900, 2023-09-21T13:14:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 37, 2023-09-21T13:14:11.986 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 8, 2023-09-21T13:14:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 2.277828441, 2023-09-21T13:14:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.687089013, 2023-09-21T13:14:11.987 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.392507937, 2023-09-21T13:14:11.988 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 1.052324098, 2023-09-21T13:14:11.988 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:11.988 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 18739, 2023-09-21T13:14:11.989 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 3.386362171, 2023-09-21T13:14:11.989 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000180712 2023-09-21T13:14:11.989 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.989 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:11.990 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 131, 2023-09-21T13:14:11.990 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000025862, 2023-09-21T13:14:11.990 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000197 2023-09-21T13:14:11.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.991 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 6064, 2023-09-21T13:14:11.991 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 618160 2023-09-21T13:14:11.991 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.992 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:11.992 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 33776, 2023-09-21T13:14:11.992 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 32593, 2023-09-21T13:14:11.992 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 10830103, 2023-09-21T13:14:11.993 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 188679567, 2023-09-21T13:14:11.993 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 10, 2023-09-21T13:14:11.993 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 6, 2023-09-21T13:14:11.994 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 4.171187417, 2023-09-21T13:14:11.994 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 1.423724440, 2023-09-21T13:14:11.994 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 1.159266708, 2023-09-21T13:14:11.994 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 1.562873844, 2023-09-21T13:14:11.995 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:11.995 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 32591, 2023-09-21T13:14:11.996 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 6.186737374, 2023-09-21T13:14:11.996 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000189829 2023-09-21T13:14:11.996 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.997 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:11.997 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 23498, 2023-09-21T13:14:11.997 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.004729843, 2023-09-21T13:14:11.997 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000201 2023-09-21T13:14:11.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.998 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:11.998 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:11.998 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:11.999 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2023-09-21T13:14:11.999 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 1, 2023-09-21T13:14:12.000 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2023-09-21T13:14:12.000 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.000 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-MDSRank": { 2023-09-21T13:14:12.000 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2023-09-21T13:14:12.001 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2023-09-21T13:14:12.001 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 56133, 2023-09-21T13:14:12.001 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 81.385388260, 2023-09-21T13:14:12.002 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.001449867 2023-09-21T13:14:12.002 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.002 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.002 INFO:teuthology.orchestra.run.smithi142.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: "queue_len": 0, 2023-09-21T13:14:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: "complete_latency": { 2023-09-21T13:14:12.003 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 33106, 2023-09-21T13:14:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 8.468940483, 2023-09-21T13:14:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000255812 2023-09-21T13:14:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.004 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: "mds": { 2023-09-21T13:14:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: "request": 161924, 2023-09-21T13:14:12.005 INFO:teuthology.orchestra.run.smithi142.stdout: "reply": 157189, 2023-09-21T13:14:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: "reply_latency": { 2023-09-21T13:14:12.006 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 157189, 2023-09-21T13:14:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 530.282127631, 2023-09-21T13:14:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003373532 2023-09-21T13:14:12.007 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: "slow_reply": 0, 2023-09-21T13:14:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: "forward": 4735, 2023-09-21T13:14:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch_complete": 8, 2023-09-21T13:14:12.008 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_fetch_keys": 0, 2023-09-21T13:14:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_commit": 151, 2023-09-21T13:14:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_split": 15, 2023-09-21T13:14:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_merge": 12, 2023-09-21T13:14:12.009 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes": 3058, 2023-09-21T13:14:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_top": 1425, 2023-09-21T13:14:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_bottom": 1622, 2023-09-21T13:14:12.010 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pin_tail": 11, 2023-09-21T13:14:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_pinned": 1023, 2023-09-21T13:14:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_expired": 82, 2023-09-21T13:14:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: "inodes_with_caps": 229, 2023-09-21T13:14:12.011 INFO:teuthology.orchestra.run.smithi142.stdout: "caps": 230, 2023-09-21T13:14:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: "subtrees": 21, 2023-09-21T13:14:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse": 239641, 2023-09-21T13:14:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_hit": 136578, 2023-09-21T13:14:12.012 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_forward": 4730, 2023-09-21T13:14:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_discover": 43, 2023-09-21T13:14:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_dir_fetch": 0, 2023-09-21T13:14:12.013 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: "traverse_lock": 813, 2023-09-21T13:14:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: "load_cent": 17666, 2023-09-21T13:14:12.014 INFO:teuthology.orchestra.run.smithi142.stdout: "q": 0, 2023-09-21T13:14:12.015 INFO:teuthology.orchestra.run.smithi142.stdout: "exported": 2, 2023-09-21T13:14:12.015 INFO:teuthology.orchestra.run.smithi142.stdout: "exported_inodes": 63, 2023-09-21T13:14:12.015 INFO:teuthology.orchestra.run.smithi142.stdout: "imported": 10, 2023-09-21T13:14:12.016 INFO:teuthology.orchestra.run.smithi142.stdout: "imported_inodes": 919, 2023-09-21T13:14:12.016 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:12.016 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_backtrace_fetch": 231, 2023-09-21T13:14:12.017 INFO:teuthology.orchestra.run.smithi142.stdout: "openino_peer_discover": 1, 2023-09-21T13:14:12.017 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rfiles": 734, 2023-09-21T13:14:12.017 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rbytes": 226086822, 2023-09-21T13:14:12.018 INFO:teuthology.orchestra.run.smithi142.stdout: "root_rsnaps": 7, 2023-09-21T13:14:12.019 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_backtrace_fetch": 231, 2023-09-21T13:14:12.019 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:12.020 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:12.020 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:12.020 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dir_inodes": 1, 2023-09-21T13:14:12.020 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dir_base_inodes": 0, 2023-09-21T13:14:12.021 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_dirfrag_rstats": 1, 2023-09-21T13:14:12.021 INFO:teuthology.orchestra.run.smithi142.stdout: "scrub_file_inodes": 230, 2023-09-21T13:14:12.021 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_inode_file_caps": 10, 2023-09-21T13:14:12.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_revoke": 2390, 2023-09-21T13:14:12.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_grant": 94236, 2023-09-21T13:14:12.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:12.022 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_flushsnap_ack": 2366, 2023-09-21T13:14:12.023 INFO:teuthology.orchestra.run.smithi142.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:12.023 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_caps": 38574, 2023-09-21T13:14:12.023 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_caps_dirty": 25571, 2023-09-21T13:14:12.023 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_cap_release": 6391, 2023-09-21T13:14:12.024 INFO:teuthology.orchestra.run.smithi142.stdout: "process_request_cap_release": 122101 2023-09-21T13:14:12.024 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.024 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_cache": { 2023-09-21T13:14:12.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_update": 55, 2023-09-21T13:14:12.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_update_receipt": 204, 2023-09-21T13:14:12.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_try_discover": 110, 2023-09-21T13:14:12.025 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_send_discover": 252, 2023-09-21T13:14:12.026 INFO:teuthology.orchestra.run.smithi142.stdout: "dir_handle_discover": 78, 2023-09-21T13:14:12.026 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays": 0, 2023-09-21T13:14:12.026 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:12.027 INFO:teuthology.orchestra.run.smithi142.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:12.027 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_created": 22704, 2023-09-21T13:14:12.027 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_enqueued": 22704, 2023-09-21T13:14:12.027 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:12.028 INFO:teuthology.orchestra.run.smithi142.stdout: "strays_migrated": 0, 2023-09-21T13:14:12.028 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:12.028 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:12.029 INFO:teuthology.orchestra.run.smithi142.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:12.029 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_started": 0, 2023-09-21T13:14:12.029 INFO:teuthology.orchestra.run.smithi142.stdout: "recovery_completed": 0, 2023-09-21T13:14:12.029 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_enqueue_scrub": 0, 2023-09-21T13:14:12.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_exportdir": 12, 2023-09-21T13:14:12.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_flush": 0, 2023-09-21T13:14:12.030 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragmentdir": 27, 2023-09-21T13:14:12.031 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:12.031 INFO:teuthology.orchestra.run.smithi142.stdout: "ireq_inodestats": 0 2023-09-21T13:14:12.031 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.031 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_log": { 2023-09-21T13:14:12.032 INFO:teuthology.orchestra.run.smithi142.stdout: "evlrg": 0, 2023-09-21T13:14:12.032 INFO:teuthology.orchestra.run.smithi142.stdout: "evadd": 157987, 2023-09-21T13:14:12.032 INFO:teuthology.orchestra.run.smithi142.stdout: "evex": 65252, 2023-09-21T13:14:12.033 INFO:teuthology.orchestra.run.smithi142.stdout: "evtrm": 61451, 2023-09-21T13:14:12.033 INFO:teuthology.orchestra.run.smithi142.stdout: "ev": 96536, 2023-09-21T13:14:12.033 INFO:teuthology.orchestra.run.smithi142.stdout: "evexg": 0, 2023-09-21T13:14:12.033 INFO:teuthology.orchestra.run.smithi142.stdout: "evexd": 3801, 2023-09-21T13:14:12.034 INFO:teuthology.orchestra.run.smithi142.stdout: "segadd": 210, 2023-09-21T13:14:12.034 INFO:teuthology.orchestra.run.smithi142.stdout: "segex": 82, 2023-09-21T13:14:12.034 INFO:teuthology.orchestra.run.smithi142.stdout: "segtrm": 77, 2023-09-21T13:14:12.034 INFO:teuthology.orchestra.run.smithi142.stdout: "seg": 133, 2023-09-21T13:14:12.035 INFO:teuthology.orchestra.run.smithi142.stdout: "segmjr": 8, 2023-09-21T13:14:12.035 INFO:teuthology.orchestra.run.smithi142.stdout: "segexg": 0, 2023-09-21T13:14:12.035 INFO:teuthology.orchestra.run.smithi142.stdout: "segexd": 5, 2023-09-21T13:14:12.036 INFO:teuthology.orchestra.run.smithi142.stdout: "expos": 104330479, 2023-09-21T13:14:12.036 INFO:teuthology.orchestra.run.smithi142.stdout: "wrpos": 518210404, 2023-09-21T13:14:12.036 INFO:teuthology.orchestra.run.smithi142.stdout: "rdpos": 0, 2023-09-21T13:14:12.036 INFO:teuthology.orchestra.run.smithi142.stdout: "jlat": { 2023-09-21T13:14:12.037 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 31657, 2023-09-21T13:14:12.037 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 217.779767261, 2023-09-21T13:14:12.037 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.006879355 2023-09-21T13:14:12.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.038 INFO:teuthology.orchestra.run.smithi142.stdout: "replayed": 0 2023-09-21T13:14:12.038 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.039 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_mem": { 2023-09-21T13:14:12.039 INFO:teuthology.orchestra.run.smithi142.stdout: "ino": 1445, 2023-09-21T13:14:12.039 INFO:teuthology.orchestra.run.smithi142.stdout: "ino+": 24196, 2023-09-21T13:14:12.039 INFO:teuthology.orchestra.run.smithi142.stdout: "ino-": 22751, 2023-09-21T13:14:12.040 INFO:teuthology.orchestra.run.smithi142.stdout: "dir": 173, 2023-09-21T13:14:12.040 INFO:teuthology.orchestra.run.smithi142.stdout: "dir+": 419, 2023-09-21T13:14:12.040 INFO:teuthology.orchestra.run.smithi142.stdout: "dir-": 246, 2023-09-21T13:14:12.040 INFO:teuthology.orchestra.run.smithi142.stdout: "dn": 3058, 2023-09-21T13:14:12.041 INFO:teuthology.orchestra.run.smithi142.stdout: "dn+": 47434, 2023-09-21T13:14:12.041 INFO:teuthology.orchestra.run.smithi142.stdout: "dn-": 44376, 2023-09-21T13:14:12.041 INFO:teuthology.orchestra.run.smithi142.stdout: "cap": 230, 2023-09-21T13:14:12.042 INFO:teuthology.orchestra.run.smithi142.stdout: "cap+": 24376, 2023-09-21T13:14:12.042 INFO:teuthology.orchestra.run.smithi142.stdout: "cap-": 24146, 2023-09-21T13:14:12.042 INFO:teuthology.orchestra.run.smithi142.stdout: "rss": 77612, 2023-09-21T13:14:12.042 INFO:teuthology.orchestra.run.smithi142.stdout: "heap": 198960 2023-09-21T13:14:12.043 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.043 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_server": { 2023-09-21T13:14:12.043 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_client_request": 227964, 2023-09-21T13:14:12.044 INFO:teuthology.orchestra.run.smithi142.stdout: "dispatch_server_request": 5, 2023-09-21T13:14:12.044 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_request": 161924, 2023-09-21T13:14:12.044 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_client_session": 3055, 2023-09-21T13:14:12.044 INFO:teuthology.orchestra.run.smithi142.stdout: "handle_peer_request": 10782, 2023-09-21T13:14:12.045 INFO:teuthology.orchestra.run.smithi142.stdout: "req_create_latency": { 2023-09-21T13:14:12.045 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 22713, 2023-09-21T13:14:12.045 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 73.844077420, 2023-09-21T13:14:12.046 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003251181 2023-09-21T13:14:12.046 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.046 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getattr_latency": { 2023-09-21T13:14:12.046 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 91, 2023-09-21T13:14:12.047 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.707731858, 2023-09-21T13:14:12.047 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.007777273 2023-09-21T13:14:12.047 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.047 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:12.048 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.048 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.048 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.049 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.049 INFO:teuthology.orchestra.run.smithi142.stdout: "req_link_latency": { 2023-09-21T13:14:12.049 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.049 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.050 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookup_latency": { 2023-09-21T13:14:12.051 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 33285, 2023-09-21T13:14:12.051 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 67.714633049, 2023-09-21T13:14:12.051 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.002034388 2023-09-21T13:14:12.051 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.052 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:12.052 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.052 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.053 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.053 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.053 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupino_latency": { 2023-09-21T13:14:12.053 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 1, 2023-09-21T13:14:12.054 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000106258, 2023-09-21T13:14:12.054 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000106258 2023-09-21T13:14:12.054 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.055 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupname_latency": { 2023-09-21T13:14:12.055 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.055 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.055 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.056 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.056 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:12.056 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.057 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.057 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.057 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.058 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:12.058 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.058 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.058 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.059 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.059 INFO:teuthology.orchestra.run.smithi142.stdout: "req_lssnap_latency": { 2023-09-21T13:14:12.059 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.060 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.060 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.060 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.060 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mkdir_latency": { 2023-09-21T13:14:12.061 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.061 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.061 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.062 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.062 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mknod_latency": { 2023-09-21T13:14:12.062 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.063 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.063 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.063 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.064 INFO:teuthology.orchestra.run.smithi142.stdout: "req_mksnap_latency": { 2023-09-21T13:14:12.064 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.064 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.064 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.065 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.065 INFO:teuthology.orchestra.run.smithi142.stdout: "req_open_latency": { 2023-09-21T13:14:12.065 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.066 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.066 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.066 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.067 INFO:teuthology.orchestra.run.smithi142.stdout: "req_readdir_latency": { 2023-09-21T13:14:12.067 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 74304, 2023-09-21T13:14:12.067 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 277.307336059, 2023-09-21T13:14:12.067 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003732064 2023-09-21T13:14:12.068 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.068 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rename_latency": { 2023-09-21T13:14:12.068 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3580, 2023-09-21T13:14:12.069 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 13.528484983, 2023-09-21T13:14:12.069 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.003778906 2023-09-21T13:14:12.069 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.069 INFO:teuthology.orchestra.run.smithi142.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:12.070 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.070 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.070 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.071 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.071 INFO:teuthology.orchestra.run.smithi142.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:12.071 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.071 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.072 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.072 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.072 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmdir_latency": { 2023-09-21T13:14:12.073 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.073 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.073 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.073 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.074 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:12.074 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.074 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:12.075 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.076 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.076 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.076 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setattr_latency": { 2023-09-21T13:14:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 15, 2023-09-21T13:14:12.077 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.246074279, 2023-09-21T13:14:12.078 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.016404951 2023-09-21T13:14:12.078 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.078 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:12.079 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.079 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.079 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.080 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.080 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:12.080 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 496, 2023-09-21T13:14:12.080 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.809620522, 2023-09-21T13:14:12.081 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.001632299 2023-09-21T13:14:12.081 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.081 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setlayout_latency": { 2023-09-21T13:14:12.082 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.082 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.082 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.083 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.083 INFO:teuthology.orchestra.run.smithi142.stdout: "req_setxattr_latency": { 2023-09-21T13:14:12.083 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.084 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.084 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.084 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.084 INFO:teuthology.orchestra.run.smithi142.stdout: "req_symlink_latency": { 2023-09-21T13:14:12.085 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.085 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.085 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.086 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.086 INFO:teuthology.orchestra.run.smithi142.stdout: "req_unlink_latency": { 2023-09-21T13:14:12.086 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 22704, 2023-09-21T13:14:12.087 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 96.124063203, 2023-09-21T13:14:12.087 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.004233794 2023-09-21T13:14:12.087 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.087 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:12.088 INFO:teuthology.orchestra.run.smithi142.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:12.088 INFO:teuthology.orchestra.run.smithi142.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:12.088 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.089 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.089 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.089 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.089 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.090 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_sessions": { 2023-09-21T13:14:12.090 INFO:teuthology.orchestra.run.smithi142.stdout: "session_count": 2, 2023-09-21T13:14:12.090 INFO:teuthology.orchestra.run.smithi142.stdout: "session_add": 4, 2023-09-21T13:14:12.091 INFO:teuthology.orchestra.run.smithi142.stdout: "session_remove": 2, 2023-09-21T13:14:12.091 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_open": 2, 2023-09-21T13:14:12.091 INFO:teuthology.orchestra.run.smithi142.stdout: "sessions_stale": 0, 2023-09-21T13:14:12.092 INFO:teuthology.orchestra.run.smithi142.stdout: "total_load": 29389, 2023-09-21T13:14:12.092 INFO:teuthology.orchestra.run.smithi142.stdout: "average_load": 14694, 2023-09-21T13:14:12.092 INFO:teuthology.orchestra.run.smithi142.stdout: "avg_session_uptime": 1050, 2023-09-21T13:14:12.092 INFO:teuthology.orchestra.run.smithi142.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:12.093 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.093 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2023-09-21T13:14:12.093 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:12.094 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:12.094 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:12.094 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:12.094 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:12.095 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:12.095 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:12.095 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:12.096 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:12.096 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:12.096 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:12.097 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:12.097 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:12.097 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:12.097 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:12.098 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:12.099 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:12.100 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:12.101 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:12.102 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2023-09-21T13:14:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:12.103 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 330286, 2023-09-21T13:14:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 1082, 2023-09-21T13:14:12.104 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 88, 2023-09-21T13:14:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 1, 2023-09-21T13:14:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2023-09-21T13:14:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2023-09-21T13:14:12.105 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:12.106 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 8152, 2023-09-21T13:14:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 170, 2023-09-21T13:14:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:12.107 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2023-09-21T13:14:12.108 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 6067094, 2023-09-21T13:14:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 61286, 2023-09-21T13:14:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2023-09-21T13:14:12.109 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2023-09-21T13:14:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.110 INFO:teuthology.orchestra.run.smithi142.stdout: "objecter": { 2023-09-21T13:14:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: "op_active": 0, 2023-09-21T13:14:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: "op_laggy": 0, 2023-09-21T13:14:12.111 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send": 56901, 2023-09-21T13:14:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: "op_send_bytes": 519254085, 2023-09-21T13:14:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: "op_resend": 25, 2023-09-21T13:14:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: "op_reply": 56901, 2023-09-21T13:14:12.112 INFO:teuthology.orchestra.run.smithi142.stdout: "op_latency": { 2023-09-21T13:14:12.113 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 56901, 2023-09-21T13:14:12.113 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 439.985379134, 2023-09-21T13:14:12.113 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.007732471 2023-09-21T13:14:12.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.114 INFO:teuthology.orchestra.run.smithi142.stdout: "op_inflight": 0, 2023-09-21T13:14:12.114 INFO:teuthology.orchestra.run.smithi142.stdout: "oplen_avg": { 2023-09-21T13:14:12.115 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 56901, 2023-09-21T13:14:12.115 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 57484 2023-09-21T13:14:12.115 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.115 INFO:teuthology.orchestra.run.smithi142.stdout: "op": 56901, 2023-09-21T13:14:12.116 INFO:teuthology.orchestra.run.smithi142.stdout: "op_r": 891, 2023-09-21T13:14:12.116 INFO:teuthology.orchestra.run.smithi142.stdout: "op_w": 56010, 2023-09-21T13:14:12.116 INFO:teuthology.orchestra.run.smithi142.stdout: "op_rmw": 0, 2023-09-21T13:14:12.117 INFO:teuthology.orchestra.run.smithi142.stdout: "op_pg": 0, 2023-09-21T13:14:12.117 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_stat": 8, 2023-09-21T13:14:12.117 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_create": 21, 2023-09-21T13:14:12.117 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_read": 652, 2023-09-21T13:14:12.118 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_write": 32309, 2023-09-21T13:14:12.118 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writefull": 368, 2023-09-21T13:14:12.118 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_writesame": 0, 2023-09-21T13:14:12.119 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_append": 0, 2023-09-21T13:14:12.119 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_zero": 0, 2023-09-21T13:14:12.119 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_truncate": 15, 2023-09-21T13:14:12.119 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_delete": 22950, 2023-09-21T13:14:12.120 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_mapext": 0, 2023-09-21T13:14:12.120 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:12.120 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:12.121 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_getxattr": 231, 2023-09-21T13:14:12.121 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_setxattr": 42, 2023-09-21T13:14:12.121 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:12.121 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:12.122 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:12.122 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_call": 0, 2023-09-21T13:14:12.122 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_watch": 0, 2023-09-21T13:14:12.123 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_notify": 0, 2023-09-21T13:14:12.123 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:12.123 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls": 0, 2023-09-21T13:14:12.123 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:12.124 INFO:teuthology.orchestra.run.smithi142.stdout: "osdop_other": 0, 2023-09-21T13:14:12.124 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_active": 0, 2023-09-21T13:14:12.124 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_send": 0, 2023-09-21T13:14:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_resend": 0, 2023-09-21T13:14:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "linger_ping": 0, 2023-09-21T13:14:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_active": 0, 2023-09-21T13:14:12.125 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_send": 0, 2023-09-21T13:14:12.126 INFO:teuthology.orchestra.run.smithi142.stdout: "poolop_resend": 0, 2023-09-21T13:14:12.126 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_active": 0, 2023-09-21T13:14:12.126 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_send": 0, 2023-09-21T13:14:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: "poolstat_resend": 0, 2023-09-21T13:14:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_active": 0, 2023-09-21T13:14:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_send": 0, 2023-09-21T13:14:12.127 INFO:teuthology.orchestra.run.smithi142.stdout: "statfs_resend": 0, 2023-09-21T13:14:12.128 INFO:teuthology.orchestra.run.smithi142.stdout: "command_active": 0, 2023-09-21T13:14:12.128 INFO:teuthology.orchestra.run.smithi142.stdout: "command_send": 0, 2023-09-21T13:14:12.128 INFO:teuthology.orchestra.run.smithi142.stdout: "command_resend": 0, 2023-09-21T13:14:12.129 INFO:teuthology.orchestra.run.smithi142.stdout: "map_epoch": 114, 2023-09-21T13:14:12.129 INFO:teuthology.orchestra.run.smithi142.stdout: "map_full": 0, 2023-09-21T13:14:12.129 INFO:teuthology.orchestra.run.smithi142.stdout: "map_inc": 30, 2023-09-21T13:14:12.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_sessions": 12, 2023-09-21T13:14:12.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_open": 12, 2023-09-21T13:14:12.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_session_close": 0, 2023-09-21T13:14:12.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_laggy": 0, 2023-09-21T13:14:12.131 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_wr": 671, 2023-09-21T13:14:12.131 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_rd": 16, 2023-09-21T13:14:12.131 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_del": 201 2023-09-21T13:14:12.131 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.132 INFO:teuthology.orchestra.run.smithi142.stdout: "oft": { 2023-09-21T13:14:12.132 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_objs": 1, 2023-09-21T13:14:12.132 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:12.133 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_updates": 0, 2023-09-21T13:14:12.133 INFO:teuthology.orchestra.run.smithi142.stdout: "omap_total_removes": 0 2023-09-21T13:14:12.133 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.133 INFO:teuthology.orchestra.run.smithi142.stdout: "osd-slow-ops": { 2023-09-21T13:14:12.134 INFO:teuthology.orchestra.run.smithi142.stdout: "slow_ops_count": 3 2023-09-21T13:14:12.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.134 INFO:teuthology.orchestra.run.smithi142.stdout: "purge_queue": { 2023-09-21T13:14:12.135 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:12.135 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_ops_high_water": 10, 2023-09-21T13:14:12.135 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing": 0, 2023-09-21T13:14:12.136 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executing_high_water": 10, 2023-09-21T13:14:12.136 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_executed": 22704, 2023-09-21T13:14:12.136 INFO:teuthology.orchestra.run.smithi142.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:12.136 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.137 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:12.137 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:12.137 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2023-09-21T13:14:12.138 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:12.138 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 2473536, 2023-09-21T13:14:12.138 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 250904161, 2023-09-21T13:14:12.138 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:12.139 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 2473536, 2023-09-21T13:14:12.139 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:12.139 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:12.140 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 2473536, 2023-09-21T13:14:12.140 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 250904161, 2023-09-21T13:14:12.140 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:12.141 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.141 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.141 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.141 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.142 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.142 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:12.142 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:12.142 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2023-09-21T13:14:12.143 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:12.143 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2023-09-21T13:14:12.143 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2023-09-21T13:14:12.144 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:12.144 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:12.144 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 56901, 2023-09-21T13:14:12.144 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 521550861, 2023-09-21T13:14:12.145 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 56901, 2023-09-21T13:14:12.145 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 521550861, 2023-09-21T13:14:12.145 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:12.145 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.146 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.146 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.146 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.147 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.147 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:12.147 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:12.147 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 1024, 2023-09-21T13:14:12.148 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:12.148 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 0, 2023-09-21T13:14:12.148 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 0, 2023-09-21T13:14:12.148 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:12.149 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:12.149 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 56901, 2023-09-21T13:14:12.149 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 56901, 2023-09-21T13:14:12.149 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 56901, 2023-09-21T13:14:12.150 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 56901, 2023-09-21T13:14:12.150 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:12.150 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.151 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.151 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.151 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.151 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.152 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:12.152 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:12.152 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2023-09-21T13:14:12.153 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:12.153 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 22704, 2023-09-21T13:14:12.153 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 2296904, 2023-09-21T13:14:12.153 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:12.154 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 22704, 2023-09-21T13:14:12.154 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:12.154 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:12.154 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 652, 2023-09-21T13:14:12.155 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 2296904, 2023-09-21T13:14:12.155 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:12.155 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.156 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.156 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.156 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.157 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:12.157 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-write_buf_throttle-0x5630dcc946e0": { 2023-09-21T13:14:12.157 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 19884, 2023-09-21T13:14:12.157 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 3758096384, 2023-09-21T13:14:12.158 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:12.158 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 157987, 2023-09-21T13:14:12.158 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 514016100, 2023-09-21T13:14:12.159 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:12.159 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 157987, 2023-09-21T13:14:12.159 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:12.159 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 31657, 2023-09-21T13:14:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 513996216, 2023-09-21T13:14:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:12.160 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:12.161 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:12.161 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:12.161 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.162 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:12.162 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:14:12.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:12 smithi156 ceph-mon[134078]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:12.399 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:12 smithi142 ceph-mon[97663]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:12.411 INFO:tasks.check_counter:Daemon mds.a mds.exported=2 2023-09-21T13:14:12.412 INFO:tasks.check_counter:Daemon mds.a mds.imported=10 2023-09-21T13:14:12.412 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=7 2023-09-21T13:14:12.413 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2023-09-21T13:14:12.413 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2023-09-21T13:14:12.413 DEBUG:tasks.check_counter:Getting stats from d 2023-09-21T13:14:12.414 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.d perf dump 2023-09-21T13:14:12.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:12 smithi160 ceph-mon[134450]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 115 KiB/s wr, 30 op/s 2023-09-21T13:14:13.145 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T13:14:14.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:14 smithi142 ceph-mon[97663]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:14.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:14 smithi156 ceph-mon[134078]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:14.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:14 smithi160 ceph-mon[134450]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:14.860 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:14:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 0, 2023-09-21T13:14:14.861 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 2, 2023-09-21T13:14:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 0, 2023-09-21T13:14:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 0, 2023-09-21T13:14:14.862 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.003464787, 2023-09-21T13:14:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000000000, 2023-09-21T13:14:14.863 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.000743710, 2023-09-21T13:14:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:14.864 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.865 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:14.866 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:14.866 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:14.867 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:14.867 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.868 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 342, 2023-09-21T13:14:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 329, 2023-09-21T13:14:14.869 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 1588288, 2023-09-21T13:14:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 197664, 2023-09-21T13:14:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:14.870 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.056068263, 2023-09-21T13:14:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.016071492, 2023-09-21T13:14:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.041087108, 2023-09-21T13:14:14.871 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.007270451, 2023-09-21T13:14:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 329, 2023-09-21T13:14:14.872 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.021382835, 2023-09-21T13:14:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000064993 2023-09-21T13:14:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:14.873 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:14.874 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:14.874 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:14.875 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.875 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 1588288, 2023-09-21T13:14:14.875 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 197664 2023-09-21T13:14:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:14.876 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 3, 2023-09-21T13:14:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 250, 2023-09-21T13:14:14.877 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 480, 2023-09-21T13:14:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 273680, 2023-09-21T13:14:14.878 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 6, 2023-09-21T13:14:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.023370437, 2023-09-21T13:14:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.015707751, 2023-09-21T13:14:14.879 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.003424051, 2023-09-21T13:14:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 247, 2023-09-21T13:14:14.880 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.032358815, 2023-09-21T13:14:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000131007 2023-09-21T13:14:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:14.881 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:14.882 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-21T13:14:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 273680 2023-09-21T13:14:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.883 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2023-09-21T13:14:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2023-09-21T13:14:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2023-09-21T13:14:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.884 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2023-09-21T13:14:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:14.885 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:14.886 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:14.887 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:14.888 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:14.889 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:14.890 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:14.891 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:14.892 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2023-09-21T13:14:14.893 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:14.894 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 148754, 2023-09-21T13:14:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 31, 2023-09-21T13:14:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:14.895 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2023-09-21T13:14:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2023-09-21T13:14:14.896 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:14.897 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2023-09-21T13:14:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:14.898 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2023-09-21T13:14:14.899 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2023-09-21T13:14:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2023-09-21T13:14:14.900 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2023-09-21T13:14:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:14.901 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2023-09-21T13:14:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 341, 2023-09-21T13:14:14.902 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1537674, 2023-09-21T13:14:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 341, 2023-09-21T13:14:14.903 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 341, 2023-09-21T13:14:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1537674, 2023-09-21T13:14:14.904 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:14.905 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:14.906 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:14.906 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:14:15.437 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-09-21T13:14:15.438 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-09-21T13:14:15.438 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-09-21T13:14:15.438 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-09-21T13:14:15.439 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-09-21T13:14:15.439 DEBUG:tasks.check_counter:Getting stats from g 2023-09-21T13:14:15.439 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.g perf dump 2023-09-21T13:14:16.165 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T13:14:16.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:16 smithi156 ceph-mon[134078]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:16.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:16 smithi142 ceph-mon[97663]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:16.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:16 smithi160 ceph-mon[134450]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 240 KiB/s wr, 23 op/s 2023-09-21T13:14:18.031 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:17 smithi142 ceph-mon[97663]: osdmap e115: 12 total, 12 up, 12 in 2023-09-21T13:14:18.032 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:17 smithi142 ceph-mon[97663]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:18.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:17 smithi156 ceph-mon[134078]: osdmap e115: 12 total, 12 up, 12 in 2023-09-21T13:14:18.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:17 smithi156 ceph-mon[134078]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:18.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:17 smithi160 ceph-mon[134450]: osdmap e115: 12 total, 12 up, 12 in 2023-09-21T13:14:18.181 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:17 smithi160 ceph-mon[134450]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:19.092 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:14:19.093 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:19.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 0, 2023-09-21T13:14:19.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 2, 2023-09-21T13:14:19.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 0, 2023-09-21T13:14:19.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 0, 2023-09-21T13:14:19.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:19.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:19.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.003330174, 2023-09-21T13:14:19.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000000000, 2023-09-21T13:14:19.096 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.000571821, 2023-09-21T13:14:19.096 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:19.096 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:19.096 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:19.097 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:19.097 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:19.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.098 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:19.098 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:19.098 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:19.099 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:19.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.099 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:19.099 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:19.100 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.100 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:19.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 339, 2023-09-21T13:14:19.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 326, 2023-09-21T13:14:19.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 1587472, 2023-09-21T13:14:19.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 195792, 2023-09-21T13:14:19.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:19.102 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:19.102 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.063147542, 2023-09-21T13:14:19.102 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.023038820, 2023-09-21T13:14:19.103 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.042782240, 2023-09-21T13:14:19.103 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.006983923, 2023-09-21T13:14:19.103 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:19.103 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 326, 2023-09-21T13:14:19.104 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.024527280, 2023-09-21T13:14:19.104 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000075237 2023-09-21T13:14:19.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.105 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:19.105 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:19.105 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:19.106 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:19.106 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.106 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 1587472, 2023-09-21T13:14:19.107 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 195792 2023-09-21T13:14:19.107 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.107 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:19.107 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 3, 2023-09-21T13:14:19.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 248, 2023-09-21T13:14:19.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 480, 2023-09-21T13:14:19.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 273328, 2023-09-21T13:14:19.109 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 6, 2023-09-21T13:14:19.109 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:19.110 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.025259694, 2023-09-21T13:14:19.110 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.017008332, 2023-09-21T13:14:19.110 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.004201140, 2023-09-21T13:14:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 245, 2023-09-21T13:14:19.111 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.020388936, 2023-09-21T13:14:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000083220 2023-09-21T13:14:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.112 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:19.113 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-21T13:14:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 273328 2023-09-21T13:14:19.114 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2023-09-21T13:14:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2023-09-21T13:14:19.115 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2023-09-21T13:14:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2023-09-21T13:14:19.116 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:19.117 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:19.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:19.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:19.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:19.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:19.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:19.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:19.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:19.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:19.121 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:19.121 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:19.121 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:19.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:19.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:19.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:19.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:19.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:19.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:19.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:19.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:19.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:19.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:19.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:19.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:19.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:19.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2023-09-21T13:14:19.126 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:19.126 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:19.126 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:19.127 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:19.127 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 150776, 2023-09-21T13:14:19.127 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 32, 2023-09-21T13:14:19.128 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:19.128 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:19.128 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2023-09-21T13:14:19.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2023-09-21T13:14:19.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:19.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:19.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:19.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:19.130 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:19.131 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2023-09-21T13:14:19.131 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:19.131 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:19.131 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:19.132 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2023-09-21T13:14:19.132 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:19.132 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2023-09-21T13:14:19.133 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:19.133 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2023-09-21T13:14:19.133 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:19.133 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2023-09-21T13:14:19.134 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:19.134 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:19.134 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:19.135 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2023-09-21T13:14:19.135 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:19.135 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 338, 2023-09-21T13:14:19.136 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1537284, 2023-09-21T13:14:19.136 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:19.136 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 338, 2023-09-21T13:14:19.136 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:19.137 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:19.137 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 338, 2023-09-21T13:14:19.137 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1537284, 2023-09-21T13:14:19.138 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:19.138 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:19.138 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:19.139 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:19.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:19.139 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:19.139 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:14:19.666 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-09-21T13:14:19.666 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-09-21T13:14:19.667 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-09-21T13:14:19.667 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-09-21T13:14:19.667 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-09-21T13:14:19.668 DEBUG:tasks.check_counter:Getting stats from j 2023-09-21T13:14:19.668 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.j perf dump 2023-09-21T13:14:20.397 INFO:teuthology.orchestra.run.smithi142.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-21T13:14:20.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:20 smithi156 ceph-mon[134078]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:20.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:20 smithi142 ceph-mon[97663]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:20.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:20 smithi160 ceph-mon[134450]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:22.092 INFO:teuthology.orchestra.run.smithi142.stdout:{ 2023-09-21T13:14:22.092 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:22.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 4, 2023-09-21T13:14:22.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 4, 2023-09-21T13:14:22.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 2944, 2023-09-21T13:14:22.093 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 448, 2023-09-21T13:14:22.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:22.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:22.094 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.003668736, 2023-09-21T13:14:22.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.000055321, 2023-09-21T13:14:22.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.001168442, 2023-09-21T13:14:22.095 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:22.096 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:22.096 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 3, 2023-09-21T13:14:22.096 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.001191579, 2023-09-21T13:14:22.096 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000397193 2023-09-21T13:14:22.097 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.097 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:22.097 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:22.098 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:22.098 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:22.098 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.098 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-21T13:14:22.099 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 448 2023-09-21T13:14:22.099 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.099 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:22.099 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 2, 2023-09-21T13:14:22.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 252, 2023-09-21T13:14:22.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 320, 2023-09-21T13:14:22.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 197296, 2023-09-21T13:14:22.100 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:22.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:22.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.023367043, 2023-09-21T13:14:22.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.016177705, 2023-09-21T13:14:22.101 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.003175506, 2023-09-21T13:14:22.102 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:22.102 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:22.102 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 249, 2023-09-21T13:14:22.103 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.025027245, 2023-09-21T13:14:22.103 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000100511 2023-09-21T13:14:22.103 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.103 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:22.104 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:22.104 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:22.104 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:22.104 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.105 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 320, 2023-09-21T13:14:22.105 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 197296 2023-09-21T13:14:22.105 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.106 INFO:teuthology.orchestra.run.smithi142.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:22.106 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_messages": 340, 2023-09-21T13:14:22.106 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages": 329, 2023-09-21T13:14:22.106 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_bytes": 1585888, 2023-09-21T13:14:22.107 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_bytes": 198464, 2023-09-21T13:14:22.107 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:22.107 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:22.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_total_time": 0.063518175, 2023-09-21T13:14:22.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_send_time": 0.023310099, 2023-09-21T13:14:22.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_recv_time": 0.042605661, 2023-09-21T13:14:22.108 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_running_fast_dispatch_time": 0.007176575, 2023-09-21T13:14:22.109 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:22.109 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 328, 2023-09-21T13:14:22.109 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.024547017, 2023-09-21T13:14:22.109 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000074838 2023-09-21T13:14:22.110 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.110 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:22.110 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:22.111 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:22.111 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:22.111 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.111 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_recv_encrypted_bytes": 1585888, 2023-09-21T13:14:22.112 INFO:teuthology.orchestra.run.smithi142.stdout: "msgr_send_encrypted_bytes": 198464 2023-09-21T13:14:22.112 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.112 INFO:teuthology.orchestra.run.smithi142.stdout: "cct": { 2023-09-21T13:14:22.112 INFO:teuthology.orchestra.run.smithi142.stdout: "total_workers": 0, 2023-09-21T13:14:22.113 INFO:teuthology.orchestra.run.smithi142.stdout: "unhealthy_workers": 0 2023-09-21T13:14:22.113 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.113 INFO:teuthology.orchestra.run.smithi142.stdout: "mempool": { 2023-09-21T13:14:22.114 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:22.114 INFO:teuthology.orchestra.run.smithi142.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:22.114 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:22.115 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:22.115 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:22.115 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:22.116 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:22.116 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:22.116 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:22.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:22.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:22.118 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:22.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:22.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:22.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:22.119 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:22.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:22.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:22.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:22.120 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:22.121 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:22.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:22.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:22.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:22.122 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:22.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:22.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:22.123 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:22.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:22.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:22.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:22.124 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_items": 0, 2023-09-21T13:14:22.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:22.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:22.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:22.125 INFO:teuthology.orchestra.run.smithi142.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:22.126 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_bytes": 148977, 2023-09-21T13:14:22.126 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_anon_items": 30, 2023-09-21T13:14:22.126 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:22.127 INFO:teuthology.orchestra.run.smithi142.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:22.127 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_bytes": 0, 2023-09-21T13:14:22.127 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_items": 0, 2023-09-21T13:14:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:22.128 INFO:teuthology.orchestra.run.smithi142.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:22.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:22.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_items": 0, 2023-09-21T13:14:22.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:22.129 INFO:teuthology.orchestra.run.smithi142.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:22.130 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:22.130 INFO:teuthology.orchestra.run.smithi142.stdout: "pgmap_items": 0, 2023-09-21T13:14:22.130 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:22.131 INFO:teuthology.orchestra.run.smithi142.stdout: "mds_co_items": 2, 2023-09-21T13:14:22.131 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:22.131 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_1_items": 0, 2023-09-21T13:14:22.131 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:22.132 INFO:teuthology.orchestra.run.smithi142.stdout: "unittest_2_items": 0 2023-09-21T13:14:22.132 INFO:teuthology.orchestra.run.smithi142.stdout: }, 2023-09-21T13:14:22.132 INFO:teuthology.orchestra.run.smithi142.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:22.133 INFO:teuthology.orchestra.run.smithi142.stdout: "val": 0, 2023-09-21T13:14:22.133 INFO:teuthology.orchestra.run.smithi142.stdout: "max": 104857600, 2023-09-21T13:14:22.133 INFO:teuthology.orchestra.run.smithi142.stdout: "get_started": 0, 2023-09-21T13:14:22.133 INFO:teuthology.orchestra.run.smithi142.stdout: "get": 342, 2023-09-21T13:14:22.134 INFO:teuthology.orchestra.run.smithi142.stdout: "get_sum": 1537907, 2023-09-21T13:14:22.134 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:22.134 INFO:teuthology.orchestra.run.smithi142.stdout: "get_or_fail_success": 342, 2023-09-21T13:14:22.135 INFO:teuthology.orchestra.run.smithi142.stdout: "take": 0, 2023-09-21T13:14:22.135 INFO:teuthology.orchestra.run.smithi142.stdout: "take_sum": 0, 2023-09-21T13:14:22.135 INFO:teuthology.orchestra.run.smithi142.stdout: "put": 342, 2023-09-21T13:14:22.135 INFO:teuthology.orchestra.run.smithi142.stdout: "put_sum": 1537907, 2023-09-21T13:14:22.136 INFO:teuthology.orchestra.run.smithi142.stdout: "wait": { 2023-09-21T13:14:22.136 INFO:teuthology.orchestra.run.smithi142.stdout: "avgcount": 0, 2023-09-21T13:14:22.136 INFO:teuthology.orchestra.run.smithi142.stdout: "sum": 0.000000000, 2023-09-21T13:14:22.137 INFO:teuthology.orchestra.run.smithi142.stdout: "avgtime": 0.000000000 2023-09-21T13:14:22.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:22.137 INFO:teuthology.orchestra.run.smithi142.stdout: } 2023-09-21T13:14:22.137 INFO:teuthology.orchestra.run.smithi142.stdout:} 2023-09-21T13:14:22.138 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:22 smithi142 ceph-mon[97663]: pgmap v575: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:22.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:22 smithi156 ceph-mon[134078]: pgmap v575: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:22.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:22 smithi160 ceph-mon[134450]: pgmap v575: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 281 KiB/s rd, 281 KiB/s wr, 23 op/s 2023-09-21T13:14:22.693 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-09-21T13:14:22.694 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-09-21T13:14:22.694 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-09-21T13:14:22.695 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-09-21T13:14:22.695 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-09-21T13:14:22.695 DEBUG:tasks.check_counter:Getting stats from b 2023-09-21T13:14:22.696 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.b perf dump 2023-09-21T13:14:23.309 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T13:14:24.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:24 smithi156 ceph-mon[134078]: pgmap v576: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:24.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:24 smithi142 ceph-mon[97663]: pgmap v576: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:24.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:24 smithi160 ceph-mon[134450]: pgmap v576: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:24.669 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-21T13:14:24.670 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:24.670 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 2219663, 2023-09-21T13:14:24.670 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2255484, 2023-09-21T13:14:24.671 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 371277423, 2023-09-21T13:14:24.671 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 832377793, 2023-09-21T13:14:24.671 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 292, 2023-09-21T13:14:24.672 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-09-21T13:14:24.672 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 64.967005755, 2023-09-21T13:14:24.672 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 25.077355708, 2023-09-21T13:14:24.672 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 42.748019542, 2023-09-21T13:14:24.673 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 2.076897600, 2023-09-21T13:14:24.673 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:24.673 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2255486, 2023-09-21T13:14:24.674 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 58.299345556, 2023-09-21T13:14:24.674 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000025847 2023-09-21T13:14:24.674 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.674 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:24.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4322232, 2023-09-21T13:14:24.675 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.340775581, 2023-09-21T13:14:24.675 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000078 2023-09-21T13:14:24.676 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.676 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 42512, 2023-09-21T13:14:24.676 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 1088 2023-09-21T13:14:24.676 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.677 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:24.677 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 415562, 2023-09-21T13:14:24.677 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 616471, 2023-09-21T13:14:24.678 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 137250388, 2023-09-21T13:14:24.678 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 692607877, 2023-09-21T13:14:24.678 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 15, 2023-09-21T13:14:24.678 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 5, 2023-09-21T13:14:24.679 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 21.530861861, 2023-09-21T13:14:24.679 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 9.241859466, 2023-09-21T13:14:24.679 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 13.687037228, 2023-09-21T13:14:24.680 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 1.756123086, 2023-09-21T13:14:24.680 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:24.680 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 616468, 2023-09-21T13:14:24.680 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 72.181440201, 2023-09-21T13:14:24.681 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000117088 2023-09-21T13:14:24.681 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.681 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:24.682 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 749453, 2023-09-21T13:14:24.683 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.108044071, 2023-09-21T13:14:24.683 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000144 2023-09-21T13:14:24.683 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.684 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 98176, 2023-09-21T13:14:24.684 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 638400 2023-09-21T13:14:24.684 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.685 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:24.685 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 224695, 2023-09-21T13:14:24.685 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 246822, 2023-09-21T13:14:24.685 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 55780992, 2023-09-21T13:14:24.686 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 273981778, 2023-09-21T13:14:24.686 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 25, 2023-09-21T13:14:24.686 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 8, 2023-09-21T13:14:24.687 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 11.275933496, 2023-09-21T13:14:24.687 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 4.333298215, 2023-09-21T13:14:24.687 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 6.567253263, 2023-09-21T13:14:24.688 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 1.195073727, 2023-09-21T13:14:24.688 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:24.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 246818, 2023-09-21T13:14:24.689 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 32.809185707, 2023-09-21T13:14:24.689 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000132928 2023-09-21T13:14:24.690 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.690 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:24.690 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 394669, 2023-09-21T13:14:24.690 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.046619590, 2023-09-21T13:14:24.691 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000118 2023-09-21T13:14:24.691 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.691 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2358656, 2023-09-21T13:14:24.692 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 414048 2023-09-21T13:14:24.692 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.692 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-09-21T13:14:24.693 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-09-21T13:14:24.693 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-09-21T13:14:24.693 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.694 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-09-21T13:14:24.694 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-09-21T13:14:24.694 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-09-21T13:14:24.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 178867, 2023-09-21T13:14:24.695 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 142.355268051, 2023-09-21T13:14:24.695 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000795872 2023-09-21T13:14:24.695 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.696 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.696 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:24.696 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-09-21T13:14:24.697 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-09-21T13:14:24.697 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 59070, 2023-09-21T13:14:24.697 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 9.779399346, 2023-09-21T13:14:24.697 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000165556 2023-09-21T13:14:24.698 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.698 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.699 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-09-21T13:14:24.699 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 250931, 2023-09-21T13:14:24.699 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 227721, 2023-09-21T13:14:24.700 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-09-21T13:14:24.700 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 227721, 2023-09-21T13:14:24.700 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1118.286042371, 2023-09-21T13:14:24.700 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004910772 2023-09-21T13:14:24.701 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.701 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-09-21T13:14:24.701 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 23210, 2023-09-21T13:14:24.702 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 23, 2023-09-21T13:14:24.702 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 6, 2023-09-21T13:14:24.702 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 3177, 2023-09-21T13:14:24.702 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 19, 2023-09-21T13:14:24.705 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 31, 2023-09-21T13:14:24.706 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 1695, 2023-09-21T13:14:24.706 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 885, 2023-09-21T13:14:24.706 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 563, 2023-09-21T13:14:24.707 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 247, 2023-09-21T13:14:24.707 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 430, 2023-09-21T13:14:24.707 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 2432, 2023-09-21T13:14:24.707 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 181, 2023-09-21T13:14:24.708 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 181, 2023-09-21T13:14:24.708 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 17, 2023-09-21T13:14:24.708 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 361765, 2023-09-21T13:14:24.709 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 245789, 2023-09-21T13:14:24.709 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 23201, 2023-09-21T13:14:24.709 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 17, 2023-09-21T13:14:24.709 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 5, 2023-09-21T13:14:24.710 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:24.710 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 2820, 2023-09-21T13:14:24.710 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 17903, 2023-09-21T13:14:24.711 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-09-21T13:14:24.711 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 22, 2023-09-21T13:14:24.711 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 1653, 2023-09-21T13:14:24.711 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 4, 2023-09-21T13:14:24.712 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 159, 2023-09-21T13:14:24.712 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:24.712 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 595, 2023-09-21T13:14:24.713 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-09-21T13:14:24.713 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 734, 2023-09-21T13:14:24.713 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 226086822, 2023-09-21T13:14:24.713 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 7, 2023-09-21T13:14:24.714 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 595, 2023-09-21T13:14:24.714 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:24.714 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:24.715 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:24.715 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 232, 2023-09-21T13:14:24.715 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 13, 2023-09-21T13:14:24.716 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 219, 2023-09-21T13:14:24.716 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 363, 2023-09-21T13:14:24.716 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 16, 2023-09-21T13:14:24.716 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 39410, 2023-09-21T13:14:24.717 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 145304, 2023-09-21T13:14:24.717 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:24.717 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 2916, 2023-09-21T13:14:24.718 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:24.718 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 92514, 2023-09-21T13:14:24.718 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 40623, 2023-09-21T13:14:24.719 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 8025, 2023-09-21T13:14:24.719 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 121049 2023-09-21T13:14:24.719 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.719 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-09-21T13:14:24.720 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 10, 2023-09-21T13:14:24.720 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 15, 2023-09-21T13:14:24.720 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 10, 2023-09-21T13:14:24.720 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 22, 2023-09-21T13:14:24.721 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 230, 2023-09-21T13:14:24.721 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-09-21T13:14:24.721 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:24.722 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:24.722 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 36289, 2023-09-21T13:14:24.722 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 36289, 2023-09-21T13:14:24.723 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:24.723 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-09-21T13:14:24.723 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:24.723 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:24.724 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:24.724 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-09-21T13:14:24.724 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-09-21T13:14:24.725 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 13, 2023-09-21T13:14:24.725 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 22, 2023-09-21T13:14:24.725 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-09-21T13:14:24.726 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 50, 2023-09-21T13:14:24.726 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:24.726 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-09-21T13:14:24.726 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.727 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-09-21T13:14:24.727 INFO:teuthology.orchestra.run.smithi156.stdout: "evlrg": 0, 2023-09-21T13:14:24.727 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 208383, 2023-09-21T13:14:24.728 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 207525, 2023-09-21T13:14:24.728 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 207525, 2023-09-21T13:14:24.728 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 858, 2023-09-21T13:14:24.728 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-09-21T13:14:24.729 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 3481, 2023-09-21T13:14:24.729 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 367, 2023-09-21T13:14:24.729 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 365, 2023-09-21T13:14:24.729 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 365, 2023-09-21T13:14:24.730 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 2, 2023-09-21T13:14:24.730 INFO:teuthology.orchestra.run.smithi156.stdout: "segmjr": 1, 2023-09-21T13:14:24.730 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-09-21T13:14:24.731 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 6, 2023-09-21T13:14:24.731 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 868906475, 2023-09-21T13:14:24.731 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 873651526, 2023-09-21T13:14:24.732 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 0, 2023-09-21T13:14:24.732 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-09-21T13:14:24.732 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 94859, 2023-09-21T13:14:24.732 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 492.115470087, 2023-09-21T13:14:24.733 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.005187862 2023-09-21T13:14:24.733 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.733 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 0 2023-09-21T13:14:24.734 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.734 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-09-21T13:14:24.734 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 684, 2023-09-21T13:14:24.735 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 38576, 2023-09-21T13:14:24.735 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 37892, 2023-09-21T13:14:24.735 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 155, 2023-09-21T13:14:24.736 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 465, 2023-09-21T13:14:24.736 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 310, 2023-09-21T13:14:24.736 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 1695, 2023-09-21T13:14:24.736 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 73955, 2023-09-21T13:14:24.737 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 72260, 2023-09-21T13:14:24.737 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 181, 2023-09-21T13:14:24.737 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 38241, 2023-09-21T13:14:24.737 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 38060, 2023-09-21T13:14:24.738 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 84804, 2023-09-21T13:14:24.738 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-09-21T13:14:24.738 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.739 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-09-21T13:14:24.739 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 355806, 2023-09-21T13:14:24.739 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 35940, 2023-09-21T13:14:24.739 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 250931, 2023-09-21T13:14:24.740 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 7041, 2023-09-21T13:14:24.740 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 71894, 2023-09-21T13:14:24.740 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-09-21T13:14:24.741 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 37040, 2023-09-21T13:14:24.741 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 116.106683870, 2023-09-21T13:14:24.741 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.003134629 2023-09-21T13:14:24.741 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.742 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-09-21T13:14:24.742 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 39326, 2023-09-21T13:14:24.742 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 296.908610009, 2023-09-21T13:14:24.743 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.007549931 2023-09-21T13:14:24.743 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.743 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:24.743 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.744 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.744 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.744 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.745 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-09-21T13:14:24.745 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.745 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.745 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.746 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.746 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-09-21T13:14:24.746 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 50126, 2023-09-21T13:14:24.747 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 114.421112045, 2023-09-21T13:14:24.747 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002282669 2023-09-21T13:14:24.747 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.748 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:24.748 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.748 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.748 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.749 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.749 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-09-21T13:14:24.749 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1, 2023-09-21T13:14:24.749 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000162720, 2023-09-21T13:14:24.750 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000162720 2023-09-21T13:14:24.750 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.750 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-09-21T13:14:24.751 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.751 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.751 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.752 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.752 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:24.752 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.752 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.753 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.753 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.753 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:24.754 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.754 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.754 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.755 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.755 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-09-21T13:14:24.755 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 18, 2023-09-21T13:14:24.755 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.007392385, 2023-09-21T13:14:24.756 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000410688 2023-09-21T13:14:24.756 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.756 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-09-21T13:14:24.757 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 119, 2023-09-21T13:14:24.757 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.766472784, 2023-09-21T13:14:24.757 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.006440947 2023-09-21T13:14:24.758 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.758 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-09-21T13:14:24.758 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.758 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.759 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.759 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.759 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-09-21T13:14:24.760 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 18, 2023-09-21T13:14:24.760 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.394637524, 2023-09-21T13:14:24.760 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.021924306 2023-09-21T13:14:24.760 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.761 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-09-21T13:14:24.761 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 9, 2023-09-21T13:14:24.761 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.014044245, 2023-09-21T13:14:24.762 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001560471 2023-09-21T13:14:24.762 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.762 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-09-21T13:14:24.763 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 53666, 2023-09-21T13:14:24.763 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 405.555515962, 2023-09-21T13:14:24.763 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.007557028 2023-09-21T13:14:24.763 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.764 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-09-21T13:14:24.764 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 9853, 2023-09-21T13:14:24.764 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 29.346453045, 2023-09-21T13:14:24.765 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002978428 2023-09-21T13:14:24.765 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.765 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:24.765 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.766 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.766 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.766 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.767 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:24.767 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.767 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.768 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.768 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.768 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-09-21T13:14:24.768 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1, 2023-09-21T13:14:24.769 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000906788, 2023-09-21T13:14:24.769 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000906788 2023-09-21T13:14:24.769 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.769 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:24.770 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 11, 2023-09-21T13:14:24.770 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 1.063930764, 2023-09-21T13:14:24.770 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.096720978 2023-09-21T13:14:24.771 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.771 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:24.771 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.771 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.772 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.772 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.772 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-09-21T13:14:24.773 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 42, 2023-09-21T13:14:24.773 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.731694453, 2023-09-21T13:14:24.773 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.017421296 2023-09-21T13:14:24.773 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.774 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:24.774 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.774 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.775 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.775 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.775 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:24.776 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1196, 2023-09-21T13:14:24.776 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2.157620076, 2023-09-21T13:14:24.776 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001804030 2023-09-21T13:14:24.776 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.777 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-09-21T13:14:24.777 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.777 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.777 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.778 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.778 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-09-21T13:14:24.778 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 6, 2023-09-21T13:14:24.779 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.016823870, 2023-09-21T13:14:24.779 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.002803978 2023-09-21T13:14:24.779 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.780 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-09-21T13:14:24.780 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.780 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.780 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.781 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.781 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-09-21T13:14:24.781 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 36289, 2023-09-21T13:14:24.781 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 150.793981831, 2023-09-21T13:14:24.782 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.004155363 2023-09-21T13:14:24.782 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.782 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:24.783 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:24.783 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:24.783 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.784 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.784 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.784 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.784 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.785 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-09-21T13:14:24.785 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 2, 2023-09-21T13:14:24.785 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 5, 2023-09-21T13:14:24.786 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 3, 2023-09-21T13:14:24.786 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 2, 2023-09-21T13:14:24.786 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-09-21T13:14:24.786 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 17942, 2023-09-21T13:14:24.787 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 8971, 2023-09-21T13:14:24.787 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 1073, 2023-09-21T13:14:24.787 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:24.788 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.788 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-09-21T13:14:24.788 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 360, 2023-09-21T13:14:24.788 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 360, 2023-09-21T13:14:24.789 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:24.789 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:24.789 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:24.790 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:24.790 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:24.790 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:24.790 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:24.791 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:24.791 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:24.791 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:24.792 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:24.792 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:24.792 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:24.792 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:24.793 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:24.793 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:24.793 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:24.794 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:24.794 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:24.794 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:24.794 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:24.795 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:24.795 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:24.795 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:24.796 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:24.796 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:24.796 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:24.796 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:24.797 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:24.797 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-09-21T13:14:24.797 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:24.798 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:24.798 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:24.798 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:24.798 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 298922, 2023-09-21T13:14:24.799 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 443, 2023-09-21T13:14:24.799 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:24.799 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:24.800 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-09-21T13:14:24.800 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-09-21T13:14:24.800 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:24.800 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:24.801 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:24.801 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:24.801 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 8032, 2023-09-21T13:14:24.802 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 167, 2023-09-21T13:14:24.802 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:24.802 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:24.803 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:24.803 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-09-21T13:14:24.803 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 3352743, 2023-09-21T13:14:24.803 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 32768, 2023-09-21T13:14:24.804 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:24.804 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-09-21T13:14:24.804 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:24.805 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-09-21T13:14:24.805 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.805 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-09-21T13:14:24.805 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-09-21T13:14:24.806 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-09-21T13:14:24.806 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 157417, 2023-09-21T13:14:24.806 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 904633459, 2023-09-21T13:14:24.807 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 31, 2023-09-21T13:14:24.807 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 157417, 2023-09-21T13:14:24.807 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-09-21T13:14:24.807 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 157417, 2023-09-21T13:14:24.808 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 2853.306728706, 2023-09-21T13:14:24.808 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.018125785 2023-09-21T13:14:24.808 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.809 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-09-21T13:14:24.809 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-09-21T13:14:24.809 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 157417, 2023-09-21T13:14:24.810 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 202196 2023-09-21T13:14:24.810 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.810 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 157417, 2023-09-21T13:14:24.810 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 1536, 2023-09-21T13:14:24.811 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 155881, 2023-09-21T13:14:24.811 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-09-21T13:14:24.811 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-09-21T13:14:24.812 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 2863, 2023-09-21T13:14:24.812 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 18449, 2023-09-21T13:14:24.812 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 899, 2023-09-21T13:14:24.812 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 95745, 2023-09-21T13:14:24.813 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 768, 2023-09-21T13:14:24.813 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-09-21T13:14:24.813 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-09-21T13:14:24.814 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-09-21T13:14:24.814 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 19, 2023-09-21T13:14:24.814 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 37350, 2023-09-21T13:14:24.814 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-09-21T13:14:24.815 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:24.815 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:24.815 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 637, 2023-09-21T13:14:24.816 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 36898, 2023-09-21T13:14:24.816 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:24.816 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:24.816 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:24.817 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-09-21T13:14:24.817 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-09-21T13:14:24.817 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-09-21T13:14:24.817 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:24.818 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-09-21T13:14:24.818 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:24.818 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-09-21T13:14:24.819 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-09-21T13:14:24.819 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-09-21T13:14:24.819 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-09-21T13:14:24.819 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-09-21T13:14:24.820 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-09-21T13:14:24.820 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-09-21T13:14:24.820 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-09-21T13:14:24.821 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-09-21T13:14:24.821 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-09-21T13:14:24.821 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-09-21T13:14:24.821 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-09-21T13:14:24.822 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-09-21T13:14:24.822 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-09-21T13:14:24.822 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-09-21T13:14:24.823 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-09-21T13:14:24.823 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-09-21T13:14:24.823 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 115, 2023-09-21T13:14:24.824 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-09-21T13:14:24.824 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 32, 2023-09-21T13:14:24.824 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 12, 2023-09-21T13:14:24.824 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 12, 2023-09-21T13:14:24.825 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-09-21T13:14:24.825 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-09-21T13:14:24.825 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 6659, 2023-09-21T13:14:24.825 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 58, 2023-09-21T13:14:24.826 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 1851 2023-09-21T13:14:24.826 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.826 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-09-21T13:14:24.827 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 1, 2023-09-21T13:14:24.827 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:24.827 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-09-21T13:14:24.827 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-09-21T13:14:24.828 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.828 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-09-21T13:14:24.828 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 2 2023-09-21T13:14:24.829 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.829 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-09-21T13:14:24.829 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:24.829 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 10, 2023-09-21T13:14:24.830 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-09-21T13:14:24.830 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 10, 2023-09-21T13:14:24.830 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 36289, 2023-09-21T13:14:24.831 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:24.831 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.831 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:24.831 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:24.832 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:24.832 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:24.832 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 2859916, 2023-09-21T13:14:24.833 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 306816021, 2023-09-21T13:14:24.833 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:24.833 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 2859916, 2023-09-21T13:14:24.833 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:24.834 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:24.834 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 2859916, 2023-09-21T13:14:24.834 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 306816021, 2023-09-21T13:14:24.835 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:24.835 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.835 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.835 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.836 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.836 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.836 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:24.837 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:24.837 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:24.837 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:24.837 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:24.838 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:24.838 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:24.838 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:24.839 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 157417, 2023-09-21T13:14:24.839 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 908302592, 2023-09-21T13:14:24.839 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 157417, 2023-09-21T13:14:24.839 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 908302592, 2023-09-21T13:14:24.840 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:24.840 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.840 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.841 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.841 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.841 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.841 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:24.842 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:24.842 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-09-21T13:14:24.842 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:24.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:24.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:24.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:24.843 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:24.844 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 157417, 2023-09-21T13:14:24.844 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 157417, 2023-09-21T13:14:24.844 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 157417, 2023-09-21T13:14:24.845 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 157417, 2023-09-21T13:14:24.845 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:24.845 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.845 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.846 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.846 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.846 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.847 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:24.847 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:24.847 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-09-21T13:14:24.847 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:24.848 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 36289, 2023-09-21T13:14:24.848 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 3669525, 2023-09-21T13:14:24.848 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:24.849 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 36289, 2023-09-21T13:14:24.849 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:24.849 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:24.849 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 886, 2023-09-21T13:14:24.850 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 3669525, 2023-09-21T13:14:24.850 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:24.850 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.851 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.851 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.851 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.851 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:24.852 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x56384b7d86e0": { 2023-09-21T13:14:24.852 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:24.852 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-09-21T13:14:24.852 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:24.853 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 208383, 2023-09-21T13:14:24.853 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 869457222, 2023-09-21T13:14:24.853 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:24.854 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 208383, 2023-09-21T13:14:24.854 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:24.854 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:24.855 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 94859, 2023-09-21T13:14:24.855 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 869457222, 2023-09-21T13:14:24.855 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:24.855 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:24.856 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:24.856 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:24.856 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.857 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:24.857 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-21T13:14:25.068 INFO:tasks.check_counter:Daemon mds.b mds.exported=22 2023-09-21T13:14:25.068 INFO:tasks.check_counter:Daemon mds.b mds.imported=4 2023-09-21T13:14:25.069 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2023-09-21T13:14:25.069 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=18 2023-09-21T13:14:25.069 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=11 2023-09-21T13:14:25.070 DEBUG:tasks.check_counter:Getting stats from e 2023-09-21T13:14:25.070 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.e perf dump 2023-09-21T13:14:25.628 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T13:14:26.147 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:26 smithi156 ceph-mon[134078]: pgmap v577: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:26.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:26 smithi142 ceph-mon[97663]: pgmap v577: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:26.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:26 smithi160 ceph-mon[134450]: pgmap v577: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 96 KiB/s wr, 13 op/s 2023-09-21T13:14:26.900 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-21T13:14:26.900 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:26.901 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 340, 2023-09-21T13:14:26.901 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 329, 2023-09-21T13:14:26.901 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 1585888, 2023-09-21T13:14:26.901 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 198448, 2023-09-21T13:14:26.902 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:26.902 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:26.902 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.051152635, 2023-09-21T13:14:26.903 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.015859949, 2023-09-21T13:14:26.903 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.034878302, 2023-09-21T13:14:26.903 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.007451385, 2023-09-21T13:14:26.903 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:26.904 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 328, 2023-09-21T13:14:26.904 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.012672031, 2023-09-21T13:14:26.904 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000038634 2023-09-21T13:14:26.904 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.905 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:26.905 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:26.905 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1585888, 2023-09-21T13:14:26.906 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 198448 2023-09-21T13:14:26.907 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.907 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:26.907 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 3, 2023-09-21T13:14:26.908 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 253, 2023-09-21T13:14:26.908 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 480, 2023-09-21T13:14:26.908 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 274208, 2023-09-21T13:14:26.908 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-09-21T13:14:26.909 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:26.909 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.012503073, 2023-09-21T13:14:26.909 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007916860, 2023-09-21T13:14:26.910 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.002150418, 2023-09-21T13:14:26.910 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:26.910 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:26.910 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 250, 2023-09-21T13:14:26.911 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.017527924, 2023-09-21T13:14:26.911 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000070111 2023-09-21T13:14:26.911 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.912 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:26.912 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:26.912 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:26.912 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:26.913 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.913 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 480, 2023-09-21T13:14:26.913 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 274208 2023-09-21T13:14:26.914 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.914 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:26.914 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 4, 2023-09-21T13:14:26.914 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 4, 2023-09-21T13:14:26.915 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 2944, 2023-09-21T13:14:26.915 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 448, 2023-09-21T13:14:26.915 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:26.916 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:26.916 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.000725010, 2023-09-21T13:14:26.916 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000035901, 2023-09-21T13:14:26.916 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000664878, 2023-09-21T13:14:26.917 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:26.917 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:26.917 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 3, 2023-09-21T13:14:26.917 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000685701, 2023-09-21T13:14:26.918 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000228567 2023-09-21T13:14:26.918 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.918 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:26.919 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:26.919 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:26.919 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:26.919 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.920 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-21T13:14:26.920 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 448 2023-09-21T13:14:26.920 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.921 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-09-21T13:14:26.921 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2023-09-21T13:14:26.921 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-09-21T13:14:26.921 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.922 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-09-21T13:14:26.922 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:26.922 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:26.923 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:26.923 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:26.923 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:26.923 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:26.924 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:26.924 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:26.924 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:26.925 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:26.925 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:26.925 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:26.925 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:26.926 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:26.926 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:26.926 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:26.926 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:26.927 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:26.927 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:26.927 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:26.928 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:26.928 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:26.928 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:26.928 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:26.929 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:26.929 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:26.929 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:26.930 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:26.930 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:26.930 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:26.930 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:26.931 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-09-21T13:14:26.931 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:26.931 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:26.932 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:26.932 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:26.932 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 148714, 2023-09-21T13:14:26.933 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 30, 2023-09-21T13:14:26.933 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:26.933 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:26.933 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-09-21T13:14:26.934 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-09-21T13:14:26.934 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:26.934 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:26.935 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:26.935 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:26.935 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:26.935 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2023-09-21T13:14:26.936 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:26.936 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:26.936 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:26.936 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-09-21T13:14:26.937 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:26.937 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2023-09-21T13:14:26.937 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:26.938 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-09-21T13:14:26.938 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:26.938 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-09-21T13:14:26.938 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:26.939 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:26.939 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:26.939 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:26.940 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:26.940 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 343, 2023-09-21T13:14:26.940 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 1537934, 2023-09-21T13:14:26.940 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:26.941 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 343, 2023-09-21T13:14:26.941 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:26.941 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:26.941 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 343, 2023-09-21T13:14:26.942 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 1537934, 2023-09-21T13:14:26.942 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:26.942 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:26.943 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:26.943 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:26.943 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:26.943 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:26.944 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-21T13:14:27.385 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2023-09-21T13:14:27.386 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2023-09-21T13:14:27.386 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.e 2023-09-21T13:14:27.387 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.e 2023-09-21T13:14:27.387 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.e 2023-09-21T13:14:27.387 DEBUG:tasks.check_counter:Getting stats from h 2023-09-21T13:14:27.388 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.h perf dump 2023-09-21T13:14:27.946 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T13:14:28.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:27 smithi156 ceph-mon[134078]: pgmap v578: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-09-21T13:14:28.158 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:27 smithi142 ceph-mon[97663]: pgmap v578: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-09-21T13:14:28.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:27 smithi160 ceph-mon[134450]: pgmap v578: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 40 KiB/s wr, 11 op/s 2023-09-21T13:14:29.332 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-21T13:14:29.333 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:29.333 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 2768, 2023-09-21T13:14:29.333 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2770, 2023-09-21T13:14:29.334 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 168598620, 2023-09-21T13:14:29.334 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 860855, 2023-09-21T13:14:29.334 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-09-21T13:14:29.334 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:29.335 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.286626932, 2023-09-21T13:14:29.335 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.059485810, 2023-09-21T13:14:29.335 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.134452154, 2023-09-21T13:14:29.336 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.074676122, 2023-09-21T13:14:29.336 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:29.336 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 2768, 2023-09-21T13:14:29.336 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.092054821, 2023-09-21T13:14:29.337 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000033256 2023-09-21T13:14:29.337 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.337 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:29.338 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.338 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.338 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.339 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.339 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:29.339 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:29.339 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.340 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:29.340 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1513, 2023-09-21T13:14:29.340 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1461, 2023-09-21T13:14:29.341 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 151259139, 2023-09-21T13:14:29.341 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 545167, 2023-09-21T13:14:29.341 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 6, 2023-09-21T13:14:29.342 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 5, 2023-09-21T13:14:29.342 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.193324688, 2023-09-21T13:14:29.342 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.037434193, 2023-09-21T13:14:29.342 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.124835154, 2023-09-21T13:14:29.343 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.033157319, 2023-09-21T13:14:29.343 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:29.343 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1461, 2023-09-21T13:14:29.344 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.058808589, 2023-09-21T13:14:29.344 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000040252 2023-09-21T13:14:29.344 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.344 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:29.345 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.345 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.345 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.345 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.346 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1781712, 2023-09-21T13:14:29.346 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 204560 2023-09-21T13:14:29.346 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.347 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:29.347 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 1017, 2023-09-21T13:14:29.347 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 1265, 2023-09-21T13:14:29.348 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 197400095, 2023-09-21T13:14:29.348 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 910753, 2023-09-21T13:14:29.348 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 8, 2023-09-21T13:14:29.348 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 6, 2023-09-21T13:14:29.349 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.173303875, 2023-09-21T13:14:29.349 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.024063659, 2023-09-21T13:14:29.349 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.117005048, 2023-09-21T13:14:29.349 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.023955492, 2023-09-21T13:14:29.350 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:29.350 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 1262, 2023-09-21T13:14:29.350 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.062801437, 2023-09-21T13:14:29.351 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000049763 2023-09-21T13:14:29.351 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.351 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:29.352 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.352 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.352 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.352 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.353 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 320, 2023-09-21T13:14:29.353 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 595088 2023-09-21T13:14:29.353 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.353 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-09-21T13:14:29.354 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 1, 2023-09-21T13:14:29.354 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-09-21T13:14:29.354 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.355 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-MDSRank": { 2023-09-21T13:14:29.355 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-09-21T13:14:29.355 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-09-21T13:14:29.356 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 8105, 2023-09-21T13:14:29.356 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.214566559, 2023-09-21T13:14:29.356 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000026473 2023-09-21T13:14:29.356 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.357 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.357 INFO:teuthology.orchestra.run.smithi156.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:29.357 INFO:teuthology.orchestra.run.smithi156.stdout: "queue_len": 0, 2023-09-21T13:14:29.357 INFO:teuthology.orchestra.run.smithi156.stdout: "complete_latency": { 2023-09-21T13:14:29.358 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.358 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.358 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.359 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.359 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.359 INFO:teuthology.orchestra.run.smithi156.stdout: "mds": { 2023-09-21T13:14:29.360 INFO:teuthology.orchestra.run.smithi156.stdout: "request": 0, 2023-09-21T13:14:29.360 INFO:teuthology.orchestra.run.smithi156.stdout: "reply": 0, 2023-09-21T13:14:29.360 INFO:teuthology.orchestra.run.smithi156.stdout: "reply_latency": { 2023-09-21T13:14:29.360 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.361 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.361 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.361 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.361 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_reply": 0, 2023-09-21T13:14:29.362 INFO:teuthology.orchestra.run.smithi156.stdout: "forward": 0, 2023-09-21T13:14:29.362 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_complete": 0, 2023-09-21T13:14:29.362 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_fetch_keys": 0, 2023-09-21T13:14:29.363 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_commit": 0, 2023-09-21T13:14:29.363 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_split": 0, 2023-09-21T13:14:29.363 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_merge": 0, 2023-09-21T13:14:29.363 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes": 22106, 2023-09-21T13:14:29.364 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_top": 2436, 2023-09-21T13:14:29.364 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_bottom": 17925, 2023-09-21T13:14:29.364 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pin_tail": 1745, 2023-09-21T13:14:29.365 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_pinned": 18625, 2023-09-21T13:14:29.365 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_expired": 2330, 2023-09-21T13:14:29.365 INFO:teuthology.orchestra.run.smithi156.stdout: "inodes_with_caps": 0, 2023-09-21T13:14:29.365 INFO:teuthology.orchestra.run.smithi156.stdout: "caps": 0, 2023-09-21T13:14:29.366 INFO:teuthology.orchestra.run.smithi156.stdout: "subtrees": 17, 2023-09-21T13:14:29.366 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse": 0, 2023-09-21T13:14:29.366 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_hit": 0, 2023-09-21T13:14:29.367 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_forward": 0, 2023-09-21T13:14:29.367 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_discover": 0, 2023-09-21T13:14:29.367 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_dir_fetch": 0, 2023-09-21T13:14:29.367 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:29.368 INFO:teuthology.orchestra.run.smithi156.stdout: "traverse_lock": 0, 2023-09-21T13:14:29.368 INFO:teuthology.orchestra.run.smithi156.stdout: "load_cent": 0, 2023-09-21T13:14:29.368 INFO:teuthology.orchestra.run.smithi156.stdout: "q": 0, 2023-09-21T13:14:29.369 INFO:teuthology.orchestra.run.smithi156.stdout: "exported": 0, 2023-09-21T13:14:29.369 INFO:teuthology.orchestra.run.smithi156.stdout: "exported_inodes": 0, 2023-09-21T13:14:29.369 INFO:teuthology.orchestra.run.smithi156.stdout: "imported": 0, 2023-09-21T13:14:29.369 INFO:teuthology.orchestra.run.smithi156.stdout: "imported_inodes": 0, 2023-09-21T13:14:29.370 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:29.370 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_backtrace_fetch": 0, 2023-09-21T13:14:29.370 INFO:teuthology.orchestra.run.smithi156.stdout: "openino_peer_discover": 0, 2023-09-21T13:14:29.371 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rfiles": 0, 2023-09-21T13:14:29.371 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rbytes": 0, 2023-09-21T13:14:29.371 INFO:teuthology.orchestra.run.smithi156.stdout: "root_rsnaps": 0, 2023-09-21T13:14:29.371 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_fetch": 0, 2023-09-21T13:14:29.372 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:29.372 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:29.372 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:29.372 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_inodes": 0, 2023-09-21T13:14:29.373 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dir_base_inodes": 0, 2023-09-21T13:14:29.373 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_dirfrag_rstats": 0, 2023-09-21T13:14:29.373 INFO:teuthology.orchestra.run.smithi156.stdout: "scrub_file_inodes": 0, 2023-09-21T13:14:29.373 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_inode_file_caps": 0, 2023-09-21T13:14:29.374 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_revoke": 0, 2023-09-21T13:14:29.374 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_grant": 0, 2023-09-21T13:14:29.374 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:29.375 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-21T13:14:29.375 INFO:teuthology.orchestra.run.smithi156.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:29.375 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps": 0, 2023-09-21T13:14:29.376 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_caps_dirty": 0, 2023-09-21T13:14:29.376 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_cap_release": 0, 2023-09-21T13:14:29.376 INFO:teuthology.orchestra.run.smithi156.stdout: "process_request_cap_release": 0 2023-09-21T13:14:29.376 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.377 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_cache": { 2023-09-21T13:14:29.377 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update": 0, 2023-09-21T13:14:29.377 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_update_receipt": 0, 2023-09-21T13:14:29.377 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_try_discover": 0, 2023-09-21T13:14:29.378 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_send_discover": 0, 2023-09-21T13:14:29.378 INFO:teuthology.orchestra.run.smithi156.stdout: "dir_handle_discover": 0, 2023-09-21T13:14:29.378 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays": 0, 2023-09-21T13:14:29.379 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:29.379 INFO:teuthology.orchestra.run.smithi156.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:29.379 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_created": 0, 2023-09-21T13:14:29.380 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_enqueued": 0, 2023-09-21T13:14:29.380 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:29.380 INFO:teuthology.orchestra.run.smithi156.stdout: "strays_migrated": 0, 2023-09-21T13:14:29.380 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:29.381 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:29.381 INFO:teuthology.orchestra.run.smithi156.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:29.381 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_started": 0, 2023-09-21T13:14:29.381 INFO:teuthology.orchestra.run.smithi156.stdout: "recovery_completed": 0, 2023-09-21T13:14:29.382 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_enqueue_scrub": 0, 2023-09-21T13:14:29.382 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_exportdir": 0, 2023-09-21T13:14:29.382 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_flush": 0, 2023-09-21T13:14:29.383 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragmentdir": 0, 2023-09-21T13:14:29.383 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:29.383 INFO:teuthology.orchestra.run.smithi156.stdout: "ireq_inodestats": 0 2023-09-21T13:14:29.383 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.384 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_log": { 2023-09-21T13:14:29.384 INFO:teuthology.orchestra.run.smithi156.stdout: "evlrg": 0, 2023-09-21T13:14:29.384 INFO:teuthology.orchestra.run.smithi156.stdout: "evadd": 0, 2023-09-21T13:14:29.384 INFO:teuthology.orchestra.run.smithi156.stdout: "evex": 0, 2023-09-21T13:14:29.385 INFO:teuthology.orchestra.run.smithi156.stdout: "evtrm": 0, 2023-09-21T13:14:29.385 INFO:teuthology.orchestra.run.smithi156.stdout: "ev": 158001, 2023-09-21T13:14:29.385 INFO:teuthology.orchestra.run.smithi156.stdout: "evexg": 0, 2023-09-21T13:14:29.386 INFO:teuthology.orchestra.run.smithi156.stdout: "evexd": 0, 2023-09-21T13:14:29.386 INFO:teuthology.orchestra.run.smithi156.stdout: "segadd": 0, 2023-09-21T13:14:29.386 INFO:teuthology.orchestra.run.smithi156.stdout: "segex": 0, 2023-09-21T13:14:29.386 INFO:teuthology.orchestra.run.smithi156.stdout: "segtrm": 0, 2023-09-21T13:14:29.387 INFO:teuthology.orchestra.run.smithi156.stdout: "seg": 133, 2023-09-21T13:14:29.387 INFO:teuthology.orchestra.run.smithi156.stdout: "segmjr": 14, 2023-09-21T13:14:29.387 INFO:teuthology.orchestra.run.smithi156.stdout: "segexg": 0, 2023-09-21T13:14:29.388 INFO:teuthology.orchestra.run.smithi156.stdout: "segexd": 0, 2023-09-21T13:14:29.388 INFO:teuthology.orchestra.run.smithi156.stdout: "expos": 104330479, 2023-09-21T13:14:29.388 INFO:teuthology.orchestra.run.smithi156.stdout: "wrpos": 518289802, 2023-09-21T13:14:29.388 INFO:teuthology.orchestra.run.smithi156.stdout: "rdpos": 518285152, 2023-09-21T13:14:29.389 INFO:teuthology.orchestra.run.smithi156.stdout: "jlat": { 2023-09-21T13:14:29.389 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.389 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.390 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.390 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.390 INFO:teuthology.orchestra.run.smithi156.stdout: "replayed": 158001 2023-09-21T13:14:29.390 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.391 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_mem": { 2023-09-21T13:14:29.391 INFO:teuthology.orchestra.run.smithi156.stdout: "ino": 1411, 2023-09-21T13:14:29.391 INFO:teuthology.orchestra.run.smithi156.stdout: "ino+": 24173, 2023-09-21T13:14:29.392 INFO:teuthology.orchestra.run.smithi156.stdout: "ino-": 22762, 2023-09-21T13:14:29.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir": 104, 2023-09-21T13:14:29.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir+": 211, 2023-09-21T13:14:29.392 INFO:teuthology.orchestra.run.smithi156.stdout: "dir-": 107, 2023-09-21T13:14:29.393 INFO:teuthology.orchestra.run.smithi156.stdout: "dn": 22106, 2023-09-21T13:14:29.393 INFO:teuthology.orchestra.run.smithi156.stdout: "dn+": 24500, 2023-09-21T13:14:29.393 INFO:teuthology.orchestra.run.smithi156.stdout: "dn-": 2394, 2023-09-21T13:14:29.394 INFO:teuthology.orchestra.run.smithi156.stdout: "cap": 0, 2023-09-21T13:14:29.394 INFO:teuthology.orchestra.run.smithi156.stdout: "cap+": 0, 2023-09-21T13:14:29.394 INFO:teuthology.orchestra.run.smithi156.stdout: "cap-": 0, 2023-09-21T13:14:29.394 INFO:teuthology.orchestra.run.smithi156.stdout: "rss": 76700, 2023-09-21T13:14:29.395 INFO:teuthology.orchestra.run.smithi156.stdout: "heap": 207152 2023-09-21T13:14:29.395 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.395 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_server": { 2023-09-21T13:14:29.396 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_client_request": 0, 2023-09-21T13:14:29.396 INFO:teuthology.orchestra.run.smithi156.stdout: "dispatch_server_request": 0, 2023-09-21T13:14:29.396 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_request": 0, 2023-09-21T13:14:29.396 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_client_session": 0, 2023-09-21T13:14:29.397 INFO:teuthology.orchestra.run.smithi156.stdout: "handle_peer_request": 0, 2023-09-21T13:14:29.397 INFO:teuthology.orchestra.run.smithi156.stdout: "req_create_latency": { 2023-09-21T13:14:29.397 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.397 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.398 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.398 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.398 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getattr_latency": { 2023-09-21T13:14:29.399 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.399 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.399 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.399 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.400 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:29.400 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.400 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.400 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.401 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.401 INFO:teuthology.orchestra.run.smithi156.stdout: "req_link_latency": { 2023-09-21T13:14:29.401 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.402 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.402 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.402 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.403 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookup_latency": { 2023-09-21T13:14:29.403 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.403 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.403 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.404 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.404 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:29.404 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.404 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.405 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.405 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.405 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupino_latency": { 2023-09-21T13:14:29.405 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.406 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.406 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.406 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.407 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupname_latency": { 2023-09-21T13:14:29.407 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.407 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.407 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.408 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.408 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:29.408 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.408 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.409 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.409 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.409 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:29.410 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.410 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.410 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.410 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.411 INFO:teuthology.orchestra.run.smithi156.stdout: "req_lssnap_latency": { 2023-09-21T13:14:29.411 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.411 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.411 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.412 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.412 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mkdir_latency": { 2023-09-21T13:14:29.412 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.413 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.413 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.413 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.413 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mknod_latency": { 2023-09-21T13:14:29.414 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.414 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.414 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.415 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.415 INFO:teuthology.orchestra.run.smithi156.stdout: "req_mksnap_latency": { 2023-09-21T13:14:29.415 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.415 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.416 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.416 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.416 INFO:teuthology.orchestra.run.smithi156.stdout: "req_open_latency": { 2023-09-21T13:14:29.416 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.417 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.417 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.417 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.417 INFO:teuthology.orchestra.run.smithi156.stdout: "req_readdir_latency": { 2023-09-21T13:14:29.418 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.418 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.418 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.419 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.419 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rename_latency": { 2023-09-21T13:14:29.419 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.419 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.420 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.420 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.420 INFO:teuthology.orchestra.run.smithi156.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:29.421 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.421 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.421 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.421 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.422 INFO:teuthology.orchestra.run.smithi156.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:29.422 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.422 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.423 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.423 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.423 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmdir_latency": { 2023-09-21T13:14:29.423 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.424 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.424 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.424 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.424 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:29.425 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.425 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.425 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.426 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.426 INFO:teuthology.orchestra.run.smithi156.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:29.426 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.426 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.427 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.427 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.427 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setattr_latency": { 2023-09-21T13:14:29.428 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.428 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.428 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.428 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.429 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:29.429 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.429 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.429 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.430 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.430 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:29.430 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.431 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.431 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.431 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.431 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setlayout_latency": { 2023-09-21T13:14:29.432 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.432 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.432 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.433 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.433 INFO:teuthology.orchestra.run.smithi156.stdout: "req_setxattr_latency": { 2023-09-21T13:14:29.433 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.433 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.434 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.434 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.434 INFO:teuthology.orchestra.run.smithi156.stdout: "req_symlink_latency": { 2023-09-21T13:14:29.435 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.435 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.435 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.435 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.436 INFO:teuthology.orchestra.run.smithi156.stdout: "req_unlink_latency": { 2023-09-21T13:14:29.436 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.436 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.437 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.437 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.437 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:29.437 INFO:teuthology.orchestra.run.smithi156.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:29.438 INFO:teuthology.orchestra.run.smithi156.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:29.438 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.438 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.438 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.439 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.439 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.439 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_sessions": { 2023-09-21T13:14:29.440 INFO:teuthology.orchestra.run.smithi156.stdout: "session_count": 2, 2023-09-21T13:14:29.440 INFO:teuthology.orchestra.run.smithi156.stdout: "session_add": 4, 2023-09-21T13:14:29.440 INFO:teuthology.orchestra.run.smithi156.stdout: "session_remove": 2, 2023-09-21T13:14:29.440 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_open": 3, 2023-09-21T13:14:29.441 INFO:teuthology.orchestra.run.smithi156.stdout: "sessions_stale": 0, 2023-09-21T13:14:29.441 INFO:teuthology.orchestra.run.smithi156.stdout: "total_load": 0, 2023-09-21T13:14:29.441 INFO:teuthology.orchestra.run.smithi156.stdout: "average_load": 0, 2023-09-21T13:14:29.441 INFO:teuthology.orchestra.run.smithi156.stdout: "avg_session_uptime": 3812, 2023-09-21T13:14:29.442 INFO:teuthology.orchestra.run.smithi156.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:29.442 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.442 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-09-21T13:14:29.443 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:29.443 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:29.443 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:29.444 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:29.444 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:29.444 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:29.444 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:29.445 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:29.445 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:29.445 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:29.445 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:29.446 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:29.446 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:29.446 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:29.447 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:29.447 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:29.447 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:29.447 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:29.448 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:29.448 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:29.448 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:29.448 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:29.449 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:29.449 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:29.449 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:29.449 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:29.450 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:29.450 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:29.450 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:29.451 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:29.451 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:29.451 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-09-21T13:14:29.452 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:29.452 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:29.452 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:29.452 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:29.453 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 297263, 2023-09-21T13:14:29.453 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 1738, 2023-09-21T13:14:29.453 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:29.453 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:29.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-09-21T13:14:29.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-09-21T13:14:29.454 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:29.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:29.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:29.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:29.455 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 8032, 2023-09-21T13:14:29.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 167, 2023-09-21T13:14:29.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:29.456 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:29.457 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:29.457 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-09-21T13:14:29.457 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 19064587, 2023-09-21T13:14:29.457 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 125082, 2023-09-21T13:14:29.458 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:29.458 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-09-21T13:14:29.458 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:29.459 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-09-21T13:14:29.459 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.459 INFO:teuthology.orchestra.run.smithi156.stdout: "objecter": { 2023-09-21T13:14:29.459 INFO:teuthology.orchestra.run.smithi156.stdout: "op_active": 0, 2023-09-21T13:14:29.460 INFO:teuthology.orchestra.run.smithi156.stdout: "op_laggy": 0, 2023-09-21T13:14:29.460 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send": 4878, 2023-09-21T13:14:29.460 INFO:teuthology.orchestra.run.smithi156.stdout: "op_send_bytes": 21, 2023-09-21T13:14:29.460 INFO:teuthology.orchestra.run.smithi156.stdout: "op_resend": 3, 2023-09-21T13:14:29.461 INFO:teuthology.orchestra.run.smithi156.stdout: "op_reply": 4878, 2023-09-21T13:14:29.461 INFO:teuthology.orchestra.run.smithi156.stdout: "op_latency": { 2023-09-21T13:14:29.461 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4878, 2023-09-21T13:14:29.462 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 6.657905842, 2023-09-21T13:14:29.462 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.001364884 2023-09-21T13:14:29.462 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.462 INFO:teuthology.orchestra.run.smithi156.stdout: "op_inflight": 0, 2023-09-21T13:14:29.463 INFO:teuthology.orchestra.run.smithi156.stdout: "oplen_avg": { 2023-09-21T13:14:29.463 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 4878, 2023-09-21T13:14:29.463 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 4879 2023-09-21T13:14:29.464 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.464 INFO:teuthology.orchestra.run.smithi156.stdout: "op": 4878, 2023-09-21T13:14:29.464 INFO:teuthology.orchestra.run.smithi156.stdout: "op_r": 4878, 2023-09-21T13:14:29.464 INFO:teuthology.orchestra.run.smithi156.stdout: "op_w": 0, 2023-09-21T13:14:29.465 INFO:teuthology.orchestra.run.smithi156.stdout: "op_rmw": 0, 2023-09-21T13:14:29.465 INFO:teuthology.orchestra.run.smithi156.stdout: "op_pg": 0, 2023-09-21T13:14:29.465 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_stat": 2687, 2023-09-21T13:14:29.465 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_create": 0, 2023-09-21T13:14:29.466 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_read": 2189, 2023-09-21T13:14:29.466 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_write": 0, 2023-09-21T13:14:29.466 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writefull": 0, 2023-09-21T13:14:29.467 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_writesame": 0, 2023-09-21T13:14:29.467 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_append": 0, 2023-09-21T13:14:29.467 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_zero": 0, 2023-09-21T13:14:29.467 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_truncate": 0, 2023-09-21T13:14:29.468 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_delete": 0, 2023-09-21T13:14:29.468 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_mapext": 0, 2023-09-21T13:14:29.468 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:29.468 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:29.469 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_getxattr": 1, 2023-09-21T13:14:29.469 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_setxattr": 0, 2023-09-21T13:14:29.469 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:29.469 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:29.470 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:29.470 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_call": 0, 2023-09-21T13:14:29.470 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_watch": 0, 2023-09-21T13:14:29.471 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_notify": 0, 2023-09-21T13:14:29.471 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:29.471 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls": 0, 2023-09-21T13:14:29.471 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:29.472 INFO:teuthology.orchestra.run.smithi156.stdout: "osdop_other": 0, 2023-09-21T13:14:29.472 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_active": 0, 2023-09-21T13:14:29.472 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_send": 0, 2023-09-21T13:14:29.473 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_resend": 0, 2023-09-21T13:14:29.473 INFO:teuthology.orchestra.run.smithi156.stdout: "linger_ping": 0, 2023-09-21T13:14:29.473 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_active": 0, 2023-09-21T13:14:29.473 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_send": 0, 2023-09-21T13:14:29.474 INFO:teuthology.orchestra.run.smithi156.stdout: "poolop_resend": 0, 2023-09-21T13:14:29.474 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_active": 0, 2023-09-21T13:14:29.474 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_send": 0, 2023-09-21T13:14:29.474 INFO:teuthology.orchestra.run.smithi156.stdout: "poolstat_resend": 0, 2023-09-21T13:14:29.475 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_active": 0, 2023-09-21T13:14:29.475 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_send": 0, 2023-09-21T13:14:29.475 INFO:teuthology.orchestra.run.smithi156.stdout: "statfs_resend": 0, 2023-09-21T13:14:29.476 INFO:teuthology.orchestra.run.smithi156.stdout: "command_active": 0, 2023-09-21T13:14:29.476 INFO:teuthology.orchestra.run.smithi156.stdout: "command_send": 0, 2023-09-21T13:14:29.476 INFO:teuthology.orchestra.run.smithi156.stdout: "command_resend": 0, 2023-09-21T13:14:29.476 INFO:teuthology.orchestra.run.smithi156.stdout: "map_epoch": 115, 2023-09-21T13:14:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: "map_full": 0, 2023-09-21T13:14:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: "map_inc": 31, 2023-09-21T13:14:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_sessions": 11, 2023-09-21T13:14:29.477 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_open": 11, 2023-09-21T13:14:29.478 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_session_close": 0, 2023-09-21T13:14:29.478 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_laggy": 0, 2023-09-21T13:14:29.478 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_wr": 0, 2023-09-21T13:14:29.479 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_rd": 2, 2023-09-21T13:14:29.479 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_del": 0 2023-09-21T13:14:29.479 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.479 INFO:teuthology.orchestra.run.smithi156.stdout: "oft": { 2023-09-21T13:14:29.480 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_objs": 0, 2023-09-21T13:14:29.480 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:29.480 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_updates": 0, 2023-09-21T13:14:29.481 INFO:teuthology.orchestra.run.smithi156.stdout: "omap_total_removes": 0 2023-09-21T13:14:29.481 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.481 INFO:teuthology.orchestra.run.smithi156.stdout: "osd-slow-ops": { 2023-09-21T13:14:29.481 INFO:teuthology.orchestra.run.smithi156.stdout: "slow_ops_count": 0 2023-09-21T13:14:29.482 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.482 INFO:teuthology.orchestra.run.smithi156.stdout: "purge_queue": { 2023-09-21T13:14:29.482 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:29.483 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_ops_high_water": 0, 2023-09-21T13:14:29.483 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing": 0, 2023-09-21T13:14:29.483 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executing_high_water": 0, 2023-09-21T13:14:29.483 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_executed": 0, 2023-09-21T13:14:29.484 INFO:teuthology.orchestra.run.smithi156.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:29.484 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.484 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:29.485 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:29.485 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:29.485 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:29.485 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 5294, 2023-09-21T13:14:29.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 516757551, 2023-09-21T13:14:29.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:29.486 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 5294, 2023-09-21T13:14:29.487 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:29.487 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:29.487 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 5294, 2023-09-21T13:14:29.487 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 516757551, 2023-09-21T13:14:29.488 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:29.488 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.488 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.488 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.489 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.489 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.489 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:29.489 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:29.490 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:29.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:29.490 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:29.491 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:29.491 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:29.491 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:29.491 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 4878, 2023-09-21T13:14:29.492 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 514135274, 2023-09-21T13:14:29.492 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 4878, 2023-09-21T13:14:29.492 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 514135274, 2023-09-21T13:14:29.492 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:29.493 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.493 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.493 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.494 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.494 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.494 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:29.494 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:29.495 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 1024, 2023-09-21T13:14:29.495 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:29.495 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:29.496 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:29.496 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:29.496 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:29.496 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 4878, 2023-09-21T13:14:29.497 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 4878, 2023-09-21T13:14:29.497 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 4878, 2023-09-21T13:14:29.497 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 4878, 2023-09-21T13:14:29.497 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:29.498 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.498 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.498 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.499 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.499 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.499 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:29.499 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:29.500 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-09-21T13:14:29.500 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:29.500 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:29.500 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:29.501 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:29.501 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:29.501 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:29.502 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:29.502 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-09-21T13:14:29.502 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-09-21T13:14:29.502 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:29.503 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.503 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.503 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.504 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.504 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:29.504 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-write_buf_throttle-0x56004721c960": { 2023-09-21T13:14:29.504 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:29.505 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 3758096384, 2023-09-21T13:14:29.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:29.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 0, 2023-09-21T13:14:29.505 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 0, 2023-09-21T13:14:29.506 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:29.506 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:29.506 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:29.507 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:29.507 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 0, 2023-09-21T13:14:29.507 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 0, 2023-09-21T13:14:29.507 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:29.508 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:29.508 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:29.508 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:29.509 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.509 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:29.509 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-21T13:14:29.904 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-09-21T13:14:29.904 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-09-21T13:14:29.905 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=0 2023-09-21T13:14:29.905 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-09-21T13:14:29.905 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-09-21T13:14:29.906 DEBUG:tasks.check_counter:Getting stats from k 2023-09-21T13:14:29.906 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.k perf dump 2023-09-21T13:14:30.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:30 smithi156 ceph-mon[134078]: pgmap v579: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:30.409 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:30 smithi142 ceph-mon[97663]: pgmap v579: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:30.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:30 smithi160 ceph-mon[134450]: pgmap v579: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:30.463 INFO:teuthology.orchestra.run.smithi156.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-21T13:14:31.825 INFO:teuthology.orchestra.run.smithi156.stdout:{ 2023-09-21T13:14:31.825 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:31.826 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 343, 2023-09-21T13:14:31.826 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 332, 2023-09-21T13:14:31.826 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 1586704, 2023-09-21T13:14:31.827 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 200320, 2023-09-21T13:14:31.827 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:31.827 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:31.828 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.051384606, 2023-09-21T13:14:31.828 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.016149882, 2023-09-21T13:14:31.828 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.033421690, 2023-09-21T13:14:31.829 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.007818105, 2023-09-21T13:14:31.829 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:31.829 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 331, 2023-09-21T13:14:31.830 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.016601102, 2023-09-21T13:14:31.830 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000050154 2023-09-21T13:14:31.830 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.831 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:31.831 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:31.831 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:31.832 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:31.832 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.832 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 1586704, 2023-09-21T13:14:31.833 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 200320 2023-09-21T13:14:31.833 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.833 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:31.833 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 6, 2023-09-21T13:14:31.834 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 257, 2023-09-21T13:14:31.834 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 3264, 2023-09-21T13:14:31.834 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 198272, 2023-09-21T13:14:31.835 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:31.835 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:31.835 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.011826038, 2023-09-21T13:14:31.835 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.007414962, 2023-09-21T13:14:31.836 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.002065889, 2023-09-21T13:14:31.836 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:31.836 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:31.836 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 255, 2023-09-21T13:14:31.837 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.019907269, 2023-09-21T13:14:31.837 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000078067 2023-09-21T13:14:31.838 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.838 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:31.839 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:31.839 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:31.839 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:31.840 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.840 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-09-21T13:14:31.842 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 198272 2023-09-21T13:14:31.842 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.843 INFO:teuthology.orchestra.run.smithi156.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:31.843 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_messages": 0, 2023-09-21T13:14:31.844 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages": 2, 2023-09-21T13:14:31.844 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_bytes": 0, 2023-09-21T13:14:31.845 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_bytes": 0, 2023-09-21T13:14:31.845 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:31.846 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:31.846 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_total_time": 0.000371113, 2023-09-21T13:14:31.847 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_send_time": 0.000000000, 2023-09-21T13:14:31.847 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_recv_time": 0.000276698, 2023-09-21T13:14:31.848 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:31.848 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:31.849 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:31.849 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:31.850 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:31.850 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.850 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:31.851 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:31.851 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:31.851 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:31.852 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.852 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:31.852 INFO:teuthology.orchestra.run.smithi156.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:31.852 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.853 INFO:teuthology.orchestra.run.smithi156.stdout: "cct": { 2023-09-21T13:14:31.853 INFO:teuthology.orchestra.run.smithi156.stdout: "total_workers": 0, 2023-09-21T13:14:31.853 INFO:teuthology.orchestra.run.smithi156.stdout: "unhealthy_workers": 0 2023-09-21T13:14:31.853 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.854 INFO:teuthology.orchestra.run.smithi156.stdout: "mempool": { 2023-09-21T13:14:31.854 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:31.855 INFO:teuthology.orchestra.run.smithi156.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:31.855 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:31.855 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:31.855 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:31.856 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:31.856 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:31.856 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:31.857 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:31.857 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:31.857 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:31.857 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:31.858 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:31.858 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:31.859 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:31.859 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:31.859 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:31.859 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:31.860 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:31.860 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:31.860 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:31.861 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:31.861 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:31.861 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:31.861 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:31.862 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:31.862 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:31.862 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:31.862 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:31.863 INFO:teuthology.orchestra.run.smithi156.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:31.863 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:31.863 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_items": 0, 2023-09-21T13:14:31.864 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:31.864 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:31.864 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:31.864 INFO:teuthology.orchestra.run.smithi156.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:31.865 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_bytes": 149057, 2023-09-21T13:14:31.865 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_anon_items": 32, 2023-09-21T13:14:31.865 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:31.866 INFO:teuthology.orchestra.run.smithi156.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:31.866 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_bytes": 0, 2023-09-21T13:14:31.866 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_items": 0, 2023-09-21T13:14:31.867 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:31.867 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:31.867 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:31.868 INFO:teuthology.orchestra.run.smithi156.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:31.868 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:31.869 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_items": 0, 2023-09-21T13:14:31.869 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:31.870 INFO:teuthology.orchestra.run.smithi156.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:31.870 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:31.871 INFO:teuthology.orchestra.run.smithi156.stdout: "pgmap_items": 0, 2023-09-21T13:14:31.871 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:31.872 INFO:teuthology.orchestra.run.smithi156.stdout: "mds_co_items": 2, 2023-09-21T13:14:31.872 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:31.872 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_1_items": 0, 2023-09-21T13:14:31.873 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:31.873 INFO:teuthology.orchestra.run.smithi156.stdout: "unittest_2_items": 0 2023-09-21T13:14:31.874 INFO:teuthology.orchestra.run.smithi156.stdout: }, 2023-09-21T13:14:31.874 INFO:teuthology.orchestra.run.smithi156.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:31.877 INFO:teuthology.orchestra.run.smithi156.stdout: "val": 0, 2023-09-21T13:14:31.877 INFO:teuthology.orchestra.run.smithi156.stdout: "max": 104857600, 2023-09-21T13:14:31.878 INFO:teuthology.orchestra.run.smithi156.stdout: "get_started": 0, 2023-09-21T13:14:31.878 INFO:teuthology.orchestra.run.smithi156.stdout: "get": 345, 2023-09-21T13:14:31.878 INFO:teuthology.orchestra.run.smithi156.stdout: "get_sum": 1538297, 2023-09-21T13:14:31.879 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:31.879 INFO:teuthology.orchestra.run.smithi156.stdout: "get_or_fail_success": 345, 2023-09-21T13:14:31.879 INFO:teuthology.orchestra.run.smithi156.stdout: "take": 0, 2023-09-21T13:14:31.880 INFO:teuthology.orchestra.run.smithi156.stdout: "take_sum": 0, 2023-09-21T13:14:31.880 INFO:teuthology.orchestra.run.smithi156.stdout: "put": 345, 2023-09-21T13:14:31.880 INFO:teuthology.orchestra.run.smithi156.stdout: "put_sum": 1538297, 2023-09-21T13:14:31.881 INFO:teuthology.orchestra.run.smithi156.stdout: "wait": { 2023-09-21T13:14:31.881 INFO:teuthology.orchestra.run.smithi156.stdout: "avgcount": 0, 2023-09-21T13:14:31.881 INFO:teuthology.orchestra.run.smithi156.stdout: "sum": 0.000000000, 2023-09-21T13:14:31.882 INFO:teuthology.orchestra.run.smithi156.stdout: "avgtime": 0.000000000 2023-09-21T13:14:31.882 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:31.882 INFO:teuthology.orchestra.run.smithi156.stdout: } 2023-09-21T13:14:31.882 INFO:teuthology.orchestra.run.smithi156.stdout:} 2023-09-21T13:14:32.148 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:32 smithi156 ceph-mon[134078]: pgmap v580: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:32.206 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-09-21T13:14:32.206 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-09-21T13:14:32.207 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2023-09-21T13:14:32.207 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2023-09-21T13:14:32.208 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2023-09-21T13:14:32.208 DEBUG:tasks.check_counter:Getting stats from c 2023-09-21T13:14:32.209 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.c perf dump 2023-09-21T13:14:32.272 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:32 smithi160 ceph-mon[134450]: pgmap v580: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:32.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:32 smithi142 ceph-mon[97663]: pgmap v580: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 34 KiB/s wr, 9 op/s 2023-09-21T13:14:32.830 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T13:14:34.157 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2023-09-21T13:14:34.157 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:34.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 268828, 2023-09-21T13:14:34.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 467327, 2023-09-21T13:14:34.158 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 88502797, 2023-09-21T13:14:34.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 557214606, 2023-09-21T13:14:34.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 16, 2023-09-21T13:14:34.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 6, 2023-09-21T13:14:34.159 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 16.209883605, 2023-09-21T13:14:34.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 7.096227123, 2023-09-21T13:14:34.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 10.404467679, 2023-09-21T13:14:34.160 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.871156691, 2023-09-21T13:14:34.161 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:34.161 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 467323, 2023-09-21T13:14:34.161 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 33.652454247, 2023-09-21T13:14:34.161 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000072011 2023-09-21T13:14:34.162 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.162 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:34.162 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 552163, 2023-09-21T13:14:34.163 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.090764813, 2023-09-21T13:14:34.163 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000164 2023-09-21T13:14:34.163 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.163 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-09-21T13:14:34.164 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 10944 2023-09-21T13:14:34.164 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.164 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:34.164 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 31758, 2023-09-21T13:14:34.165 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 32010, 2023-09-21T13:14:34.165 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 8002660, 2023-09-21T13:14:34.165 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 191052280, 2023-09-21T13:14:34.166 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 38, 2023-09-21T13:14:34.166 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 10, 2023-09-21T13:14:34.166 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 2.584312057, 2023-09-21T13:14:34.166 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.788943122, 2023-09-21T13:14:34.167 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.481565676, 2023-09-21T13:14:34.167 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 1.159983405, 2023-09-21T13:14:34.167 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:34.168 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 32006, 2023-09-21T13:14:34.168 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 2.120289979, 2023-09-21T13:14:34.168 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000066246 2023-09-21T13:14:34.168 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.169 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:34.169 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 40, 2023-09-21T13:14:34.169 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000004651, 2023-09-21T13:14:34.170 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000116 2023-09-21T13:14:34.170 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.170 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 5088, 2023-09-21T13:14:34.171 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 606736 2023-09-21T13:14:34.171 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.171 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:34.172 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 246315, 2023-09-21T13:14:34.172 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 224291, 2023-09-21T13:14:34.172 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 79258654, 2023-09-21T13:14:34.173 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 236884644, 2023-09-21T13:14:34.173 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2023-09-21T13:14:34.173 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:34.173 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 12.227963234, 2023-09-21T13:14:34.174 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 4.694093854, 2023-09-21T13:14:34.174 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 8.142125092, 2023-09-21T13:14:34.174 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.890733817, 2023-09-21T13:14:34.175 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:34.175 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 224294, 2023-09-21T13:14:34.175 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 7.932449448, 2023-09-21T13:14:34.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000035366 2023-09-21T13:14:34.176 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.176 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:34.176 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 415630, 2023-09-21T13:14:34.177 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.052989108, 2023-09-21T13:14:34.177 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000127 2023-09-21T13:14:34.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.178 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1784016, 2023-09-21T13:14:34.178 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 219136 2023-09-21T13:14:34.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.178 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2023-09-21T13:14:34.179 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2023-09-21T13:14:34.179 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2023-09-21T13:14:34.179 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.180 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2023-09-21T13:14:34.180 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:34.180 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:34.180 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 82538, 2023-09-21T13:14:34.181 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 90.197183089, 2023-09-21T13:14:34.181 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001092795 2023-09-21T13:14:34.181 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.182 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.182 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:34.183 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:34.183 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:34.183 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 60299, 2023-09-21T13:14:34.183 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 7.155401887, 2023-09-21T13:14:34.184 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000118665 2023-09-21T13:14:34.184 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.184 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.184 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2023-09-21T13:14:34.185 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 188655, 2023-09-21T13:14:34.185 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 183021, 2023-09-21T13:14:34.185 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2023-09-21T13:14:34.186 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 183021, 2023-09-21T13:14:34.186 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 534.061658915, 2023-09-21T13:14:34.187 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002918034 2023-09-21T13:14:34.187 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.187 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2023-09-21T13:14:34.188 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 5634, 2023-09-21T13:14:34.188 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 2, 2023-09-21T13:14:34.188 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2023-09-21T13:14:34.189 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 132, 2023-09-21T13:14:34.189 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 13, 2023-09-21T13:14:34.189 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 14, 2023-09-21T13:14:34.190 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 2710, 2023-09-21T13:14:34.190 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 1252, 2023-09-21T13:14:34.190 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 1436, 2023-09-21T13:14:34.191 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 22, 2023-09-21T13:14:34.191 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 923, 2023-09-21T13:14:34.191 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 173, 2023-09-21T13:14:34.191 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 225, 2023-09-21T13:14:34.192 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 225, 2023-09-21T13:14:34.192 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 24, 2023-09-21T13:14:34.192 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 347409, 2023-09-21T13:14:34.193 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 176063, 2023-09-21T13:14:34.193 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 5632, 2023-09-21T13:14:34.193 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 45, 2023-09-21T13:14:34.193 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2023-09-21T13:14:34.194 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:34.194 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 3894, 2023-09-21T13:14:34.194 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 3227, 2023-09-21T13:14:34.195 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2023-09-21T13:14:34.195 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 3, 2023-09-21T13:14:34.196 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 99, 2023-09-21T13:14:34.196 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 13, 2023-09-21T13:14:34.196 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 737, 2023-09-21T13:14:34.196 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:34.197 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 182, 2023-09-21T13:14:34.197 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2023-09-21T13:14:34.198 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 734, 2023-09-21T13:14:34.198 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 226086822, 2023-09-21T13:14:34.198 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 7, 2023-09-21T13:14:34.198 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 182, 2023-09-21T13:14:34.199 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:34.199 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:34.199 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:34.200 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2023-09-21T13:14:34.200 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2023-09-21T13:14:34.200 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2023-09-21T13:14:34.201 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 182, 2023-09-21T13:14:34.201 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 3, 2023-09-21T13:14:34.201 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 5995, 2023-09-21T13:14:34.202 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 133991, 2023-09-21T13:14:34.202 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:34.202 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 1762, 2023-09-21T13:14:34.202 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:34.203 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 33660, 2023-09-21T13:14:34.203 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 19832, 2023-09-21T13:14:34.203 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 3890, 2023-09-21T13:14:34.204 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 152345 2023-09-21T13:14:34.204 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.204 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2023-09-21T13:14:34.204 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 91, 2023-09-21T13:14:34.205 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 129, 2023-09-21T13:14:34.205 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 72, 2023-09-21T13:14:34.205 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 157, 2023-09-21T13:14:34.206 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 123, 2023-09-21T13:14:34.206 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2023-09-21T13:14:34.206 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:34.206 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:34.207 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 36179, 2023-09-21T13:14:34.207 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 36179, 2023-09-21T13:14:34.207 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:34.208 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2023-09-21T13:14:34.208 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:34.208 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:34.208 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:34.209 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2023-09-21T13:14:34.209 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2023-09-21T13:14:34.209 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2023-09-21T13:14:34.210 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 6, 2023-09-21T13:14:34.210 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2023-09-21T13:14:34.210 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 27, 2023-09-21T13:14:34.210 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:34.211 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2023-09-21T13:14:34.211 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.211 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2023-09-21T13:14:34.212 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2023-09-21T13:14:34.212 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 166918, 2023-09-21T13:14:34.212 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 75433, 2023-09-21T13:14:34.213 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 73741, 2023-09-21T13:14:34.213 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 93177, 2023-09-21T13:14:34.213 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2023-09-21T13:14:34.213 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 1692, 2023-09-21T13:14:34.214 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 221, 2023-09-21T13:14:34.214 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 93, 2023-09-21T13:14:34.214 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 90, 2023-09-21T13:14:34.215 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 131, 2023-09-21T13:14:34.215 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 8, 2023-09-21T13:14:34.215 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2023-09-21T13:14:34.216 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 3, 2023-09-21T13:14:34.216 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 146532781, 2023-09-21T13:14:34.216 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 583622257, 2023-09-21T13:14:34.216 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 0, 2023-09-21T13:14:34.217 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2023-09-21T13:14:34.217 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 44325, 2023-09-21T13:14:34.217 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 253.445772931, 2023-09-21T13:14:34.218 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.005717896 2023-09-21T13:14:34.218 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.218 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 0 2023-09-21T13:14:34.218 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.219 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2023-09-21T13:14:34.219 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 1284, 2023-09-21T13:14:34.219 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 37579, 2023-09-21T13:14:34.220 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 36295, 2023-09-21T13:14:34.220 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 157, 2023-09-21T13:14:34.220 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 374, 2023-09-21T13:14:34.220 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 217, 2023-09-21T13:14:34.221 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 2710, 2023-09-21T13:14:34.221 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 60451, 2023-09-21T13:14:34.221 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 57741, 2023-09-21T13:14:34.222 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 225, 2023-09-21T13:14:34.222 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 37623, 2023-09-21T13:14:34.222 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 37398, 2023-09-21T13:14:34.222 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 77516, 2023-09-21T13:14:34.223 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 198960 2023-09-21T13:14:34.223 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.223 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2023-09-21T13:14:34.224 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 306514, 2023-09-21T13:14:34.224 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 33, 2023-09-21T13:14:34.224 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 188655, 2023-09-21T13:14:34.224 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 3220, 2023-09-21T13:14:34.225 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 25206, 2023-09-21T13:14:34.225 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2023-09-21T13:14:34.225 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 36153, 2023-09-21T13:14:34.226 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 106.112265334, 2023-09-21T13:14:34.226 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002935088 2023-09-21T13:14:34.226 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.227 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2023-09-21T13:14:34.227 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 139, 2023-09-21T13:14:34.227 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.267454716, 2023-09-21T13:14:34.228 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001924134 2023-09-21T13:14:34.228 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.228 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:34.229 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.229 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.229 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.230 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.230 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2023-09-21T13:14:34.230 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.230 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.231 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.231 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.231 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2023-09-21T13:14:34.231 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 47482, 2023-09-21T13:14:34.232 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 84.894751137, 2023-09-21T13:14:34.232 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001787935 2023-09-21T13:14:34.232 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.233 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:34.233 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.233 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.234 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.234 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.234 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2023-09-21T13:14:34.235 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.235 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.235 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.235 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.236 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2023-09-21T13:14:34.236 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.236 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.237 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.237 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.237 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:34.237 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.238 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.238 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.238 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.239 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:34.239 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.239 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.239 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.240 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.240 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2023-09-21T13:14:34.240 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.241 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.241 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.241 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.241 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2023-09-21T13:14:34.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.242 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.242 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.243 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.243 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2023-09-21T13:14:34.243 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.243 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.244 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.244 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.244 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2023-09-21T13:14:34.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.245 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.245 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.245 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.246 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2023-09-21T13:14:34.246 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.246 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.247 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2023-09-21T13:14:34.247 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 55099, 2023-09-21T13:14:34.248 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 249.661083830, 2023-09-21T13:14:34.248 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.004531136 2023-09-21T13:14:34.248 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.249 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2023-09-21T13:14:34.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6579, 2023-09-21T13:14:34.249 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 19.679987657, 2023-09-21T13:14:34.249 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002991334 2023-09-21T13:14:34.250 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.250 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:34.250 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.250 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.251 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.251 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.251 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:34.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.252 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.252 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.252 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.253 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2023-09-21T13:14:34.253 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.253 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.254 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.254 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.254 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:34.254 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.255 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.255 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.256 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.257 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:34.257 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.258 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.258 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.258 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.259 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2023-09-21T13:14:34.259 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 6, 2023-09-21T13:14:34.259 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.232398972, 2023-09-21T13:14:34.259 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.038733162 2023-09-21T13:14:34.260 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.260 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:34.260 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.261 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.261 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.261 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.262 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:34.262 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1384, 2023-09-21T13:14:34.262 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.215200964, 2023-09-21T13:14:34.263 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000878035 2023-09-21T13:14:34.263 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.263 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2023-09-21T13:14:34.264 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.264 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.264 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.265 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.265 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2023-09-21T13:14:34.265 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.266 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.266 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.266 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.267 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2023-09-21T13:14:34.267 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.267 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.268 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.268 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.268 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2023-09-21T13:14:34.269 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 36179, 2023-09-21T13:14:34.269 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 71.998516305, 2023-09-21T13:14:34.270 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001990063 2023-09-21T13:14:34.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.270 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:34.271 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:34.271 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:34.271 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.272 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.272 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.272 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.273 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.273 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2023-09-21T13:14:34.273 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 2, 2023-09-21T13:14:34.274 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 4, 2023-09-21T13:14:34.274 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 2, 2023-09-21T13:14:34.275 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 2, 2023-09-21T13:14:34.275 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2023-09-21T13:14:34.275 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 29343, 2023-09-21T13:14:34.276 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 14671, 2023-09-21T13:14:34.276 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 1085, 2023-09-21T13:14:34.276 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:34.277 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.277 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2023-09-21T13:14:34.277 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:34.277 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:34.278 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:34.278 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:34.278 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:34.279 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:34.279 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:34.279 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:34.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:34.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:34.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:34.280 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:34.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:34.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:34.281 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:34.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:34.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:34.282 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:34.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:34.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:34.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:34.283 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:34.284 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:34.284 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:34.284 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:34.285 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:34.285 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:34.285 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:34.286 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:34.286 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:34.286 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:34.286 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2023-09-21T13:14:34.287 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:34.287 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:34.287 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:34.288 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:34.288 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 346616, 2023-09-21T13:14:34.288 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 924, 2023-09-21T13:14:34.289 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:34.289 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:34.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2023-09-21T13:14:34.289 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2023-09-21T13:14:34.290 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:34.290 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:34.290 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:34.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:34.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8032, 2023-09-21T13:14:34.291 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 167, 2023-09-21T13:14:34.292 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:34.292 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:34.292 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:34.293 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2023-09-21T13:14:34.293 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 5438961, 2023-09-21T13:14:34.293 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 51899, 2023-09-21T13:14:34.293 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:34.294 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2023-09-21T13:14:34.294 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:34.294 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2023-09-21T13:14:34.295 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.295 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2023-09-21T13:14:34.295 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2023-09-21T13:14:34.296 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2023-09-21T13:14:34.296 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 83669, 2023-09-21T13:14:34.296 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 586301075, 2023-09-21T13:14:34.297 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 33, 2023-09-21T13:14:34.297 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 83669, 2023-09-21T13:14:34.297 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2023-09-21T13:14:34.298 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 83669, 2023-09-21T13:14:34.298 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 529.470353341, 2023-09-21T13:14:34.298 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.006328154 2023-09-21T13:14:34.299 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.299 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2023-09-21T13:14:34.299 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2023-09-21T13:14:34.299 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 83669, 2023-09-21T13:14:34.300 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 84238 2023-09-21T13:14:34.300 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.301 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 83669, 2023-09-21T13:14:34.301 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 1120, 2023-09-21T13:14:34.301 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 82549, 2023-09-21T13:14:34.302 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2023-09-21T13:14:34.302 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2023-09-21T13:14:34.302 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 3, 2023-09-21T13:14:34.303 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 21, 2023-09-21T13:14:34.303 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 936, 2023-09-21T13:14:34.303 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 45261, 2023-09-21T13:14:34.304 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 480, 2023-09-21T13:14:34.304 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2023-09-21T13:14:34.304 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2023-09-21T13:14:34.304 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2023-09-21T13:14:34.305 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 13, 2023-09-21T13:14:34.305 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 36439, 2023-09-21T13:14:34.305 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2023-09-21T13:14:34.306 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:34.306 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:34.306 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 184, 2023-09-21T13:14:34.307 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 42, 2023-09-21T13:14:34.307 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:34.307 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:34.307 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:34.308 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2023-09-21T13:14:34.308 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2023-09-21T13:14:34.308 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2023-09-21T13:14:34.309 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:34.309 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2023-09-21T13:14:34.309 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:34.310 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2023-09-21T13:14:34.310 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2023-09-21T13:14:34.310 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2023-09-21T13:14:34.311 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2023-09-21T13:14:34.311 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2023-09-21T13:14:34.311 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2023-09-21T13:14:34.312 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2023-09-21T13:14:34.312 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2023-09-21T13:14:34.312 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2023-09-21T13:14:34.312 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2023-09-21T13:14:34.313 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2023-09-21T13:14:34.313 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2023-09-21T13:14:34.313 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2023-09-21T13:14:34.314 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2023-09-21T13:14:34.314 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2023-09-21T13:14:34.314 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2023-09-21T13:14:34.315 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2023-09-21T13:14:34.315 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 115, 2023-09-21T13:14:34.315 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2023-09-21T13:14:34.315 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 31, 2023-09-21T13:14:34.316 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 12, 2023-09-21T13:14:34.316 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 12, 2023-09-21T13:14:34.316 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2023-09-21T13:14:34.317 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2023-09-21T13:14:34.317 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 650, 2023-09-21T13:14:34.317 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 4, 2023-09-21T13:14:34.317 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 205 2023-09-21T13:14:34.318 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.318 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2023-09-21T13:14:34.318 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 1, 2023-09-21T13:14:34.319 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:34.319 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2023-09-21T13:14:34.319 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2023-09-21T13:14:34.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.320 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2023-09-21T13:14:34.320 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 4 2023-09-21T13:14:34.320 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.321 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2023-09-21T13:14:34.321 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:34.322 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 10, 2023-09-21T13:14:34.325 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2023-09-21T13:14:34.326 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 10, 2023-09-21T13:14:34.326 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 36179, 2023-09-21T13:14:34.326 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:34.326 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.327 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:34.327 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:34.327 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:34.328 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:34.328 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 546897, 2023-09-21T13:14:34.328 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 126516337, 2023-09-21T13:14:34.329 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:34.329 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 546897, 2023-09-21T13:14:34.329 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:34.329 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:34.330 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 546897, 2023-09-21T13:14:34.330 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 126516337, 2023-09-21T13:14:34.330 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:34.331 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.331 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.331 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.332 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.332 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.332 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:34.333 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:34.333 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:34.333 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:34.334 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:34.334 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:34.334 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:34.334 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 83669, 2023-09-21T13:14:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 589958570, 2023-09-21T13:14:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 83669, 2023-09-21T13:14:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 589958570, 2023-09-21T13:14:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2023-09-21T13:14:34.339 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:34.339 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:34.339 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:34.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:34.340 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:34.340 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 83669, 2023-09-21T13:14:34.340 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 83669, 2023-09-21T13:14:34.341 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 83669, 2023-09-21T13:14:34.341 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 83669, 2023-09-21T13:14:34.341 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:34.342 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.342 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.342 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.343 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.343 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.343 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:34.343 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:34.344 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:34.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:34.344 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 36179, 2023-09-21T13:14:34.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 3657527, 2023-09-21T13:14:34.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:34.345 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 36179, 2023-09-21T13:14:34.346 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:34.346 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:34.346 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 936, 2023-09-21T13:14:34.346 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 3657527, 2023-09-21T13:14:34.347 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:34.347 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.347 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.348 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.348 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.348 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:34.348 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x56341ebba6e0": { 2023-09-21T13:14:34.349 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:34.349 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:34.349 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:34.350 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 166918, 2023-09-21T13:14:34.350 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 579427953, 2023-09-21T13:14:34.350 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:34.351 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 166918, 2023-09-21T13:14:34.351 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:34.351 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:34.352 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 44325, 2023-09-21T13:14:34.352 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 579427953, 2023-09-21T13:14:34.352 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:34.352 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:34.353 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:34.353 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:34.353 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.354 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:34.354 INFO:teuthology.orchestra.run.smithi160.stdout:} 2023-09-21T13:14:34.355 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:34 smithi160 ceph-mon[134450]: pgmap v581: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 13 op/s 2023-09-21T13:14:34.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:34 smithi156 ceph-mon[134078]: pgmap v581: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 13 op/s 2023-09-21T13:14:34.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:34 smithi142 ceph-mon[97663]: pgmap v581: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 45 KiB/s wr, 13 op/s 2023-09-21T13:14:34.587 INFO:tasks.check_counter:Daemon mds.c mds.exported=3 2023-09-21T13:14:34.587 INFO:tasks.check_counter:Daemon mds.c mds.imported=13 2023-09-21T13:14:34.588 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=7 2023-09-21T13:14:34.588 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2023-09-21T13:14:34.589 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2023-09-21T13:14:34.589 DEBUG:tasks.check_counter:Getting stats from f 2023-09-21T13:14:34.589 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.f perf dump 2023-09-21T13:14:35.149 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T13:14:36.391 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2023-09-21T13:14:36.392 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:36.392 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1333, 2023-09-21T13:14:36.393 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1335, 2023-09-21T13:14:36.393 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 210075358, 2023-09-21T13:14:36.393 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 414627, 2023-09-21T13:14:36.394 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 8, 2023-09-21T13:14:36.394 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:36.394 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.209930876, 2023-09-21T13:14:36.395 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.026142778, 2023-09-21T13:14:36.395 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.138994383, 2023-09-21T13:14:36.396 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.034760098, 2023-09-21T13:14:36.396 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:36.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1333, 2023-09-21T13:14:36.397 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.065795295, 2023-09-21T13:14:36.397 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000049358 2023-09-21T13:14:36.398 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.398 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:36.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.399 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.399 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.400 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.400 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:36.401 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:36.401 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.401 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:36.402 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 1145, 2023-09-21T13:14:36.402 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 1396, 2023-09-21T13:14:36.402 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 172281304, 2023-09-21T13:14:36.403 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 954262, 2023-09-21T13:14:36.403 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 9, 2023-09-21T13:14:36.403 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 7, 2023-09-21T13:14:36.404 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.172903580, 2023-09-21T13:14:36.404 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.031605097, 2023-09-21T13:14:36.405 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.101293973, 2023-09-21T13:14:36.405 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.030520195, 2023-09-21T13:14:36.406 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:36.406 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1393, 2023-09-21T13:14:36.406 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.085060092, 2023-09-21T13:14:36.407 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000061062 2023-09-21T13:14:36.407 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.407 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:36.408 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.408 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.408 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.409 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.409 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 320, 2023-09-21T13:14:36.409 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 598784 2023-09-21T13:14:36.410 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.410 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:36.411 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 2872, 2023-09-21T13:14:36.411 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 2823, 2023-09-21T13:14:36.412 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 200242218, 2023-09-21T13:14:36.412 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 969626, 2023-09-21T13:14:36.412 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:36.413 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:36.413 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.348995092, 2023-09-21T13:14:36.413 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.071615989, 2023-09-21T13:14:36.414 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.189321586, 2023-09-21T13:14:36.414 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.079728283, 2023-09-21T13:14:36.414 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:36.414 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 2823, 2023-09-21T13:14:36.415 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.126668364, 2023-09-21T13:14:36.415 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000044870 2023-09-21T13:14:36.415 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.416 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:36.416 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.416 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.417 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.417 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.417 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1772448, 2023-09-21T13:14:36.418 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 206432 2023-09-21T13:14:36.418 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.418 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2023-09-21T13:14:36.419 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2023-09-21T13:14:36.419 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2023-09-21T13:14:36.419 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.420 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2023-09-21T13:14:36.420 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:36.420 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:36.421 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 8126, 2023-09-21T13:14:36.421 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.288315799, 2023-09-21T13:14:36.422 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000035480 2023-09-21T13:14:36.422 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.422 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.423 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:36.423 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:36.423 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:36.424 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.424 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.424 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.425 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.425 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.425 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2023-09-21T13:14:36.426 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2023-09-21T13:14:36.426 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2023-09-21T13:14:36.426 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2023-09-21T13:14:36.426 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.427 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.427 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.427 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.428 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2023-09-21T13:14:36.428 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2023-09-21T13:14:36.428 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2023-09-21T13:14:36.429 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2023-09-21T13:14:36.429 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2023-09-21T13:14:36.429 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2023-09-21T13:14:36.430 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2023-09-21T13:14:36.430 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 33054, 2023-09-21T13:14:36.430 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 7559, 2023-09-21T13:14:36.431 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 25459, 2023-09-21T13:14:36.431 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 36, 2023-09-21T13:14:36.431 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 22255, 2023-09-21T13:14:36.432 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 4665, 2023-09-21T13:14:36.432 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2023-09-21T13:14:36.432 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2023-09-21T13:14:36.432 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 19, 2023-09-21T13:14:36.433 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2023-09-21T13:14:36.433 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2023-09-21T13:14:36.433 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2023-09-21T13:14:36.434 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2023-09-21T13:14:36.434 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2023-09-21T13:14:36.434 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:36.435 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2023-09-21T13:14:36.435 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2023-09-21T13:14:36.435 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2023-09-21T13:14:36.435 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2023-09-21T13:14:36.436 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2023-09-21T13:14:36.436 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2023-09-21T13:14:36.436 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2023-09-21T13:14:36.437 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:36.437 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2023-09-21T13:14:36.437 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2023-09-21T13:14:36.437 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 0, 2023-09-21T13:14:36.438 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 0, 2023-09-21T13:14:36.438 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 0, 2023-09-21T13:14:36.438 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2023-09-21T13:14:36.439 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:36.439 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:36.439 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:36.440 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2023-09-21T13:14:36.440 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2023-09-21T13:14:36.440 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2023-09-21T13:14:36.441 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2023-09-21T13:14:36.441 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2023-09-21T13:14:36.441 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2023-09-21T13:14:36.441 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2023-09-21T13:14:36.442 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:36.442 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-21T13:14:36.442 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:36.443 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2023-09-21T13:14:36.443 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2023-09-21T13:14:36.443 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2023-09-21T13:14:36.444 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2023-09-21T13:14:36.444 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.444 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2023-09-21T13:14:36.445 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2023-09-21T13:14:36.445 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2023-09-21T13:14:36.445 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2023-09-21T13:14:36.446 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2023-09-21T13:14:36.446 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2023-09-21T13:14:36.446 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2023-09-21T13:14:36.447 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:36.447 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:36.448 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2023-09-21T13:14:36.448 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2023-09-21T13:14:36.448 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:36.449 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2023-09-21T13:14:36.449 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:36.450 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:36.450 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:36.450 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2023-09-21T13:14:36.450 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2023-09-21T13:14:36.451 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2023-09-21T13:14:36.451 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2023-09-21T13:14:36.452 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2023-09-21T13:14:36.452 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2023-09-21T13:14:36.452 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:36.452 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2023-09-21T13:14:36.453 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.453 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2023-09-21T13:14:36.453 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2023-09-21T13:14:36.454 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2023-09-21T13:14:36.454 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2023-09-21T13:14:36.454 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2023-09-21T13:14:36.455 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 166918, 2023-09-21T13:14:36.455 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2023-09-21T13:14:36.455 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2023-09-21T13:14:36.455 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2023-09-21T13:14:36.456 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2023-09-21T13:14:36.456 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2023-09-21T13:14:36.456 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 131, 2023-09-21T13:14:36.457 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 15, 2023-09-21T13:14:36.457 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2023-09-21T13:14:36.457 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2023-09-21T13:14:36.457 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 146532781, 2023-09-21T13:14:36.458 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 583622257, 2023-09-21T13:14:36.458 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 583619925, 2023-09-21T13:14:36.458 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2023-09-21T13:14:36.459 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.459 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.459 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.460 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.460 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 166918 2023-09-21T13:14:36.460 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.461 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2023-09-21T13:14:36.461 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 1259, 2023-09-21T13:14:36.461 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 37484, 2023-09-21T13:14:36.462 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 36225, 2023-09-21T13:14:36.462 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 93, 2023-09-21T13:14:36.462 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 186, 2023-09-21T13:14:36.463 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 93, 2023-09-21T13:14:36.463 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 33054, 2023-09-21T13:14:36.463 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 37791, 2023-09-21T13:14:36.463 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 4737, 2023-09-21T13:14:36.464 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2023-09-21T13:14:36.464 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2023-09-21T13:14:36.464 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2023-09-21T13:14:36.465 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 85224, 2023-09-21T13:14:36.465 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 207152 2023-09-21T13:14:36.465 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.465 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2023-09-21T13:14:36.466 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2023-09-21T13:14:36.466 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2023-09-21T13:14:36.466 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2023-09-21T13:14:36.467 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2023-09-21T13:14:36.467 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2023-09-21T13:14:36.467 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2023-09-21T13:14:36.468 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.468 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.468 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.469 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.469 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2023-09-21T13:14:36.469 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.469 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.470 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.470 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.470 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:36.471 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.471 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.471 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.472 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.472 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2023-09-21T13:14:36.472 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.472 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.473 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.473 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.473 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2023-09-21T13:14:36.474 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.474 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.474 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.475 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.475 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:36.475 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.475 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.476 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.476 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.476 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2023-09-21T13:14:36.477 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.477 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.477 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.478 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.478 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2023-09-21T13:14:36.478 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.478 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.479 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.479 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.479 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:36.480 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.480 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.480 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.481 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.481 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:36.481 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.482 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.482 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.482 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.483 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2023-09-21T13:14:36.483 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.483 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.483 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.484 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.484 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2023-09-21T13:14:36.484 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.485 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.485 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.485 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.486 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2023-09-21T13:14:36.486 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.487 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.487 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.487 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.488 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2023-09-21T13:14:36.488 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.489 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.489 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.489 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.489 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2023-09-21T13:14:36.490 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.490 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.490 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.491 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.491 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2023-09-21T13:14:36.491 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.492 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.492 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.492 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.492 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2023-09-21T13:14:36.493 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.493 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.493 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.494 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.494 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:36.494 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.495 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.495 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.495 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.495 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:36.496 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.496 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.496 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.497 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.497 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2023-09-21T13:14:36.497 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.498 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.498 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.498 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:36.499 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.499 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.499 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.500 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.500 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:36.501 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.501 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.501 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.501 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.502 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2023-09-21T13:14:36.502 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.503 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.503 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.503 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.504 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:36.504 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.504 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.505 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.505 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.505 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:36.506 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.506 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.506 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.507 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.507 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2023-09-21T13:14:36.508 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.508 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.508 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.509 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.509 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2023-09-21T13:14:36.509 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.510 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.510 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.511 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.511 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2023-09-21T13:14:36.512 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.512 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.513 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.513 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.513 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2023-09-21T13:14:36.513 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.514 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.514 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.515 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.515 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:36.516 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:36.516 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:36.517 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.517 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.517 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.518 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.518 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.519 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2023-09-21T13:14:36.519 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 2, 2023-09-21T13:14:36.519 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 4, 2023-09-21T13:14:36.520 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 2, 2023-09-21T13:14:36.520 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 3, 2023-09-21T13:14:36.520 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2023-09-21T13:14:36.520 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2023-09-21T13:14:36.521 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2023-09-21T13:14:36.521 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 3801, 2023-09-21T13:14:36.521 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:36.522 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.522 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2023-09-21T13:14:36.522 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:36.523 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:36.523 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:36.523 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:36.523 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:36.524 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:36.524 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:36.524 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:36.525 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:36.525 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:36.525 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:36.525 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:36.526 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:36.526 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:36.527 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:36.527 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:36.527 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:36.527 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:36.528 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:36.528 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:36.528 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:36.529 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:36.529 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:36.529 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:36.529 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:36.530 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:36.530 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:36.530 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:36.531 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:36.531 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:36.531 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:36.532 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2023-09-21T13:14:36.532 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:36.532 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:36.533 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:36.533 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:36.533 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 290389, 2023-09-21T13:14:36.533 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 1536, 2023-09-21T13:14:36.534 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:36.534 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:36.534 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2023-09-21T13:14:36.535 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2023-09-21T13:14:36.535 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:36.535 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:36.536 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:36.536 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:36.536 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8032, 2023-09-21T13:14:36.536 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 167, 2023-09-21T13:14:36.537 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:36.537 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:36.537 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:36.538 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2023-09-21T13:14:36.538 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 26283874, 2023-09-21T13:14:36.538 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 164842, 2023-09-21T13:14:36.539 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:36.539 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2023-09-21T13:14:36.539 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:36.539 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2023-09-21T13:14:36.540 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.540 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2023-09-21T13:14:36.540 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2023-09-21T13:14:36.541 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2023-09-21T13:14:36.541 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 4930, 2023-09-21T13:14:36.541 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 21, 2023-09-21T13:14:36.541 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 3, 2023-09-21T13:14:36.542 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 4930, 2023-09-21T13:14:36.542 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2023-09-21T13:14:36.542 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4930, 2023-09-21T13:14:36.543 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 9.110850966, 2023-09-21T13:14:36.543 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.001848042 2023-09-21T13:14:36.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.544 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2023-09-21T13:14:36.544 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2023-09-21T13:14:36.544 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 4930, 2023-09-21T13:14:36.545 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 4931 2023-09-21T13:14:36.545 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.545 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 4930, 2023-09-21T13:14:36.545 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 4930, 2023-09-21T13:14:36.546 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2023-09-21T13:14:36.546 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2023-09-21T13:14:36.546 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2023-09-21T13:14:36.547 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 2722, 2023-09-21T13:14:36.547 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2023-09-21T13:14:36.547 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 2206, 2023-09-21T13:14:36.548 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2023-09-21T13:14:36.548 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2023-09-21T13:14:36.548 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2023-09-21T13:14:36.549 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2023-09-21T13:14:36.549 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2023-09-21T13:14:36.549 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2023-09-21T13:14:36.549 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2023-09-21T13:14:36.550 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2023-09-21T13:14:36.550 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:36.550 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:36.551 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 1, 2023-09-21T13:14:36.551 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2023-09-21T13:14:36.551 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:36.552 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:36.552 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:36.552 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2023-09-21T13:14:36.552 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2023-09-21T13:14:36.553 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2023-09-21T13:14:36.553 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:36.553 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2023-09-21T13:14:36.554 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:36.554 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2023-09-21T13:14:36.554 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2023-09-21T13:14:36.555 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2023-09-21T13:14:36.555 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2023-09-21T13:14:36.555 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2023-09-21T13:14:36.555 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2023-09-21T13:14:36.556 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2023-09-21T13:14:36.556 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2023-09-21T13:14:36.556 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2023-09-21T13:14:36.557 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2023-09-21T13:14:36.557 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2023-09-21T13:14:36.557 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2023-09-21T13:14:36.558 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2023-09-21T13:14:36.558 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2023-09-21T13:14:36.558 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2023-09-21T13:14:36.559 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2023-09-21T13:14:36.559 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2023-09-21T13:14:36.559 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 115, 2023-09-21T13:14:36.559 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2023-09-21T13:14:36.560 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 31, 2023-09-21T13:14:36.560 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 11, 2023-09-21T13:14:36.560 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 11, 2023-09-21T13:14:36.561 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2023-09-21T13:14:36.561 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2023-09-21T13:14:36.561 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2023-09-21T13:14:36.561 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2023-09-21T13:14:36.562 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2023-09-21T13:14:36.562 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.562 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2023-09-21T13:14:36.563 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2023-09-21T13:14:36.563 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:36.563 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2023-09-21T13:14:36.564 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2023-09-21T13:14:36.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.564 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2023-09-21T13:14:36.565 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2023-09-21T13:14:36.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.565 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2023-09-21T13:14:36.565 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:36.566 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2023-09-21T13:14:36.566 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2023-09-21T13:14:36.566 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2023-09-21T13:14:36.567 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2023-09-21T13:14:36.567 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:36.567 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.568 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:36.568 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:36.568 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:36.569 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:36.569 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 5346, 2023-09-21T13:14:36.569 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 582093890, 2023-09-21T13:14:36.569 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:36.570 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 5346, 2023-09-21T13:14:36.570 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:36.570 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:36.571 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 5346, 2023-09-21T13:14:36.571 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 582093890, 2023-09-21T13:14:36.571 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:36.572 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.572 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.572 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.572 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.573 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:36.573 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:36.574 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:36.575 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:36.575 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:36.575 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:36.575 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4930, 2023-09-21T13:14:36.576 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 579470442, 2023-09-21T13:14:36.576 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4930, 2023-09-21T13:14:36.576 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 579470442, 2023-09-21T13:14:36.577 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:36.577 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.577 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.578 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.578 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.578 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.578 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:36.579 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:36.579 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2023-09-21T13:14:36.579 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:36.580 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:36.580 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:36.580 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:36.581 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:36.581 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 4930, 2023-09-21T13:14:36.581 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 4930, 2023-09-21T13:14:36.581 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 4930, 2023-09-21T13:14:36.582 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 4930, 2023-09-21T13:14:36.582 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:36.582 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.583 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.583 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.583 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.584 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.584 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:36.584 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:36.584 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:36.585 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:36.585 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:36.585 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:36.586 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:36.586 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:36.586 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:36.587 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:36.587 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2023-09-21T13:14:36.587 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2023-09-21T13:14:36.588 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:36.588 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.588 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.588 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.589 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.589 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:36.589 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x56073f826960": { 2023-09-21T13:14:36.590 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:36.590 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:36.590 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:36.590 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:36.591 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:36.591 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:36.591 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:36.592 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:36.592 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:36.592 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2023-09-21T13:14:36.593 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2023-09-21T13:14:36.593 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:36.593 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:36.593 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:36.594 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:36.594 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.594 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:36.595 INFO:teuthology.orchestra.run.smithi160.stdout:} 2023-09-21T13:14:36.596 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:36 smithi142 ceph-mon[97663]: pgmap v582: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-09-21T13:14:36.596 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:36 smithi156 ceph-mon[134078]: pgmap v582: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-09-21T13:14:36.596 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:36 smithi160 ceph-mon[134450]: pgmap v582: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 KiB/s wr, 8 op/s 2023-09-21T13:14:36.796 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-09-21T13:14:36.796 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-09-21T13:14:36.797 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2023-09-21T13:14:36.797 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2023-09-21T13:14:36.797 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2023-09-21T13:14:36.798 DEBUG:tasks.check_counter:Getting stats from i 2023-09-21T13:14:36.798 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.i perf dump 2023-09-21T13:14:37.355 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T13:14:37.823 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:37 smithi160 ceph-mon[134450]: pgmap v583: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2023-09-21T13:14:38.147 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:37 smithi156 ceph-mon[134078]: pgmap v583: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2023-09-21T13:14:38.158 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:37 smithi142 ceph-mon[97663]: pgmap v583: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 31 KiB/s wr, 11 op/s 2023-09-21T13:14:38.552 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2023-09-21T13:14:38.552 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:38.553 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 204, 2023-09-21T13:14:38.553 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 206, 2023-09-21T13:14:38.553 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 21040291, 2023-09-21T13:14:38.554 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 63463, 2023-09-21T13:14:38.554 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 7, 2023-09-21T13:14:38.555 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:38.555 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.033722601, 2023-09-21T13:14:38.555 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.005459096, 2023-09-21T13:14:38.555 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.017213354, 2023-09-21T13:14:38.556 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.007505231, 2023-09-21T13:14:38.556 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:38.556 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 204, 2023-09-21T13:14:38.557 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.028065410, 2023-09-21T13:14:38.557 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000137575 2023-09-21T13:14:38.557 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.557 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:38.558 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.558 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.558 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.559 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.559 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-21T13:14:38.559 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 0 2023-09-21T13:14:38.560 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.560 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:38.560 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 260, 2023-09-21T13:14:38.560 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 252, 2023-09-21T13:14:38.561 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 33246882, 2023-09-21T13:14:38.561 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 88005, 2023-09-21T13:14:38.561 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:38.561 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:38.562 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.041472067, 2023-09-21T13:14:38.562 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.007332442, 2023-09-21T13:14:38.562 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.026544596, 2023-09-21T13:14:38.563 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.006713399, 2023-09-21T13:14:38.563 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:38.563 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 252, 2023-09-21T13:14:38.563 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.025984448, 2023-09-21T13:14:38.564 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000103112 2023-09-21T13:14:38.564 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.564 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:38.564 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.565 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.565 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.565 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.566 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 190960, 2023-09-21T13:14:38.566 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 26992 2023-09-21T13:14:38.566 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.566 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:38.567 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 231, 2023-09-21T13:14:38.567 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 263, 2023-09-21T13:14:38.567 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 26713991, 2023-09-21T13:14:38.568 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 208651, 2023-09-21T13:14:38.568 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:38.568 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 4, 2023-09-21T13:14:38.568 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.032998041, 2023-09-21T13:14:38.569 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.007105057, 2023-09-21T13:14:38.569 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.017208304, 2023-09-21T13:14:38.569 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.006805839, 2023-09-21T13:14:38.570 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:38.570 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 261, 2023-09-21T13:14:38.570 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.024379734, 2023-09-21T13:14:38.570 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000093408 2023-09-21T13:14:38.571 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.571 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:38.571 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.571 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.572 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.572 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.572 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 160, 2023-09-21T13:14:38.573 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 137120 2023-09-21T13:14:38.573 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.573 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2023-09-21T13:14:38.573 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 1, 2023-09-21T13:14:38.574 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2023-09-21T13:14:38.574 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.574 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-MDSRank": { 2023-09-21T13:14:38.575 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:38.575 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:38.575 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 1001, 2023-09-21T13:14:38.576 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.063596731, 2023-09-21T13:14:38.576 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000063533 2023-09-21T13:14:38.577 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.577 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.577 INFO:teuthology.orchestra.run.smithi160.stdout: "finisher-PurgeQueue": { 2023-09-21T13:14:38.577 INFO:teuthology.orchestra.run.smithi160.stdout: "queue_len": 0, 2023-09-21T13:14:38.578 INFO:teuthology.orchestra.run.smithi160.stdout: "complete_latency": { 2023-09-21T13:14:38.578 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.579 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.579 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.579 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.580 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.580 INFO:teuthology.orchestra.run.smithi160.stdout: "mds": { 2023-09-21T13:14:38.580 INFO:teuthology.orchestra.run.smithi160.stdout: "request": 0, 2023-09-21T13:14:38.581 INFO:teuthology.orchestra.run.smithi160.stdout: "reply": 0, 2023-09-21T13:14:38.581 INFO:teuthology.orchestra.run.smithi160.stdout: "reply_latency": { 2023-09-21T13:14:38.581 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.582 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.582 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.582 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.583 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_reply": 0, 2023-09-21T13:14:38.583 INFO:teuthology.orchestra.run.smithi160.stdout: "forward": 0, 2023-09-21T13:14:38.583 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_complete": 0, 2023-09-21T13:14:38.583 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_fetch_keys": 0, 2023-09-21T13:14:38.584 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_commit": 0, 2023-09-21T13:14:38.584 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_split": 0, 2023-09-21T13:14:38.584 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_merge": 0, 2023-09-21T13:14:38.584 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes": 5158, 2023-09-21T13:14:38.585 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_top": 3284, 2023-09-21T13:14:38.585 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_bottom": 1799, 2023-09-21T13:14:38.585 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pin_tail": 75, 2023-09-21T13:14:38.586 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_pinned": 466, 2023-09-21T13:14:38.586 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_expired": 46, 2023-09-21T13:14:38.586 INFO:teuthology.orchestra.run.smithi160.stdout: "inodes_with_caps": 0, 2023-09-21T13:14:38.587 INFO:teuthology.orchestra.run.smithi160.stdout: "caps": 0, 2023-09-21T13:14:38.587 INFO:teuthology.orchestra.run.smithi160.stdout: "subtrees": 16, 2023-09-21T13:14:38.587 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse": 0, 2023-09-21T13:14:38.588 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_hit": 0, 2023-09-21T13:14:38.588 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_forward": 0, 2023-09-21T13:14:38.589 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_discover": 0, 2023-09-21T13:14:38.589 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_dir_fetch": 0, 2023-09-21T13:14:38.589 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_remote_ino": 0, 2023-09-21T13:14:38.590 INFO:teuthology.orchestra.run.smithi160.stdout: "traverse_lock": 0, 2023-09-21T13:14:38.590 INFO:teuthology.orchestra.run.smithi160.stdout: "load_cent": 0, 2023-09-21T13:14:38.590 INFO:teuthology.orchestra.run.smithi160.stdout: "q": 0, 2023-09-21T13:14:38.591 INFO:teuthology.orchestra.run.smithi160.stdout: "exported": 0, 2023-09-21T13:14:38.591 INFO:teuthology.orchestra.run.smithi160.stdout: "exported_inodes": 0, 2023-09-21T13:14:38.592 INFO:teuthology.orchestra.run.smithi160.stdout: "imported": 0, 2023-09-21T13:14:38.592 INFO:teuthology.orchestra.run.smithi160.stdout: "imported_inodes": 0, 2023-09-21T13:14:38.592 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_dir_fetch": 0, 2023-09-21T13:14:38.593 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_backtrace_fetch": 0, 2023-09-21T13:14:38.593 INFO:teuthology.orchestra.run.smithi160.stdout: "openino_peer_discover": 0, 2023-09-21T13:14:38.593 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rfiles": 734, 2023-09-21T13:14:38.594 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rbytes": 226086822, 2023-09-21T13:14:38.594 INFO:teuthology.orchestra.run.smithi160.stdout: "root_rsnaps": 7, 2023-09-21T13:14:38.594 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_fetch": 0, 2023-09-21T13:14:38.594 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_set_tag": 0, 2023-09-21T13:14:38.595 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_backtrace_repaired": 0, 2023-09-21T13:14:38.595 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_inotable_repaired": 0, 2023-09-21T13:14:38.595 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_inodes": 0, 2023-09-21T13:14:38.596 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dir_base_inodes": 0, 2023-09-21T13:14:38.596 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_dirfrag_rstats": 0, 2023-09-21T13:14:38.596 INFO:teuthology.orchestra.run.smithi160.stdout: "scrub_file_inodes": 0, 2023-09-21T13:14:38.596 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_inode_file_caps": 0, 2023-09-21T13:14:38.597 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_revoke": 0, 2023-09-21T13:14:38.597 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_grant": 0, 2023-09-21T13:14:38.597 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_trunc": 0, 2023-09-21T13:14:38.598 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-21T13:14:38.598 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-21T13:14:38.598 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps": 0, 2023-09-21T13:14:38.598 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_caps_dirty": 0, 2023-09-21T13:14:38.599 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_cap_release": 0, 2023-09-21T13:14:38.599 INFO:teuthology.orchestra.run.smithi160.stdout: "process_request_cap_release": 0 2023-09-21T13:14:38.599 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.600 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_cache": { 2023-09-21T13:14:38.600 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update": 0, 2023-09-21T13:14:38.600 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_update_receipt": 0, 2023-09-21T13:14:38.600 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_try_discover": 0, 2023-09-21T13:14:38.601 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_send_discover": 0, 2023-09-21T13:14:38.601 INFO:teuthology.orchestra.run.smithi160.stdout: "dir_handle_discover": 0, 2023-09-21T13:14:38.601 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays": 0, 2023-09-21T13:14:38.601 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_delayed": 0, 2023-09-21T13:14:38.602 INFO:teuthology.orchestra.run.smithi160.stdout: "num_strays_enqueuing": 0, 2023-09-21T13:14:38.602 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_created": 0, 2023-09-21T13:14:38.602 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_enqueued": 0, 2023-09-21T13:14:38.603 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_reintegrated": 0, 2023-09-21T13:14:38.603 INFO:teuthology.orchestra.run.smithi160.stdout: "strays_migrated": 0, 2023-09-21T13:14:38.603 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_processing": 0, 2023-09-21T13:14:38.603 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_enqueued": 0, 2023-09-21T13:14:38.604 INFO:teuthology.orchestra.run.smithi160.stdout: "num_recovering_prioritized": 0, 2023-09-21T13:14:38.604 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_started": 0, 2023-09-21T13:14:38.604 INFO:teuthology.orchestra.run.smithi160.stdout: "recovery_completed": 0, 2023-09-21T13:14:38.604 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_enqueue_scrub": 0, 2023-09-21T13:14:38.605 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_exportdir": 0, 2023-09-21T13:14:38.605 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_flush": 0, 2023-09-21T13:14:38.605 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragmentdir": 0, 2023-09-21T13:14:38.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_fragstats": 0, 2023-09-21T13:14:38.606 INFO:teuthology.orchestra.run.smithi160.stdout: "ireq_inodestats": 0 2023-09-21T13:14:38.606 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.606 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_log": { 2023-09-21T13:14:38.607 INFO:teuthology.orchestra.run.smithi160.stdout: "evlrg": 0, 2023-09-21T13:14:38.607 INFO:teuthology.orchestra.run.smithi160.stdout: "evadd": 0, 2023-09-21T13:14:38.607 INFO:teuthology.orchestra.run.smithi160.stdout: "evex": 0, 2023-09-21T13:14:38.607 INFO:teuthology.orchestra.run.smithi160.stdout: "evtrm": 0, 2023-09-21T13:14:38.608 INFO:teuthology.orchestra.run.smithi160.stdout: "ev": 20908, 2023-09-21T13:14:38.608 INFO:teuthology.orchestra.run.smithi160.stdout: "evexg": 0, 2023-09-21T13:14:38.608 INFO:teuthology.orchestra.run.smithi160.stdout: "evexd": 0, 2023-09-21T13:14:38.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segadd": 0, 2023-09-21T13:14:38.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segex": 0, 2023-09-21T13:14:38.609 INFO:teuthology.orchestra.run.smithi160.stdout: "segtrm": 0, 2023-09-21T13:14:38.609 INFO:teuthology.orchestra.run.smithi160.stdout: "seg": 2, 2023-09-21T13:14:38.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segmjr": 5, 2023-09-21T13:14:38.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segexg": 0, 2023-09-21T13:14:38.610 INFO:teuthology.orchestra.run.smithi160.stdout: "segexd": 0, 2023-09-21T13:14:38.610 INFO:teuthology.orchestra.run.smithi160.stdout: "expos": 868906475, 2023-09-21T13:14:38.611 INFO:teuthology.orchestra.run.smithi160.stdout: "wrpos": 873902414, 2023-09-21T13:14:38.611 INFO:teuthology.orchestra.run.smithi160.stdout: "rdpos": 873881560, 2023-09-21T13:14:38.611 INFO:teuthology.orchestra.run.smithi160.stdout: "jlat": { 2023-09-21T13:14:38.612 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.612 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.612 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.612 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.613 INFO:teuthology.orchestra.run.smithi160.stdout: "replayed": 20908 2023-09-21T13:14:38.613 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.613 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_mem": { 2023-09-21T13:14:38.614 INFO:teuthology.orchestra.run.smithi160.stdout: "ino": 346, 2023-09-21T13:14:38.614 INFO:teuthology.orchestra.run.smithi160.stdout: "ino+": 5050, 2023-09-21T13:14:38.614 INFO:teuthology.orchestra.run.smithi160.stdout: "ino-": 4704, 2023-09-21T13:14:38.615 INFO:teuthology.orchestra.run.smithi160.stdout: "dir": 87, 2023-09-21T13:14:38.615 INFO:teuthology.orchestra.run.smithi160.stdout: "dir+": 125, 2023-09-21T13:14:38.615 INFO:teuthology.orchestra.run.smithi160.stdout: "dir-": 38, 2023-09-21T13:14:38.616 INFO:teuthology.orchestra.run.smithi160.stdout: "dn": 5158, 2023-09-21T13:14:38.616 INFO:teuthology.orchestra.run.smithi160.stdout: "dn+": 5434, 2023-09-21T13:14:38.616 INFO:teuthology.orchestra.run.smithi160.stdout: "dn-": 276, 2023-09-21T13:14:38.617 INFO:teuthology.orchestra.run.smithi160.stdout: "cap": 0, 2023-09-21T13:14:38.617 INFO:teuthology.orchestra.run.smithi160.stdout: "cap+": 0, 2023-09-21T13:14:38.617 INFO:teuthology.orchestra.run.smithi160.stdout: "cap-": 0, 2023-09-21T13:14:38.618 INFO:teuthology.orchestra.run.smithi160.stdout: "rss": 55924, 2023-09-21T13:14:38.618 INFO:teuthology.orchestra.run.smithi160.stdout: "heap": 207128 2023-09-21T13:14:38.622 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.623 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_server": { 2023-09-21T13:14:38.623 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_client_request": 0, 2023-09-21T13:14:38.624 INFO:teuthology.orchestra.run.smithi160.stdout: "dispatch_server_request": 0, 2023-09-21T13:14:38.624 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_request": 0, 2023-09-21T13:14:38.624 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_client_session": 0, 2023-09-21T13:14:38.625 INFO:teuthology.orchestra.run.smithi160.stdout: "handle_peer_request": 0, 2023-09-21T13:14:38.625 INFO:teuthology.orchestra.run.smithi160.stdout: "req_create_latency": { 2023-09-21T13:14:38.626 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.626 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.626 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.627 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.627 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getattr_latency": { 2023-09-21T13:14:38.628 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.628 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.628 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.629 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.629 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getfilelock_latency": { 2023-09-21T13:14:38.629 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.630 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.630 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.630 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.631 INFO:teuthology.orchestra.run.smithi160.stdout: "req_link_latency": { 2023-09-21T13:14:38.631 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.631 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.631 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.632 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.632 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookup_latency": { 2023-09-21T13:14:38.632 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.633 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.633 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.633 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.633 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookuphash_latency": { 2023-09-21T13:14:38.634 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.634 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.634 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.635 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.635 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupino_latency": { 2023-09-21T13:14:38.636 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.636 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.636 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.637 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.637 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupname_latency": { 2023-09-21T13:14:38.637 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.637 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.638 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.638 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.639 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupparent_latency": { 2023-09-21T13:14:38.639 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.639 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.639 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.640 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.640 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lookupsnap_latency": { 2023-09-21T13:14:38.640 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.641 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.641 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.641 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.641 INFO:teuthology.orchestra.run.smithi160.stdout: "req_lssnap_latency": { 2023-09-21T13:14:38.642 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.642 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.642 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.643 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.643 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mkdir_latency": { 2023-09-21T13:14:38.643 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.643 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.644 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.644 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.644 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mknod_latency": { 2023-09-21T13:14:38.645 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.645 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.645 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.646 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.646 INFO:teuthology.orchestra.run.smithi160.stdout: "req_mksnap_latency": { 2023-09-21T13:14:38.647 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.647 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.647 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.647 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.648 INFO:teuthology.orchestra.run.smithi160.stdout: "req_open_latency": { 2023-09-21T13:14:38.648 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.648 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.649 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.649 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.649 INFO:teuthology.orchestra.run.smithi160.stdout: "req_readdir_latency": { 2023-09-21T13:14:38.650 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.650 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.650 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.651 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.651 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rename_latency": { 2023-09-21T13:14:38.651 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.652 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.652 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.653 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.653 INFO:teuthology.orchestra.run.smithi160.stdout: "req_renamesnap_latency": { 2023-09-21T13:14:38.654 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.654 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.655 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.655 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.656 INFO:teuthology.orchestra.run.smithi160.stdout: "req_snapdiff_latency": { 2023-09-21T13:14:38.656 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.657 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.657 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.657 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.658 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmdir_latency": { 2023-09-21T13:14:38.658 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.659 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.659 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.659 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.660 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmsnap_latency": { 2023-09-21T13:14:38.660 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.660 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.661 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.661 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.661 INFO:teuthology.orchestra.run.smithi160.stdout: "req_rmxattr_latency": { 2023-09-21T13:14:38.662 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.662 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.662 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.662 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.663 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setattr_latency": { 2023-09-21T13:14:38.663 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.664 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.664 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.665 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.665 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setdirlayout_latency": { 2023-09-21T13:14:38.666 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.666 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.666 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.667 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.667 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setfilelock_latency": { 2023-09-21T13:14:38.668 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.668 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.668 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.669 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.669 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setlayout_latency": { 2023-09-21T13:14:38.669 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.670 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.670 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.670 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.671 INFO:teuthology.orchestra.run.smithi160.stdout: "req_setxattr_latency": { 2023-09-21T13:14:38.671 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.671 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.672 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.672 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.672 INFO:teuthology.orchestra.run.smithi160.stdout: "req_symlink_latency": { 2023-09-21T13:14:38.673 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.673 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.673 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.674 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.674 INFO:teuthology.orchestra.run.smithi160.stdout: "req_unlink_latency": { 2023-09-21T13:14:38.674 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.675 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.675 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.675 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.675 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_revoke_eviction": 0, 2023-09-21T13:14:38.676 INFO:teuthology.orchestra.run.smithi160.stdout: "cap_acquisition_throttle": 0, 2023-09-21T13:14:38.676 INFO:teuthology.orchestra.run.smithi160.stdout: "req_getvxattr_latency": { 2023-09-21T13:14:38.676 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.677 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.677 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.677 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.677 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.678 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_sessions": { 2023-09-21T13:14:38.678 INFO:teuthology.orchestra.run.smithi160.stdout: "session_count": 2, 2023-09-21T13:14:38.679 INFO:teuthology.orchestra.run.smithi160.stdout: "session_add": 2, 2023-09-21T13:14:38.679 INFO:teuthology.orchestra.run.smithi160.stdout: "session_remove": 0, 2023-09-21T13:14:38.679 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_open": 0, 2023-09-21T13:14:38.680 INFO:teuthology.orchestra.run.smithi160.stdout: "sessions_stale": 0, 2023-09-21T13:14:38.680 INFO:teuthology.orchestra.run.smithi160.stdout: "total_load": 0, 2023-09-21T13:14:38.680 INFO:teuthology.orchestra.run.smithi160.stdout: "average_load": 0, 2023-09-21T13:14:38.681 INFO:teuthology.orchestra.run.smithi160.stdout: "avg_session_uptime": 2901, 2023-09-21T13:14:38.681 INFO:teuthology.orchestra.run.smithi160.stdout: "mdthresh_evicted": 0 2023-09-21T13:14:38.681 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.681 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2023-09-21T13:14:38.682 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:38.682 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:38.682 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:38.683 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:38.683 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:38.683 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:38.683 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:38.684 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:38.684 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:38.684 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:38.684 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:38.685 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:38.685 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:38.685 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:38.686 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:38.686 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:38.686 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:38.687 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:38.687 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:38.687 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:38.688 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:38.688 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:38.689 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:38.689 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:38.689 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:38.690 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:38.690 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:38.690 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:38.691 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:38.691 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:38.691 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:38.692 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2023-09-21T13:14:38.692 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:38.692 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:38.693 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:38.693 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:38.693 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 231697, 2023-09-21T13:14:38.694 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 617, 2023-09-21T13:14:38.694 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:38.694 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:38.695 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2023-09-21T13:14:38.695 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2023-09-21T13:14:38.696 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:38.696 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:38.697 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:38.697 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:38.697 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 8032, 2023-09-21T13:14:38.698 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 167, 2023-09-21T13:14:38.698 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:38.698 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:38.699 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:38.699 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2023-09-21T13:14:38.700 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 4725533, 2023-09-21T13:14:38.700 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 32925, 2023-09-21T13:14:38.700 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:38.701 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2023-09-21T13:14:38.701 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:38.701 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2023-09-21T13:14:38.702 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.702 INFO:teuthology.orchestra.run.smithi160.stdout: "objecter": { 2023-09-21T13:14:38.702 INFO:teuthology.orchestra.run.smithi160.stdout: "op_active": 0, 2023-09-21T13:14:38.703 INFO:teuthology.orchestra.run.smithi160.stdout: "op_laggy": 0, 2023-09-21T13:14:38.703 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send": 630, 2023-09-21T13:14:38.703 INFO:teuthology.orchestra.run.smithi160.stdout: "op_send_bytes": 26, 2023-09-21T13:14:38.703 INFO:teuthology.orchestra.run.smithi160.stdout: "op_resend": 4, 2023-09-21T13:14:38.704 INFO:teuthology.orchestra.run.smithi160.stdout: "op_reply": 630, 2023-09-21T13:14:38.704 INFO:teuthology.orchestra.run.smithi160.stdout: "op_latency": { 2023-09-21T13:14:38.704 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 630, 2023-09-21T13:14:38.705 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 1.311978706, 2023-09-21T13:14:38.706 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.002082505 2023-09-21T13:14:38.706 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.706 INFO:teuthology.orchestra.run.smithi160.stdout: "op_inflight": 0, 2023-09-21T13:14:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "oplen_avg": { 2023-09-21T13:14:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 630, 2023-09-21T13:14:38.707 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 631 2023-09-21T13:14:38.708 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op": 630, 2023-09-21T13:14:38.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_r": 630, 2023-09-21T13:14:38.708 INFO:teuthology.orchestra.run.smithi160.stdout: "op_w": 0, 2023-09-21T13:14:38.709 INFO:teuthology.orchestra.run.smithi160.stdout: "op_rmw": 0, 2023-09-21T13:14:38.709 INFO:teuthology.orchestra.run.smithi160.stdout: "op_pg": 0, 2023-09-21T13:14:38.709 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_stat": 357, 2023-09-21T13:14:38.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_create": 0, 2023-09-21T13:14:38.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_read": 270, 2023-09-21T13:14:38.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_write": 0, 2023-09-21T13:14:38.710 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writefull": 0, 2023-09-21T13:14:38.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_writesame": 0, 2023-09-21T13:14:38.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_append": 0, 2023-09-21T13:14:38.711 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_zero": 0, 2023-09-21T13:14:38.712 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_truncate": 0, 2023-09-21T13:14:38.712 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_delete": 0, 2023-09-21T13:14:38.712 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_mapext": 0, 2023-09-21T13:14:38.712 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_sparse_read": 0, 2023-09-21T13:14:38.713 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_clonerange": 0, 2023-09-21T13:14:38.713 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_getxattr": 2, 2023-09-21T13:14:38.713 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_setxattr": 0, 2023-09-21T13:14:38.714 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_cmpxattr": 0, 2023-09-21T13:14:38.714 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_rmxattr": 0, 2023-09-21T13:14:38.714 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_resetxattrs": 0, 2023-09-21T13:14:38.714 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_call": 0, 2023-09-21T13:14:38.715 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_watch": 0, 2023-09-21T13:14:38.715 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_notify": 0, 2023-09-21T13:14:38.715 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_src_cmpxattr": 0, 2023-09-21T13:14:38.716 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls": 0, 2023-09-21T13:14:38.716 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_pgls_filter": 0, 2023-09-21T13:14:38.716 INFO:teuthology.orchestra.run.smithi160.stdout: "osdop_other": 0, 2023-09-21T13:14:38.716 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_active": 0, 2023-09-21T13:14:38.717 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_send": 0, 2023-09-21T13:14:38.717 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_resend": 0, 2023-09-21T13:14:38.717 INFO:teuthology.orchestra.run.smithi160.stdout: "linger_ping": 0, 2023-09-21T13:14:38.718 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_active": 0, 2023-09-21T13:14:38.718 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_send": 0, 2023-09-21T13:14:38.718 INFO:teuthology.orchestra.run.smithi160.stdout: "poolop_resend": 0, 2023-09-21T13:14:38.718 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_active": 0, 2023-09-21T13:14:38.719 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_send": 0, 2023-09-21T13:14:38.719 INFO:teuthology.orchestra.run.smithi160.stdout: "poolstat_resend": 0, 2023-09-21T13:14:38.719 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_active": 0, 2023-09-21T13:14:38.719 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_send": 0, 2023-09-21T13:14:38.720 INFO:teuthology.orchestra.run.smithi160.stdout: "statfs_resend": 0, 2023-09-21T13:14:38.720 INFO:teuthology.orchestra.run.smithi160.stdout: "command_active": 0, 2023-09-21T13:14:38.720 INFO:teuthology.orchestra.run.smithi160.stdout: "command_send": 0, 2023-09-21T13:14:38.721 INFO:teuthology.orchestra.run.smithi160.stdout: "command_resend": 0, 2023-09-21T13:14:38.721 INFO:teuthology.orchestra.run.smithi160.stdout: "map_epoch": 115, 2023-09-21T13:14:38.721 INFO:teuthology.orchestra.run.smithi160.stdout: "map_full": 0, 2023-09-21T13:14:38.721 INFO:teuthology.orchestra.run.smithi160.stdout: "map_inc": 5, 2023-09-21T13:14:38.722 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_sessions": 8, 2023-09-21T13:14:38.722 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_open": 8, 2023-09-21T13:14:38.722 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_session_close": 0, 2023-09-21T13:14:38.723 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_laggy": 0, 2023-09-21T13:14:38.723 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_wr": 0, 2023-09-21T13:14:38.723 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_rd": 2, 2023-09-21T13:14:38.723 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_del": 0 2023-09-21T13:14:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: "oft": { 2023-09-21T13:14:38.724 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_objs": 0, 2023-09-21T13:14:38.725 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_kv_pairs": 0, 2023-09-21T13:14:38.725 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_updates": 0, 2023-09-21T13:14:38.725 INFO:teuthology.orchestra.run.smithi160.stdout: "omap_total_removes": 0 2023-09-21T13:14:38.725 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.726 INFO:teuthology.orchestra.run.smithi160.stdout: "osd-slow-ops": { 2023-09-21T13:14:38.726 INFO:teuthology.orchestra.run.smithi160.stdout: "slow_ops_count": 0 2023-09-21T13:14:38.726 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.727 INFO:teuthology.orchestra.run.smithi160.stdout: "purge_queue": { 2023-09-21T13:14:38.727 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops": 0, 2023-09-21T13:14:38.727 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_ops_high_water": 0, 2023-09-21T13:14:38.727 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing": 0, 2023-09-21T13:14:38.728 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executing_high_water": 0, 2023-09-21T13:14:38.728 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_executed": 0, 2023-09-21T13:14:38.728 INFO:teuthology.orchestra.run.smithi160.stdout: "pq_item_in_journal": 0 2023-09-21T13:14:38.729 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.729 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:38.729 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:38.729 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:38.730 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:38.730 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 691, 2023-09-21T13:14:38.730 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 80933012, 2023-09-21T13:14:38.731 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:38.731 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 691, 2023-09-21T13:14:38.731 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:38.731 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:38.732 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 691, 2023-09-21T13:14:38.732 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 80933012, 2023-09-21T13:14:38.732 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:38.732 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.733 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.733 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.733 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_bytes": { 2023-09-21T13:14:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:38.734 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:38.735 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:38.735 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:38.735 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:38.736 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:38.736 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:38.736 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 630, 2023-09-21T13:14:38.736 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 80629519, 2023-09-21T13:14:38.737 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 630, 2023-09-21T13:14:38.737 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 80629519, 2023-09-21T13:14:38.737 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:38.738 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.738 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.738 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.739 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.739 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.739 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-objecter_ops": { 2023-09-21T13:14:38.739 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:38.740 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 1024, 2023-09-21T13:14:38.740 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:38.740 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:38.741 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:38.741 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:38.741 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:38.741 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 630, 2023-09-21T13:14:38.742 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 630, 2023-09-21T13:14:38.742 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 630, 2023-09-21T13:14:38.742 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 630, 2023-09-21T13:14:38.743 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:38.743 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.743 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.743 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.744 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.744 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.744 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle": { 2023-09-21T13:14:38.744 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:38.745 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:38.745 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:38.745 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:38.746 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:38.746 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:38.746 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:38.746 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:38.747 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:38.747 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2023-09-21T13:14:38.747 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2023-09-21T13:14:38.748 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:38.748 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.748 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.748 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.749 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.749 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:38.749 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-write_buf_throttle-0x561f9f4d8960": { 2023-09-21T13:14:38.750 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:38.750 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 3758096384, 2023-09-21T13:14:38.750 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:38.750 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 0, 2023-09-21T13:14:38.751 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 0, 2023-09-21T13:14:38.751 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:38.751 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 0, 2023-09-21T13:14:38.751 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:38.752 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:38.752 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 0, 2023-09-21T13:14:38.752 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 0, 2023-09-21T13:14:38.753 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:38.753 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:38.753 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:38.753 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:38.754 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.754 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:38.754 INFO:teuthology.orchestra.run.smithi160.stdout:} 2023-09-21T13:14:39.001 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2023-09-21T13:14:39.002 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2023-09-21T13:14:39.002 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=7 2023-09-21T13:14:39.002 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-09-21T13:14:39.002 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-09-21T13:14:39.003 DEBUG:tasks.check_counter:Getting stats from l 2023-09-21T13:14:39.003 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:41c9e835c3f621102ade35dd597317a42116a491 shell --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.l perf dump 2023-09-21T13:14:39.562 INFO:teuthology.orchestra.run.smithi160.stderr:Inferring config /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-21T13:14:40.081 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:40 smithi160 ceph-mon[134450]: pgmap v584: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:40.397 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:40 smithi156 ceph-mon[134078]: pgmap v584: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:40.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:40 smithi142 ceph-mon[97663]: pgmap v584: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:40.773 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2023-09-21T13:14:40.774 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-0": { 2023-09-21T13:14:40.774 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 4, 2023-09-21T13:14:40.774 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 4, 2023-09-21T13:14:40.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 2944, 2023-09-21T13:14:40.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 448, 2023-09-21T13:14:40.775 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 4, 2023-09-21T13:14:40.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 0, 2023-09-21T13:14:40.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.001484483, 2023-09-21T13:14:40.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.000038400, 2023-09-21T13:14:40.776 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.000645387, 2023-09-21T13:14:40.777 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:40.777 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:40.777 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 3, 2023-09-21T13:14:40.778 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000708181, 2023-09-21T13:14:40.778 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000236060 2023-09-21T13:14:40.778 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.778 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:40.779 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:40.779 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:40.779 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:40.780 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.780 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-21T13:14:40.780 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 448 2023-09-21T13:14:40.780 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.781 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-1": { 2023-09-21T13:14:40.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 347, 2023-09-21T13:14:40.781 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 336, 2023-09-21T13:14:40.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 1588416, 2023-09-21T13:14:40.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 202528, 2023-09-21T13:14:40.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 2, 2023-09-21T13:14:40.782 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 1, 2023-09-21T13:14:40.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.053907052, 2023-09-21T13:14:40.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.016993565, 2023-09-21T13:14:40.783 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.036184219, 2023-09-21T13:14:40.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.008146797, 2023-09-21T13:14:40.784 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:40.784 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 335, 2023-09-21T13:14:40.784 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.020814153, 2023-09-21T13:14:40.785 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000062131 2023-09-21T13:14:40.785 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.785 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:40.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:40.786 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:40.786 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:40.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.787 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 1588416, 2023-09-21T13:14:40.787 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 202528 2023-09-21T13:14:40.787 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.788 INFO:teuthology.orchestra.run.smithi160.stdout: "AsyncMessenger::Worker-2": { 2023-09-21T13:14:40.788 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_messages": 2, 2023-09-21T13:14:40.788 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages": 257, 2023-09-21T13:14:40.789 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_bytes": 320, 2023-09-21T13:14:40.789 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_bytes": 198176, 2023-09-21T13:14:40.789 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_created_connections": 5, 2023-09-21T13:14:40.789 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_active_connections": 3, 2023-09-21T13:14:40.790 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_total_time": 0.012654604, 2023-09-21T13:14:40.790 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_send_time": 0.008663179, 2023-09-21T13:14:40.790 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_recv_time": 0.001359240, 2023-09-21T13:14:40.791 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-21T13:14:40.791 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_messages_queue_lat": { 2023-09-21T13:14:40.791 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 254, 2023-09-21T13:14:40.792 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.022363933, 2023-09-21T13:14:40.792 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000088046 2023-09-21T13:14:40.792 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.792 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_handle_ack_lat": { 2023-09-21T13:14:40.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:40.793 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:40.793 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:40.794 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.794 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_recv_encrypted_bytes": 320, 2023-09-21T13:14:40.794 INFO:teuthology.orchestra.run.smithi160.stdout: "msgr_send_encrypted_bytes": 198176 2023-09-21T13:14:40.795 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.795 INFO:teuthology.orchestra.run.smithi160.stdout: "cct": { 2023-09-21T13:14:40.795 INFO:teuthology.orchestra.run.smithi160.stdout: "total_workers": 0, 2023-09-21T13:14:40.796 INFO:teuthology.orchestra.run.smithi160.stdout: "unhealthy_workers": 0 2023-09-21T13:14:40.796 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.796 INFO:teuthology.orchestra.run.smithi160.stdout: "mempool": { 2023-09-21T13:14:40.796 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_bytes": 0, 2023-09-21T13:14:40.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bloom_filter_items": 0, 2023-09-21T13:14:40.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_bytes": 0, 2023-09-21T13:14:40.797 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_alloc_items": 0, 2023-09-21T13:14:40.798 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_bytes": 0, 2023-09-21T13:14:40.798 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_data_items": 0, 2023-09-21T13:14:40.798 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-21T13:14:40.799 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_onode_items": 0, 2023-09-21T13:14:40.799 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-21T13:14:40.799 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_meta_items": 0, 2023-09-21T13:14:40.800 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_bytes": 0, 2023-09-21T13:14:40.800 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_other_items": 0, 2023-09-21T13:14:40.800 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-21T13:14:40.800 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_cache_buffer_items": 0, 2023-09-21T13:14:40.801 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_bytes": 0, 2023-09-21T13:14:40.801 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_extent_items": 0, 2023-09-21T13:14:40.801 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_bytes": 0, 2023-09-21T13:14:40.802 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_blob_items": 0, 2023-09-21T13:14:40.802 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-21T13:14:40.802 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_shared_blob_items": 0, 2023-09-21T13:14:40.802 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-21T13:14:40.803 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_inline_bl_items": 0, 2023-09-21T13:14:40.803 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_bytes": 0, 2023-09-21T13:14:40.803 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_fsck_items": 0, 2023-09-21T13:14:40.803 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_bytes": 0, 2023-09-21T13:14:40.804 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_txc_items": 0, 2023-09-21T13:14:40.804 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-21T13:14:40.804 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_deferred_items": 0, 2023-09-21T13:14:40.805 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_bytes": 0, 2023-09-21T13:14:40.805 INFO:teuthology.orchestra.run.smithi160.stdout: "bluestore_writing_items": 0, 2023-09-21T13:14:40.805 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_bytes": 0, 2023-09-21T13:14:40.805 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_items": 0, 2023-09-21T13:14:40.806 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_bytes": 0, 2023-09-21T13:14:40.806 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_reader_items": 0, 2023-09-21T13:14:40.807 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_bytes": 0, 2023-09-21T13:14:40.807 INFO:teuthology.orchestra.run.smithi160.stdout: "bluefs_file_writer_items": 0, 2023-09-21T13:14:40.807 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_bytes": 149034, 2023-09-21T13:14:40.807 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_anon_items": 32, 2023-09-21T13:14:40.808 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_bytes": 0, 2023-09-21T13:14:40.808 INFO:teuthology.orchestra.run.smithi160.stdout: "buffer_meta_items": 0, 2023-09-21T13:14:40.808 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_bytes": 0, 2023-09-21T13:14:40.809 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_items": 0, 2023-09-21T13:14:40.809 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_bytes": 0, 2023-09-21T13:14:40.809 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_mapbl_items": 0, 2023-09-21T13:14:40.809 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_bytes": 0, 2023-09-21T13:14:40.810 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_pglog_items": 0, 2023-09-21T13:14:40.810 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_bytes": 0, 2023-09-21T13:14:40.810 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_items": 0, 2023-09-21T13:14:40.811 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_bytes": 0, 2023-09-21T13:14:40.811 INFO:teuthology.orchestra.run.smithi160.stdout: "osdmap_mapping_items": 0, 2023-09-21T13:14:40.811 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_bytes": 0, 2023-09-21T13:14:40.811 INFO:teuthology.orchestra.run.smithi160.stdout: "pgmap_items": 0, 2023-09-21T13:14:40.812 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_bytes": 928, 2023-09-21T13:14:40.812 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_co_items": 2, 2023-09-21T13:14:40.812 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_bytes": 0, 2023-09-21T13:14:40.812 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_1_items": 0, 2023-09-21T13:14:40.813 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_bytes": 0, 2023-09-21T13:14:40.813 INFO:teuthology.orchestra.run.smithi160.stdout: "unittest_2_items": 0 2023-09-21T13:14:40.813 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2023-09-21T13:14:40.814 INFO:teuthology.orchestra.run.smithi160.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-21T13:14:40.814 INFO:teuthology.orchestra.run.smithi160.stdout: "val": 0, 2023-09-21T13:14:40.814 INFO:teuthology.orchestra.run.smithi160.stdout: "max": 104857600, 2023-09-21T13:14:40.814 INFO:teuthology.orchestra.run.smithi160.stdout: "get_started": 0, 2023-09-21T13:14:40.815 INFO:teuthology.orchestra.run.smithi160.stdout: "get": 349, 2023-09-21T13:14:40.815 INFO:teuthology.orchestra.run.smithi160.stdout: "get_sum": 1539454, 2023-09-21T13:14:40.815 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_fail": 0, 2023-09-21T13:14:40.816 INFO:teuthology.orchestra.run.smithi160.stdout: "get_or_fail_success": 349, 2023-09-21T13:14:40.816 INFO:teuthology.orchestra.run.smithi160.stdout: "take": 0, 2023-09-21T13:14:40.816 INFO:teuthology.orchestra.run.smithi160.stdout: "take_sum": 0, 2023-09-21T13:14:40.816 INFO:teuthology.orchestra.run.smithi160.stdout: "put": 349, 2023-09-21T13:14:40.817 INFO:teuthology.orchestra.run.smithi160.stdout: "put_sum": 1539454, 2023-09-21T13:14:40.817 INFO:teuthology.orchestra.run.smithi160.stdout: "wait": { 2023-09-21T13:14:40.817 INFO:teuthology.orchestra.run.smithi160.stdout: "avgcount": 0, 2023-09-21T13:14:40.818 INFO:teuthology.orchestra.run.smithi160.stdout: "sum": 0.000000000, 2023-09-21T13:14:40.818 INFO:teuthology.orchestra.run.smithi160.stdout: "avgtime": 0.000000000 2023-09-21T13:14:40.818 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:40.818 INFO:teuthology.orchestra.run.smithi160.stdout: } 2023-09-21T13:14:40.819 INFO:teuthology.orchestra.run.smithi160.stdout:} 2023-09-21T13:14:41.122 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-09-21T13:14:41.123 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-09-21T13:14:41.123 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2023-09-21T13:14:41.124 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2023-09-21T13:14:41.124 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2023-09-21T13:14:41.125 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-21T13:14:41.147 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-21T13:14:41.148 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T13:14:41.148 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T13:14:41.211 DEBUG:teuthology.orchestra.run.smithi142:> set -ex 2023-09-21T13:14:41.211 DEBUG:teuthology.orchestra.run.smithi142:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-21T13:14:41.297 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T13:14:41.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 -- 172.21.15.142:0/2471762417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb730101980 msgr2=0x7fb7301059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 --2- 172.21.15.142:0/2471762417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb730101980 0x7fb7301059c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb724009990 tx=0x7fb724009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 -- 172.21.15.142:0/2471762417 shutdown_connections 2023-09-21T13:14:41.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 --2- 172.21.15.142:0/2471762417 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb7301060f0 0x7fb73010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 --2- 172.21.15.142:0/2471762417 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb730100fd0 0x7fb7301013b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 --2- 172.21.15.142:0/2471762417 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb730101980 0x7fb7301059c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 -- 172.21.15.142:0/2471762417 >> 172.21.15.142:0/2471762417 conn(0x7fb7300fc890 msgr2=0x7fb7300fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 -- 172.21.15.142:0/2471762417 shutdown_connections 2023-09-21T13:14:41.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.547+0000 7fb735dff700 1 -- 172.21.15.142:0/2471762417 wait complete. 2023-09-21T13:14:41.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.548+0000 7fb735dff700 1 Processor -- start 2023-09-21T13:14:41.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.548+0000 7fb735dff700 1 -- start start 2023-09-21T13:14:41.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 0x7fb7301990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7301060f0 0x7fb730199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73019e4e0 con 0x7fb73019da60 2023-09-21T13:14:41.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73019e650 con 0x7fb730100fd0 2023-09-21T13:14:41.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb735dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73019e810 con 0x7fb7301060f0 2023-09-21T13:14:41.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47646/0 (socket says 172.21.15.142:47646) 2023-09-21T13:14:41.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 -- 172.21.15.142:0/2679442832 learned_addr learned my addr 172.21.15.142:0/2679442832 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:41.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72effd700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7301060f0 0x7fb730199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72f7fe700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 0x7fb7301990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 -- 172.21.15.142:0/2679442832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7301060f0 msgr2=0x7fb730199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7301060f0 0x7fb730199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 -- 172.21.15.142:0/2679442832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 msgr2=0x7fb7301990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 0x7fb7301990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72ffff700 1 -- 172.21.15.142:0/2679442832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720009520 con 0x7fb73019da60 2023-09-21T13:14:41.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.549+0000 7fb72f7fe700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 0x7fb7301990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-21T13:14:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb72ffff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ef30 tx=0x7fb72800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb728018070 con 0x7fb73019da60 2023-09-21T13:14:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7240095f0 con 0x7fb73019da60 2023-09-21T13:14:41.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb72800f040 con 0x7fb73019da60 2023-09-21T13:14:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72800cdb0 con 0x7fb73019da60 2023-09-21T13:14:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.550+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7301a6060 con 0x7fb73019da60 2023-09-21T13:14:41.551 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.551+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb730067bd0 con 0x7fb73019da60 2023-09-21T13:14:41.552 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.553+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fb728003a00 con 0x7fb73019da60 2023-09-21T13:14:41.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.554+0000 7fb72cff9700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 0x7fb7180a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.555+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fb7280cc500 con 0x7fb73019da60 2023-09-21T13:14:41.553 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.555+0000 7fb72f7fe700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 0x7fb7180a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.555+0000 7fb72f7fe700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 0x7fb7180a2cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb720009e40 tx=0x7fb720009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:41.554 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.557+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb728095d20 con 0x7fb73019da60 2023-09-21T13:14:41.753 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.761+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb730101b10 con 0x7fb73019da60 2023-09-21T13:14:41.755 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.763+0000 7fb72cff9700 1 -- 172.21.15.142:0/2679442832 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+23078 (secure 0 0 0) 0x7fb728025380 con 0x7fb73019da60 2023-09-21T13:14:41.755 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:41.756 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":115,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T13:14:16.778784+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":30,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6800/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/969325249":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/3896559715":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2723441093":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1844445290":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":17,"length":1},{"begin":30,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T13:14:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.765+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 msgr2=0x7fb7180a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.765+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 0x7fb7180a2cb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb720009e40 tx=0x7fb720009260 comp rx=0 tx=0).stop 2023-09-21T13:14:41.757 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.765+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 msgr2=0x7fb73019dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.758 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.765+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb72800ef30 tx=0x7fb72800c3a0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 shutdown_connections 2023-09-21T13:14:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb7180a07f0 0x7fb7180a2cb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.759 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb73019da60 0x7fb73019dee0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb730100fd0 0x7fb7301990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 --2- 172.21.15.142:0/2679442832 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7301060f0 0x7fb730199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.760 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 >> 172.21.15.142:0/2679442832 conn(0x7fb7300fc890 msgr2=0x7fb7300fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 shutdown_connections 2023-09-21T13:14:41.761 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.766+0000 7fb735dff700 1 -- 172.21.15.142:0/2679442832 wait complete. 2023-09-21T13:14:41.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-21T12:50:00.891036+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-21T12:54:09.980098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-21T12:54:11.417588+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '114', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 30, 'snap_epoch': 114, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-21T13:14:41.777 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-21T13:14:41.980 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 -- 172.21.15.142:0/2266676803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e4100fc0 msgr2=0x7fc7e41013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/2266676803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e4100fc0 0x7fc7e41013a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fc7d40098f0 tx=0x7fc7d4009c00 comp rx=0 tx=0).stop 2023-09-21T13:14:41.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 -- 172.21.15.142:0/2266676803 shutdown_connections 2023-09-21T13:14:41.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/2266676803 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e41060e0 0x7fc7e410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.981 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/2266676803 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e4100fc0 0x7fc7e41013a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/2266676803 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4101970 0x7fc7e41059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 -- 172.21.15.142:0/2266676803 >> 172.21.15.142:0/2266676803 conn(0x7fc7e40fc840 msgr2=0x7fc7e40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:41.982 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 -- 172.21.15.142:0/2266676803 shutdown_connections 2023-09-21T13:14:41.983 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.988+0000 7fc7e99ff700 1 -- 172.21.15.142:0/2266676803 wait complete. 2023-09-21T13:14:41.984 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.989+0000 7fc7e99ff700 1 Processor -- start 2023-09-21T13:14:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.989+0000 7fc7e99ff700 1 -- start start 2023-09-21T13:14:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.985 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e41060e0 0x7fc7e4073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4073b60 0x7fc7e41a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41a57e0 con 0x7fc7e4100fc0 2023-09-21T13:14:41.986 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41a5950 con 0x7fc7e4073b60 2023-09-21T13:14:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e99ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e41a5b10 con 0x7fc7e41060e0 2023-09-21T13:14:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47666/0 (socket says 172.21.15.142:47666) 2023-09-21T13:14:41.987 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7dbfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e41060e0 0x7fc7e4073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 -- 172.21.15.142:0/4187810141 learned_addr learned my addr 172.21.15.142:0/4187810141 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e37fe700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4073b60 0x7fc7e41a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.988 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 -- 172.21.15.142:0/4187810141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e41060e0 msgr2=0x7fc7e4073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e41060e0 0x7fc7e4073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 -- 172.21.15.142:0/4187810141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4073b60 msgr2=0x7fc7e41a5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:41.989 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4073b60 0x7fc7e41a5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 -- 172.21.15.142:0/4187810141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d4009520 con 0x7fc7e4100fc0 2023-09-21T13:14:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.990+0000 7fc7e2ffd700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009230 tx=0x7fc7d400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.991+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d401c070 con 0x7fc7e4100fc0 2023-09-21T13:14:41.990 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.991+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e41a5d90 con 0x7fc7e4100fc0 2023-09-21T13:14:41.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.991+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d40058e0 con 0x7fc7e4100fc0 2023-09-21T13:14:41.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.991+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d40038e0 con 0x7fc7e4100fc0 2023-09-21T13:14:41.991 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.991+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e41a61e0 con 0x7fc7e4100fc0 2023-09-21T13:14:41.992 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.992+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7e4067b60 con 0x7fc7e4100fc0 2023-09-21T13:14:41.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.994+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fc7d4020030 con 0x7fc7e4100fc0 2023-09-21T13:14:41.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.996+0000 7fc7e89fd700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 0x7fc7d00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:41.993 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.996+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7fc7d40cd250 con 0x7fc7e4100fc0 2023-09-21T13:14:41.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.996+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 0x7fc7d00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:41.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.997+0000 7fc7dbfff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 0x7fc7d00a2c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40748d0 tx=0x7fc7cc009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:41.994 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:41.998+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc7d4096a70 con 0x7fc7e4100fc0 2023-09-21T13:14:42.158 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:42 smithi142 ceph-mon[97663]: pgmap v585: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:42.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:42 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2679442832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:42.192 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.200+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7e4101ab0 con 0x7fc7e4100fc0 2023-09-21T13:14:42.193 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.201+0000 7fc7e89fd700 1 -- 172.21.15.142:0/4187810141 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v115) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7d409a090 con 0x7fc7e4100fc0 2023-09-21T13:14:42.193 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 1 2023-09-21T13:14:42.195 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 msgr2=0x7fc7d00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 0x7fc7d00a2c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc7e40748d0 tx=0x7fc7cc009260 comp rx=0 tx=0).stop 2023-09-21T13:14:42.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 msgr2=0x7fc7e40730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.196 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4009230 tx=0x7fc7d400bf20 comp rx=0 tx=0).stop 2023-09-21T13:14:42.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 shutdown_connections 2023-09-21T13:14:42.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fc7d00a07b0 0x7fc7d00a2c70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.197 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fc7e4100fc0 0x7fc7e40730e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fc7e4073b60 0x7fc7e41a5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 --2- 172.21.15.142:0/4187810141 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7e41060e0 0x7fc7e4073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.203+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 >> 172.21.15.142:0/4187810141 conn(0x7fc7e40fc840 msgr2=0x7fc7e4104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:42.198 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.204+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 shutdown_connections 2023-09-21T13:14:42.199 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.204+0000 7fc7e99ff700 1 -- 172.21.15.142:0/4187810141 wait complete. 2023-09-21T13:14:42.214 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-21T13:14:42.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:42 smithi156 ceph-mon[134078]: pgmap v585: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:42.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:42 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2679442832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:42.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 -- 172.21.15.142:0/2530385837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 msgr2=0x7efed41013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.417 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2530385837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41013a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7efed0009990 tx=0x7efed0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 -- 172.21.15.142:0/2530385837 shutdown_connections 2023-09-21T13:14:42.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2530385837 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41013a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.418 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2530385837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed41060e0 0x7efed410dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2530385837 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed4101970 0x7efed41059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 -- 172.21.15.142:0/2530385837 >> 172.21.15.142:0/2530385837 conn(0x7efed40fc840 msgr2=0x7efed40fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:42.419 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 -- 172.21.15.142:0/2530385837 shutdown_connections 2023-09-21T13:14:42.420 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.425+0000 7efedc1ff700 1 -- 172.21.15.142:0/2530385837 wait complete. 2023-09-21T13:14:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.426+0000 7efedc1ff700 1 Processor -- start 2023-09-21T13:14:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.426+0000 7efedc1ff700 1 -- start start 2023-09-21T13:14:42.422 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.426+0000 7efedc1ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.426+0000 7efedc1ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed41060e0 0x7efed4199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efedc1ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed419da90 0x7efed419df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efedc1ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed419e510 con 0x7efed4100fc0 2023-09-21T13:14:42.423 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efedc1ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed419e680 con 0x7efed41060e0 2023-09-21T13:14:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efedc1ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed419e840 con 0x7efed419da90 2023-09-21T13:14:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.424 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47686/0 (socket says 172.21.15.142:47686) 2023-09-21T13:14:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 -- 172.21.15.142:0/2336635318 learned_addr learned my addr 172.21.15.142:0/2336635318 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efeda79c700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed419da90 0x7efed419df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed979a700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed41060e0 0x7efed4199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.425 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 -- 172.21.15.142:0/2336635318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed419da90 msgr2=0x7efed419df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed419da90 0x7efed419df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 -- 172.21.15.142:0/2336635318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed41060e0 msgr2=0x7efed4199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.426 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed41060e0 0x7efed4199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 -- 172.21.15.142:0/2336635318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00095f0 con 0x7efed4100fc0 2023-09-21T13:14:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.427+0000 7efed9f9b700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efed0005910 tx=0x7efed0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.428+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed001d070 con 0x7efed4100fc0 2023-09-21T13:14:42.427 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.428+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efed0022470 con 0x7efed4100fc0 2023-09-21T13:14:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.428+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed41a5d40 con 0x7efed4100fc0 2023-09-21T13:14:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.428+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed0017650 con 0x7efed4100fc0 2023-09-21T13:14:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.428+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed41a6160 con 0x7efed4100fc0 2023-09-21T13:14:42.428 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.429+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed4067b60 con 0x7efed4100fc0 2023-09-21T13:14:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.431+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7efed00225e0 con 0x7efed4100fc0 2023-09-21T13:14:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.432+0000 7efecaffd700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 0x7efec00a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.432+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7efed00cda30 con 0x7efed4100fc0 2023-09-21T13:14:42.430 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.432+0000 7efed979a700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 0x7efec00a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.433+0000 7efed979a700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 0x7efec00a2c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efed419a700 tx=0x7efec4009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:42.431 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.434+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7efed0097250 con 0x7efed4100fc0 2023-09-21T13:14:42.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:42 smithi160 ceph-mon[134450]: pgmap v585: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 19 KiB/s wr, 7 op/s 2023-09-21T13:14:42.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:42 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2679442832' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:42.626 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.635+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efed41018e0 con 0x7efed4100fc0 2023-09-21T13:14:42.627 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.635+0000 7efecaffd700 1 -- 172.21.15.142:0/2336635318 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v115) v1 ==== 104+0+11 (secure 0 0 0) 0x7efed009a870 con 0x7efed4100fc0 2023-09-21T13:14:42.627 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 32 2023-09-21T13:14:42.629 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.637+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 msgr2=0x7efec00a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.637+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 0x7efec00a2c70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7efed419a700 tx=0x7efec4009260 comp rx=0 tx=0).stop 2023-09-21T13:14:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.637+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 msgr2=0x7efed41990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.630 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.637+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7efed0005910 tx=0x7efed0005740 comp rx=0 tx=0).stop 2023-09-21T13:14:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 shutdown_connections 2023-09-21T13:14:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7efec00a07b0 0x7efec00a2c70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.631 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7efed4100fc0 0x7efed41990f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efed419da90 0x7efed419df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 --2- 172.21.15.142:0/2336635318 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7efed41060e0 0x7efed4199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 >> 172.21.15.142:0/2336635318 conn(0x7efed40fc840 msgr2=0x7efed40fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:42.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 shutdown_connections 2023-09-21T13:14:42.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.638+0000 7efedc1ff700 1 -- 172.21.15.142:0/2336635318 wait complete. 2023-09-21T13:14:42.648 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-21T13:14:42.850 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 -- 172.21.15.142:0/2913301212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c100fc0 msgr2=0x7ff00c1013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 --2- 172.21.15.142:0/2913301212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c100fc0 0x7ff00c1013a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b0a0 tx=0x7ff00000b3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 -- 172.21.15.142:0/2913301212 shutdown_connections 2023-09-21T13:14:42.851 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 --2- 172.21.15.142:0/2913301212 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c100fc0 0x7ff00c1013a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 --2- 172.21.15.142:0/2913301212 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c1060e0 0x7ff00c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.852 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 --2- 172.21.15.142:0/2913301212 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c101970 0x7ff00c1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 -- 172.21.15.142:0/2913301212 >> 172.21.15.142:0/2913301212 conn(0x7ff00c0fc840 msgr2=0x7ff00c0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:42.853 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 -- 172.21.15.142:0/2913301212 shutdown_connections 2023-09-21T13:14:42.854 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.858+0000 7ff012bff700 1 -- 172.21.15.142:0/2913301212 wait complete. 2023-09-21T13:14:42.858 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.860+0000 7ff012bff700 1 Processor -- start 2023-09-21T13:14:42.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.860+0000 7ff012bff700 1 -- start start 2023-09-21T13:14:42.859 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.860+0000 7ff012bff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c100fc0 0x7ff00c199220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.860+0000 7ff012bff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.860 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff012bff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c19dbc0 0x7ff00c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff012bff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e640 con 0x7ff00c1060e0 2023-09-21T13:14:42.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff012bff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e7b0 con 0x7ff00c100fc0 2023-09-21T13:14:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff012bff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e970 con 0x7ff00c19dbc0 2023-09-21T13:14:42.862 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.863 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47698/0 (socket says 172.21.15.142:47698) 2023-09-21T13:14:42.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 -- 172.21.15.142:0/1407038903 learned_addr learned my addr 172.21.15.142:0/1407038903 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:42.864 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff01119c700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c19dbc0 0x7ff00c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff01099b700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c100fc0 0x7ff00c199220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 -- 172.21.15.142:0/1407038903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c19dbc0 msgr2=0x7ff00c19e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.865 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c19dbc0 0x7ff00c19e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 -- 172.21.15.142:0/1407038903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c100fc0 msgr2=0x7ff00c199220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c100fc0 0x7ff00c199220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:42.866 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 -- 172.21.15.142:0/1407038903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009d00 con 0x7ff00c1060e0 2023-09-21T13:14:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.861+0000 7ff00bfff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7feff800e970 tx=0x7feff800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.862+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff8009790 con 0x7ff00c1060e0 2023-09-21T13:14:42.867 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.862+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feff800c7e0 con 0x7ff00c1060e0 2023-09-21T13:14:42.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.862+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c1a5ed0 con 0x7ff00c1060e0 2023-09-21T13:14:42.868 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.862+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff80054e0 con 0x7ff00c1060e0 2023-09-21T13:14:42.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.862+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c1a6350 con 0x7ff00c1060e0 2023-09-21T13:14:42.869 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.863+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00c067b60 con 0x7ff00c1060e0 2023-09-21T13:14:42.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.865+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7feff800c950 con 0x7ff00c1060e0 2023-09-21T13:14:42.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.866+0000 7ff009ffb700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 0x7feffc0a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:42.870 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.866+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7feff8014070 con 0x7ff00c1060e0 2023-09-21T13:14:42.871 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.866+0000 7ff01099b700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 0x7feffc0a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:42.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.867+0000 7ff01099b700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 0x7feffc0a2c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff000009fd0 tx=0x7ff00000b700 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:42.872 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:42.870+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7feff80959a0 con 0x7ff00c1060e0 2023-09-21T13:14:43.065 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.073+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff00c101b90 con 0x7ff00c1060e0 2023-09-21T13:14:43.071 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.073+0000 7ff009ffb700 1 -- 172.21.15.142:0/1407038903 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v115) v1 ==== 100+0+11 (secure 0 0 0) 0x7feff8082e60 con 0x7ff00c1060e0 2023-09-21T13:14:43.072 INFO:teuthology.orchestra.run.smithi142.stdout:pg_num: 64 2023-09-21T13:14:43.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 msgr2=0x7feffc0a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 0x7feffc0a2c70 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff000009fd0 tx=0x7ff00000b700 comp rx=0 tx=0).stop 2023-09-21T13:14:43.073 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 msgr2=0x7ff00c199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7feff800e970 tx=0x7feff800ec80 comp rx=0 tx=0).stop 2023-09-21T13:14:43.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 shutdown_connections 2023-09-21T13:14:43.074 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7feffc0a07b0 0x7feffc0a2c70 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff00c19dbc0 0x7ff00c19e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff00c100fc0 0x7ff00c199220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.075 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 --2- 172.21.15.142:0/1407038903 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff00c1060e0 0x7ff00c199760 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 >> 172.21.15.142:0/1407038903 conn(0x7ff00c0fc840 msgr2=0x7ff00c0fd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:43.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 shutdown_connections 2023-09-21T13:14:43.076 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.076+0000 7ff012bff700 1 -- 172.21.15.142:0/1407038903 wait complete. 2023-09-21T13:14:43.093 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-21T13:14:43.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 -- 172.21.15.142:0/3331069526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7608101970 msgr2=0x7f76081059b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 --2- 172.21.15.142:0/3331069526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7608101970 0x7f76081059b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f75f0009990 tx=0x7f75f0009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 -- 172.21.15.142:0/3331069526 shutdown_connections 2023-09-21T13:14:43.294 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 --2- 172.21.15.142:0/3331069526 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f76081060e0 0x7f760810dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 --2- 172.21.15.142:0/3331069526 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f7608100fc0 0x7f76081013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 --2- 172.21.15.142:0/3331069526 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7608101970 0x7f76081059b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.295 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 -- 172.21.15.142:0/3331069526 >> 172.21.15.142:0/3331069526 conn(0x7f76080fc840 msgr2=0x7f76080fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:43.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 -- 172.21.15.142:0/3331069526 shutdown_connections 2023-09-21T13:14:43.296 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.301+0000 7f760cbff700 1 -- 172.21.15.142:0/3331069526 wait complete. 2023-09-21T13:14:43.298 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.302+0000 7f760cbff700 1 Processor -- start 2023-09-21T13:14:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.302+0000 7f760cbff700 1 -- start start 2023-09-21T13:14:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:43.299 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76081060e0 0x7f76081996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 0x7f760819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760819e5a0 con 0x7f7608100fc0 2023-09-21T13:14:43.300 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760819e710 con 0x7f76081060e0 2023-09-21T13:14:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760cbff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760819e8d0 con 0x7f760819db20 2023-09-21T13:14:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:47726/0 (socket says 172.21.15.142:47726) 2023-09-21T13:14:43.301 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 -- 172.21.15.142:0/2486892058 learned_addr learned my addr 172.21.15.142:0/2486892058 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f7606d9d700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 0x7f760819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f75fffff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76081060e0 0x7f76081996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:43.302 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 -- 172.21.15.142:0/2486892058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 msgr2=0x7f760819dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 0x7f760819dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 -- 172.21.15.142:0/2486892058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76081060e0 msgr2=0x7f76081996c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76081060e0 0x7f76081996c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f760659c700 1 -- 172.21.15.142:0/2486892058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00095f0 con 0x7f7608100fc0 2023-09-21T13:14:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.303+0000 7f7606d9d700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 0x7f760819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f760659c700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e9a0 tx=0x7f75f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:43.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8009790 con 0x7f7608100fc0 2023-09-21T13:14:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f75f8010430 con 0x7f7608100fc0 2023-09-21T13:14:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76081a5e30 con 0x7f7608100fc0 2023-09-21T13:14:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f8018680 con 0x7f7608100fc0 2023-09-21T13:14:43.305 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.304+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76081a6250 con 0x7f7608100fc0 2023-09-21T13:14:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.305+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7608067b60 con 0x7f7608100fc0 2023-09-21T13:14:43.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.307+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f75f80105a0 con 0x7f7608100fc0 2023-09-21T13:14:43.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.308+0000 7f75ff7fe700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 0x7f75f40a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:43.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.308+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f75f8014070 con 0x7f7608100fc0 2023-09-21T13:14:43.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.308+0000 7f75fffff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 0x7f75f40a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:43.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.309+0000 7f75fffff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 0x7f75f40a2c70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75f000b2e0 tx=0x7f75f0005960 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:43.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.312+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f75f8051e10 con 0x7f7608100fc0 2023-09-21T13:14:43.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:43 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4187810141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:43 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2336635318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:43 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4187810141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:43 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2336635318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:43 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4187810141' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:43 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2336635318' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-21T13:14:43.526 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.534+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7608101bb0 con 0x7f7608100fc0 2023-09-21T13:14:43.527 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.534+0000 7f75ff7fe700 1 -- 172.21.15.142:0/2486892058 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v115) v1 ==== 81+0+961 (secure 0 0 0) 0x7f75f80958c0 con 0x7f7608100fc0 2023-09-21T13:14:43.527 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3499877374 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.527 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/969325249 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.528 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3896559715 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.528 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2205822122 2023-09-22T12:47:40.288815+0000 2023-09-21T13:14:43.528 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2427588007 2023-09-22T12:47:40.288815+0000 2023-09-21T13:14:43.529 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3720958087 2023-09-22T12:47:40.288815+0000 2023-09-21T13:14:43.529 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2723441093 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.529 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3720958087 2023-09-22T12:47:40.288815+0000 2023-09-21T13:14:43.529 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3499877374 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.530 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/2135445545 2023-09-22T12:47:13.540584+0000 2023-09-21T13:14:43.530 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1696580850 2023-09-22T12:47:13.540584+0000 2023-09-21T13:14:43.530 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1982354187 2023-09-22T12:47:13.540584+0000 2023-09-21T13:14:43.530 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6801/3614708159 2023-09-22T12:47:13.540584+0000 2023-09-21T13:14:43.531 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/1844445290 2023-09-22T12:56:14.397873+0000 2023-09-21T13:14:43.531 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:6800/3614708159 2023-09-22T12:47:13.540584+0000 2023-09-21T13:14:43.531 INFO:teuthology.orchestra.run.smithi142.stdout:172.21.15.142:0/3623066670 2023-09-22T12:47:40.288815+0000 2023-09-21T13:14:43.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 msgr2=0x7f75f40a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 0x7f75f40a2c70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f75f000b2e0 tx=0x7f75f0005960 comp rx=0 tx=0).stop 2023-09-21T13:14:43.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 msgr2=0x7f7608199180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:43.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f75f800e9a0 tx=0x7f75f800ecb0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 shutdown_connections 2023-09-21T13:14:43.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f75f40a07b0 0x7f75f40a2c70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f7608100fc0 0x7f7608199180 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f760819db20 0x7f760819dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 --2- 172.21.15.142:0/2486892058 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f76081060e0 0x7f76081996c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 >> 172.21.15.142:0/2486892058 conn(0x7f76080fc840 msgr2=0x7f76080fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 shutdown_connections 2023-09-21T13:14:43.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:43.537+0000 7f760cbff700 1 -- 172.21.15.142:0/2486892058 wait complete. 2023-09-21T13:14:43.536 INFO:teuthology.orchestra.run.smithi142.stderr:listed 16 entries 2023-09-21T13:14:43.549 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-21T13:14:43.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T13:14:43.550 DEBUG:teuthology.orchestra.run.smithi142:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-21T13:14:43.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T13:14:43.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T13:14:43.785 DEBUG:teuthology.orchestra.run.smithi142:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-21T13:14:44.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T13:14:44.026 DEBUG:teuthology.orchestra.run.smithi142:> ip netns list 2023-09-21T13:14:44.194 INFO:teuthology.orchestra.run.smithi142.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-21T13:14:44.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T13:14:44.195 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-21T13:14:44.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-21T13:14:44.274 DEBUG:teuthology.orchestra.run.smithi142:> sudo ip link delete ceph-brx 2023-09-21T13:14:44.299 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:44 smithi142 ceph-mon[97663]: pgmap v586: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-09-21T13:14:44.299 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:44 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1407038903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:44.300 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:44 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/2486892058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-21T13:14:44.386 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-09-21T13:14:44.397 INFO:tasks.cephadm:Teardown begin 2023-09-21T13:14:44.398 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-21T13:14:44.398 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:14:44.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:44 smithi156 ceph-mon[134078]: pgmap v586: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-09-21T13:14:44.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:44 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1407038903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:44.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:44 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/2486892058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-21T13:14:44.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:44 smithi160 ceph-mon[134450]: pgmap v586: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 28 KiB/s wr, 10 op/s 2023-09-21T13:14:44.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:44 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1407038903' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-21T13:14:44.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:44 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/2486892058' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-21T13:14:44.632 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 -- 172.21.15.142:0/2765202090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c073ad0 msgr2=0x7f777c10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 --2- 172.21.15.142:0/2765202090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c073ad0 0x7f777c10d0c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f7770009990 tx=0x7f7770009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 -- 172.21.15.142:0/2765202090 shutdown_connections 2023-09-21T13:14:44.633 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 --2- 172.21.15.142:0/2765202090 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c0731b0 0x7f777c073590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 --2- 172.21.15.142:0/2765202090 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c10fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 --2- 172.21.15.142:0/2765202090 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c073ad0 0x7f777c10d0c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.634 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 -- 172.21.15.142:0/2765202090 >> 172.21.15.142:0/2765202090 conn(0x7f777c0fc890 msgr2=0x7f777c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:44.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 -- 172.21.15.142:0/2765202090 shutdown_connections 2023-09-21T13:14:44.635 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.640+0000 7f77815ff700 1 -- 172.21.15.142:0/2765202090 wait complete. 2023-09-21T13:14:44.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.641+0000 7f77815ff700 1 Processor -- start 2023-09-21T13:14:44.637 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 -- start start 2023-09-21T13:14:44.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c0731b0 0x7f777c199090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:44.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:44.638 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c19da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:44.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c19e070 con 0x7f777c073ad0 2023-09-21T13:14:44.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c19e1e0 con 0x7f777c10d600 2023-09-21T13:14:44.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f77815ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c19e3a0 con 0x7f777c0731b0 2023-09-21T13:14:44.639 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f777a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:44.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f777a7fc700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43892/0 (socket says 172.21.15.142:43892) 2023-09-21T13:14:44.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f777a7fc700 1 -- 172.21.15.142:0/3975809839 learned_addr learned my addr 172.21.15.142:0/3975809839 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:44.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f777b7fe700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c19da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:44.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.642+0000 7f777affd700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c0731b0 0x7f777c199090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:44.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 -- 172.21.15.142:0/3975809839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c0731b0 msgr2=0x7f777c199090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:44.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c0731b0 0x7f777c199090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 -- 172.21.15.142:0/3975809839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 msgr2=0x7f777c19da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:44.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c19da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 -- 172.21.15.142:0/3975809839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c009520 con 0x7f777c073ad0 2023-09-21T13:14:44.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777b7fe700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:44.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f777a7fc700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7770005910 tx=0x7f7770004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:44.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777001d070 con 0x7f777c073ad0 2023-09-21T13:14:44.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77700095f0 con 0x7f777c073ad0 2023-09-21T13:14:44.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7770022470 con 0x7f777c073ad0 2023-09-21T13:14:44.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7770017650 con 0x7f777c073ad0 2023-09-21T13:14:44.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.643+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c1a5ce0 con 0x7f777c073ad0 2023-09-21T13:14:44.644 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.644+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c067bd0 con 0x7f777c073ad0 2023-09-21T13:14:44.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.646+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f77700225e0 con 0x7f777c073ad0 2023-09-21T13:14:44.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.647+0000 7f7763fff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 0x7f77640a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:44.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.648+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f77700cd1c0 con 0x7f777c073ad0 2023-09-21T13:14:44.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.648+0000 7f777affd700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 0x7f77640a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:44.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.648+0000 7f777affd700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 0x7f77640a2cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f776c009df0 tx=0x7f776c009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:44.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.651+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f777005ce10 con 0x7f777c073ad0 2023-09-21T13:14:44.896 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.904+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f777c19a3e0 con 0x7f777c073ad0 2023-09-21T13:14:44.897 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.905+0000 7f7763fff700 1 -- 172.21.15.142:0/3975809839 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+11342 (secure 0 0 0) 0x7f7770096a40 con 0x7f777c073ad0 2023-09-21T13:14:44.898 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:44.898 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":59,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:13:58.329655+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_28258":{"gid":28258,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/3000866200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":3000866200},{"type":"v1","addr":"172.21.15.160:6839","nonce":3000866200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:14:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 msgr2=0x7f77640a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 0x7f77640a2cb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f776c009df0 tx=0x7f776c009260 comp rx=0 tx=0).stop 2023-09-21T13:14:44.900 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 msgr2=0x7f777c1995d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:44.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f7770005910 tx=0x7f7770004710 comp rx=0 tx=0).stop 2023-09-21T13:14:44.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 shutdown_connections 2023-09-21T13:14:44.901 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f77640a07f0 0x7f77640a2cb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f777c10d600 0x7f777c19da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f777c0731b0 0x7f777c199090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.902 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 --2- 172.21.15.142:0/3975809839 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f777c073ad0 0x7f777c1995d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:44.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 >> 172.21.15.142:0/3975809839 conn(0x7f777c0fc890 msgr2=0x7f777c10f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:44.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 shutdown_connections 2023-09-21T13:14:44.903 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:44.908+0000 7f77815ff700 1 -- 172.21.15.142:0/3975809839 wait complete. 2023-09-21T13:14:44.904 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 59 2023-09-21T13:14:44.919 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-21T13:14:45.120 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3961488584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 msgr2=0x7ff3dc0735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3961488584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc0735f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0098f0 tx=0x7ff3cc009c00 comp rx=0 tx=0).stop 2023-09-21T13:14:45.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3961488584 shutdown_connections 2023-09-21T13:14:45.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3961488584 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 0x7ff3dc10fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.121 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3961488584 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc0735f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3961488584 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 0x7ff3dc10d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3961488584 >> 172.21.15.142:0/3961488584 conn(0x7ff3dc0fc800 msgr2=0x7ff3dc0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:45.122 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3961488584 shutdown_connections 2023-09-21T13:14:45.123 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.128+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3961488584 wait complete. 2023-09-21T13:14:45.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.129+0000 7ff3e13ff700 1 Processor -- start 2023-09-21T13:14:45.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.129+0000 7ff3e13ff700 1 -- start start 2023-09-21T13:14:45.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.129+0000 7ff3e13ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.125 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.129+0000 7ff3e13ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 0x7ff3dc1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3e13ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 0x7ff3dc19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3e13ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc19e190 con 0x7ff3dc10d590 2023-09-21T13:14:45.126 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3e13ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc19e300 con 0x7ff3dc073210 2023-09-21T13:14:45.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3e13ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc19e4c0 con 0x7ff3dc073b30 2023-09-21T13:14:45.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3d3fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 0x7ff3dc1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.127 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.156:3300/0 says I am v2:172.21.15.142:60500/0 (socket says 172.21.15.142:60500) 2023-09-21T13:14:45.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 0x7ff3dc19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 -- 172.21.15.142:0/3904129751 learned_addr learned my addr 172.21.15.142:0/3904129751 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:45.128 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 -- 172.21.15.142:0/3904129751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 msgr2=0x7ff3dc1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 0x7ff3dc1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 -- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 msgr2=0x7ff3dc19db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 0x7ff3dc19db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.129 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 -- 172.21.15.142:0/3904129751 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc009520 con 0x7ff3dc073210 2023-09-21T13:14:45.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.130+0000 7ff3daffd700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009810 tx=0x7ff3cc00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:45.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.131+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc01c070 con 0x7ff3dc073210 2023-09-21T13:14:45.130 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.131+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3cc00bb20 con 0x7ff3dc073210 2023-09-21T13:14:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.131+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc19e740 con 0x7ff3dc073210 2023-09-21T13:14:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.131+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc004930 con 0x7ff3dc073210 2023-09-21T13:14:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.131+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc1a5fe0 con 0x7ff3dc073210 2023-09-21T13:14:45.131 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.132+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc067bd0 con 0x7ff3dc073210 2023-09-21T13:14:45.132 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.134+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7ff3cc020070 con 0x7ff3dc073210 2023-09-21T13:14:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.135+0000 7ff3d8ff9700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 0x7ff3c80a2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.135+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7ff3cc0ccff0 con 0x7ff3dc073210 2023-09-21T13:14:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.136+0000 7ff3d3fff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 0x7ff3c80a2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.133 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.136+0000 7ff3d3fff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 0x7ff3c80a2cb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc19a7c0 tx=0x7ff3c4009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:45.134 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.137+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff3cc096990 con 0x7ff3dc073210 2023-09-21T13:14:45.373 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.382+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3dc19a500 con 0x7ff3dc073210 2023-09-21T13:14:45.374 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.383+0000 7ff3d8ff9700 1 -- 172.21.15.142:0/3904129751 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+11342 (secure 0 0 0) 0x7ff3cc027070 con 0x7ff3dc073210 2023-09-21T13:14:45.375 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:45.375 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14445,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6835/2681250553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6834","nonce":2681250553},{"type":"v1","addr":"172.21.15.142:6835","nonce":2681250553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14505,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6839/445702531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6838","nonce":445702531},{"type":"v1","addr":"172.21.15.142:6839","nonce":445702531}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24454,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6833/3462586639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3462586639},{"type":"v1","addr":"172.21.15.160:6833","nonce":3462586639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24467,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6833/3649477303","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6832","nonce":3649477303},{"type":"v1","addr":"172.21.15.156:6833","nonce":3649477303}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24488,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.142:6837/2227040296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6836","nonce":2227040296},{"type":"v1","addr":"172.21.15.142:6837","nonce":2227040296}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24500,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.156:6835/3821479486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6834","nonce":3821479486},{"type":"v1","addr":"172.21.15.156:6835","nonce":3821479486}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":59,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-21T12:54:11.985089+0000","modified":"2023-09-21T13:13:58.329655+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24578,"mds_1":24559,"mds_2":24514},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24502":{"gid":24502,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6835/2687704828","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2687704828},{"type":"v1","addr":"172.21.15.160:6835","nonce":2687704828}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24514":{"gid":24514,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.160:6837/1554558585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6836","nonce":1554558585},{"type":"v1","addr":"172.21.15.160:6837","nonce":1554558585}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24533":{"gid":24533,"name":"h","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.156:6837/3800669997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6836","nonce":3800669997},{"type":"v1","addr":"172.21.15.156:6837","nonce":3800669997}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24559":{"gid":24559,"name":"a","rank":1,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.142:6841/3027031872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6840","nonce":3027031872},{"type":"v1","addr":"172.21.15.142:6841","nonce":3027031872}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24578":{"gid":24578,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.156:6839/1981914736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6838","nonce":1981914736},{"type":"v1","addr":"172.21.15.156:6839","nonce":1981914736}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_28258":{"gid":28258,"name":"i","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.160:6839/3000866200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6838","nonce":3000866200},{"type":"v1","addr":"172.21.15.160:6839","nonce":3000866200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-21T13:14:45.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 msgr2=0x7ff3c80a2cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 0x7ff3c80a2cb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc19a7c0 tx=0x7ff3c4009260 comp rx=0 tx=0).stop 2023-09-21T13:14:45.377 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 msgr2=0x7ff3dc1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009810 tx=0x7ff3cc00fa00 comp rx=0 tx=0).stop 2023-09-21T13:14:45.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 shutdown_connections 2023-09-21T13:14:45.378 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7ff3c80a07f0 0x7ff3c80a2cb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7ff3dc10d590 0x7ff3dc19db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7ff3dc073210 0x7ff3dc1991b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 --2- 172.21.15.142:0/3904129751 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3dc073b30 0x7ff3dc1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.379 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 >> 172.21.15.142:0/3904129751 conn(0x7ff3dc0fc800 msgr2=0x7ff3dc10f740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:45.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 shutdown_connections 2023-09-21T13:14:45.380 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.385+0000 7ff3e13ff700 1 -- 172.21.15.142:0/3904129751 wait complete. 2023-09-21T13:14:45.381 INFO:teuthology.orchestra.run.smithi142.stderr:dumped fsmap epoch 59 2023-09-21T13:14:45.393 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:45 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3975809839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:45.396 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-21T13:14:45.397 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:45 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3975809839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:45.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:45 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3975809839' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:45.595 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 -- 172.21.15.142:0/2036531860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24141060e0 msgr2=0x7f241410dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 --2- 172.21.15.142:0/2036531860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24141060e0 0x7f241410dc60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f240c00b0a0 tx=0x7f240c00b3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 -- 172.21.15.142:0/2036531860 shutdown_connections 2023-09-21T13:14:45.596 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 --2- 172.21.15.142:0/2036531860 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f24141060e0 0x7f241410dc60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 --2- 172.21.15.142:0/2036531860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24141013a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 --2- 172.21.15.142:0/2036531860 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f2414101970 0x7f24141059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 -- 172.21.15.142:0/2036531860 >> 172.21.15.142:0/2036531860 conn(0x7f24140fc800 msgr2=0x7f24140fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:45.597 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 -- 172.21.15.142:0/2036531860 shutdown_connections 2023-09-21T13:14:45.598 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.603+0000 7f241c3ff700 1 -- 172.21.15.142:0/2036531860 wait complete. 2023-09-21T13:14:45.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.604+0000 7f241c3ff700 1 Processor -- start 2023-09-21T13:14:45.600 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.604+0000 7f241c3ff700 1 -- start start 2023-09-21T13:14:45.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24140730e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24141060e0 0x7f2414073620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 0x7f24141a5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.601 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24141a57c0 con 0x7f2414073b60 2023-09-21T13:14:45.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24141a5930 con 0x7f24141060e0 2023-09-21T13:14:45.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241c3ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24141a5af0 con 0x7f2414100fc0 2023-09-21T13:14:45.602 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24140730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 0x7f24141a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241999a700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24141060e0 0x7f2414073620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a19b700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24140730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43926/0 (socket says 172.21.15.142:43926) 2023-09-21T13:14:45.603 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a19b700 1 -- 172.21.15.142:0/3655271376 learned_addr learned my addr 172.21.15.142:0/3655271376 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 -- 172.21.15.142:0/3655271376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 msgr2=0x7f24140730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24140730e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.604 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 -- 172.21.15.142:0/3655271376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24141060e0 msgr2=0x7f2414073620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24141060e0 0x7f2414073620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.605+0000 7f241a99c700 1 -- 172.21.15.142:0/3655271376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f240c009d00 con 0x7f2414073b60 2023-09-21T13:14:45.605 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f241a99c700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 0x7f24141a5130 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f240c009fd0 tx=0x7f240c007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00e040 con 0x7f2414073b60 2023-09-21T13:14:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f240c01d480 con 0x7f2414073b60 2023-09-21T13:14:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c0052a0 con 0x7f2414073b60 2023-09-21T13:14:45.606 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24141a5d70 con 0x7f2414073b60 2023-09-21T13:14:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.606+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24141a6140 con 0x7f2414073b60 2023-09-21T13:14:45.607 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.607+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2414067bd0 con 0x7f2414073b60 2023-09-21T13:14:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.609+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f240c01d5f0 con 0x7f2414073b60 2023-09-21T13:14:45.608 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.610+0000 7f240b7fe700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 0x7f24000a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.610+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f240c0ccf90 con 0x7f2414073b60 2023-09-21T13:14:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.610+0000 7f241a19b700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 0x7f24000a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:45.609 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.611+0000 7f241a19b700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 0x7f24000a2d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d20 tx=0x7f2410009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:45.610 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.614+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f240c0967b0 con 0x7f2414073b60 2023-09-21T13:14:45.812 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.820+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2414074610 con 0x7f2414073b60 2023-09-21T13:14:45.813 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.822+0000 7f240b7fe700 1 -- 172.21.15.142:0/3655271376 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+23078 (secure 0 0 0) 0x7f240c099dd0 con 0x7f2414073b60 2023-09-21T13:14:45.814 INFO:teuthology.orchestra.run.smithi142.stdout: 2023-09-21T13:14:45.815 INFO:teuthology.orchestra.run.smithi142.stdout:{"epoch":115,"fsid":"ca3f7e80-587c-11ee-9ab8-7b867c8bd7da","created":"2023-09-21T12:46:39.123325+0000","modified":"2023-09-21T13:14:16.778784+0000","last_up_change":"2023-09-21T12:53:24.316845+0000","last_in_change":"2023-09-21T12:53:06.629208+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-21T12:50:00.891036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-21T12:54:09.980098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-21T12:54:11.417588+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"114","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":30,"snap_epoch":114,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7ea0a160-c930-4a0c-bec7-4613739a09d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6802","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6803","nonce":3599687873}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6804","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6805","nonce":3599687873}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6808","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6809","nonce":3599687873}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6806","nonce":3599687873},{"type":"v1","addr":"172.21.15.142:6807","nonce":3599687873}]},"public_addr":"172.21.15.142:6803/3599687873","cluster_addr":"172.21.15.142:6805/3599687873","heartbeat_back_addr":"172.21.15.142:6809/3599687873","heartbeat_front_addr":"172.21.15.142:6807/3599687873","state":["exists","up"]},{"osd":1,"uuid":"6fbd4acd-e759-44ab-8f94-9cc17468eb03","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6800","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6801","nonce":247411952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6802","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6803","nonce":247411952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6806","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6807","nonce":247411952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6804","nonce":247411952},{"type":"v1","addr":"172.21.15.156:6805","nonce":247411952}]},"public_addr":"172.21.15.156:6801/247411952","cluster_addr":"172.21.15.156:6803/247411952","heartbeat_back_addr":"172.21.15.156:6807/247411952","heartbeat_front_addr":"172.21.15.156:6805/247411952","state":["exists","up"]},{"osd":2,"uuid":"6abafec8-0f0f-46bd-a696-307d17b092ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6801","nonce":3134850125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6803","nonce":3134850125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6807","nonce":3134850125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":3134850125},{"type":"v1","addr":"172.21.15.160:6805","nonce":3134850125}]},"public_addr":"172.21.15.160:6801/3134850125","cluster_addr":"172.21.15.160:6803/3134850125","heartbeat_back_addr":"172.21.15.160:6807/3134850125","heartbeat_front_addr":"172.21.15.160:6805/3134850125","state":["exists","up"]},{"osd":3,"uuid":"ff8696c6-6583-4072-a479-2d6d0ce9ca37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6810","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6811","nonce":3058352987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6812","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6813","nonce":3058352987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6816","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6817","nonce":3058352987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6814","nonce":3058352987},{"type":"v1","addr":"172.21.15.142:6815","nonce":3058352987}]},"public_addr":"172.21.15.142:6811/3058352987","cluster_addr":"172.21.15.142:6813/3058352987","heartbeat_back_addr":"172.21.15.142:6817/3058352987","heartbeat_front_addr":"172.21.15.142:6815/3058352987","state":["exists","up"]},{"osd":4,"uuid":"6992ad1c-863b-4ac1-8916-f4639f26cc5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6808","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6809","nonce":3785987022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6810","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6811","nonce":3785987022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6814","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6815","nonce":3785987022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6812","nonce":3785987022},{"type":"v1","addr":"172.21.15.156:6813","nonce":3785987022}]},"public_addr":"172.21.15.156:6809/3785987022","cluster_addr":"172.21.15.156:6811/3785987022","heartbeat_back_addr":"172.21.15.156:6815/3785987022","heartbeat_front_addr":"172.21.15.156:6813/3785987022","state":["exists","up"]},{"osd":5,"uuid":"8ae7fea9-544d-49a6-9013-60b6856d3a0e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6809","nonce":4176368552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6811","nonce":4176368552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6815","nonce":4176368552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":4176368552},{"type":"v1","addr":"172.21.15.160:6813","nonce":4176368552}]},"public_addr":"172.21.15.160:6809/4176368552","cluster_addr":"172.21.15.160:6811/4176368552","heartbeat_back_addr":"172.21.15.160:6815/4176368552","heartbeat_front_addr":"172.21.15.160:6813/4176368552","state":["exists","up"]},{"osd":6,"uuid":"6c35da40-e01d-46b9-bd3c-ddd75f470a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6818","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6819","nonce":231467539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6820","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6821","nonce":231467539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6824","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6825","nonce":231467539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6822","nonce":231467539},{"type":"v1","addr":"172.21.15.142:6823","nonce":231467539}]},"public_addr":"172.21.15.142:6819/231467539","cluster_addr":"172.21.15.142:6821/231467539","heartbeat_back_addr":"172.21.15.142:6825/231467539","heartbeat_front_addr":"172.21.15.142:6823/231467539","state":["exists","up"]},{"osd":7,"uuid":"7529cf76-0674-4014-89b5-2468f2dc7dc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":52,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6816","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6817","nonce":129918073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6818","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6819","nonce":129918073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6822","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6823","nonce":129918073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6820","nonce":129918073},{"type":"v1","addr":"172.21.15.156:6821","nonce":129918073}]},"public_addr":"172.21.15.156:6817/129918073","cluster_addr":"172.21.15.156:6819/129918073","heartbeat_back_addr":"172.21.15.156:6823/129918073","heartbeat_front_addr":"172.21.15.156:6821/129918073","state":["exists","up"]},{"osd":8,"uuid":"0f108a2f-c86d-4470-bfa1-1309dc3a7ccf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6817","nonce":2074363946}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6819","nonce":2074363946}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6823","nonce":2074363946}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":2074363946},{"type":"v1","addr":"172.21.15.160:6821","nonce":2074363946}]},"public_addr":"172.21.15.160:6817/2074363946","cluster_addr":"172.21.15.160:6819/2074363946","heartbeat_back_addr":"172.21.15.160:6823/2074363946","heartbeat_front_addr":"172.21.15.160:6821/2074363946","state":["exists","up"]},{"osd":9,"uuid":"daf12b88-9896-4d51-9344-19982347fc29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6826","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6827","nonce":1610185584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6828","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6829","nonce":1610185584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6832","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6833","nonce":1610185584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.142:6830","nonce":1610185584},{"type":"v1","addr":"172.21.15.142:6831","nonce":1610185584}]},"public_addr":"172.21.15.142:6827/1610185584","cluster_addr":"172.21.15.142:6829/1610185584","heartbeat_back_addr":"172.21.15.142:6833/1610185584","heartbeat_front_addr":"172.21.15.142:6831/1610185584","state":["exists","up"]},{"osd":10,"uuid":"0f5dfd0a-9c50-4263-a4ac-8e08f16b1017","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6824","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6825","nonce":2737214225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6826","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6827","nonce":2737214225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6830","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6831","nonce":2737214225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.156:6828","nonce":2737214225},{"type":"v1","addr":"172.21.15.156:6829","nonce":2737214225}]},"public_addr":"172.21.15.156:6825/2737214225","cluster_addr":"172.21.15.156:6827/2737214225","heartbeat_back_addr":"172.21.15.156:6831/2737214225","heartbeat_front_addr":"172.21.15.156:6829/2737214225","state":["exists","up"]},{"osd":11,"uuid":"f2973989-1721-4164-9d5e-a6fd05b73d52","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6825","nonce":742511667}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6827","nonce":742511667}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6831","nonce":742511667}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":742511667},{"type":"v1","addr":"172.21.15.160:6829","nonce":742511667}]},"public_addr":"172.21.15.160:6825/742511667","cluster_addr":"172.21.15.160:6827/742511667","heartbeat_back_addr":"172.21.15.160:6831/742511667","heartbeat_front_addr":"172.21.15.160:6829/742511667","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:15.233216+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:36.816490+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:49:57.352969+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:22.955129+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:50:44.549706+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:05.344277+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:30.736355+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:51:52.503713+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:13.325454+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:52:39.168898+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:01.504726+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-21T12:53:22.683625+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1c","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.1a","mappings":[{"from":5,"to":6}]},{"pgid":"3.29","mappings":[{"from":3,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.142:6800/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/969325249":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/3896559715":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2205822122":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2427588007":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:0/2723441093":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3720958087":"2023-09-22T12:47:40.288815+0000","172.21.15.142:6801/3499877374":"2023-09-22T12:56:14.397873+0000","172.21.15.142:0/2135445545":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1696580850":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1982354187":"2023-09-22T12:47:13.540584+0000","172.21.15.142:6801/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/1844445290":"2023-09-22T12:56:14.397873+0000","172.21.15.142:6800/3614708159":"2023-09-22T12:47:13.540584+0000","172.21.15.142:0/3623066670":"2023-09-22T12:47:40.288815+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":17,"length":1},{"begin":30,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-21T13:14:45.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 msgr2=0x7f24000a2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.816 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 0x7f24000a2d30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2410009d20 tx=0x7f2410009260 comp rx=0 tx=0).stop 2023-09-21T13:14:45.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 msgr2=0x7f24141a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:45.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 0x7f24141a5130 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f240c009fd0 tx=0x7f240c007910 comp rx=0 tx=0).stop 2023-09-21T13:14:45.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 shutdown_connections 2023-09-21T13:14:45.817 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f24000a0870 0x7f24000a2d30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f2414073b60 0x7f24141a5130 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2414100fc0 0x7f24140730e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.818 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 --2- 172.21.15.142:0/3655271376 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f24141060e0 0x7f2414073620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:45.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 >> 172.21.15.142:0/3655271376 conn(0x7f24140fc800 msgr2=0x7f24140fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:45.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 shutdown_connections 2023-09-21T13:14:45.819 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:45.824+0000 7f241c3ff700 1 -- 172.21.15.142:0/3655271376 wait complete. 2023-09-21T13:14:45.836 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-21T13:14:46.035 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 -- 172.21.15.142:0/2959586015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac10d590 msgr2=0x7f28ac10fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 --2- 172.21.15.142:0/2959586015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac10d590 0x7f28ac10fa00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f28a400b0a0 tx=0x7f28a400b3b0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 -- 172.21.15.142:0/2959586015 shutdown_connections 2023-09-21T13:14:46.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 --2- 172.21.15.142:0/2959586015 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac10d590 0x7f28ac10fa00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.036 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 --2- 172.21.15.142:0/2959586015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac073210 0x7f28ac0735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 --2- 172.21.15.142:0/2959586015 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 0x7f28ac10d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 -- 172.21.15.142:0/2959586015 >> 172.21.15.142:0/2959586015 conn(0x7f28ac0fc840 msgr2=0x7f28ac0fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:46.037 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 -- 172.21.15.142:0/2959586015 shutdown_connections 2023-09-21T13:14:46.038 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.043+0000 7f28b2dff700 1 -- 172.21.15.142:0/2959586015 wait complete. 2023-09-21T13:14:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.044+0000 7f28b2dff700 1 Processor -- start 2023-09-21T13:14:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.044+0000 7f28b2dff700 1 -- start start 2023-09-21T13:14:46.040 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 0x7f28ac1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 0x7f28ac19db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.041 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19e170 con 0x7f28ac073210 2023-09-21T13:14:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19e2e0 con 0x7f28ac073b30 2023-09-21T13:14:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b2dff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac19e4a0 con 0x7f28ac10d590 2023-09-21T13:14:46.042 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43928/0 (socket says 172.21.15.142:43928) 2023-09-21T13:14:46.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 -- 172.21.15.142:0/3373621689 learned_addr learned my addr 172.21.15.142:0/3373621689 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:46.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b139c700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 0x7f28ac19db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.043 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28abfff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 0x7f28ac1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 -- 172.21.15.142:0/3373621689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 msgr2=0x7f28ac19db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 0x7f28ac19db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.044 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 -- 172.21.15.142:0/3373621689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 msgr2=0x7f28ac1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 0x7f28ac1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b0b9b700 1 -- 172.21.15.142:0/3373621689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a4009d00 con 0x7f28ac073210 2023-09-21T13:14:46.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.045+0000 7f28b139c700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 0x7f28ac19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:46.045 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28b0b9b700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e9a0 tx=0x7f28a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:46.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0009790 con 0x7f28ac073210 2023-09-21T13:14:46.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f28a0010430 con 0x7f28ac073210 2023-09-21T13:14:46.046 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac19e780 con 0x7f28ac073210 2023-09-21T13:14:46.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a0018680 con 0x7f28ac073210 2023-09-21T13:14:46.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.046+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac1a5fc0 con 0x7f28ac073210 2023-09-21T13:14:46.047 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.047+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac107eb0 con 0x7f28ac073210 2023-09-21T13:14:46.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.049+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f28a00105a0 con 0x7f28ac073210 2023-09-21T13:14:46.048 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.050+0000 7f28a9ffb700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 0x7f289c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.051+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8513+0+0 (secure 0 0 0) 0x7f28a0014070 con 0x7f28ac073210 2023-09-21T13:14:46.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.051+0000 7f28abfff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 0x7f289c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.049 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.051+0000 7f28abfff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 0x7f289c0a2cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28ac19a7a0 tx=0x7f2898009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:46.050 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.054+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f28a0051e10 con 0x7f28ac073210 2023-09-21T13:14:46.158 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-mon[97663]: pgmap v587: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-09-21T13:14:46.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3904129751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.159 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3655271376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.293 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.301+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f28ac067b60 con 0x7f28ac073210 2023-09-21T13:14:46.303 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.311+0000 7f28a9ffb700 1 -- 172.21.15.142:0/3373621689 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f28a00958e0 con 0x7f28ac073210 2023-09-21T13:14:46.306 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 msgr2=0x7f289c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 0x7f289c0a2cf0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f28ac19a7a0 tx=0x7f2898009260 comp rx=0 tx=0).stop 2023-09-21T13:14:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 msgr2=0x7f28ac199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f28a000e9a0 tx=0x7f28a000ecb0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 shutdown_connections 2023-09-21T13:14:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f289c0a0830 0x7f289c0a2cf0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f28ac073210 0x7f28ac199190 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac10d590 0x7f28ac19db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 --2- 172.21.15.142:0/3373621689 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f28ac073b30 0x7f28ac1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 >> 172.21.15.142:0/3373621689 conn(0x7f28ac0fc840 msgr2=0x7f28ac104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:46.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 shutdown_connections 2023-09-21T13:14:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.314+0000 7f28b2dff700 1 -- 172.21.15.142:0/3373621689 wait complete. 2023-09-21T13:14:46.310 INFO:teuthology.orchestra.run.smithi142.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-21T13:14:46.327 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-21T13:14:46.344 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-mon[134078]: pgmap v587: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-09-21T13:14:46.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3904129751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.345 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3655271376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.346 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-mon[134450]: pgmap v587: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 17 KiB/s wr, 6 op/s 2023-09-21T13:14:46.346 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3904129751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.347 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3655271376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-21T13:14:46.532 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 -- 172.21.15.142:0/2816228522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 msgr2=0x7f0e901035b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 --2- 172.21.15.142:0/2816228522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e901035b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0e80009990 tx=0x7f0e80009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.533 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 -- 172.21.15.142:0/2816228522 shutdown_connections 2023-09-21T13:14:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 --2- 172.21.15.142:0/2816228522 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e901035b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 --2- 172.21.15.142:0/2816228522 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e9010fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 --2- 172.21.15.142:0/2816228522 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e90103b80 0x7f0e90107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 -- 172.21.15.142:0/2816228522 >> 172.21.15.142:0/2816228522 conn(0x7f0e900fea50 msgr2=0x7f0e90100e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 -- 172.21.15.142:0/2816228522 shutdown_connections 2023-09-21T13:14:46.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.540+0000 7f0e949ff700 1 -- 172.21.15.142:0/2816228522 wait complete. 2023-09-21T13:14:46.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.541+0000 7f0e949ff700 1 Processor -- start 2023-09-21T13:14:46.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.541+0000 7f0e949ff700 1 -- start start 2023-09-21T13:14:46.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e90199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.538 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e9019dae0 0x7f0e9019df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9019e560 con 0x7f0e901031d0 2023-09-21T13:14:46.539 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9019e6d0 con 0x7f0e9019dae0 2023-09-21T13:14:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e949ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9019e890 con 0x7f0e901082f0 2023-09-21T13:14:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e8e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e90199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e8e59c700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43958/0 (socket says 172.21.15.142:43958) 2023-09-21T13:14:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e8e59c700 1 -- 172.21.15.142:0/492722036 learned_addr learned my addr 172.21.15.142:0/492722036 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e8ed9d700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e9019dae0 0x7f0e9019df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 -- 172.21.15.142:0/492722036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e9019dae0 msgr2=0x7f0e9019df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e9019dae0 0x7f0e9019df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 -- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 msgr2=0x7f0e90199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:46.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.542+0000 7f0e87fff700 1 -- 172.21.15.142:0/492722036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800095f0 con 0x7f0e901082f0 2023-09-21T13:14:46.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e8e59c700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-21T13:14:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e87fff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e90199680 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e9c0 tx=0x7f0e7800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7800c9c0 con 0x7f0e901082f0 2023-09-21T13:14:46.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e78010430 con 0x7f0e901082f0 2023-09-21T13:14:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78018680 con 0x7f0e901082f0 2023-09-21T13:14:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e901a5df0 con 0x7f0e901082f0 2023-09-21T13:14:46.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.543+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e901a6270 con 0x7f0e901082f0 2023-09-21T13:14:46.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.544+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e90067fb0 con 0x7f0e901082f0 2023-09-21T13:14:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.546+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f0e7800cb20 con 0x7f0e901082f0 2023-09-21T13:14:46.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.547+0000 7f0e877fe700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 0x7f0e7c0a2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.548+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8727+0+0 (secure 0 0 0) 0x7f0e78014070 con 0x7f0e901082f0 2023-09-21T13:14:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.548+0000 7f0e8e59c700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 0x7f0e7c0a2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.548+0000 7f0e8e59c700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 0x7f0e7c0a2cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e8000b260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:46.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.549+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0e78095a70 con 0x7f0e901082f0 2023-09-21T13:14:46.648 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.648 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.649 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-mds[170129]: -- 172.21.15.156:0/3995184326 <== mon.2 v2:172.21.15.156:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56364df391e0 con 0x56364df0f000 2023-09-21T13:14:46.649 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: starting mds.h at 2023-09-21T13:14:46.649 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.650 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.650 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-mds[170468]: -- 172.21.15.156:0/2655501649 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d518a791e0 con 0x55d518a4e800 2023-09-21T13:14:46.650 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:14:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: starting mds.b at 2023-09-21T13:14:46.658 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a[97638]: 2023-09-21T13:14:46.302+0000 7ff5fd527700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T13:14:46.659 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.659 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.660 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-mds[149060]: -- 172.21.15.142:0/646450037 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55805e2791e0 con 0x55805e24e800 2023-09-21T13:14:46.660 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:14:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: starting mds.a at 2023-09-21T13:14:46.680 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.681 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.681 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: starting mds.f at 2023-09-21T13:14:46.682 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.682 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.682 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: starting mds.i at 2023-09-21T13:14:46.683 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: ignoring --setuser ceph since I am not root 2023-09-21T13:14:46.683 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: ignoring --setgroup ceph since I am not root 2023-09-21T13:14:46.683 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-mds[171847]: -- 172.21.15.160:0/2123535272 <== mon.1 v2:172.21.15.160:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ed5fd811e0 con 0x55ed5fd56800 2023-09-21T13:14:46.684 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:14:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: starting mds.c at 2023-09-21T13:14:46.790 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:46.798+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e90112f40 con 0x7f0e901082f0 2023-09-21T13:14:47.304 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.313+0000 7f0e877fe700 1 -- 172.21.15.142:0/492722036 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0e78099090 con 0x7f0e901082f0 2023-09-21T13:14:47.308 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 msgr2=0x7f0e7c0a2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 0x7f0e7c0a2cf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0e80006010 tx=0x7f0e8000b260 comp rx=0 tx=0).stop 2023-09-21T13:14:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 msgr2=0x7f0e90199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:47.309 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e90199680 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f0e7800e9c0 tx=0x7f0e7800ecd0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 shutdown_connections 2023-09-21T13:14:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f0e7c0a0830 0x7f0e7c0a2cf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.310 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f0e901031d0 0x7f0e90199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f0e9019dae0 0x7f0e9019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 --2- 172.21.15.142:0/492722036 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e901082f0 0x7f0e90199680 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.311 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.316+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 >> 172.21.15.142:0/492722036 conn(0x7f0e900fea50 msgr2=0x7f0e900ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.317+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 shutdown_connections 2023-09-21T13:14:47.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.317+0000 7f0e949ff700 1 -- 172.21.15.142:0/492722036 wait complete. 2023-09-21T13:14:47.328 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-21T13:14:47.328 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-21T13:14:47.328 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T13:14:47.329 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: osdmap e116: 12 total, 12 up, 12 in 2023-09-21T13:14:47.329 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-21T13:14:47.329 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-09-21T13:14:47.330 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/492722036' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.330 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:47 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.331 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-21T13:14:47.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-21T13:14:47.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-21T13:14:47.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T13:14:47.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: osdmap e116: 12 total, 12 up, 12 in 2023-09-21T13:14:47.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-21T13:14:47.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-09-21T13:14:47.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/492722036' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:47 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-21T13:14:47.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-21T13:14:47.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-21T13:14:47.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: osdmap e116: 12 total, 12 up, 12 in 2023-09-21T13:14:47.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/3373621689' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-21T13:14:47.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-09-21T13:14:47.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/492722036' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:47 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-21T13:14:47.534 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 -- 172.21.15.142:0/3754159547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c101950 msgr2=0x7fb11c105990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:47.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 --2- 172.21.15.142:0/3754159547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c101950 0x7fb11c105990 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb110009990 tx=0x7fb110009ca0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.535 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 -- 172.21.15.142:0/3754159547 shutdown_connections 2023-09-21T13:14:47.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 --2- 172.21.15.142:0/3754159547 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c1060c0 0x7fb11c10dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 --2- 172.21.15.142:0/3754159547 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 0x7fb11c101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 --2- 172.21.15.142:0/3754159547 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c101950 0x7fb11c105990 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.536 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 -- 172.21.15.142:0/3754159547 >> 172.21.15.142:0/3754159547 conn(0x7fb11c0fc860 msgr2=0x7fb11c0fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 -- 172.21.15.142:0/3754159547 shutdown_connections 2023-09-21T13:14:47.537 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.542+0000 7fb1227ff700 1 -- 172.21.15.142:0/3754159547 wait complete. 2023-09-21T13:14:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.544+0000 7fb1227ff700 1 Processor -- start 2023-09-21T13:14:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.544+0000 7fb1227ff700 1 -- start start 2023-09-21T13:14:47.540 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 0x7fb11c196ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c19b870 0x7fb11c19bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c19c2f0 con 0x7fb11c1060c0 2023-09-21T13:14:47.541 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c19c460 con 0x7fb11c100fa0 2023-09-21T13:14:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb1227ff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11c19c620 con 0x7fb11c19b870 2023-09-21T13:14:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:47.542 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.142:3300/0 says I am v2:172.21.15.142:43964/0 (socket says 172.21.15.142:43964) 2023-09-21T13:14:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 -- 172.21.15.142:0/4279526538 learned_addr learned my addr 172.21.15.142:0/4279526538 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11bfff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 0x7fb11c196ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:47.543 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb120d9c700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c19b870 0x7fb11c19bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 -- 172.21.15.142:0/4279526538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c19b870 msgr2=0x7fb11c19bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c19b870 0x7fb11c19bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.544 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 -- 172.21.15.142:0/4279526538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 msgr2=0x7fb11c196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 0x7fb11c196ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.545+0000 7fb11b7fe700 1 -- 172.21.15.142:0/4279526538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1100095f0 con 0x7fb11c1060c0 2023-09-21T13:14:47.545 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb11b7fe700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb110004760 tx=0x7fb110004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb11001d070 con 0x7fb11c1060c0 2023-09-21T13:14:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11c1a3b20 con 0x7fb11c1060c0 2023-09-21T13:14:47.546 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb110004830 con 0x7fb11c1060c0 2023-09-21T13:14:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb110005280 con 0x7fb11c1060c0 2023-09-21T13:14:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.546+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb11c1a3ef0 con 0x7fb11c1060c0 2023-09-21T13:14:47.547 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.547+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11c067b60 con 0x7fb11c1060c0 2023-09-21T13:14:47.548 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.549+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7fb110005400 con 0x7fb11c1060c0 2023-09-21T13:14:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.550+0000 7fb1197fa700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 0x7fb1040a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.550+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8727+0+0 (secure 0 0 0) 0x7fb1100cd110 con 0x7fb11c1060c0 2023-09-21T13:14:47.549 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.550+0000 7fb11bfff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 0x7fb1040a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.551+0000 7fb11bfff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 0x7fb1040a2c70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009c60 tx=0x7fb10c009260 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:47.550 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.554+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb11005ae10 con 0x7fb11c1060c0 2023-09-21T13:14:47.748 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:47.757+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb11c198220 con 0x7fb11c1060c0 2023-09-21T13:14:48.307 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.315+0000 7fb1197fa700 1 -- 172.21.15.142:0/4279526538 <== mon.0 v2:172.21.15.142:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v117) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1100968c0 con 0x7fb11c1060c0 2023-09-21T13:14:48.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.320+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 msgr2=0x7fb1040a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:48.312 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.320+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 0x7fb1040a2c70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb10c009c60 tx=0x7fb10c009260 comp rx=0 tx=0).stop 2023-09-21T13:14:48.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.320+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 msgr2=0x7fb11c197410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:48.313 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.320+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb110004760 tx=0x7fb110004790 comp rx=0 tx=0).stop 2023-09-21T13:14:48.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 shutdown_connections 2023-09-21T13:14:48.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7fb1040a07b0 0x7fb1040a2c70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.314 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb11c19b870 0x7fb11c19bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7fb11c100fa0 0x7fb11c196ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 --2- 172.21.15.142:0/4279526538 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7fb11c1060c0 0x7fb11c197410 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.315 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 >> 172.21.15.142:0/4279526538 conn(0x7fb11c0fc860 msgr2=0x7fb11c0fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:48.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 shutdown_connections 2023-09-21T13:14:48.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.321+0000 7fb1227ff700 1 -- 172.21.15.142:0/4279526538 wait complete. 2023-09-21T13:14:48.316 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_metadata' removed 2023-09-21T13:14:48.334 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: pgmap v589: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-09-21T13:14:48.335 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-21T13:14:48.335 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-21T13:14:48.335 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: Cluster is now healthy 2023-09-21T13:14:48.336 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6836/3876872947,v1:172.21.15.156:6839/3876872947] up:boot 2023-09-21T13:14:48.336 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6837/2985847943,v1:172.21.15.160:6839/2985847943] up:boot 2023-09-21T13:14:48.336 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.156:6837/1129649021,v1:172.21.15.156:6838/1129649021] up:boot 2023-09-21T13:14:48.337 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6834/1843497868,v1:172.21.15.160:6835/1843497868] up:boot 2023-09-21T13:14:48.337 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.160:6836/176499544,v1:172.21.15.160:6838/176499544] up:boot 2023-09-21T13:14:48.337 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: mds.? [v2:172.21.15.142:6840/4202076224,v1:172.21.15.142:6841/4202076224] up:boot 2023-09-21T13:14:48.337 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-21T13:14:48.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: fsmap 12 up:standby 2023-09-21T13:14:48.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T13:14:48.338 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:14:48.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T13:14:48.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T13:14:48.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T13:14:48.339 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T13:14:48.340 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:48 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:48.341 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-21T13:14:48.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: pgmap v589: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-09-21T13:14:48.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-21T13:14:48.398 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-21T13:14:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: Cluster is now healthy 2023-09-21T13:14:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6836/3876872947,v1:172.21.15.156:6839/3876872947] up:boot 2023-09-21T13:14:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6837/2985847943,v1:172.21.15.160:6839/2985847943] up:boot 2023-09-21T13:14:48.399 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.156:6837/1129649021,v1:172.21.15.156:6838/1129649021] up:boot 2023-09-21T13:14:48.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6834/1843497868,v1:172.21.15.160:6835/1843497868] up:boot 2023-09-21T13:14:48.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.160:6836/176499544,v1:172.21.15.160:6838/176499544] up:boot 2023-09-21T13:14:48.400 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: mds.? [v2:172.21.15.142:6840/4202076224,v1:172.21.15.142:6841/4202076224] up:boot 2023-09-21T13:14:48.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-21T13:14:48.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: fsmap 12 up:standby 2023-09-21T13:14:48.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T13:14:48.401 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:14:48.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T13:14:48.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T13:14:48.402 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T13:14:48.403 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T13:14:48.403 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:48 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:48.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: pgmap v589: 97 pgs: 97 active+clean; 1.2 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 18 KiB/s wr, 8 op/s 2023-09-21T13:14:48.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-21T13:14:48.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-21T13:14:48.431 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: Cluster is now healthy 2023-09-21T13:14:48.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6836/3876872947,v1:172.21.15.156:6839/3876872947] up:boot 2023-09-21T13:14:48.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6837/2985847943,v1:172.21.15.160:6839/2985847943] up:boot 2023-09-21T13:14:48.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.156:6837/1129649021,v1:172.21.15.156:6838/1129649021] up:boot 2023-09-21T13:14:48.432 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6834/1843497868,v1:172.21.15.160:6835/1843497868] up:boot 2023-09-21T13:14:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.160:6836/176499544,v1:172.21.15.160:6838/176499544] up:boot 2023-09-21T13:14:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: mds.? [v2:172.21.15.142:6840/4202076224,v1:172.21.15.142:6841/4202076224] up:boot 2023-09-21T13:14:48.433 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-21T13:14:48.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: fsmap 12 up:standby 2023-09-21T13:14:48.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-21T13:14:48.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-21T13:14:48.434 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-21T13:14:48.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-21T13:14:48.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-21T13:14:48.435 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='mgr.15303 172.21.15.142:0/831710714' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-21T13:14:48.436 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:48 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:48.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 -- 172.21.15.142:0/2534779773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4758102810 msgr2=0x7f475810acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:48.640 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 --2- 172.21.15.142:0/2534779773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4758102810 0x7f475810acf0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f474c00dd20 tx=0x7f474c00f330 comp rx=0 tx=0).stop 2023-09-21T13:14:48.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 -- 172.21.15.142:0/2534779773 shutdown_connections 2023-09-21T13:14:48.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 --2- 172.21.15.142:0/2534779773 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f475810b310 0x7f475810d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.641 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 --2- 172.21.15.142:0/2534779773 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758101ef0 0x7f47581022d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 --2- 172.21.15.142:0/2534779773 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4758102810 0x7f475810acf0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.647+0000 7f475dfff700 1 -- 172.21.15.142:0/2534779773 >> 172.21.15.142:0/2534779773 conn(0x7f47580fb730 msgr2=0x7f47580fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:48.642 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.648+0000 7f475dfff700 1 -- 172.21.15.142:0/2534779773 shutdown_connections 2023-09-21T13:14:48.643 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.648+0000 7f475dfff700 1 -- 172.21.15.142:0/2534779773 wait complete. 2023-09-21T13:14:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.649+0000 7f475dfff700 1 Processor -- start 2023-09-21T13:14:48.645 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.649+0000 7f475dfff700 1 -- start start 2023-09-21T13:14:48.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4758101ef0 0x7f4758194cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:48.646 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 0x7f4758195210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 0x7f47581985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 -- --> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758198bc0 con 0x7f4758101ef0 2023-09-21T13:14:48.647 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 -- --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758198d30 con 0x7f4758102810 2023-09-21T13:14:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f475dfff700 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4758198ef0 con 0x7f475810b310 2023-09-21T13:14:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f47577fe700 1 --2- >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4758101ef0 0x7f4758194cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f4757fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 0x7f47581985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:48.648 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f4757fff700 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 0x7f47581985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.142:43996/0 (socket says 172.21.15.142:43996) 2023-09-21T13:14:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f4757fff700 1 -- 172.21.15.142:0/1727225864 learned_addr learned my addr 172.21.15.142:0/1727225864 (peer_addr_for_me v2:172.21.15.142:0/0) 2023-09-21T13:14:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.650+0000 7f4756ffd700 1 --2- >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 0x7f4758195210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:48.649 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 -- 172.21.15.142:0/1727225864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 msgr2=0x7f47581985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 0x7f47581985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 -- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4758101ef0 msgr2=0x7f4758194cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:48.650 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4758101ef0 0x7f4758194cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 -- 172.21.15.142:0/1727225864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c00da00 con 0x7f4758102810 2023-09-21T13:14:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4756ffd700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 0x7f4758195210 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f474c000c00 tx=0x7f474c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c012070 con 0x7f4758102810 2023-09-21T13:14:48.651 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4758199170 con 0x7f4758102810 2023-09-21T13:14:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f474c00b5d0 con 0x7f4758102810 2023-09-21T13:14:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.651+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c016670 con 0x7f4758102810 2023-09-21T13:14:48.652 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.652+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47581a1b30 con 0x7f4758102810 2023-09-21T13:14:48.653 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.653+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4758067b60 con 0x7f4758102810 2023-09-21T13:14:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.656+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 4 ==== mgrmap(e 26) v1 ==== 135391+0+0 (secure 0 0 0) 0x7f474c00ba20 con 0x7f4758102810 2023-09-21T13:14:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.657+0000 7f4754ff9700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 0x7f47400a2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-21T13:14:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.658+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8231+0+0 (secure 0 0 0) 0x7f474c0d0870 con 0x7f4758102810 2023-09-21T13:14:48.654 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.658+0000 7f47577fe700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 0x7f47400a2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-21T13:14:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.658+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f474c09a110 con 0x7f4758102810 2023-09-21T13:14:48.655 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.658+0000 7f47577fe700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 0x7f47400a2c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4748005950 tx=0x7f474800b410 comp rx=0 tx=0).ready entity=mgr.15303 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-21T13:14:48.861 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:48.869+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 --> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f475810eb80 con 0x7f4758102810 2023-09-21T13:14:49.316 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.324+0000 7f4754ff9700 1 -- 172.21.15.142:0/1727225864 <== mon.2 v2:172.21.15.156:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v118) v1 ==== 169+0+0 (secure 0 0 0) 0x7f474c09d730 con 0x7f4758102810 2023-09-21T13:14:49.320 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 msgr2=0x7f47400a2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 0x7f47400a2c70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4748005950 tx=0x7f474800b410 comp rx=0 tx=0).stop 2023-09-21T13:14:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 msgr2=0x7f4758195210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-21T13:14:49.321 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 0x7f4758195210 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f474c000c00 tx=0x7f474c005dc0 comp rx=0 tx=0).stop 2023-09-21T13:14:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 shutdown_connections 2023-09-21T13:14:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:6800/373173545,v1:172.21.15.142:6801/373173545] conn(0x7f47400a07b0 0x7f47400a2c70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:49.322 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.142:3300/0,v1:172.21.15.142:6789/0] conn(0x7f4758101ef0 0x7f4758194cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f475810b310 0x7f47581985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:49.323 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 --2- 172.21.15.142:0/1727225864 >> [v2:172.21.15.156:3300/0,v1:172.21.15.156:6789/0] conn(0x7f4758102810 0x7f4758195210 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-21T13:14:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.328+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 >> 172.21.15.142:0/1727225864 conn(0x7f47580fb730 msgr2=0x7f475810d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-21T13:14:49.324 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.329+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 shutdown_connections 2023-09-21T13:14:49.325 INFO:teuthology.orchestra.run.smithi142.stderr:2023-09-21T13:14:49.329+0000 7f475dfff700 1 -- 172.21.15.142:0/1727225864 wait complete. 2023-09-21T13:14:49.326 INFO:teuthology.orchestra.run.smithi142.stderr:pool 'cephfs_data' removed 2023-09-21T13:14:49.343 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:14:49.413 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:14:49.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:14:49.518 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-09-21T13:14:49.518 DEBUG:teuthology.orchestra.run.smithi142:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-21T13:14:49.564 DEBUG:teuthology.orchestra.run.smithi156:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-21T13:14:49.581 DEBUG:teuthology.orchestra.run.smithi160:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-21T13:14:49.599 INFO:tasks.cephadm:Stopping all daemons... 2023-09-21T13:14:49.600 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-09-21T13:14:49.600 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a 2023-09-21T13:14:49.648 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:49 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-21T13:14:49.649 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:49 smithi156 ceph-mon[134078]: osdmap e117: 12 total, 12 up, 12 in 2023-09-21T13:14:49.650 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:49 smithi156 ceph-mon[134078]: from='client.? 172.21.15.142:0/1727225864' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.650 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:49 smithi156 ceph-mon[134078]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.651 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:49 smithi156 ceph-mon[134078]: pgmap v591: 65 pgs: 65 active+clean; 345 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T13:14:49.658 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-21T13:14:49.661 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 ceph-mon[97663]: osdmap e117: 12 total, 12 up, 12 in 2023-09-21T13:14:49.662 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 ceph-mon[97663]: from='client.? 172.21.15.142:0/1727225864' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.662 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 ceph-mon[97663]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.662 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 ceph-mon[97663]: pgmap v591: 65 pgs: 65 active+clean; 345 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T13:14:49.680 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:49 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/4279526538' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-21T13:14:49.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:49 smithi160 ceph-mon[134450]: osdmap e117: 12 total, 12 up, 12 in 2023-09-21T13:14:49.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:49 smithi160 ceph-mon[134450]: from='client.? 172.21.15.142:0/1727225864' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:49 smithi160 ceph-mon[134450]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-21T13:14:49.681 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:49 smithi160 ceph-mon[134450]: pgmap v591: 65 pgs: 65 active+clean; 345 MiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-21T13:14:50.152 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:49 smithi142 systemd[1]: Stopping Ceph mon.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:50.407 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a[97638]: 2023-09-21T13:14:50.159+0000 7ff602d32700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:14:50.408 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a[97638]: 2023-09-21T13:14:50.159+0000 7ff602d32700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-09-21T13:14:50.908 INFO:journalctl@ceph.mon.a.smithi142.stdout:Sep 21 13:14:50 smithi142 bash[180753]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-a 2023-09-21T13:14:50.981 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.a.service' 2023-09-21T13:14:51.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:51.111 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-09-21T13:14:51.112 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-09-21T13:14:51.112 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.b 2023-09-21T13:14:51.397 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:51 smithi156 systemd[1]: Stopping Ceph mon.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:51.794 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-b[134054]: 2023-09-21T13:14:51.504+0000 7fcf77ec3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:14:51.795 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-b[134054]: 2023-09-21T13:14:51.504+0000 7fcf77ec3700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-09-21T13:14:52.034 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.b.service' 2023-09-21T13:14:52.060 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:51 smithi156 bash[177958]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-b 2023-09-21T13:14:52.060 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:52 smithi156 systemd[1]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.b.service: Succeeded. 2023-09-21T13:14:52.061 INFO:journalctl@ceph.mon.b.smithi156.stdout:Sep 21 13:14:52 smithi156 systemd[1]: Stopped Ceph mon.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T13:14:52.086 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:52.087 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-09-21T13:14:52.087 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-09-21T13:14:52.088 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.c 2023-09-21T13:14:52.430 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:52 smithi160 systemd[1]: Stopping Ceph mon.c for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:52.831 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-c[134426]: 2023-09-21T13:14:52.486+0000 7fc29f6ac700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:14:52.832 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-c[134426]: 2023-09-21T13:14:52.486+0000 7fc29f6ac700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-09-21T13:14:53.180 INFO:journalctl@ceph.mon.c.smithi160.stdout:Sep 21 13:14:52 smithi160 bash[180841]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mon-c 2023-09-21T13:14:53.213 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mon.c.service' 2023-09-21T13:14:53.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:53.257 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-09-21T13:14:53.258 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-09-21T13:14:53.258 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x 2023-09-21T13:14:53.658 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 13:14:53 smithi142 systemd[1]: Stopping Ceph mgr.x for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:54.050 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 13:14:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T13:14:53.777+0000 7ff165738700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:14:54.050 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 13:14:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x[97906]: 2023-09-21T13:14:53.777+0000 7ff165738700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-09-21T13:14:54.320 INFO:journalctl@ceph.mgr.x.smithi142.stdout:Sep 21 13:14:54 smithi142 bash[180899]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-x 2023-09-21T13:14:54.627 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.x.service' 2023-09-21T13:14:54.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:54.714 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-09-21T13:14:54.715 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-09-21T13:14:54.715 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.y 2023-09-21T13:14:55.145 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 13:14:54 smithi156 systemd[1]: Stopping Ceph mgr.y for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:55.397 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 13:14:55 smithi156 bash[178098]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-y 2023-09-21T13:14:55.609 INFO:journalctl@ceph.mgr.y.smithi156.stdout:Sep 21 13:14:55 smithi156 systemd[1]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-09-21T13:14:55.614 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.y.service' 2023-09-21T13:14:55.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:55.652 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-09-21T13:14:55.653 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-09-21T13:14:55.653 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.z 2023-09-21T13:14:56.094 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 13:14:55 smithi160 systemd[1]: Stopping Ceph mgr.z for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:56.384 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 13:14:56 smithi160 bash[180990]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mgr-z 2023-09-21T13:14:56.563 INFO:journalctl@ceph.mgr.z.smithi160.stdout:Sep 21 13:14:56 smithi160 systemd[1]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-09-21T13:14:56.567 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mgr.z.service' 2023-09-21T13:14:56.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:14:56.606 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-09-21T13:14:56.606 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-09-21T13:14:56.607 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.0 2023-09-21T13:14:57.134 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 13:14:56 smithi142 systemd[1]: Stopping Ceph osd.0 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:14:57.408 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 13:14:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0[115994]: 2023-09-21T13:14:57.140+0000 7f68e86de700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:14:57.409 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 13:14:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0[115994]: 2023-09-21T13:14:57.140+0000 7f68e86de700 -1 osd.0 118 *** Got signal Terminated *** 2023-09-21T13:14:57.409 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 13:14:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0[115994]: 2023-09-21T13:14:57.140+0000 7f68e86de700 -1 osd.0 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:03.409 INFO:journalctl@ceph.osd.0.smithi142.stdout:Sep 21 13:15:03 smithi142 bash[181049]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-0 2023-09-21T13:15:05.133 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.0.service' 2023-09-21T13:15:05.225 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:05.225 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-09-21T13:15:05.226 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-09-21T13:15:05.227 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.1 2023-09-21T13:15:05.577 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 13:15:05 smithi156 systemd[1]: Stopping Ceph osd.1 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:05.898 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 13:15:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T13:15:05.585+0000 7fd6be3a8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:05.898 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 13:15:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T13:15:05.585+0000 7fd6be3a8700 -1 osd.1 118 *** Got signal Terminated *** 2023-09-21T13:15:05.899 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 13:15:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1[139208]: 2023-09-21T13:15:05.585+0000 7fd6be3a8700 -1 osd.1 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:11.649 INFO:journalctl@ceph.osd.1.smithi156.stdout:Sep 21 13:15:11 smithi156 bash[178246]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-1 2023-09-21T13:15:12.772 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.1.service' 2023-09-21T13:15:12.814 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:12.815 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-09-21T13:15:12.816 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-09-21T13:15:12.816 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.2 2023-09-21T13:15:13.177 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 13:15:12 smithi160 systemd[1]: Stopping Ceph osd.2 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:13.430 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 13:15:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T13:15:13.185+0000 7fc02ce0a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:13.431 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 13:15:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T13:15:13.185+0000 7fc02ce0a700 -1 osd.2 118 *** Got signal Terminated *** 2023-09-21T13:15:13.431 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 13:15:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2[140290]: 2023-09-21T13:15:13.185+0000 7fc02ce0a700 -1 osd.2 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:19.180 INFO:journalctl@ceph.osd.2.smithi160.stdout:Sep 21 13:15:18 smithi160 bash[181137]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-2 2023-09-21T13:15:20.318 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.2.service' 2023-09-21T13:15:20.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:20.359 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-09-21T13:15:20.360 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-09-21T13:15:20.360 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.3 2023-09-21T13:15:20.888 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:20 smithi142 systemd[1]: Stopping Ceph osd.3 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:21.158 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:20 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T13:15:20.895+0000 7f9bc184a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:21.159 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:20 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T13:15:20.895+0000 7f9bc184a700 -1 osd.3 118 *** Got signal Terminated *** 2023-09-21T13:15:21.159 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:20 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T13:15:20.895+0000 7f9bc184a700 -1 osd.3 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:24.408 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:24 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T13:15:24.114+0000 7f9bbbe3c700 -1 osd.3 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.288758+0000 front 2023-09-21T13:14:59.288841+0000 (oldest deadline 2023-09-21T13:15:23.388914+0000) 2023-09-21T13:15:25.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:25.090+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:25.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:24.895+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:25.408 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:25 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3[124158]: 2023-09-21T13:15:25.137+0000 7f9bbbe3c700 -1 osd.3 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.288758+0000 front 2023-09-21T13:14:59.288841+0000 (oldest deadline 2023-09-21T13:15:23.388914+0000) 2023-09-21T13:15:26.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:26.051+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:26.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:25.877+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:26.408 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:25 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:25.981+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:26.954 INFO:journalctl@ceph.osd.3.smithi142.stdout:Sep 21 13:15:26 smithi142 bash[181330]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-3 2023-09-21T13:15:26.955 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:26 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:26.711+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:27.182 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:27.018+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:27.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:26.912+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:27.408 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:26 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:26.962+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:27.930 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:27.598+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:27.982 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:27 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:27.729+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:28.337 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:27 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:27.990+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:28.430 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:27.986+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:28.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:27.955+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:28.766 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.3.service' 2023-09-21T13:15:28.857 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:28.858 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-09-21T13:15:28.859 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-09-21T13:15:28.860 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.4 2023-09-21T13:15:28.930 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:28.575+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:28.981 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:28 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:28.735+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:29.147 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:28 smithi156 systemd[1]: Stopping Ceph osd.4 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:29.408 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:28 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:28.990+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:29.430 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:29.018+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:29.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:28.941+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:29.647 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:29 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T13:15:29.224+0000 7fbb31c9f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:29.648 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:29 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T13:15:29.224+0000 7fbb31c9f700 -1 osd.4 118 *** Got signal Terminated *** 2023-09-21T13:15:29.648 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:29 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T13:15:29.224+0000 7fbb31c9f700 -1 osd.4 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:29.886 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:29.545+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:30.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:29 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:29.956+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:30.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:29 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:29.773+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:30.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:30 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:30.046+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:30.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:29 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:29.894+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:30.905 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:30 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:30.549+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:31.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:30 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:30.969+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:31.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:30 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:30.773+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:31.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:31 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:31.031+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:31.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:30 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:30.914+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:31.860 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:31 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:31.504+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:32.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:31.967+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:32.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:31.761+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:32.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:31 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:31.869+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:32.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:32 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:32.010+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:32.898 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:32 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:32.488+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:32.899 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:32 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:32.488+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:33.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:32.804+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:33.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:32.804+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:33.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:32.956+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:33.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:32 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:32.956+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:33.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:32 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:32.964+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:33.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:32 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:32.907+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:33.397 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:33 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4[147269]: 2023-09-21T13:15:33.332+0000 7fbb2c291700 -1 osd.4 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:07.212186+0000 front 2023-09-21T13:15:07.212217+0000 (oldest deadline 2023-09-21T13:15:33.112416+0000) 2023-09-21T13:15:33.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:33 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:33.085+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:33.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:33 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:33.187+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:33.913 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:33 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:33.517+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:33.914 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:33 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:33.517+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:34.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:33.967+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:34.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:33.967+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:34.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:33.761+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:34.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:33 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:33.761+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:34.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:33 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:33.951+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:34.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:33 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:33.922+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:34.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:33 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:33.922+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:34.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:34 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:34.118+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:34.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:34 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:34.140+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:34.867 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:34 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:34.539+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:34.868 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:34 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:34.539+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:35.003 INFO:journalctl@ceph.osd.4.smithi156.stdout:Sep 21 13:15:34 smithi156 bash[178525]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-4 2023-09-21T13:15:35.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:34.767+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:35.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:34.767+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:35.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:34.953+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:35.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:34 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:34.953+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:35.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:34 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:34.902+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:35.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:34 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:34.876+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:35.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:34 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:34.876+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:35.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:35 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:35.146+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:35.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:35 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:35.116+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:35.888 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:35 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:35.525+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:35.889 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:35 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:35.525+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:36.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:35.723+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:36.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:35.723+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:36.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:35.951+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:36.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:35.951+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:36.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:35 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:35.944+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:36.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:35 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:35.897+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:36.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:35 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:35.897+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:36.357 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:36 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:36.101+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:36.357 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:36 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:36.119+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:36.365 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.4.service' 2023-09-21T13:15:36.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:36.407 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-09-21T13:15:36.408 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-09-21T13:15:36.408 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.5 2023-09-21T13:15:36.773 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 systemd[1]: Stopping Ceph osd.5 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:36.773 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:36.533+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:36.774 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:36.533+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:36.774 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:36.781+0000 7f9e7c457700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:37.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:36.970+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:37.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:36.970+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:37.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:36.738+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:37.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:36 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:36.738+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:37.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:36.920+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:37.180 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:36.781+0000 7f9e7c457700 -1 osd.5 118 *** Got signal Terminated *** 2023-09-21T13:15:37.181 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:36.781+0000 7f9e7c457700 -1 osd.5 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:37.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:36.880+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:37.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:36 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:36.880+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:37.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:37 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:37.167+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:37.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:37 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:37.058+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:37.823 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:37.580+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:37.823 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:37.580+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:38.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:37.770+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:38.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:37.770+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:38.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:37.937+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:38.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:37 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:37.937+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:38.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:37.962+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:38.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:37.831+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:38.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:37 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:37.831+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:38.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:38 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:38.118+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:38.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:38 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:38.049+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:38.837 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:38.548+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:38.838 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:38.548+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:39.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:38.786+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:39.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:38.786+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:39.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:38.940+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:39.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:38 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:38.940+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:39.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:38.948+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:39.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:38.846+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:39.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:38 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:38.846+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:39.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:39 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:39.047+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:39.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:39 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:39.070+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:39.879 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:39.552+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:39.880 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:39.552+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:40.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:39.973+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:40.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:39.973+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:40.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:39.756+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:40.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:39.756+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:40.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:39.951+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:40.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:39.888+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:40.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:39.888+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:40.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:39 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:39.888+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:40.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:40 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:40.098+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:40.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:40 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:40.003+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:40.856 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:40.507+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:40.856 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:40.507+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:41.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:40.761+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:41.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:40.761+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:41.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:40.976+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:41.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:40.976+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:41.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:40 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:40.976+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:41.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:40.915+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:41.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:40.865+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:41.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:40.865+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:41.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:40 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:40.865+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:41.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:41 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:41.095+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:41.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:41 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:41.017+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:41.872 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:41.527+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.515035+0000 front 2023-09-21T13:15:01.515012+0000 (oldest deadline 2023-09-21T13:15:26.814857+0000) 2023-09-21T13:15:41.873 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5[148978]: 2023-09-21T13:15:41.527+0000 7f9e76248700 -1 osd.5 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.115921+0000 front 2023-09-21T13:15:09.116062+0000 (oldest deadline 2023-09-21T13:15:32.016032+0000) 2023-09-21T13:15:42.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:41 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:41.945+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:42.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:41 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:41.945+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:42.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:41 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:41.945+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:42.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:41 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:41.731+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:42.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:41 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:41.731+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:42.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:41.887+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:42.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:41.881+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:42.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:41.881+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:42.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:41 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:41.881+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:42.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:41 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:41.983+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:42.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:41 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:41.983+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:42.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:42 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:42.069+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:42.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:42 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:42.069+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:42.680 INFO:journalctl@ceph.osd.5.smithi160.stdout:Sep 21 13:15:42 smithi160 bash[181411]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-5 2023-09-21T13:15:43.090 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:42 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:42.842+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:43.090 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:42 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:42.842+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:43.091 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:42 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:42.904+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:43.091 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:42 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:42.904+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:43.091 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:42 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:42.904+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:43.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:42.899+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:43.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:42.899+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:43.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:42.899+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:43.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:42.738+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:43.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:42.738+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:43.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:43.023+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:43.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:43.023+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:43.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:43.109+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:43.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:43.109+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:43.760 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.5.service' 2023-09-21T13:15:43.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:43.803 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-09-21T13:15:43.804 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-09-21T13:15:43.804 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.6 2023-09-21T13:15:44.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:43.741+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:44.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:43.741+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:44.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:43.741+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:44.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:43.851+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:44.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:43.851+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:44.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:43 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:43.851+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:44.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:43 smithi142 systemd[1]: Stopping Ceph osd.6 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:44.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:43 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:43.822+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:44.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:43 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:43.822+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:44.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:43 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:43.908+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:44.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:43 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:43.908+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:44.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:43 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:43.908+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:44.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:43.993+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:44.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:43 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:43.993+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:44.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:44.153+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:44.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:44.153+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:44.658 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.325+0000 7f4a749de700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:44.659 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.325+0000 7f4a749de700 -1 osd.6 118 *** Got signal Terminated *** 2023-09-21T13:15:44.659 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.325+0000 7f4a749de700 -1 osd.6 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:45.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.819+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:45.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.819+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:45.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:44.819+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:45.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:44.724+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:45.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:44.724+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:45.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:44 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:44.724+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:45.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:44 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:44.826+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:45.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:44 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:44.826+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:45.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:44 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:44.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:45.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:44 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:44.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:45.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:44 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:44.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:45.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:44.969+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:45.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:44.969+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:45.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:45.157+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:45.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:45.157+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:46.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:45.826+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:46.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:45.826+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:46.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:45.826+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:46.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:45.719+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:46.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:45.719+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:46.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:45 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:45.719+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:46.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:45 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:45.832+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:46.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:45 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:45.832+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:46.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:45 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:45.930+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:46.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:45 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:45.930+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:46.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:45 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:45.930+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:46.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:45.952+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:46.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:45 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:45.952+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:46.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:46.124+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:46.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:46.124+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:47.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:46.739+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:47.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:46.739+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:47.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:46.739+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:47.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:46.856+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:47.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:46.856+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:47.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:46 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:46.856+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:47.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:46.847+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:47.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:46.847+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:47.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:46.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:47.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:46.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:47.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:46.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:47.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:46 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:46.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:47.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:46.949+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:47.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:46 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:46.949+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:47.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:47.091+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:47.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:47.091+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:48.158 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:47.895+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:48.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:47.895+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:48.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:47.895+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:48.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:47.895+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.440473+0000 front 2023-09-21T13:15:24.440508+0000 (oldest deadline 2023-09-21T13:15:47.841231+0000) 2023-09-21T13:15:48.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:47.753+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:48.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:47.753+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:48.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:47 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:47.753+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:48.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:47.812+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:48.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:47.812+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:48.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:47.914+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:48.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:47.914+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:48.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:47.914+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:48.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:47 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:47.914+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:48.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:47.958+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:48.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:47.958+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:48.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:47.958+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:48.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:48.105+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:48.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:48.105+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:48.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:48.105+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:49.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:48.732+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:49.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:48.732+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:49.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:48.732+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:49.159 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:48.901+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.931586+0000 front 2023-09-21T13:15:00.931657+0000 (oldest deadline 2023-09-21T13:15:25.031746+0000) 2023-09-21T13:15:49.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:48.901+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.234499+0000 front 2023-09-21T13:15:10.234527+0000 (oldest deadline 2023-09-21T13:15:32.435754+0000) 2023-09-21T13:15:49.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:48.901+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:15.838229+0000 front 2023-09-21T13:15:15.838110+0000 (oldest deadline 2023-09-21T13:15:40.537883+0000) 2023-09-21T13:15:49.160 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:48 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6[132022]: 2023-09-21T13:15:48.901+0000 7f4a6e7cf700 -1 osd.6 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.440473+0000 front 2023-09-21T13:15:24.440508+0000 (oldest deadline 2023-09-21T13:15:47.841231+0000) 2023-09-21T13:15:49.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:48.779+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:49.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:48.779+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:49.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:48.957+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:49.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:48.957+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:49.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:48.957+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:49.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:48 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:48.957+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:49.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:48.925+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:49.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:48.925+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:49.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:48 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:48.925+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:49.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:49.068+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:49.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:49.068+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:49.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:49.068+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:50.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:49.757+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:50.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:49.757+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:50.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:49 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:49.757+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:50.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:49.755+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:50.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:49.755+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:50.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:49.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:50.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:49.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:50.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:49.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:50.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:49 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:49.952+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:50.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:49.913+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:50.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:49.913+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:50.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:49.913+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:50.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:50.040+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:50.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:50.040+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:50.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:50.040+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:50.658 INFO:journalctl@ceph.osd.6.smithi142.stdout:Sep 21 13:15:50 smithi142 bash[181603]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-6 2023-09-21T13:15:51.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:50.746+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:51.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:50.746+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:51.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:50 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:50.746+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:51.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:50.759+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:51.182 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:50.759+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:51.182 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:50.759+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:51.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:50.970+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:51.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:50.970+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:51.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:50.970+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:51.184 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:50 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:50.970+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:51.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:50.917+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:51.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:50.917+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:51.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:50 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:50.917+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:51.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.013+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:51.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.013+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:51.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.013+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:52.005 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:51.734+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:52.005 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:51.734+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:52.006 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:51.734+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:52.006 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:51 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:51.734+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:52.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:51.748+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:52.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:51.748+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:52.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:51.748+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:52.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:51.961+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:52.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:51.961+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:52.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:51.961+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:52.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:51 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:51.961+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:52.291 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.6.service' 2023-09-21T13:15:52.380 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:15:52.381 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-09-21T13:15:52.382 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-09-21T13:15:52.382 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.7 2023-09-21T13:15:52.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:51.954+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:52.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:51.954+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:52.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:51.954+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:52.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.972+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:52.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.972+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:52.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:51 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:51.972+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:52.753 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:52 smithi156 systemd[1]: Stopping Ceph osd.7 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:15:53.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:53.006+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:53.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:53.006+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:53.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:53.006+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:53.148 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:52 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:52.761+0000 7f021ac16700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:15:53.149 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:52 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:52.761+0000 7f021ac16700 -1 osd.7 118 *** Got signal Terminated *** 2023-09-21T13:15:53.149 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:52 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:52.761+0000 7f021ac16700 -1 osd.7 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:15:53.149 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:53.000+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:53.150 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:53.000+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:53.150 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:53 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:53.000+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:53.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:52.713+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:53.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:52.713+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:53.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:52.713+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:53.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:52 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:52.713+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:53.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:52.790+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:53.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:52.790+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:53.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:52.790+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:53.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:52.987+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:53.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:52.987+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:53.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:52.987+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:53.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:52 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:52.987+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:54.025 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:53.773+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:54.026 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:53.773+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:54.026 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:53 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:53.773+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:54.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:53.708+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:54.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:53.708+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:54.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:53.708+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:54.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:53 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:53.708+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:54.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:54.043+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:54.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:54.043+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:54.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:54.043+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:54.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:54.047+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:54.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:54.047+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:54.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:54.047+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:54.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:54.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:54.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:54.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:54.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:54.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:54.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:54.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:54.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:54.660+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:54.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:54.660+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:54.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:54.660+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:54.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:54 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:54.660+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:55.033 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:54.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:55.033 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:54.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:55.033 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:54 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:54.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:55.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:55.061+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:55.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:55.061+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:55.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:55.061+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:55.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:55.077+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:55.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:55.077+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:55.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:55 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:55.077+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:55.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:55.041+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:55.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:55.041+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:55.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:55.041+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:55.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:55.041+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:56.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:55.707+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:56.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:55.707+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:56.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:55.707+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:56.160 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:55 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:55.707+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:56.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:55.801+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:56.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:55.801+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:56.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:55.801+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:56.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:55 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:55.801+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:15:56.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:56.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:56.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:56.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:56.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:56.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:56.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:56.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:56.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:56.034+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:15:56.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:56.080+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:56.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:56.080+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:56.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:56.080+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:56.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:56.030+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:56.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:56.030+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:56.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:56 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:56.030+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:57.071 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:56.754+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:57.072 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:56.754+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:57.072 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:56.754+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:57.073 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:56 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:56.754+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:15:57.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:56 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:56.751+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:57.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:56 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:56.751+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:57.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:56 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:56.751+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:57.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:56 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:56.751+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:57.397 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:57.128+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.877691+0000 front 2023-09-21T13:15:09.877722+0000 (oldest deadline 2023-09-21T13:15:32.777851+0000) 2023-09-21T13:15:57.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:57.128+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:16.279004+0000 front 2023-09-21T13:15:16.279073+0000 (oldest deadline 2023-09-21T13:15:41.578977+0000) 2023-09-21T13:15:57.398 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7[155993]: 2023-09-21T13:15:57.128+0000 7f0214206700 -1 osd.7 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:24.380853+0000 front 2023-09-21T13:15:24.380933+0000 (oldest deadline 2023-09-21T13:15:47.880895+0000) 2023-09-21T13:15:57.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:57.011+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:57.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:57.011+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:57.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:57 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:57.011+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:57.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:57.080+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:57.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:57.080+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:57.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:57.080+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:57.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:57.080+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:57.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:57.080+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:15:58.076 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:57.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:58.076 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:57.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:58.077 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:57.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:58.077 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:57.765+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:15:58.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:57.717+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:58.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:57.717+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:58.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:57.717+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:58.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:57 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:57.717+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:58.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:58 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:58.060+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:58.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:58 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:58.060+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:58.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:58 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:58.060+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:58.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:58 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:58.060+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:15:58.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:58.085+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:58.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:58.085+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:58.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:58.085+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:58.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:58.085+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:58.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:58.085+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:15:58.897 INFO:journalctl@ceph.osd.7.smithi156.stdout:Sep 21 13:15:58 smithi156 bash[178786]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-7 2023-09-21T13:15:59.117 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:58.770+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:15:59.118 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:58.770+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:15:59.118 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:58.770+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:15:59.118 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:58 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:58.770+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:15:59.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:58 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:58.686+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:59.158 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:58 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:58.686+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:59.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:58 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:58.686+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:59.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:58 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:58.686+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:15:59.289 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.017+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:15:59.290 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.017+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:15:59.290 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.017+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:15:59.290 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.017+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:15:59.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:59.126+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:15:59.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:59.126+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:15:59.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:59.126+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:15:59.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:59.126+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:15:59.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:15:59.126+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:15:59.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:59 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:59.644+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:15:59.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:59 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:59.644+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:15:59.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:59 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:59.644+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:15:59.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:15:59 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:15:59.644+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:00.073 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.7.service' 2023-09-21T13:16:00.097 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:59.797+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:00.098 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:59.797+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:00.098 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:59.797+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:00.098 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:15:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:15:59.797+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:00.154 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:00.155 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-09-21T13:16:00.155 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-09-21T13:16:00.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.8 2023-09-21T13:16:00.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.983+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:00.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.983+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:00.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.983+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:00.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:15:59 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:15:59.983+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:00.429 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 systemd[1]: Stopping Ceph osd.8 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:00.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:00.105+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:00.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:00.105+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:00.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:00.105+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:00.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:00.105+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:00.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:00.105+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:00.820 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.527+0000 7f9625e97700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:00.820 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.527+0000 7f9625e97700 -1 osd.8 118 *** Got signal Terminated *** 2023-09-21T13:16:00.821 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.527+0000 7f9625e97700 -1 osd.8 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:16:00.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:00.606+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:00.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:00.606+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:00.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:00.606+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:00.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:00 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:00.606+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:01.074 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.828+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:01.075 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.828+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:01.075 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.828+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:01.075 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:00 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:00.828+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:01.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:01.008+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:01.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:01.008+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:01.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:01.008+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:01.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:01 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:01.008+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:01.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:01.083+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:01.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:01.083+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:01.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:01.083+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:01.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:01.083+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:01.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:01.083+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:01.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:01 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:01.560+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:01.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:01 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:01.560+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:01.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:01 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:01.560+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:01.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:01 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:01.560+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:02.107 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:01.864+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:02.107 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:01.864+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:02.108 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:01.864+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:02.108 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:01 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:01.864+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:02.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.001+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:02.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.001+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:02.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.001+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:02.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.001+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:02.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:02.116+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:02.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:02.116+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:02.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:02.116+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:02.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:02.116+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:02.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:02.116+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:02.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:02 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:02.516+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:02.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:02 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:02.516+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:02.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:02 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:02.516+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:02.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:02 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:02.516+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:03.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:02.908+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:03.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:02.908+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:03.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:02.908+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:03.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:02 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:02.908+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:03.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:03.096+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:03.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:03.096+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:03.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:03.096+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:03.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:03.096+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:03.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:03.096+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:03.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.963+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:03.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.963+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:03.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.963+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:03.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:02 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:02.963+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:03.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:03 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:03.546+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:03.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:03 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:03.546+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:03.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:03 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:03.546+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:03.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:03 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:03.546+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:04.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:03.876+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:04.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:03.876+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:04.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:03.876+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:04.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:03.876+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:04.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:04.088+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:04.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:04.088+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:04.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:04.089+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:04.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:04.089+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:04.183 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:04.089+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:04.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:03 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:03.924+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:04.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:03 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:03.924+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:04.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:03 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:03.924+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:04.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:03 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:03.924+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:04.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:04 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:04.567+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:04.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:04 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:04.567+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:04.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:04 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:04.567+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:04.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:04 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:04.567+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:05.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:04.877+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:01.910877+0000 front 2023-09-21T13:15:01.910712+0000 (oldest deadline 2023-09-21T13:15:24.810617+0000) 2023-09-21T13:16:05.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:04.877+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.712763+0000 front 2023-09-21T13:15:17.712795+0000 (oldest deadline 2023-09-21T13:15:42.412969+0000) 2023-09-21T13:16:05.180 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:04.877+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.214718+0000 front 2023-09-21T13:15:25.214929+0000 (oldest deadline 2023-09-21T13:15:50.514804+0000) 2023-09-21T13:16:05.181 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:04 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8[156876]: 2023-09-21T13:16:04.877+0000 7f961f487700 -1 osd.8 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:32.816228+0000 front 2023-09-21T13:15:32.816066+0000 (oldest deadline 2023-09-21T13:15:55.616680+0000) 2023-09-21T13:16:05.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:05.056+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:05.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:05.056+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:05.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:05.056+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:05.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:05.056+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:05.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:05 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:05.056+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:05.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:04 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:04.937+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:05.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:04 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:04.937+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:05.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:04 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:04.937+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:05.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:04 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:04.937+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:05.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:04 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:04.937+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:05.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:05.584+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:05.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:05.584+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:05.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:05.584+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:05.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:05.584+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:05.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:05 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:05.584+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:06.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:05.905+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:06.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:05.905+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:06.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:05.905+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:06.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:05.905+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:06.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:05 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:05.905+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:06.375 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:06.074+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:06.376 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:06.074+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:06.376 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:06.074+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:06.376 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:06.074+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:06.377 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:06 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:06.074+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:06.679 INFO:journalctl@ceph.osd.8.smithi160.stdout:Sep 21 13:16:06 smithi160 bash[181675]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-8 2023-09-21T13:16:06.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:06.559+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:06.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:06.559+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:06.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:06.559+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:06.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:06.559+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:06.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:06 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:06.559+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:07.319 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:07.319 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:07.320 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:07.320 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:07.320 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:07.320 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:07.063+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:07.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:06.917+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:07.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:06.917+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:07.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:06.917+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:07.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:06.917+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:07.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:06 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:06.917+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:07.651 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.8.service' 2023-09-21T13:16:07.692 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:07.693 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-09-21T13:16:07.693 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-09-21T13:16:07.694 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.9 2023-09-21T13:16:07.778 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:07.536+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:07.779 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:07.536+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:07.779 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:07.536+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:07.779 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:07.536+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:07.780 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:07.536+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:08.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:07.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:08.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:07.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:08.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:07.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:08.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:07.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:08.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:07 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:07.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:08.159 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:07 smithi142 systemd[1]: Stopping Ceph osd.9 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:08.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:08.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:08.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:08.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:08.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:08.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:08 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:08.030+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:08.491 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.212+0000 7f08e6cd6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:08.492 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.212+0000 7f08e6cd6700 -1 osd.9 118 *** Got signal Terminated *** 2023-09-21T13:16:08.492 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.212+0000 7f08e6cd6700 -1 osd.9 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:16:08.492 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.500+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:08.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.500+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:08.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.500+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:08.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.500+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:08.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:08 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:08.500+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:09.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:08.855+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:09.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:08.855+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:09.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:08.855+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:09.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:08.855+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:09.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:08 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:08.855+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:09.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:09.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:09.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:09.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:09.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:09.433 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:09 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:09.019+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:09.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:09.498+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:09.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:09.498+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:09.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:09.498+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:09.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:09.498+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:09.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:09 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:09.498+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:10.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:09.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:10.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:09.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:10.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:09.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:10.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:09.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:10.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:09 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:09.880+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:10.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:10.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:10.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:10.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:10.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:10.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:10 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:10.055+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:10.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:10.472+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:10.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:10.472+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:10.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:10.472+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:10.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:10.472+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:10.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:10 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:10.472+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:11.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:10.889+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:11.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:10.889+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:11.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:10.889+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:11.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:10.889+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:11.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:10 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:10.889+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:11.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:11.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:11.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:11.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:11.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:11.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:11 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:11.007+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:11.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:11.479+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:11.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:11.479+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:11.910 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:11.479+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:11.910 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:11.479+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:11.910 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:11 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:11.479+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:12.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:11.903+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:12.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:11.903+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:12.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:11.903+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:12.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:11.903+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:12.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:11 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:11.903+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:12.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:12.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:12.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:12.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:12.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:12.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:12 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:12.046+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:12.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:15:00.920830+0000 front 2023-09-21T13:15:00.920906+0000 (oldest deadline 2023-09-21T13:15:26.220883+0000) 2023-09-21T13:16:12.908 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.722055+0000 front 2023-09-21T13:15:09.722153+0000 (oldest deadline 2023-09-21T13:15:32.622295+0000) 2023-09-21T13:16:12.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.724765+0000 front 2023-09-21T13:15:17.724916+0000 (oldest deadline 2023-09-21T13:15:43.624833+0000) 2023-09-21T13:16:12.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:23.625438+0000 front 2023-09-21T13:15:23.625308+0000 (oldest deadline 2023-09-21T13:15:51.126585+0000) 2023-09-21T13:16:12.909 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:41.728706+0000 front 2023-09-21T13:15:41.728646+0000 (oldest deadline 2023-09-21T13:16:05.228647+0000) 2023-09-21T13:16:12.910 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:12 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9[140533]: 2023-09-21T13:16:12.464+0000 7f08dfac5700 -1 osd.9 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:45.229189+0000 front 2023-09-21T13:15:45.229247+0000 (oldest deadline 2023-09-21T13:16:11.629764+0000) 2023-09-21T13:16:13.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:13.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:13.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:13.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:13.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:13.150 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:12 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:12.875+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:13.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:13.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:13.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:13.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:13.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:13.432 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:13 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:13.076+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:14.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:14.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:14.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:14.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:14.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:14.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:13 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:13.896+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:14.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:14.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:14.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:14.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:14.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:14.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:14 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:14.031+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:14.658 INFO:journalctl@ceph.osd.9.smithi142.stdout:Sep 21 13:16:14 smithi142 bash[181872]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-9 2023-09-21T13:16:15.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:15.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:15.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:15.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:15.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:15.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:14 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:14.938+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:15.429 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:15.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:15.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:15.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:15.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:15.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.003+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:16.126 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.9.service' 2023-09-21T13:16:16.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:16.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:16.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:16.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:16.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:16.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:15 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:15.894+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:16.216 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:16.216 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-09-21T13:16:16.217 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-09-21T13:16:16.217 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.10 2023-09-21T13:16:16.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:16.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:16.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:16.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:16.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:16.432 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:15 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:15.996+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:16.591 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 systemd[1]: Stopping Ceph osd.10 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:16.897 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.599+0000 7faaaeda2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:16.898 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.599+0000 7faaaeda2700 -1 osd.10 118 *** Got signal Terminated *** 2023-09-21T13:16:16.898 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.599+0000 7faaaeda2700 -1 osd.10 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:16:16.898 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:16.898 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:16.899 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:16.899 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:16.899 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:16.900 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:16 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:16.848+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:17.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:17.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:17.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:17.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:17.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:17.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.017+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:18.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:18.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:18.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:18.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:18.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:18.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:17 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:17.876+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:18.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:18.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:18.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:18.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:18.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:18.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:17 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:17.988+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:19.147 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:19.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:19.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:19.148 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:19.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:19.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:19.149 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:18 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:18.898+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:56.241134+0000 front 2023-09-21T13:15:56.241152+0000 (oldest deadline 2023-09-21T13:16:18.541410+0000) 2023-09-21T13:16:19.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:19.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:19.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:19.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:19.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:19.432 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:18 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:18.973+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:20.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:20.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:20.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:20.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:20.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:20.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:20.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:19 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:19.908+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:56.241134+0000 front 2023-09-21T13:15:56.241152+0000 (oldest deadline 2023-09-21T13:16:18.541410+0000) 2023-09-21T13:16:20.429 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:20.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:20.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:20.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:20.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:20.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:19 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:19.978+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:21.397 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:09.930716+0000 front 2023-09-21T13:15:09.930745+0000 (oldest deadline 2023-09-21T13:15:32.830928+0000) 2023-09-21T13:16:21.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:18.032769+0000 front 2023-09-21T13:15:18.032697+0000 (oldest deadline 2023-09-21T13:15:41.532821+0000) 2023-09-21T13:16:21.398 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:21.533410+0000 front 2023-09-21T13:15:21.533492+0000 (oldest deadline 2023-09-21T13:15:47.934086+0000) 2023-09-21T13:16:21.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.135811+0000 front 2023-09-21T13:15:33.135844+0000 (oldest deadline 2023-09-21T13:15:57.235950+0000) 2023-09-21T13:16:21.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:39.438056+0000 front 2023-09-21T13:15:39.437972+0000 (oldest deadline 2023-09-21T13:16:04.738054+0000) 2023-09-21T13:16:21.399 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.142:6822 osd.6 since back 2023-09-21T13:15:48.139613+0000 front 2023-09-21T13:15:48.139711+0000 (oldest deadline 2023-09-21T13:16:12.239565+0000) 2023-09-21T13:16:21.400 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:20 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10[164090]: 2023-09-21T13:16:20.957+0000 7faaa7390700 -1 osd.10 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:56.241134+0000 front 2023-09-21T13:15:56.241152+0000 (oldest deadline 2023-09-21T13:16:18.541410+0000) 2023-09-21T13:16:21.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:21.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:21.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:21.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:21.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:21.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:20 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:20.945+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:22.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:22.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:22.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:22.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:22.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:22.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:21 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:21.984+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:22.647 INFO:journalctl@ceph.osd.10.smithi156.stdout:Sep 21 13:16:22 smithi156 bash[179063]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-10 2023-09-21T13:16:23.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:23.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:23.430 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:23.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:23.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:23.431 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:23.432 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:22 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:22.963+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:23.779 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.10.service' 2023-09-21T13:16:23.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:23.821 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-09-21T13:16:23.821 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-09-21T13:16:23.822 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.11 2023-09-21T13:16:24.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 systemd[1]: Stopping Ceph osd.11 for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:24.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:24.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:24.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:24.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:24.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:24.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:24.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:23 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:23.920+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:24.679 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.190+0000 7fb0f08ed700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:24.680 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.190+0000 7fb0f08ed700 -1 osd.11 118 *** Got signal Terminated *** 2023-09-21T13:16:24.680 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.190+0000 7fb0f08ed700 -1 osd.11 118 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-21T13:16:25.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:25.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:25.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:25.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:25.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:25.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:25.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:24 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:24.896+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:26.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:26.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:26.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:26.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:26.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:26.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:26.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:25 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:25.878+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:27.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:27.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:27.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:27.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:27.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:27.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:27.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:26 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:26.839+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:28.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:28.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:28.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:28.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:28.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:28.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:28.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:27 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:27.885+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:29.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6806 osd.0 since back 2023-09-21T13:14:59.060453+0000 front 2023-09-21T13:14:59.060716+0000 (oldest deadline 2023-09-21T13:15:24.360620+0000) 2023-09-21T13:16:29.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6804 osd.1 since back 2023-09-21T13:15:10.261874+0000 front 2023-09-21T13:15:10.261711+0000 (oldest deadline 2023-09-21T13:15:33.062464+0000) 2023-09-21T13:16:29.180 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6804 osd.2 since back 2023-09-21T13:15:17.063909+0000 front 2023-09-21T13:15:17.063868+0000 (oldest deadline 2023-09-21T13:15:39.363972+0000) 2023-09-21T13:16:29.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.142:6814 osd.3 since back 2023-09-21T13:15:25.066012+0000 front 2023-09-21T13:15:25.066000+0000 (oldest deadline 2023-09-21T13:15:46.666633+0000) 2023-09-21T13:16:29.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6812 osd.4 since back 2023-09-21T13:15:33.068221+0000 front 2023-09-21T13:15:33.068257+0000 (oldest deadline 2023-09-21T13:15:55.968203+0000) 2023-09-21T13:16:29.181 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.160:6812 osd.5 since back 2023-09-21T13:15:35.968562+0000 front 2023-09-21T13:15:35.968626+0000 (oldest deadline 2023-09-21T13:16:06.569383+0000) 2023-09-21T13:16:29.182 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:28 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11[164864]: 2023-09-21T13:16:28.871+0000 7fb0ea6de700 -1 osd.11 118 heartbeat_check: no reply from 172.21.15.156:6820 osd.7 since back 2023-09-21T13:15:52.370962+0000 front 2023-09-21T13:15:52.370907+0000 (oldest deadline 2023-09-21T13:16:22.371354+0000) 2023-09-21T13:16:29.961 INFO:journalctl@ceph.osd.11.smithi160.stdout:Sep 21 13:16:29 smithi160 bash[181933]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-osd-11 2023-09-21T13:16:31.228 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@osd.11.service' 2023-09-21T13:16:31.269 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:31.269 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-09-21T13:16:31.270 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-09-21T13:16:31.270 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.a 2023-09-21T13:16:31.658 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:16:31 smithi142 systemd[1]: Stopping Ceph mds.a for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:32.158 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:16:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: 2023-09-21T13:16:31.800+0000 7f030c931700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:32.158 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:16:31 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a[149036]: 2023-09-21T13:16:31.800+0000 7f030c931700 -1 mds.a *** got signal Terminated *** 2023-09-21T13:16:34.908 INFO:journalctl@ceph.mds.a.smithi142.stdout:Sep 21 13:16:34 smithi142 bash[182147]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-a 2023-09-21T13:16:35.106 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.a.service' 2023-09-21T13:16:35.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:35.191 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-09-21T13:16:35.192 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-09-21T13:16:35.192 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.d 2023-09-21T13:16:35.408 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 13:16:35 smithi142 systemd[1]: Stopping Ceph mds.d for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:36.158 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 13:16:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-d[148037]: 2023-09-21T13:16:35.699+0000 7fa39ddd4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:36.158 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 13:16:35 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-d[148037]: 2023-09-21T13:16:35.699+0000 7fa39ddd4700 -1 mds.d *** got signal Terminated *** 2023-09-21T13:16:39.158 INFO:journalctl@ceph.mds.d.smithi142.stdout:Sep 21 13:16:38 smithi142 bash[182291]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-d 2023-09-21T13:16:39.248 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.d.service' 2023-09-21T13:16:39.331 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:39.331 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-09-21T13:16:39.332 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-09-21T13:16:39.332 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.g 2023-09-21T13:16:39.658 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 13:16:39 smithi142 systemd[1]: Stopping Ceph mds.g for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:40.158 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 13:16:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-g[148648]: 2023-09-21T13:16:39.848+0000 7f22d14f4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:40.158 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 13:16:39 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-g[148648]: 2023-09-21T13:16:39.848+0000 7f22d14f4700 -1 mds.g *** got signal Terminated *** 2023-09-21T13:16:41.658 INFO:journalctl@ceph.mds.g.smithi142.stdout:Sep 21 13:16:41 smithi142 bash[182436]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-g 2023-09-21T13:16:41.749 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.g.service' 2023-09-21T13:16:41.832 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:41.833 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-09-21T13:16:41.834 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-09-21T13:16:41.834 DEBUG:teuthology.orchestra.run.smithi142:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.j 2023-09-21T13:16:42.158 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:41 smithi142 systemd[1]: Stopping Ceph mds.j for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:42.658 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-j[147647]: 2023-09-21T13:16:42.348+0000 7f7248c36700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:42.658 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:42 smithi142 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-j[147647]: 2023-09-21T13:16:42.348+0000 7f7248c36700 -1 mds.j *** got signal Terminated *** 2023-09-21T13:16:43.850 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:43 smithi142 bash[182578]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-j 2023-09-21T13:16:44.080 DEBUG:teuthology.orchestra.run.smithi142:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.j.service' 2023-09-21T13:16:44.139 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:44 smithi142 systemd[1]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.j.service: Succeeded. 2023-09-21T13:16:44.140 INFO:journalctl@ceph.mds.j.smithi142.stdout:Sep 21 13:16:44 smithi142 systemd[1]: Stopped Ceph mds.j for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da. 2023-09-21T13:16:44.162 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:44.163 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-09-21T13:16:44.163 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-09-21T13:16:44.163 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.b 2023-09-21T13:16:44.528 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:16:44 smithi156 systemd[1]: Stopping Ceph mds.b for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:44.897 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:16:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: 2023-09-21T13:16:44.537+0000 7fcdcb92d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:44.897 INFO:journalctl@ceph.mds.b.smithi156.stdout:Sep 21 13:16:44 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-b[170444]: 2023-09-21T13:16:44.537+0000 7fcdcb92d700 -1 mds.b *** got signal Terminated *** 2023-09-21T13:16:46.870 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.b.service' 2023-09-21T13:16:46.906 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:46.906 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-09-21T13:16:46.907 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-09-21T13:16:46.907 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.e 2023-09-21T13:16:47.293 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 13:16:46 smithi156 systemd[1]: Stopping Ceph mds.e for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:47.647 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 13:16:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-e[169762]: 2023-09-21T13:16:47.302+0000 7fd9fffea700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:47.647 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 13:16:47 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-e[169762]: 2023-09-21T13:16:47.302+0000 7fd9fffea700 -1 mds.e *** got signal Terminated *** 2023-09-21T13:16:49.308 INFO:journalctl@ceph.mds.e.smithi156.stdout:Sep 21 13:16:48 smithi156 bash[179478]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-e 2023-09-21T13:16:49.314 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.e.service' 2023-09-21T13:16:49.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:49.350 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-09-21T13:16:49.351 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-09-21T13:16:49.351 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.h 2023-09-21T13:16:49.647 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:16:49 smithi156 systemd[1]: Stopping Ceph mds.h for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:50.147 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:16:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: 2023-09-21T13:16:49.736+0000 7f5f03af3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:50.147 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:16:49 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h[170105]: 2023-09-21T13:16:49.736+0000 7f5f03af3700 -1 mds.h *** got signal Terminated *** 2023-09-21T13:16:54.147 INFO:journalctl@ceph.mds.h.smithi156.stdout:Sep 21 13:16:53 smithi156 bash[179635]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-h 2023-09-21T13:16:54.212 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.h.service' 2023-09-21T13:16:54.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:54.248 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-09-21T13:16:54.249 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-09-21T13:16:54.249 DEBUG:teuthology.orchestra.run.smithi156:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.k 2023-09-21T13:16:54.634 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 13:16:54 smithi156 systemd[1]: Stopping Ceph mds.k for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:54.897 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 13:16:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-k[169420]: 2023-09-21T13:16:54.643+0000 7f5f948c5700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:54.897 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 13:16:54 smithi156 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-k[169420]: 2023-09-21T13:16:54.643+0000 7f5f948c5700 -1 mds.k *** got signal Terminated *** 2023-09-21T13:16:56.601 INFO:journalctl@ceph.mds.k.smithi156.stdout:Sep 21 13:16:56 smithi156 bash[179783]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-k 2023-09-21T13:16:56.786 DEBUG:teuthology.orchestra.run.smithi156:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.k.service' 2023-09-21T13:16:56.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:56.820 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-09-21T13:16:56.821 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-09-21T13:16:56.821 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.c 2023-09-21T13:16:57.179 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:16:56 smithi160 systemd[1]: Stopping Ceph mds.c for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:57.679 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:16:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: 2023-09-21T13:16:57.193+0000 7fada7cad700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:57.680 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:16:57 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c[171823]: 2023-09-21T13:16:57.193+0000 7fada7cad700 -1 mds.c *** got signal Terminated *** 2023-09-21T13:16:58.841 INFO:journalctl@ceph.mds.c.smithi160.stdout:Sep 21 13:16:58 smithi160 bash[182201]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-c 2023-09-21T13:16:58.847 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.c.service' 2023-09-21T13:16:58.887 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:16:58.887 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-09-21T13:16:58.888 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-09-21T13:16:58.888 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.f 2023-09-21T13:16:59.179 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:16:58 smithi160 systemd[1]: Stopping Ceph mds.f for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:16:59.679 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:16:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: 2023-09-21T13:16:59.267+0000 7fdfbfd71700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:16:59.680 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:16:59 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f[171479]: 2023-09-21T13:16:59.267+0000 7fdfbfd71700 -1 mds.f *** got signal Terminated *** 2023-09-21T13:17:02.679 INFO:journalctl@ceph.mds.f.smithi160.stdout:Sep 21 13:17:02 smithi160 bash[182347]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-f 2023-09-21T13:17:02.819 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.f.service' 2023-09-21T13:17:02.854 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:17:02.854 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-09-21T13:17:02.855 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-09-21T13:17:02.855 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.i 2023-09-21T13:17:03.179 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:17:02 smithi160 systemd[1]: Stopping Ceph mds.i for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:17:03.679 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:17:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: 2023-09-21T13:17:03.249+0000 7fc4f4c3b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:17:03.680 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:17:03 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i[172163]: 2023-09-21T13:17:03.249+0000 7fc4f4c3b700 -1 mds.i *** got signal Terminated *** 2023-09-21T13:17:06.680 INFO:journalctl@ceph.mds.i.smithi160.stdout:Sep 21 13:17:06 smithi160 bash[182486]: ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-i 2023-09-21T13:17:06.891 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.i.service' 2023-09-21T13:17:06.925 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:17:06.926 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-09-21T13:17:06.926 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-09-21T13:17:06.927 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.l 2023-09-21T13:17:07.179 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 13:17:07 smithi160 systemd[1]: Stopping Ceph mds.l for ca3f7e80-587c-11ee-9ab8-7b867c8bd7da... 2023-09-21T13:17:07.679 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 13:17:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-l[171136]: 2023-09-21T13:17:07.315+0000 7ff9f8a57700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-21T13:17:07.680 INFO:journalctl@ceph.mds.l.smithi160.stdout:Sep 21 13:17:07 smithi160 ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da-mds-l[171136]: 2023-09-21T13:17:07.315+0000 7ff9f8a57700 -1 mds.l *** got signal Terminated *** 2023-09-21T13:17:10.668 DEBUG:teuthology.orchestra.run.smithi160:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ca3f7e80-587c-11ee-9ab8-7b867c8bd7da@mds.l.service' 2023-09-21T13:17:10.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-21T13:17:10.702 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-09-21T13:17:10.703 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-21T13:17:11.094 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:17:14.375 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-21T13:17:14.678 INFO:teuthology.orchestra.run.smithi156.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:17:16.222 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-21T13:17:16.525 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:17:18.078 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:17:18.159 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:17:18.196 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-21T13:17:18.227 INFO:tasks.cephadm:Archiving crash dumps... 2023-09-21T13:17:18.229 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi142/crash 2023-09-21T13:17:18.230 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-21T13:17:18.320 INFO:teuthology.orchestra.run.smithi142.stderr:tar: /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-21T13:17:18.320 INFO:teuthology.orchestra.run.smithi142.stderr:tar: Error is not recoverable: exiting now 2023-09-21T13:17:18.323 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi156/crash 2023-09-21T13:17:18.324 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-21T13:17:18.365 INFO:teuthology.orchestra.run.smithi156.stderr:tar: /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-21T13:17:18.366 INFO:teuthology.orchestra.run.smithi156.stderr:tar: Error is not recoverable: exiting now 2023-09-21T13:17:18.367 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi160/crash 2023-09-21T13:17:18.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-21T13:17:18.412 INFO:teuthology.orchestra.run.smithi160.stderr:tar: /var/lib/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-21T13:17:18.413 INFO:teuthology.orchestra.run.smithi160.stderr:tar: Error is not recoverable: exiting now 2023-09-21T13:17:18.414 INFO:tasks.cephadm:Checking cluster log for badness... 2023-09-21T13:17:18.415 DEBUG:teuthology.orchestra.run.smithi142:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-09-21T13:17:18.491 INFO:teuthology.orchestra.run.smithi142.stderr:grep: /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph.log: No such file or directory 2023-09-21T13:17:18.496 INFO:tasks.cephadm:Compressing logs... 2023-09-21T13:17:18.497 DEBUG:teuthology.orchestra.run.smithi142:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-21T13:17:18.502 DEBUG:teuthology.orchestra.run.smithi156:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-21T13:17:18.505 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-21T13:17:18.545 INFO:teuthology.orchestra.run.smithi156.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-21T13:17:18.546 INFO:teuthology.orchestra.run.smithi156.stderr:: No such file or directory 2023-09-21T13:17:18.553 INFO:teuthology.orchestra.run.smithi160.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-21T13:17:18.553 INFO:teuthology.orchestra.run.smithi160.stderr:: No such file or directory 2023-09-21T13:17:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log 2023-09-21T13:17:18.554 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log 2023-09-21T13:17:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log 2023-09-21T13:17:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log 2023-09-21T13:17:18.556 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log 2023-09-21T13:17:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log 2023-09-21T13:17:18.557 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-21T13:17:18.558 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log 2023-09-21T13:17:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log 2023-09-21T13:17:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log 2023-09-21T13:17:18.559 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log: /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log 2023-09-21T13:17:18.560 INFO:teuthology.orchestra.run.smithi156.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log: /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log: 94.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log.gz 2023-09-21T13:17:18.560 INFO:teuthology.orchestra.run.smithi156.stderr: 94.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log.gz 2023-09-21T13:17:18.564 INFO:teuthology.orchestra.run.smithi156.stderr: 92.2% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log.gz 2023-09-21T13:17:18.569 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log 2023-09-21T13:17:18.570 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log 2023-09-21T13:17:18.570 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log 2023-09-21T13:17:18.570 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log 2023-09-21T13:17:18.571 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log 2023-09-21T13:17:18.571 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log 2023-09-21T13:17:18.571 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log 2023-09-21T13:17:18.572 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log 2023-09-21T13:17:18.572 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log 2023-09-21T13:17:18.573 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-21T13:17:18.573 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log 2023-09-21T13:17:18.575 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log: /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log: 94.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log.gz 2023-09-21T13:17:18.577 INFO:teuthology.orchestra.run.smithi160.stderr: 92.3% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log.gz 2023-09-21T13:17:18.583 INFO:teuthology.orchestra.run.smithi142.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-09-21T13:17:18.583 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-21T13:17:18.594 INFO:teuthology.orchestra.run.smithi142.stderr:gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log 2023-09-21T13:17:18.595 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log 2023-09-21T13:17:18.596 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log 2023-09-21T13:17:18.597 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log 2023-09-21T13:17:18.598 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log 2023-09-21T13:17:18.599 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log 2023-09-21T13:17:18.600 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log 2023-09-21T13:17:18.602 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log 2023-09-21T13:17:18.602 INFO:teuthology.orchestra.run.smithi142.stderr: 94.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log.gz 2023-09-21T13:17:18.603 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-21T13:17:18.604 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log 2023-09-21T13:17:18.605 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log 2023-09-21T13:17:18.605 INFO:teuthology.orchestra.run.smithi142.stderr: 94.3% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log.gz 2023-09-21T13:17:18.610 INFO:teuthology.orchestra.run.smithi142.stderr:/var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log: /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log: 94.6% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log.gz 2023-09-21T13:17:18.793 INFO:teuthology.orchestra.run.smithi156.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-21T13:17:18.807 INFO:teuthology.orchestra.run.smithi156.stderr: 91.0% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-21T13:17:18.941 INFO:teuthology.orchestra.run.smithi142.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-21T13:17:19.092 INFO:teuthology.orchestra.run.smithi142.stderr: 91.0% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-21T13:17:19.223 INFO:teuthology.orchestra.run.smithi160.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-21T13:17:19.230 INFO:teuthology.orchestra.run.smithi160.stderr: 91.0% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-21T13:17:19.319 INFO:teuthology.orchestra.run.smithi142.stderr: 89.8% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log.gz 2023-09-21T13:17:20.600 INFO:teuthology.orchestra.run.smithi156.stderr: 91.7% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log.gz 2023-09-21T13:17:20.979 INFO:teuthology.orchestra.run.smithi160.stderr: 91.9% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log.gz 2023-09-21T13:17:21.830 INFO:teuthology.orchestra.run.smithi142.stderr: 92.2% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log.gz 2023-09-21T13:17:37.118 INFO:teuthology.orchestra.run.smithi160.stderr: 95.3% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log.gz 2023-09-21T13:17:39.877 INFO:teuthology.orchestra.run.smithi156.stderr: 95.2% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log.gz 2023-09-21T13:17:40.775 INFO:teuthology.orchestra.run.smithi160.stderr: 95.2% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log.gz 2023-09-21T13:17:59.242 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log.gz 2023-09-21T13:18:01.878 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log.gz 2023-09-21T13:18:03.789 INFO:teuthology.orchestra.run.smithi142.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log.gz 2023-09-21T13:18:08.155 INFO:teuthology.orchestra.run.smithi142.stderr: 91.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log.gz 2023-09-21T13:18:10.921 INFO:teuthology.orchestra.run.smithi142.stderr: 91.2% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log.gz 2023-09-21T13:18:14.398 INFO:teuthology.orchestra.run.smithi156.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log.gz 2023-09-21T13:18:15.478 INFO:teuthology.orchestra.run.smithi160.stderr: 91.4% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log.gz 2023-09-21T13:18:17.011 INFO:teuthology.orchestra.run.smithi160.stderr: 91.0% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log.gz 2023-09-21T13:18:18.456 INFO:teuthology.orchestra.run.smithi156.stderr: 91.5% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log.gz 2023-09-21T13:18:23.152 INFO:teuthology.orchestra.run.smithi156.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log.gz 2023-09-21T13:18:26.095 INFO:teuthology.orchestra.run.smithi160.stderr: 90.9% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log.gz 2023-09-21T13:18:34.135 INFO:teuthology.orchestra.run.smithi156.stderr: 91.1% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log.gz 2023-09-21T13:19:59.593 INFO:teuthology.orchestra.run.smithi142.stderr: 93.8% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log.gz 2023-09-21T13:19:59.596 INFO:teuthology.orchestra.run.smithi142.stderr: 2023-09-21T13:19:59.596 INFO:teuthology.orchestra.run.smithi142.stderr:real 2m41.057s 2023-09-21T13:19:59.596 INFO:teuthology.orchestra.run.smithi142.stderr:user 4m12.716s 2023-09-21T13:19:59.597 INFO:teuthology.orchestra.run.smithi142.stderr:sys 0m24.778s 2023-09-21T13:20:05.139 INFO:teuthology.orchestra.run.smithi160.stderr: 93.3% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log.gz 2023-09-21T13:20:05.161 INFO:teuthology.orchestra.run.smithi160.stderr: 2023-09-21T13:20:05.161 INFO:teuthology.orchestra.run.smithi160.stderr:real 2m46.640s 2023-09-21T13:20:05.162 INFO:teuthology.orchestra.run.smithi160.stderr:user 4m44.957s 2023-09-21T13:20:05.162 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m10.643s 2023-09-21T13:22:03.078 INFO:teuthology.orchestra.run.smithi156.stderr: 93.9% -- replaced with /var/log/ceph/ca3f7e80-587c-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log.gz 2023-09-21T13:22:03.105 INFO:teuthology.orchestra.run.smithi156.stderr: 2023-09-21T13:22:03.105 INFO:teuthology.orchestra.run.smithi156.stderr:real 4m44.580s 2023-09-21T13:22:03.105 INFO:teuthology.orchestra.run.smithi156.stderr:user 5m54.201s 2023-09-21T13:22:03.106 INFO:teuthology.orchestra.run.smithi156.stderr:sys 0m13.577s 2023-09-21T13:22:03.106 INFO:tasks.cephadm:Archiving logs... 2023-09-21T13:22:03.107 DEBUG:teuthology.misc:Transferring archived files from smithi142:/var/log/ceph to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi142/log 2023-09-21T13:22:03.109 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-21T13:22:42.267 DEBUG:teuthology.misc:Transferring archived files from smithi156:/var/log/ceph to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi156/log 2023-09-21T13:22:42.269 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-21T13:23:37.534 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi160/log 2023-09-21T13:23:37.536 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-21T13:24:22.886 INFO:tasks.cephadm:Removing cluster... 2023-09-21T13:24:22.887 DEBUG:teuthology.orchestra.run.smithi142:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force 2023-09-21T13:24:23.329 INFO:teuthology.orchestra.run.smithi142.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:24:24.891 DEBUG:teuthology.orchestra.run.smithi156:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force 2023-09-21T13:24:25.631 INFO:teuthology.orchestra.run.smithi156.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:24:26.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ca3f7e80-587c-11ee-9ab8-7b867c8bd7da --force 2023-09-21T13:24:26.893 INFO:teuthology.orchestra.run.smithi160.stdout:Deleting cluster with fsid: ca3f7e80-587c-11ee-9ab8-7b867c8bd7da 2023-09-21T13:24:27.750 INFO:tasks.cephadm:Removing cephadm ... 2023-09-21T13:24:27.751 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-21T13:24:27.799 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-21T13:24:27.833 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-21T13:24:27.866 INFO:tasks.cephadm:Teardown complete 2023-09-21T13:24:27.867 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-21T13:24:27.880 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-21T13:24:27.881 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-21T13:24:27.886 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-21T13:24:27.889 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-21T13:24:28.047 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-21T13:24:28.058 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-21T13:24:28.059 DEBUG:teuthology.orchestra.run.smithi142:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T13:24:28.064 DEBUG:teuthology.orchestra.run.smithi156:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T13:24:28.068 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-21T13:24:28.084 INFO:teuthology.orchestra.run.smithi156.stderr:bash: ntpq: command not found 2023-09-21T13:24:28.085 INFO:teuthology.orchestra.run.smithi160.stderr:bash: ntpq: command not found 2023-09-21T13:24:28.102 INFO:teuthology.orchestra.run.smithi142.stderr:bash: ntpq: command not found 2023-09-21T13:24:28.104 INFO:teuthology.orchestra.run.smithi156.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T13:24:28.104 INFO:teuthology.orchestra.run.smithi156.stdout:=============================================================================== 2023-09-21T13:24:28.104 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 34 +986us[ +963us] +/- 91ms 2023-09-21T13:24:28.105 INFO:teuthology.orchestra.run.smithi156.stdout:^* hv02.front.sepia.ceph.com 3 6 377 33 -853us[ -876us] +/- 47ms 2023-09-21T13:24:28.105 INFO:teuthology.orchestra.run.smithi156.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +443us[ +443us] +/- 70ms 2023-09-21T13:24:28.105 INFO:teuthology.orchestra.run.smithi156.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T13:24:28.114 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T13:24:28.115 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2023-09-21T13:24:28.115 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 32 +1014us[+1017us] +/- 91ms 2023-09-21T13:24:28.115 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv02.front.sepia.ceph.com 3 6 377 30 -779us[ -776us] +/- 48ms 2023-09-21T13:24:28.116 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +444us[ +444us] +/- 70ms 2023-09-21T13:24:28.116 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T13:24:28.120 INFO:teuthology.orchestra.run.smithi142.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-21T13:24:28.120 INFO:teuthology.orchestra.run.smithi142.stdout:=============================================================================== 2023-09-21T13:24:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +1041us[+1041us] +/- 91ms 2023-09-21T13:24:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:^* hv02.front.sepia.ceph.com 3 6 377 35 -838us[ -835us] +/- 47ms 2023-09-21T13:24:28.121 INFO:teuthology.orchestra.run.smithi142.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +465us[ +468us] +/- 70ms 2023-09-21T13:24:28.122 INFO:teuthology.orchestra.run.smithi142.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-21T13:24:28.123 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-21T13:24:28.134 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-21T13:24:28.135 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-21T13:24:28.148 DEBUG:teuthology.orchestra.run.smithi142:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-21T13:24:28.405 DEBUG:teuthology.orchestra.run.smithi156:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-21T13:24:28.553 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-21T13:24:28.692 DEBUG:teuthology.orchestra.run.smithi142:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T13:24:28.769 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:28.770 DEBUG:teuthology.orchestra.run.smithi156:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T13:24:28.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:28.807 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-21T13:24:28.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:28.841 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-21T13:24:28.860 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-21T13:24:28.876 INFO:teuthology.task.internal:Duration was 3212.918722 seconds 2023-09-21T13:24:28.877 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-21T13:24:28.899 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-21T13:24:28.900 DEBUG:teuthology.orchestra.run.smithi142:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-21T13:24:28.906 DEBUG:teuthology.orchestra.run.smithi156:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-21T13:24:28.909 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-21T13:24:29.001 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T13:24:29.042 INFO:teuthology.orchestra.run.smithi156.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T13:24:29.061 INFO:teuthology.orchestra.run.smithi142.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-21T13:24:29.465 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-21T13:24:29.465 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi142.front.sepia.ceph.com 2023-09-21T13:24:29.466 DEBUG:teuthology.orchestra.run.smithi142:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-21T13:24:29.526 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi156.front.sepia.ceph.com 2023-09-21T13:24:29.527 DEBUG:teuthology.orchestra.run.smithi156:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-21T13:24:29.567 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2023-09-21T13:24:29.568 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-21T13:24:29.606 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-21T13:24:29.606 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-21T13:24:29.611 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-21T13:24:29.614 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-21T13:24:29.714 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-21T13:24:29.715 DEBUG:teuthology.orchestra.run.smithi142:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-21T13:24:29.720 DEBUG:teuthology.orchestra.run.smithi156:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-21T13:24:29.723 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-21T13:24:29.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-21T13:24:29.896 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-21T13:24:29.897 DEBUG:teuthology.orchestra.run.smithi142:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-21T13:24:29.968 DEBUG:teuthology.orchestra.run.smithi156:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-21T13:24:30.003 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-21T13:24:30.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-21T13:24:30.057 DEBUG:teuthology.orchestra.run.smithi142:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.063 DEBUG:teuthology.orchestra.run.smithi156:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.066 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.098 INFO:teuthology.orchestra.run.smithi156.stdout:kernel.core_pattern = core 2023-09-21T13:24:30.122 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2023-09-21T13:24:30.143 INFO:teuthology.orchestra.run.smithi142.stdout:kernel.core_pattern = core 2023-09-21T13:24:30.198 DEBUG:teuthology.orchestra.run.smithi142:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.239 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:30.240 DEBUG:teuthology.orchestra.run.smithi156:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.256 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:30.257 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-21T13:24:30.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-21T13:24:30.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-21T13:24:30.285 INFO:teuthology.task.internal:Transferring archived files... 2023-09-21T13:24:30.287 DEBUG:teuthology.misc:Transferring archived files from smithi142:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi142 2023-09-21T13:24:30.287 DEBUG:teuthology.orchestra.run.smithi142:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-21T13:24:30.373 DEBUG:teuthology.misc:Transferring archived files from smithi156:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi156 2023-09-21T13:24:30.373 DEBUG:teuthology.orchestra.run.smithi156:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-21T13:24:30.417 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862/remote/smithi160 2023-09-21T13:24:30.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-21T13:24:30.461 INFO:teuthology.task.internal:Removing archive directory... 2023-09-21T13:24:30.462 DEBUG:teuthology.orchestra.run.smithi142:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-21T13:24:30.467 DEBUG:teuthology.orchestra.run.smithi156:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-21T13:24:30.469 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-21T13:24:30.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-21T13:24:30.523 INFO:teuthology.task.internal:Not uploading archives. 2023-09-21T13:24:30.524 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-21T13:24:30.538 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-21T13:24:30.539 DEBUG:teuthology.orchestra.run.smithi142:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-21T13:24:30.550 DEBUG:teuthology.orchestra.run.smithi156:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-21T13:24:30.553 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-21T13:24:30.568 INFO:teuthology.orchestra.run.smithi156.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 13:24 /home/ubuntu/cephtest 2023-09-21T13:24:30.569 INFO:teuthology.orchestra.run.smithi160.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 13:24 /home/ubuntu/cephtest 2023-09-21T13:24:30.590 INFO:teuthology.orchestra.run.smithi142.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 13:24 /home/ubuntu/cephtest 2023-09-21T13:24:30.592 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-21T13:24:30.607 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-21T13:24:30.639 INFO:teuthology.nuke:Checking targets against current locks 2023-09-21T13:24:30.672 DEBUG:teuthology.nuke:shortname: smithi142 2023-09-21T13:24:30.673 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:24:30.696 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi142.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.622250', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T13:24:30.702 DEBUG:teuthology.nuke:shortname: smithi156 2023-09-21T13:24:30.702 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:24:30.728 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi156.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.620549', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T13:24:30.730 DEBUG:teuthology.nuke:shortname: smithi160 2023-09-21T13:24:30.730 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-21T13:24:30.759 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2023-09-20_16:32:45-fs-wip-lusov-config-format-distro-default-smithi/7399862', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-21 12:21:52.618630', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-21T13:24:30.766 INFO:teuthology.orchestra.console.smithi142:Power off 2023-09-21T13:24:30.768 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:24:30.794 DEBUG:teuthology.orchestra.console.smithi142:power off output: Chassis Power Control: Down/Off 2023-09-21T13:24:30.795 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:30.813 INFO:teuthology.orchestra.console.smithi156:Power off 2023-09-21T13:24:30.815 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:24:30.829 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-21T13:24:30.840 DEBUG:teuthology.orchestra.console.smithi156:power off output: Chassis Power Control: Down/Off 2023-09-21T13:24:30.840 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:30.858 INFO:teuthology.orchestra.console.smithi160:Power off 2023-09-21T13:24:30.859 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-21T13:24:30.869 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-21T13:24:30.884 DEBUG:teuthology.orchestra.console.smithi160:power off output: Chassis Power Control: Down/Off 2023-09-21T13:24:30.884 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:30.912 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-09-21T13:24:34.831 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:34.871 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:34.914 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:34.942 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is on 2023-09-21T13:24:34.986 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is on 2023-09-21T13:24:35.024 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is on 2023-09-21T13:24:38.946 DEBUG:teuthology.orchestra.console.smithi142:pexpect command: ipmitool -H smithi142.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:38.987 DEBUG:teuthology.orchestra.console.smithi156:pexpect command: ipmitool -H smithi156.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:39.025 DEBUG:teuthology.orchestra.console.smithi160:pexpect command: ipmitool -H smithi160.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-21T13:24:39.056 DEBUG:teuthology.orchestra.console.smithi142:check power output: Chassis Power is off 2023-09-21T13:24:39.098 DEBUG:teuthology.orchestra.console.smithi156:check power output: Chassis Power is off 2023-09-21T13:24:39.136 DEBUG:teuthology.orchestra.console.smithi160:check power output: Chassis Power is off 2023-09-21T13:24:39.158 INFO:teuthology.orchestra.console.smithi142:Power off completed 2023-09-21T13:24:39.199 INFO:teuthology.orchestra.console.smithi156:Power off completed 2023-09-21T13:24:39.237 INFO:teuthology.orchestra.console.smithi160:Power off completed 2023-09-21T13:24:39.344 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/suites/dbench}} duration: 3212.918721675873 failure_reason: 'Command failed (workunit test suites/dbench.sh) on smithi142 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=41c9e835c3f621102ade35dd597317a42116a491 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3371da1716f44c12965f94e5d3f47138 status: fail success: false 2023-09-21T13:24:39.345 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-21T13:24:39.426 INFO:teuthology.run:FAIL